2024-01-31T04:47:54.163 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-01-31T04:47:54.163 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} --owner scheduled_vshankar@teuthology --verbose --archive /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539483 -- /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539483/orig.config.yaml 2024-01-31T04:47:54.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T04:47:54.295 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539483 branch: wip-vshankar-testing-20240125.044502 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7539483' kernel: flavor: default kdb: true sha1: cd42140e628558a450ba1d39a9d0835a2fa62cda ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing-20240125.044502 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 661946e7044723130c03627323f6a879a9848cb5 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 661946e7044723130c03627323f6a879a9848cb5 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240125.044502 sha1: 661946e7044723130c03627323f6a879a9848cb5 owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9619 sha1: 661946e7044723130c03627323f6a879a9848cb5 sleep_before_teardown: 0 subset: 293/1024 suite: fs suite_branch: wip-vshankar-testing-20240125.044502 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 661946e7044723130c03627323f6a879a9848cb5 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPFxmT4wC/zThucb9khkDkUHR3lKlMB/awM8/KXblCtL1201ldkv8uxM3iAzdMJb468Vp9CPethCr0crd0/SJPw= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEupds0LOIiCuVGxS99rzAnFhSRtCQ38YtaVzvSc9IwsznDlXx+gUEfrFIkgXUYMscxQ8OtkQpuwPo7TKEtACqw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: d9fdb2209e15b39d9f061fd85399f352ce0f0894 timestamp: 2024-01-31_04:15:12 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-31T04:47:54.295 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa; will attempt to use it 2024-01-31T04:47:54.295 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks 2024-01-31T04:47:54.296 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-31T04:47:54.297 INFO:teuthology.task.internal:Checking packages... 2024-01-31T04:47:54.324 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '661946e7044723130c03627323f6a879a9848cb5' 2024-01-31T04:47:54.324 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-31T04:47:54.324 INFO:teuthology.packaging:ref: None 2024-01-31T04:47:54.325 INFO:teuthology.packaging:tag: None 2024-01-31T04:47:54.325 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240125.044502 2024-01-31T04:47:54.325 INFO:teuthology.packaging:sha1: 661946e7044723130c03627323f6a879a9848cb5 2024-01-31T04:47:54.325 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing-20240125.044502 2024-01-31T04:47:54.739 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-885-g661946e7-1jammy 2024-01-31T04:47:54.741 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-31T04:47:54.748 INFO:teuthology.task.internal:no buildpackages task found 2024-01-31T04:47:54.748 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-31T04:47:54.757 INFO:teuthology.task.internal:Saving configuration 2024-01-31T04:47:54.773 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-31T04:47:54.779 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-31T04:47:54.806 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539483', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-31 04:40:04.463942', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIB2y/T382P2C8eLmohRpcQqOIwjCDVu7l/+cuCP+2/F4'} 2024-01-31T04:47:54.830 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539483', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-31 04:40:04.462540', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJt5Memf9FLFRxtV5tCLfzuC+CAowR4tplqDaqsZJIdV'} 2024-01-31T04:47:54.831 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-31T04:47:54.836 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-01-31T04:47:54.837 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-01-31T04:47:54.837 INFO:teuthology.run_tasks:Running task console_log... 2024-01-31T04:47:54.904 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f12038364c0>, signals=[15]) 2024-01-31T04:47:54.904 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-31T04:47:54.912 INFO:teuthology.task.internal:Opening connections... 2024-01-31T04:47:54.912 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi049.front.sepia.ceph.com 2024-01-31T04:47:54.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:47:54.999 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2024-01-31T04:47:55.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:47:55.076 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-31T04:47:55.083 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2024-01-31T04:47:55.089 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2024-01-31T04:47:55.089 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-01-31T04:47:55.135 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-31T04:47:55.135 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Ubuntu" 2024-01-31T04:47:55.135 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="22.04" 2024-01-31T04:47:55.135 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-31T04:47:55.135 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_CODENAME=jammy 2024-01-31T04:47:55.135 INFO:teuthology.orchestra.run.smithi049.stdout:ID=ubuntu 2024-01-31T04:47:55.135 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE=debian 2024-01-31T04:47:55.135 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-31T04:47:55.135 INFO:teuthology.orchestra.run.smithi049.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-31T04:47:55.136 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-31T04:47:55.136 INFO:teuthology.orchestra.run.smithi049.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-31T04:47:55.136 INFO:teuthology.orchestra.run.smithi049.stdout:UBUNTU_CODENAME=jammy 2024-01-31T04:47:55.136 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-01-31T04:47:55.160 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-01-31T04:47:55.166 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-01-31T04:47:55.166 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-01-31T04:47:55.212 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-31T04:47:55.212 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Ubuntu" 2024-01-31T04:47:55.212 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="22.04" 2024-01-31T04:47:55.212 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-31T04:47:55.212 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_CODENAME=jammy 2024-01-31T04:47:55.212 INFO:teuthology.orchestra.run.smithi195.stdout:ID=ubuntu 2024-01-31T04:47:55.212 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE=debian 2024-01-31T04:47:55.212 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-31T04:47:55.212 INFO:teuthology.orchestra.run.smithi195.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-31T04:47:55.212 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-31T04:47:55.212 INFO:teuthology.orchestra.run.smithi195.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-31T04:47:55.213 INFO:teuthology.orchestra.run.smithi195.stdout:UBUNTU_CODENAME=jammy 2024-01-31T04:47:55.213 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-01-31T04:47:55.234 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-31T04:47:55.243 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-31T04:47:55.248 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-31T04:47:55.248 DEBUG:teuthology.orchestra.run.smithi049:> test '!' -e /home/ubuntu/cephtest 2024-01-31T04:47:55.251 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2024-01-31T04:47:55.259 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-31T04:47:55.265 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-31T04:47:55.265 DEBUG:teuthology.orchestra.run.smithi049:> test -z $(ls -A /var/lib/ceph) 2024-01-31T04:47:55.296 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2024-01-31T04:47:55.317 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-31T04:47:55.375 INFO:teuthology.run_tasks:Running task kernel... 2024-01-31T04:47:55.389 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'cd42140e628558a450ba1d39a9d0835a2fa62cda'} 2024-01-31T04:47:55.389 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'cd42140e628558a450ba1d39a9d0835a2fa62cda'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'cd42140e628558a450ba1d39a9d0835a2fa62cda'}}, timeout 300 2024-01-31T04:47:55.389 DEBUG:teuthology.orchestra.run.smithi049:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-31T04:47:55.390 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-31T04:47:55.394 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T04:47:55.394 DEBUG:teuthology.task.kernel:sha1 for mon.a is cd42140e628558a450ba1d39a9d0835a2fa62cda 2024-01-31T04:47:55.394 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "cd42140e628558a450ba1d39a9d0835a2fa62cda"... 2024-01-31T04:47:55.395 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-01-31T04:47:55.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T04:47:55.396 DEBUG:teuthology.task.kernel:sha1 for mon.b is cd42140e628558a450ba1d39a9d0835a2fa62cda 2024-01-31T04:47:55.396 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "cd42140e628558a450ba1d39a9d0835a2fa62cda"... 2024-01-31T04:47:55.396 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-01-31T04:47:55.443 INFO:teuthology.orchestra.run.smithi049.stdout:5.15.0-56-generic 2024-01-31T04:47:55.443 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs cd42140e628558a450ba1d39a9d0835a2fa62cda 2024-01-31T04:47:55.443 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-31T04:47:55.444 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd42140e628558a450ba1d39a9d0835a2fa62cda 2024-01-31T04:47:55.447 INFO:teuthology.orchestra.run.smithi195.stdout:5.15.0-56-generic 2024-01-31T04:47:55.447 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs cd42140e628558a450ba1d39a9d0835a2fa62cda 2024-01-31T04:47:55.447 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-31T04:47:55.448 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd42140e628558a450ba1d39a9d0835a2fa62cda 2024-01-31T04:47:55.583 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2024-01-31T04:47:55.583 DEBUG:teuthology.orchestra.run.smithi195:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-01-31T04:47:55.604 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-01-31T04:47:55.741 INFO:teuthology.orchestra.run.smithi195.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-01-31T04:47:55.741 INFO:teuthology.orchestra.run.smithi195.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-01-31T04:47:55.741 INFO:teuthology.orchestra.run.smithi195.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-01-31T04:47:55.742 INFO:teuthology.orchestra.run.smithi195.stderr:hint: 2024-01-31T04:47:55.742 INFO:teuthology.orchestra.run.smithi195.stderr:hint: git config --global init.defaultBranch 2024-01-31T04:47:55.742 INFO:teuthology.orchestra.run.smithi195.stderr:hint: 2024-01-31T04:47:55.742 INFO:teuthology.orchestra.run.smithi195.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-01-31T04:47:55.742 INFO:teuthology.orchestra.run.smithi195.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-01-31T04:47:55.742 INFO:teuthology.orchestra.run.smithi195.stderr:hint: 2024-01-31T04:47:55.742 INFO:teuthology.orchestra.run.smithi195.stderr:hint: git branch -m 2024-01-31T04:47:55.743 INFO:teuthology.orchestra.run.smithi195.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-01-31T04:47:55.745 DEBUG:teuthology.orchestra.run.smithi195:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-01-31T04:47:55.811 DEBUG:teuthology.orchestra.run.smithi195:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-01-31T04:47:55.858 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2024-01-31T04:47:55.858 DEBUG:teuthology.orchestra.run.smithi049:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-01-31T04:47:55.866 DEBUG:teuthology.orchestra.run.smithi195:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-01-31T04:47:55.873 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-01-31T04:47:55.996 INFO:teuthology.orchestra.run.smithi049.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-01-31T04:47:55.996 INFO:teuthology.orchestra.run.smithi049.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-01-31T04:47:55.996 INFO:teuthology.orchestra.run.smithi049.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-01-31T04:47:55.996 INFO:teuthology.orchestra.run.smithi049.stderr:hint: 2024-01-31T04:47:55.996 INFO:teuthology.orchestra.run.smithi049.stderr:hint: git config --global init.defaultBranch 2024-01-31T04:47:55.996 INFO:teuthology.orchestra.run.smithi049.stderr:hint: 2024-01-31T04:47:55.997 INFO:teuthology.orchestra.run.smithi049.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-01-31T04:47:55.997 INFO:teuthology.orchestra.run.smithi049.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-01-31T04:47:55.997 INFO:teuthology.orchestra.run.smithi049.stderr:hint: 2024-01-31T04:47:55.997 INFO:teuthology.orchestra.run.smithi049.stderr:hint: git branch -m 2024-01-31T04:47:55.997 INFO:teuthology.orchestra.run.smithi049.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-01-31T04:47:55.999 DEBUG:teuthology.orchestra.run.smithi049:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-01-31T04:47:56.074 DEBUG:teuthology.orchestra.run.smithi049:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-01-31T04:47:56.127 DEBUG:teuthology.orchestra.run.smithi049:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-01-31T04:49:44.898 INFO:teuthology.orchestra.run.smithi049.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-01-31T04:49:44.898 INFO:teuthology.orchestra.run.smithi049.stderr: * [new branch] main -> origin/main 2024-01-31T04:49:44.932 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190312 -> 20190312 2024-01-31T04:49:44.932 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190416 -> 20190416 2024-01-31T04:49:44.932 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190514 -> 20190514 2024-01-31T04:49:44.932 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190618 -> 20190618 2024-01-31T04:49:44.932 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190717 -> 20190717 2024-01-31T04:49:44.933 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190815 -> 20190815 2024-01-31T04:49:44.933 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20190923 -> 20190923 2024-01-31T04:49:44.933 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20191022 -> 20191022 2024-01-31T04:49:44.935 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20191215 -> 20191215 2024-01-31T04:49:44.935 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200122 -> 20200122 2024-01-31T04:49:44.935 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200316 -> 20200316 2024-01-31T04:49:44.935 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200421 -> 20200421 2024-01-31T04:49:44.935 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200519 -> 20200519 2024-01-31T04:49:44.935 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200619 -> 20200619 2024-01-31T04:49:44.935 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200721 -> 20200721 2024-01-31T04:49:44.935 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200817 -> 20200817 2024-01-31T04:49:44.935 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20200918 -> 20200918 2024-01-31T04:49:44.935 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20201022 -> 20201022 2024-01-31T04:49:44.935 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20201118 -> 20201118 2024-01-31T04:49:44.936 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20201218 -> 20201218 2024-01-31T04:49:44.936 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20210208 -> 20210208 2024-01-31T04:49:44.936 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20210315 -> 20210315 2024-01-31T04:49:44.936 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20210511 -> 20210511 2024-01-31T04:49:44.936 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20210716 -> 20210716 2024-01-31T04:49:44.936 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20210818 -> 20210818 2024-01-31T04:49:44.936 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20210919 -> 20210919 2024-01-31T04:49:44.938 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20211027 -> 20211027 2024-01-31T04:49:44.938 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20211216 -> 20211216 2024-01-31T04:49:44.939 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220209 -> 20220209 2024-01-31T04:49:44.939 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220310 -> 20220310 2024-01-31T04:49:44.939 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220411 -> 20220411 2024-01-31T04:49:44.939 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220509 -> 20220509 2024-01-31T04:49:44.939 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220610 -> 20220610 2024-01-31T04:49:44.939 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220708 -> 20220708 2024-01-31T04:49:44.939 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220815 -> 20220815 2024-01-31T04:49:44.939 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20220913 -> 20220913 2024-01-31T04:49:44.939 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20221012 -> 20221012 2024-01-31T04:49:44.939 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20221109 -> 20221109 2024-01-31T04:49:44.939 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20221214 -> 20221214 2024-01-31T04:49:44.939 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230117 -> 20230117 2024-01-31T04:49:44.939 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230210 -> 20230210 2024-01-31T04:49:44.939 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230310 -> 20230310 2024-01-31T04:49:44.939 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230404 -> 20230404 2024-01-31T04:49:44.940 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230515 -> 20230515 2024-01-31T04:49:44.940 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230625 -> 20230625 2024-01-31T04:49:44.940 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230804 -> 20230804 2024-01-31T04:49:44.940 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20230919 -> 20230919 2024-01-31T04:49:44.940 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20231030 -> 20231030 2024-01-31T04:49:44.940 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20231111 -> 20231111 2024-01-31T04:49:44.940 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20231211 -> 20231211 2024-01-31T04:49:44.940 INFO:teuthology.orchestra.run.smithi049.stderr: * [new tag] 20240115 -> 20240115 2024-01-31T04:49:46.477 INFO:teuthology.orchestra.run.smithi195.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-01-31T04:49:46.477 INFO:teuthology.orchestra.run.smithi195.stderr: * [new branch] main -> origin/main 2024-01-31T04:49:46.509 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190312 -> 20190312 2024-01-31T04:49:46.509 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190416 -> 20190416 2024-01-31T04:49:46.510 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190514 -> 20190514 2024-01-31T04:49:46.510 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190618 -> 20190618 2024-01-31T04:49:46.510 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190717 -> 20190717 2024-01-31T04:49:46.510 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190815 -> 20190815 2024-01-31T04:49:46.510 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190923 -> 20190923 2024-01-31T04:49:46.512 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20191022 -> 20191022 2024-01-31T04:49:46.512 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20191215 -> 20191215 2024-01-31T04:49:46.512 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200122 -> 20200122 2024-01-31T04:49:46.512 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200316 -> 20200316 2024-01-31T04:49:46.512 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200421 -> 20200421 2024-01-31T04:49:46.512 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200519 -> 20200519 2024-01-31T04:49:46.512 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200619 -> 20200619 2024-01-31T04:49:46.512 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200721 -> 20200721 2024-01-31T04:49:46.512 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200817 -> 20200817 2024-01-31T04:49:46.512 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200918 -> 20200918 2024-01-31T04:49:46.513 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20201022 -> 20201022 2024-01-31T04:49:46.513 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20201118 -> 20201118 2024-01-31T04:49:46.513 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20201218 -> 20201218 2024-01-31T04:49:46.513 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210208 -> 20210208 2024-01-31T04:49:46.513 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210315 -> 20210315 2024-01-31T04:49:46.513 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210511 -> 20210511 2024-01-31T04:49:46.513 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210716 -> 20210716 2024-01-31T04:49:46.513 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210818 -> 20210818 2024-01-31T04:49:46.516 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210919 -> 20210919 2024-01-31T04:49:46.516 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20211027 -> 20211027 2024-01-31T04:49:46.516 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20211216 -> 20211216 2024-01-31T04:49:46.516 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220209 -> 20220209 2024-01-31T04:49:46.516 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220310 -> 20220310 2024-01-31T04:49:46.516 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220411 -> 20220411 2024-01-31T04:49:46.516 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220509 -> 20220509 2024-01-31T04:49:46.516 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220610 -> 20220610 2024-01-31T04:49:46.516 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220708 -> 20220708 2024-01-31T04:49:46.516 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220815 -> 20220815 2024-01-31T04:49:46.516 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220913 -> 20220913 2024-01-31T04:49:46.516 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20221012 -> 20221012 2024-01-31T04:49:46.516 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20221109 -> 20221109 2024-01-31T04:49:46.517 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20221214 -> 20221214 2024-01-31T04:49:46.517 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230117 -> 20230117 2024-01-31T04:49:46.517 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230210 -> 20230210 2024-01-31T04:49:46.517 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230310 -> 20230310 2024-01-31T04:49:46.517 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230404 -> 20230404 2024-01-31T04:49:46.517 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230515 -> 20230515 2024-01-31T04:49:46.517 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230625 -> 20230625 2024-01-31T04:49:46.517 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230804 -> 20230804 2024-01-31T04:49:46.517 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230919 -> 20230919 2024-01-31T04:49:46.517 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20231030 -> 20231030 2024-01-31T04:49:46.517 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20231111 -> 20231111 2024-01-31T04:49:46.517 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20231211 -> 20231211 2024-01-31T04:49:46.517 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20240115 -> 20240115 2024-01-31T04:49:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:Updating files: 48% (1722/3543) Updating files: 49% (1737/3543) Updating files: 50% (1772/3543) Updating files: 51% (1807/3543) Updating files: 52% (1843/3543) Updating files: 53% (1878/3543) Updating files: 54% (1914/3543) Updating files: 55% (1949/3543) Updating files: 56% (1985/3543) Updating files: 57% (2020/3543) Updating files: 58% (2055/3543) Updating files: 59% (2091/3543) Updating files: 60% (2126/3543) Updating files: 61% (2162/3543) Updating files: 62% (2197/3543) Updating files: 63% (2233/3543) Updating files: 64% (2268/3543) Updating files: 64% (2277/3543) Updating files: 65% (2303/3543) Updating files: 66% (2339/3543) Updating files: 67% (2374/3543) Updating files: 68% (2410/3543) Updating files: 69% (2445/3543) Updating files: 70% (2481/3543) Updating files: 71% (2516/3543) Updating files: 72% (2551/3543) Updating files: 73% (2587/3543) Updating files: 74% (2622/3543) Updating files: 75% (2658/3543) Updating files: 76% (2693/3543) Updating files: 77% (2729/3543) Updating files: 77% (2734/3543) Updating files: 78% (2764/3543) Updating files: 79% (2799/3543) Updating files: 80% (2835/3543) Updating files: 81% (2870/3543) Updating files: 82% (2906/3543) Updating files: 83% (2941/3543) Updating files: 83% (2974/3543) Updating files: 84% (2977/3543) Updating files: 85% (3012/3543) Updating files: 86% (3047/3543) Updating files: 87% (3083/3543) Updating files: 88% (3118/3543) Updating files: 89% (3154/3543) Updating files: 90% (3189/3543) Updating files: 91% (3225/3543) Updating files: 92% (3260/3543) Updating files: 93% (3295/3543) Updating files: 94% (3331/3543) Updating files: 95% (3366/3543) Updating files: 96% (3402/3543) Updating files: 97% (3437/3543) Updating files: 98% (3473/3543) Updating files: 99% (3508/3543) Updating files: 100% (3543/3543) Updating files: 100% (3543/3543), done. 2024-01-31T04:49:49.255 INFO:teuthology.orchestra.run.smithi049.stdout:HEAD is now at 001ba06d Merge branch 'robot/pr-0-1706638273' into 'main' 2024-01-31T04:49:49.278 INFO:teuthology.task.kernel:Downloading kernel cd42140e628558a450ba1d39a9d0835a2fa62cda on mon.a... 2024-01-31T04:49:49.278 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd42140e628558a450ba1d39a9d0835a2fa62cda 2024-01-31T04:49:49.424 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/cd42140e628558a450ba1d39a9d0835a2fa62cda/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gcd42140e6285/ 2024-01-31T04:49:49.425 DEBUG:teuthology.orchestra.run.smithi049:> rm -f /tmp/linux-image.deb && echo linux-image-6.7.0-gcd42140e6285_6.7.0-gcd42140e6285-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/cd42140e628558a450ba1d39a9d0835a2fa62cda/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gcd42140e6285/ --input-file=- 2024-01-31T04:49:49.427 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi049.front.sepia.ceph.com to complete... 2024-01-31T04:49:50.574 INFO:teuthology.orchestra.run.smithi195.stderr:Updating files: 52% (1843/3543) Updating files: 53% (1878/3543) Updating files: 54% (1914/3543) Updating files: 55% (1949/3543) Updating files: 56% (1985/3543) Updating files: 57% (2020/3543) Updating files: 58% (2055/3543) Updating files: 59% (2091/3543) Updating files: 60% (2126/3543) Updating files: 61% (2162/3543) Updating files: 62% (2197/3543) Updating files: 63% (2233/3543) Updating files: 64% (2268/3543) Updating files: 65% (2303/3543) Updating files: 65% (2338/3543) Updating files: 66% (2339/3543) Updating files: 67% (2374/3543) Updating files: 68% (2410/3543) Updating files: 69% (2445/3543) Updating files: 70% (2481/3543) Updating files: 71% (2516/3543) Updating files: 72% (2551/3543) Updating files: 73% (2587/3543) Updating files: 74% (2622/3543) Updating files: 75% (2658/3543) Updating files: 76% (2693/3543) Updating files: 77% (2729/3543) Updating files: 78% (2764/3543) Updating files: 79% (2799/3543) Updating files: 80% (2835/3543) Updating files: 81% (2870/3543) Updating files: 81% (2903/3543) Updating files: 82% (2906/3543) Updating files: 83% (2941/3543) Updating files: 84% (2977/3543) Updating files: 85% (3012/3543) Updating files: 86% (3047/3543) Updating files: 87% (3083/3543) Updating files: 88% (3118/3543) Updating files: 89% (3154/3543) Updating files: 90% (3189/3543) Updating files: 91% (3225/3543) Updating files: 92% (3260/3543) Updating files: 93% (3295/3543) Updating files: 94% (3331/3543) Updating files: 95% (3366/3543) Updating files: 96% (3402/3543) Updating files: 97% (3437/3543) Updating files: 97% (3442/3543) Updating files: 98% (3473/3543) Updating files: 99% (3508/3543) Updating files: 100% (3543/3543) Updating files: 100% (3543/3543), done. 2024-01-31T04:49:50.579 INFO:teuthology.orchestra.run.smithi195.stdout:HEAD is now at 001ba06d Merge branch 'robot/pr-0-1706638273' into 'main' 2024-01-31T04:49:50.597 INFO:teuthology.task.kernel:Downloading kernel cd42140e628558a450ba1d39a9d0835a2fa62cda on mon.b... 2024-01-31T04:49:50.598 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd42140e628558a450ba1d39a9d0835a2fa62cda 2024-01-31T04:49:50.818 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/cd42140e628558a450ba1d39a9d0835a2fa62cda/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gcd42140e6285/ 2024-01-31T04:49:50.818 DEBUG:teuthology.orchestra.run.smithi195:> rm -f /tmp/linux-image.deb && echo linux-image-6.7.0-gcd42140e6285_6.7.0-gcd42140e6285-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/cd42140e628558a450ba1d39a9d0835a2fa62cda/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gcd42140e6285/ --input-file=- 2024-01-31T04:49:50.821 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi195.front.sepia.ceph.com to complete... 2024-01-31T04:49:50.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31 04:49:50 URL:https://2.chacra.ceph.com/r/kernel/testing/cd42140e628558a450ba1d39a9d0835a2fa62cda/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gcd42140e6285/linux-image-6.7.0-gcd42140e6285_6.7.0-gcd42140e6285-1_amd64.deb [39118482/39118482] -> "/tmp/linux-image.deb" [1] 2024-01-31T04:49:50.930 INFO:teuthology.orchestra.run.smithi049.stderr:FINISHED --2024-01-31 04:49:50-- 2024-01-31T04:49:50.930 INFO:teuthology.orchestra.run.smithi049.stderr:Total wall clock time: 1.5s 2024-01-31T04:49:50.930 INFO:teuthology.orchestra.run.smithi049.stderr:Downloaded: 1 files, 37M in 1.4s (27.6 MB/s) 2024-01-31T04:49:50.935 INFO:teuthology.task.kernel:Installing kernel cd42140e628558a450ba1d39a9d0835a2fa62cda on mon.a... 2024-01-31T04:49:50.935 DEBUG:teuthology.orchestra.run.smithi049:> sudo dpkg -i /tmp/linux-image.deb 2024-01-31T04:49:51.187 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package linux-image-6.7.0-gcd42140e6285. 2024-01-31T04:49:52.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31 04:49:52 URL:https://2.chacra.ceph.com/r/kernel/testing/cd42140e628558a450ba1d39a9d0835a2fa62cda/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gcd42140e6285/linux-image-6.7.0-gcd42140e6285_6.7.0-gcd42140e6285-1_amd64.deb [39118482/39118482] -> "/tmp/linux-image.deb" [1] 2024-01-31T04:49:52.361 INFO:teuthology.orchestra.run.smithi195.stderr:FINISHED --2024-01-31 04:49:52-- 2024-01-31T04:49:52.362 INFO:teuthology.orchestra.run.smithi195.stderr:Total wall clock time: 1.5s 2024-01-31T04:49:52.362 INFO:teuthology.orchestra.run.smithi195.stderr:Downloaded: 1 files, 37M in 1.4s (27.4 MB/s) 2024-01-31T04:49:52.366 INFO:teuthology.task.kernel:Installing kernel cd42140e628558a450ba1d39a9d0835a2fa62cda on mon.b... 2024-01-31T04:49:52.366 DEBUG:teuthology.orchestra.run.smithi195:> sudo dpkg -i /tmp/linux-image.deb 2024-01-31T04:49:52.621 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package linux-image-6.7.0-gcd42140e6285. 2024-01-31T04:49:53.166 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-01-31T04:49:53.171 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-01-31T04:49:53.274 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking linux-image-6.7.0-gcd42140e6285 (6.7.0-gcd42140e6285-1) ... 2024-01-31T04:49:54.732 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-01-31T04:49:54.736 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-01-31T04:49:54.892 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-image-6.7.0-gcd42140e6285 (6.7.0-gcd42140e6285-1) ... 2024-01-31T04:49:56.589 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up linux-image-6.7.0-gcd42140e6285 (6.7.0-gcd42140e6285-1) ... 2024-01-31T04:49:56.676 INFO:teuthology.orchestra.run.smithi049.stderr:update-initramfs: Generating /boot/initrd.img-6.7.0-gcd42140e6285 2024-01-31T04:49:58.439 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-image-6.7.0-gcd42140e6285 (6.7.0-gcd42140e6285-1) ... 2024-01-31T04:49:58.554 INFO:teuthology.orchestra.run.smithi195.stderr:update-initramfs: Generating /boot/initrd.img-6.7.0-gcd42140e6285 2024-01-31T04:50:17.540 INFO:teuthology.orchestra.run.smithi049.stderr:Sourcing file `/etc/default/grub' 2024-01-31T04:50:17.551 INFO:teuthology.orchestra.run.smithi049.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-31T04:50:17.562 INFO:teuthology.orchestra.run.smithi049.stderr:Generating grub configuration file ... 2024-01-31T04:50:17.864 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-6.7.0-gcd42140e6285 2024-01-31T04:50:17.884 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-6.7.0-gcd42140e6285 2024-01-31T04:50:18.156 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-31T04:50:18.162 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-31T04:50:18.217 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-31T04:50:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-31T04:50:18.380 INFO:teuthology.orchestra.run.smithi049.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-31T04:50:18.380 INFO:teuthology.orchestra.run.smithi049.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-31T04:50:18.380 INFO:teuthology.orchestra.run.smithi049.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-31T04:50:18.421 INFO:teuthology.orchestra.run.smithi049.stderr:done 2024-01-31T04:50:18.606 DEBUG:teuthology.orchestra.run.smithi049:> dpkg-deb -c /tmp/linux-image.deb 2024-01-31T04:50:18.614 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./ 2024-01-31T04:50:18.614 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./boot/ 2024-01-31T04:50:18.614 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 4444641 2024-01-25 04:04 ./boot/System.map-6.7.0-gcd42140e6285 2024-01-31T04:50:18.627 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 170149 2024-01-25 04:04 ./boot/config-6.7.0-gcd42140e6285 2024-01-31T04:50:18.627 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11441152 2024-01-25 04:04 ./boot/vmlinuz-6.7.0-gcd42140e6285 2024-01-31T04:50:18.647 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/ 2024-01-31T04:50:18.647 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/ 2024-01-31T04:50:18.647 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/postinst.d/ 2024-01-31T04:50:18.648 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/postrm.d/ 2024-01-31T04:50:18.648 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/preinst.d/ 2024-01-31T04:50:18.648 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/prerm.d/ 2024-01-31T04:50:18.648 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/ 2024-01-31T04:50:18.648 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/ 2024-01-31T04:50:18.648 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/ 2024-01-31T04:50:18.648 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/ 2024-01-31T04:50:18.648 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/ 2024-01-31T04:50:18.648 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/ 2024-01-31T04:50:18.648 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/ 2024-01-31T04:50:18.648 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 490345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/aesni-intel.ko 2024-01-31T04:50:18.651 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-31T04:50:18.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-31T04:50:18.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-31T04:50:18.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 93113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-31T04:50:18.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 106729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-31T04:50:18.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 152241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-31T04:50:18.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-31T04:50:18.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-31T04:50:18.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 83889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-31T04:50:18.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-31T04:50:18.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-31T04:50:18.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-31T04:50:18.652 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-31T04:50:18.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-31T04:50:18.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-31T04:50:18.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-31T04:50:18.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-31T04:50:18.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-31T04:50:18.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-31T04:50:18.653 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/ 2024-01-31T04:50:18.653 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpu/ 2024-01-31T04:50:18.653 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpu/mce/ 2024-01-31T04:50:18.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-31T04:50:18.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpuid.ko 2024-01-31T04:50:18.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/msr.ko 2024-01-31T04:50:18.653 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/ 2024-01-31T04:50:18.653 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 353705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-31T04:50:18.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 881649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-31T04:50:18.654 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 2276625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/kvm.ko 2024-01-31T04:50:18.731 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/ 2024-01-31T04:50:18.731 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/af_alg.ko 2024-01-31T04:50:18.731 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/algif_hash.ko 2024-01-31T04:50:18.731 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/algif_skcipher.ko 2024-01-31T04:50:18.731 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/ansi_cprng.ko 2024-01-31T04:50:18.731 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/anubis.ko 2024-01-31T04:50:18.731 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/arc4.ko 2024-01-31T04:50:18.732 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/asymmetric_keys/ 2024-01-31T04:50:18.732 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-01-31T04:50:18.732 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/ 2024-01-31T04:50:18.732 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_memcpy.ko 2024-01-31T04:50:18.732 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_pq.ko 2024-01-31T04:50:18.732 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-31T04:50:18.732 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_tx.ko 2024-01-31T04:50:18.732 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_xor.ko 2024-01-31T04:50:18.732 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/raid6test.ko 2024-01-31T04:50:18.732 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/authenc.ko 2024-01-31T04:50:18.732 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/authencesn.ko 2024-01-31T04:50:18.732 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/blake2b_generic.ko 2024-01-31T04:50:18.732 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/blowfish_common.ko 2024-01-31T04:50:18.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/blowfish_generic.ko 2024-01-31T04:50:18.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/camellia_generic.ko 2024-01-31T04:50:18.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cast5_generic.ko 2024-01-31T04:50:18.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cast6_generic.ko 2024-01-31T04:50:18.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cast_common.ko 2024-01-31T04:50:18.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/ccm.ko 2024-01-31T04:50:18.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cmac.ko 2024-01-31T04:50:18.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crc32_generic.ko 2024-01-31T04:50:18.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cryptd.ko 2024-01-31T04:50:18.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crypto_engine.ko 2024-01-31T04:50:18.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crypto_simd.ko 2024-01-31T04:50:18.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crypto_user.ko 2024-01-31T04:50:18.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cts.ko 2024-01-31T04:50:18.733 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/des_generic.ko 2024-01-31T04:50:18.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/dh_generic.ko 2024-01-31T04:50:18.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/echainiv.ko 2024-01-31T04:50:18.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/essiv.ko 2024-01-31T04:50:18.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/fcrypt.ko 2024-01-31T04:50:18.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/khazad.ko 2024-01-31T04:50:18.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/lrw.ko 2024-01-31T04:50:18.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/lz4.ko 2024-01-31T04:50:18.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/lz4hc.ko 2024-01-31T04:50:18.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/md4.ko 2024-01-31T04:50:18.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/michael_mic.ko 2024-01-31T04:50:18.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/pcbc.ko 2024-01-31T04:50:18.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/pcrypt.ko 2024-01-31T04:50:18.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/rmd160.ko 2024-01-31T04:50:18.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/seed.ko 2024-01-31T04:50:18.734 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/serpent_generic.ko 2024-01-31T04:50:18.735 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 149481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/tcrypt.ko 2024-01-31T04:50:18.735 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/tea.ko 2024-01-31T04:50:18.735 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/twofish_common.ko 2024-01-31T04:50:18.735 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/twofish_generic.ko 2024-01-31T04:50:18.735 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/vmac.ko 2024-01-31T04:50:18.735 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/wp512.ko 2024-01-31T04:50:18.735 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xcbc.ko 2024-01-31T04:50:18.735 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xor.ko 2024-01-31T04:50:18.735 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xts.ko 2024-01-31T04:50:18.735 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xxhash_generic.ko 2024-01-31T04:50:18.735 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ 2024-01-31T04:50:18.735 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/ 2024-01-31T04:50:18.735 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/acpi_extlog.ko 2024-01-31T04:50:18.735 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-31T04:50:18.735 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/acpi_pad.ko 2024-01-31T04:50:18.736 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/apei/ 2024-01-31T04:50:18.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/apei/einj.ko 2024-01-31T04:50:18.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/ec_sys.ko 2024-01-31T04:50:18.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/platform_profile.ko 2024-01-31T04:50:18.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/sbs.ko 2024-01-31T04:50:18.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/sbshc.ko 2024-01-31T04:50:18.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 104729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/video.ko 2024-01-31T04:50:18.736 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/ 2024-01-31T04:50:18.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/acard-ahci.ko 2024-01-31T04:50:18.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/ahci.ko 2024-01-31T04:50:18.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/ahci_platform.ko 2024-01-31T04:50:18.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 88401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/libahci.ko 2024-01-31T04:50:18.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/libahci_platform.ko 2024-01-31T04:50:18.736 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_acpi.ko 2024-01-31T04:50:18.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ali.ko 2024-01-31T04:50:18.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_amd.ko 2024-01-31T04:50:18.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_artop.ko 2024-01-31T04:50:18.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_atiixp.ko 2024-01-31T04:50:18.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_atp867x.ko 2024-01-31T04:50:18.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_cmd640.ko 2024-01-31T04:50:18.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_cmd64x.ko 2024-01-31T04:50:18.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_cypress.ko 2024-01-31T04:50:18.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_efar.ko 2024-01-31T04:50:18.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt366.ko 2024-01-31T04:50:18.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt37x.ko 2024-01-31T04:50:18.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-31T04:50:18.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-31T04:50:18.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_it8213.ko 2024-01-31T04:50:18.737 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_it821x.ko 2024-01-31T04:50:18.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_jmicron.ko 2024-01-31T04:50:18.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_legacy.ko 2024-01-31T04:50:18.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_marvell.ko 2024-01-31T04:50:18.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_mpiix.ko 2024-01-31T04:50:18.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_netcell.ko 2024-01-31T04:50:18.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ninja32.ko 2024-01-31T04:50:18.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ns87410.ko 2024-01-31T04:50:18.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ns87415.ko 2024-01-31T04:50:18.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_oldpiix.ko 2024-01-31T04:50:18.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_opti.ko 2024-01-31T04:50:18.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_optidma.ko 2024-01-31T04:50:18.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_pcmcia.ko 2024-01-31T04:50:18.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-31T04:50:18.738 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-31T04:50:18.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_piccolo.ko 2024-01-31T04:50:18.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_radisys.ko 2024-01-31T04:50:18.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_rdc.ko 2024-01-31T04:50:18.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_rz1000.ko 2024-01-31T04:50:18.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_sch.ko 2024-01-31T04:50:18.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_serverworks.ko 2024-01-31T04:50:18.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_sil680.ko 2024-01-31T04:50:18.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_sl82c105.ko 2024-01-31T04:50:18.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_triflex.ko 2024-01-31T04:50:18.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_via.ko 2024-01-31T04:50:18.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pdc_adma.ko 2024-01-31T04:50:18.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_inic162x.ko 2024-01-31T04:50:18.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 83345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_mv.ko 2024-01-31T04:50:18.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_nv.ko 2024-01-31T04:50:18.739 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_promise.ko 2024-01-31T04:50:18.740 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_qstor.ko 2024-01-31T04:50:18.740 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sil.ko 2024-01-31T04:50:18.740 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sil24.ko 2024-01-31T04:50:18.740 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sis.ko 2024-01-31T04:50:18.740 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_svw.ko 2024-01-31T04:50:18.740 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sx4.ko 2024-01-31T04:50:18.740 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_uli.ko 2024-01-31T04:50:18.740 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_via.ko 2024-01-31T04:50:18.740 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_vsc.ko 2024-01-31T04:50:18.740 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/auxdisplay/ 2024-01-31T04:50:18.740 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/auxdisplay/ks0108.ko 2024-01-31T04:50:18.740 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/bcma/ 2024-01-31T04:50:18.740 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 124473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/bcma/bcma.ko 2024-01-31T04:50:18.740 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/ 2024-01-31T04:50:18.741 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/aoe/ 2024-01-31T04:50:18.741 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 113753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/aoe/aoe.ko 2024-01-31T04:50:18.741 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/drbd/ 2024-01-31T04:50:18.741 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 965305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/drbd/drbd.ko 2024-01-31T04:50:18.741 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 173353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/floppy.ko 2024-01-31T04:50:18.741 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/mtip32xx/ 2024-01-31T04:50:18.741 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 94297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-31T04:50:18.741 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 116321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/nbd.ko 2024-01-31T04:50:18.741 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/null_blk/ 2024-01-31T04:50:18.741 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 110737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/null_blk/null_blk.ko 2024-01-31T04:50:18.741 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 98281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/pktcdvd.ko 2024-01-31T04:50:18.741 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 263769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/rbd.ko 2024-01-31T04:50:18.741 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/xen-blkback/ 2024-01-31T04:50:18.741 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 98185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-31T04:50:18.742 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/zram/ 2024-01-31T04:50:18.742 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/zram/zram.ko 2024-01-31T04:50:18.742 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ 2024-01-31T04:50:18.742 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/applicom.ko 2024-01-31T04:50:18.742 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hangcheck-timer.ko 2024-01-31T04:50:18.742 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/ 2024-01-31T04:50:18.742 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-31T04:50:18.742 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-31T04:50:18.742 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-31T04:50:18.742 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/via-rng.ko 2024-01-31T04:50:18.742 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-31T04:50:18.742 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ 2024-01-31T04:50:18.742 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-31T04:50:18.742 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 148609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-31T04:50:18.742 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-31T04:50:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 139313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-31T04:50:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-31T04:50:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-31T04:50:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/lp.ko 2024-01-31T04:50:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/mwave/ 2024-01-31T04:50:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 84097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/mwave/mwave.ko 2024-01-31T04:50:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/nvram.ko 2024-01-31T04:50:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ppdev.ko 2024-01-31T04:50:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tlclk.ko 2024-01-31T04:50:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/ 2024-01-31T04:50:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-31T04:50:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-01-31T04:50:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-01-31T04:50:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-01-31T04:50:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-31T04:50:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-31T04:50:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-01-31T04:50:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/ 2024-01-31T04:50:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/xillybus_class.ko 2024-01-31T04:50:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/xillybus_core.ko 2024-01-31T04:50:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-01-31T04:50:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/ 2024-01-31T04:50:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-palmas.ko 2024-01-31T04:50:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-si5351.ko 2024-01-31T04:50:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-twl6040.ko 2024-01-31T04:50:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-wm831x.ko 2024-01-31T04:50:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/ 2024-01-31T04:50:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-31T04:50:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-31T04:50:18.745 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-31T04:50:18.745 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ 2024-01-31T04:50:18.745 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ccp/ 2024-01-31T04:50:18.745 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-31T04:50:18.745 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 246841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ccp/ccp.ko 2024-01-31T04:50:18.745 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/ 2024-01-31T04:50:18.745 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/ 2024-01-31T04:50:18.745 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_common/ 2024-01-31T04:50:18.745 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 517033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-31T04:50:18.745 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-01-31T04:50:18.745 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-31T04:50:18.745 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/padlock-aes.ko 2024-01-31T04:50:18.745 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/padlock-sha.ko 2024-01-31T04:50:18.745 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/virtio/ 2024-01-31T04:50:18.746 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-31T04:50:18.746 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dca/ 2024-01-31T04:50:18.746 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dca/dca.ko 2024-01-31T04:50:18.746 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/ 2024-01-31T04:50:18.746 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/dw/ 2024-01-31T04:50:18.746 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-31T04:50:18.746 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/ioat/ 2024-01-31T04:50:18.746 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 122569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-31T04:50:18.746 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/ 2024-01-31T04:50:18.746 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 79953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/amd64_edac.ko 2024-01-31T04:50:18.746 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/e752x_edac.ko 2024-01-31T04:50:18.746 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 63617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/edac_mce_amd.ko 2024-01-31T04:50:18.746 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i3000_edac.ko 2024-01-31T04:50:18.746 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i3200_edac.ko 2024-01-31T04:50:18.746 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i5100_edac.ko 2024-01-31T04:50:18.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i5400_edac.ko 2024-01-31T04:50:18.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i7300_edac.ko 2024-01-31T04:50:18.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i7core_edac.ko 2024-01-31T04:50:18.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i82975x_edac.ko 2024-01-31T04:50:18.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/ie31200_edac.ko 2024-01-31T04:50:18.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/sb_edac.ko 2024-01-31T04:50:18.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/x38_edac.ko 2024-01-31T04:50:18.747 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/ 2024-01-31T04:50:18.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-gpio.ko 2024-01-31T04:50:18.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-max14577.ko 2024-01-31T04:50:18.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-max77693.ko 2024-01-31T04:50:18.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-max8997.ko 2024-01-31T04:50:18.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-palmas.ko 2024-01-31T04:50:18.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-rt8973a.ko 2024-01-31T04:50:18.747 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-sm5502.ko 2024-01-31T04:50:18.748 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/ 2024-01-31T04:50:18.748 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/dmi-sysfs.ko 2024-01-31T04:50:18.748 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/efi/ 2024-01-31T04:50:18.748 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/efi/efi-pstore.ko 2024-01-31T04:50:18.748 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-31T04:50:18.748 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/ 2024-01-31T04:50:18.748 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-adp5520.ko 2024-01-31T04:50:18.748 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-amd8111.ko 2024-01-31T04:50:18.748 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-arizona.ko 2024-01-31T04:50:18.748 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-da9052.ko 2024-01-31T04:50:18.748 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-da9055.ko 2024-01-31T04:50:18.748 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-dln2.ko 2024-01-31T04:50:18.748 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 77849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-f7188x.ko 2024-01-31T04:50:18.748 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-generic.ko 2024-01-31T04:50:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-ich.ko 2024-01-31T04:50:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-01-31T04:50:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-kempld.ko 2024-01-31T04:50:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-lp3943.ko 2024-01-31T04:50:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-max7300.ko 2024-01-31T04:50:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-max730x.ko 2024-01-31T04:50:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-max732x.ko 2024-01-31T04:50:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-01-31T04:50:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-pca953x.ko 2024-01-31T04:50:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-pcf857x.ko 2024-01-31T04:50:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-rdc321x.ko 2024-01-31T04:50:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-sch.ko 2024-01-31T04:50:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-sch311x.ko 2024-01-31T04:50:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-tps65912.ko 2024-01-31T04:50:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-twl4030.ko 2024-01-31T04:50:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-twl6040.ko 2024-01-31T04:50:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-31T04:50:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-vx855.ko 2024-01-31T04:50:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-wm831x.ko 2024-01-31T04:50:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-wm8350.ko 2024-01-31T04:50:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-wm8994.ko 2024-01-31T04:50:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/ 2024-01-31T04:50:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-a4tech.ko 2024-01-31T04:50:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-apple.ko 2024-01-31T04:50:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-appleir.ko 2024-01-31T04:50:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-aureal.ko 2024-01-31T04:50:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-axff.ko 2024-01-31T04:50:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-belkin.ko 2024-01-31T04:50:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-cherry.ko 2024-01-31T04:50:18.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-chicony.ko 2024-01-31T04:50:18.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-cp2112.ko 2024-01-31T04:50:18.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-cypress.ko 2024-01-31T04:50:18.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-dr.ko 2024-01-31T04:50:18.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-elecom.ko 2024-01-31T04:50:18.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-elo.ko 2024-01-31T04:50:18.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-emsff.ko 2024-01-31T04:50:18.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-ezkey.ko 2024-01-31T04:50:18.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-gaff.ko 2024-01-31T04:50:18.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-generic.ko 2024-01-31T04:50:18.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-gt683r.ko 2024-01-31T04:50:18.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-gyration.ko 2024-01-31T04:50:18.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-31T04:50:18.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-31T04:50:18.751 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-holtekff.ko 2024-01-31T04:50:18.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-hyperv.ko 2024-01-31T04:50:18.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-icade.ko 2024-01-31T04:50:18.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-kensington.ko 2024-01-31T04:50:18.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-keytouch.ko 2024-01-31T04:50:18.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-kye.ko 2024-01-31T04:50:18.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-lcpower.ko 2024-01-31T04:50:18.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-led.ko 2024-01-31T04:50:18.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-lenovo.ko 2024-01-31T04:50:18.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-lg-g15.ko 2024-01-31T04:50:18.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-31T04:50:18.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-31T04:50:18.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 80993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-logitech.ko 2024-01-31T04:50:18.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-magicmouse.ko 2024-01-31T04:50:18.752 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-microsoft.ko 2024-01-31T04:50:18.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-monterey.ko 2024-01-31T04:50:18.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-multitouch.ko 2024-01-31T04:50:18.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-ntrig.ko 2024-01-31T04:50:18.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-ortek.ko 2024-01-31T04:50:18.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-penmount.ko 2024-01-31T04:50:18.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-petalynx.ko 2024-01-31T04:50:18.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 72937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-picolcd.ko 2024-01-31T04:50:18.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-pl.ko 2024-01-31T04:50:18.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-plantronics.ko 2024-01-31T04:50:18.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-primax.ko 2024-01-31T04:50:18.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-rmi.ko 2024-01-31T04:50:18.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-31T04:50:18.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-common.ko 2024-01-31T04:50:18.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-31T04:50:18.753 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-31T04:50:18.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-31T04:50:18.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-31T04:50:18.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-31T04:50:18.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-31T04:50:18.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-31T04:50:18.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-31T04:50:18.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-31T04:50:18.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat.ko 2024-01-31T04:50:18.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-saitek.ko 2024-01-31T04:50:18.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-samsung.ko 2024-01-31T04:50:18.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-31T04:50:18.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sjoy.ko 2024-01-31T04:50:18.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sony.ko 2024-01-31T04:50:18.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-speedlink.ko 2024-01-31T04:50:18.754 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-steelseries.ko 2024-01-31T04:50:18.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sunplus.ko 2024-01-31T04:50:18.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-31T04:50:18.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-tivo.ko 2024-01-31T04:50:18.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-tmff.ko 2024-01-31T04:50:18.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-topseed.ko 2024-01-31T04:50:18.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-twinhan.ko 2024-01-31T04:50:18.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 71073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-uclogic.ko 2024-01-31T04:50:18.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-waltop.ko 2024-01-31T04:50:18.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 143473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-wiimote.ko 2024-01-31T04:50:18.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-xinmo.ko 2024-01-31T04:50:18.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-zpff.ko 2024-01-31T04:50:18.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-zydacron.ko 2024-01-31T04:50:18.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 269281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid.ko 2024-01-31T04:50:18.755 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/uhid.ko 2024-01-31T04:50:18.755 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/ 2024-01-31T04:50:18.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 125785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/usbhid.ko 2024-01-31T04:50:18.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/usbkbd.ko 2024-01-31T04:50:18.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/usbmouse.ko 2024-01-31T04:50:18.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 217873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/wacom.ko 2024-01-31T04:50:18.756 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/ 2024-01-31T04:50:18.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 64201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/hv_balloon.ko 2024-01-31T04:50:18.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/hv_utils.ko 2024-01-31T04:50:18.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 305321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/hv_vmbus.ko 2024-01-31T04:50:18.756 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ 2024-01-31T04:50:18.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/abituguru.ko 2024-01-31T04:50:18.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/abituguru3.ko 2024-01-31T04:50:18.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-31T04:50:18.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ad7414.ko 2024-01-31T04:50:18.756 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ad7418.ko 2024-01-31T04:50:18.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adc128d818.ko 2024-01-31T04:50:18.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1025.ko 2024-01-31T04:50:18.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 97977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1026.ko 2024-01-31T04:50:18.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1029.ko 2024-01-31T04:50:18.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1031.ko 2024-01-31T04:50:18.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm9240.ko 2024-01-31T04:50:18.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ads7828.ko 2024-01-31T04:50:18.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7410.ko 2024-01-31T04:50:18.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7411.ko 2024-01-31T04:50:18.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 74409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7462.ko 2024-01-31T04:50:18.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7470.ko 2024-01-31T04:50:18.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7475.ko 2024-01-31T04:50:18.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7x10.ko 2024-01-31T04:50:18.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/amc6821.ko 2024-01-31T04:50:18.757 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 55201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/applesmc.ko 2024-01-31T04:50:18.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/asb100.ko 2024-01-31T04:50:18.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/asc7621.ko 2024-01-31T04:50:18.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-31T04:50:18.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/atxp1.ko 2024-01-31T04:50:18.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/coretemp.ko 2024-01-31T04:50:18.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/da9052-hwmon.ko 2024-01-31T04:50:18.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/da9055-hwmon.ko 2024-01-31T04:50:18.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-31T04:50:18.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 99601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/dme1737.ko 2024-01-31T04:50:18.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ds1621.ko 2024-01-31T04:50:18.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ds620.ko 2024-01-31T04:50:18.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/emc1403.ko 2024-01-31T04:50:18.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/emc2103.ko 2024-01-31T04:50:18.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/emc6w201.ko 2024-01-31T04:50:18.758 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/f71805f.ko 2024-01-31T04:50:18.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 94689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/f71882fg.ko 2024-01-31T04:50:18.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/f75375s.ko 2024-01-31T04:50:18.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/fam15h_power.ko 2024-01-31T04:50:18.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 55449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/fschmd.ko 2024-01-31T04:50:18.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/g760a.ko 2024-01-31T04:50:18.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/g762.ko 2024-01-31T04:50:18.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/gl518sm.ko 2024-01-31T04:50:18.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/gl520sm.ko 2024-01-31T04:50:18.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/hih6130.ko 2024-01-31T04:50:18.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-31T04:50:18.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/i5500_temp.ko 2024-01-31T04:50:18.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/i5k_amb.ko 2024-01-31T04:50:18.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ibmaem.ko 2024-01-31T04:50:18.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ibmpex.ko 2024-01-31T04:50:18.759 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ina209.ko 2024-01-31T04:50:18.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ina2xx.ko 2024-01-31T04:50:18.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 130449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/it87.ko 2024-01-31T04:50:18.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/jc42.ko 2024-01-31T04:50:18.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/k10temp.ko 2024-01-31T04:50:18.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/k8temp.ko 2024-01-31T04:50:18.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lineage-pem.ko 2024-01-31T04:50:18.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm63.ko 2024-01-31T04:50:18.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm73.ko 2024-01-31T04:50:18.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm75.ko 2024-01-31T04:50:18.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm77.ko 2024-01-31T04:50:18.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm78.ko 2024-01-31T04:50:18.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm80.ko 2024-01-31T04:50:18.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm83.ko 2024-01-31T04:50:18.760 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 72833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm85.ko 2024-01-31T04:50:18.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm87.ko 2024-01-31T04:50:18.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm90.ko 2024-01-31T04:50:18.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm92.ko 2024-01-31T04:50:18.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 108841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm93.ko 2024-01-31T04:50:18.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm95234.ko 2024-01-31T04:50:18.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm95241.ko 2024-01-31T04:50:18.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm95245.ko 2024-01-31T04:50:18.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc2945.ko 2024-01-31T04:50:18.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4151.ko 2024-01-31T04:50:18.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4215.ko 2024-01-31T04:50:18.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4222.ko 2024-01-31T04:50:18.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4245.ko 2024-01-31T04:50:18.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4260.ko 2024-01-31T04:50:18.761 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4261.ko 2024-01-31T04:50:18.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max16065.ko 2024-01-31T04:50:18.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max1619.ko 2024-01-31T04:50:18.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max1668.ko 2024-01-31T04:50:18.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max197.ko 2024-01-31T04:50:18.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max6639.ko 2024-01-31T04:50:18.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max6650.ko 2024-01-31T04:50:18.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max6697.ko 2024-01-31T04:50:18.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/mc13783-adc.ko 2024-01-31T04:50:18.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/mcp3021.ko 2024-01-31T04:50:18.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-01-31T04:50:18.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct6683.ko 2024-01-31T04:50:18.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 119689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct6775-core.ko 2024-01-31T04:50:18.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct6775.ko 2024-01-31T04:50:18.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct7802.ko 2024-01-31T04:50:18.762 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 82337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pc87360.ko 2024-01-31T04:50:18.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pc87427.ko 2024-01-31T04:50:18.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pcf8591.ko 2024-01-31T04:50:18.763 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ 2024-01-31T04:50:18.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-31T04:50:18.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-31T04:50:18.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-31T04:50:18.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-31T04:50:18.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-31T04:50:18.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-31T04:50:18.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-31T04:50:18.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 82577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-31T04:50:18.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-31T04:50:18.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-31T04:50:18.763 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-31T04:50:18.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-31T04:50:18.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/powr1220.ko 2024-01-31T04:50:18.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sch5627.ko 2024-01-31T04:50:18.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sch5636.ko 2024-01-31T04:50:18.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-31T04:50:18.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sht15.ko 2024-01-31T04:50:18.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sht21.ko 2024-01-31T04:50:18.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/shtc1.ko 2024-01-31T04:50:18.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sis5595.ko 2024-01-31T04:50:18.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/smsc47b397.ko 2024-01-31T04:50:18.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/smsc47m1.ko 2024-01-31T04:50:18.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/smsc47m192.ko 2024-01-31T04:50:18.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/thmc50.ko 2024-01-31T04:50:18.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp102.ko 2024-01-31T04:50:18.764 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp103.ko 2024-01-31T04:50:18.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp401.ko 2024-01-31T04:50:18.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp421.ko 2024-01-31T04:50:18.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/via-cputemp.ko 2024-01-31T04:50:18.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/via686a.ko 2024-01-31T04:50:18.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/vt1211.ko 2024-01-31T04:50:18.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/vt8231.ko 2024-01-31T04:50:18.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83627ehf.ko 2024-01-31T04:50:18.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83627hf.ko 2024-01-31T04:50:18.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 71345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83781d.ko 2024-01-31T04:50:18.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 63225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83791d.ko 2024-01-31T04:50:18.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 71321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83792d.ko 2024-01-31T04:50:18.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 101473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83793.ko 2024-01-31T04:50:18.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 119505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83795.ko 2024-01-31T04:50:18.765 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83l785ts.ko 2024-01-31T04:50:18.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83l786ng.ko 2024-01-31T04:50:18.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-01-31T04:50:18.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-01-31T04:50:18.766 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/ 2024-01-31T04:50:18.766 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/algos/ 2024-01-31T04:50:18.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-31T04:50:18.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-31T04:50:18.766 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/ 2024-01-31T04:50:18.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-01-31T04:50:18.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-01-31T04:50:18.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-01-31T04:50:18.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-31T04:50:18.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-31T04:50:18.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-31T04:50:18.766 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-01-31T04:50:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 6929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-31T04:50:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-01-31T04:50:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-31T04:50:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-31T04:50:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-31T04:50:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-31T04:50:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-01-31T04:50:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-01-31T04:50:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 62681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-31T04:50:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-31T04:50:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-31T04:50:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-01-31T04:50:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-31T04:50:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-31T04:50:18.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-01-31T04:50:18.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-31T04:50:18.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-31T04:50:18.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-31T04:50:18.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-01-31T04:50:18.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-31T04:50:18.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-31T04:50:18.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-01-31T04:50:18.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-01-31T04:50:18.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-31T04:50:18.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-01-31T04:50:18.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-31T04:50:18.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-31T04:50:18.768 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-31T04:50:18.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-31T04:50:18.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-01-31T04:50:18.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/i2c-mux.ko 2024-01-31T04:50:18.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/i2c-smbus.ko 2024-01-31T04:50:18.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/i2c-stub.ko 2024-01-31T04:50:18.769 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/ 2024-01-31T04:50:18.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-01-31T04:50:18.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-01-31T04:50:18.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-01-31T04:50:18.769 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ 2024-01-31T04:50:18.769 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ 2024-01-31T04:50:18.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 273609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-31T04:50:18.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 883681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_core.ko 2024-01-31T04:50:18.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-31T04:50:18.769 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 324329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-31T04:50:18.770 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 97921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-31T04:50:18.770 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 282601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-31T04:50:18.770 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-31T04:50:18.770 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/ 2024-01-31T04:50:18.770 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/cxgb4/ 2024-01-31T04:50:18.770 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 493217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-31T04:50:18.770 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx4/ 2024-01-31T04:50:18.770 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 420561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-31T04:50:18.770 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx5/ 2024-01-31T04:50:18.770 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 741449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-31T04:50:18.770 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mthca/ 2024-01-31T04:50:18.770 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 296881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-31T04:50:18.770 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/ocrdma/ 2024-01-31T04:50:18.770 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 153801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-01-31T04:50:18.771 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/usnic/ 2024-01-31T04:50:18.771 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 168969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-01-31T04:50:18.771 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/ 2024-01-31T04:50:18.771 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/ipoib/ 2024-01-31T04:50:18.771 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 263081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-31T04:50:18.771 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/iser/ 2024-01-31T04:50:18.771 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-31T04:50:18.771 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/isert/ 2024-01-31T04:50:18.771 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 111425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-31T04:50:18.771 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srp/ 2024-01-31T04:50:18.771 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 128753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-31T04:50:18.771 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srpt/ 2024-01-31T04:50:18.771 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 129529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-31T04:50:18.771 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/ 2024-01-31T04:50:18.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/evbug.ko 2024-01-31T04:50:18.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/ff-memless.ko 2024-01-31T04:50:18.772 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/ 2024-01-31T04:50:18.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-31T04:50:18.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-31T04:50:18.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/gameport.ko 2024-01-31T04:50:18.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/joydev.ko 2024-01-31T04:50:18.772 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/ 2024-01-31T04:50:18.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-01-31T04:50:18.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-01-31T04:50:18.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-01-31T04:50:18.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-01-31T04:50:18.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-31T04:50:18.772 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-01-31T04:50:18.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/lkkbd.ko 2024-01-31T04:50:18.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/lm8323.ko 2024-01-31T04:50:18.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/lm8333.ko 2024-01-31T04:50:18.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-01-31T04:50:18.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-01-31T04:50:18.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-01-31T04:50:18.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-01-31T04:50:18.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/newtonkbd.ko 2024-01-31T04:50:18.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-01-31T04:50:18.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/qt1070.ko 2024-01-31T04:50:18.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/qt2160.ko 2024-01-31T04:50:18.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-01-31T04:50:18.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/stowaway.ko 2024-01-31T04:50:18.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/sunkbd.ko 2024-01-31T04:50:18.773 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-01-31T04:50:18.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-01-31T04:50:18.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-01-31T04:50:18.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/xtkbd.ko 2024-01-31T04:50:18.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/matrix-keymap.ko 2024-01-31T04:50:18.774 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/ 2024-01-31T04:50:18.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/appletouch.ko 2024-01-31T04:50:18.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/bcm5974.ko 2024-01-31T04:50:18.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 123417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/cyapatp.ko 2024-01-31T04:50:18.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-31T04:50:18.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/gpio_mouse.ko 2024-01-31T04:50:18.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 335953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/psmouse.ko 2024-01-31T04:50:18.774 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/sermouse.ko 2024-01-31T04:50:18.775 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-31T04:50:18.775 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-31T04:50:18.775 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-31T04:50:18.776 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/rmi4/ 2024-01-31T04:50:18.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 109873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-31T04:50:18.776 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/ 2024-01-31T04:50:18.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/altera_ps2.ko 2024-01-31T04:50:18.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/arc_ps2.ko 2024-01-31T04:50:18.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/ct82c710.ko 2024-01-31T04:50:18.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-31T04:50:18.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/parkbd.ko 2024-01-31T04:50:18.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/pcips2.ko 2024-01-31T04:50:18.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/ps2mult.ko 2024-01-31T04:50:18.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/serio_raw.ko 2024-01-31T04:50:18.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/serport.ko 2024-01-31T04:50:18.776 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/sparse-keymap.ko 2024-01-31T04:50:18.776 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/ 2024-01-31T04:50:18.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-88pm860x.ko 2024-01-31T04:50:18.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-adp5520.ko 2024-01-31T04:50:18.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-bd2802.ko 2024-01-31T04:50:18.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-blinkm.ko 2024-01-31T04:50:18.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-da903x.ko 2024-01-31T04:50:18.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-da9052.ko 2024-01-31T04:50:18.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-gpio.ko 2024-01-31T04:50:18.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm3530.ko 2024-01-31T04:50:18.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm3533.ko 2024-01-31T04:50:18.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm355x.ko 2024-01-31T04:50:18.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm3642.ko 2024-01-31T04:50:18.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lp3944.ko 2024-01-31T04:50:18.777 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lp8788.ko 2024-01-31T04:50:18.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-max8997.ko 2024-01-31T04:50:18.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-mc13783.ko 2024-01-31T04:50:18.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-menf21bmc.ko 2024-01-31T04:50:18.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-pca9532.ko 2024-01-31T04:50:18.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-pca955x.ko 2024-01-31T04:50:18.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-pca963x.ko 2024-01-31T04:50:18.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-ss4200.ko 2024-01-31T04:50:18.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-tca6507.ko 2024-01-31T04:50:18.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-wm831x-status.ko 2024-01-31T04:50:18.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-wm8350.ko 2024-01-31T04:50:18.778 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ 2024-01-31T04:50:18.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-31T04:50:18.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-31T04:50:18.778 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-31T04:50:18.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-31T04:50:18.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-31T04:50:18.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-31T04:50:18.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-31T04:50:18.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-31T04:50:18.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-31T04:50:18.779 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/ 2024-01-31T04:50:18.779 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/bcache/ 2024-01-31T04:50:18.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 647193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/bcache/bcache.ko 2024-01-31T04:50:18.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-bio-prison.ko 2024-01-31T04:50:18.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 93409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-bufio.ko 2024-01-31T04:50:18.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-cache-smq.ko 2024-01-31T04:50:18.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 155897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-cache.ko 2024-01-31T04:50:18.779 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 107257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-crypt.ko 2024-01-31T04:50:18.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-delay.ko 2024-01-31T04:50:18.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-era.ko 2024-01-31T04:50:18.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-flakey.ko 2024-01-31T04:50:18.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-log-userspace.ko 2024-01-31T04:50:18.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-log.ko 2024-01-31T04:50:18.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-mirror.ko 2024-01-31T04:50:18.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-multipath.ko 2024-01-31T04:50:18.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-queue-length.ko 2024-01-31T04:50:18.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 71073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-raid.ko 2024-01-31T04:50:18.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-region-hash.ko 2024-01-31T04:50:18.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-round-robin.ko 2024-01-31T04:50:18.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-service-time.ko 2024-01-31T04:50:18.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 109529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-snapshot.ko 2024-01-31T04:50:18.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-switch.ko 2024-01-31T04:50:18.780 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 181865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-thin-pool.ko 2024-01-31T04:50:18.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-verity.ko 2024-01-31T04:50:18.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-zero.ko 2024-01-31T04:50:18.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/faulty.ko 2024-01-31T04:50:18.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/linear.ko 2024-01-31T04:50:18.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/multipath.ko 2024-01-31T04:50:18.781 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/persistent-data/ 2024-01-31T04:50:18.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 199937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-31T04:50:18.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid0.ko 2024-01-31T04:50:18.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 113001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid1.ko 2024-01-31T04:50:18.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 158657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid10.ko 2024-01-31T04:50:18.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 393777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid456.ko 2024-01-31T04:50:18.781 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/ 2024-01-31T04:50:18.781 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/ 2024-01-31T04:50:18.781 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 178137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptbase.ko 2024-01-31T04:50:18.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 63321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptctl.ko 2024-01-31T04:50:18.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptfc.ko 2024-01-31T04:50:18.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptlan.ko 2024-01-31T04:50:18.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 123321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptsas.ko 2024-01-31T04:50:18.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 81009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptscsih.ko 2024-01-31T04:50:18.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptspi.ko 2024-01-31T04:50:18.782 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/ 2024-01-31T04:50:18.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/88pm800.ko 2024-01-31T04:50:18.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/88pm805.ko 2024-01-31T04:50:18.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/88pm80x.ko 2024-01-31T04:50:18.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/arizona-i2c.ko 2024-01-31T04:50:18.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 123721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/arizona.ko 2024-01-31T04:50:18.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/bcm590xx.ko 2024-01-31T04:50:18.782 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/cros_ec_dev.ko 2024-01-31T04:50:18.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/dln2.ko 2024-01-31T04:50:18.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/janz-cmodio.ko 2024-01-31T04:50:18.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/kempld-core.ko 2024-01-31T04:50:18.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lm3533-core.ko 2024-01-31T04:50:18.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-01-31T04:50:18.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lp3943.ko 2024-01-31T04:50:18.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lpc_ich.ko 2024-01-31T04:50:18.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lpc_sch.ko 2024-01-31T04:50:18.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/max8907.ko 2024-01-31T04:50:18.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/mc13xxx-core.ko 2024-01-31T04:50:18.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-01-31T04:50:18.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/menf21bmc.ko 2024-01-31T04:50:18.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/pcf50633-adc.ko 2024-01-31T04:50:18.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/pcf50633-gpio.ko 2024-01-31T04:50:18.783 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/pcf50633.ko 2024-01-31T04:50:18.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-01-31T04:50:18.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/retu-mfd.ko 2024-01-31T04:50:18.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 80425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/si476x-core.ko 2024-01-31T04:50:18.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/sm501.ko 2024-01-31T04:50:18.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/ti_am335x_tscadc.ko 2024-01-31T04:50:18.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/tps65010.ko 2024-01-31T04:50:18.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/tps6507x.ko 2024-01-31T04:50:18.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/viperboard.ko 2024-01-31T04:50:18.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/vx855.ko 2024-01-31T04:50:18.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/wl1273-core.ko 2024-01-31T04:50:18.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/wm8994.ko 2024-01-31T04:50:18.784 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ 2024-01-31T04:50:18.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-01-31T04:50:18.784 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ad525x_dpot.ko 2024-01-31T04:50:18.785 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/altera-stapl/ 2024-01-31T04:50:18.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-31T04:50:18.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/apds9802als.ko 2024-01-31T04:50:18.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/apds990x.ko 2024-01-31T04:50:18.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/bh1770glc.ko 2024-01-31T04:50:18.785 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/c2port/ 2024-01-31T04:50:18.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-01-31T04:50:18.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/c2port/core.ko 2024-01-31T04:50:18.785 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/cb710/ 2024-01-31T04:50:18.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/cb710/cb710.ko 2024-01-31T04:50:18.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ds1682.ko 2024-01-31T04:50:18.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/dummy-irq.ko 2024-01-31T04:50:18.785 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/echo/ 2024-01-31T04:50:18.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/echo/echo.ko 2024-01-31T04:50:18.785 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/ 2024-01-31T04:50:18.785 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/at24.ko 2024-01-31T04:50:18.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-31T04:50:18.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/max6875.ko 2024-01-31T04:50:18.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/enclosure.ko 2024-01-31T04:50:18.786 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/genwqe/ 2024-01-31T04:50:18.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 152201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-01-31T04:50:18.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/hmc6352.ko 2024-01-31T04:50:18.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/hpilo.ko 2024-01-31T04:50:18.786 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ibmasm/ 2024-01-31T04:50:18.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 72601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-01-31T04:50:18.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ics932s401.ko 2024-01-31T04:50:18.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/isl29003.ko 2024-01-31T04:50:18.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/isl29020.ko 2024-01-31T04:50:18.786 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/lis3lv02d/ 2024-01-31T04:50:18.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-31T04:50:18.786 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-31T04:50:18.787 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/ 2024-01-31T04:50:18.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 125945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/mei-me.ko 2024-01-31T04:50:18.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/mei-txe.ko 2024-01-31T04:50:18.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 313641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/mei.ko 2024-01-31T04:50:18.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/phantom.ko 2024-01-31T04:50:18.787 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ti-st/ 2024-01-31T04:50:18.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 74377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ti-st/st_drv.ko 2024-01-31T04:50:18.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/tifm_7xx1.ko 2024-01-31T04:50:18.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/tifm_core.ko 2024-01-31T04:50:18.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/tsl2550.ko 2024-01-31T04:50:18.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/vmw_balloon.ko 2024-01-31T04:50:18.787 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/vmw_vmci/ 2024-01-31T04:50:18.787 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 183609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-31T04:50:18.787 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ 2024-01-31T04:50:18.788 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/bonding/ 2024-01-31T04:50:18.788 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 490849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/bonding/bonding.ko 2024-01-31T04:50:18.828 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/ 2024-01-31T04:50:18.828 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/b53/ 2024-01-31T04:50:18.828 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 106033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-31T04:50:18.828 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-31T04:50:18.829 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-31T04:50:18.829 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/mv88e6xxx/ 2024-01-31T04:50:18.829 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 455065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-31T04:50:18.829 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dummy.ko 2024-01-31T04:50:18.829 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/eql.ko 2024-01-31T04:50:18.829 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ 2024-01-31T04:50:18.829 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/ 2024-01-31T04:50:18.829 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-31T04:50:18.829 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-31T04:50:18.829 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 130553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-31T04:50:18.829 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 68849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-31T04:50:18.829 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/ 2024-01-31T04:50:18.829 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-31T04:50:18.829 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-31T04:50:18.829 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-31T04:50:18.830 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 99049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-31T04:50:18.830 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/adaptec/ 2024-01-31T04:50:18.830 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-31T04:50:18.830 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/agere/ 2024-01-31T04:50:18.830 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-31T04:50:18.830 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/alteon/ 2024-01-31T04:50:18.830 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-31T04:50:18.830 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/altera/ 2024-01-31T04:50:18.830 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-31T04:50:18.830 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/ 2024-01-31T04:50:18.830 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-31T04:50:18.830 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-31T04:50:18.830 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 87297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-31T04:50:18.830 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/ 2024-01-31T04:50:18.831 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/alx/ 2024-01-31T04:50:18.831 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 97337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-31T04:50:18.831 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-01-31T04:50:18.831 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 102497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-31T04:50:18.831 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-01-31T04:50:18.831 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 90345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-31T04:50:18.831 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atlx/ 2024-01-31T04:50:18.831 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 81569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-31T04:50:18.831 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-31T04:50:18.831 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/ 2024-01-31T04:50:18.831 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-31T04:50:18.831 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 176761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-31T04:50:18.831 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-01-31T04:50:18.831 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1421529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-31T04:50:18.831 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 128569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-31T04:50:18.832 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/genet/ 2024-01-31T04:50:18.832 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 131337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-31T04:50:18.832 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 314553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-31T04:50:18.832 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/brocade/ 2024-01-31T04:50:18.832 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/brocade/bna/ 2024-01-31T04:50:18.832 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 323745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-31T04:50:18.832 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/ 2024-01-31T04:50:18.832 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-01-31T04:50:18.832 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 193497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-31T04:50:18.832 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-01-31T04:50:18.832 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 347257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-31T04:50:18.832 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-01-31T04:50:18.832 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1044793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-31T04:50:18.832 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-01-31T04:50:18.833 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 166193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-31T04:50:18.833 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-01-31T04:50:18.833 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-31T04:50:18.833 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/cisco/ 2024-01-31T04:50:18.833 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/cisco/enic/ 2024-01-31T04:50:18.833 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 204345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-31T04:50:18.833 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/ 2024-01-31T04:50:18.833 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/ 2024-01-31T04:50:18.833 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-31T04:50:18.833 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-31T04:50:18.833 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 141225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-31T04:50:18.833 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-31T04:50:18.833 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 62817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-31T04:50:18.833 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-31T04:50:18.833 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dlink/ 2024-01-31T04:50:18.834 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-31T04:50:18.834 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 62833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-31T04:50:18.834 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dnet.ko 2024-01-31T04:50:18.834 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ec_bhf.ko 2024-01-31T04:50:18.834 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/emulex/ 2024-01-31T04:50:18.834 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/emulex/benet/ 2024-01-31T04:50:18.834 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 281137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-31T04:50:18.834 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ethoc.ko 2024-01-31T04:50:18.834 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/fealnx.ko 2024-01-31T04:50:18.834 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/fujitsu/ 2024-01-31T04:50:18.834 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-01-31T04:50:18.834 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ 2024-01-31T04:50:18.834 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 90369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-31T04:50:18.834 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000/ 2024-01-31T04:50:18.834 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 295481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-31T04:50:18.835 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000e/ 2024-01-31T04:50:18.835 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 584497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-31T04:50:18.835 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/fm10k/ 2024-01-31T04:50:18.835 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 246209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-31T04:50:18.835 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/i40e/ 2024-01-31T04:50:18.835 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 937673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-31T04:50:18.835 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/iavf/ 2024-01-31T04:50:18.835 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 287305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-31T04:50:18.835 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igb/ 2024-01-31T04:50:18.835 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 514569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-31T04:50:18.835 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igbvf/ 2024-01-31T04:50:18.835 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 93497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-31T04:50:18.835 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-01-31T04:50:18.835 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 734353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-31T04:50:18.835 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-01-31T04:50:18.836 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 151769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-31T04:50:18.836 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 86921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/jme.ko 2024-01-31T04:50:18.836 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/ 2024-01-31T04:50:18.836 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-31T04:50:18.836 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 102289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-31T04:50:18.836 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 122601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-31T04:50:18.836 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/ 2024-01-31T04:50:18.836 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-01-31T04:50:18.836 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 727473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-31T04:50:18.836 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 278961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-31T04:50:18.836 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-01-31T04:50:18.836 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-01-31T04:50:18.836 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1118201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-31T04:50:18.836 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ 2024-01-31T04:50:18.836 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-01-31T04:50:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-01-31T04:50:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-01-31T04:50:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 95665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-31T04:50:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/myricom/ 2024-01-31T04:50:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-01-31T04:50:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 108649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-31T04:50:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/natsemi/ 2024-01-31T04:50:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-31T04:50:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-31T04:50:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/neterion/ 2024-01-31T04:50:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 150905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-31T04:50:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/nvidia/ 2024-01-31T04:50:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 136721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-31T04:50:18.837 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/packetengines/ 2024-01-31T04:50:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-31T04:50:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-31T04:50:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/ 2024-01-31T04:50:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-01-31T04:50:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 227897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-31T04:50:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 87105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-31T04:50:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-01-31T04:50:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 671937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-31T04:50:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/rdc/ 2024-01-31T04:50:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-31T04:50:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/ 2024-01-31T04:50:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-31T04:50:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 83985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-31T04:50:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-31T04:50:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 192353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-31T04:50:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/samsung/ 2024-01-31T04:50:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-01-31T04:50:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 104241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-01-31T04:50:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sfc/ 2024-01-31T04:50:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1064737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-31T04:50:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/silan/ 2024-01-31T04:50:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-31T04:50:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sis/ 2024-01-31T04:50:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-31T04:50:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 63337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-31T04:50:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/ 2024-01-31T04:50:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-31T04:50:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-31T04:50:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-31T04:50:18.840 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 68177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-31T04:50:18.840 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/ 2024-01-31T04:50:18.840 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-01-31T04:50:18.840 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-01-31T04:50:18.840 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-31T04:50:18.840 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-01-31T04:50:18.840 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 487593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-31T04:50:18.840 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/ 2024-01-31T04:50:18.840 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 103337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-31T04:50:18.840 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 166097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-31T04:50:18.840 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-31T04:50:18.840 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-31T04:50:18.840 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/tehuti/ 2024-01-31T04:50:18.840 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-31T04:50:18.841 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ti/ 2024-01-31T04:50:18.841 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 86529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-31T04:50:18.841 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/via/ 2024-01-31T04:50:18.841 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 80273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-31T04:50:18.841 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 83793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-31T04:50:18.841 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/wiznet/ 2024-01-31T04:50:18.841 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-31T04:50:18.841 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-31T04:50:18.841 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/xircom/ 2024-01-31T04:50:18.841 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-31T04:50:18.841 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/ 2024-01-31T04:50:18.841 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/defxx.ko 2024-01-31T04:50:18.841 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/skfp/ 2024-01-31T04:50:18.841 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 216985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/skfp/skfp.ko 2024-01-31T04:50:18.842 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 74569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/geneve.ko 2024-01-31T04:50:18.842 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/hyperv/ 2024-01-31T04:50:18.842 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 236225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-31T04:50:18.842 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ieee802154/ 2024-01-31T04:50:18.842 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-31T04:50:18.842 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ifb.ko 2024-01-31T04:50:18.842 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ipvlan/ 2024-01-31T04:50:18.842 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 85817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-31T04:50:18.842 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 62769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/macvlan.ko 2024-01-31T04:50:18.842 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/macvtap.ko 2024-01-31T04:50:18.842 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/ 2024-01-31T04:50:18.842 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-31T04:50:18.842 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-31T04:50:18.842 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-gpio.ko 2024-01-31T04:50:18.843 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-31T04:50:18.843 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio.ko 2024-01-31T04:50:18.843 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mii.ko 2024-01-31T04:50:18.843 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/netconsole.ko 2024-01-31T04:50:18.843 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/nlmon.ko 2024-01-31T04:50:18.843 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/pcs/ 2024-01-31T04:50:18.843 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-31T04:50:18.843 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-31T04:50:18.843 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/ 2024-01-31T04:50:18.843 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/amd.ko 2024-01-31T04:50:18.843 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-31T04:50:18.843 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-31T04:50:18.843 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/bcm87xx.ko 2024-01-31T04:50:18.843 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/broadcom.ko 2024-01-31T04:50:18.844 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/cicada.ko 2024-01-31T04:50:18.844 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/davicom.ko 2024-01-31T04:50:18.844 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/et1011c.ko 2024-01-31T04:50:18.844 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/icplus.ko 2024-01-31T04:50:18.844 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/lxt.ko 2024-01-31T04:50:18.844 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 82049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/marvell.ko 2024-01-31T04:50:18.844 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 76409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/micrel.ko 2024-01-31T04:50:18.844 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/national.ko 2024-01-31T04:50:18.844 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 95561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/phylink.ko 2024-01-31T04:50:18.844 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/qsemi.ko 2024-01-31T04:50:18.844 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/realtek.ko 2024-01-31T04:50:18.844 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/smsc.ko 2024-01-31T04:50:18.844 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/ste10Xp.ko 2024-01-31T04:50:18.844 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/vitesse.ko 2024-01-31T04:50:18.844 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/plip/ 2024-01-31T04:50:18.845 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/plip/plip.ko 2024-01-31T04:50:18.845 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ 2024-01-31T04:50:18.845 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-31T04:50:18.845 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_async.ko 2024-01-31T04:50:18.845 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-31T04:50:18.845 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-31T04:50:18.845 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-31T04:50:18.845 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/pppoe.ko 2024-01-31T04:50:18.845 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/pppox.ko 2024-01-31T04:50:18.845 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/pptp.ko 2024-01-31T04:50:18.845 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/sb1000.ko 2024-01-31T04:50:18.845 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/slip/ 2024-01-31T04:50:18.845 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/slip/slip.ko 2024-01-31T04:50:18.845 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/sungem_phy.ko 2024-01-31T04:50:18.845 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 64585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/tap.ko 2024-01-31T04:50:18.846 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/ 2024-01-31T04:50:18.846 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 107089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team.ko 2024-01-31T04:50:18.846 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-31T04:50:18.846 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-31T04:50:18.846 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-31T04:50:18.846 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_random.ko 2024-01-31T04:50:18.846 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-31T04:50:18.846 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 86945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/veth.ko 2024-01-31T04:50:18.846 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vmxnet3/ 2024-01-31T04:50:18.846 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 144361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-31T04:50:18.846 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vxlan/ 2024-01-31T04:50:18.846 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 301281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vxlan/vxlan.ko 2024-01-31T04:50:18.846 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/xen-netback/ 2024-01-31T04:50:18.846 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 144001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-31T04:50:18.847 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ntb/ 2024-01-31T04:50:18.847 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ntb/ntb.ko 2024-01-31T04:50:18.847 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/ 2024-01-31T04:50:18.847 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/host/ 2024-01-31T04:50:18.847 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 265777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/host/nvme-core.ko 2024-01-31T04:50:18.847 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 102545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/host/nvme.ko 2024-01-31T04:50:18.847 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/ 2024-01-31T04:50:18.847 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 131249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport.ko 2024-01-31T04:50:18.847 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport_cs.ko 2024-01-31T04:50:18.847 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 85377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport_pc.ko 2024-01-31T04:50:18.847 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport_serial.ko 2024-01-31T04:50:18.847 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/ 2024-01-31T04:50:18.847 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/ 2024-01-31T04:50:18.847 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-31T04:50:18.848 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-01-31T04:50:18.848 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-01-31T04:50:18.848 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/pci-stub.ko 2024-01-31T04:50:18.848 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/xen-pcifront.ko 2024-01-31T04:50:18.848 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/ 2024-01-31T04:50:18.848 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/i82092.ko 2024-01-31T04:50:18.848 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 146289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pcmcia.ko 2024-01-31T04:50:18.848 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 62161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pcmcia_core.ko 2024-01-31T04:50:18.848 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-01-31T04:50:18.848 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pd6729.ko 2024-01-31T04:50:18.848 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 112889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-31T04:50:18.848 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/ 2024-01-31T04:50:18.848 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/broadcom/ 2024-01-31T04:50:18.848 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-01-31T04:50:18.849 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/samsung/ 2024-01-31T04:50:18.849 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-01-31T04:50:18.849 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pinctrl/ 2024-01-31T04:50:18.849 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pinctrl/intel/ 2024-01-31T04:50:18.849 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-31T04:50:18.849 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/ 2024-01-31T04:50:18.849 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/ 2024-01-31T04:50:18.849 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-01-31T04:50:18.849 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec.ko 2024-01-31T04:50:18.849 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-01-31T04:50:18.849 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-01-31T04:50:18.849 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-01-31T04:50:18.849 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-01-31T04:50:18.849 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-01-31T04:50:18.849 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/ 2024-01-31T04:50:18.850 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-31T04:50:18.850 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/acerhdf.ko 2024-01-31T04:50:18.850 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-31T04:50:18.850 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-31T04:50:18.850 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-31T04:50:18.850 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 132025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-31T04:50:18.850 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-31T04:50:18.850 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-31T04:50:18.850 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-31T04:50:18.850 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-31T04:50:18.850 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-31T04:50:18.850 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/hdaps.ko 2024-01-31T04:50:18.850 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/ibm_rtl.ko 2024-01-31T04:50:18.850 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel/ 2024-01-31T04:50:18.850 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-31T04:50:18.851 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-01-31T04:50:18.851 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel_ips.ko 2024-01-31T04:50:18.851 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-31T04:50:18.851 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-31T04:50:18.851 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-31T04:50:18.851 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-31T04:50:18.851 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-31T04:50:18.851 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-31T04:50:18.851 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-31T04:50:18.851 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-31T04:50:18.851 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-31T04:50:18.851 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/wmi.ko 2024-01-31T04:50:18.851 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/ 2024-01-31T04:50:18.851 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ 2024-01-31T04:50:18.852 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/88pm860x_battery.ko 2024-01-31T04:50:18.852 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/88pm860x_charger.ko 2024-01-31T04:50:18.852 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 55057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/bq2415x_charger.ko 2024-01-31T04:50:18.852 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/bq24190_charger.ko 2024-01-31T04:50:18.852 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/bq24735-charger.ko 2024-01-31T04:50:18.852 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-01-31T04:50:18.852 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/da9030_battery.ko 2024-01-31T04:50:18.852 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/da9052-battery.ko 2024-01-31T04:50:18.852 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2760_battery.ko 2024-01-31T04:50:18.852 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2780_battery.ko 2024-01-31T04:50:18.852 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2781_battery.ko 2024-01-31T04:50:18.852 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2782_battery.ko 2024-01-31T04:50:18.852 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/gpio-charger.ko 2024-01-31T04:50:18.852 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/isp1704_charger.ko 2024-01-31T04:50:18.853 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/lp8727_charger.ko 2024-01-31T04:50:18.853 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max14577_charger.ko 2024-01-31T04:50:18.853 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max17042_battery.ko 2024-01-31T04:50:18.853 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max8903_charger.ko 2024-01-31T04:50:18.853 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max8925_power.ko 2024-01-31T04:50:18.853 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/pcf50633-charger.ko 2024-01-31T04:50:18.853 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/sbs-battery.ko 2024-01-31T04:50:18.853 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/test_power.ko 2024-01-31T04:50:18.853 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/tps65090-charger.ko 2024-01-31T04:50:18.853 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/wm831x_backup.ko 2024-01-31T04:50:18.853 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/wm831x_power.ko 2024-01-31T04:50:18.853 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/wm8350_power.ko 2024-01-31T04:50:18.853 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/powercap/ 2024-01-31T04:50:18.853 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-31T04:50:18.854 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-31T04:50:18.854 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/ 2024-01-31T04:50:18.854 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/ 2024-01-31T04:50:18.854 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-31T04:50:18.854 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-31T04:50:18.854 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/pps_parport.ko 2024-01-31T04:50:18.854 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/pps_core.ko 2024-01-31T04:50:18.854 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ptp/ 2024-01-31T04:50:18.854 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ptp/ptp.ko 2024-01-31T04:50:18.854 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ptp/ptp_kvm.ko 2024-01-31T04:50:18.854 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/ 2024-01-31T04:50:18.854 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-88pm80x.ko 2024-01-31T04:50:18.854 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-88pm860x.ko 2024-01-31T04:50:18.854 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-31T04:50:18.854 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-da9052.ko 2024-01-31T04:50:18.855 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-da9055.ko 2024-01-31T04:50:18.855 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-da9063.ko 2024-01-31T04:50:18.855 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-31T04:50:18.855 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 68577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-31T04:50:18.855 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-31T04:50:18.855 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-31T04:50:18.855 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-31T04:50:18.855 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-31T04:50:18.855 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-31T04:50:18.855 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-31T04:50:18.855 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-31T04:50:18.855 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-em3027.ko 2024-01-31T04:50:18.855 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-31T04:50:18.855 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-31T04:50:18.855 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-31T04:50:18.856 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-lp8788.ko 2024-01-31T04:50:18.856 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-31T04:50:18.856 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-31T04:50:18.856 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-31T04:50:18.856 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m48t86.ko 2024-01-31T04:50:18.856 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max6900.ko 2024-01-31T04:50:18.856 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8907.ko 2024-01-31T04:50:18.856 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8925.ko 2024-01-31T04:50:18.856 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8997.ko 2024-01-31T04:50:18.856 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8998.ko 2024-01-31T04:50:18.856 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-01-31T04:50:18.856 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-31T04:50:18.856 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-palmas.ko 2024-01-31T04:50:18.856 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-31T04:50:18.856 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf50633.ko 2024-01-31T04:50:18.857 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-31T04:50:18.857 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-31T04:50:18.857 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-31T04:50:18.857 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-31T04:50:18.857 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rc5t583.ko 2024-01-31T04:50:18.857 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-31T04:50:18.857 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-31T04:50:18.857 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-31T04:50:18.857 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-31T04:50:18.857 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-31T04:50:18.857 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-s35390a.ko 2024-01-31T04:50:18.857 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-31T04:50:18.857 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-tps6586x.ko 2024-01-31T04:50:18.857 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-tps65910.ko 2024-01-31T04:50:18.858 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-wm831x.ko 2024-01-31T04:50:18.858 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-wm8350.ko 2024-01-31T04:50:18.858 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-x1205.ko 2024-01-31T04:50:18.858 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ 2024-01-31T04:50:18.858 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 77617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/3w-9xxx.ko 2024-01-31T04:50:18.858 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/3w-sas.ko 2024-01-31T04:50:18.858 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 55105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/3w-xxxx.ko 2024-01-31T04:50:18.858 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 135185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/BusLogic.ko 2024-01-31T04:50:18.858 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/a100u2w.ko 2024-01-31T04:50:18.858 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aacraid/ 2024-01-31T04:50:18.858 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 271113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-31T04:50:18.858 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/advansys.ko 2024-01-31T04:50:18.858 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic7xxx/ 2024-01-31T04:50:18.858 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 356929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-31T04:50:18.858 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 296049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-31T04:50:18.859 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic94xx/ 2024-01-31T04:50:18.859 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 189185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-01-31T04:50:18.859 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/am53c974.ko 2024-01-31T04:50:18.859 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/arcmsr/ 2024-01-31T04:50:18.859 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 106881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-31T04:50:18.859 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/atp870u.ko 2024-01-31T04:50:18.859 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/be2iscsi/ 2024-01-31T04:50:18.859 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 247009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-31T04:50:18.859 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bfa/ 2024-01-31T04:50:18.859 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1171945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bfa/bfa.ko 2024-01-31T04:50:18.859 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2fc/ 2024-01-31T04:50:18.859 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 237721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-31T04:50:18.859 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2i/ 2024-01-31T04:50:18.859 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 115369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-31T04:50:18.859 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ch.ko 2024-01-31T04:50:18.860 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/csiostor/ 2024-01-31T04:50:18.860 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 308921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-31T04:50:18.860 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/ 2024-01-31T04:50:18.860 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-01-31T04:50:18.860 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 76145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-31T04:50:18.860 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-01-31T04:50:18.860 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 101449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-31T04:50:18.860 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 146625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-31T04:50:18.860 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 75553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/dc395x.ko 2024-01-31T04:50:18.860 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/dmx3191d.ko 2024-01-31T04:50:18.860 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/esas2r/ 2024-01-31T04:50:18.860 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 212425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-31T04:50:18.860 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/esp_scsi.ko 2024-01-31T04:50:18.860 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fcoe/ 2024-01-31T04:50:18.861 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-31T04:50:18.861 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 158505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-31T04:50:18.861 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fdomain.ko 2024-01-31T04:50:18.861 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fnic/ 2024-01-31T04:50:18.861 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 263489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fnic/fnic.ko 2024-01-31T04:50:18.861 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 201817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/hpsa.ko 2024-01-31T04:50:18.861 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/hptiop.ko 2024-01-31T04:50:18.861 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/hv_storvsc.ko 2024-01-31T04:50:18.861 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/imm.ko 2024-01-31T04:50:18.861 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/initio.ko 2024-01-31T04:50:18.861 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 266537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ipr.ko 2024-01-31T04:50:18.861 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 101473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ips.ko 2024-01-31T04:50:18.861 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/isci/ 2024-01-31T04:50:18.861 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 317153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/isci/isci.ko 2024-01-31T04:50:18.862 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-31T04:50:18.862 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-31T04:50:18.862 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libfc/ 2024-01-31T04:50:18.862 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 315209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libfc/libfc.ko 2024-01-31T04:50:18.862 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 145585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libiscsi.ko 2024-01-31T04:50:18.862 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-31T04:50:18.862 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libsas/ 2024-01-31T04:50:18.862 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 216441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libsas/libsas.ko 2024-01-31T04:50:18.862 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/lpfc/ 2024-01-31T04:50:18.862 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 2197481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-31T04:50:18.862 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/ 2024-01-31T04:50:18.862 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-31T04:50:18.862 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-31T04:50:18.862 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 310841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-31T04:50:18.862 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 84649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid.ko 2024-01-31T04:50:18.863 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mpt3sas/ 2024-01-31T04:50:18.863 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 659801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-31T04:50:18.863 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mvsas/ 2024-01-31T04:50:18.863 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 119561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-31T04:50:18.863 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mvumi.ko 2024-01-31T04:50:18.863 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/ 2024-01-31T04:50:18.863 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 81649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-01-31T04:50:18.863 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-01-31T04:50:18.863 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-01-31T04:50:18.863 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-01-31T04:50:18.863 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pm8001/ 2024-01-31T04:50:18.863 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 366401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-31T04:50:18.863 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 124633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pmcraid.ko 2024-01-31T04:50:18.863 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ppa.ko 2024-01-31T04:50:18.863 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 55425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla1280.ko 2024-01-31T04:50:18.864 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla2xxx/ 2024-01-31T04:50:18.864 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1876633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-31T04:50:18.864 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 85289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-31T04:50:18.864 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla4xxx/ 2024-01-31T04:50:18.864 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 559033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-31T04:50:18.864 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qlogicfas408.ko 2024-01-31T04:50:18.864 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/raid_class.ko 2024-01-31T04:50:18.864 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 261241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_debug.ko 2024-01-31T04:50:18.864 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 173937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-31T04:50:18.864 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 279313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-31T04:50:18.864 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 97729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-31T04:50:18.864 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-31T04:50:18.864 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-31T04:50:18.864 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ses.ko 2024-01-31T04:50:18.865 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 115889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/st.ko 2024-01-31T04:50:18.865 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/stex.ko 2024-01-31T04:50:18.865 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/sym53c8xx_2/ 2024-01-31T04:50:18.865 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 164961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-31T04:50:18.865 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/virtio_scsi.ko 2024-01-31T04:50:18.865 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-31T04:50:18.865 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/wd719x.ko 2024-01-31T04:50:18.865 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/xen-scsifront.ko 2024-01-31T04:50:18.865 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ssb/ 2024-01-31T04:50:18.865 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 129441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ssb/ssb.ko 2024-01-31T04:50:18.865 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/ 2024-01-31T04:50:18.865 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/iscsi/ 2024-01-31T04:50:18.865 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 736769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-31T04:50:18.865 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/loopback/ 2024-01-31T04:50:18.865 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-31T04:50:18.866 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_file.ko 2024-01-31T04:50:18.866 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_iblock.ko 2024-01-31T04:50:18.866 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 930697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_mod.ko 2024-01-31T04:50:18.904 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_pscsi.ko 2024-01-31T04:50:18.905 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 122521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_user.ko 2024-01-31T04:50:18.905 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/tcm_fc/ 2024-01-31T04:50:18.905 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 75593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-31T04:50:18.905 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/ 2024-01-31T04:50:18.905 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/ 2024-01-31T04:50:18.905 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/ 2024-01-31T04:50:18.905 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-31T04:50:18.905 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-31T04:50:18.905 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-31T04:50:18.905 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-31T04:50:18.905 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-31T04:50:18.905 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-31T04:50:18.906 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-31T04:50:18.906 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-31T04:50:18.906 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-31T04:50:18.906 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-31T04:50:18.906 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-31T04:50:18.906 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-31T04:50:18.906 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-31T04:50:18.906 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-31T04:50:18.906 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-31T04:50:18.906 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-01-31T04:50:18.906 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-31T04:50:18.906 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-31T04:50:18.906 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-31T04:50:18.906 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/ 2024-01-31T04:50:18.907 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/ipwireless/ 2024-01-31T04:50:18.907 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-31T04:50:18.907 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/moxa.ko 2024-01-31T04:50:18.907 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 50953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/mxser.ko 2024-01-31T04:50:18.907 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 108601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/n_gsm.ko 2024-01-31T04:50:18.907 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/n_hdlc.ko 2024-01-31T04:50:18.907 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/nozomi.ko 2024-01-31T04:50:18.907 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/ 2024-01-31T04:50:18.907 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/8250/ 2024-01-31T04:50:18.907 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-01-31T04:50:18.907 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-31T04:50:18.907 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-01-31T04:50:18.907 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/altera_uart.ko 2024-01-31T04:50:18.907 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/arc_uart.ko 2024-01-31T04:50:18.907 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 72425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-01-31T04:50:18.908 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/jsm/ 2024-01-31T04:50:18.908 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 103073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-31T04:50:18.908 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/rp2.ko 2024-01-31T04:50:18.908 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/sc16is7xx.ko 2024-01-31T04:50:18.908 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/ 2024-01-31T04:50:18.908 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/core/ 2024-01-31T04:50:18.908 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 535985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-31T04:50:18.908 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/host/ 2024-01-31T04:50:18.908 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-31T04:50:18.908 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-01-31T04:50:18.908 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/ 2024-01-31T04:50:18.908 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio.ko 2024-01-31T04:50:18.908 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_aec.ko 2024-01-31T04:50:18.908 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_cif.ko 2024-01-31T04:50:18.909 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_dmem_genirq.ko 2024-01-31T04:50:18.909 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_mf624.ko 2024-01-31T04:50:18.909 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_netx.ko 2024-01-31T04:50:18.909 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_pci_generic.ko 2024-01-31T04:50:18.909 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-01-31T04:50:18.909 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_sercos3.ko 2024-01-31T04:50:18.909 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/ 2024-01-31T04:50:18.909 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/c67x00/ 2024-01-31T04:50:18.909 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/c67x00/c67x00.ko 2024-01-31T04:50:18.909 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ 2024-01-31T04:50:18.909 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 144617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-01-31T04:50:18.909 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-01-31T04:50:18.909 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-01-31T04:50:18.909 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-01-31T04:50:18.909 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-01-31T04:50:18.910 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/ 2024-01-31T04:50:18.910 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 87073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/cdc-acm.ko 2024-01-31T04:50:18.910 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-31T04:50:18.910 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/usblp.ko 2024-01-31T04:50:18.910 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/usbtmc.ko 2024-01-31T04:50:18.910 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/common/ 2024-01-31T04:50:18.910 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/common/ulpi.ko 2024-01-31T04:50:18.910 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc2/ 2024-01-31T04:50:18.910 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-01-31T04:50:18.910 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/ 2024-01-31T04:50:18.910 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-01-31T04:50:18.910 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-01-31T04:50:18.910 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 454385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/dwc3.ko 2024-01-31T04:50:18.910 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/ 2024-01-31T04:50:18.910 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/ 2024-01-31T04:50:18.911 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/u_ether.ko 2024-01-31T04:50:18.911 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/u_serial.ko 2024-01-31T04:50:18.911 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-01-31T04:50:18.911 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-01-31T04:50:18.911 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-01-31T04:50:18.911 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-01-31T04:50:18.911 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 92489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-01-31T04:50:18.911 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-01-31T04:50:18.911 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 122081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-01-31T04:50:18.911 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-01-31T04:50:18.911 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-01-31T04:50:18.911 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-01-31T04:50:18.911 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 57729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-01-31T04:50:18.911 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 85609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-01-31T04:50:18.912 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-01-31T04:50:18.912 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-01-31T04:50:18.912 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-01-31T04:50:18.912 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/ 2024-01-31T04:50:18.912 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-01-31T04:50:18.912 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-01-31T04:50:18.912 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-01-31T04:50:18.912 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-01-31T04:50:18.912 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-01-31T04:50:18.912 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-01-31T04:50:18.912 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-01-31T04:50:18.912 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-01-31T04:50:18.912 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-01-31T04:50:18.912 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-01-31T04:50:18.912 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-01-31T04:50:18.913 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-01-31T04:50:18.913 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 62361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-01-31T04:50:18.913 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-01-31T04:50:18.913 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 161225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/libcomposite.ko 2024-01-31T04:50:18.913 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/ 2024-01-31T04:50:18.913 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-01-31T04:50:18.913 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/bdc/ 2024-01-31T04:50:18.913 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 157681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-01-31T04:50:18.913 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-01-31T04:50:18.913 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-01-31T04:50:18.913 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 69705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-01-31T04:50:18.913 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-01-31T04:50:18.913 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 76057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/net2272.ko 2024-01-31T04:50:18.913 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 75073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/net2280.ko 2024-01-31T04:50:18.913 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 73169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-01-31T04:50:18.914 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 65809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-01-31T04:50:18.914 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-01-31T04:50:18.914 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 81505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-01-31T04:50:18.914 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 156409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-01-31T04:50:18.914 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/ 2024-01-31T04:50:18.914 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/bcma-hcd.ko 2024-01-31T04:50:18.914 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 80113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/isp116x-hcd.ko 2024-01-31T04:50:18.914 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 87353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-01-31T04:50:18.914 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-01-31T04:50:18.914 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-31T04:50:18.914 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/sl811_cs.ko 2024-01-31T04:50:18.914 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/ssb-hcd.ko 2024-01-31T04:50:18.914 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-01-31T04:50:18.914 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/image/ 2024-01-31T04:50:18.915 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/image/mdc800.ko 2024-01-31T04:50:18.915 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/image/microtek.ko 2024-01-31T04:50:18.915 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ 2024-01-31T04:50:18.915 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/adutux.ko 2024-01-31T04:50:18.915 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/appledisplay.ko 2024-01-31T04:50:18.915 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-01-31T04:50:18.915 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/cytherm.ko 2024-01-31T04:50:18.915 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ehset.ko 2024-01-31T04:50:18.915 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/emi26.ko 2024-01-31T04:50:18.915 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/emi62.ko 2024-01-31T04:50:18.915 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ezusb.ko 2024-01-31T04:50:18.915 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/idmouse.ko 2024-01-31T04:50:18.915 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/iowarrior.ko 2024-01-31T04:50:18.915 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-31T04:50:18.915 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ldusb.ko 2024-01-31T04:50:18.916 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/legousbtower.ko 2024-01-31T04:50:18.916 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/lvstest.ko 2024-01-31T04:50:18.916 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/sisusbvga/ 2024-01-31T04:50:18.916 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 64841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-31T04:50:18.916 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-31T04:50:18.916 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usb3503.ko 2024-01-31T04:50:18.916 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usblcd.ko 2024-01-31T04:50:18.916 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-31T04:50:18.916 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usbtest.ko 2024-01-31T04:50:18.916 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/uss720.ko 2024-01-31T04:50:18.916 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/yurex.ko 2024-01-31T04:50:18.916 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/mon/ 2024-01-31T04:50:18.916 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 72953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/mon/usbmon.ko 2024-01-31T04:50:18.916 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/musb/ 2024-01-31T04:50:18.917 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 301697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/musb/musb_hdrc.ko 2024-01-31T04:50:18.917 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/ 2024-01-31T04:50:18.917 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-generic.ko 2024-01-31T04:50:18.917 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-01-31T04:50:18.917 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-isp1301.ko 2024-01-31T04:50:18.917 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-tahvo.ko 2024-01-31T04:50:18.917 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ 2024-01-31T04:50:18.917 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/aircable.ko 2024-01-31T04:50:18.917 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ark3116.ko 2024-01-31T04:50:18.917 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-31T04:50:18.917 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ch341.ko 2024-01-31T04:50:18.917 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/cp210x.ko 2024-01-31T04:50:18.917 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/cyberjack.ko 2024-01-31T04:50:18.917 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-31T04:50:18.918 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-31T04:50:18.918 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/empeg.ko 2024-01-31T04:50:18.918 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/f81232.ko 2024-01-31T04:50:18.918 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 175193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-31T04:50:18.918 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-31T04:50:18.918 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 137081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-31T04:50:18.918 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 124833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/io_ti.ko 2024-01-31T04:50:18.918 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ipaq.ko 2024-01-31T04:50:18.918 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ipw.ko 2024-01-31T04:50:18.918 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ir-usb.ko 2024-01-31T04:50:18.918 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-31T04:50:18.918 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 107521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/keyspan.ko 2024-01-31T04:50:18.918 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-31T04:50:18.918 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-31T04:50:18.918 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-31T04:50:18.919 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mct_u232.ko 2024-01-31T04:50:18.919 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/metro-usb.ko 2024-01-31T04:50:18.919 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mos7720.ko 2024-01-31T04:50:18.919 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 78217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mos7840.ko 2024-01-31T04:50:18.919 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mxuport.ko 2024-01-31T04:50:18.919 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/navman.ko 2024-01-31T04:50:18.919 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/omninet.ko 2024-01-31T04:50:18.919 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/opticon.ko 2024-01-31T04:50:18.919 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 191801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/option.ko 2024-01-31T04:50:18.919 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/oti6858.ko 2024-01-31T04:50:18.919 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/pl2303.ko 2024-01-31T04:50:18.919 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/qcaux.ko 2024-01-31T04:50:18.919 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/qcserial.ko 2024-01-31T04:50:18.919 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/quatech2.ko 2024-01-31T04:50:18.920 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/safe_serial.ko 2024-01-31T04:50:18.920 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 51625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/sierra.ko 2024-01-31T04:50:18.920 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-31T04:50:18.920 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ssu100.ko 2024-01-31T04:50:18.920 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/symbolserial.ko 2024-01-31T04:50:18.920 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-31T04:50:18.920 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-31T04:50:18.920 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usb_debug.ko 2024-01-31T04:50:18.920 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-31T04:50:18.920 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 125609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usbserial.ko 2024-01-31T04:50:18.920 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/visor.ko 2024-01-31T04:50:18.920 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/whiteheat.ko 2024-01-31T04:50:18.920 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/wishbone-serial.ko 2024-01-31T04:50:18.920 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-31T04:50:18.921 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ 2024-01-31T04:50:18.921 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 52913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/uas.ko 2024-01-31T04:50:18.921 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-31T04:50:18.921 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-31T04:50:18.921 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-31T04:50:18.921 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-31T04:50:18.921 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-31T04:50:18.921 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-31T04:50:18.921 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-31T04:50:18.921 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-karma.ko 2024-01-31T04:50:18.921 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-31T04:50:18.921 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-31T04:50:18.921 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-31T04:50:18.921 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-31T04:50:18.921 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-31T04:50:18.922 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 180225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/usb-storage.ko 2024-01-31T04:50:18.922 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/ 2024-01-31T04:50:18.922 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 67481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-31T04:50:18.922 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 71097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-31T04:50:18.922 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 103977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-31T04:50:18.922 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/ 2024-01-31T04:50:18.922 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/pci/ 2024-01-31T04:50:18.922 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 154297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-31T04:50:18.922 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-31T04:50:18.922 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 103737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/vfio.ko 2024-01-31T04:50:18.922 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 77609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-31T04:50:18.922 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/ 2024-01-31T04:50:18.922 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 113785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost.ko 2024-01-31T04:50:18.922 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-31T04:50:18.922 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost_net.ko 2024-01-31T04:50:18.923 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost_scsi.ko 2024-01-31T04:50:18.923 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/ 2024-01-31T04:50:18.923 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/ 2024-01-31T04:50:18.923 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-01-31T04:50:18.923 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/aat2870_bl.ko 2024-01-31T04:50:18.923 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/adp5520_bl.ko 2024-01-31T04:50:18.923 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/adp8860_bl.ko 2024-01-31T04:50:18.923 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/adp8870_bl.ko 2024-01-31T04:50:18.923 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/apple_bl.ko 2024-01-31T04:50:18.923 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/as3711_bl.ko 2024-01-31T04:50:18.923 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/bd6107.ko 2024-01-31T04:50:18.923 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/da903x_bl.ko 2024-01-31T04:50:18.923 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/da9052_bl.ko 2024-01-31T04:50:18.923 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/gpio_backlight.ko 2024-01-31T04:50:18.924 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/kb3886_bl.ko 2024-01-31T04:50:18.924 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lcd.ko 2024-01-31T04:50:18.924 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lm3533_bl.ko 2024-01-31T04:50:18.924 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lm3639_bl.ko 2024-01-31T04:50:18.924 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lv5207lp.ko 2024-01-31T04:50:18.924 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/max8925_bl.ko 2024-01-31T04:50:18.924 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/pandora_bl.ko 2024-01-31T04:50:18.924 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-01-31T04:50:18.924 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-31T04:50:18.924 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/wm831x_bl.ko 2024-01-31T04:50:18.924 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/ 2024-01-31T04:50:18.924 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/ 2024-01-31T04:50:18.924 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/ds2482.ko 2024-01-31T04:50:18.924 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/ds2490.ko 2024-01-31T04:50:18.924 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/matrox_w1.ko 2024-01-31T04:50:18.925 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/w1-gpio.ko 2024-01-31T04:50:18.925 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/ 2024-01-31T04:50:18.925 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-31T04:50:18.925 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-31T04:50:18.925 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-31T04:50:18.925 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-31T04:50:18.925 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-31T04:50:18.925 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-31T04:50:18.925 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-31T04:50:18.925 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-31T04:50:18.925 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-31T04:50:18.925 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-31T04:50:18.925 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-31T04:50:18.925 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 102673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/wire.ko 2024-01-31T04:50:18.925 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ 2024-01-31T04:50:18.926 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/acquirewdt.ko 2024-01-31T04:50:18.926 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/advantechwdt.ko 2024-01-31T04:50:18.926 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-31T04:50:18.926 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-31T04:50:18.926 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/cpu5wdt.ko 2024-01-31T04:50:18.926 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/da9052_wdt.ko 2024-01-31T04:50:18.926 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/da9055_wdt.ko 2024-01-31T04:50:18.926 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/da9063_wdt.ko 2024-01-31T04:50:18.926 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/dw_wdt.ko 2024-01-31T04:50:18.926 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/eurotechwdt.ko 2024-01-31T04:50:18.926 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-31T04:50:18.926 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/hpwdt.ko 2024-01-31T04:50:18.926 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/i6300esb.ko 2024-01-31T04:50:18.926 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-31T04:50:18.926 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-31T04:50:18.927 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ib700wdt.ko 2024-01-31T04:50:18.927 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ibmasr.ko 2024-01-31T04:50:18.927 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-31T04:50:18.927 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-31T04:50:18.927 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/it87_wdt.ko 2024-01-31T04:50:18.927 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/kempld_wdt.ko 2024-01-31T04:50:18.927 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/machzwd.ko 2024-01-31T04:50:18.927 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/mena21_wdt.ko 2024-01-31T04:50:18.927 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-01-31T04:50:18.927 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/nv_tco.ko 2024-01-31T04:50:18.927 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-01-31T04:50:18.927 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/pc87413_wdt.ko 2024-01-31T04:50:18.927 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-31T04:50:18.927 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-31T04:50:18.927 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/retu_wdt.ko 2024-01-31T04:50:18.928 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-01-31T04:50:18.928 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-01-31T04:50:18.928 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-31T04:50:18.928 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sc1200wdt.ko 2024-01-31T04:50:18.928 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-31T04:50:18.928 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-01-31T04:50:18.928 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/softdog.ko 2024-01-31T04:50:18.928 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-31T04:50:18.928 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/twl4030_wdt.ko 2024-01-31T04:50:18.928 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/via_wdt.ko 2024-01-31T04:50:18.928 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-31T04:50:18.929 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-31T04:50:18.929 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-31T04:50:18.929 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wafer5823wdt.ko 2024-01-31T04:50:18.929 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wdt_pci.ko 2024-01-31T04:50:18.929 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wm831x_wdt.ko 2024-01-31T04:50:18.929 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wm8350_wdt.ko 2024-01-31T04:50:18.929 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/xen_wdt.ko 2024-01-31T04:50:18.929 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/ 2024-01-31T04:50:18.929 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-evtchn.ko 2024-01-31T04:50:18.929 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-gntalloc.ko 2024-01-31T04:50:18.929 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-gntdev.ko 2024-01-31T04:50:18.929 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-pciback/ 2024-01-31T04:50:18.929 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 176441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-31T04:50:18.929 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-privcmd.ko 2024-01-31T04:50:18.929 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 71249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-scsiback.ko 2024-01-31T04:50:18.930 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xenfs/ 2024-01-31T04:50:18.930 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-31T04:50:18.930 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ 2024-01-31T04:50:18.930 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/9p/ 2024-01-31T04:50:18.930 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 166753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/9p/9p.ko 2024-01-31T04:50:18.930 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/adfs/ 2024-01-31T04:50:18.930 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/adfs/adfs.ko 2024-01-31T04:50:18.930 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/affs/ 2024-01-31T04:50:18.930 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 163449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/affs/affs.ko 2024-01-31T04:50:18.930 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/afs/ 2024-01-31T04:50:18.930 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 935033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/afs/kafs.ko 2024-01-31T04:50:18.930 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/autofs/ 2024-01-31T04:50:18.930 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 103401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/autofs/autofs4.ko 2024-01-31T04:50:18.930 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/befs/ 2024-01-31T04:50:18.930 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 64681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/befs/befs.ko 2024-01-31T04:50:18.931 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/bfs/ 2024-01-31T04:50:18.931 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/bfs/bfs.ko 2024-01-31T04:50:18.931 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/binfmt_misc.ko 2024-01-31T04:50:18.931 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/btrfs/ 2024-01-31T04:50:18.931 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 3455857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/btrfs/btrfs.ko 2024-01-31T04:50:18.931 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cachefiles/ 2024-01-31T04:50:18.931 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 306009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cachefiles/cachefiles.ko 2024-01-31T04:50:18.931 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ceph/ 2024-01-31T04:50:18.931 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1336985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ceph/ceph.ko 2024-01-31T04:50:18.931 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/coda/ 2024-01-31T04:50:18.931 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/coda/coda.ko 2024-01-31T04:50:18.931 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/configfs/ 2024-01-31T04:50:18.931 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 108641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/configfs/configfs.ko 2024-01-31T04:50:18.931 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cramfs/ 2024-01-31T04:50:18.932 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cramfs/cramfs.ko 2024-01-31T04:50:18.932 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/dlm/ 2024-01-31T04:50:18.932 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 644073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/dlm/dlm.ko 2024-01-31T04:50:18.932 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/efs/ 2024-01-31T04:50:18.932 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/efs/efs.ko 2024-01-31T04:50:18.932 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/f2fs/ 2024-01-31T04:50:18.932 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1506641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/f2fs/f2fs.ko 2024-01-31T04:50:18.932 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fat/ 2024-01-31T04:50:18.932 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fat/msdos.ko 2024-01-31T04:50:18.932 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/freevxfs/ 2024-01-31T04:50:18.932 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/freevxfs/freevxfs.ko 2024-01-31T04:50:18.932 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fscache/ 2024-01-31T04:50:18.932 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 226481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fscache/fscache.ko 2024-01-31T04:50:18.932 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fuse/ 2024-01-31T04:50:18.932 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fuse/cuse.ko 2024-01-31T04:50:18.933 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/gfs2/ 2024-01-31T04:50:18.933 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1229913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/gfs2/gfs2.ko 2024-01-31T04:50:18.933 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfs/ 2024-01-31T04:50:18.933 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 141985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfs/hfs.ko 2024-01-31T04:50:18.933 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfsplus/ 2024-01-31T04:50:18.933 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 223225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfsplus/hfsplus.ko 2024-01-31T04:50:18.933 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hpfs/ 2024-01-31T04:50:18.933 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 193569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hpfs/hpfs.ko 2024-01-31T04:50:18.933 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/isofs/ 2024-01-31T04:50:18.933 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 74785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/isofs/isofs.ko 2024-01-31T04:50:18.933 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/jfs/ 2024-01-31T04:50:18.933 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 419881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/jfs/jfs.ko 2024-01-31T04:50:18.933 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/lockd/ 2024-01-31T04:50:18.933 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 282049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/lockd/lockd.ko 2024-01-31T04:50:18.934 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/minix/ 2024-01-31T04:50:18.934 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/minix/minix.ko 2024-01-31T04:50:18.934 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/netfs/ 2024-01-31T04:50:18.934 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 124649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/netfs/netfs.ko 2024-01-31T04:50:18.934 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/ 2024-01-31T04:50:18.934 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/blocklayout/ 2024-01-31T04:50:18.934 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 81513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-31T04:50:18.934 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/filelayout/ 2024-01-31T04:50:18.934 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-31T04:50:18.934 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/flexfilelayout/ 2024-01-31T04:50:18.934 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 117465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-31T04:50:18.934 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1057969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfs.ko 2024-01-31T04:50:18.934 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfsv2.ko 2024-01-31T04:50:18.934 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 120265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfsv3.ko 2024-01-31T04:50:18.934 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 2042153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfsv4.ko 2024-01-31T04:50:18.935 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs_common/ 2024-01-31T04:50:18.935 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs_common/grace.ko 2024-01-31T04:50:18.935 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs_common/nfs_acl.ko 2024-01-31T04:50:18.935 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfsd/ 2024-01-31T04:50:18.935 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1563929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfsd/nfsd.ko 2024-01-31T04:50:18.935 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nilfs2/ 2024-01-31T04:50:18.935 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 590713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nilfs2/nilfs2.ko 2024-01-31T04:50:18.935 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/ 2024-01-31T04:50:18.935 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-celtic.ko 2024-01-31T04:50:18.935 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-centeuro.ko 2024-01-31T04:50:18.935 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-croatian.ko 2024-01-31T04:50:18.935 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-cyrillic.ko 2024-01-31T04:50:18.935 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-gaelic.ko 2024-01-31T04:50:18.935 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-greek.ko 2024-01-31T04:50:18.935 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-iceland.ko 2024-01-31T04:50:18.936 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-inuit.ko 2024-01-31T04:50:18.936 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-roman.ko 2024-01-31T04:50:18.936 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-romanian.ko 2024-01-31T04:50:18.936 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-turkish.ko 2024-01-31T04:50:18.936 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_ascii.ko 2024-01-31T04:50:18.936 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp1250.ko 2024-01-31T04:50:18.936 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp1251.ko 2024-01-31T04:50:18.936 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp1255.ko 2024-01-31T04:50:18.936 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp737.ko 2024-01-31T04:50:18.936 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp775.ko 2024-01-31T04:50:18.936 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp850.ko 2024-01-31T04:50:18.936 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp852.ko 2024-01-31T04:50:18.936 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp855.ko 2024-01-31T04:50:18.936 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp857.ko 2024-01-31T04:50:18.937 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp860.ko 2024-01-31T04:50:18.937 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp861.ko 2024-01-31T04:50:18.937 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp862.ko 2024-01-31T04:50:18.937 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp863.ko 2024-01-31T04:50:18.937 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp864.ko 2024-01-31T04:50:18.937 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp865.ko 2024-01-31T04:50:18.937 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp866.ko 2024-01-31T04:50:18.937 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp869.ko 2024-01-31T04:50:18.937 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp874.ko 2024-01-31T04:50:18.937 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 94137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp932.ko 2024-01-31T04:50:18.937 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 142673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp936.ko 2024-01-31T04:50:18.937 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 165745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp949.ko 2024-01-31T04:50:18.937 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 118121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp950.ko 2024-01-31T04:50:18.937 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_euc-jp.ko 2024-01-31T04:50:18.937 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-1.ko 2024-01-31T04:50:18.938 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-13.ko 2024-01-31T04:50:18.938 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-14.ko 2024-01-31T04:50:18.938 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-15.ko 2024-01-31T04:50:18.938 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-2.ko 2024-01-31T04:50:18.938 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-3.ko 2024-01-31T04:50:18.938 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-4.ko 2024-01-31T04:50:18.938 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-5.ko 2024-01-31T04:50:18.938 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-6.ko 2024-01-31T04:50:18.938 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-7.ko 2024-01-31T04:50:18.938 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-9.ko 2024-01-31T04:50:18.938 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_koi8-r.ko 2024-01-31T04:50:18.938 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_koi8-ru.ko 2024-01-31T04:50:18.938 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_koi8-u.ko 2024-01-31T04:50:18.938 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-31T04:50:18.939 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_utf8.ko 2024-01-31T04:50:18.939 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ntfs/ 2024-01-31T04:50:18.939 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 220553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ntfs/ntfs.ko 2024-01-31T04:50:18.939 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ 2024-01-31T04:50:18.939 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/cluster/ 2024-01-31T04:50:18.939 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 244737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-31T04:50:18.939 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlm/ 2024-01-31T04:50:18.939 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 440737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-31T04:50:18.939 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlmfs/ 2024-01-31T04:50:18.939 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-31T04:50:18.939 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 2593521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2.ko 2024-01-31T04:50:18.939 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-31T04:50:18.939 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-31T04:50:18.939 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-31T04:50:18.939 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/omfs/ 2024-01-31T04:50:18.940 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/omfs/omfs.ko 2024-01-31T04:50:18.940 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/overlayfs/ 2024-01-31T04:50:18.940 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 370697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/overlayfs/overlay.ko 2024-01-31T04:50:18.940 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/pstore/ 2024-01-31T04:50:18.940 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/pstore/ramoops.ko 2024-01-31T04:50:18.940 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx4/ 2024-01-31T04:50:18.940 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx4/qnx4.ko 2024-01-31T04:50:18.940 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx6/ 2024-01-31T04:50:18.940 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 46689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx6/qnx6.ko 2024-01-31T04:50:18.940 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/ 2024-01-31T04:50:18.940 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/quota_tree.ko 2024-01-31T04:50:18.940 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/quota_v1.ko 2024-01-31T04:50:18.940 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/quota_v2.ko 2024-01-31T04:50:18.940 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/reiserfs/ 2024-01-31T04:50:18.941 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 532025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/reiserfs/reiserfs.ko 2024-01-31T04:50:18.941 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/romfs/ 2024-01-31T04:50:18.941 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/romfs/romfs.ko 2024-01-31T04:50:18.941 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/ 2024-01-31T04:50:18.941 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/client/ 2024-01-31T04:50:18.941 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 2683249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/client/cifs.ko 2024-01-31T04:50:18.941 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/common/ 2024-01-31T04:50:18.941 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/common/cifs_arc4.ko 2024-01-31T04:50:18.941 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/common/cifs_md4.ko 2024-01-31T04:50:18.941 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/squashfs/ 2024-01-31T04:50:18.941 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 134777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/squashfs/squashfs.ko 2024-01-31T04:50:18.941 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/sysv/ 2024-01-31T04:50:18.941 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 91249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/sysv/sysv.ko 2024-01-31T04:50:18.941 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/udf/ 2024-01-31T04:50:18.941 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 248425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/udf/udf.ko 2024-01-31T04:50:18.941 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ufs/ 2024-01-31T04:50:18.942 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 162537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ufs/ufs.ko 2024-01-31T04:50:18.942 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/xfs/ 2024-01-31T04:50:18.942 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 4014433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/xfs/xfs.ko 2024-01-31T04:50:18.979 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/ 2024-01-31T04:50:18.979 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/locking/ 2024-01-31T04:50:18.979 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 80585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/locking/locktorture.ko 2024-01-31T04:50:18.979 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/time/ 2024-01-31T04:50:18.979 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/time/test_udelay.ko 2024-01-31T04:50:18.979 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/torture.ko 2024-01-31T04:50:18.979 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ 2024-01-31T04:50:18.979 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 6833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crc-itu-t.ko 2024-01-31T04:50:18.979 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 6529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crc7.ko 2024-01-31T04:50:18.979 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crc8.ko 2024-01-31T04:50:18.979 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crypto/ 2024-01-31T04:50:18.979 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crypto/libarc4.ko 2024-01-31T04:50:18.980 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crypto/libdes.ko 2024-01-31T04:50:18.980 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/interval_tree_test.ko 2024-01-31T04:50:18.980 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/libcrc32c.ko 2024-01-31T04:50:18.980 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lru_cache.ko 2024-01-31T04:50:18.980 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lz4/ 2024-01-31T04:50:18.980 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lz4/lz4_compress.ko 2024-01-31T04:50:18.980 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lz4/lz4hc_compress.ko 2024-01-31T04:50:18.980 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/math/ 2024-01-31T04:50:18.980 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 6617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/math/cordic.ko 2024-01-31T04:50:18.980 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/memory-notifier-error-inject.ko 2024-01-31T04:50:18.980 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/notifier-error-inject.ko 2024-01-31T04:50:18.980 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/percpu_test.ko 2024-01-31T04:50:18.980 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/pm-notifier-error-inject.ko 2024-01-31T04:50:18.980 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/raid6/ 2024-01-31T04:50:18.981 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 143353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/raid6/raid6_pq.ko 2024-01-31T04:50:18.981 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/rbtree_test.ko 2024-01-31T04:50:18.981 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/reed_solomon/ 2024-01-31T04:50:18.981 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-31T04:50:18.981 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test-kstrtox.ko 2024-01-31T04:50:18.981 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test-string_helpers.ko 2024-01-31T04:50:18.981 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 4876633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_bpf.ko 2024-01-31T04:50:18.981 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_firmware.ko 2024-01-31T04:50:18.981 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 6369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_module.ko 2024-01-31T04:50:18.981 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_user_copy.ko 2024-01-31T04:50:18.981 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ts_bm.ko 2024-01-31T04:50:18.981 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ts_fsm.ko 2024-01-31T04:50:18.981 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ts_kmp.ko 2024-01-31T04:50:18.981 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/xz/ 2024-01-31T04:50:18.982 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/xz/xz_dec_test.ko 2024-01-31T04:50:18.982 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/mm/ 2024-01-31T04:50:18.982 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/mm/hwpoison-inject.ko 2024-01-31T04:50:18.982 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ 2024-01-31T04:50:18.982 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/ 2024-01-31T04:50:18.982 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 55737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/6lowpan.ko 2024-01-31T04:50:18.982 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_dest.ko 2024-01-31T04:50:18.982 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_fragment.ko 2024-01-31T04:50:18.982 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_hop.ko 2024-01-31T04:50:18.982 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 6985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-31T04:50:18.982 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_mobility.ko 2024-01-31T04:50:18.982 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_routing.ko 2024-01-31T04:50:18.982 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_udp.ko 2024-01-31T04:50:18.982 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/ 2024-01-31T04:50:18.982 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/garp.ko 2024-01-31T04:50:18.983 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/mrp.ko 2024-01-31T04:50:18.983 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/p8022.ko 2024-01-31T04:50:18.983 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/psnap.ko 2024-01-31T04:50:18.983 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/stp.ko 2024-01-31T04:50:18.983 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/8021q/ 2024-01-31T04:50:18.983 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 82593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/8021q/8021q.ko 2024-01-31T04:50:18.983 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/ 2024-01-31T04:50:18.983 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 198905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet.ko 2024-01-31T04:50:18.983 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet_fd.ko 2024-01-31T04:50:18.983 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet_rdma.ko 2024-01-31T04:50:18.983 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet_virtio.ko 2024-01-31T04:50:18.983 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/batman-adv/ 2024-01-31T04:50:18.983 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 649977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/batman-adv/batman-adv.ko 2024-01-31T04:50:18.983 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/ 2024-01-31T04:50:18.983 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 65137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/br_netfilter.ko 2024-01-31T04:50:18.984 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 785817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/bridge.ko 2024-01-31T04:50:18.984 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ 2024-01-31T04:50:18.984 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-31T04:50:18.984 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-31T04:50:18.984 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-31T04:50:18.984 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-31T04:50:18.984 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-31T04:50:18.984 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-31T04:50:18.984 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-31T04:50:18.984 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-31T04:50:18.984 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-31T04:50:18.984 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-31T04:50:18.984 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-31T04:50:18.985 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-31T04:50:18.985 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-31T04:50:18.985 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-31T04:50:18.985 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-31T04:50:18.985 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-31T04:50:18.985 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-31T04:50:18.985 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-31T04:50:18.985 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-31T04:50:18.985 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-31T04:50:18.985 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 56033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtables.ko 2024-01-31T04:50:18.985 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-31T04:50:18.985 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-31T04:50:18.985 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ceph/ 2024-01-31T04:50:18.985 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1046753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ceph/libceph.ko 2024-01-31T04:50:18.985 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/core/ 2024-01-31T04:50:18.986 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 126041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/core/pktgen.ko 2024-01-31T04:50:18.986 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/ 2024-01-31T04:50:18.986 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 194529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp.ko 2024-01-31T04:50:18.986 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp_diag.ko 2024-01-31T04:50:18.986 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 58841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp_ipv4.ko 2024-01-31T04:50:18.986 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 60873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp_ipv6.ko 2024-01-31T04:50:18.986 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/ 2024-01-31T04:50:18.986 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 390129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/dsa_core.ko 2024-01-31T04:50:18.986 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_brcm.ko 2024-01-31T04:50:18.986 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_dsa.ko 2024-01-31T04:50:18.986 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_none.ko 2024-01-31T04:50:18.986 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_trailer.ko 2024-01-31T04:50:18.986 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/hsr/ 2024-01-31T04:50:18.986 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 99881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/hsr/hsr.ko 2024-01-31T04:50:18.987 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/ 2024-01-31T04:50:18.987 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/6lowpan/ 2024-01-31T04:50:18.987 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 45537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-31T04:50:18.987 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 255849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/ieee802154.ko 2024-01-31T04:50:18.987 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 47985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-31T04:50:18.987 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ 2024-01-31T04:50:18.987 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ah4.ko 2024-01-31T04:50:18.987 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/esp4.ko 2024-01-31T04:50:18.987 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/fou.ko 2024-01-31T04:50:18.987 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/gre.ko 2024-01-31T04:50:18.987 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/inet_diag.ko 2024-01-31T04:50:18.987 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ip_gre.ko 2024-01-31T04:50:18.987 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ip_tunnel.ko 2024-01-31T04:50:18.987 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ip_vti.ko 2024-01-31T04:50:18.987 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ipcomp.ko 2024-01-31T04:50:18.988 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 29001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ipip.ko 2024-01-31T04:50:18.988 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ 2024-01-31T04:50:18.988 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-31T04:50:18.988 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-31T04:50:18.988 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-31T04:50:18.988 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 41929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ip_tables.ko 2024-01-31T04:50:18.988 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-31T04:50:18.988 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-01-31T04:50:18.988 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-31T04:50:18.988 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-31T04:50:18.988 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-31T04:50:18.988 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-01-31T04:50:18.988 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-31T04:50:18.988 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-31T04:50:18.988 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-31T04:50:18.989 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-31T04:50:18.989 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-31T04:50:18.989 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-31T04:50:18.989 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-31T04:50:18.989 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-31T04:50:18.989 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-31T04:50:18.989 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-01-31T04:50:18.989 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-31T04:50:18.989 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-31T04:50:18.989 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-31T04:50:18.989 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-31T04:50:18.989 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-31T04:50:18.989 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_bic.ko 2024-01-31T04:50:18.989 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_dctcp.ko 2024-01-31T04:50:18.990 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_diag.ko 2024-01-31T04:50:18.990 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_highspeed.ko 2024-01-31T04:50:18.990 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_htcp.ko 2024-01-31T04:50:18.990 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_hybla.ko 2024-01-31T04:50:18.990 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_illinois.ko 2024-01-31T04:50:18.990 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_lp.ko 2024-01-31T04:50:18.990 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_scalable.ko 2024-01-31T04:50:18.990 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_vegas.ko 2024-01-31T04:50:18.990 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_veno.ko 2024-01-31T04:50:18.990 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_westwood.ko 2024-01-31T04:50:18.990 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_yeah.ko 2024-01-31T04:50:18.990 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tunnel4.ko 2024-01-31T04:50:18.990 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/udp_diag.ko 2024-01-31T04:50:18.990 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/udp_tunnel.ko 2024-01-31T04:50:18.991 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-31T04:50:18.991 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ 2024-01-31T04:50:18.991 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ah6.ko 2024-01-31T04:50:18.991 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/esp6.ko 2024-01-31T04:50:18.991 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/fou6.ko 2024-01-31T04:50:18.991 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 80105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_gre.ko 2024-01-31T04:50:18.991 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 93977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_tunnel.ko 2024-01-31T04:50:18.991 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-31T04:50:18.991 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_vti.ko 2024-01-31T04:50:18.991 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ipcomp6.ko 2024-01-31T04:50:18.991 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/mip6.ko 2024-01-31T04:50:18.991 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ 2024-01-31T04:50:18.991 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-31T04:50:18.991 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-01-31T04:50:18.991 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-31T04:50:18.992 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-31T04:50:18.992 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-31T04:50:18.992 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-31T04:50:18.992 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-31T04:50:18.992 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-31T04:50:18.992 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-31T04:50:18.992 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-31T04:50:18.992 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-31T04:50:18.992 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-31T04:50:18.992 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-31T04:50:18.992 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-31T04:50:18.992 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-31T04:50:18.992 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-31T04:50:18.992 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-31T04:50:18.992 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-31T04:50:18.993 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-31T04:50:18.993 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-31T04:50:18.993 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-31T04:50:18.993 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-31T04:50:18.993 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-31T04:50:18.993 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-31T04:50:18.993 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-31T04:50:18.993 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 74921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/sit.ko 2024-01-31T04:50:18.993 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/tunnel6.ko 2024-01-31T04:50:18.993 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-31T04:50:18.993 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/key/ 2024-01-31T04:50:18.993 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 84433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/key/af_key.ko 2024-01-31T04:50:18.993 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/ 2024-01-31T04:50:18.993 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 125305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_core.ko 2024-01-31T04:50:18.993 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-31T04:50:18.994 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 25953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_eth.ko 2024-01-31T04:50:18.994 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_ip.ko 2024-01-31T04:50:18.994 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_ip6.ko 2024-01-31T04:50:18.994 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_netlink.ko 2024-01-31T04:50:18.994 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 53321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_ppp.ko 2024-01-31T04:50:18.994 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/lapb/ 2024-01-31T04:50:18.994 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/lapb/lapb.ko 2024-01-31T04:50:18.994 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/llc/ 2024-01-31T04:50:18.994 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/llc/llc.ko 2024-01-31T04:50:18.994 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 268265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/llc/llc2.ko 2024-01-31T04:50:18.994 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mac802154/ 2024-01-31T04:50:18.994 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 290441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mac802154/mac802154.ko 2024-01-31T04:50:18.994 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mpls/ 2024-01-31T04:50:18.994 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mpls/mpls_gso.ko 2024-01-31T04:50:18.995 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ 2024-01-31T04:50:18.995 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ 2024-01-31T04:50:18.995 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 118801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set.ko 2024-01-31T04:50:18.995 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-31T04:50:18.995 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-31T04:50:18.995 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-31T04:50:18.995 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-31T04:50:18.995 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 100633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-31T04:50:18.995 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 102881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-31T04:50:18.995 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 102649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-31T04:50:18.995 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 112017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-31T04:50:18.995 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 59585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-31T04:50:18.995 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 108761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-31T04:50:18.995 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 112297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-31T04:50:18.995 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 112649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-31T04:50:18.996 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 110753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-31T04:50:18.996 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 113633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-31T04:50:18.996 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-31T04:50:18.996 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ 2024-01-31T04:50:18.996 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 412561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-31T04:50:18.996 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-31T04:50:18.996 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-31T04:50:18.996 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-31T04:50:18.996 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-31T04:50:18.996 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-31T04:50:18.996 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-31T04:50:18.996 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-31T04:50:18.996 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-31T04:50:18.996 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-31T04:50:18.997 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-31T04:50:18.997 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-31T04:50:18.997 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-31T04:50:18.997 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-31T04:50:18.997 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conncount.ko 2024-01-31T04:50:18.997 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 411489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack.ko 2024-01-31T04:50:18.997 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-31T04:50:18.997 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-31T04:50:18.997 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-31T04:50:18.997 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 118193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-31T04:50:18.997 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-31T04:50:18.997 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-31T04:50:18.997 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 108105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-31T04:50:18.997 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-31T04:50:18.997 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-31T04:50:18.998 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-31T04:50:18.998 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-31T04:50:18.998 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-31T04:50:18.998 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-31T04:50:18.998 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 91737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_flow_table.ko 2024-01-31T04:50:18.998 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-31T04:50:18.998 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 37297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_log_syslog.ko 2024-01-31T04:50:18.998 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 96545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat.ko 2024-01-31T04:50:18.998 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-31T04:50:18.998 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-31T04:50:18.998 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_irc.ko 2024-01-31T04:50:18.998 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_sip.ko 2024-01-31T04:50:18.998 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-31T04:50:18.998 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 44297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-31T04:50:18.998 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 614025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_tables.ko 2024-01-31T04:50:18.999 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 42609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink.ko 2024-01-31T04:50:18.999 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-31T04:50:18.999 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-01-31T04:50:18.999 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 39785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_log.ko 2024-01-31T04:50:18.999 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-31T04:50:18.999 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-31T04:50:18.999 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_chain_nat.ko 2024-01-31T04:50:18.999 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_compat.ko 2024-01-31T04:50:18.999 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_ct.ko 2024-01-31T04:50:18.999 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-31T04:50:18.999 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_fib.ko 2024-01-31T04:50:18.999 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-31T04:50:18.999 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_hash.ko 2024-01-31T04:50:18.999 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_limit.ko 2024-01-31T04:50:18.999 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_log.ko 2024-01-31T04:50:19.000 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_masq.ko 2024-01-31T04:50:19.000 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_nat.ko 2024-01-31T04:50:19.000 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_numgen.ko 2024-01-31T04:50:19.000 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_osf.ko 2024-01-31T04:50:19.000 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_queue.ko 2024-01-31T04:50:19.000 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_redir.ko 2024-01-31T04:50:19.000 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_reject.ko 2024-01-31T04:50:19.000 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_reject_inet.ko 2024-01-31T04:50:19.000 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_socket.ko 2024-01-31T04:50:19.000 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_synproxy.ko 2024-01-31T04:50:19.000 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_tproxy.ko 2024-01-31T04:50:19.000 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 89313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/x_tables.ko 2024-01-31T04:50:19.000 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_AUDIT.ko 2024-01-31T04:50:19.000 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-31T04:50:19.001 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-31T04:50:19.001 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-31T04:50:19.001 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 18169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CT.ko 2024-01-31T04:50:19.001 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_DSCP.ko 2024-01-31T04:50:19.001 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_HL.ko 2024-01-31T04:50:19.001 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_HMARK.ko 2024-01-31T04:50:19.001 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 38873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-31T04:50:19.001 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_LED.ko 2024-01-31T04:50:19.001 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_LOG.ko 2024-01-31T04:50:19.001 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-31T04:50:19.001 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_NETMAP.ko 2024-01-31T04:50:19.001 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_NFLOG.ko 2024-01-31T04:50:19.001 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-31T04:50:19.001 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_RATEEST.ko 2024-01-31T04:50:19.002 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-31T04:50:19.002 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_SECMARK.ko 2024-01-31T04:50:19.002 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-31T04:50:19.002 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-31T04:50:19.002 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TEE.ko 2024-01-31T04:50:19.002 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TPROXY.ko 2024-01-31T04:50:19.002 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TRACE.ko 2024-01-31T04:50:19.002 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_addrtype.ko 2024-01-31T04:50:19.002 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_bpf.ko 2024-01-31T04:50:19.002 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_cgroup.ko 2024-01-31T04:50:19.002 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_cluster.ko 2024-01-31T04:50:19.002 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_comment.ko 2024-01-31T04:50:19.002 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connbytes.ko 2024-01-31T04:50:19.002 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connlabel.ko 2024-01-31T04:50:19.002 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connlimit.ko 2024-01-31T04:50:19.003 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connmark.ko 2024-01-31T04:50:19.003 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_conntrack.ko 2024-01-31T04:50:19.003 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_cpu.ko 2024-01-31T04:50:19.003 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_dccp.ko 2024-01-31T04:50:19.003 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_devgroup.ko 2024-01-31T04:50:19.003 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_dscp.ko 2024-01-31T04:50:19.003 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_ecn.ko 2024-01-31T04:50:19.003 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_esp.ko 2024-01-31T04:50:19.003 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_hashlimit.ko 2024-01-31T04:50:19.003 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_helper.ko 2024-01-31T04:50:19.003 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_hl.ko 2024-01-31T04:50:19.003 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_ipcomp.ko 2024-01-31T04:50:19.003 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_iprange.ko 2024-01-31T04:50:19.003 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_ipvs.ko 2024-01-31T04:50:19.003 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_l2tp.ko 2024-01-31T04:50:19.004 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_length.ko 2024-01-31T04:50:19.004 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_limit.ko 2024-01-31T04:50:19.004 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_mac.ko 2024-01-31T04:50:19.004 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_mark.ko 2024-01-31T04:50:19.004 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_multiport.ko 2024-01-31T04:50:19.004 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_nat.ko 2024-01-31T04:50:19.004 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_nfacct.ko 2024-01-31T04:50:19.004 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_osf.ko 2024-01-31T04:50:19.004 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_owner.ko 2024-01-31T04:50:19.004 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_physdev.ko 2024-01-31T04:50:19.004 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_pkttype.ko 2024-01-31T04:50:19.004 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_policy.ko 2024-01-31T04:50:19.004 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_quota.ko 2024-01-31T04:50:19.004 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_rateest.ko 2024-01-31T04:50:19.005 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_realm.ko 2024-01-31T04:50:19.005 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_recent.ko 2024-01-31T04:50:19.005 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_sctp.ko 2024-01-31T04:50:19.005 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_set.ko 2024-01-31T04:50:19.005 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_socket.ko 2024-01-31T04:50:19.005 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_state.ko 2024-01-31T04:50:19.005 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_statistic.ko 2024-01-31T04:50:19.005 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_string.ko 2024-01-31T04:50:19.005 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 8553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_tcpmss.ko 2024-01-31T04:50:19.005 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_tcpudp.ko 2024-01-31T04:50:19.005 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_time.ko 2024-01-31T04:50:19.005 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_u32.ko 2024-01-31T04:50:19.005 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netlink/ 2024-01-31T04:50:19.005 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 14537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netlink/netlink_diag.ko 2024-01-31T04:50:19.005 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/nsh/ 2024-01-31T04:50:19.006 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 12425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/nsh/nsh.ko 2024-01-31T04:50:19.006 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/ 2024-01-31T04:50:19.006 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 383481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/openvswitch.ko 2024-01-31T04:50:19.006 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/vport-geneve.ko 2024-01-31T04:50:19.006 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/vport-gre.ko 2024-01-31T04:50:19.006 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/vport-vxlan.ko 2024-01-31T04:50:19.006 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/packet/ 2024-01-31T04:50:19.006 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/packet/af_packet_diag.ko 2024-01-31T04:50:19.006 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/phonet/ 2024-01-31T04:50:19.006 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 112057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/phonet/phonet.ko 2024-01-31T04:50:19.006 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/phonet/pn_pep.ko 2024-01-31T04:50:19.006 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/ 2024-01-31T04:50:19.006 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 252953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/rds.ko 2024-01-31T04:50:19.006 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 164937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/rds_rdma.ko 2024-01-31T04:50:19.006 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 68161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/rds_tcp.ko 2024-01-31T04:50:19.007 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rxrpc/ 2024-01-31T04:50:19.007 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 818777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rxrpc/rxrpc.ko 2024-01-31T04:50:19.007 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/ 2024-01-31T04:50:19.007 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_csum.ko 2024-01-31T04:50:19.007 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_gact.ko 2024-01-31T04:50:19.007 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_ipt.ko 2024-01-31T04:50:19.007 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_mirred.ko 2024-01-31T04:50:19.007 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_nat.ko 2024-01-31T04:50:19.007 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 43449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_pedit.ko 2024-01-31T04:50:19.007 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_police.ko 2024-01-31T04:50:19.007 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_simple.ko 2024-01-31T04:50:19.007 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_skbedit.ko 2024-01-31T04:50:19.007 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_vlan.ko 2024-01-31T04:50:19.007 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_basic.ko 2024-01-31T04:50:19.007 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_bpf.ko 2024-01-31T04:50:19.008 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 19281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_cgroup.ko 2024-01-31T04:50:19.008 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_flow.ko 2024-01-31T04:50:19.008 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 32377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_fw.ko 2024-01-31T04:50:19.008 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 40009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_route.ko 2024-01-31T04:50:19.008 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 61529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_u32.ko 2024-01-31T04:50:19.008 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_cmp.ko 2024-01-31T04:50:19.008 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 13409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_ipset.ko 2024-01-31T04:50:19.008 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_meta.ko 2024-01-31T04:50:19.008 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_nbyte.ko 2024-01-31T04:50:19.008 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_text.ko 2024-01-31T04:50:19.008 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_u32.ko 2024-01-31T04:50:19.008 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 21769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_choke.ko 2024-01-31T04:50:19.008 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_codel.ko 2024-01-31T04:50:19.008 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 34681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_drr.ko 2024-01-31T04:50:19.009 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_fq.ko 2024-01-31T04:50:19.009 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_fq_codel.ko 2024-01-31T04:50:19.009 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 35545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_gred.ko 2024-01-31T04:50:19.009 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 49937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_hfsc.ko 2024-01-31T04:50:19.009 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 22089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_hhf.ko 2024-01-31T04:50:19.009 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 66577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_htb.ko 2024-01-31T04:50:19.009 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_ingress.ko 2024-01-31T04:50:19.009 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 30385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_mqprio.ko 2024-01-31T04:50:19.009 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_mqprio_lib.ko 2024-01-31T04:50:19.009 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_multiq.ko 2024-01-31T04:50:19.009 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 36249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_netem.ko 2024-01-31T04:50:19.009 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 27497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_pie.ko 2024-01-31T04:50:19.009 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_plug.ko 2024-01-31T04:50:19.009 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 24841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_prio.ko 2024-01-31T04:50:19.009 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 48625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_qfq.ko 2024-01-31T04:50:19.010 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 33017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_red.ko 2024-01-31T04:50:19.010 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 26881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_sfb.ko 2024-01-31T04:50:19.010 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 31409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_sfq.ko 2024-01-31T04:50:19.010 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_tbf.ko 2024-01-31T04:50:19.010 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 28153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_teql.ko 2024-01-31T04:50:19.010 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sctp/ 2024-01-31T04:50:19.010 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 932169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sctp/sctp.ko 2024-01-31T04:50:19.010 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sctp/sctp_diag.ko 2024-01-31T04:50:19.010 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/ 2024-01-31T04:50:19.010 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/auth_gss/ 2024-01-31T04:50:19.010 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 336777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-31T04:50:19.010 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 54993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-31T04:50:19.010 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 1518417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/sunrpc.ko 2024-01-31T04:50:19.010 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/xprtrdma/ 2024-01-31T04:50:19.010 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 708281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-31T04:50:19.011 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/tipc/ 2024-01-31T04:50:19.011 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 10489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/tipc/diag.ko 2024-01-31T04:50:19.011 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 866345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/tipc/tipc.ko 2024-01-31T04:50:19.011 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/unix/ 2024-01-31T04:50:19.011 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 16033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/unix/unix_diag.ko 2024-01-31T04:50:19.011 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/ 2024-01-31T04:50:19.011 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 86417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-31T04:50:19.011 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 68049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-31T04:50:19.011 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 98017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vsock.ko 2024-01-31T04:50:19.011 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 11177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-31T04:50:19.011 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 17761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-31T04:50:19.011 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/x25/ 2024-01-31T04:50:19.011 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 125409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/x25/x25.ko 2024-01-31T04:50:19.011 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/ 2024-01-31T04:50:19.011 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/xfrm_algo.ko 2024-01-31T04:50:19.012 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 20649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-31T04:50:19.012 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 104161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/xfrm_user.ko 2024-01-31T04:50:19.012 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/virt/ 2024-01-31T04:50:19.012 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/virt/lib/ 2024-01-31T04:50:19.012 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 15537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/virt/lib/irqbypass.ko 2024-01-31T04:50:19.012 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 641009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.alias 2024-01-31T04:50:19.012 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 625033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.alias.bin 2024-01-31T04:50:19.012 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 7677 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin 2024-01-31T04:50:19.012 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 23634 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin.alias.bin 2024-01-31T04:50:19.012 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 9916 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin.bin 2024-01-31T04:50:19.012 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 70653 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin.modinfo 2024-01-31T04:50:19.012 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 147734 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.dep 2024-01-31T04:50:19.012 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 234045 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.dep.bin 2024-01-31T04:50:19.012 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 210 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.devname 2024-01-31T04:50:19.012 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 72797 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.order 2024-01-31T04:50:19.013 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 879 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.softdep 2024-01-31T04:50:19.013 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 255175 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.symbols 2024-01-31T04:50:19.013 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 309826 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.symbols.bin 2024-01-31T04:50:19.013 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/ 2024-01-31T04:50:19.013 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/share/ 2024-01-31T04:50:19.013 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/share/doc/ 2024-01-31T04:50:19.013 INFO:teuthology.orchestra.run.smithi049.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/share/doc/linux-image-6.7.0-gcd42140e6285/ 2024-01-31T04:50:19.013 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 171 2024-01-25 04:04 ./usr/share/doc/linux-image-6.7.0-gcd42140e6285/changelog.Debian.gz 2024-01-31T04:50:19.013 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r-- root/root 691 2024-01-25 04:04 ./usr/share/doc/linux-image-6.7.0-gcd42140e6285/copyright 2024-01-31T04:50:19.014 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-gcd42140e6285 2024-01-31T04:50:19.014 INFO:teuthology.task.kernel:searching for kernel 6.7.0-gcd42140e6285 2024-01-31T04:50:19.014 DEBUG:teuthology.orchestra.run.smithi049:> egrep '(submenu|menuentry.*6.7.0-gcd42140e6285).*{' /boot/grub/grub.cfg 2024-01-31T04:50:19.026 INFO:teuthology.orchestra.run.smithi049.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-31T04:50:19.026 INFO:teuthology.orchestra.run.smithi049.stdout: menuentry 'Ubuntu, with Linux 6.7.0-gcd42140e6285' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-gcd42140e6285-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-31T04:50:19.026 INFO:teuthology.orchestra.run.smithi049.stdout: menuentry 'Ubuntu, with Linux 6.7.0-gcd42140e6285 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-gcd42140e6285-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-31T04:50:19.026 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-01-31T04:50:19.026 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.7.0-gcd42140e6285 2024-01-31T04:50:19.027 DEBUG:teuthology.orchestra.run.smithi049:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-01-31T04:50:19.069 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi049.front.sepia.ceph.com to complete... 2024-01-31T04:50:19.155 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub' 2024-01-31T04:50:19.174 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-31T04:50:19.198 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2024-01-31T04:50:19.469 INFO:teuthology.orchestra.run.smithi049.stderr:Sourcing file `/etc/default/grub' 2024-01-31T04:50:19.470 INFO:teuthology.orchestra.run.smithi049.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-31T04:50:19.479 INFO:teuthology.orchestra.run.smithi049.stderr:Generating grub configuration file ... 2024-01-31T04:50:19.597 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-6.7.0-gcd42140e6285 2024-01-31T04:50:19.623 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-6.7.0-gcd42140e6285 2024-01-31T04:50:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-6.7.0-gcd42140e6285 2024-01-31T04:50:19.657 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-6.7.0-gcd42140e6285 2024-01-31T04:50:19.888 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-31T04:50:19.894 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-31T04:50:19.937 INFO:teuthology.orchestra.run.smithi049.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-31T04:50:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-31T04:50:19.950 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-31T04:50:19.962 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-31T04:50:20.028 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-31T04:50:20.033 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-31T04:50:20.058 INFO:teuthology.orchestra.run.smithi049.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-31T04:50:20.058 INFO:teuthology.orchestra.run.smithi049.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-31T04:50:20.058 INFO:teuthology.orchestra.run.smithi049.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-31T04:50:20.067 INFO:teuthology.orchestra.run.smithi049.stderr:done 2024-01-31T04:50:20.190 INFO:teuthology.orchestra.run.smithi195.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-31T04:50:20.190 INFO:teuthology.orchestra.run.smithi195.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-31T04:50:20.190 INFO:teuthology.orchestra.run.smithi195.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-31T04:50:20.229 INFO:teuthology.orchestra.run.smithi195.stderr:done 2024-01-31T04:50:20.430 DEBUG:teuthology.orchestra.run.smithi195:> dpkg-deb -c /tmp/linux-image.deb 2024-01-31T04:50:20.438 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./ 2024-01-31T04:50:20.438 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./boot/ 2024-01-31T04:50:20.438 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 4444641 2024-01-25 04:04 ./boot/System.map-6.7.0-gcd42140e6285 2024-01-31T04:50:20.450 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 170149 2024-01-25 04:04 ./boot/config-6.7.0-gcd42140e6285 2024-01-31T04:50:20.450 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11441152 2024-01-25 04:04 ./boot/vmlinuz-6.7.0-gcd42140e6285 2024-01-31T04:50:20.471 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/ 2024-01-31T04:50:20.471 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/ 2024-01-31T04:50:20.471 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/postinst.d/ 2024-01-31T04:50:20.471 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/postrm.d/ 2024-01-31T04:50:20.471 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/preinst.d/ 2024-01-31T04:50:20.471 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/prerm.d/ 2024-01-31T04:50:20.471 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/ 2024-01-31T04:50:20.471 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/ 2024-01-31T04:50:20.471 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/ 2024-01-31T04:50:20.471 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/ 2024-01-31T04:50:20.471 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/ 2024-01-31T04:50:20.472 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/ 2024-01-31T04:50:20.472 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/ 2024-01-31T04:50:20.472 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 490345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/aesni-intel.ko 2024-01-31T04:50:20.474 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-31T04:50:20.474 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-31T04:50:20.474 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-31T04:50:20.474 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 93113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-31T04:50:20.474 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 106729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-31T04:50:20.475 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 152241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-31T04:50:20.475 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-31T04:50:20.475 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-31T04:50:20.475 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 83889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-31T04:50:20.475 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-31T04:50:20.475 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-31T04:50:20.475 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-31T04:50:20.475 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-31T04:50:20.475 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-31T04:50:20.475 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-31T04:50:20.475 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-31T04:50:20.475 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-31T04:50:20.475 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-31T04:50:20.475 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-31T04:50:20.476 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/ 2024-01-31T04:50:20.476 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpu/ 2024-01-31T04:50:20.476 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpu/mce/ 2024-01-31T04:50:20.476 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-31T04:50:20.476 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpuid.ko 2024-01-31T04:50:20.476 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/msr.ko 2024-01-31T04:50:20.476 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/ 2024-01-31T04:50:20.476 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 353705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-31T04:50:20.476 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 881649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-31T04:50:20.477 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2276625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/kvm.ko 2024-01-31T04:50:20.576 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/ 2024-01-31T04:50:20.576 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/af_alg.ko 2024-01-31T04:50:20.576 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/algif_hash.ko 2024-01-31T04:50:20.576 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/algif_skcipher.ko 2024-01-31T04:50:20.576 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/ansi_cprng.ko 2024-01-31T04:50:20.576 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/anubis.ko 2024-01-31T04:50:20.576 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/arc4.ko 2024-01-31T04:50:20.576 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/asymmetric_keys/ 2024-01-31T04:50:20.576 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-01-31T04:50:20.576 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/ 2024-01-31T04:50:20.577 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_memcpy.ko 2024-01-31T04:50:20.577 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_pq.ko 2024-01-31T04:50:20.577 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-31T04:50:20.577 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_tx.ko 2024-01-31T04:50:20.577 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_xor.ko 2024-01-31T04:50:20.577 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/raid6test.ko 2024-01-31T04:50:20.577 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/authenc.ko 2024-01-31T04:50:20.577 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/authencesn.ko 2024-01-31T04:50:20.577 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/blake2b_generic.ko 2024-01-31T04:50:20.577 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/blowfish_common.ko 2024-01-31T04:50:20.577 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/blowfish_generic.ko 2024-01-31T04:50:20.577 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/camellia_generic.ko 2024-01-31T04:50:20.577 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cast5_generic.ko 2024-01-31T04:50:20.577 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cast6_generic.ko 2024-01-31T04:50:20.577 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cast_common.ko 2024-01-31T04:50:20.578 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/ccm.ko 2024-01-31T04:50:20.578 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cmac.ko 2024-01-31T04:50:20.578 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crc32_generic.ko 2024-01-31T04:50:20.578 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cryptd.ko 2024-01-31T04:50:20.578 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crypto_engine.ko 2024-01-31T04:50:20.578 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crypto_simd.ko 2024-01-31T04:50:20.578 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crypto_user.ko 2024-01-31T04:50:20.578 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cts.ko 2024-01-31T04:50:20.578 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/des_generic.ko 2024-01-31T04:50:20.578 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/dh_generic.ko 2024-01-31T04:50:20.578 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/echainiv.ko 2024-01-31T04:50:20.579 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/essiv.ko 2024-01-31T04:50:20.579 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/fcrypt.ko 2024-01-31T04:50:20.579 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/khazad.ko 2024-01-31T04:50:20.579 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/lrw.ko 2024-01-31T04:50:20.579 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/lz4.ko 2024-01-31T04:50:20.579 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/lz4hc.ko 2024-01-31T04:50:20.579 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/md4.ko 2024-01-31T04:50:20.579 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/michael_mic.ko 2024-01-31T04:50:20.579 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/pcbc.ko 2024-01-31T04:50:20.579 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/pcrypt.ko 2024-01-31T04:50:20.579 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/rmd160.ko 2024-01-31T04:50:20.580 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/seed.ko 2024-01-31T04:50:20.580 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/serpent_generic.ko 2024-01-31T04:50:20.580 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 149481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/tcrypt.ko 2024-01-31T04:50:20.580 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/tea.ko 2024-01-31T04:50:20.580 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/twofish_common.ko 2024-01-31T04:50:20.580 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/twofish_generic.ko 2024-01-31T04:50:20.580 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/vmac.ko 2024-01-31T04:50:20.580 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/wp512.ko 2024-01-31T04:50:20.581 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xcbc.ko 2024-01-31T04:50:20.581 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xor.ko 2024-01-31T04:50:20.581 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xts.ko 2024-01-31T04:50:20.581 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xxhash_generic.ko 2024-01-31T04:50:20.581 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ 2024-01-31T04:50:20.581 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/ 2024-01-31T04:50:20.581 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/acpi_extlog.ko 2024-01-31T04:50:20.581 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-31T04:50:20.581 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/acpi_pad.ko 2024-01-31T04:50:20.581 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/apei/ 2024-01-31T04:50:20.581 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/apei/einj.ko 2024-01-31T04:50:20.581 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/ec_sys.ko 2024-01-31T04:50:20.582 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/platform_profile.ko 2024-01-31T04:50:20.582 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/sbs.ko 2024-01-31T04:50:20.582 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/sbshc.ko 2024-01-31T04:50:20.582 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 104729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/video.ko 2024-01-31T04:50:20.582 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/ 2024-01-31T04:50:20.582 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/acard-ahci.ko 2024-01-31T04:50:20.582 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/ahci.ko 2024-01-31T04:50:20.582 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/ahci_platform.ko 2024-01-31T04:50:20.582 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 88401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/libahci.ko 2024-01-31T04:50:20.582 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/libahci_platform.ko 2024-01-31T04:50:20.582 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_acpi.ko 2024-01-31T04:50:20.582 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ali.ko 2024-01-31T04:50:20.582 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_amd.ko 2024-01-31T04:50:20.582 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_artop.ko 2024-01-31T04:50:20.582 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_atiixp.ko 2024-01-31T04:50:20.583 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_atp867x.ko 2024-01-31T04:50:20.583 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_cmd640.ko 2024-01-31T04:50:20.583 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_cmd64x.ko 2024-01-31T04:50:20.583 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_cypress.ko 2024-01-31T04:50:20.583 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_efar.ko 2024-01-31T04:50:20.583 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt366.ko 2024-01-31T04:50:20.583 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt37x.ko 2024-01-31T04:50:20.583 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-31T04:50:20.583 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-31T04:50:20.583 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_it8213.ko 2024-01-31T04:50:20.583 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_it821x.ko 2024-01-31T04:50:20.583 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_jmicron.ko 2024-01-31T04:50:20.583 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_legacy.ko 2024-01-31T04:50:20.583 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_marvell.ko 2024-01-31T04:50:20.584 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_mpiix.ko 2024-01-31T04:50:20.584 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_netcell.ko 2024-01-31T04:50:20.584 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ninja32.ko 2024-01-31T04:50:20.584 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ns87410.ko 2024-01-31T04:50:20.584 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ns87415.ko 2024-01-31T04:50:20.584 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_oldpiix.ko 2024-01-31T04:50:20.584 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_opti.ko 2024-01-31T04:50:20.584 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_optidma.ko 2024-01-31T04:50:20.584 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_pcmcia.ko 2024-01-31T04:50:20.584 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-31T04:50:20.584 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-31T04:50:20.585 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_piccolo.ko 2024-01-31T04:50:20.585 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_radisys.ko 2024-01-31T04:50:20.585 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_rdc.ko 2024-01-31T04:50:20.585 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_rz1000.ko 2024-01-31T04:50:20.585 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_sch.ko 2024-01-31T04:50:20.585 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_serverworks.ko 2024-01-31T04:50:20.585 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_sil680.ko 2024-01-31T04:50:20.585 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_sl82c105.ko 2024-01-31T04:50:20.585 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_triflex.ko 2024-01-31T04:50:20.585 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_via.ko 2024-01-31T04:50:20.585 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pdc_adma.ko 2024-01-31T04:50:20.585 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_inic162x.ko 2024-01-31T04:50:20.585 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 83345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_mv.ko 2024-01-31T04:50:20.585 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_nv.ko 2024-01-31T04:50:20.585 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_promise.ko 2024-01-31T04:50:20.585 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_qstor.ko 2024-01-31T04:50:20.586 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sil.ko 2024-01-31T04:50:20.586 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sil24.ko 2024-01-31T04:50:20.586 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sis.ko 2024-01-31T04:50:20.586 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_svw.ko 2024-01-31T04:50:20.586 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sx4.ko 2024-01-31T04:50:20.586 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_uli.ko 2024-01-31T04:50:20.586 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_via.ko 2024-01-31T04:50:20.586 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_vsc.ko 2024-01-31T04:50:20.586 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/auxdisplay/ 2024-01-31T04:50:20.586 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/auxdisplay/ks0108.ko 2024-01-31T04:50:20.586 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/bcma/ 2024-01-31T04:50:20.586 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 124473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/bcma/bcma.ko 2024-01-31T04:50:20.586 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/ 2024-01-31T04:50:20.586 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/aoe/ 2024-01-31T04:50:20.586 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 113753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/aoe/aoe.ko 2024-01-31T04:50:20.587 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/drbd/ 2024-01-31T04:50:20.587 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 965305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/drbd/drbd.ko 2024-01-31T04:50:20.587 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 173353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/floppy.ko 2024-01-31T04:50:20.587 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/mtip32xx/ 2024-01-31T04:50:20.587 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 94297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-31T04:50:20.587 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 116321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/nbd.ko 2024-01-31T04:50:20.587 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/null_blk/ 2024-01-31T04:50:20.587 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 110737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/null_blk/null_blk.ko 2024-01-31T04:50:20.587 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 98281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/pktcdvd.ko 2024-01-31T04:50:20.587 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 263769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/rbd.ko 2024-01-31T04:50:20.587 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/xen-blkback/ 2024-01-31T04:50:20.587 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 98185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-31T04:50:20.587 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/zram/ 2024-01-31T04:50:20.587 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/zram/zram.ko 2024-01-31T04:50:20.587 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ 2024-01-31T04:50:20.588 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/applicom.ko 2024-01-31T04:50:20.588 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hangcheck-timer.ko 2024-01-31T04:50:20.588 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/ 2024-01-31T04:50:20.588 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-31T04:50:20.588 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-31T04:50:20.588 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-31T04:50:20.588 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/via-rng.ko 2024-01-31T04:50:20.588 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-31T04:50:20.588 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ 2024-01-31T04:50:20.588 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-31T04:50:20.589 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 148609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-31T04:50:20.589 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-31T04:50:20.589 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 139313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-31T04:50:20.589 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-31T04:50:20.589 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-31T04:50:20.589 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/lp.ko 2024-01-31T04:50:20.589 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/mwave/ 2024-01-31T04:50:20.589 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 84097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/mwave/mwave.ko 2024-01-31T04:50:20.589 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/nvram.ko 2024-01-31T04:50:20.589 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ppdev.ko 2024-01-31T04:50:20.590 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tlclk.ko 2024-01-31T04:50:20.590 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/ 2024-01-31T04:50:20.590 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-31T04:50:20.590 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-01-31T04:50:20.590 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-01-31T04:50:20.590 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-01-31T04:50:20.590 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-31T04:50:20.590 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-31T04:50:20.590 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-01-31T04:50:20.590 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/ 2024-01-31T04:50:20.591 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/xillybus_class.ko 2024-01-31T04:50:20.591 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/xillybus_core.ko 2024-01-31T04:50:20.591 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-01-31T04:50:20.591 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/ 2024-01-31T04:50:20.591 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-palmas.ko 2024-01-31T04:50:20.591 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-si5351.ko 2024-01-31T04:50:20.591 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-twl6040.ko 2024-01-31T04:50:20.591 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-wm831x.ko 2024-01-31T04:50:20.591 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/ 2024-01-31T04:50:20.591 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-31T04:50:20.592 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-31T04:50:20.592 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-31T04:50:20.592 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ 2024-01-31T04:50:20.592 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ccp/ 2024-01-31T04:50:20.592 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-31T04:50:20.592 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 246841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ccp/ccp.ko 2024-01-31T04:50:20.592 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/ 2024-01-31T04:50:20.592 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/ 2024-01-31T04:50:20.592 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_common/ 2024-01-31T04:50:20.592 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 517033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-31T04:50:20.592 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-01-31T04:50:20.592 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-31T04:50:20.593 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/padlock-aes.ko 2024-01-31T04:50:20.593 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/padlock-sha.ko 2024-01-31T04:50:20.593 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/virtio/ 2024-01-31T04:50:20.593 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-31T04:50:20.593 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dca/ 2024-01-31T04:50:20.593 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dca/dca.ko 2024-01-31T04:50:20.593 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/ 2024-01-31T04:50:20.593 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/dw/ 2024-01-31T04:50:20.593 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-31T04:50:20.593 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/ioat/ 2024-01-31T04:50:20.593 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 122569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-31T04:50:20.593 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/ 2024-01-31T04:50:20.593 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 79953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/amd64_edac.ko 2024-01-31T04:50:20.593 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/e752x_edac.ko 2024-01-31T04:50:20.594 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 63617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/edac_mce_amd.ko 2024-01-31T04:50:20.594 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i3000_edac.ko 2024-01-31T04:50:20.594 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i3200_edac.ko 2024-01-31T04:50:20.594 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i5100_edac.ko 2024-01-31T04:50:20.594 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i5400_edac.ko 2024-01-31T04:50:20.594 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i7300_edac.ko 2024-01-31T04:50:20.594 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i7core_edac.ko 2024-01-31T04:50:20.594 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i82975x_edac.ko 2024-01-31T04:50:20.594 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/ie31200_edac.ko 2024-01-31T04:50:20.594 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/sb_edac.ko 2024-01-31T04:50:20.594 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/x38_edac.ko 2024-01-31T04:50:20.594 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/ 2024-01-31T04:50:20.594 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-gpio.ko 2024-01-31T04:50:20.594 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-max14577.ko 2024-01-31T04:50:20.594 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-max77693.ko 2024-01-31T04:50:20.594 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-max8997.ko 2024-01-31T04:50:20.595 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-palmas.ko 2024-01-31T04:50:20.595 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-rt8973a.ko 2024-01-31T04:50:20.595 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-sm5502.ko 2024-01-31T04:50:20.595 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/ 2024-01-31T04:50:20.595 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/dmi-sysfs.ko 2024-01-31T04:50:20.595 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/efi/ 2024-01-31T04:50:20.595 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/efi/efi-pstore.ko 2024-01-31T04:50:20.595 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-31T04:50:20.595 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/ 2024-01-31T04:50:20.595 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-adp5520.ko 2024-01-31T04:50:20.595 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-amd8111.ko 2024-01-31T04:50:20.595 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-arizona.ko 2024-01-31T04:50:20.595 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-da9052.ko 2024-01-31T04:50:20.595 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-da9055.ko 2024-01-31T04:50:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-dln2.ko 2024-01-31T04:50:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 77849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-f7188x.ko 2024-01-31T04:50:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-generic.ko 2024-01-31T04:50:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-ich.ko 2024-01-31T04:50:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-01-31T04:50:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-kempld.ko 2024-01-31T04:50:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-lp3943.ko 2024-01-31T04:50:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-max7300.ko 2024-01-31T04:50:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-max730x.ko 2024-01-31T04:50:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-max732x.ko 2024-01-31T04:50:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-01-31T04:50:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-pca953x.ko 2024-01-31T04:50:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-pcf857x.ko 2024-01-31T04:50:20.597 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-rdc321x.ko 2024-01-31T04:50:20.597 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-sch.ko 2024-01-31T04:50:20.597 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-sch311x.ko 2024-01-31T04:50:20.597 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-tps65912.ko 2024-01-31T04:50:20.597 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-twl4030.ko 2024-01-31T04:50:20.597 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-twl6040.ko 2024-01-31T04:50:20.597 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-31T04:50:20.597 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-vx855.ko 2024-01-31T04:50:20.597 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-wm831x.ko 2024-01-31T04:50:20.597 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-wm8350.ko 2024-01-31T04:50:20.597 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-wm8994.ko 2024-01-31T04:50:20.597 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/ 2024-01-31T04:50:20.597 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-a4tech.ko 2024-01-31T04:50:20.597 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-apple.ko 2024-01-31T04:50:20.598 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-appleir.ko 2024-01-31T04:50:20.598 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-aureal.ko 2024-01-31T04:50:20.598 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-axff.ko 2024-01-31T04:50:20.598 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-belkin.ko 2024-01-31T04:50:20.598 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-cherry.ko 2024-01-31T04:50:20.598 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-chicony.ko 2024-01-31T04:50:20.598 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-cp2112.ko 2024-01-31T04:50:20.598 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-cypress.ko 2024-01-31T04:50:20.598 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-dr.ko 2024-01-31T04:50:20.598 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-elecom.ko 2024-01-31T04:50:20.598 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-elo.ko 2024-01-31T04:50:20.598 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-emsff.ko 2024-01-31T04:50:20.598 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-ezkey.ko 2024-01-31T04:50:20.598 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-gaff.ko 2024-01-31T04:50:20.599 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-generic.ko 2024-01-31T04:50:20.599 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-gt683r.ko 2024-01-31T04:50:20.599 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-gyration.ko 2024-01-31T04:50:20.599 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-31T04:50:20.599 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-31T04:50:20.599 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-holtekff.ko 2024-01-31T04:50:20.599 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-hyperv.ko 2024-01-31T04:50:20.599 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-icade.ko 2024-01-31T04:50:20.599 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-kensington.ko 2024-01-31T04:50:20.599 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-keytouch.ko 2024-01-31T04:50:20.599 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-kye.ko 2024-01-31T04:50:20.599 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-lcpower.ko 2024-01-31T04:50:20.599 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-led.ko 2024-01-31T04:50:20.599 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-lenovo.ko 2024-01-31T04:50:20.599 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-lg-g15.ko 2024-01-31T04:50:20.600 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-31T04:50:20.600 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 100649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-31T04:50:20.600 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-logitech.ko 2024-01-31T04:50:20.600 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-magicmouse.ko 2024-01-31T04:50:20.600 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-microsoft.ko 2024-01-31T04:50:20.600 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-monterey.ko 2024-01-31T04:50:20.600 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-multitouch.ko 2024-01-31T04:50:20.600 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-ntrig.ko 2024-01-31T04:50:20.600 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-ortek.ko 2024-01-31T04:50:20.600 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-penmount.ko 2024-01-31T04:50:20.600 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-petalynx.ko 2024-01-31T04:50:20.600 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-picolcd.ko 2024-01-31T04:50:20.600 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-pl.ko 2024-01-31T04:50:20.600 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-plantronics.ko 2024-01-31T04:50:20.601 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-primax.ko 2024-01-31T04:50:20.601 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-rmi.ko 2024-01-31T04:50:20.601 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-31T04:50:20.601 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-common.ko 2024-01-31T04:50:20.601 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-31T04:50:20.601 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-31T04:50:20.601 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-31T04:50:20.601 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-31T04:50:20.601 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-31T04:50:20.601 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-31T04:50:20.601 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-31T04:50:20.601 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-31T04:50:20.601 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-31T04:50:20.601 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat.ko 2024-01-31T04:50:20.602 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-saitek.ko 2024-01-31T04:50:20.602 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-samsung.ko 2024-01-31T04:50:20.602 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-31T04:50:20.602 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sjoy.ko 2024-01-31T04:50:20.602 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sony.ko 2024-01-31T04:50:20.602 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-speedlink.ko 2024-01-31T04:50:20.602 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-steelseries.ko 2024-01-31T04:50:20.602 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sunplus.ko 2024-01-31T04:50:20.602 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-31T04:50:20.602 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-tivo.ko 2024-01-31T04:50:20.602 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-tmff.ko 2024-01-31T04:50:20.602 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-topseed.ko 2024-01-31T04:50:20.602 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-twinhan.ko 2024-01-31T04:50:20.602 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-uclogic.ko 2024-01-31T04:50:20.602 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-waltop.ko 2024-01-31T04:50:20.603 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 143473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-wiimote.ko 2024-01-31T04:50:20.603 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-xinmo.ko 2024-01-31T04:50:20.603 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-zpff.ko 2024-01-31T04:50:20.603 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-zydacron.ko 2024-01-31T04:50:20.603 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 269281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid.ko 2024-01-31T04:50:20.603 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/uhid.ko 2024-01-31T04:50:20.603 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/ 2024-01-31T04:50:20.603 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 125785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/usbhid.ko 2024-01-31T04:50:20.603 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/usbkbd.ko 2024-01-31T04:50:20.603 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/usbmouse.ko 2024-01-31T04:50:20.603 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 217873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/wacom.ko 2024-01-31T04:50:20.603 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/ 2024-01-31T04:50:20.603 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 64201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/hv_balloon.ko 2024-01-31T04:50:20.603 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/hv_utils.ko 2024-01-31T04:50:20.603 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 305321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/hv_vmbus.ko 2024-01-31T04:50:20.604 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ 2024-01-31T04:50:20.604 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/abituguru.ko 2024-01-31T04:50:20.604 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/abituguru3.ko 2024-01-31T04:50:20.604 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-31T04:50:20.604 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ad7414.ko 2024-01-31T04:50:20.604 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ad7418.ko 2024-01-31T04:50:20.604 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adc128d818.ko 2024-01-31T04:50:20.604 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1025.ko 2024-01-31T04:50:20.604 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 97977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1026.ko 2024-01-31T04:50:20.604 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1029.ko 2024-01-31T04:50:20.604 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1031.ko 2024-01-31T04:50:20.605 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm9240.ko 2024-01-31T04:50:20.605 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ads7828.ko 2024-01-31T04:50:20.605 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7410.ko 2024-01-31T04:50:20.605 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7411.ko 2024-01-31T04:50:20.605 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 74409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7462.ko 2024-01-31T04:50:20.605 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7470.ko 2024-01-31T04:50:20.605 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7475.ko 2024-01-31T04:50:20.605 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7x10.ko 2024-01-31T04:50:20.605 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/amc6821.ko 2024-01-31T04:50:20.605 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/applesmc.ko 2024-01-31T04:50:20.605 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/asb100.ko 2024-01-31T04:50:20.606 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/asc7621.ko 2024-01-31T04:50:20.606 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-31T04:50:20.606 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/atxp1.ko 2024-01-31T04:50:20.606 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/coretemp.ko 2024-01-31T04:50:20.606 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/da9052-hwmon.ko 2024-01-31T04:50:20.606 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/da9055-hwmon.ko 2024-01-31T04:50:20.606 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-31T04:50:20.606 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 99601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/dme1737.ko 2024-01-31T04:50:20.606 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ds1621.ko 2024-01-31T04:50:20.606 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ds620.ko 2024-01-31T04:50:20.606 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/emc1403.ko 2024-01-31T04:50:20.606 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/emc2103.ko 2024-01-31T04:50:20.606 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/emc6w201.ko 2024-01-31T04:50:20.606 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/f71805f.ko 2024-01-31T04:50:20.606 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 94689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/f71882fg.ko 2024-01-31T04:50:20.606 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/f75375s.ko 2024-01-31T04:50:20.607 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/fam15h_power.ko 2024-01-31T04:50:20.607 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/fschmd.ko 2024-01-31T04:50:20.607 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/g760a.ko 2024-01-31T04:50:20.607 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/g762.ko 2024-01-31T04:50:20.607 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/gl518sm.ko 2024-01-31T04:50:20.607 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/gl520sm.ko 2024-01-31T04:50:20.607 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/hih6130.ko 2024-01-31T04:50:20.607 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-31T04:50:20.607 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/i5500_temp.ko 2024-01-31T04:50:20.607 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/i5k_amb.ko 2024-01-31T04:50:20.607 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ibmaem.ko 2024-01-31T04:50:20.607 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ibmpex.ko 2024-01-31T04:50:20.607 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ina209.ko 2024-01-31T04:50:20.607 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ina2xx.ko 2024-01-31T04:50:20.608 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 130449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/it87.ko 2024-01-31T04:50:20.608 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/jc42.ko 2024-01-31T04:50:20.608 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/k10temp.ko 2024-01-31T04:50:20.608 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/k8temp.ko 2024-01-31T04:50:20.608 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lineage-pem.ko 2024-01-31T04:50:20.608 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm63.ko 2024-01-31T04:50:20.608 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm73.ko 2024-01-31T04:50:20.608 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm75.ko 2024-01-31T04:50:20.609 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm77.ko 2024-01-31T04:50:20.609 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm78.ko 2024-01-31T04:50:20.609 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm80.ko 2024-01-31T04:50:20.609 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm83.ko 2024-01-31T04:50:20.609 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm85.ko 2024-01-31T04:50:20.609 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm87.ko 2024-01-31T04:50:20.609 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm90.ko 2024-01-31T04:50:20.609 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm92.ko 2024-01-31T04:50:20.609 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm93.ko 2024-01-31T04:50:20.609 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm95234.ko 2024-01-31T04:50:20.609 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm95241.ko 2024-01-31T04:50:20.609 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm95245.ko 2024-01-31T04:50:20.609 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc2945.ko 2024-01-31T04:50:20.609 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4151.ko 2024-01-31T04:50:20.610 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4215.ko 2024-01-31T04:50:20.610 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4222.ko 2024-01-31T04:50:20.610 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4245.ko 2024-01-31T04:50:20.610 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4260.ko 2024-01-31T04:50:20.610 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4261.ko 2024-01-31T04:50:20.610 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max16065.ko 2024-01-31T04:50:20.610 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max1619.ko 2024-01-31T04:50:20.610 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max1668.ko 2024-01-31T04:50:20.610 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max197.ko 2024-01-31T04:50:20.610 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max6639.ko 2024-01-31T04:50:20.610 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max6650.ko 2024-01-31T04:50:20.610 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max6697.ko 2024-01-31T04:50:20.610 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/mc13783-adc.ko 2024-01-31T04:50:20.610 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/mcp3021.ko 2024-01-31T04:50:20.610 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-01-31T04:50:20.611 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct6683.ko 2024-01-31T04:50:20.611 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 119689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct6775-core.ko 2024-01-31T04:50:20.611 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct6775.ko 2024-01-31T04:50:20.611 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct7802.ko 2024-01-31T04:50:20.611 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 82337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pc87360.ko 2024-01-31T04:50:20.611 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pc87427.ko 2024-01-31T04:50:20.611 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pcf8591.ko 2024-01-31T04:50:20.611 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ 2024-01-31T04:50:20.611 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-31T04:50:20.611 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-31T04:50:20.611 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-31T04:50:20.611 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-31T04:50:20.611 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-31T04:50:20.611 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-31T04:50:20.612 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-31T04:50:20.612 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 82577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-31T04:50:20.612 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-31T04:50:20.612 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-31T04:50:20.612 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-31T04:50:20.612 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-31T04:50:20.613 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/powr1220.ko 2024-01-31T04:50:20.613 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sch5627.ko 2024-01-31T04:50:20.613 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sch5636.ko 2024-01-31T04:50:20.613 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-31T04:50:20.613 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sht15.ko 2024-01-31T04:50:20.613 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sht21.ko 2024-01-31T04:50:20.613 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/shtc1.ko 2024-01-31T04:50:20.613 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sis5595.ko 2024-01-31T04:50:20.613 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/smsc47b397.ko 2024-01-31T04:50:20.613 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/smsc47m1.ko 2024-01-31T04:50:20.614 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/smsc47m192.ko 2024-01-31T04:50:20.614 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/thmc50.ko 2024-01-31T04:50:20.614 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp102.ko 2024-01-31T04:50:20.614 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp103.ko 2024-01-31T04:50:20.614 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp401.ko 2024-01-31T04:50:20.614 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp421.ko 2024-01-31T04:50:20.614 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/via-cputemp.ko 2024-01-31T04:50:20.614 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/via686a.ko 2024-01-31T04:50:20.614 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/vt1211.ko 2024-01-31T04:50:20.614 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/vt8231.ko 2024-01-31T04:50:20.614 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83627ehf.ko 2024-01-31T04:50:20.614 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83627hf.ko 2024-01-31T04:50:20.615 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83781d.ko 2024-01-31T04:50:20.615 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 63225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83791d.ko 2024-01-31T04:50:20.615 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83792d.ko 2024-01-31T04:50:20.615 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 101473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83793.ko 2024-01-31T04:50:20.615 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 119505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83795.ko 2024-01-31T04:50:20.615 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83l785ts.ko 2024-01-31T04:50:20.615 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83l786ng.ko 2024-01-31T04:50:20.615 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-01-31T04:50:20.615 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-01-31T04:50:20.615 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/ 2024-01-31T04:50:20.615 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/algos/ 2024-01-31T04:50:20.615 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-31T04:50:20.615 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-31T04:50:20.615 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/ 2024-01-31T04:50:20.616 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-01-31T04:50:20.616 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-01-31T04:50:20.616 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-01-31T04:50:20.616 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-31T04:50:20.616 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-31T04:50:20.616 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-31T04:50:20.616 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-01-31T04:50:20.616 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 6929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-31T04:50:20.616 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-01-31T04:50:20.617 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-31T04:50:20.617 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-31T04:50:20.617 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-31T04:50:20.617 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-31T04:50:20.617 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-01-31T04:50:20.617 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-01-31T04:50:20.617 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-31T04:50:20.617 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-31T04:50:20.618 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-31T04:50:20.618 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-01-31T04:50:20.618 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-31T04:50:20.618 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-31T04:50:20.618 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-01-31T04:50:20.618 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-31T04:50:20.618 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-31T04:50:20.618 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-31T04:50:20.618 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-01-31T04:50:20.618 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-31T04:50:20.618 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-31T04:50:20.618 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-01-31T04:50:20.618 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-01-31T04:50:20.618 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-31T04:50:20.618 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-01-31T04:50:20.619 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-31T04:50:20.619 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-31T04:50:20.619 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-31T04:50:20.619 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-31T04:50:20.619 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-01-31T04:50:20.619 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/i2c-mux.ko 2024-01-31T04:50:20.619 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/i2c-smbus.ko 2024-01-31T04:50:20.619 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/i2c-stub.ko 2024-01-31T04:50:20.619 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/ 2024-01-31T04:50:20.619 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-01-31T04:50:20.619 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-01-31T04:50:20.619 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-01-31T04:50:20.619 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ 2024-01-31T04:50:20.619 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ 2024-01-31T04:50:20.620 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 273609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-31T04:50:20.620 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 883681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_core.ko 2024-01-31T04:50:20.620 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-31T04:50:20.620 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 324329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-31T04:50:20.620 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 97921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-31T04:50:20.620 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 282601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-31T04:50:20.620 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-31T04:50:20.620 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/ 2024-01-31T04:50:20.620 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/cxgb4/ 2024-01-31T04:50:20.620 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 493217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-31T04:50:20.620 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx4/ 2024-01-31T04:50:20.620 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 420561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-31T04:50:20.620 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx5/ 2024-01-31T04:50:20.621 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 741449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-31T04:50:20.621 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mthca/ 2024-01-31T04:50:20.621 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 296881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-31T04:50:20.621 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/ocrdma/ 2024-01-31T04:50:20.621 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 153801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-01-31T04:50:20.621 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/usnic/ 2024-01-31T04:50:20.621 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 168969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-01-31T04:50:20.621 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/ 2024-01-31T04:50:20.621 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/ipoib/ 2024-01-31T04:50:20.621 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 263081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-31T04:50:20.621 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/iser/ 2024-01-31T04:50:20.621 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 100353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-31T04:50:20.621 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/isert/ 2024-01-31T04:50:20.621 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 111425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-31T04:50:20.621 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srp/ 2024-01-31T04:50:20.622 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 128753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-31T04:50:20.622 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srpt/ 2024-01-31T04:50:20.622 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 129529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-31T04:50:20.622 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/ 2024-01-31T04:50:20.622 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/evbug.ko 2024-01-31T04:50:20.622 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/ff-memless.ko 2024-01-31T04:50:20.622 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/ 2024-01-31T04:50:20.622 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-31T04:50:20.622 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-31T04:50:20.622 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/gameport.ko 2024-01-31T04:50:20.622 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/joydev.ko 2024-01-31T04:50:20.622 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/ 2024-01-31T04:50:20.622 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-01-31T04:50:20.622 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-01-31T04:50:20.622 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-01-31T04:50:20.623 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-01-31T04:50:20.623 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-31T04:50:20.623 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-01-31T04:50:20.623 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/lkkbd.ko 2024-01-31T04:50:20.623 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/lm8323.ko 2024-01-31T04:50:20.623 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/lm8333.ko 2024-01-31T04:50:20.623 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-01-31T04:50:20.623 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-01-31T04:50:20.623 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-01-31T04:50:20.623 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-01-31T04:50:20.623 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/newtonkbd.ko 2024-01-31T04:50:20.623 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-01-31T04:50:20.623 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/qt1070.ko 2024-01-31T04:50:20.623 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/qt2160.ko 2024-01-31T04:50:20.623 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-01-31T04:50:20.624 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/stowaway.ko 2024-01-31T04:50:20.624 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/sunkbd.ko 2024-01-31T04:50:20.624 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-01-31T04:50:20.624 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-01-31T04:50:20.624 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-01-31T04:50:20.624 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/xtkbd.ko 2024-01-31T04:50:20.624 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/matrix-keymap.ko 2024-01-31T04:50:20.624 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/ 2024-01-31T04:50:20.624 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/appletouch.ko 2024-01-31T04:50:20.624 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/bcm5974.ko 2024-01-31T04:50:20.624 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 123417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/cyapatp.ko 2024-01-31T04:50:20.624 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-31T04:50:20.625 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/gpio_mouse.ko 2024-01-31T04:50:20.625 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 335953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/psmouse.ko 2024-01-31T04:50:20.625 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/sermouse.ko 2024-01-31T04:50:20.625 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-31T04:50:20.625 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-31T04:50:20.625 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-31T04:50:20.625 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/rmi4/ 2024-01-31T04:50:20.625 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 109873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-31T04:50:20.625 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/ 2024-01-31T04:50:20.625 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/altera_ps2.ko 2024-01-31T04:50:20.625 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/arc_ps2.ko 2024-01-31T04:50:20.625 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/ct82c710.ko 2024-01-31T04:50:20.625 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-31T04:50:20.625 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/parkbd.ko 2024-01-31T04:50:20.626 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/pcips2.ko 2024-01-31T04:50:20.626 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/ps2mult.ko 2024-01-31T04:50:20.626 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/serio_raw.ko 2024-01-31T04:50:20.626 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/serport.ko 2024-01-31T04:50:20.626 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/sparse-keymap.ko 2024-01-31T04:50:20.626 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/ 2024-01-31T04:50:20.626 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-88pm860x.ko 2024-01-31T04:50:20.626 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-adp5520.ko 2024-01-31T04:50:20.626 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-bd2802.ko 2024-01-31T04:50:20.626 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-blinkm.ko 2024-01-31T04:50:20.626 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-da903x.ko 2024-01-31T04:50:20.626 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-da9052.ko 2024-01-31T04:50:20.626 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-gpio.ko 2024-01-31T04:50:20.626 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm3530.ko 2024-01-31T04:50:20.627 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm3533.ko 2024-01-31T04:50:20.627 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm355x.ko 2024-01-31T04:50:20.627 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm3642.ko 2024-01-31T04:50:20.627 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lp3944.ko 2024-01-31T04:50:20.627 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lp8788.ko 2024-01-31T04:50:20.627 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-max8997.ko 2024-01-31T04:50:20.627 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-mc13783.ko 2024-01-31T04:50:20.627 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-menf21bmc.ko 2024-01-31T04:50:20.627 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-pca9532.ko 2024-01-31T04:50:20.627 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-pca955x.ko 2024-01-31T04:50:20.627 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-pca963x.ko 2024-01-31T04:50:20.627 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-ss4200.ko 2024-01-31T04:50:20.627 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-tca6507.ko 2024-01-31T04:50:20.627 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-wm831x-status.ko 2024-01-31T04:50:20.628 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-wm8350.ko 2024-01-31T04:50:20.628 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ 2024-01-31T04:50:20.628 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-31T04:50:20.628 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-31T04:50:20.628 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-31T04:50:20.628 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-31T04:50:20.628 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-31T04:50:20.628 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-31T04:50:20.628 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-31T04:50:20.628 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-31T04:50:20.628 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-31T04:50:20.629 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/ 2024-01-31T04:50:20.629 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/bcache/ 2024-01-31T04:50:20.629 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 647193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/bcache/bcache.ko 2024-01-31T04:50:20.629 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-bio-prison.ko 2024-01-31T04:50:20.629 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 93409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-bufio.ko 2024-01-31T04:50:20.629 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-cache-smq.ko 2024-01-31T04:50:20.629 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 155897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-cache.ko 2024-01-31T04:50:20.629 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 107257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-crypt.ko 2024-01-31T04:50:20.629 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-delay.ko 2024-01-31T04:50:20.629 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-era.ko 2024-01-31T04:50:20.629 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-flakey.ko 2024-01-31T04:50:20.630 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-log-userspace.ko 2024-01-31T04:50:20.630 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-log.ko 2024-01-31T04:50:20.630 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-mirror.ko 2024-01-31T04:50:20.630 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-multipath.ko 2024-01-31T04:50:20.630 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-queue-length.ko 2024-01-31T04:50:20.630 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-raid.ko 2024-01-31T04:50:20.630 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-region-hash.ko 2024-01-31T04:50:20.630 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-round-robin.ko 2024-01-31T04:50:20.630 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-service-time.ko 2024-01-31T04:50:20.630 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 109529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-snapshot.ko 2024-01-31T04:50:20.630 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-switch.ko 2024-01-31T04:50:20.630 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 181865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-thin-pool.ko 2024-01-31T04:50:20.630 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-verity.ko 2024-01-31T04:50:20.631 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-zero.ko 2024-01-31T04:50:20.631 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/faulty.ko 2024-01-31T04:50:20.631 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/linear.ko 2024-01-31T04:50:20.631 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/multipath.ko 2024-01-31T04:50:20.631 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/persistent-data/ 2024-01-31T04:50:20.631 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 199937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-31T04:50:20.631 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid0.ko 2024-01-31T04:50:20.631 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 113001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid1.ko 2024-01-31T04:50:20.631 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 158657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid10.ko 2024-01-31T04:50:20.631 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 393777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid456.ko 2024-01-31T04:50:20.631 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/ 2024-01-31T04:50:20.632 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/ 2024-01-31T04:50:20.632 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 178137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptbase.ko 2024-01-31T04:50:20.632 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 63321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptctl.ko 2024-01-31T04:50:20.632 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptfc.ko 2024-01-31T04:50:20.632 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptlan.ko 2024-01-31T04:50:20.632 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 123321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptsas.ko 2024-01-31T04:50:20.632 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptscsih.ko 2024-01-31T04:50:20.632 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptspi.ko 2024-01-31T04:50:20.632 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/ 2024-01-31T04:50:20.632 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/88pm800.ko 2024-01-31T04:50:20.632 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/88pm805.ko 2024-01-31T04:50:20.632 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/88pm80x.ko 2024-01-31T04:50:20.632 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/arizona-i2c.ko 2024-01-31T04:50:20.633 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 123721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/arizona.ko 2024-01-31T04:50:20.633 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/bcm590xx.ko 2024-01-31T04:50:20.633 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/cros_ec_dev.ko 2024-01-31T04:50:20.633 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/dln2.ko 2024-01-31T04:50:20.633 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/janz-cmodio.ko 2024-01-31T04:50:20.633 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/kempld-core.ko 2024-01-31T04:50:20.633 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lm3533-core.ko 2024-01-31T04:50:20.633 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-01-31T04:50:20.633 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lp3943.ko 2024-01-31T04:50:20.633 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lpc_ich.ko 2024-01-31T04:50:20.633 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lpc_sch.ko 2024-01-31T04:50:20.633 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/max8907.ko 2024-01-31T04:50:20.633 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/mc13xxx-core.ko 2024-01-31T04:50:20.633 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-01-31T04:50:20.634 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/menf21bmc.ko 2024-01-31T04:50:20.634 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/pcf50633-adc.ko 2024-01-31T04:50:20.634 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/pcf50633-gpio.ko 2024-01-31T04:50:20.634 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/pcf50633.ko 2024-01-31T04:50:20.634 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-01-31T04:50:20.634 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/retu-mfd.ko 2024-01-31T04:50:20.635 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/si476x-core.ko 2024-01-31T04:50:20.635 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/sm501.ko 2024-01-31T04:50:20.635 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/ti_am335x_tscadc.ko 2024-01-31T04:50:20.635 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/tps65010.ko 2024-01-31T04:50:20.635 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/tps6507x.ko 2024-01-31T04:50:20.635 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/viperboard.ko 2024-01-31T04:50:20.635 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/vx855.ko 2024-01-31T04:50:20.635 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/wl1273-core.ko 2024-01-31T04:50:20.635 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/wm8994.ko 2024-01-31T04:50:20.635 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ 2024-01-31T04:50:20.635 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-01-31T04:50:20.635 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ad525x_dpot.ko 2024-01-31T04:50:20.635 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/altera-stapl/ 2024-01-31T04:50:20.636 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-31T04:50:20.636 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/apds9802als.ko 2024-01-31T04:50:20.636 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/apds990x.ko 2024-01-31T04:50:20.636 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/bh1770glc.ko 2024-01-31T04:50:20.636 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/c2port/ 2024-01-31T04:50:20.636 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-01-31T04:50:20.636 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/c2port/core.ko 2024-01-31T04:50:20.636 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/cb710/ 2024-01-31T04:50:20.636 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/cb710/cb710.ko 2024-01-31T04:50:20.636 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ds1682.ko 2024-01-31T04:50:20.636 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/dummy-irq.ko 2024-01-31T04:50:20.636 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/echo/ 2024-01-31T04:50:20.636 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/echo/echo.ko 2024-01-31T04:50:20.636 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/ 2024-01-31T04:50:20.637 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/at24.ko 2024-01-31T04:50:20.637 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-31T04:50:20.637 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/max6875.ko 2024-01-31T04:50:20.637 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/enclosure.ko 2024-01-31T04:50:20.637 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/genwqe/ 2024-01-31T04:50:20.637 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 152201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-01-31T04:50:20.637 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/hmc6352.ko 2024-01-31T04:50:20.637 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/hpilo.ko 2024-01-31T04:50:20.637 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ibmasm/ 2024-01-31T04:50:20.637 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-01-31T04:50:20.637 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ics932s401.ko 2024-01-31T04:50:20.637 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/isl29003.ko 2024-01-31T04:50:20.638 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/isl29020.ko 2024-01-31T04:50:20.638 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/lis3lv02d/ 2024-01-31T04:50:20.638 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-31T04:50:20.638 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-31T04:50:20.638 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/ 2024-01-31T04:50:20.638 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 125945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/mei-me.ko 2024-01-31T04:50:20.638 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/mei-txe.ko 2024-01-31T04:50:20.638 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 313641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/mei.ko 2024-01-31T04:50:20.638 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/phantom.ko 2024-01-31T04:50:20.638 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ti-st/ 2024-01-31T04:50:20.638 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 74377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ti-st/st_drv.ko 2024-01-31T04:50:20.638 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/tifm_7xx1.ko 2024-01-31T04:50:20.638 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/tifm_core.ko 2024-01-31T04:50:20.639 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/tsl2550.ko 2024-01-31T04:50:20.639 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/vmw_balloon.ko 2024-01-31T04:50:20.639 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/vmw_vmci/ 2024-01-31T04:50:20.639 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 183609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-31T04:50:20.639 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ 2024-01-31T04:50:20.639 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/bonding/ 2024-01-31T04:50:20.639 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 490849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/bonding/bonding.ko 2024-01-31T04:50:20.639 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/ 2024-01-31T04:50:20.639 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/b53/ 2024-01-31T04:50:20.639 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 106033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-31T04:50:20.639 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-31T04:50:20.639 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-31T04:50:20.639 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/mv88e6xxx/ 2024-01-31T04:50:20.639 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 455065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-31T04:50:20.640 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dummy.ko 2024-01-31T04:50:20.640 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/eql.ko 2024-01-31T04:50:20.640 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ 2024-01-31T04:50:20.640 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/ 2024-01-31T04:50:20.640 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-31T04:50:20.640 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-31T04:50:20.640 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 130553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-31T04:50:20.640 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 68849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-31T04:50:20.640 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/ 2024-01-31T04:50:20.640 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-31T04:50:20.640 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-31T04:50:20.640 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-31T04:50:20.640 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 99049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-31T04:50:20.640 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/adaptec/ 2024-01-31T04:50:20.641 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-31T04:50:20.641 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/agere/ 2024-01-31T04:50:20.641 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-31T04:50:20.641 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/alteon/ 2024-01-31T04:50:20.641 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-31T04:50:20.641 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/altera/ 2024-01-31T04:50:20.641 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-31T04:50:20.641 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/ 2024-01-31T04:50:20.641 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-31T04:50:20.641 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-31T04:50:20.641 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 87297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-31T04:50:20.641 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/ 2024-01-31T04:50:20.641 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/alx/ 2024-01-31T04:50:20.642 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 97337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-31T04:50:20.642 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-01-31T04:50:20.642 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-31T04:50:20.642 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-01-31T04:50:20.642 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 90345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-31T04:50:20.642 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atlx/ 2024-01-31T04:50:20.642 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-31T04:50:20.642 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-31T04:50:20.642 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/ 2024-01-31T04:50:20.642 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-31T04:50:20.642 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 176761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-31T04:50:20.642 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-01-31T04:50:20.642 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1421529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-31T04:50:20.643 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 128569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-31T04:50:20.643 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/genet/ 2024-01-31T04:50:20.643 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 131337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-31T04:50:20.643 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 314553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-31T04:50:20.643 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/brocade/ 2024-01-31T04:50:20.643 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/brocade/bna/ 2024-01-31T04:50:20.643 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 323745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-31T04:50:20.643 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/ 2024-01-31T04:50:20.643 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-01-31T04:50:20.643 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 193497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-31T04:50:20.643 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-01-31T04:50:20.643 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 347257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-31T04:50:20.644 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-01-31T04:50:20.644 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1044793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-31T04:50:20.644 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-01-31T04:50:20.644 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 166193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-31T04:50:20.644 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-01-31T04:50:20.644 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-31T04:50:20.644 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/cisco/ 2024-01-31T04:50:20.644 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/cisco/enic/ 2024-01-31T04:50:20.644 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 204345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-31T04:50:20.644 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/ 2024-01-31T04:50:20.644 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/ 2024-01-31T04:50:20.644 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-31T04:50:20.644 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-31T04:50:20.645 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 141225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-31T04:50:20.645 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-31T04:50:20.645 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-31T04:50:20.645 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-31T04:50:20.645 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dlink/ 2024-01-31T04:50:20.645 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-31T04:50:20.645 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-31T04:50:20.645 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dnet.ko 2024-01-31T04:50:20.645 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ec_bhf.ko 2024-01-31T04:50:20.645 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/emulex/ 2024-01-31T04:50:20.645 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/emulex/benet/ 2024-01-31T04:50:20.646 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 281137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-31T04:50:20.646 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ethoc.ko 2024-01-31T04:50:20.646 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/fealnx.ko 2024-01-31T04:50:20.646 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/fujitsu/ 2024-01-31T04:50:20.646 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-01-31T04:50:20.646 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ 2024-01-31T04:50:20.646 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 90369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-31T04:50:20.646 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000/ 2024-01-31T04:50:20.646 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 295481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-31T04:50:20.646 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000e/ 2024-01-31T04:50:20.646 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 584497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-31T04:50:20.646 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/fm10k/ 2024-01-31T04:50:20.646 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 246209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-31T04:50:20.647 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/i40e/ 2024-01-31T04:50:20.647 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 937673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-31T04:50:20.647 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/iavf/ 2024-01-31T04:50:20.647 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 287305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-31T04:50:20.647 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igb/ 2024-01-31T04:50:20.647 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 514569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-31T04:50:20.647 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igbvf/ 2024-01-31T04:50:20.647 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 93497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-31T04:50:20.647 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-01-31T04:50:20.647 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 734353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-31T04:50:20.647 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-01-31T04:50:20.647 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 151769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-31T04:50:20.648 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 86921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/jme.ko 2024-01-31T04:50:20.648 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/ 2024-01-31T04:50:20.648 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-31T04:50:20.648 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-31T04:50:20.648 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 122601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-31T04:50:20.648 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/ 2024-01-31T04:50:20.648 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-01-31T04:50:20.648 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 727473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-31T04:50:20.648 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 278961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-31T04:50:20.648 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-01-31T04:50:20.648 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-01-31T04:50:20.648 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1118201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-31T04:50:20.789 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ 2024-01-31T04:50:20.790 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-01-31T04:50:20.790 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-01-31T04:50:20.790 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-01-31T04:50:20.790 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 95665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-31T04:50:20.790 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/myricom/ 2024-01-31T04:50:20.790 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-01-31T04:50:20.790 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-31T04:50:20.790 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/natsemi/ 2024-01-31T04:50:20.790 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-31T04:50:20.791 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-31T04:50:20.791 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/neterion/ 2024-01-31T04:50:20.791 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 150905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-31T04:50:20.791 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/nvidia/ 2024-01-31T04:50:20.791 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 136721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-31T04:50:20.791 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/packetengines/ 2024-01-31T04:50:20.791 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-31T04:50:20.791 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-31T04:50:20.791 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/ 2024-01-31T04:50:20.791 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-01-31T04:50:20.791 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 227897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-31T04:50:20.791 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 87105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-31T04:50:20.791 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-01-31T04:50:20.792 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 671937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-31T04:50:20.792 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/rdc/ 2024-01-31T04:50:20.792 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-31T04:50:20.792 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/ 2024-01-31T04:50:20.792 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-31T04:50:20.792 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 83985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-31T04:50:20.792 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-31T04:50:20.792 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 192353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-31T04:50:20.792 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/samsung/ 2024-01-31T04:50:20.792 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-01-31T04:50:20.792 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 104241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-01-31T04:50:20.792 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sfc/ 2024-01-31T04:50:20.792 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1064737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-31T04:50:20.793 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/silan/ 2024-01-31T04:50:20.793 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-31T04:50:20.793 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sis/ 2024-01-31T04:50:20.793 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-31T04:50:20.793 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 63337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-31T04:50:20.793 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/ 2024-01-31T04:50:20.793 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-31T04:50:20.793 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-31T04:50:20.793 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-31T04:50:20.793 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 68177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-31T04:50:20.793 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/ 2024-01-31T04:50:20.793 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-01-31T04:50:20.793 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-01-31T04:50:20.793 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-31T04:50:20.793 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-01-31T04:50:20.794 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 487593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-31T04:50:20.794 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/ 2024-01-31T04:50:20.794 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 103337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-31T04:50:20.794 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 166097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-31T04:50:20.794 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-31T04:50:20.794 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-31T04:50:20.794 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/tehuti/ 2024-01-31T04:50:20.794 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-31T04:50:20.794 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ti/ 2024-01-31T04:50:20.794 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 86529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-31T04:50:20.794 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/via/ 2024-01-31T04:50:20.794 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-31T04:50:20.794 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 83793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-31T04:50:20.794 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/wiznet/ 2024-01-31T04:50:20.794 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-31T04:50:20.795 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-31T04:50:20.795 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/xircom/ 2024-01-31T04:50:20.795 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-31T04:50:20.795 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/ 2024-01-31T04:50:20.795 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/defxx.ko 2024-01-31T04:50:20.795 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/skfp/ 2024-01-31T04:50:20.795 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 216985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/skfp/skfp.ko 2024-01-31T04:50:20.795 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 74569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/geneve.ko 2024-01-31T04:50:20.795 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/hyperv/ 2024-01-31T04:50:20.795 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 236225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-31T04:50:20.795 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ieee802154/ 2024-01-31T04:50:20.795 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-31T04:50:20.795 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ifb.ko 2024-01-31T04:50:20.795 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ipvlan/ 2024-01-31T04:50:20.795 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-31T04:50:20.796 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/macvlan.ko 2024-01-31T04:50:20.796 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/macvtap.ko 2024-01-31T04:50:20.796 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/ 2024-01-31T04:50:20.796 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-31T04:50:20.796 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-31T04:50:20.796 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-gpio.ko 2024-01-31T04:50:20.796 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-31T04:50:20.796 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio.ko 2024-01-31T04:50:20.796 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mii.ko 2024-01-31T04:50:20.796 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/netconsole.ko 2024-01-31T04:50:20.796 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/nlmon.ko 2024-01-31T04:50:20.797 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/pcs/ 2024-01-31T04:50:20.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-31T04:50:20.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-31T04:50:20.797 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/ 2024-01-31T04:50:20.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/amd.ko 2024-01-31T04:50:20.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-31T04:50:20.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-31T04:50:20.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/bcm87xx.ko 2024-01-31T04:50:20.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/broadcom.ko 2024-01-31T04:50:20.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/cicada.ko 2024-01-31T04:50:20.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/davicom.ko 2024-01-31T04:50:20.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/et1011c.ko 2024-01-31T04:50:20.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/icplus.ko 2024-01-31T04:50:20.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/lxt.ko 2024-01-31T04:50:20.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 82049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/marvell.ko 2024-01-31T04:50:20.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 76409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/micrel.ko 2024-01-31T04:50:20.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/national.ko 2024-01-31T04:50:20.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 95561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/phylink.ko 2024-01-31T04:50:20.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/qsemi.ko 2024-01-31T04:50:20.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/realtek.ko 2024-01-31T04:50:20.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/smsc.ko 2024-01-31T04:50:20.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/ste10Xp.ko 2024-01-31T04:50:20.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/vitesse.ko 2024-01-31T04:50:20.798 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/plip/ 2024-01-31T04:50:20.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/plip/plip.ko 2024-01-31T04:50:20.799 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ 2024-01-31T04:50:20.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-31T04:50:20.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_async.ko 2024-01-31T04:50:20.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-31T04:50:20.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-31T04:50:20.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-31T04:50:20.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/pppoe.ko 2024-01-31T04:50:20.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/pppox.ko 2024-01-31T04:50:20.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/pptp.ko 2024-01-31T04:50:20.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/sb1000.ko 2024-01-31T04:50:20.799 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/slip/ 2024-01-31T04:50:20.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/slip/slip.ko 2024-01-31T04:50:20.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/sungem_phy.ko 2024-01-31T04:50:20.800 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 64585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/tap.ko 2024-01-31T04:50:20.800 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/ 2024-01-31T04:50:20.800 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 107089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team.ko 2024-01-31T04:50:20.800 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-31T04:50:20.800 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-31T04:50:20.800 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-31T04:50:20.800 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_random.ko 2024-01-31T04:50:20.800 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-31T04:50:20.800 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 86945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/veth.ko 2024-01-31T04:50:20.800 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vmxnet3/ 2024-01-31T04:50:20.800 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 144361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-31T04:50:20.800 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vxlan/ 2024-01-31T04:50:20.800 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 301281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vxlan/vxlan.ko 2024-01-31T04:50:20.801 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/xen-netback/ 2024-01-31T04:50:20.801 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 144001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-31T04:50:20.801 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ntb/ 2024-01-31T04:50:20.801 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ntb/ntb.ko 2024-01-31T04:50:20.801 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/ 2024-01-31T04:50:20.801 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/host/ 2024-01-31T04:50:20.801 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 265777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/host/nvme-core.ko 2024-01-31T04:50:20.801 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/host/nvme.ko 2024-01-31T04:50:20.801 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/ 2024-01-31T04:50:20.801 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 131249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport.ko 2024-01-31T04:50:20.801 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport_cs.ko 2024-01-31T04:50:20.801 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport_pc.ko 2024-01-31T04:50:20.801 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport_serial.ko 2024-01-31T04:50:20.801 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/ 2024-01-31T04:50:20.802 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/ 2024-01-31T04:50:20.802 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-31T04:50:20.802 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-01-31T04:50:20.802 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-01-31T04:50:20.802 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/pci-stub.ko 2024-01-31T04:50:20.802 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/xen-pcifront.ko 2024-01-31T04:50:20.802 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/ 2024-01-31T04:50:20.802 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/i82092.ko 2024-01-31T04:50:20.802 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 146289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pcmcia.ko 2024-01-31T04:50:20.802 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pcmcia_core.ko 2024-01-31T04:50:20.802 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-01-31T04:50:20.802 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pd6729.ko 2024-01-31T04:50:20.802 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 112889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-31T04:50:20.802 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/ 2024-01-31T04:50:20.802 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/broadcom/ 2024-01-31T04:50:20.803 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-01-31T04:50:20.803 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/samsung/ 2024-01-31T04:50:20.803 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-01-31T04:50:20.803 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pinctrl/ 2024-01-31T04:50:20.803 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pinctrl/intel/ 2024-01-31T04:50:20.803 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-31T04:50:20.803 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/ 2024-01-31T04:50:20.803 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/ 2024-01-31T04:50:20.803 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-01-31T04:50:20.803 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec.ko 2024-01-31T04:50:20.803 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-01-31T04:50:20.803 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-01-31T04:50:20.803 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-01-31T04:50:20.803 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-01-31T04:50:20.803 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-01-31T04:50:20.804 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/ 2024-01-31T04:50:20.804 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-31T04:50:20.804 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/acerhdf.ko 2024-01-31T04:50:20.804 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-31T04:50:20.804 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-31T04:50:20.804 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-31T04:50:20.804 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 132025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-31T04:50:20.804 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-31T04:50:20.804 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-31T04:50:20.804 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-31T04:50:20.804 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-31T04:50:20.804 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-31T04:50:20.805 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/hdaps.ko 2024-01-31T04:50:20.805 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/ibm_rtl.ko 2024-01-31T04:50:20.805 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel/ 2024-01-31T04:50:20.805 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-31T04:50:20.805 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-01-31T04:50:20.805 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel_ips.ko 2024-01-31T04:50:20.805 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-31T04:50:20.805 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-31T04:50:20.805 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-31T04:50:20.805 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-31T04:50:20.805 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-31T04:50:20.805 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-31T04:50:20.805 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-31T04:50:20.806 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-31T04:50:20.806 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-31T04:50:20.806 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/wmi.ko 2024-01-31T04:50:20.806 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/ 2024-01-31T04:50:20.806 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ 2024-01-31T04:50:20.806 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/88pm860x_battery.ko 2024-01-31T04:50:20.806 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/88pm860x_charger.ko 2024-01-31T04:50:20.806 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/bq2415x_charger.ko 2024-01-31T04:50:20.806 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/bq24190_charger.ko 2024-01-31T04:50:20.806 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/bq24735-charger.ko 2024-01-31T04:50:20.806 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-01-31T04:50:20.806 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/da9030_battery.ko 2024-01-31T04:50:20.806 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/da9052-battery.ko 2024-01-31T04:50:20.806 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2760_battery.ko 2024-01-31T04:50:20.806 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2780_battery.ko 2024-01-31T04:50:20.807 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2781_battery.ko 2024-01-31T04:50:20.807 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2782_battery.ko 2024-01-31T04:50:20.807 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/gpio-charger.ko 2024-01-31T04:50:20.807 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/isp1704_charger.ko 2024-01-31T04:50:20.807 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/lp8727_charger.ko 2024-01-31T04:50:20.807 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max14577_charger.ko 2024-01-31T04:50:20.807 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max17042_battery.ko 2024-01-31T04:50:20.807 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max8903_charger.ko 2024-01-31T04:50:20.807 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max8925_power.ko 2024-01-31T04:50:20.807 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/pcf50633-charger.ko 2024-01-31T04:50:20.808 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/sbs-battery.ko 2024-01-31T04:50:20.808 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/test_power.ko 2024-01-31T04:50:20.808 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/tps65090-charger.ko 2024-01-31T04:50:20.808 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/wm831x_backup.ko 2024-01-31T04:50:20.808 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/wm831x_power.ko 2024-01-31T04:50:20.811 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/wm8350_power.ko 2024-01-31T04:50:20.811 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/powercap/ 2024-01-31T04:50:20.811 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-31T04:50:20.811 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-31T04:50:20.811 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/ 2024-01-31T04:50:20.811 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/ 2024-01-31T04:50:20.811 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-31T04:50:20.812 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-31T04:50:20.812 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/pps_parport.ko 2024-01-31T04:50:20.812 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/pps_core.ko 2024-01-31T04:50:20.812 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ptp/ 2024-01-31T04:50:20.812 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ptp/ptp.ko 2024-01-31T04:50:20.812 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ptp/ptp_kvm.ko 2024-01-31T04:50:20.812 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/ 2024-01-31T04:50:20.812 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-88pm80x.ko 2024-01-31T04:50:20.812 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-88pm860x.ko 2024-01-31T04:50:20.812 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-31T04:50:20.812 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-da9052.ko 2024-01-31T04:50:20.812 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-da9055.ko 2024-01-31T04:50:20.812 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-da9063.ko 2024-01-31T04:50:20.813 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-31T04:50:20.813 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 68577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-31T04:50:20.813 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-31T04:50:20.813 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-31T04:50:20.813 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-31T04:50:20.813 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-31T04:50:20.813 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-31T04:50:20.813 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-31T04:50:20.813 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-31T04:50:20.813 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-em3027.ko 2024-01-31T04:50:20.813 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-31T04:50:20.814 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-31T04:50:20.814 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-31T04:50:20.814 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-lp8788.ko 2024-01-31T04:50:20.814 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-31T04:50:20.814 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-31T04:50:20.814 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-31T04:50:20.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m48t86.ko 2024-01-31T04:50:20.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max6900.ko 2024-01-31T04:50:20.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8907.ko 2024-01-31T04:50:20.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8925.ko 2024-01-31T04:50:20.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8997.ko 2024-01-31T04:50:20.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8998.ko 2024-01-31T04:50:20.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-01-31T04:50:20.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-31T04:50:20.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-palmas.ko 2024-01-31T04:50:20.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-31T04:50:20.815 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf50633.ko 2024-01-31T04:50:20.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-31T04:50:20.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-31T04:50:20.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-31T04:50:20.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-31T04:50:20.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rc5t583.ko 2024-01-31T04:50:20.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-31T04:50:20.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-31T04:50:20.816 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-31T04:50:20.817 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-31T04:50:20.817 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-31T04:50:20.817 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-s35390a.ko 2024-01-31T04:50:20.817 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-31T04:50:20.817 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-tps6586x.ko 2024-01-31T04:50:20.817 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-tps65910.ko 2024-01-31T04:50:20.818 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-wm831x.ko 2024-01-31T04:50:20.818 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-wm8350.ko 2024-01-31T04:50:20.818 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-x1205.ko 2024-01-31T04:50:20.818 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ 2024-01-31T04:50:20.818 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 77617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/3w-9xxx.ko 2024-01-31T04:50:20.818 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/3w-sas.ko 2024-01-31T04:50:20.819 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/3w-xxxx.ko 2024-01-31T04:50:20.819 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 135185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/BusLogic.ko 2024-01-31T04:50:20.819 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/a100u2w.ko 2024-01-31T04:50:20.819 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aacraid/ 2024-01-31T04:50:20.819 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 271113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-31T04:50:20.819 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 100617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/advansys.ko 2024-01-31T04:50:20.819 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic7xxx/ 2024-01-31T04:50:20.819 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 356929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-31T04:50:20.819 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 296049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-31T04:50:20.819 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic94xx/ 2024-01-31T04:50:20.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 189185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-01-31T04:50:20.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/am53c974.ko 2024-01-31T04:50:20.820 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/arcmsr/ 2024-01-31T04:50:20.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 106881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-31T04:50:20.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/atp870u.ko 2024-01-31T04:50:20.820 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/be2iscsi/ 2024-01-31T04:50:20.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 247009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-31T04:50:20.820 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bfa/ 2024-01-31T04:50:20.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1171945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bfa/bfa.ko 2024-01-31T04:50:20.820 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2fc/ 2024-01-31T04:50:20.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 237721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-31T04:50:20.820 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2i/ 2024-01-31T04:50:20.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 115369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-31T04:50:20.820 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ch.ko 2024-01-31T04:50:20.821 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/csiostor/ 2024-01-31T04:50:20.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 308921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-31T04:50:20.821 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/ 2024-01-31T04:50:20.821 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-01-31T04:50:20.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 76145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-31T04:50:20.821 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-01-31T04:50:20.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 101449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-31T04:50:20.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 146625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-31T04:50:20.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 75553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/dc395x.ko 2024-01-31T04:50:20.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/dmx3191d.ko 2024-01-31T04:50:20.821 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/esas2r/ 2024-01-31T04:50:20.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 212425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-31T04:50:20.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/esp_scsi.ko 2024-01-31T04:50:20.821 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fcoe/ 2024-01-31T04:50:20.821 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-31T04:50:20.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 158505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-31T04:50:20.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fdomain.ko 2024-01-31T04:50:20.822 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fnic/ 2024-01-31T04:50:20.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 263489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fnic/fnic.ko 2024-01-31T04:50:20.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 201817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/hpsa.ko 2024-01-31T04:50:20.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/hptiop.ko 2024-01-31T04:50:20.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/hv_storvsc.ko 2024-01-31T04:50:20.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/imm.ko 2024-01-31T04:50:20.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/initio.ko 2024-01-31T04:50:20.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 266537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ipr.ko 2024-01-31T04:50:20.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 101473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ips.ko 2024-01-31T04:50:20.822 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/isci/ 2024-01-31T04:50:20.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 317153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/isci/isci.ko 2024-01-31T04:50:20.822 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-31T04:50:20.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-31T04:50:20.823 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libfc/ 2024-01-31T04:50:20.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 315209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libfc/libfc.ko 2024-01-31T04:50:20.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 145585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libiscsi.ko 2024-01-31T04:50:20.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-31T04:50:20.823 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libsas/ 2024-01-31T04:50:20.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 216441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libsas/libsas.ko 2024-01-31T04:50:20.823 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/lpfc/ 2024-01-31T04:50:20.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2197481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-31T04:50:20.823 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/ 2024-01-31T04:50:20.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-31T04:50:20.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-31T04:50:20.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 310841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-31T04:50:20.823 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 84649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid.ko 2024-01-31T04:50:20.824 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mpt3sas/ 2024-01-31T04:50:20.824 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 659801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-31T04:50:20.824 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mvsas/ 2024-01-31T04:50:20.824 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 119561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-31T04:50:20.824 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mvumi.ko 2024-01-31T04:50:20.824 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/ 2024-01-31T04:50:20.824 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-01-31T04:50:20.824 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-01-31T04:50:20.824 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-01-31T04:50:20.824 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-01-31T04:50:20.824 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pm8001/ 2024-01-31T04:50:20.824 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 366401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-31T04:50:20.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 124633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pmcraid.ko 2024-01-31T04:50:20.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ppa.ko 2024-01-31T04:50:20.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla1280.ko 2024-01-31T04:50:20.825 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla2xxx/ 2024-01-31T04:50:20.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1876633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-31T04:50:20.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-31T04:50:20.825 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla4xxx/ 2024-01-31T04:50:20.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 559033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-31T04:50:20.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qlogicfas408.ko 2024-01-31T04:50:20.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/raid_class.ko 2024-01-31T04:50:20.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 261241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_debug.ko 2024-01-31T04:50:20.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 173937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-31T04:50:20.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 279313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-31T04:50:20.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 97729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-31T04:50:20.825 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-31T04:50:20.826 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-31T04:50:20.826 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ses.ko 2024-01-31T04:50:20.826 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 115889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/st.ko 2024-01-31T04:50:20.826 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/stex.ko 2024-01-31T04:50:20.826 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/sym53c8xx_2/ 2024-01-31T04:50:20.826 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 164961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-31T04:50:20.826 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/virtio_scsi.ko 2024-01-31T04:50:20.826 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-31T04:50:20.826 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/wd719x.ko 2024-01-31T04:50:20.826 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/xen-scsifront.ko 2024-01-31T04:50:20.826 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ssb/ 2024-01-31T04:50:20.826 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 129441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ssb/ssb.ko 2024-01-31T04:50:20.826 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/ 2024-01-31T04:50:20.826 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/iscsi/ 2024-01-31T04:50:20.827 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 736769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-31T04:50:20.827 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/loopback/ 2024-01-31T04:50:20.827 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-31T04:50:20.827 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_file.ko 2024-01-31T04:50:20.827 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_iblock.ko 2024-01-31T04:50:20.827 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 930697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_mod.ko 2024-01-31T04:50:20.827 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_pscsi.ko 2024-01-31T04:50:20.827 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 122521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_user.ko 2024-01-31T04:50:20.827 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/tcm_fc/ 2024-01-31T04:50:20.827 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 75593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-31T04:50:20.827 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/ 2024-01-31T04:50:20.827 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/ 2024-01-31T04:50:20.828 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/ 2024-01-31T04:50:20.828 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-31T04:50:20.828 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-31T04:50:20.828 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-31T04:50:20.828 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-31T04:50:20.828 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-31T04:50:20.829 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-31T04:50:20.829 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-31T04:50:20.829 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-31T04:50:20.829 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-31T04:50:20.829 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-31T04:50:20.829 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-31T04:50:20.830 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-31T04:50:20.830 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-31T04:50:20.830 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-31T04:50:20.830 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-31T04:50:20.830 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-01-31T04:50:20.831 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-31T04:50:20.831 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-31T04:50:20.831 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-31T04:50:20.831 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/ 2024-01-31T04:50:20.831 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/ipwireless/ 2024-01-31T04:50:20.831 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-31T04:50:20.831 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/moxa.ko 2024-01-31T04:50:20.831 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/mxser.ko 2024-01-31T04:50:20.831 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/n_gsm.ko 2024-01-31T04:50:20.831 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/n_hdlc.ko 2024-01-31T04:50:20.831 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/nozomi.ko 2024-01-31T04:50:20.831 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/ 2024-01-31T04:50:20.831 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/8250/ 2024-01-31T04:50:20.831 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-01-31T04:50:20.832 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-31T04:50:20.832 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-01-31T04:50:20.832 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/altera_uart.ko 2024-01-31T04:50:20.832 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/arc_uart.ko 2024-01-31T04:50:20.832 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-01-31T04:50:20.832 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/jsm/ 2024-01-31T04:50:20.832 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 103073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-31T04:50:20.832 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/rp2.ko 2024-01-31T04:50:20.832 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/sc16is7xx.ko 2024-01-31T04:50:20.832 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/ 2024-01-31T04:50:20.832 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/core/ 2024-01-31T04:50:20.833 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 535985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-31T04:50:20.833 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/host/ 2024-01-31T04:50:20.833 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-31T04:50:20.833 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-01-31T04:50:20.833 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/ 2024-01-31T04:50:20.833 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio.ko 2024-01-31T04:50:20.833 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_aec.ko 2024-01-31T04:50:20.833 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_cif.ko 2024-01-31T04:50:20.833 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_dmem_genirq.ko 2024-01-31T04:50:20.833 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_mf624.ko 2024-01-31T04:50:20.833 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_netx.ko 2024-01-31T04:50:20.833 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_pci_generic.ko 2024-01-31T04:50:20.833 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-01-31T04:50:20.833 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_sercos3.ko 2024-01-31T04:50:20.833 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/ 2024-01-31T04:50:20.833 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/c67x00/ 2024-01-31T04:50:20.834 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/c67x00/c67x00.ko 2024-01-31T04:50:20.834 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ 2024-01-31T04:50:20.834 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 144617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-01-31T04:50:20.834 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-01-31T04:50:20.834 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-01-31T04:50:20.834 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-01-31T04:50:20.834 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-01-31T04:50:20.834 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/ 2024-01-31T04:50:20.834 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 87073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/cdc-acm.ko 2024-01-31T04:50:20.834 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-31T04:50:20.834 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/usblp.ko 2024-01-31T04:50:20.834 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/usbtmc.ko 2024-01-31T04:50:20.834 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/common/ 2024-01-31T04:50:20.834 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/common/ulpi.ko 2024-01-31T04:50:20.835 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc2/ 2024-01-31T04:50:20.835 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-01-31T04:50:20.835 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/ 2024-01-31T04:50:20.835 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-01-31T04:50:20.835 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-01-31T04:50:20.835 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 454385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/dwc3.ko 2024-01-31T04:50:20.835 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/ 2024-01-31T04:50:20.835 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/ 2024-01-31T04:50:20.835 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/u_ether.ko 2024-01-31T04:50:20.835 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/u_serial.ko 2024-01-31T04:50:20.835 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-01-31T04:50:20.835 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-01-31T04:50:20.835 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-01-31T04:50:20.835 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-01-31T04:50:20.836 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 92489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-01-31T04:50:20.836 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-01-31T04:50:20.836 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 122081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-01-31T04:50:20.836 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-01-31T04:50:20.836 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-01-31T04:50:20.836 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-01-31T04:50:20.836 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-01-31T04:50:20.836 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-01-31T04:50:20.836 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-01-31T04:50:20.836 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-01-31T04:50:20.836 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-01-31T04:50:20.837 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/ 2024-01-31T04:50:20.837 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-01-31T04:50:20.837 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-01-31T04:50:20.837 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-01-31T04:50:20.837 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-01-31T04:50:20.837 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-01-31T04:50:20.837 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-01-31T04:50:20.837 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-01-31T04:50:20.837 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-01-31T04:50:20.838 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-01-31T04:50:20.838 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-01-31T04:50:20.838 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-01-31T04:50:20.838 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-01-31T04:50:20.838 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-01-31T04:50:20.838 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-01-31T04:50:20.838 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 161225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/libcomposite.ko 2024-01-31T04:50:20.839 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/ 2024-01-31T04:50:20.839 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-01-31T04:50:20.839 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/bdc/ 2024-01-31T04:50:20.839 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 157681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-01-31T04:50:20.839 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-01-31T04:50:20.839 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-01-31T04:50:20.840 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-01-31T04:50:20.840 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-01-31T04:50:20.840 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 76057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/net2272.ko 2024-01-31T04:50:20.840 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 75073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/net2280.ko 2024-01-31T04:50:20.840 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-01-31T04:50:20.840 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 65809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-01-31T04:50:20.840 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-01-31T04:50:20.840 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-01-31T04:50:20.840 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 156409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-01-31T04:50:20.840 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/ 2024-01-31T04:50:20.841 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/bcma-hcd.ko 2024-01-31T04:50:20.841 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/isp116x-hcd.ko 2024-01-31T04:50:20.841 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 87353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-01-31T04:50:20.841 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-01-31T04:50:20.841 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-31T04:50:20.842 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/sl811_cs.ko 2024-01-31T04:50:20.842 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/ssb-hcd.ko 2024-01-31T04:50:20.842 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-01-31T04:50:20.842 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/image/ 2024-01-31T04:50:20.842 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/image/mdc800.ko 2024-01-31T04:50:20.842 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/image/microtek.ko 2024-01-31T04:50:20.842 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ 2024-01-31T04:50:20.842 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/adutux.ko 2024-01-31T04:50:20.842 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/appledisplay.ko 2024-01-31T04:50:20.842 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-01-31T04:50:20.842 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/cytherm.ko 2024-01-31T04:50:20.842 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ehset.ko 2024-01-31T04:50:20.842 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/emi26.ko 2024-01-31T04:50:20.843 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/emi62.ko 2024-01-31T04:50:20.843 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ezusb.ko 2024-01-31T04:50:20.843 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/idmouse.ko 2024-01-31T04:50:20.843 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/iowarrior.ko 2024-01-31T04:50:20.843 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-31T04:50:20.843 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ldusb.ko 2024-01-31T04:50:20.843 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/legousbtower.ko 2024-01-31T04:50:20.843 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/lvstest.ko 2024-01-31T04:50:20.843 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/sisusbvga/ 2024-01-31T04:50:20.843 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 64841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-31T04:50:20.843 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-31T04:50:20.843 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usb3503.ko 2024-01-31T04:50:20.843 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usblcd.ko 2024-01-31T04:50:20.843 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-31T04:50:20.843 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usbtest.ko 2024-01-31T04:50:20.844 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/uss720.ko 2024-01-31T04:50:20.844 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/yurex.ko 2024-01-31T04:50:20.844 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/mon/ 2024-01-31T04:50:20.844 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/mon/usbmon.ko 2024-01-31T04:50:20.844 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/musb/ 2024-01-31T04:50:20.844 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 301697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/musb/musb_hdrc.ko 2024-01-31T04:50:20.844 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/ 2024-01-31T04:50:20.844 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-generic.ko 2024-01-31T04:50:20.844 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-01-31T04:50:20.844 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-isp1301.ko 2024-01-31T04:50:20.844 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-tahvo.ko 2024-01-31T04:50:20.844 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ 2024-01-31T04:50:20.844 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/aircable.ko 2024-01-31T04:50:20.845 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ark3116.ko 2024-01-31T04:50:20.845 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-31T04:50:20.845 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ch341.ko 2024-01-31T04:50:20.845 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/cp210x.ko 2024-01-31T04:50:20.845 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/cyberjack.ko 2024-01-31T04:50:20.845 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-31T04:50:20.845 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-31T04:50:20.845 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/empeg.ko 2024-01-31T04:50:20.845 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/f81232.ko 2024-01-31T04:50:20.845 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 175193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-31T04:50:20.845 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-31T04:50:20.845 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 137081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-31T04:50:20.845 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 124833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/io_ti.ko 2024-01-31T04:50:20.845 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ipaq.ko 2024-01-31T04:50:20.845 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ipw.ko 2024-01-31T04:50:20.845 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ir-usb.ko 2024-01-31T04:50:20.846 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-31T04:50:20.846 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 107521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/keyspan.ko 2024-01-31T04:50:20.846 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-31T04:50:20.846 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-31T04:50:20.846 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-31T04:50:20.846 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mct_u232.ko 2024-01-31T04:50:20.846 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/metro-usb.ko 2024-01-31T04:50:20.846 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mos7720.ko 2024-01-31T04:50:20.846 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mos7840.ko 2024-01-31T04:50:20.846 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mxuport.ko 2024-01-31T04:50:20.846 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/navman.ko 2024-01-31T04:50:20.846 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/omninet.ko 2024-01-31T04:50:20.846 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/opticon.ko 2024-01-31T04:50:20.846 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 191801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/option.ko 2024-01-31T04:50:20.846 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/oti6858.ko 2024-01-31T04:50:20.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/pl2303.ko 2024-01-31T04:50:20.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/qcaux.ko 2024-01-31T04:50:20.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/qcserial.ko 2024-01-31T04:50:20.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/quatech2.ko 2024-01-31T04:50:20.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/safe_serial.ko 2024-01-31T04:50:20.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/sierra.ko 2024-01-31T04:50:20.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-31T04:50:20.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ssu100.ko 2024-01-31T04:50:20.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/symbolserial.ko 2024-01-31T04:50:20.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-31T04:50:20.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-31T04:50:20.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usb_debug.ko 2024-01-31T04:50:20.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-31T04:50:20.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 125609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usbserial.ko 2024-01-31T04:50:20.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/visor.ko 2024-01-31T04:50:20.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/whiteheat.ko 2024-01-31T04:50:20.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/wishbone-serial.ko 2024-01-31T04:50:20.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-31T04:50:20.848 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ 2024-01-31T04:50:20.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/uas.ko 2024-01-31T04:50:20.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-31T04:50:20.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-31T04:50:20.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-31T04:50:20.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-31T04:50:20.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-31T04:50:20.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-31T04:50:20.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-31T04:50:20.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-karma.ko 2024-01-31T04:50:20.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-31T04:50:20.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-31T04:50:20.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-31T04:50:20.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-31T04:50:20.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-31T04:50:20.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 180225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/usb-storage.ko 2024-01-31T04:50:20.849 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/ 2024-01-31T04:50:20.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-31T04:50:20.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-31T04:50:20.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 103977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-31T04:50:20.849 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/ 2024-01-31T04:50:20.849 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/pci/ 2024-01-31T04:50:20.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 154297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-31T04:50:20.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-31T04:50:20.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 103737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/vfio.ko 2024-01-31T04:50:20.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 77609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-31T04:50:20.850 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/ 2024-01-31T04:50:20.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 113785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost.ko 2024-01-31T04:50:20.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-31T04:50:20.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost_net.ko 2024-01-31T04:50:20.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost_scsi.ko 2024-01-31T04:50:20.850 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/ 2024-01-31T04:50:20.850 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/ 2024-01-31T04:50:20.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-01-31T04:50:20.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/aat2870_bl.ko 2024-01-31T04:50:20.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/adp5520_bl.ko 2024-01-31T04:50:20.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/adp8860_bl.ko 2024-01-31T04:50:20.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/adp8870_bl.ko 2024-01-31T04:50:20.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/apple_bl.ko 2024-01-31T04:50:20.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/as3711_bl.ko 2024-01-31T04:50:20.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/bd6107.ko 2024-01-31T04:50:20.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/da903x_bl.ko 2024-01-31T04:50:20.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/da9052_bl.ko 2024-01-31T04:50:20.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/gpio_backlight.ko 2024-01-31T04:50:20.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/kb3886_bl.ko 2024-01-31T04:50:20.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lcd.ko 2024-01-31T04:50:20.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lm3533_bl.ko 2024-01-31T04:50:20.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lm3639_bl.ko 2024-01-31T04:50:20.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lv5207lp.ko 2024-01-31T04:50:20.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/max8925_bl.ko 2024-01-31T04:50:20.852 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/pandora_bl.ko 2024-01-31T04:50:20.852 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-01-31T04:50:20.852 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-31T04:50:20.852 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/wm831x_bl.ko 2024-01-31T04:50:20.852 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/ 2024-01-31T04:50:20.852 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/ 2024-01-31T04:50:20.852 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/ds2482.ko 2024-01-31T04:50:20.852 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/ds2490.ko 2024-01-31T04:50:20.852 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/matrox_w1.ko 2024-01-31T04:50:20.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/w1-gpio.ko 2024-01-31T04:50:20.853 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/ 2024-01-31T04:50:20.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-31T04:50:20.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-31T04:50:20.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-31T04:50:20.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-31T04:50:20.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-31T04:50:20.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-31T04:50:20.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-31T04:50:20.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-31T04:50:20.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-31T04:50:20.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-31T04:50:20.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-31T04:50:20.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/wire.ko 2024-01-31T04:50:20.854 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ 2024-01-31T04:50:20.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/acquirewdt.ko 2024-01-31T04:50:20.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/advantechwdt.ko 2024-01-31T04:50:20.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-31T04:50:20.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-31T04:50:20.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/cpu5wdt.ko 2024-01-31T04:50:20.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/da9052_wdt.ko 2024-01-31T04:50:20.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/da9055_wdt.ko 2024-01-31T04:50:20.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/da9063_wdt.ko 2024-01-31T04:50:20.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/dw_wdt.ko 2024-01-31T04:50:20.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/eurotechwdt.ko 2024-01-31T04:50:20.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-31T04:50:20.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/hpwdt.ko 2024-01-31T04:50:20.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/i6300esb.ko 2024-01-31T04:50:20.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-31T04:50:20.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-31T04:50:20.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ib700wdt.ko 2024-01-31T04:50:20.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ibmasr.ko 2024-01-31T04:50:20.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-31T04:50:20.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-31T04:50:20.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/it87_wdt.ko 2024-01-31T04:50:20.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/kempld_wdt.ko 2024-01-31T04:50:20.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/machzwd.ko 2024-01-31T04:50:20.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/mena21_wdt.ko 2024-01-31T04:50:20.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-01-31T04:50:20.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/nv_tco.ko 2024-01-31T04:50:20.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-01-31T04:50:20.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/pc87413_wdt.ko 2024-01-31T04:50:20.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-31T04:50:20.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-31T04:50:20.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/retu_wdt.ko 2024-01-31T04:50:20.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-01-31T04:50:20.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-01-31T04:50:20.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-31T04:50:20.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sc1200wdt.ko 2024-01-31T04:50:20.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-31T04:50:20.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-01-31T04:50:20.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/softdog.ko 2024-01-31T04:50:20.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-31T04:50:20.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/twl4030_wdt.ko 2024-01-31T04:50:20.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/via_wdt.ko 2024-01-31T04:50:20.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-31T04:50:20.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-31T04:50:20.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-31T04:50:20.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wafer5823wdt.ko 2024-01-31T04:50:20.857 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wdt_pci.ko 2024-01-31T04:50:20.857 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wm831x_wdt.ko 2024-01-31T04:50:20.857 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wm8350_wdt.ko 2024-01-31T04:50:20.857 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/xen_wdt.ko 2024-01-31T04:50:20.857 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/ 2024-01-31T04:50:20.857 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-evtchn.ko 2024-01-31T04:50:20.857 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-gntalloc.ko 2024-01-31T04:50:20.857 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-gntdev.ko 2024-01-31T04:50:20.857 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-pciback/ 2024-01-31T04:50:20.857 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 176441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-31T04:50:20.857 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-privcmd.ko 2024-01-31T04:50:20.857 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-scsiback.ko 2024-01-31T04:50:20.858 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xenfs/ 2024-01-31T04:50:20.858 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-31T04:50:20.858 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ 2024-01-31T04:50:20.858 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/9p/ 2024-01-31T04:50:20.858 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 166753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/9p/9p.ko 2024-01-31T04:50:20.858 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/adfs/ 2024-01-31T04:50:20.858 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/adfs/adfs.ko 2024-01-31T04:50:20.858 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/affs/ 2024-01-31T04:50:20.858 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 163449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/affs/affs.ko 2024-01-31T04:50:20.858 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/afs/ 2024-01-31T04:50:20.858 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 935033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/afs/kafs.ko 2024-01-31T04:50:20.858 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/autofs/ 2024-01-31T04:50:20.858 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 103401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/autofs/autofs4.ko 2024-01-31T04:50:20.859 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/befs/ 2024-01-31T04:50:20.859 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 64681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/befs/befs.ko 2024-01-31T04:50:20.859 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/bfs/ 2024-01-31T04:50:20.859 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/bfs/bfs.ko 2024-01-31T04:50:20.859 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/binfmt_misc.ko 2024-01-31T04:50:20.859 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/btrfs/ 2024-01-31T04:50:20.859 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 3455857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/btrfs/btrfs.ko 2024-01-31T04:50:20.859 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cachefiles/ 2024-01-31T04:50:20.859 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 306009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cachefiles/cachefiles.ko 2024-01-31T04:50:20.859 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ceph/ 2024-01-31T04:50:20.859 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1336985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ceph/ceph.ko 2024-01-31T04:50:20.859 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/coda/ 2024-01-31T04:50:20.859 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 100801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/coda/coda.ko 2024-01-31T04:50:20.860 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/configfs/ 2024-01-31T04:50:20.860 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/configfs/configfs.ko 2024-01-31T04:50:20.860 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cramfs/ 2024-01-31T04:50:20.860 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cramfs/cramfs.ko 2024-01-31T04:50:20.860 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/dlm/ 2024-01-31T04:50:20.860 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 644073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/dlm/dlm.ko 2024-01-31T04:50:20.860 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/efs/ 2024-01-31T04:50:20.861 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/efs/efs.ko 2024-01-31T04:50:20.861 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/f2fs/ 2024-01-31T04:50:20.861 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1506641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/f2fs/f2fs.ko 2024-01-31T04:50:20.861 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fat/ 2024-01-31T04:50:20.861 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fat/msdos.ko 2024-01-31T04:50:20.861 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/freevxfs/ 2024-01-31T04:50:20.861 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/freevxfs/freevxfs.ko 2024-01-31T04:50:20.861 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fscache/ 2024-01-31T04:50:20.861 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 226481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fscache/fscache.ko 2024-01-31T04:50:20.861 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fuse/ 2024-01-31T04:50:20.861 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fuse/cuse.ko 2024-01-31T04:50:20.862 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/gfs2/ 2024-01-31T04:50:20.862 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1229913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/gfs2/gfs2.ko 2024-01-31T04:50:20.862 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfs/ 2024-01-31T04:50:20.862 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 141985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfs/hfs.ko 2024-01-31T04:50:20.862 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfsplus/ 2024-01-31T04:50:20.862 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 223225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfsplus/hfsplus.ko 2024-01-31T04:50:20.862 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hpfs/ 2024-01-31T04:50:20.862 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 193569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hpfs/hpfs.ko 2024-01-31T04:50:20.862 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/isofs/ 2024-01-31T04:50:20.862 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 74785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/isofs/isofs.ko 2024-01-31T04:50:20.862 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/jfs/ 2024-01-31T04:50:20.862 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 419881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/jfs/jfs.ko 2024-01-31T04:50:20.862 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/lockd/ 2024-01-31T04:50:20.862 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 282049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/lockd/lockd.ko 2024-01-31T04:50:20.863 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/minix/ 2024-01-31T04:50:20.863 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/minix/minix.ko 2024-01-31T04:50:20.863 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/netfs/ 2024-01-31T04:50:20.863 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 124649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/netfs/netfs.ko 2024-01-31T04:50:20.863 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/ 2024-01-31T04:50:20.863 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/blocklayout/ 2024-01-31T04:50:20.863 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-31T04:50:20.863 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/filelayout/ 2024-01-31T04:50:20.863 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-31T04:50:20.863 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/flexfilelayout/ 2024-01-31T04:50:20.863 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 117465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-31T04:50:20.863 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1057969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfs.ko 2024-01-31T04:50:20.863 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfsv2.ko 2024-01-31T04:50:20.863 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 120265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfsv3.ko 2024-01-31T04:50:20.863 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2042153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfsv4.ko 2024-01-31T04:50:20.864 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs_common/ 2024-01-31T04:50:20.864 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs_common/grace.ko 2024-01-31T04:50:20.864 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs_common/nfs_acl.ko 2024-01-31T04:50:20.864 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfsd/ 2024-01-31T04:50:20.864 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1563929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfsd/nfsd.ko 2024-01-31T04:50:20.864 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nilfs2/ 2024-01-31T04:50:20.864 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 590713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nilfs2/nilfs2.ko 2024-01-31T04:50:20.864 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/ 2024-01-31T04:50:20.864 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-celtic.ko 2024-01-31T04:50:20.864 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-centeuro.ko 2024-01-31T04:50:20.864 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-croatian.ko 2024-01-31T04:50:20.864 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-cyrillic.ko 2024-01-31T04:50:20.864 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-gaelic.ko 2024-01-31T04:50:20.865 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-greek.ko 2024-01-31T04:50:20.865 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-iceland.ko 2024-01-31T04:50:20.865 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-inuit.ko 2024-01-31T04:50:20.865 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-roman.ko 2024-01-31T04:50:20.865 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-romanian.ko 2024-01-31T04:50:20.865 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-turkish.ko 2024-01-31T04:50:20.865 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_ascii.ko 2024-01-31T04:50:20.865 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp1250.ko 2024-01-31T04:50:20.865 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp1251.ko 2024-01-31T04:50:20.865 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp1255.ko 2024-01-31T04:50:20.865 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp737.ko 2024-01-31T04:50:20.865 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp775.ko 2024-01-31T04:50:20.865 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp850.ko 2024-01-31T04:50:20.865 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp852.ko 2024-01-31T04:50:20.865 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp855.ko 2024-01-31T04:50:20.866 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp857.ko 2024-01-31T04:50:20.866 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp860.ko 2024-01-31T04:50:20.866 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp861.ko 2024-01-31T04:50:20.866 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp862.ko 2024-01-31T04:50:20.866 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp863.ko 2024-01-31T04:50:20.866 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp864.ko 2024-01-31T04:50:20.866 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp865.ko 2024-01-31T04:50:20.866 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp866.ko 2024-01-31T04:50:20.866 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp869.ko 2024-01-31T04:50:20.866 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp874.ko 2024-01-31T04:50:20.866 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 94137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp932.ko 2024-01-31T04:50:20.867 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 142673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp936.ko 2024-01-31T04:50:20.867 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 165745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp949.ko 2024-01-31T04:50:20.867 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 118121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp950.ko 2024-01-31T04:50:20.867 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_euc-jp.ko 2024-01-31T04:50:20.867 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-1.ko 2024-01-31T04:50:20.867 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-13.ko 2024-01-31T04:50:20.867 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-14.ko 2024-01-31T04:50:20.867 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-15.ko 2024-01-31T04:50:20.867 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-2.ko 2024-01-31T04:50:20.867 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-3.ko 2024-01-31T04:50:20.867 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-4.ko 2024-01-31T04:50:20.868 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-5.ko 2024-01-31T04:50:20.868 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-6.ko 2024-01-31T04:50:20.868 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-7.ko 2024-01-31T04:50:20.868 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-9.ko 2024-01-31T04:50:20.868 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_koi8-r.ko 2024-01-31T04:50:20.868 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_koi8-ru.ko 2024-01-31T04:50:20.868 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_koi8-u.ko 2024-01-31T04:50:20.869 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-31T04:50:20.869 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_utf8.ko 2024-01-31T04:50:20.869 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ntfs/ 2024-01-31T04:50:20.869 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 220553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ntfs/ntfs.ko 2024-01-31T04:50:20.869 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ 2024-01-31T04:50:20.869 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/cluster/ 2024-01-31T04:50:20.870 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 244737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-31T04:50:20.870 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlm/ 2024-01-31T04:50:20.870 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 440737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-31T04:50:20.870 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlmfs/ 2024-01-31T04:50:20.870 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-31T04:50:20.870 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2593521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2.ko 2024-01-31T04:50:20.870 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-31T04:50:20.870 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-31T04:50:20.870 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-31T04:50:20.870 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/omfs/ 2024-01-31T04:50:20.870 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/omfs/omfs.ko 2024-01-31T04:50:20.870 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/overlayfs/ 2024-01-31T04:50:20.870 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 370697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/overlayfs/overlay.ko 2024-01-31T04:50:20.870 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/pstore/ 2024-01-31T04:50:20.871 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/pstore/ramoops.ko 2024-01-31T04:50:20.871 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx4/ 2024-01-31T04:50:20.871 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx4/qnx4.ko 2024-01-31T04:50:20.871 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx6/ 2024-01-31T04:50:20.871 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx6/qnx6.ko 2024-01-31T04:50:20.871 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/ 2024-01-31T04:50:20.871 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/quota_tree.ko 2024-01-31T04:50:20.871 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/quota_v1.ko 2024-01-31T04:50:20.871 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/quota_v2.ko 2024-01-31T04:50:20.871 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/reiserfs/ 2024-01-31T04:50:20.871 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 532025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/reiserfs/reiserfs.ko 2024-01-31T04:50:20.871 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/romfs/ 2024-01-31T04:50:20.871 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/romfs/romfs.ko 2024-01-31T04:50:20.871 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/ 2024-01-31T04:50:20.871 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/client/ 2024-01-31T04:50:20.872 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2683249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/client/cifs.ko 2024-01-31T04:50:20.872 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/common/ 2024-01-31T04:50:20.872 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/common/cifs_arc4.ko 2024-01-31T04:50:20.872 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/common/cifs_md4.ko 2024-01-31T04:50:20.872 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/squashfs/ 2024-01-31T04:50:20.872 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 134777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/squashfs/squashfs.ko 2024-01-31T04:50:20.872 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/sysv/ 2024-01-31T04:50:20.872 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 91249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/sysv/sysv.ko 2024-01-31T04:50:20.872 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/udf/ 2024-01-31T04:50:20.872 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 248425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/udf/udf.ko 2024-01-31T04:50:20.872 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ufs/ 2024-01-31T04:50:20.872 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 162537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ufs/ufs.ko 2024-01-31T04:50:20.872 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/xfs/ 2024-01-31T04:50:20.872 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 4014433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/xfs/xfs.ko 2024-01-31T04:50:20.873 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/ 2024-01-31T04:50:20.873 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/locking/ 2024-01-31T04:50:20.873 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/locking/locktorture.ko 2024-01-31T04:50:20.873 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/time/ 2024-01-31T04:50:20.873 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/time/test_udelay.ko 2024-01-31T04:50:20.873 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/torture.ko 2024-01-31T04:50:20.873 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ 2024-01-31T04:50:20.873 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 6833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crc-itu-t.ko 2024-01-31T04:50:20.873 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 6529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crc7.ko 2024-01-31T04:50:20.873 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crc8.ko 2024-01-31T04:50:20.873 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crypto/ 2024-01-31T04:50:20.873 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crypto/libarc4.ko 2024-01-31T04:50:20.873 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crypto/libdes.ko 2024-01-31T04:50:20.873 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/interval_tree_test.ko 2024-01-31T04:50:20.873 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/libcrc32c.ko 2024-01-31T04:50:20.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lru_cache.ko 2024-01-31T04:50:20.874 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lz4/ 2024-01-31T04:50:20.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lz4/lz4_compress.ko 2024-01-31T04:50:20.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lz4/lz4hc_compress.ko 2024-01-31T04:50:20.874 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/math/ 2024-01-31T04:50:20.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 6617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/math/cordic.ko 2024-01-31T04:50:20.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/memory-notifier-error-inject.ko 2024-01-31T04:50:20.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/notifier-error-inject.ko 2024-01-31T04:50:20.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/percpu_test.ko 2024-01-31T04:50:20.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/pm-notifier-error-inject.ko 2024-01-31T04:50:20.874 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/raid6/ 2024-01-31T04:50:20.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 143353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/raid6/raid6_pq.ko 2024-01-31T04:50:20.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/rbtree_test.ko 2024-01-31T04:50:20.874 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/reed_solomon/ 2024-01-31T04:50:20.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-31T04:50:20.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test-kstrtox.ko 2024-01-31T04:50:20.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test-string_helpers.ko 2024-01-31T04:50:20.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 4876633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_bpf.ko 2024-01-31T04:50:20.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_firmware.ko 2024-01-31T04:50:20.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 6369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_module.ko 2024-01-31T04:50:20.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_user_copy.ko 2024-01-31T04:50:20.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ts_bm.ko 2024-01-31T04:50:20.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ts_fsm.ko 2024-01-31T04:50:20.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ts_kmp.ko 2024-01-31T04:50:20.875 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/xz/ 2024-01-31T04:50:20.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/xz/xz_dec_test.ko 2024-01-31T04:50:20.875 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/mm/ 2024-01-31T04:50:20.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/mm/hwpoison-inject.ko 2024-01-31T04:50:20.875 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ 2024-01-31T04:50:20.875 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/ 2024-01-31T04:50:20.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/6lowpan.ko 2024-01-31T04:50:20.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_dest.ko 2024-01-31T04:50:20.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_fragment.ko 2024-01-31T04:50:20.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_hop.ko 2024-01-31T04:50:20.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 6985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-31T04:50:20.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_mobility.ko 2024-01-31T04:50:20.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_routing.ko 2024-01-31T04:50:20.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_udp.ko 2024-01-31T04:50:20.876 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/ 2024-01-31T04:50:20.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/garp.ko 2024-01-31T04:50:20.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/mrp.ko 2024-01-31T04:50:20.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/p8022.ko 2024-01-31T04:50:20.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/psnap.ko 2024-01-31T04:50:20.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/stp.ko 2024-01-31T04:50:20.877 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/8021q/ 2024-01-31T04:50:20.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 82593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/8021q/8021q.ko 2024-01-31T04:50:20.877 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/ 2024-01-31T04:50:20.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 198905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet.ko 2024-01-31T04:50:20.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet_fd.ko 2024-01-31T04:50:20.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet_rdma.ko 2024-01-31T04:50:20.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet_virtio.ko 2024-01-31T04:50:20.877 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/batman-adv/ 2024-01-31T04:50:20.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 649977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/batman-adv/batman-adv.ko 2024-01-31T04:50:20.877 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/ 2024-01-31T04:50:20.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 65137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/br_netfilter.ko 2024-01-31T04:50:20.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 785817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/bridge.ko 2024-01-31T04:50:20.877 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ 2024-01-31T04:50:20.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-31T04:50:20.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-31T04:50:20.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-31T04:50:20.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-31T04:50:20.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-31T04:50:20.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-31T04:50:20.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-31T04:50:20.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-31T04:50:20.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-31T04:50:20.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-31T04:50:20.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-31T04:50:20.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-31T04:50:20.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-31T04:50:20.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-31T04:50:20.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-31T04:50:20.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-31T04:50:20.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-31T04:50:20.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-31T04:50:20.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-31T04:50:20.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-31T04:50:20.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtables.ko 2024-01-31T04:50:20.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-31T04:50:20.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-31T04:50:20.879 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ceph/ 2024-01-31T04:50:20.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1046753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ceph/libceph.ko 2024-01-31T04:50:20.879 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/core/ 2024-01-31T04:50:20.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 126041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/core/pktgen.ko 2024-01-31T04:50:20.879 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/ 2024-01-31T04:50:20.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 194529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp.ko 2024-01-31T04:50:20.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp_diag.ko 2024-01-31T04:50:20.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp_ipv4.ko 2024-01-31T04:50:20.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp_ipv6.ko 2024-01-31T04:50:20.880 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/ 2024-01-31T04:50:20.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 390129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/dsa_core.ko 2024-01-31T04:50:20.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_brcm.ko 2024-01-31T04:50:20.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_dsa.ko 2024-01-31T04:50:20.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_none.ko 2024-01-31T04:50:20.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_trailer.ko 2024-01-31T04:50:20.880 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/hsr/ 2024-01-31T04:50:20.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 99881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/hsr/hsr.ko 2024-01-31T04:50:20.880 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/ 2024-01-31T04:50:20.880 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/6lowpan/ 2024-01-31T04:50:20.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-31T04:50:20.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 255849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/ieee802154.ko 2024-01-31T04:50:20.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-31T04:50:20.881 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ 2024-01-31T04:50:20.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ah4.ko 2024-01-31T04:50:20.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/esp4.ko 2024-01-31T04:50:20.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/fou.ko 2024-01-31T04:50:20.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/gre.ko 2024-01-31T04:50:20.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/inet_diag.ko 2024-01-31T04:50:20.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ip_gre.ko 2024-01-31T04:50:20.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ip_tunnel.ko 2024-01-31T04:50:20.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ip_vti.ko 2024-01-31T04:50:20.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ipcomp.ko 2024-01-31T04:50:20.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ipip.ko 2024-01-31T04:50:20.881 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ 2024-01-31T04:50:20.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-31T04:50:20.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-31T04:50:20.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-31T04:50:20.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ip_tables.ko 2024-01-31T04:50:20.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-31T04:50:20.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-01-31T04:50:20.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-31T04:50:20.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-31T04:50:20.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-31T04:50:20.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-01-31T04:50:20.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-31T04:50:20.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-31T04:50:20.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-31T04:50:20.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-31T04:50:20.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-31T04:50:20.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-31T04:50:20.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-31T04:50:20.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-31T04:50:20.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-31T04:50:20.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-01-31T04:50:20.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-31T04:50:20.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-31T04:50:20.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-31T04:50:20.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-31T04:50:20.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-31T04:50:20.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_bic.ko 2024-01-31T04:50:20.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_dctcp.ko 2024-01-31T04:50:20.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_diag.ko 2024-01-31T04:50:20.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_highspeed.ko 2024-01-31T04:50:20.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_htcp.ko 2024-01-31T04:50:20.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_hybla.ko 2024-01-31T04:50:20.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_illinois.ko 2024-01-31T04:50:20.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_lp.ko 2024-01-31T04:50:20.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_scalable.ko 2024-01-31T04:50:20.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_vegas.ko 2024-01-31T04:50:20.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_veno.ko 2024-01-31T04:50:20.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_westwood.ko 2024-01-31T04:50:20.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_yeah.ko 2024-01-31T04:50:20.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tunnel4.ko 2024-01-31T04:50:20.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/udp_diag.ko 2024-01-31T04:50:20.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/udp_tunnel.ko 2024-01-31T04:50:20.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-31T04:50:20.886 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ 2024-01-31T04:50:20.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ah6.ko 2024-01-31T04:50:20.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/esp6.ko 2024-01-31T04:50:20.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/fou6.ko 2024-01-31T04:50:20.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_gre.ko 2024-01-31T04:50:20.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 93977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_tunnel.ko 2024-01-31T04:50:20.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-31T04:50:20.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_vti.ko 2024-01-31T04:50:20.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ipcomp6.ko 2024-01-31T04:50:20.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/mip6.ko 2024-01-31T04:50:20.886 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ 2024-01-31T04:50:20.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-31T04:50:20.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-01-31T04:50:20.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-31T04:50:20.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-31T04:50:20.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-31T04:50:20.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-31T04:50:20.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-31T04:50:20.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-31T04:50:20.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-31T04:50:20.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-31T04:50:20.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-31T04:50:20.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-31T04:50:20.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-31T04:50:20.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-31T04:50:20.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-31T04:50:20.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-31T04:50:20.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-31T04:50:20.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-31T04:50:20.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-31T04:50:20.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-31T04:50:20.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-31T04:50:20.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-31T04:50:20.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-31T04:50:20.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-31T04:50:20.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-31T04:50:20.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 74921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/sit.ko 2024-01-31T04:50:20.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/tunnel6.ko 2024-01-31T04:50:20.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-31T04:50:20.888 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/key/ 2024-01-31T04:50:20.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 84433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/key/af_key.ko 2024-01-31T04:50:20.888 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/ 2024-01-31T04:50:20.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 125305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_core.ko 2024-01-31T04:50:20.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-31T04:50:20.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_eth.ko 2024-01-31T04:50:20.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_ip.ko 2024-01-31T04:50:20.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_ip6.ko 2024-01-31T04:50:20.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_netlink.ko 2024-01-31T04:50:20.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_ppp.ko 2024-01-31T04:50:20.889 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/lapb/ 2024-01-31T04:50:20.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/lapb/lapb.ko 2024-01-31T04:50:20.889 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/llc/ 2024-01-31T04:50:20.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/llc/llc.ko 2024-01-31T04:50:20.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 268265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/llc/llc2.ko 2024-01-31T04:50:20.889 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mac802154/ 2024-01-31T04:50:20.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 290441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mac802154/mac802154.ko 2024-01-31T04:50:20.889 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mpls/ 2024-01-31T04:50:20.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mpls/mpls_gso.ko 2024-01-31T04:50:20.889 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ 2024-01-31T04:50:20.889 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ 2024-01-31T04:50:20.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 118801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set.ko 2024-01-31T04:50:20.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-31T04:50:20.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-31T04:50:20.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-31T04:50:20.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 100297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-31T04:50:20.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 100633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-31T04:50:20.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-31T04:50:20.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-31T04:50:20.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 112017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-31T04:50:20.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-31T04:50:20.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-31T04:50:20.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 112297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-31T04:50:20.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 112649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-31T04:50:20.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 110753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-31T04:50:20.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 113633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-31T04:50:20.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-31T04:50:20.890 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ 2024-01-31T04:50:20.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 412561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-31T04:50:20.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-31T04:50:20.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-31T04:50:20.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-31T04:50:20.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-31T04:50:20.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-31T04:50:20.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-31T04:50:20.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-31T04:50:20.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-31T04:50:20.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-31T04:50:20.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-31T04:50:20.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-31T04:50:20.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-31T04:50:20.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-31T04:50:20.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conncount.ko 2024-01-31T04:50:20.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 411489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack.ko 2024-01-31T04:50:20.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-31T04:50:20.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-31T04:50:20.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-31T04:50:20.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 118193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-31T04:50:20.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-31T04:50:20.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-31T04:50:20.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-31T04:50:20.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-31T04:50:20.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-31T04:50:20.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-31T04:50:20.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-31T04:50:20.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-31T04:50:20.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-31T04:50:20.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 91737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_flow_table.ko 2024-01-31T04:50:20.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-31T04:50:20.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_log_syslog.ko 2024-01-31T04:50:20.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 96545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat.ko 2024-01-31T04:50:20.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-31T04:50:20.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-31T04:50:20.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_irc.ko 2024-01-31T04:50:20.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_sip.ko 2024-01-31T04:50:20.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-31T04:50:20.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-31T04:50:20.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 614025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_tables.ko 2024-01-31T04:50:20.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink.ko 2024-01-31T04:50:20.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-31T04:50:20.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-01-31T04:50:20.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_log.ko 2024-01-31T04:50:20.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-31T04:50:20.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-31T04:50:20.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_chain_nat.ko 2024-01-31T04:50:20.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_compat.ko 2024-01-31T04:50:20.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_ct.ko 2024-01-31T04:50:20.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-31T04:50:20.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_fib.ko 2024-01-31T04:50:20.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-31T04:50:20.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_hash.ko 2024-01-31T04:50:20.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_limit.ko 2024-01-31T04:50:20.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_log.ko 2024-01-31T04:50:20.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_masq.ko 2024-01-31T04:50:20.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_nat.ko 2024-01-31T04:50:20.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_numgen.ko 2024-01-31T04:50:20.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_osf.ko 2024-01-31T04:50:20.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_queue.ko 2024-01-31T04:50:20.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_redir.ko 2024-01-31T04:50:20.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_reject.ko 2024-01-31T04:50:20.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_reject_inet.ko 2024-01-31T04:50:20.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_socket.ko 2024-01-31T04:50:20.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_synproxy.ko 2024-01-31T04:50:20.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_tproxy.ko 2024-01-31T04:50:20.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/x_tables.ko 2024-01-31T04:50:20.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_AUDIT.ko 2024-01-31T04:50:20.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-31T04:50:20.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-31T04:50:20.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-31T04:50:20.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CT.ko 2024-01-31T04:50:20.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_DSCP.ko 2024-01-31T04:50:20.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_HL.ko 2024-01-31T04:50:20.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_HMARK.ko 2024-01-31T04:50:20.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-31T04:50:20.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_LED.ko 2024-01-31T04:50:20.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_LOG.ko 2024-01-31T04:50:20.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-31T04:50:20.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_NETMAP.ko 2024-01-31T04:50:20.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_NFLOG.ko 2024-01-31T04:50:20.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-31T04:50:20.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_RATEEST.ko 2024-01-31T04:50:20.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-31T04:50:20.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_SECMARK.ko 2024-01-31T04:50:20.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-31T04:50:20.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-31T04:50:20.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TEE.ko 2024-01-31T04:50:20.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TPROXY.ko 2024-01-31T04:50:20.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TRACE.ko 2024-01-31T04:50:20.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_addrtype.ko 2024-01-31T04:50:20.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_bpf.ko 2024-01-31T04:50:20.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_cgroup.ko 2024-01-31T04:50:20.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_cluster.ko 2024-01-31T04:50:20.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_comment.ko 2024-01-31T04:50:20.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connbytes.ko 2024-01-31T04:50:20.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connlabel.ko 2024-01-31T04:50:20.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connlimit.ko 2024-01-31T04:50:20.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connmark.ko 2024-01-31T04:50:20.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_conntrack.ko 2024-01-31T04:50:20.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_cpu.ko 2024-01-31T04:50:20.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_dccp.ko 2024-01-31T04:50:20.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_devgroup.ko 2024-01-31T04:50:20.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_dscp.ko 2024-01-31T04:50:20.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_ecn.ko 2024-01-31T04:50:20.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_esp.ko 2024-01-31T04:50:20.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_hashlimit.ko 2024-01-31T04:50:20.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_helper.ko 2024-01-31T04:50:20.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_hl.ko 2024-01-31T04:50:20.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_ipcomp.ko 2024-01-31T04:50:20.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_iprange.ko 2024-01-31T04:50:20.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_ipvs.ko 2024-01-31T04:50:20.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_l2tp.ko 2024-01-31T04:50:20.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_length.ko 2024-01-31T04:50:20.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_limit.ko 2024-01-31T04:50:20.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_mac.ko 2024-01-31T04:50:20.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_mark.ko 2024-01-31T04:50:20.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_multiport.ko 2024-01-31T04:50:20.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_nat.ko 2024-01-31T04:50:20.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_nfacct.ko 2024-01-31T04:50:20.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_osf.ko 2024-01-31T04:50:20.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_owner.ko 2024-01-31T04:50:20.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_physdev.ko 2024-01-31T04:50:20.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_pkttype.ko 2024-01-31T04:50:20.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_policy.ko 2024-01-31T04:50:20.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_quota.ko 2024-01-31T04:50:20.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_rateest.ko 2024-01-31T04:50:20.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_realm.ko 2024-01-31T04:50:20.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_recent.ko 2024-01-31T04:50:20.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_sctp.ko 2024-01-31T04:50:20.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_set.ko 2024-01-31T04:50:20.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_socket.ko 2024-01-31T04:50:20.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_state.ko 2024-01-31T04:50:20.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_statistic.ko 2024-01-31T04:50:20.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_string.ko 2024-01-31T04:50:20.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_tcpmss.ko 2024-01-31T04:50:20.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_tcpudp.ko 2024-01-31T04:50:20.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_time.ko 2024-01-31T04:50:20.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_u32.ko 2024-01-31T04:50:20.901 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netlink/ 2024-01-31T04:50:20.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netlink/netlink_diag.ko 2024-01-31T04:50:20.901 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/nsh/ 2024-01-31T04:50:20.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/nsh/nsh.ko 2024-01-31T04:50:20.901 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/ 2024-01-31T04:50:20.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 383481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/openvswitch.ko 2024-01-31T04:50:20.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/vport-geneve.ko 2024-01-31T04:50:20.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/vport-gre.ko 2024-01-31T04:50:20.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/vport-vxlan.ko 2024-01-31T04:50:20.902 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/packet/ 2024-01-31T04:50:20.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/packet/af_packet_diag.ko 2024-01-31T04:50:20.902 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/phonet/ 2024-01-31T04:50:20.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 112057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/phonet/phonet.ko 2024-01-31T04:50:20.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/phonet/pn_pep.ko 2024-01-31T04:50:20.902 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/ 2024-01-31T04:50:20.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 252953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/rds.ko 2024-01-31T04:50:20.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 164937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/rds_rdma.ko 2024-01-31T04:50:20.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 68161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/rds_tcp.ko 2024-01-31T04:50:20.902 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rxrpc/ 2024-01-31T04:50:20.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 818777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rxrpc/rxrpc.ko 2024-01-31T04:50:20.902 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/ 2024-01-31T04:50:20.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_csum.ko 2024-01-31T04:50:20.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_gact.ko 2024-01-31T04:50:20.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_ipt.ko 2024-01-31T04:50:20.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_mirred.ko 2024-01-31T04:50:20.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_nat.ko 2024-01-31T04:50:20.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_pedit.ko 2024-01-31T04:50:20.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_police.ko 2024-01-31T04:50:20.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_simple.ko 2024-01-31T04:50:20.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_skbedit.ko 2024-01-31T04:50:20.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_vlan.ko 2024-01-31T04:50:20.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_basic.ko 2024-01-31T04:50:20.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_bpf.ko 2024-01-31T04:50:20.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_cgroup.ko 2024-01-31T04:50:20.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_flow.ko 2024-01-31T04:50:20.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_fw.ko 2024-01-31T04:50:20.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_route.ko 2024-01-31T04:50:20.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_u32.ko 2024-01-31T04:50:20.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_cmp.ko 2024-01-31T04:50:20.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_ipset.ko 2024-01-31T04:50:20.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_meta.ko 2024-01-31T04:50:20.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_nbyte.ko 2024-01-31T04:50:20.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_text.ko 2024-01-31T04:50:20.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_u32.ko 2024-01-31T04:50:20.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_choke.ko 2024-01-31T04:50:20.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_codel.ko 2024-01-31T04:50:20.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_drr.ko 2024-01-31T04:50:20.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_fq.ko 2024-01-31T04:50:20.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_fq_codel.ko 2024-01-31T04:50:20.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_gred.ko 2024-01-31T04:50:20.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_hfsc.ko 2024-01-31T04:50:20.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_hhf.ko 2024-01-31T04:50:20.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_htb.ko 2024-01-31T04:50:20.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_ingress.ko 2024-01-31T04:50:20.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_mqprio.ko 2024-01-31T04:50:20.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_mqprio_lib.ko 2024-01-31T04:50:20.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_multiq.ko 2024-01-31T04:50:20.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_netem.ko 2024-01-31T04:50:20.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_pie.ko 2024-01-31T04:50:20.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_plug.ko 2024-01-31T04:50:20.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_prio.ko 2024-01-31T04:50:20.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_qfq.ko 2024-01-31T04:50:20.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_red.ko 2024-01-31T04:50:20.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_sfb.ko 2024-01-31T04:50:20.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_sfq.ko 2024-01-31T04:50:20.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_tbf.ko 2024-01-31T04:50:20.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_teql.ko 2024-01-31T04:50:20.906 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sctp/ 2024-01-31T04:50:20.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 932169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sctp/sctp.ko 2024-01-31T04:50:20.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sctp/sctp_diag.ko 2024-01-31T04:50:20.906 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/ 2024-01-31T04:50:20.906 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/auth_gss/ 2024-01-31T04:50:20.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 336777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-31T04:50:20.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-31T04:50:20.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1518417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/sunrpc.ko 2024-01-31T04:50:20.906 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/xprtrdma/ 2024-01-31T04:50:20.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 708281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-31T04:50:20.907 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/tipc/ 2024-01-31T04:50:20.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/tipc/diag.ko 2024-01-31T04:50:20.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 866345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/tipc/tipc.ko 2024-01-31T04:50:20.907 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/unix/ 2024-01-31T04:50:20.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/unix/unix_diag.ko 2024-01-31T04:50:20.907 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/ 2024-01-31T04:50:20.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 86417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-31T04:50:20.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 68049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-31T04:50:20.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 98017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vsock.ko 2024-01-31T04:50:20.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-31T04:50:20.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-31T04:50:20.908 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/x25/ 2024-01-31T04:50:20.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 125409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/x25/x25.ko 2024-01-31T04:50:20.908 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/ 2024-01-31T04:50:20.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/xfrm_algo.ko 2024-01-31T04:50:20.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-31T04:50:20.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 104161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/xfrm_user.ko 2024-01-31T04:50:20.908 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/virt/ 2024-01-31T04:50:20.908 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/virt/lib/ 2024-01-31T04:50:20.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/virt/lib/irqbypass.ko 2024-01-31T04:50:20.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 641009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.alias 2024-01-31T04:50:20.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 625033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.alias.bin 2024-01-31T04:50:20.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7677 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin 2024-01-31T04:50:20.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23634 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin.alias.bin 2024-01-31T04:50:20.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9916 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin.bin 2024-01-31T04:50:20.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70653 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin.modinfo 2024-01-31T04:50:20.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 147734 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.dep 2024-01-31T04:50:20.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 234045 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.dep.bin 2024-01-31T04:50:20.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 210 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.devname 2024-01-31T04:50:20.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72797 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.order 2024-01-31T04:50:20.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 879 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.softdep 2024-01-31T04:50:20.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 255175 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.symbols 2024-01-31T04:50:20.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 309826 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.symbols.bin 2024-01-31T04:50:20.909 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/ 2024-01-31T04:50:20.909 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/share/ 2024-01-31T04:50:20.909 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/share/doc/ 2024-01-31T04:50:20.909 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/share/doc/linux-image-6.7.0-gcd42140e6285/ 2024-01-31T04:50:20.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 171 2024-01-25 04:04 ./usr/share/doc/linux-image-6.7.0-gcd42140e6285/changelog.Debian.gz 2024-01-31T04:50:20.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 691 2024-01-25 04:04 ./usr/share/doc/linux-image-6.7.0-gcd42140e6285/copyright 2024-01-31T04:50:20.910 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-gcd42140e6285 2024-01-31T04:50:20.910 INFO:teuthology.task.kernel:searching for kernel 6.7.0-gcd42140e6285 2024-01-31T04:50:20.911 DEBUG:teuthology.orchestra.run.smithi195:> egrep '(submenu|menuentry.*6.7.0-gcd42140e6285).*{' /boot/grub/grub.cfg 2024-01-31T04:50:20.918 INFO:teuthology.orchestra.run.smithi195.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-31T04:50:20.918 INFO:teuthology.orchestra.run.smithi195.stdout: menuentry 'Ubuntu, with Linux 6.7.0-gcd42140e6285' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-gcd42140e6285-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-31T04:50:20.918 INFO:teuthology.orchestra.run.smithi195.stdout: menuentry 'Ubuntu, with Linux 6.7.0-gcd42140e6285 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-gcd42140e6285-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-31T04:50:20.918 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-01-31T04:50:20.919 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.7.0-gcd42140e6285 2024-01-31T04:50:20.919 DEBUG:teuthology.orchestra.run.smithi195:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-01-31T04:50:20.964 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi195.front.sepia.ceph.com to complete... 2024-01-31T04:50:21.361 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub' 2024-01-31T04:50:21.362 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-31T04:50:21.379 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2024-01-31T04:50:21.572 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-6.7.0-gcd42140e6285 2024-01-31T04:50:21.579 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-6.7.0-gcd42140e6285 2024-01-31T04:50:21.824 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-31T04:50:21.829 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-31T04:50:21.869 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-31T04:50:21.874 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-31T04:50:21.991 INFO:teuthology.orchestra.run.smithi195.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-31T04:50:21.991 INFO:teuthology.orchestra.run.smithi195.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-31T04:50:21.991 INFO:teuthology.orchestra.run.smithi195.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-31T04:50:22.012 INFO:teuthology.orchestra.run.smithi195.stderr:done 2024-01-31T04:50:51.221 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-01-31T04:50:51.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-31T04:50:51.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:50:53.182 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-01-31T04:50:53.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-01-31T04:50:53.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:51:09.760 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-31T04:51:11.548 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-01-31T04:51:18.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-31T04:51:18.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:51:20.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-01-31T04:51:20.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:51:21.827 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-31T04:51:33.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-31T04:51:33.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:51:36.896 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-31T04:51:51.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-31T04:51:51.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:51:54.972 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-31T04:52:12.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-31T04:52:12.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:52:20.560 DEBUG:teuthology.orchestra.remote:timed out 2024-01-31T04:52:32.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-01-31T04:52:32.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:52:32.793 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-01-31T04:52:33.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-01-31T04:52:33.518 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.7.0-gcd42140e6285"... 2024-01-31T04:52:33.518 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-01-31T04:52:33.568 INFO:teuthology.orchestra.run.smithi195.stdout:6.7.0-gcd42140e6285 2024-01-31T04:52:33.568 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-gcd42140e6285 vs 6.7.0-gcd42140e6285 2024-01-31T04:52:33.569 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-31T04:52:33.569 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-31T04:52:34.569 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-01-31T04:52:34.570 DEBUG:teuthology.orchestra.run.smithi195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-31T04:52:34.904 INFO:teuthology.orchestra.run.smithi195.stdout:ttyS1 2024-01-31T04:52:34.948 DEBUG:teuthology.parallel:result is None 2024-01-31T04:52:44.925 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-01-31T04:52:45.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-31T04:52:45.834 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.7.0-gcd42140e6285"... 2024-01-31T04:52:45.834 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-01-31T04:52:45.883 INFO:teuthology.orchestra.run.smithi049.stdout:6.7.0-gcd42140e6285 2024-01-31T04:52:45.883 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-gcd42140e6285 vs 6.7.0-gcd42140e6285 2024-01-31T04:52:45.883 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-31T04:52:45.883 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-31T04:52:46.884 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-01-31T04:52:46.884 DEBUG:teuthology.orchestra.run.smithi049:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-31T04:52:46.956 INFO:teuthology.orchestra.run.smithi049.stdout:ttyS1 2024-01-31T04:52:47.031 DEBUG:teuthology.parallel:result is None 2024-01-31T04:52:47.031 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-31T04:52:47.043 INFO:teuthology.task.internal:Creating test directory... 2024-01-31T04:52:47.043 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-31T04:52:47.046 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-31T04:52:47.055 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-31T04:52:47.062 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-31T04:52:47.071 INFO:teuthology.task.internal:Creating archive directory... 2024-01-31T04:52:47.071 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-31T04:52:47.102 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-31T04:52:47.239 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-31T04:52:47.246 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-31T04:52:47.246 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-31T04:52:47.250 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-31T04:52:47.275 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-31T04:52:47.287 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-31T04:52:47.288 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-31T04:52:47.301 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-31T04:52:47.304 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-31T04:52:47.311 INFO:teuthology.task.internal:Configuring sudo... 2024-01-31T04:52:47.311 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-31T04:52:47.335 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-31T04:52:47.365 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-31T04:52:47.376 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-31T04:52:47.377 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-31T04:52:47.403 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-31T04:52:47.419 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-31T04:52:47.460 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-31T04:52:47.513 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T04:52:47.513 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-31T04:52:47.589 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-31T04:52:47.598 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-31T04:52:47.649 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T04:52:47.650 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-31T04:52:47.733 DEBUG:teuthology.orchestra.run.smithi049:> sudo service rsyslog restart 2024-01-31T04:52:47.736 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2024-01-31T04:52:47.866 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-31T04:52:47.875 INFO:teuthology.task.internal:Starting timer... 2024-01-31T04:52:47.875 INFO:teuthology.run_tasks:Running task pcp... 2024-01-31T04:52:48.202 INFO:teuthology.run_tasks:Running task selinux... 2024-01-31T04:52:48.210 DEBUG:teuthology.task.selinux:Excluding smithi049: OS 'ubuntu' does not support SELinux 2024-01-31T04:52:48.210 DEBUG:teuthology.task.selinux:Excluding smithi195: OS 'ubuntu' does not support SELinux 2024-01-31T04:52:48.211 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-31T04:52:48.211 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-01-31T04:52:48.211 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-31T04:52:48.211 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-31T04:52:48.220 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-31T04:52:48.239 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-31T04:52:48.240 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi049.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-31T05:00:25.033 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi049.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2024-01-31T05:00:25.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-31T05:00:25.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T05:00:25.123 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-01-31T05:00:25.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-31T05:00:25.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-01-31T05:00:25.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T05:00:25.358 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-01-31T05:00:25.468 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-01-31T05:00:25.469 INFO:teuthology.run_tasks:Running task clock... 2024-01-31T05:00:25.483 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-31T05:00:25.484 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-31T05:00:25.485 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-31T05:00:25.490 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-31T05:00:25.490 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-31T05:00:25.530 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-31T05:00:25.530 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: Command line: ntpd -gq 2024-01-31T05:00:25.531 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: ---------------------------------------------------- 2024-01-31T05:00:25.531 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: ntp-4 is maintained by Network Time Foundation, 2024-01-31T05:00:25.531 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-31T05:00:25.531 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: corporation. Support and training for ntp-4 are 2024-01-31T05:00:25.531 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: available at https://www.nwtime.org/support 2024-01-31T05:00:25.531 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: ---------------------------------------------------- 2024-01-31T05:00:25.532 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: proto: precision = 0.045 usec (-24) 2024-01-31T05:00:25.532 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: basedate set to 2022-02-04 2024-01-31T05:00:25.532 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: gps base set to 2022-02-06 (week 2196) 2024-01-31T05:00:25.532 INFO:teuthology.orchestra.run.smithi049.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-31T05:00:25.533 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-31T05:00:25.533 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: restrict ::: KOD does nothing without LIMITED. 2024-01-31T05:00:25.533 INFO:teuthology.orchestra.run.smithi049.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-31T05:00:25.534 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: Listen and drop on 0 v6wildcard [::]:123 2024-01-31T05:00:25.534 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-31T05:00:25.534 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: Listen normally on 2 lo 127.0.0.1:123 2024-01-31T05:00:25.534 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: Listen normally on 3 ens1f0 172.21.15.49:123 2024-01-31T05:00:25.535 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: Listen normally on 4 lo [::1]:123 2024-01-31T05:00:25.535 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1566%4]:123 2024-01-31T05:00:25.535 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:25 ntpd[16782]: Listening on routing socket on fd #22 for interface updates 2024-01-31T05:00:25.557 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-31T05:00:25.557 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: Command line: ntpd -gq 2024-01-31T05:00:25.557 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: ---------------------------------------------------- 2024-01-31T05:00:25.557 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: ntp-4 is maintained by Network Time Foundation, 2024-01-31T05:00:25.557 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-31T05:00:25.557 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: corporation. Support and training for ntp-4 are 2024-01-31T05:00:25.558 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: available at https://www.nwtime.org/support 2024-01-31T05:00:25.558 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: ---------------------------------------------------- 2024-01-31T05:00:25.558 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: proto: precision = 0.042 usec (-24) 2024-01-31T05:00:25.558 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: basedate set to 2022-02-04 2024-01-31T05:00:25.558 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: gps base set to 2022-02-06 (week 2196) 2024-01-31T05:00:25.559 INFO:teuthology.orchestra.run.smithi195.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-31T05:00:25.559 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-31T05:00:25.560 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: restrict ::: KOD does nothing without LIMITED. 2024-01-31T05:00:25.560 INFO:teuthology.orchestra.run.smithi195.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-31T05:00:25.561 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: Listen and drop on 0 v6wildcard [::]:123 2024-01-31T05:00:25.561 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-31T05:00:25.561 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: Listen normally on 2 lo 127.0.0.1:123 2024-01-31T05:00:25.561 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: Listen normally on 3 enp3s0f1 172.21.15.195:123 2024-01-31T05:00:25.561 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: Listen normally on 4 lo [::1]:123 2024-01-31T05:00:25.561 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8081%5]:123 2024-01-31T05:00:25.561 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:25 ntpd[16903]: Listening on routing socket on fd #22 for interface updates 2024-01-31T05:00:26.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:26 ntpd[16782]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:26.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:26 ntpd[16782]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:26.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:26 ntpd[16782]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:26.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:26 ntpd[16782]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:26.532 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:26 ntpd[16782]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:26.532 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:26 ntpd[16782]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:26.532 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:26 ntpd[16782]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-31T05:00:26.532 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:26 ntpd[16782]: can't open /var/log/ntpstats/peerstats.20240131: Permission denied 2024-01-31T05:00:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:27 ntpd[16782]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:27 ntpd[16782]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:27 ntpd[16782]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:27 ntpd[16782]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:27 ntpd[16782]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-31T05:00:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:27 ntpd[16782]: can't open /var/log/ntpstats/peerstats.20240131: Permission denied 2024-01-31T05:00:28.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:28 ntpd[16782]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:28.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:28 ntpd[16782]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:28.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:28 ntpd[16782]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:28.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:28 ntpd[16782]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:28.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:28 ntpd[16782]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-31T05:00:28.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:28 ntpd[16782]: can't open /var/log/ntpstats/peerstats.20240131: Permission denied 2024-01-31T05:00:29.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:29 ntpd[16782]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:29.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:29 ntpd[16782]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:29.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:29 ntpd[16782]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:29.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:29 ntpd[16782]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:29.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:29 ntpd[16782]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-31T05:00:29.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:29 ntpd[16782]: can't open /var/log/ntpstats/peerstats.20240131: Permission denied 2024-01-31T05:00:29.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:29 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:29.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:29 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:29.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:29 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:29.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:29 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:29.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:29 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:29.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:29 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:29.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:29 ntpd[16903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-31T05:00:29.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:29 ntpd[16903]: can't open /var/log/ntpstats/peerstats.20240131: Permission denied 2024-01-31T05:00:29.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:29 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:29.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:29 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:29.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:29 ntpd[16903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-31T05:00:29.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:29 ntpd[16903]: can't open /var/log/ntpstats/peerstats.20240131: Permission denied 2024-01-31T05:00:30.534 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:30 ntpd[16782]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:30.534 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:30 ntpd[16782]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:30.534 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:30 ntpd[16782]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:30.535 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:30 ntpd[16782]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:30.535 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:30 ntpd[16782]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:30.535 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:30 ntpd[16782]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:30.535 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:30 ntpd[16782]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-31T05:00:30.535 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:30 ntpd[16782]: can't open /var/log/ntpstats/peerstats.20240131: Permission denied 2024-01-31T05:00:30.535 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:30 ntpd[16782]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:30.535 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:30 ntpd[16782]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:30.535 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:30 ntpd[16782]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-31T05:00:30.536 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:30 ntpd[16782]: can't open /var/log/ntpstats/peerstats.20240131: Permission denied 2024-01-31T05:00:30.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:30 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:30.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:30 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:30.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:30 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:30.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:30 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:30.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:30 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:30.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:30 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:30.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:30 ntpd[16903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-31T05:00:30.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:30 ntpd[16903]: can't open /var/log/ntpstats/peerstats.20240131: Permission denied 2024-01-31T05:00:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:31 ntpd[16782]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:31 ntpd[16782]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:31 ntpd[16782]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:31 ntpd[16782]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:31 ntpd[16782]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-31T05:00:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:31 ntpd[16782]: can't open /var/log/ntpstats/peerstats.20240131: Permission denied 2024-01-31T05:00:31.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:31 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:31.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:31 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:31.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:31 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:31.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:31 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:31.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:31 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:31.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:31 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:31.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:31 ntpd[16903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-31T05:00:31.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:31 ntpd[16903]: can't open /var/log/ntpstats/peerstats.20240131: Permission denied 2024-01-31T05:00:31.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:31 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:31.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:31 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:31.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:31 ntpd[16903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-31T05:00:31.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:31 ntpd[16903]: can't open /var/log/ntpstats/peerstats.20240131: Permission denied 2024-01-31T05:00:32.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:32 ntpd[16782]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:32.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:32 ntpd[16782]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:32.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:32 ntpd[16782]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:32.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:32 ntpd[16782]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:32.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:32 ntpd[16782]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:32.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:32 ntpd[16782]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:32.531 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:32 ntpd[16782]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-31T05:00:32.532 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:32 ntpd[16782]: can't open /var/log/ntpstats/peerstats.20240131: Permission denied 2024-01-31T05:00:32.532 INFO:teuthology.orchestra.run.smithi049.stdout:31 Jan 05:00:32 ntpd[16782]: ntpd: time slew -0.001611 s 2024-01-31T05:00:32.532 INFO:teuthology.orchestra.run.smithi049.stdout:ntpd: time slew -0.001611s 2024-01-31T05:00:32.532 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:32 ntpd[16782]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-31T05:00:32.532 INFO:teuthology.orchestra.run.smithi049.stderr:31 Jan 05:00:32 ntpd[16782]: can't open /var/log/ntpstats/loopstats.20240131: Permission denied 2024-01-31T05:00:32.557 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:32 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:32.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:32 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:32.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:32 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:32.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:32 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:32.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:32 ntpd[16903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-31T05:00:32.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:32 ntpd[16903]: can't open /var/log/ntpstats/peerstats.20240131: Permission denied 2024-01-31T05:00:32.634 INFO:teuthology.orchestra.run.smithi049.stdout: remote refid st t when poll reach delay offset jitter 2024-01-31T05:00:32.634 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================== 2024-01-31T05:00:32.634 INFO:teuthology.orchestra.run.smithi049.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-31T05:00:32.634 INFO:teuthology.orchestra.run.smithi049.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-31T05:00:32.634 INFO:teuthology.orchestra.run.smithi049.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-31T05:00:32.634 INFO:teuthology.orchestra.run.smithi049.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-31T05:00:33.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:33 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:33.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:33 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:33.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:33 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:33.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:33 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:33.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:33 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:33.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:33 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:33.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:33 ntpd[16903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-31T05:00:33.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:33 ntpd[16903]: can't open /var/log/ntpstats/peerstats.20240131: Permission denied 2024-01-31T05:00:33.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:33 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:33.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:33 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:33.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:33 ntpd[16903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-31T05:00:33.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:33 ntpd[16903]: can't open /var/log/ntpstats/peerstats.20240131: Permission denied 2024-01-31T05:00:34.557 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:34 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:34.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:34 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:34.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:34 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:34.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:34 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:34.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:34 ntpd[16903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-31T05:00:34.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:34 ntpd[16903]: can't open /var/log/ntpstats/peerstats.20240131: Permission denied 2024-01-31T05:00:35.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:35 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:35.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:35 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:35.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:35 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:35.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:35 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:35.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:35 ntpd[16903]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-31T05:00:35.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:35 ntpd[16903]: can't open /var/log/ntpstats/rawstats.20240131: Permission denied 2024-01-31T05:00:35.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:35 ntpd[16903]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-31T05:00:35.558 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:35 ntpd[16903]: can't open /var/log/ntpstats/peerstats.20240131: Permission denied 2024-01-31T05:00:35.559 INFO:teuthology.orchestra.run.smithi195.stdout:31 Jan 05:00:35 ntpd[16903]: ntpd: time slew +0.000177 s 2024-01-31T05:00:35.559 INFO:teuthology.orchestra.run.smithi195.stdout:ntpd: time slew +0.000177s 2024-01-31T05:00:35.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:35 ntpd[16903]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-31T05:00:35.559 INFO:teuthology.orchestra.run.smithi195.stderr:31 Jan 05:00:35 ntpd[16903]: can't open /var/log/ntpstats/loopstats.20240131: Permission denied 2024-01-31T05:00:35.661 INFO:teuthology.orchestra.run.smithi195.stdout: remote refid st t when poll reach delay offset jitter 2024-01-31T05:00:35.662 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================== 2024-01-31T05:00:35.662 INFO:teuthology.orchestra.run.smithi195.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-31T05:00:35.662 INFO:teuthology.orchestra.run.smithi195.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-31T05:00:35.662 INFO:teuthology.orchestra.run.smithi195.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-31T05:00:35.662 INFO:teuthology.orchestra.run.smithi195.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-31T05:00:35.663 INFO:teuthology.run_tasks:Running task install... 2024-01-31T05:00:35.672 DEBUG:teuthology.task.install:project ceph 2024-01-31T05:00:35.672 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '661946e7044723130c03627323f6a879a9848cb5'}} 2024-01-31T05:00:35.672 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '661946e7044723130c03627323f6a879a9848cb5'} 2024-01-31T05:00:35.673 INFO:teuthology.task.install:Using flavor: default 2024-01-31T05:00:35.678 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-31T05:00:35.678 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-01-31T05:00:35.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-key list | grep Ceph 2024-01-31T05:00:35.679 DEBUG:teuthology.orchestra.run.smithi195:> sudo apt-key list | grep Ceph 2024-01-31T05:00:35.787 INFO:teuthology.orchestra.run.smithi049.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-31T05:00:35.808 INFO:teuthology.orchestra.run.smithi195.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-31T05:00:35.840 INFO:teuthology.orchestra.run.smithi049.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-31T05:00:35.840 INFO:teuthology.orchestra.run.smithi049.stdout:uid [ unknown] Ceph.com (release key) 2024-01-31T05:00:35.841 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-31T05:00:35.841 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-31T05:00:35.842 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-31T05:00:35.859 INFO:teuthology.orchestra.run.smithi195.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-31T05:00:35.859 INFO:teuthology.orchestra.run.smithi195.stdout:uid [ unknown] Ceph.com (release key) 2024-01-31T05:00:35.860 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-31T05:00:35.860 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-31T05:00:35.860 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-31T05:00:35.988 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default/ 2024-01-31T05:00:35.988 INFO:teuthology.task.install.deb:Package version is 19.0.0-885-g661946e7-1jammy 2024-01-31T05:00:36.084 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default/ 2024-01-31T05:00:36.084 INFO:teuthology.task.install.deb:Package version is 19.0.0-885-g661946e7-1jammy 2024-01-31T05:00:36.103 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:00:36.104 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-31T05:00:36.137 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-get update 2024-01-31T05:00:36.257 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:00:36.257 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-31T05:00:36.277 DEBUG:teuthology.orchestra.run.smithi195:> sudo apt-get update 2024-01-31T05:00:36.330 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-31T05:00:36.339 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-31T05:00:36.359 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-31T05:00:36.375 INFO:teuthology.orchestra.run.smithi049.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy InRelease 2024-01-31T05:00:36.396 INFO:teuthology.orchestra.run.smithi049.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-31T05:00:36.418 INFO:teuthology.orchestra.run.smithi049.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-31T05:00:36.439 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,403 B] 2024-01-31T05:00:36.450 INFO:teuthology.orchestra.run.smithi049.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-31T05:00:36.470 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-31T05:00:36.471 INFO:teuthology.orchestra.run.smithi049.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-01-31T05:00:36.577 INFO:teuthology.orchestra.run.smithi195.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy InRelease 2024-01-31T05:00:36.579 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-31T05:00:36.613 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-31T05:00:36.651 INFO:teuthology.orchestra.run.smithi195.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-31T05:00:36.660 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-31T05:00:36.694 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-01-31T05:00:36.742 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-31T05:00:36.778 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,403 B] 2024-01-31T05:00:36.937 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 28.8 kB in 1s (50.5 kB/s) 2024-01-31T05:00:37.057 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 28.8 kB in 1s (51.8 kB/s) 2024-01-31T05:00:37.898 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2024-01-31T05:00:37.912 DEBUG:teuthology.orchestra.run.smithi049:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-885-g661946e7-1jammy cephadm=19.0.0-885-g661946e7-1jammy ceph-mds=19.0.0-885-g661946e7-1jammy ceph-mgr=19.0.0-885-g661946e7-1jammy ceph-common=19.0.0-885-g661946e7-1jammy ceph-fuse=19.0.0-885-g661946e7-1jammy ceph-test=19.0.0-885-g661946e7-1jammy ceph-volume=19.0.0-885-g661946e7-1jammy radosgw=19.0.0-885-g661946e7-1jammy python3-rados=19.0.0-885-g661946e7-1jammy python3-rgw=19.0.0-885-g661946e7-1jammy python3-cephfs=19.0.0-885-g661946e7-1jammy python3-rbd=19.0.0-885-g661946e7-1jammy libcephfs2=19.0.0-885-g661946e7-1jammy libcephfs-dev=19.0.0-885-g661946e7-1jammy librados2=19.0.0-885-g661946e7-1jammy librbd1=19.0.0-885-g661946e7-1jammy rbd-fuse=19.0.0-885-g661946e7-1jammy python3-cephfs=19.0.0-885-g661946e7-1jammy cephfs-shell=19.0.0-885-g661946e7-1jammy cephfs-top=19.0.0-885-g661946e7-1jammy cephfs-mirror=19.0.0-885-g661946e7-1jammy 2024-01-31T05:00:37.988 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2024-01-31T05:00:37.988 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-01-31T05:00:38.003 DEBUG:teuthology.orchestra.run.smithi195:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-885-g661946e7-1jammy cephadm=19.0.0-885-g661946e7-1jammy ceph-mds=19.0.0-885-g661946e7-1jammy ceph-mgr=19.0.0-885-g661946e7-1jammy ceph-common=19.0.0-885-g661946e7-1jammy ceph-fuse=19.0.0-885-g661946e7-1jammy ceph-test=19.0.0-885-g661946e7-1jammy ceph-volume=19.0.0-885-g661946e7-1jammy radosgw=19.0.0-885-g661946e7-1jammy python3-rados=19.0.0-885-g661946e7-1jammy python3-rgw=19.0.0-885-g661946e7-1jammy python3-cephfs=19.0.0-885-g661946e7-1jammy python3-rbd=19.0.0-885-g661946e7-1jammy libcephfs2=19.0.0-885-g661946e7-1jammy libcephfs-dev=19.0.0-885-g661946e7-1jammy librados2=19.0.0-885-g661946e7-1jammy librbd1=19.0.0-885-g661946e7-1jammy rbd-fuse=19.0.0-885-g661946e7-1jammy python3-cephfs=19.0.0-885-g661946e7-1jammy cephfs-shell=19.0.0-885-g661946e7-1jammy cephfs-top=19.0.0-885-g661946e7-1jammy cephfs-mirror=19.0.0-885-g661946e7-1jammy 2024-01-31T05:00:38.076 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-01-31T05:00:38.156 INFO:teuthology.orchestra.run.smithi049.stdout:Building dependency tree... 2024-01-31T05:00:38.157 INFO:teuthology.orchestra.run.smithi049.stdout:Reading state information... 2024-01-31T05:00:38.242 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2024-01-31T05:00:38.242 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2024-01-31T05:00:38.318 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages were automatically installed and are no longer required: 2024-01-31T05:00:38.318 INFO:teuthology.orchestra.run.smithi049.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-31T05:00:38.318 INFO:teuthology.orchestra.run.smithi049.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-31T05:00:38.318 INFO:teuthology.orchestra.run.smithi049.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-31T05:00:38.318 INFO:teuthology.orchestra.run.smithi049.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-31T05:00:38.319 INFO:teuthology.orchestra.run.smithi049.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-31T05:00:38.319 INFO:teuthology.orchestra.run.smithi049.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-31T05:00:38.321 INFO:teuthology.orchestra.run.smithi049.stdout:The following additional packages will be installed: 2024-01-31T05:00:38.321 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-31T05:00:38.321 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-31T05:00:38.321 INFO:teuthology.orchestra.run.smithi049.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-31T05:00:38.321 INFO:teuthology.orchestra.run.smithi049.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-31T05:00:38.321 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-31T05:00:38.321 INFO:teuthology.orchestra.run.smithi049.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-31T05:00:38.321 INFO:teuthology.orchestra.run.smithi049.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-31T05:00:38.321 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-31T05:00:38.321 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-31T05:00:38.321 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-31T05:00:38.321 INFO:teuthology.orchestra.run.smithi049.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-31T05:00:38.322 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-31T05:00:38.322 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-31T05:00:38.322 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-31T05:00:38.322 INFO:teuthology.orchestra.run.smithi049.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-31T05:00:38.322 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-31T05:00:38.322 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-31T05:00:38.322 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-31T05:00:38.322 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-31T05:00:38.322 INFO:teuthology.orchestra.run.smithi049.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-31T05:00:38.322 INFO:teuthology.orchestra.run.smithi049.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-31T05:00:38.322 INFO:teuthology.orchestra.run.smithi049.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-31T05:00:38.322 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-31T05:00:38.322 INFO:teuthology.orchestra.run.smithi049.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-01-31T05:00:38.323 INFO:teuthology.orchestra.run.smithi049.stdout:Suggested packages: 2024-01-31T05:00:38.323 INFO:teuthology.orchestra.run.smithi049.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-31T05:00:38.323 INFO:teuthology.orchestra.run.smithi049.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-31T05:00:38.323 INFO:teuthology.orchestra.run.smithi049.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-31T05:00:38.323 INFO:teuthology.orchestra.run.smithi049.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-31T05:00:38.323 INFO:teuthology.orchestra.run.smithi049.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-31T05:00:38.323 INFO:teuthology.orchestra.run.smithi049.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-31T05:00:38.323 INFO:teuthology.orchestra.run.smithi049.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-31T05:00:38.323 INFO:teuthology.orchestra.run.smithi049.stdout:Recommended packages: 2024-01-31T05:00:38.323 INFO:teuthology.orchestra.run.smithi049.stdout: btrfs-tools 2024-01-31T05:00:38.396 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages were automatically installed and are no longer required: 2024-01-31T05:00:38.396 INFO:teuthology.orchestra.run.smithi195.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-31T05:00:38.396 INFO:teuthology.orchestra.run.smithi195.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-31T05:00:38.397 INFO:teuthology.orchestra.run.smithi195.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-31T05:00:38.397 INFO:teuthology.orchestra.run.smithi195.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-31T05:00:38.397 INFO:teuthology.orchestra.run.smithi195.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-31T05:00:38.397 INFO:teuthology.orchestra.run.smithi195.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-31T05:00:38.399 INFO:teuthology.orchestra.run.smithi195.stdout:The following additional packages will be installed: 2024-01-31T05:00:38.399 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-31T05:00:38.399 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-31T05:00:38.399 INFO:teuthology.orchestra.run.smithi195.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-31T05:00:38.399 INFO:teuthology.orchestra.run.smithi195.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-31T05:00:38.399 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-31T05:00:38.399 INFO:teuthology.orchestra.run.smithi195.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-31T05:00:38.399 INFO:teuthology.orchestra.run.smithi195.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-31T05:00:38.399 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-31T05:00:38.399 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-31T05:00:38.400 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-31T05:00:38.400 INFO:teuthology.orchestra.run.smithi195.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-31T05:00:38.400 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-31T05:00:38.400 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-31T05:00:38.400 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-31T05:00:38.400 INFO:teuthology.orchestra.run.smithi195.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-31T05:00:38.400 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-31T05:00:38.400 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-31T05:00:38.400 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-31T05:00:38.400 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-31T05:00:38.400 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-31T05:00:38.400 INFO:teuthology.orchestra.run.smithi195.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-31T05:00:38.400 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-31T05:00:38.400 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-31T05:00:38.400 INFO:teuthology.orchestra.run.smithi195.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-01-31T05:00:38.401 INFO:teuthology.orchestra.run.smithi195.stdout:Suggested packages: 2024-01-31T05:00:38.401 INFO:teuthology.orchestra.run.smithi195.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-31T05:00:38.401 INFO:teuthology.orchestra.run.smithi195.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-31T05:00:38.401 INFO:teuthology.orchestra.run.smithi195.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-31T05:00:38.401 INFO:teuthology.orchestra.run.smithi195.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-31T05:00:38.401 INFO:teuthology.orchestra.run.smithi195.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-31T05:00:38.401 INFO:teuthology.orchestra.run.smithi195.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-31T05:00:38.401 INFO:teuthology.orchestra.run.smithi195.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-31T05:00:38.401 INFO:teuthology.orchestra.run.smithi195.stdout:Recommended packages: 2024-01-31T05:00:38.401 INFO:teuthology.orchestra.run.smithi195.stdout: btrfs-tools 2024-01-31T05:00:38.480 INFO:teuthology.orchestra.run.smithi049.stdout:The following NEW packages will be installed: 2024-01-31T05:00:38.480 INFO:teuthology.orchestra.run.smithi049.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-01-31T05:00:38.480 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-01-31T05:00:38.480 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-01-31T05:00:38.480 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-01-31T05:00:38.480 INFO:teuthology.orchestra.run.smithi049.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-31T05:00:38.480 INFO:teuthology.orchestra.run.smithi049.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-01-31T05:00:38.480 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-01-31T05:00:38.480 INFO:teuthology.orchestra.run.smithi049.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-31T05:00:38.480 INFO:teuthology.orchestra.run.smithi049.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-31T05:00:38.480 INFO:teuthology.orchestra.run.smithi049.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-31T05:00:38.481 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-31T05:00:38.481 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-31T05:00:38.481 INFO:teuthology.orchestra.run.smithi049.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-31T05:00:38.481 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-31T05:00:38.481 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-31T05:00:38.481 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-31T05:00:38.481 INFO:teuthology.orchestra.run.smithi049.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-31T05:00:38.481 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-31T05:00:38.481 INFO:teuthology.orchestra.run.smithi049.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-31T05:00:38.481 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-31T05:00:38.481 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-31T05:00:38.481 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-31T05:00:38.481 INFO:teuthology.orchestra.run.smithi049.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-31T05:00:38.481 INFO:teuthology.orchestra.run.smithi049.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-31T05:00:38.481 INFO:teuthology.orchestra.run.smithi049.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-31T05:00:38.482 INFO:teuthology.orchestra.run.smithi049.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-31T05:00:38.482 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-01-31T05:00:38.482 INFO:teuthology.orchestra.run.smithi049.stdout: socat unzip xmlstarlet zip 2024-01-31T05:00:38.548 INFO:teuthology.orchestra.run.smithi195.stdout:The following NEW packages will be installed: 2024-01-31T05:00:38.549 INFO:teuthology.orchestra.run.smithi195.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-01-31T05:00:38.549 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-01-31T05:00:38.549 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-01-31T05:00:38.549 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-01-31T05:00:38.551 INFO:teuthology.orchestra.run.smithi195.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-31T05:00:38.551 INFO:teuthology.orchestra.run.smithi195.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-01-31T05:00:38.551 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-01-31T05:00:38.551 INFO:teuthology.orchestra.run.smithi195.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-31T05:00:38.551 INFO:teuthology.orchestra.run.smithi195.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-31T05:00:38.551 INFO:teuthology.orchestra.run.smithi195.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-31T05:00:38.551 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-31T05:00:38.551 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-31T05:00:38.551 INFO:teuthology.orchestra.run.smithi195.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-31T05:00:38.551 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-31T05:00:38.551 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-31T05:00:38.551 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-31T05:00:38.552 INFO:teuthology.orchestra.run.smithi195.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-31T05:00:38.552 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-31T05:00:38.552 INFO:teuthology.orchestra.run.smithi195.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-31T05:00:38.552 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-31T05:00:38.552 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-31T05:00:38.552 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-31T05:00:38.552 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-31T05:00:38.552 INFO:teuthology.orchestra.run.smithi195.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-31T05:00:38.552 INFO:teuthology.orchestra.run.smithi195.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-31T05:00:38.552 INFO:teuthology.orchestra.run.smithi195.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-31T05:00:38.552 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-01-31T05:00:38.552 INFO:teuthology.orchestra.run.smithi195.stdout: socat unzip xmlstarlet zip 2024-01-31T05:00:38.575 INFO:teuthology.orchestra.run.smithi049.stdout:0 upgraded, 124 newly installed, 0 to remove and 271 not upgraded. 2024-01-31T05:00:38.575 INFO:teuthology.orchestra.run.smithi049.stdout:Need to get 173 MB of archives. 2024-01-31T05:00:38.576 INFO:teuthology.orchestra.run.smithi049.stdout:After this operation, 719 MB of additional disk space will be used. 2024-01-31T05:00:38.576 INFO:teuthology.orchestra.run.smithi049.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-31T05:00:38.596 INFO:teuthology.orchestra.run.smithi049.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-31T05:00:38.607 INFO:teuthology.orchestra.run.smithi049.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-31T05:00:38.622 INFO:teuthology.orchestra.run.smithi195.stdout:0 upgraded, 124 newly installed, 0 to remove and 271 not upgraded. 2024-01-31T05:00:38.622 INFO:teuthology.orchestra.run.smithi195.stdout:Need to get 173 MB of archives. 2024-01-31T05:00:38.623 INFO:teuthology.orchestra.run.smithi195.stdout:After this operation, 719 MB of additional disk space will be used. 2024-01-31T05:00:38.623 INFO:teuthology.orchestra.run.smithi195.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-31T05:00:38.643 INFO:teuthology.orchestra.run.smithi195.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-31T05:00:38.654 INFO:teuthology.orchestra.run.smithi195.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-31T05:00:38.656 INFO:teuthology.orchestra.run.smithi049.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-31T05:00:38.680 INFO:teuthology.orchestra.run.smithi049.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-31T05:00:38.683 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-31T05:00:38.697 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-31T05:00:38.698 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-885-g661946e7-1jammy [3,514 kB] 2024-01-31T05:00:38.701 INFO:teuthology.orchestra.run.smithi195.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-31T05:00:38.704 INFO:teuthology.orchestra.run.smithi049.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-885-g661946e7-1jammy [3,514 kB] 2024-01-31T05:00:38.725 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-31T05:00:38.728 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-31T05:00:38.741 INFO:teuthology.orchestra.run.smithi049.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-31T05:00:38.742 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-31T05:00:38.747 INFO:teuthology.orchestra.run.smithi049.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-31T05:00:38.753 INFO:teuthology.orchestra.run.smithi049.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-31T05:00:38.757 INFO:teuthology.orchestra.run.smithi049.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-31T05:00:38.757 INFO:teuthology.orchestra.run.smithi049.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-31T05:00:38.765 INFO:teuthology.orchestra.run.smithi049.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-31T05:00:38.767 INFO:teuthology.orchestra.run.smithi049.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-31T05:00:38.769 INFO:teuthology.orchestra.run.smithi049.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-31T05:00:38.770 INFO:teuthology.orchestra.run.smithi049.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-31T05:00:38.773 INFO:teuthology.orchestra.run.smithi049.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-31T05:00:38.791 INFO:teuthology.orchestra.run.smithi049.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-31T05:00:38.793 INFO:teuthology.orchestra.run.smithi049.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-31T05:00:38.795 INFO:teuthology.orchestra.run.smithi049.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-31T05:00:38.796 INFO:teuthology.orchestra.run.smithi049.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-31T05:00:38.796 INFO:teuthology.orchestra.run.smithi049.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-31T05:00:38.797 INFO:teuthology.orchestra.run.smithi049.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-31T05:00:38.798 INFO:teuthology.orchestra.run.smithi049.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-31T05:00:38.798 INFO:teuthology.orchestra.run.smithi049.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-31T05:00:38.798 INFO:teuthology.orchestra.run.smithi049.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-31T05:00:38.802 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-31T05:00:38.805 INFO:teuthology.orchestra.run.smithi195.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-31T05:00:38.813 INFO:teuthology.orchestra.run.smithi195.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-31T05:00:38.816 INFO:teuthology.orchestra.run.smithi195.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-31T05:00:38.816 INFO:teuthology.orchestra.run.smithi195.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-31T05:00:38.823 INFO:teuthology.orchestra.run.smithi049.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-31T05:00:38.823 INFO:teuthology.orchestra.run.smithi049.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-31T05:00:38.823 INFO:teuthology.orchestra.run.smithi049.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-31T05:00:38.824 INFO:teuthology.orchestra.run.smithi195.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-31T05:00:38.828 INFO:teuthology.orchestra.run.smithi195.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-31T05:00:38.831 INFO:teuthology.orchestra.run.smithi195.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-31T05:00:38.832 INFO:teuthology.orchestra.run.smithi195.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-31T05:00:38.833 INFO:teuthology.orchestra.run.smithi195.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-31T05:00:38.842 INFO:teuthology.orchestra.run.smithi049.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-31T05:00:38.843 INFO:teuthology.orchestra.run.smithi049.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-31T05:00:38.843 INFO:teuthology.orchestra.run.smithi049.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-31T05:00:38.844 INFO:teuthology.orchestra.run.smithi049.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-31T05:00:38.845 INFO:teuthology.orchestra.run.smithi049.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-31T05:00:38.845 INFO:teuthology.orchestra.run.smithi049.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-31T05:00:38.845 INFO:teuthology.orchestra.run.smithi049.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-31T05:00:38.852 INFO:teuthology.orchestra.run.smithi195.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-31T05:00:38.854 INFO:teuthology.orchestra.run.smithi195.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-31T05:00:38.856 INFO:teuthology.orchestra.run.smithi195.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-31T05:00:38.856 INFO:teuthology.orchestra.run.smithi195.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-31T05:00:38.857 INFO:teuthology.orchestra.run.smithi195.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-31T05:00:38.858 INFO:teuthology.orchestra.run.smithi195.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-31T05:00:38.858 INFO:teuthology.orchestra.run.smithi195.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-31T05:00:38.862 INFO:teuthology.orchestra.run.smithi049.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-31T05:00:38.863 INFO:teuthology.orchestra.run.smithi049.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-31T05:00:38.864 INFO:teuthology.orchestra.run.smithi049.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-31T05:00:38.872 INFO:teuthology.orchestra.run.smithi195.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-31T05:00:38.872 INFO:teuthology.orchestra.run.smithi195.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-31T05:00:38.872 INFO:teuthology.orchestra.run.smithi195.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-31T05:00:38.883 INFO:teuthology.orchestra.run.smithi049.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-31T05:00:38.883 INFO:teuthology.orchestra.run.smithi049.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-31T05:00:38.883 INFO:teuthology.orchestra.run.smithi049.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-31T05:00:38.884 INFO:teuthology.orchestra.run.smithi049.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-31T05:00:38.885 INFO:teuthology.orchestra.run.smithi049.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-31T05:00:38.887 INFO:teuthology.orchestra.run.smithi049.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-31T05:00:38.888 INFO:teuthology.orchestra.run.smithi049.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-31T05:00:38.891 INFO:teuthology.orchestra.run.smithi195.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-31T05:00:38.891 INFO:teuthology.orchestra.run.smithi195.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-31T05:00:38.893 INFO:teuthology.orchestra.run.smithi195.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-31T05:00:38.894 INFO:teuthology.orchestra.run.smithi195.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-31T05:00:38.894 INFO:teuthology.orchestra.run.smithi195.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-31T05:00:38.895 INFO:teuthology.orchestra.run.smithi195.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-31T05:00:38.896 INFO:teuthology.orchestra.run.smithi195.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-31T05:00:38.902 INFO:teuthology.orchestra.run.smithi049.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-31T05:00:38.903 INFO:teuthology.orchestra.run.smithi049.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-31T05:00:38.905 INFO:teuthology.orchestra.run.smithi049.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-31T05:00:38.911 INFO:teuthology.orchestra.run.smithi195.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-31T05:00:38.912 INFO:teuthology.orchestra.run.smithi195.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-31T05:00:38.912 INFO:teuthology.orchestra.run.smithi195.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-31T05:00:38.922 INFO:teuthology.orchestra.run.smithi049.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-31T05:00:38.922 INFO:teuthology.orchestra.run.smithi049.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-31T05:00:38.925 INFO:teuthology.orchestra.run.smithi049.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-31T05:00:38.942 INFO:teuthology.orchestra.run.smithi195.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-31T05:00:38.942 INFO:teuthology.orchestra.run.smithi195.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-31T05:00:38.952 INFO:teuthology.orchestra.run.smithi195.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-31T05:00:38.952 INFO:teuthology.orchestra.run.smithi195.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-31T05:00:38.952 INFO:teuthology.orchestra.run.smithi195.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-31T05:00:38.953 INFO:teuthology.orchestra.run.smithi195.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-31T05:00:38.954 INFO:teuthology.orchestra.run.smithi195.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-31T05:00:38.989 INFO:teuthology.orchestra.run.smithi195.stdout:Get:46 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-885-g661946e7-1jammy [3,209 kB] 2024-01-31T05:00:38.992 INFO:teuthology.orchestra.run.smithi195.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-31T05:00:38.996 INFO:teuthology.orchestra.run.smithi049.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-31T05:00:38.996 INFO:teuthology.orchestra.run.smithi049.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-01-31T05:00:38.996 INFO:teuthology.orchestra.run.smithi195.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-31T05:00:38.996 INFO:teuthology.orchestra.run.smithi195.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-31T05:00:38.998 INFO:teuthology.orchestra.run.smithi049.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-31T05:00:38.999 INFO:teuthology.orchestra.run.smithi049.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-31T05:00:39.000 INFO:teuthology.orchestra.run.smithi049.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-31T05:00:39.028 INFO:teuthology.orchestra.run.smithi049.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-31T05:00:39.030 INFO:teuthology.orchestra.run.smithi049.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-31T05:00:39.030 INFO:teuthology.orchestra.run.smithi049.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-31T05:00:39.036 INFO:teuthology.orchestra.run.smithi195.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-31T05:00:39.039 INFO:teuthology.orchestra.run.smithi195.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-31T05:00:39.039 INFO:teuthology.orchestra.run.smithi195.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-31T05:00:39.039 INFO:teuthology.orchestra.run.smithi195.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-31T05:00:39.041 INFO:teuthology.orchestra.run.smithi195.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-31T05:00:39.116 INFO:teuthology.orchestra.run.smithi195.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-885-g661946e7-1jammy [710 kB] 2024-01-31T05:00:39.139 INFO:teuthology.orchestra.run.smithi195.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-885-g661946e7-1jammy [356 kB] 2024-01-31T05:00:39.141 INFO:teuthology.orchestra.run.smithi049.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-31T05:00:39.141 INFO:teuthology.orchestra.run.smithi049.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-31T05:00:39.142 INFO:teuthology.orchestra.run.smithi049.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-31T05:00:39.142 INFO:teuthology.orchestra.run.smithi049.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-31T05:00:39.143 INFO:teuthology.orchestra.run.smithi049.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-31T05:00:39.143 INFO:teuthology.orchestra.run.smithi049.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-31T05:00:39.144 INFO:teuthology.orchestra.run.smithi049.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-31T05:00:39.146 INFO:teuthology.orchestra.run.smithi195.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-31T05:00:39.147 INFO:teuthology.orchestra.run.smithi195.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-01-31T05:00:39.148 INFO:teuthology.orchestra.run.smithi195.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-31T05:00:39.149 INFO:teuthology.orchestra.run.smithi195.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-31T05:00:39.150 INFO:teuthology.orchestra.run.smithi195.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-31T05:00:39.155 INFO:teuthology.orchestra.run.smithi195.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-885-g661946e7-1jammy [32.8 kB] 2024-01-31T05:00:39.156 INFO:teuthology.orchestra.run.smithi195.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-885-g661946e7-1jammy [180 kB] 2024-01-31T05:00:39.160 INFO:teuthology.orchestra.run.smithi049.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-31T05:00:39.162 INFO:teuthology.orchestra.run.smithi195.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-885-g661946e7-1jammy [64.1 kB] 2024-01-31T05:00:39.165 INFO:teuthology.orchestra.run.smithi049.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-31T05:00:39.165 INFO:teuthology.orchestra.run.smithi195.stdout:Get:65 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-885-g661946e7-1jammy [330 kB] 2024-01-31T05:00:39.169 INFO:teuthology.orchestra.run.smithi195.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-31T05:00:39.171 INFO:teuthology.orchestra.run.smithi195.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-31T05:00:39.171 INFO:teuthology.orchestra.run.smithi195.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-31T05:00:39.176 INFO:teuthology.orchestra.run.smithi049.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-31T05:00:39.177 INFO:teuthology.orchestra.run.smithi195.stdout:Get:69 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-885-g661946e7-1jammy [6,233 kB] 2024-01-31T05:00:39.196 INFO:teuthology.orchestra.run.smithi195.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-31T05:00:39.196 INFO:teuthology.orchestra.run.smithi195.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-31T05:00:39.200 INFO:teuthology.orchestra.run.smithi049.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-31T05:00:39.200 INFO:teuthology.orchestra.run.smithi049.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-31T05:00:39.204 INFO:teuthology.orchestra.run.smithi049.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-31T05:00:39.208 INFO:teuthology.orchestra.run.smithi049.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-31T05:00:39.208 INFO:teuthology.orchestra.run.smithi049.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-31T05:00:39.209 INFO:teuthology.orchestra.run.smithi049.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-31T05:00:39.210 INFO:teuthology.orchestra.run.smithi049.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-31T05:00:39.215 INFO:teuthology.orchestra.run.smithi049.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-31T05:00:39.216 INFO:teuthology.orchestra.run.smithi049.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-31T05:00:39.220 INFO:teuthology.orchestra.run.smithi195.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-31T05:00:39.220 INFO:teuthology.orchestra.run.smithi195.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-31T05:00:39.221 INFO:teuthology.orchestra.run.smithi195.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-31T05:00:39.221 INFO:teuthology.orchestra.run.smithi195.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-31T05:00:39.222 INFO:teuthology.orchestra.run.smithi195.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-31T05:00:39.222 INFO:teuthology.orchestra.run.smithi195.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-31T05:00:39.226 INFO:teuthology.orchestra.run.smithi195.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-31T05:00:39.233 INFO:teuthology.orchestra.run.smithi049.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-31T05:00:39.234 INFO:teuthology.orchestra.run.smithi049.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-31T05:00:39.235 INFO:teuthology.orchestra.run.smithi049.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-31T05:00:39.235 INFO:teuthology.orchestra.run.smithi049.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-31T05:00:39.237 INFO:teuthology.orchestra.run.smithi049.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-31T05:00:39.238 INFO:teuthology.orchestra.run.smithi049.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-31T05:00:39.245 INFO:teuthology.orchestra.run.smithi195.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-31T05:00:39.246 INFO:teuthology.orchestra.run.smithi049.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-31T05:00:39.246 INFO:teuthology.orchestra.run.smithi195.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-31T05:00:39.247 INFO:teuthology.orchestra.run.smithi195.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-31T05:00:39.253 INFO:teuthology.orchestra.run.smithi049.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-31T05:00:39.254 INFO:teuthology.orchestra.run.smithi049.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-31T05:00:39.257 INFO:teuthology.orchestra.run.smithi049.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-31T05:00:39.268 INFO:teuthology.orchestra.run.smithi195.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-31T05:00:39.270 INFO:teuthology.orchestra.run.smithi195.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-31T05:00:39.271 INFO:teuthology.orchestra.run.smithi195.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-31T05:00:39.272 INFO:teuthology.orchestra.run.smithi195.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-31T05:00:39.272 INFO:teuthology.orchestra.run.smithi195.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-31T05:00:39.277 INFO:teuthology.orchestra.run.smithi195.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-31T05:00:39.278 INFO:teuthology.orchestra.run.smithi195.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-31T05:00:39.287 INFO:teuthology.orchestra.run.smithi049.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-31T05:00:39.308 INFO:teuthology.orchestra.run.smithi195.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-31T05:00:39.308 INFO:teuthology.orchestra.run.smithi195.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-31T05:00:39.309 INFO:teuthology.orchestra.run.smithi195.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-31T05:00:39.327 INFO:teuthology.orchestra.run.smithi195.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-31T05:00:39.329 INFO:teuthology.orchestra.run.smithi195.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-31T05:00:39.330 INFO:teuthology.orchestra.run.smithi195.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-31T05:00:39.337 INFO:teuthology.orchestra.run.smithi195.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-31T05:00:39.338 INFO:teuthology.orchestra.run.smithi195.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-31T05:00:39.338 INFO:teuthology.orchestra.run.smithi195.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-31T05:00:39.340 INFO:teuthology.orchestra.run.smithi195.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-31T05:00:39.353 INFO:teuthology.orchestra.run.smithi195.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-31T05:00:39.420 INFO:teuthology.orchestra.run.smithi195.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-885-g661946e7-1jammy [112 kB] 2024-01-31T05:00:39.423 INFO:teuthology.orchestra.run.smithi195.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-885-g661946e7-1jammy [465 kB] 2024-01-31T05:00:39.442 INFO:teuthology.orchestra.run.smithi195.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-885-g661946e7-1jammy [23.0 MB] 2024-01-31T05:00:39.624 INFO:teuthology.orchestra.run.smithi049.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-885-g661946e7-1jammy [3,209 kB] 2024-01-31T05:00:40.203 INFO:teuthology.orchestra.run.smithi049.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-885-g661946e7-1jammy [710 kB] 2024-01-31T05:00:40.320 INFO:teuthology.orchestra.run.smithi049.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-885-g661946e7-1jammy [356 kB] 2024-01-31T05:00:40.381 INFO:teuthology.orchestra.run.smithi049.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-885-g661946e7-1jammy [32.8 kB] 2024-01-31T05:00:40.384 INFO:teuthology.orchestra.run.smithi049.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-885-g661946e7-1jammy [180 kB] 2024-01-31T05:00:40.403 INFO:teuthology.orchestra.run.smithi049.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-885-g661946e7-1jammy [64.1 kB] 2024-01-31T05:00:40.410 INFO:teuthology.orchestra.run.smithi049.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-885-g661946e7-1jammy [330 kB] 2024-01-31T05:00:40.413 INFO:teuthology.orchestra.run.smithi195.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-885-g661946e7-1jammy [5,059 kB] 2024-01-31T05:00:40.462 INFO:teuthology.orchestra.run.smithi049.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-885-g661946e7-1jammy [6,233 kB] 2024-01-31T05:00:40.573 INFO:teuthology.orchestra.run.smithi195.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-885-g661946e7-1jammy [240 kB] 2024-01-31T05:00:40.582 INFO:teuthology.orchestra.run.smithi195.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-885-g661946e7-1jammy [124 kB] 2024-01-31T05:00:40.587 INFO:teuthology.orchestra.run.smithi195.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-885-g661946e7-1jammy [1,518 kB] 2024-01-31T05:00:40.654 INFO:teuthology.orchestra.run.smithi195.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-885-g661946e7-1jammy [6,239 kB] 2024-01-31T05:00:40.942 INFO:teuthology.orchestra.run.smithi195.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-885-g661946e7-1jammy [22.7 MB] 2024-01-31T05:00:41.210 INFO:teuthology.orchestra.run.smithi049.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-885-g661946e7-1jammy [112 kB] 2024-01-31T05:00:41.217 INFO:teuthology.orchestra.run.smithi049.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-885-g661946e7-1jammy [465 kB] 2024-01-31T05:00:41.286 INFO:teuthology.orchestra.run.smithi049.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-885-g661946e7-1jammy [23.0 MB] 2024-01-31T05:00:41.968 INFO:teuthology.orchestra.run.smithi195.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-885-g661946e7-1jammy [14.0 kB] 2024-01-31T05:00:41.969 INFO:teuthology.orchestra.run.smithi195.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-885-g661946e7-1jammy [865 kB] 2024-01-31T05:00:42.000 INFO:teuthology.orchestra.run.smithi195.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-885-g661946e7-1jammy [2,183 kB] 2024-01-31T05:00:42.098 INFO:teuthology.orchestra.run.smithi195.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-885-g661946e7-1jammy [770 kB] 2024-01-31T05:00:42.131 INFO:teuthology.orchestra.run.smithi195.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-885-g661946e7-1jammy [139 kB] 2024-01-31T05:00:42.137 INFO:teuthology.orchestra.run.smithi195.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-885-g661946e7-1jammy [1,876 kB] 2024-01-31T05:00:42.222 INFO:teuthology.orchestra.run.smithi195.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-885-g661946e7-1jammy [8,625 kB] 2024-01-31T05:00:42.677 INFO:teuthology.orchestra.run.smithi195.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-885-g661946e7-1jammy [14.2 kB] 2024-01-31T05:00:42.677 INFO:teuthology.orchestra.run.smithi195.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-885-g661946e7-1jammy [48.9 MB] 2024-01-31T05:00:44.061 INFO:teuthology.orchestra.run.smithi049.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-885-g661946e7-1jammy [5,059 kB] 2024-01-31T05:00:44.658 INFO:teuthology.orchestra.run.smithi049.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-885-g661946e7-1jammy [240 kB] 2024-01-31T05:00:44.687 INFO:teuthology.orchestra.run.smithi049.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-885-g661946e7-1jammy [124 kB] 2024-01-31T05:00:44.702 INFO:teuthology.orchestra.run.smithi049.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-885-g661946e7-1jammy [1,518 kB] 2024-01-31T05:00:44.840 INFO:teuthology.orchestra.run.smithi195.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-885-g661946e7-1jammy [121 kB] 2024-01-31T05:00:44.841 INFO:teuthology.orchestra.run.smithi195.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-885-g661946e7-1jammy [226 kB] 2024-01-31T05:00:44.843 INFO:teuthology.orchestra.run.smithi195.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-885-g661946e7-1jammy [34.0 kB] 2024-01-31T05:00:44.843 INFO:teuthology.orchestra.run.smithi195.stdout:Get:121 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-885-g661946e7-1jammy [23.4 kB] 2024-01-31T05:00:44.843 INFO:teuthology.orchestra.run.smithi195.stdout:Get:122 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-885-g661946e7-1jammy [38.4 kB] 2024-01-31T05:00:44.844 INFO:teuthology.orchestra.run.smithi195.stdout:Get:123 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-885-g661946e7-1jammy [12.3 MB] 2024-01-31T05:00:44.882 INFO:teuthology.orchestra.run.smithi049.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-885-g661946e7-1jammy [6,239 kB] 2024-01-31T05:00:45.405 INFO:teuthology.orchestra.run.smithi195.stdout:Get:124 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-885-g661946e7-1jammy [91.7 kB] 2024-01-31T05:00:45.505 INFO:teuthology.orchestra.run.smithi049.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-885-g661946e7-1jammy [22.7 MB] 2024-01-31T05:00:46.032 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 173 MB in 7s (25.3 MB/s) 2024-01-31T05:00:46.175 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-31T05:00:46.242 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2024-01-31T05:00:46.245 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-31T05:00:46.290 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-31T05:00:46.618 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-31T05:00:46.632 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-31T05:00:46.685 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-31T05:00:46.720 INFO:teuthology.orchestra.run.smithi049.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-885-g661946e7-1jammy [14.0 kB] 2024-01-31T05:00:46.720 INFO:teuthology.orchestra.run.smithi049.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-885-g661946e7-1jammy [865 kB] 2024-01-31T05:00:46.759 INFO:teuthology.orchestra.run.smithi049.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-885-g661946e7-1jammy [2,183 kB] 2024-01-31T05:00:46.880 INFO:teuthology.orchestra.run.smithi049.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-885-g661946e7-1jammy [770 kB] 2024-01-31T05:00:46.922 INFO:teuthology.orchestra.run.smithi049.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-885-g661946e7-1jammy [139 kB] 2024-01-31T05:00:46.925 INFO:teuthology.orchestra.run.smithi049.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-885-g661946e7-1jammy [1,876 kB] 2024-01-31T05:00:46.987 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cmd2. 2024-01-31T05:00:47.001 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-31T05:00:47.029 INFO:teuthology.orchestra.run.smithi049.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-885-g661946e7-1jammy [8,625 kB] 2024-01-31T05:00:47.046 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-31T05:00:47.365 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-31T05:00:47.379 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-31T05:00:47.457 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-31T05:00:47.473 INFO:teuthology.orchestra.run.smithi049.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-885-g661946e7-1jammy [14.2 kB] 2024-01-31T05:00:47.473 INFO:teuthology.orchestra.run.smithi049.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-885-g661946e7-1jammy [48.9 MB] 2024-01-31T05:00:47.769 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-31T05:00:47.783 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-31T05:00:48.027 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-31T05:00:48.497 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-31T05:00:48.511 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-31T05:00:48.555 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-31T05:00:48.959 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-31T05:00:48.973 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-31T05:00:49.016 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-31T05:00:49.420 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-31T05:00:49.434 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-31T05:00:49.479 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-31T05:00:49.823 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-31T05:00:49.837 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-31T05:00:49.881 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-31T05:00:50.168 INFO:teuthology.orchestra.run.smithi049.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-885-g661946e7-1jammy [121 kB] 2024-01-31T05:00:50.169 INFO:teuthology.orchestra.run.smithi049.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-885-g661946e7-1jammy [226 kB] 2024-01-31T05:00:50.171 INFO:teuthology.orchestra.run.smithi049.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-885-g661946e7-1jammy [34.0 kB] 2024-01-31T05:00:50.172 INFO:teuthology.orchestra.run.smithi049.stdout:Get:121 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-885-g661946e7-1jammy [23.4 kB] 2024-01-31T05:00:50.179 INFO:teuthology.orchestra.run.smithi049.stdout:Get:122 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-885-g661946e7-1jammy [38.4 kB] 2024-01-31T05:00:50.181 INFO:teuthology.orchestra.run.smithi049.stdout:Get:123 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-885-g661946e7-1jammy [12.3 MB] 2024-01-31T05:00:50.193 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-31T05:00:50.207 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-31T05:00:50.251 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-31T05:00:50.571 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librados2. 2024-01-31T05:00:50.585 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../010-librados2_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:00:50.629 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librados2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:50.910 INFO:teuthology.orchestra.run.smithi049.stdout:Get:124 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-885-g661946e7-1jammy [91.7 kB] 2024-01-31T05:00:51.007 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librbd1. 2024-01-31T05:00:51.020 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../011-librbd1_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:00:51.065 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librbd1 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:51.476 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libcephfs2. 2024-01-31T05:00:51.489 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:00:51.534 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libcephfs2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:51.576 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 173 MB in 12s (13.9 MB/s) 2024-01-31T05:00:51.744 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-31T05:00:51.813 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2024-01-31T05:00:51.816 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-31T05:00:51.848 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rados. 2024-01-31T05:00:51.859 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-31T05:00:51.859 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../013-python3-rados_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:00:51.904 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rados (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:52.162 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-31T05:00:52.176 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-31T05:00:52.181 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-31T05:00:52.195 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:00:52.220 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-31T05:00:52.231 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-ceph-argparse (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:52.450 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cephfs. 2024-01-31T05:00:52.464 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:00:52.508 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cephfs (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:52.539 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cmd2. 2024-01-31T05:00:52.554 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-31T05:00:52.598 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-31T05:00:52.861 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-31T05:00:52.875 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:00:52.911 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-ceph-common (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:53.147 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-31T05:00:53.162 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-31T05:00:53.214 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-prettytable. 2024-01-31T05:00:53.228 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-31T05:00:53.251 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-31T05:00:53.273 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-31T05:00:53.509 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rbd. 2024-01-31T05:00:53.522 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:00:53.583 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rbd (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:53.596 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-31T05:00:53.611 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-31T05:00:53.655 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-31T05:00:53.895 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-31T05:00:53.908 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-31T05:00:53.945 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-31T05:00:53.966 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-31T05:00:53.981 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-31T05:00:54.024 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-31T05:00:54.247 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-31T05:00:54.260 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-31T05:00:54.305 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-31T05:00:54.444 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-31T05:00:54.460 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-31T05:00:54.519 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-31T05:00:54.600 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-31T05:00:54.613 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-31T05:00:54.658 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-31T05:00:54.914 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-31T05:00:54.929 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-31T05:00:54.962 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package lua5.1. 2024-01-31T05:00:54.972 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-31T05:00:54.975 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-31T05:00:55.011 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-31T05:00:55.309 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-31T05:00:55.315 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package lua-any. 2024-01-31T05:00:55.324 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-31T05:00:55.328 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-31T05:00:55.367 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-31T05:00:55.398 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-31T05:00:55.642 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package zip. 2024-01-31T05:00:55.655 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-31T05:00:55.700 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking zip (3.0-12build2) ... 2024-01-31T05:00:55.711 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-31T05:00:55.727 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-31T05:00:55.761 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-31T05:00:56.020 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package unzip. 2024-01-31T05:00:56.033 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-31T05:00:56.073 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librados2. 2024-01-31T05:00:56.078 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-31T05:00:56.088 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../010-librados2_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:00:56.131 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librados2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:56.457 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package luarocks. 2024-01-31T05:00:56.471 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-31T05:00:56.516 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-31T05:00:56.550 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librbd1. 2024-01-31T05:00:56.565 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../011-librbd1_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:00:56.608 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librbd1 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:56.899 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librgw2. 2024-01-31T05:00:56.912 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../027-librgw2_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:00:56.959 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librgw2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:57.011 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libcephfs2. 2024-01-31T05:00:57.025 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:00:57.069 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libcephfs2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:57.330 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rados. 2024-01-31T05:00:57.345 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../013-python3-rados_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:00:57.380 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rados (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:57.392 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rgw. 2024-01-31T05:00:57.406 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:00:57.450 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rgw (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:57.666 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-31T05:00:57.680 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:00:57.724 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-ceph-argparse (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:57.779 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-31T05:00:57.792 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-31T05:00:57.849 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-31T05:00:57.978 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cephfs. 2024-01-31T05:00:57.991 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:00:58.177 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cephfs (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:58.366 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libradosstriper1. 2024-01-31T05:00:58.366 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:00:58.381 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libradosstriper1 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:58.513 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-31T05:00:58.528 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:00:58.571 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-ceph-common (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:58.793 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-common. 2024-01-31T05:00:58.806 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../031-ceph-common_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:00:58.851 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-common (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:58.908 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-prettytable. 2024-01-31T05:00:58.923 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-31T05:00:58.957 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-31T05:00:59.177 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rbd. 2024-01-31T05:00:59.192 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:00:59.235 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rbd (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:59.580 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-31T05:00:59.595 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-31T05:00:59.638 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-31T05:00:59.865 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-base. 2024-01-31T05:00:59.880 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../032-ceph-base_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:00:59.923 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-base (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:00:59.965 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-31T05:00:59.981 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-31T05:01:00.015 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-31T05:01:00.327 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-31T05:01:00.341 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-31T05:01:00.385 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-31T05:01:00.494 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-31T05:01:00.507 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-31T05:01:00.561 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-31T05:01:00.780 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package lua5.1. 2024-01-31T05:01:00.795 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-31T05:01:00.805 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cheroot. 2024-01-31T05:01:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-31T05:01:00.846 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-31T05:01:00.855 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-31T05:01:01.150 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package lua-any. 2024-01-31T05:01:01.150 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-31T05:01:01.163 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-31T05:01:01.165 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-31T05:01:01.199 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-31T05:01:01.208 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-31T05:01:01.427 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package zip. 2024-01-31T05:01:01.443 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-31T05:01:01.485 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking zip (3.0-12build2) ... 2024-01-31T05:01:01.519 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-31T05:01:01.533 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-31T05:01:01.577 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-31T05:01:01.805 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package unzip. 2024-01-31T05:01:01.821 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-31T05:01:01.863 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-31T05:01:01.931 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-31T05:01:01.944 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-31T05:01:01.989 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-31T05:01:02.242 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package luarocks. 2024-01-31T05:01:02.250 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-tempora. 2024-01-31T05:01:02.258 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-31T05:01:02.263 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-31T05:01:02.300 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-31T05:01:02.308 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-31T05:01:02.569 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-portend. 2024-01-31T05:01:02.583 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-31T05:01:02.636 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-31T05:01:02.700 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package librgw2. 2024-01-31T05:01:02.714 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../027-librgw2_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:02.757 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking librgw2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:02.914 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-31T05:01:02.927 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-31T05:01:03.006 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-31T05:01:03.169 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rgw. 2024-01-31T05:01:03.183 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:03.227 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rgw (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:03.309 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-31T05:01:03.323 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-31T05:01:03.366 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-31T05:01:03.554 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-31T05:01:03.569 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-31T05:01:03.612 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-31T05:01:03.670 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-natsort. 2024-01-31T05:01:03.684 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-31T05:01:03.720 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-31T05:01:04.007 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-logutils. 2024-01-31T05:01:04.016 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libradosstriper1. 2024-01-31T05:01:04.020 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-31T05:01:04.032 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:04.065 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-31T05:01:04.074 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libradosstriper1 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:04.376 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-31T05:01:04.391 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-31T05:01:04.426 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-31T05:01:04.444 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-common. 2024-01-31T05:01:04.459 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../031-ceph-common_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:04.493 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-common (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:04.721 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-mako. 2024-01-31T05:01:04.735 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-31T05:01:04.779 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-31T05:01:05.107 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-31T05:01:05.122 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-31T05:01:05.165 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-31T05:01:05.491 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-base. 2024-01-31T05:01:05.506 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../032-ceph-base_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:05.510 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-31T05:01:05.525 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-31T05:01:05.558 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-base (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:05.568 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-31T05:01:05.846 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-webob. 2024-01-31T05:01:05.861 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-31T05:01:05.896 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-31T05:01:06.103 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-31T05:01:06.118 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-31T05:01:06.161 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-31T05:01:06.207 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-waitress. 2024-01-31T05:01:06.223 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-31T05:01:06.268 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-31T05:01:06.489 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cheroot. 2024-01-31T05:01:06.505 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-31T05:01:06.548 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-31T05:01:06.585 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-tempita. 2024-01-31T05:01:06.600 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-31T05:01:06.643 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-31T05:01:06.875 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-31T05:01:06.891 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-31T05:01:06.933 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-31T05:01:06.980 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-paste. 2024-01-31T05:01:06.995 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-31T05:01:07.038 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-31T05:01:07.203 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-31T05:01:07.219 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-31T05:01:07.261 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-31T05:01:07.366 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-31T05:01:07.381 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-31T05:01:07.424 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-31T05:01:07.573 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-31T05:01:07.588 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-31T05:01:07.631 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-31T05:01:07.710 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-31T05:01:07.725 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-31T05:01:07.769 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-31T05:01:07.950 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-tempora. 2024-01-31T05:01:07.966 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-31T05:01:08.008 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-31T05:01:08.105 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-webtest. 2024-01-31T05:01:08.121 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-31T05:01:08.163 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-31T05:01:08.478 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-portend. 2024-01-31T05:01:08.494 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-31T05:01:08.608 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pecan. 2024-01-31T05:01:08.623 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-31T05:01:08.658 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-31T05:01:08.837 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-31T05:01:08.988 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-certifi. 2024-01-31T05:01:09.002 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-31T05:01:09.046 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-31T05:01:09.239 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-31T05:01:09.255 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-31T05:01:09.306 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-31T05:01:09.399 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-idna. 2024-01-31T05:01:09.414 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-31T05:01:09.457 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-31T05:01:09.659 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-31T05:01:09.674 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-31T05:01:09.717 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-31T05:01:09.768 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-urllib3. 2024-01-31T05:01:09.784 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-31T05:01:09.826 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-31T05:01:10.037 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-natsort. 2024-01-31T05:01:10.055 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-31T05:01:10.095 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-31T05:01:10.155 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-requests. 2024-01-31T05:01:10.170 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-31T05:01:10.213 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-31T05:01:10.449 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-logutils. 2024-01-31T05:01:10.465 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-31T05:01:10.507 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-31T05:01:10.558 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-31T05:01:10.573 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-31T05:01:10.616 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-31T05:01:10.793 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-31T05:01:10.808 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-31T05:01:10.852 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-31T05:01:10.910 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-31T05:01:10.925 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:01:10.968 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-modules-core (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:11.212 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-mako. 2024-01-31T05:01:11.228 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-31T05:01:11.278 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-31T05:01:11.349 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-31T05:01:11.363 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:11.407 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:11.709 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-31T05:01:11.725 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-31T05:01:11.767 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-31T05:01:12.028 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-31T05:01:12.044 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-31T05:01:12.078 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-31T05:01:12.364 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-webob. 2024-01-31T05:01:12.368 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-31T05:01:12.380 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-31T05:01:12.383 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-31T05:01:12.422 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-31T05:01:12.426 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-31T05:01:12.721 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-openssl. 2024-01-31T05:01:12.736 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-31T05:01:12.759 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-waitress. 2024-01-31T05:01:12.775 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-31T05:01:12.779 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-31T05:01:12.820 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-31T05:01:13.049 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr. 2024-01-31T05:01:13.063 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:13.098 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:13.154 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-tempita. 2024-01-31T05:01:13.169 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-31T05:01:13.211 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-31T05:01:13.501 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mon. 2024-01-31T05:01:13.514 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-paste. 2024-01-31T05:01:13.516 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:13.530 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-31T05:01:13.560 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mon (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:13.572 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-31T05:01:13.893 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-31T05:01:13.908 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-31T05:01:13.950 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-31T05:01:14.130 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-osd. 2024-01-31T05:01:14.145 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:14.188 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-osd (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:14.237 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-31T05:01:14.253 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-31T05:01:14.295 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-31T05:01:14.623 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-webtest. 2024-01-31T05:01:14.638 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-31T05:01:14.673 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-31T05:01:14.950 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph. 2024-01-31T05:01:14.951 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pecan. 2024-01-31T05:01:14.964 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../068-ceph_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:14.966 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-31T05:01:15.000 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:15.000 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-31T05:01:15.302 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-fuse. 2024-01-31T05:01:15.318 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:15.355 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-certifi. 2024-01-31T05:01:15.360 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-fuse (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:15.371 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-31T05:01:15.413 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-31T05:01:15.724 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mds. 2024-01-31T05:01:15.724 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-idna. 2024-01-31T05:01:15.739 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:15.740 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-31T05:01:15.773 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mds (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:15.783 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-31T05:01:16.052 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-urllib3. 2024-01-31T05:01:16.068 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-31T05:01:16.110 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-31T05:01:16.118 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephadm. 2024-01-31T05:01:16.133 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../071-cephadm_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:16.176 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephadm (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:16.414 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-requests. 2024-01-31T05:01:16.429 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-31T05:01:16.472 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-31T05:01:16.487 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-31T05:01:16.502 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-31T05:01:16.545 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-31T05:01:16.792 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-31T05:01:16.807 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-31T05:01:16.823 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-31T05:01:16.838 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-31T05:01:16.849 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-31T05:01:16.881 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-31T05:01:17.145 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-31T05:01:17.160 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:01:17.202 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-modules-core (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:17.582 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-31T05:01:17.597 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:17.640 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:17.910 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-31T05:01:17.911 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-babel. 2024-01-31T05:01:17.925 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-31T05:01:17.926 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-31T05:01:17.960 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-31T05:01:17.969 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-31T05:01:18.254 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-openssl. 2024-01-31T05:01:18.270 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-31T05:01:18.298 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jinja2. 2024-01-31T05:01:18.312 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-01-31T05:01:18.320 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-31T05:01:18.356 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-01-31T05:01:18.674 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr. 2024-01-31T05:01:18.690 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:18.732 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:18.934 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-31T05:01:18.948 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:01:18.992 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-cephadm (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:19.119 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mon. 2024-01-31T05:01:19.134 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:19.177 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mon (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:19.328 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-31T05:01:19.343 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-31T05:01:19.386 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-31T05:01:19.656 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-routes. 2024-01-31T05:01:19.671 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-31T05:01:19.705 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-osd. 2024-01-31T05:01:19.706 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-31T05:01:19.721 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:19.763 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-osd (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:20.051 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-31T05:01:20.066 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:01:20.101 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-dashboard (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:20.483 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph. 2024-01-31T05:01:20.487 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-31T05:01:20.498 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../068-ceph_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:20.502 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-31T05:01:20.541 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:20.545 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-31T05:01:20.852 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-fuse. 2024-01-31T05:01:20.867 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:20.902 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-fuse (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:21.024 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-joblib. 2024-01-31T05:01:21.039 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-31T05:01:21.107 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-31T05:01:21.247 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mds. 2024-01-31T05:01:21.263 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:21.305 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mds (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:21.461 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-31T05:01:21.475 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-31T05:01:21.604 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-31T05:01:21.675 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package cephadm. 2024-01-31T05:01:21.690 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../071-cephadm_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:21.732 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking cephadm (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:21.916 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-sklearn. 2024-01-31T05:01:21.930 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-31T05:01:21.965 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-31T05:01:22.052 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-31T05:01:22.068 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-31T05:01:22.110 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-31T05:01:22.421 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-31T05:01:22.437 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-31T05:01:22.479 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-31T05:01:22.649 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-31T05:01:22.664 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:01:22.708 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:23.426 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-babel. 2024-01-31T05:01:23.440 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-31T05:01:23.484 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-31T05:01:23.644 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cachetools. 2024-01-31T05:01:23.660 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-31T05:01:23.694 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-31T05:01:23.837 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-jinja2. 2024-01-31T05:01:23.851 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-01-31T05:01:23.895 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-01-31T05:01:23.997 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-31T05:01:24.012 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-31T05:01:24.055 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-31T05:01:24.248 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-31T05:01:24.262 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:01:24.297 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-cephadm (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:24.392 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-31T05:01:24.408 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-31T05:01:24.450 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-31T05:01:24.710 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-31T05:01:24.720 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rsa. 2024-01-31T05:01:24.724 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-31T05:01:24.735 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-31T05:01:24.769 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-31T05:01:24.776 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-31T05:01:25.074 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-google-auth. 2024-01-31T05:01:25.089 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-31T05:01:25.132 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-31T05:01:25.179 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-routes. 2024-01-31T05:01:25.194 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-31T05:01:25.237 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-31T05:01:25.460 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-31T05:01:25.475 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-31T05:01:25.518 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-31T05:01:25.624 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-31T05:01:25.639 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:01:25.690 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-dashboard (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:25.796 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-websocket. 2024-01-31T05:01:25.811 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-31T05:01:25.846 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-31T05:01:26.127 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-31T05:01:26.142 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-31T05:01:26.182 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-31T05:01:26.185 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-31T05:01:26.198 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-31T05:01:26.241 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-31T05:01:26.689 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-joblib. 2024-01-31T05:01:26.704 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-31T05:01:26.746 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-31T05:01:26.904 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-31T05:01:26.919 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:01:26.962 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:27.092 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-31T05:01:27.107 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-31T05:01:27.236 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-31T05:01:27.299 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-31T05:01:27.313 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-31T05:01:27.382 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-31T05:01:27.563 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-sklearn. 2024-01-31T05:01:27.579 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-31T05:01:27.621 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-31T05:01:27.668 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-31T05:01:27.683 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-31T05:01:27.718 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-31T05:01:27.971 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package jq. 2024-01-31T05:01:27.985 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-31T05:01:28.029 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-31T05:01:28.282 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package socat. 2024-01-31T05:01:28.296 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-31T05:01:28.340 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-31T05:01:28.364 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-31T05:01:28.379 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:01:28.422 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:28.660 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package xmlstarlet. 2024-01-31T05:01:28.675 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-31T05:01:28.718 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-31T05:01:29.239 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-test. 2024-01-31T05:01:29.253 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../099-ceph-test_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:29.297 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-test (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:29.792 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-cachetools. 2024-01-31T05:01:29.808 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-31T05:01:29.850 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-31T05:01:30.120 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-31T05:01:30.136 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-31T05:01:30.178 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-31T05:01:30.540 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-31T05:01:30.556 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-31T05:01:30.598 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-31T05:01:30.926 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-rsa. 2024-01-31T05:01:30.942 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-31T05:01:30.984 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-31T05:01:31.277 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-volume. 2024-01-31T05:01:31.279 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-google-auth. 2024-01-31T05:01:31.292 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:01:31.296 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-31T05:01:31.334 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-volume (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:31.337 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-31T05:01:31.649 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-31T05:01:31.665 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-31T05:01:31.707 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-31T05:01:31.714 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-31T05:01:31.731 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:31.772 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephfs-mirror (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:32.027 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-websocket. 2024-01-31T05:01:32.044 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-31T05:01:32.075 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-colorama. 2024-01-31T05:01:32.085 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-31T05:01:32.090 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-31T05:01:32.133 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-31T05:01:32.344 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephfs-shell. 2024-01-31T05:01:32.359 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:01:32.397 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-31T05:01:32.413 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-31T05:01:32.435 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephfs-shell (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:32.446 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-31T05:01:32.696 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephfs-top. 2024-01-31T05:01:32.713 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:01:32.754 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephfs-top (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:33.007 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-31T05:01:33.023 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:33.065 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libcephfs-dev (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:33.144 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-31T05:01:33.159 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:01:33.202 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:33.385 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-31T05:01:33.401 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-31T05:01:33.443 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-31T05:01:33.554 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-31T05:01:33.569 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-31T05:01:33.621 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-31T05:01:33.772 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-31T05:01:33.788 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-31T05:01:33.822 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-31T05:01:34.016 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-31T05:01:34.031 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-31T05:01:34.082 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-31T05:01:34.184 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package nvme-cli. 2024-01-31T05:01:34.200 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-31T05:01:34.242 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-31T05:01:34.402 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package jq. 2024-01-31T05:01:34.418 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-31T05:01:34.460 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-31T05:01:34.639 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package pkg-config. 2024-01-31T05:01:34.654 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-31T05:01:34.697 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-31T05:01:34.755 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package socat. 2024-01-31T05:01:34.770 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-31T05:01:34.821 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-31T05:01:34.984 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-31T05:01:34.999 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-31T05:01:35.042 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-31T05:01:35.157 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package xmlstarlet. 2024-01-31T05:01:35.173 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-31T05:01:35.224 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-31T05:01:35.470 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-31T05:01:35.484 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-31T05:01:35.528 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-31T05:01:35.611 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-test. 2024-01-31T05:01:35.626 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../099-ceph-test_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:35.669 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-test (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:35.789 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pastescript. 2024-01-31T05:01:35.803 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-31T05:01:35.839 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-31T05:01:36.134 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pluggy. 2024-01-31T05:01:36.148 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-31T05:01:36.184 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-31T05:01:36.470 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-psutil. 2024-01-31T05:01:36.484 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-31T05:01:36.528 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-31T05:01:36.831 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-py. 2024-01-31T05:01:36.847 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-31T05:01:36.880 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-31T05:01:37.218 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pygments. 2024-01-31T05:01:37.232 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-31T05:01:37.276 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-31T05:01:37.482 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ceph-volume. 2024-01-31T05:01:37.498 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:01:37.540 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ceph-volume (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:37.730 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-31T05:01:37.744 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-31T05:01:37.788 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-31T05:01:37.886 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-31T05:01:37.902 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:37.944 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking cephfs-mirror (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:38.091 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-toml. 2024-01-31T05:01:38.105 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-31T05:01:38.140 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-31T05:01:38.272 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-colorama. 2024-01-31T05:01:38.288 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-31T05:01:38.330 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-31T05:01:38.410 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pytest. 2024-01-31T05:01:38.425 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-31T05:01:38.468 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-31T05:01:38.574 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package cephfs-shell. 2024-01-31T05:01:38.590 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:01:38.632 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking cephfs-shell (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:38.830 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-simplejson. 2024-01-31T05:01:38.844 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-31T05:01:38.885 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package cephfs-top. 2024-01-31T05:01:38.888 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-31T05:01:38.901 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-885-g661946e7-1jammy_all.deb ... 2024-01-31T05:01:38.943 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking cephfs-top (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:39.158 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-31T05:01:39.162 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-31T05:01:39.172 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-31T05:01:39.179 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:39.216 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-31T05:01:39.245 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libcephfs-dev (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:39.756 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-31T05:01:39.773 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-31T05:01:39.814 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-31T05:01:39.894 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package radosgw. 2024-01-31T05:01:39.909 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../122-radosgw_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:39.952 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking radosgw (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:40.144 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-31T05:01:40.160 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-31T05:01:40.202 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-31T05:01:40.506 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package rbd-fuse. 2024-01-31T05:01:40.521 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:40.555 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking rbd-fuse (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:40.581 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package nvme-cli. 2024-01-31T05:01:40.597 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-31T05:01:40.631 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-31T05:01:40.849 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-31T05:01:41.044 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package pkg-config. 2024-01-31T05:01:41.060 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-31T05:01:41.094 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-31T05:01:41.111 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-31T05:01:41.262 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-31T05:01:41.331 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-31T05:01:41.346 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-31T05:01:41.389 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-31T05:01:41.517 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-31T05:01:41.817 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-31T05:01:41.833 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-31T05:01:41.874 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-31T05:01:41.900 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-31T05:01:42.203 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pastescript. 2024-01-31T05:01:42.219 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-31T05:01:42.261 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-31T05:01:42.474 INFO:teuthology.orchestra.run.smithi195.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-31T05:01:42.520 INFO:teuthology.orchestra.run.smithi195.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-01-31T05:01:42.564 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephadm (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:42.564 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pluggy. 2024-01-31T05:01:42.583 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-31T05:01:42.622 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-31T05:01:42.933 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-psutil. 2024-01-31T05:01:42.949 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-31T05:01:42.991 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-31T05:01:43.103 INFO:teuthology.orchestra.run.smithi195.stdout:Adding system user cephadm....done 2024-01-31T05:01:43.261 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-31T05:01:43.319 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-py. 2024-01-31T05:01:43.336 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-31T05:01:43.377 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-31T05:01:43.529 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-31T05:01:43.723 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pygments. 2024-01-31T05:01:43.739 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-31T05:01:43.780 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-31T05:01:43.814 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-31T05:01:43.940 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-31T05:01:44.207 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-31T05:01:44.218 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-31T05:01:44.234 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-31T05:01:44.276 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-31T05:01:44.587 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-toml. 2024-01-31T05:01:44.603 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-31T05:01:44.645 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-31T05:01:44.675 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-31T05:01:44.785 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-31T05:01:44.948 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-pytest. 2024-01-31T05:01:44.964 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-31T05:01:45.006 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-31T05:01:45.103 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-31T05:01:45.318 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package python3-simplejson. 2024-01-31T05:01:45.334 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-31T05:01:45.368 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-31T05:01:45.463 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-31T05:01:45.629 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-31T05:01:45.645 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-31T05:01:45.687 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-31T05:01:45.723 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-31T05:01:45.966 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-31T05:01:46.242 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-31T05:01:46.382 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package radosgw. 2024-01-31T05:01:46.397 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../122-radosgw_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:46.440 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking radosgw (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:46.510 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-31T05:01:46.811 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-31T05:01:47.010 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package rbd-fuse. 2024-01-31T05:01:47.026 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-885-g661946e7-1jammy_amd64.deb ... 2024-01-31T05:01:47.062 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-31T05:01:47.071 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking rbd-fuse (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:47.322 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-ceph-argparse (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:47.354 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-31T05:01:47.589 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-31T05:01:47.640 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-31T05:01:47.691 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-31T05:01:47.758 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-31T05:01:47.809 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-31T05:01:48.004 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-31T05:01:48.068 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-31T05:01:48.193 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-31T05:01:48.397 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-31T05:01:48.461 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-31T05:01:48.825 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-31T05:01:48.892 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-31T05:01:48.956 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-31T05:01:49.009 INFO:teuthology.orchestra.run.smithi049.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-31T05:01:49.049 INFO:teuthology.orchestra.run.smithi049.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-01-31T05:01:49.082 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-31T05:01:49.102 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up cephadm (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:49.450 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-31T05:01:49.576 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-31T05:01:49.844 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-31T05:01:49.956 INFO:teuthology.orchestra.run.smithi049.stdout:Adding system user cephadm....done 2024-01-31T05:01:50.116 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-31T05:01:50.120 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-31T05:01:50.386 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-31T05:01:50.438 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up zip (3.0-12build2) ... 2024-01-31T05:01:50.564 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-31T05:01:50.671 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-31T05:01:50.797 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-31T05:01:51.065 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-31T05:01:51.283 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-31T05:01:51.358 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-31T05:01:51.484 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-31T05:01:51.583 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-31T05:01:51.710 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-31T05:01:51.811 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-31T05:01:51.819 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-31T05:01:52.120 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-31T05:01:52.196 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-31T05:01:52.513 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-31T05:01:52.572 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-31T05:01:52.806 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-31T05:01:52.840 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-31T05:01:53.182 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-31T05:01:53.216 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-31T05:01:53.468 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-31T05:01:53.483 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-31T05:01:53.735 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-31T05:01:53.801 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-31T05:01:54.029 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-31T05:01:54.178 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-31T05:01:54.296 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-ceph-argparse (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:54.429 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-31T05:01:54.546 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-ceph-common (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:01:54.580 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-31T05:01:54.706 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-31T05:01:54.824 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-31T05:01:54.848 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-idna (3.3-1) ... 2024-01-31T05:01:55.182 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-31T05:01:55.401 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-31T05:01:55.510 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-31T05:01:55.761 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-31T05:01:56.144 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-31T05:01:56.175 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-31T05:01:56.239 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-31T05:01:56.365 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-31T05:01:56.396 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-31T05:01:56.623 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-31T05:01:56.733 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-31T05:01:56.741 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-31T05:01:56.850 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-31T05:01:57.008 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-31T05:01:57.118 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-31T05:01:57.134 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-31T05:01:57.260 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-31T05:01:57.403 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-31T05:01:57.553 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-31T05:01:57.721 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up zip (3.0-12build2) ... 2024-01-31T05:01:57.846 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-31T05:01:57.847 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-31T05:01:58.107 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-31T05:01:58.231 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-31T05:01:58.552 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-31T05:01:58.565 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-31T05:01:58.811 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-31T05:01:58.833 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-31T05:01:58.951 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-31T05:01:59.052 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-31T05:01:59.095 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-31T05:01:59.363 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-31T05:01:59.378 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-31T05:01:59.622 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-31T05:01:59.788 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-31T05:01:59.907 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-31T05:02:00.033 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-31T05:02:00.055 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-31T05:02:00.359 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-31T05:02:00.457 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-31T05:02:00.485 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-31T05:02:00.742 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-31T05:02:00.778 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-31T05:02:01.068 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-31T05:02:01.071 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-31T05:02:01.330 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-31T05:02:01.428 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-31T05:02:01.489 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-31T05:02:01.615 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-31T05:02:01.687 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-31T05:02:01.703 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-31T05:02:01.813 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-ceph-common (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:01.942 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-31T05:02:02.060 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-31T05:02:02.131 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-idna (3.3-1) ... 2024-01-31T05:02:02.437 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-31T05:02:02.474 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-31T05:02:02.713 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-31T05:02:02.838 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-31T05:02:03.098 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-31T05:02:03.199 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-01-31T05:02:03.516 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-31T05:02:03.738 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-31T05:02:03.834 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-31T05:02:03.974 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-31T05:02:04.108 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-31T05:02:04.144 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-31T05:02:04.330 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-31T05:02:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-31T05:02:04.501 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-31T05:02:04.598 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-31T05:02:04.661 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-31T05:02:04.875 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-31T05:02:04.971 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-31T05:02:05.184 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-31T05:02:05.247 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-31T05:02:05.515 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-31T05:02:05.561 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-31T05:02:05.640 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-31T05:02:05.838 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-31T05:02:05.967 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-31T05:02:06.182 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-31T05:02:06.218 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-31T05:02:06.308 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librados2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:06.459 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libsqlite3-mod-ceph (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:06.503 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-31T05:02:06.577 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-31T05:02:06.779 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-31T05:02:06.863 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libcephfs2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:06.989 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libradosstriper1 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:07.046 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-31T05:02:07.115 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-31T05:02:07.322 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-31T05:02:07.399 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librbd1 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:07.432 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-31T05:02:07.534 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-modules-core (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:07.660 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-fuse (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:07.716 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-31T05:02:07.842 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-31T05:02:07.893 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-31T05:02:07.893 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-31T05:02:08.144 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-31T05:02:08.462 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-31T05:02:08.478 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libcephfs-dev (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:08.604 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rados (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:08.722 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librgw2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:08.762 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-31T05:02:08.831 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephfs-top (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:08.888 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-31T05:02:08.955 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-31T05:02:09.014 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-31T05:02:09.087 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-31T05:02:09.341 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-31T05:02:09.450 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-31T05:02:09.844 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-31T05:02:10.120 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-31T05:02:10.244 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rbd (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:10.370 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up rbd-fuse (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:10.488 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-31T05:02:10.496 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rgw (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:10.605 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cephfs (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:10.715 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephfs-shell (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:10.764 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-31T05:02:10.824 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-common (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:10.881 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-01-31T05:02:11.199 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-31T05:02:11.369 INFO:teuthology.orchestra.run.smithi195.stdout:Adding group ceph....done 2024-01-31T05:02:11.492 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-31T05:02:11.768 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-31T05:02:11.770 INFO:teuthology.orchestra.run.smithi195.stdout:Adding system user ceph....done 2024-01-31T05:02:11.955 INFO:teuthology.orchestra.run.smithi195.stdout:Setting system user ceph properties....done 2024-01-31T05:02:11.977 INFO:teuthology.orchestra.run.smithi195.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-31T05:02:11.979 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-31T05:02:12.117 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-31T05:02:12.264 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-31T05:02:12.497 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-31T05:02:12.549 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-31T05:02:12.808 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-31T05:02:13.125 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephfs-mirror (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:13.202 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-31T05:02:13.344 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-31T05:02:13.345 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-31T05:02:13.504 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-31T05:02:13.865 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-31T05:02:13.974 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librados2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:14.001 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-test (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:14.083 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libsqlite3-mod-ceph (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:14.127 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up radosgw (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:14.209 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-31T05:02:14.546 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libcephfs2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:14.651 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-31T05:02:14.652 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-31T05:02:14.672 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libradosstriper1 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:14.798 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-31T05:02:15.108 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librbd1 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:15.217 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-modules-core (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:15.326 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-fuse (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:15.404 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-base (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:15.553 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-31T05:02:15.553 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-31T05:02:15.761 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-31T05:02:16.136 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libcephfs-dev (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:16.262 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rados (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:16.381 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mds (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:16.388 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up librgw2 (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:16.539 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up cephfs-top (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:16.602 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-31T05:02:16.602 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-31T05:02:16.665 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-31T05:02:17.199 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:17.411 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-31T05:02:17.411 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-31T05:02:17.975 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-osd (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:18.011 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rbd (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:18.137 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up rbd-fuse (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:18.263 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-rgw (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:18.295 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-31T05:02:18.295 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-31T05:02:18.389 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up python3-cephfs (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:18.514 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up cephfs-shell (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:18.624 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-common (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:18.902 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-k8sevents (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:19.028 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:19.186 INFO:teuthology.orchestra.run.smithi049.stdout:Adding group ceph....done 2024-01-31T05:02:19.195 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mon (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:19.403 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-31T05:02:19.403 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-31T05:02:19.570 INFO:teuthology.orchestra.run.smithi049.stdout:Adding system user ceph....done 2024-01-31T05:02:19.748 INFO:teuthology.orchestra.run.smithi049.stdout:Setting system user ceph properties....done 2024-01-31T05:02:19.770 INFO:teuthology.orchestra.run.smithi049.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-31T05:02:19.921 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-31T05:02:20.022 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-cephadm (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:20.164 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:20.313 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-31T05:02:20.342 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-dashboard (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:20.526 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-volume (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:20.871 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-31T05:02:20.975 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up cephfs-mirror (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:20.979 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-31T05:02:21.132 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-31T05:02:21.181 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-31T05:02:21.181 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-31T05:02:21.819 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-test (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:21.952 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up radosgw (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:22.257 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-31T05:02:22.488 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-31T05:02:22.488 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-31T05:02:22.888 INFO:teuthology.orchestra.run.smithi195.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-31T05:02:22.893 DEBUG:teuthology.orchestra.run.smithi195:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-31T05:02:22.966 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-01-31T05:02:23.096 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-base (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:23.132 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2024-01-31T05:02:23.133 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2024-01-31T05:02:23.284 INFO:teuthology.orchestra.run.smithi195.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-31T05:02:23.284 INFO:teuthology.orchestra.run.smithi195.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-31T05:02:23.285 INFO:teuthology.orchestra.run.smithi195.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-31T05:02:23.285 INFO:teuthology.orchestra.run.smithi195.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-31T05:02:23.285 INFO:teuthology.orchestra.run.smithi195.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-31T05:02:23.285 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages were automatically installed and are no longer required: 2024-01-31T05:02:23.285 INFO:teuthology.orchestra.run.smithi195.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-31T05:02:23.285 INFO:teuthology.orchestra.run.smithi195.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-31T05:02:23.285 INFO:teuthology.orchestra.run.smithi195.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-31T05:02:23.285 INFO:teuthology.orchestra.run.smithi195.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-31T05:02:23.285 INFO:teuthology.orchestra.run.smithi195.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-31T05:02:23.285 INFO:teuthology.orchestra.run.smithi195.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-31T05:02:23.286 INFO:teuthology.orchestra.run.smithi195.stdout:The following additional packages will be installed: 2024-01-31T05:02:23.286 INFO:teuthology.orchestra.run.smithi195.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-31T05:02:23.286 INFO:teuthology.orchestra.run.smithi195.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-31T05:02:23.286 INFO:teuthology.orchestra.run.smithi195.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-31T05:02:23.286 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-31T05:02:23.286 INFO:teuthology.orchestra.run.smithi195.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-31T05:02:23.287 INFO:teuthology.orchestra.run.smithi195.stdout:Suggested packages: 2024-01-31T05:02:23.287 INFO:teuthology.orchestra.run.smithi195.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-31T05:02:23.287 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-31T05:02:23.287 INFO:teuthology.orchestra.run.smithi195.stdout: libengine-pkcs11-openssl 2024-01-31T05:02:23.335 INFO:teuthology.orchestra.run.smithi195.stdout:The following NEW packages will be installed: 2024-01-31T05:02:23.335 INFO:teuthology.orchestra.run.smithi195.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-31T05:02:23.335 INFO:teuthology.orchestra.run.smithi195.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-31T05:02:23.336 INFO:teuthology.orchestra.run.smithi195.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-31T05:02:23.336 INFO:teuthology.orchestra.run.smithi195.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-31T05:02:23.336 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-31T05:02:23.336 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-31T05:02:23.336 INFO:teuthology.orchestra.run.smithi195.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-31T05:02:23.337 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages will be upgraded: 2024-01-31T05:02:23.337 INFO:teuthology.orchestra.run.smithi195.stdout: libssl3 2024-01-31T05:02:23.461 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-31T05:02:23.553 INFO:teuthology.orchestra.run.smithi195.stdout:1 upgraded, 39 newly installed, 0 to remove and 270 not upgraded. 2024-01-31T05:02:23.554 INFO:teuthology.orchestra.run.smithi195.stdout:Need to get 54.6 MB of archives. 2024-01-31T05:02:23.554 INFO:teuthology.orchestra.run.smithi195.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-31T05:02:23.554 INFO:teuthology.orchestra.run.smithi195.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-31T05:02:24.051 INFO:teuthology.orchestra.run.smithi195.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.13 [1,902 kB] 2024-01-31T05:02:24.131 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mds (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:24.308 INFO:teuthology.orchestra.run.smithi195.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-31T05:02:24.343 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-31T05:02:24.345 INFO:teuthology.orchestra.run.smithi195.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-31T05:02:24.350 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-31T05:02:24.353 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-31T05:02:24.354 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-31T05:02:24.357 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-31T05:02:24.359 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-31T05:02:24.359 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-31T05:02:24.360 INFO:teuthology.orchestra.run.smithi195.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-31T05:02:24.524 INFO:teuthology.orchestra.run.smithi195.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-31T05:02:24.524 INFO:teuthology.orchestra.run.smithi195.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-31T05:02:24.780 INFO:teuthology.orchestra.run.smithi195.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-31T05:02:24.966 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:25.201 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-31T05:02:25.201 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-31T05:02:25.800 INFO:teuthology.orchestra.run.smithi195.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-31T05:02:25.802 INFO:teuthology.orchestra.run.smithi195.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-31T05:02:25.802 INFO:teuthology.orchestra.run.smithi195.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-01-31T05:02:25.805 INFO:teuthology.orchestra.run.smithi195.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-31T05:02:25.805 INFO:teuthology.orchestra.run.smithi195.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-31T05:02:25.810 INFO:teuthology.orchestra.run.smithi195.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-31T05:02:25.811 INFO:teuthology.orchestra.run.smithi195.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-31T05:02:25.835 INFO:teuthology.orchestra.run.smithi195.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-31T05:02:26.001 INFO:teuthology.orchestra.run.smithi195.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.13 [2,374 kB] 2024-01-31T05:02:26.085 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-osd (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:26.671 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-31T05:02:26.671 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-31T05:02:26.750 INFO:teuthology.orchestra.run.smithi195.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-31T05:02:26.751 INFO:teuthology.orchestra.run.smithi195.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-01-31T05:02:26.777 INFO:teuthology.orchestra.run.smithi195.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-31T05:02:26.855 INFO:teuthology.orchestra.run.smithi195.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-31T05:02:26.863 INFO:teuthology.orchestra.run.smithi195.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-31T05:02:26.863 INFO:teuthology.orchestra.run.smithi195.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-31T05:02:26.864 INFO:teuthology.orchestra.run.smithi195.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-31T05:02:26.865 INFO:teuthology.orchestra.run.smithi195.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-31T05:02:26.893 INFO:teuthology.orchestra.run.smithi195.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-31T05:02:26.896 INFO:teuthology.orchestra.run.smithi195.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-31T05:02:27.298 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-k8sevents (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:27.407 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:27.523 INFO:teuthology.orchestra.run.smithi195.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-31T05:02:27.542 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mon (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:27.605 INFO:teuthology.orchestra.run.smithi195.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-31T05:02:27.605 INFO:teuthology.orchestra.run.smithi195.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-31T05:02:27.605 INFO:teuthology.orchestra.run.smithi195.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-31T05:02:27.700 INFO:teuthology.orchestra.run.smithi195.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-31T05:02:27.715 INFO:teuthology.orchestra.run.smithi195.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-31T05:02:27.756 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-31T05:02:27.756 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-31T05:02:28.163 INFO:teuthology.orchestra.run.smithi195.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-31T05:02:28.165 INFO:teuthology.orchestra.run.smithi195.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-31T05:02:28.368 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-cephadm (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:28.511 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:28.545 INFO:teuthology.orchestra.run.smithi195.stdout:Preconfiguring packages ... 2024-01-31T05:02:28.637 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-mgr-dashboard (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:28.689 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 54.6 MB in 5s (11.3 MB/s) 2024-01-31T05:02:28.779 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ceph-volume (19.0.0-885-g661946e7-1jammy) ... 2024-01-31T05:02:28.798 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package flex. 2024-01-31T05:02:28.869 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140578 files and directories currently installed.) 2024-01-31T05:02:28.873 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-31T05:02:28.914 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-31T05:02:29.140 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-31T05:02:29.233 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-31T05:02:29.385 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-31T05:02:29.425 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.13_amd64.deb ... 2024-01-31T05:02:29.570 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.13) over (3.0.2-0ubuntu1.7) ... 2024-01-31T05:02:29.952 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.13) ... 2024-01-31T05:02:30.495 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package bison. 2024-01-31T05:02:30.544 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-31T05:02:30.564 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140651 files and directories currently installed.) 2024-01-31T05:02:30.568 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-31T05:02:30.606 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-31T05:02:31.108 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-31T05:02:31.122 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-31T05:02:31.175 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-31T05:02:31.283 INFO:teuthology.orchestra.run.smithi049.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-31T05:02:31.287 DEBUG:teuthology.orchestra.run.smithi049:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-31T05:02:31.363 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2024-01-31T05:02:31.463 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package dump. 2024-01-31T05:02:31.475 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-31T05:02:31.519 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking dump (0.4b47-3) ... 2024-01-31T05:02:31.533 INFO:teuthology.orchestra.run.smithi049.stdout:Building dependency tree... 2024-01-31T05:02:31.534 INFO:teuthology.orchestra.run.smithi049.stdout:Reading state information... 2024-01-31T05:02:31.690 INFO:teuthology.orchestra.run.smithi049.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-31T05:02:31.691 INFO:teuthology.orchestra.run.smithi049.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-31T05:02:31.691 INFO:teuthology.orchestra.run.smithi049.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-31T05:02:31.691 INFO:teuthology.orchestra.run.smithi049.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-31T05:02:31.691 INFO:teuthology.orchestra.run.smithi049.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-31T05:02:31.691 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages were automatically installed and are no longer required: 2024-01-31T05:02:31.691 INFO:teuthology.orchestra.run.smithi049.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-31T05:02:31.691 INFO:teuthology.orchestra.run.smithi049.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-31T05:02:31.691 INFO:teuthology.orchestra.run.smithi049.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-31T05:02:31.692 INFO:teuthology.orchestra.run.smithi049.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-31T05:02:31.692 INFO:teuthology.orchestra.run.smithi049.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-31T05:02:31.692 INFO:teuthology.orchestra.run.smithi049.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-31T05:02:31.692 INFO:teuthology.orchestra.run.smithi049.stdout:The following additional packages will be installed: 2024-01-31T05:02:31.692 INFO:teuthology.orchestra.run.smithi049.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-31T05:02:31.692 INFO:teuthology.orchestra.run.smithi049.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-31T05:02:31.693 INFO:teuthology.orchestra.run.smithi049.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-31T05:02:31.693 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-31T05:02:31.693 INFO:teuthology.orchestra.run.smithi049.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-31T05:02:31.694 INFO:teuthology.orchestra.run.smithi049.stdout:Suggested packages: 2024-01-31T05:02:31.694 INFO:teuthology.orchestra.run.smithi049.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-31T05:02:31.694 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-31T05:02:31.694 INFO:teuthology.orchestra.run.smithi049.stdout: libengine-pkcs11-openssl 2024-01-31T05:02:31.743 INFO:teuthology.orchestra.run.smithi049.stdout:The following NEW packages will be installed: 2024-01-31T05:02:31.743 INFO:teuthology.orchestra.run.smithi049.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-31T05:02:31.743 INFO:teuthology.orchestra.run.smithi049.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-31T05:02:31.744 INFO:teuthology.orchestra.run.smithi049.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-31T05:02:31.744 INFO:teuthology.orchestra.run.smithi049.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-31T05:02:31.744 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-31T05:02:31.744 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-31T05:02:31.744 INFO:teuthology.orchestra.run.smithi049.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-31T05:02:31.745 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages will be upgraded: 2024-01-31T05:02:31.745 INFO:teuthology.orchestra.run.smithi049.stdout: libssl3 2024-01-31T05:02:31.847 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package indent. 2024-01-31T05:02:31.862 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-31T05:02:31.898 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-31T05:02:31.930 INFO:teuthology.orchestra.run.smithi049.stdout:1 upgraded, 39 newly installed, 0 to remove and 270 not upgraded. 2024-01-31T05:02:31.931 INFO:teuthology.orchestra.run.smithi049.stdout:Need to get 54.6 MB of archives. 2024-01-31T05:02:31.931 INFO:teuthology.orchestra.run.smithi049.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-31T05:02:31.931 INFO:teuthology.orchestra.run.smithi049.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-31T05:02:32.150 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-31T05:02:32.164 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-31T05:02:32.208 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-31T05:02:32.425 INFO:teuthology.orchestra.run.smithi049.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.13 [1,902 kB] 2024-01-31T05:02:32.537 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-31T05:02:32.552 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-31T05:02:32.595 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-31T05:02:32.683 INFO:teuthology.orchestra.run.smithi049.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-31T05:02:32.717 INFO:teuthology.orchestra.run.smithi049.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-31T05:02:32.719 INFO:teuthology.orchestra.run.smithi049.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-31T05:02:32.724 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-31T05:02:32.728 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-31T05:02:32.728 INFO:teuthology.orchestra.run.smithi049.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-31T05:02:32.731 INFO:teuthology.orchestra.run.smithi049.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-31T05:02:32.734 INFO:teuthology.orchestra.run.smithi049.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-31T05:02:32.734 INFO:teuthology.orchestra.run.smithi049.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-31T05:02:32.814 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-31T05:02:32.829 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-31T05:02:32.864 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-31T05:02:32.898 INFO:teuthology.orchestra.run.smithi049.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-31T05:02:33.209 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-31T05:02:33.225 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-31T05:02:33.234 INFO:teuthology.orchestra.run.smithi049.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-31T05:02:33.326 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-31T05:02:33.562 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-31T05:02:33.578 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-31T05:02:33.620 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-31T05:02:33.873 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libjson-perl. 2024-01-31T05:02:33.889 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-31T05:02:33.930 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-31T05:02:34.234 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-31T05:02:34.250 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-31T05:02:34.273 INFO:teuthology.orchestra.run.smithi049.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-31T05:02:34.284 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-31T05:02:34.298 INFO:teuthology.orchestra.run.smithi049.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-31T05:02:34.298 INFO:teuthology.orchestra.run.smithi049.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-01-31T05:02:34.301 INFO:teuthology.orchestra.run.smithi049.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-31T05:02:34.301 INFO:teuthology.orchestra.run.smithi049.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-31T05:02:34.306 INFO:teuthology.orchestra.run.smithi049.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-31T05:02:34.307 INFO:teuthology.orchestra.run.smithi049.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-31T05:02:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-31T05:02:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.13 [2,374 kB] 2024-01-31T05:02:34.555 INFO:teuthology.orchestra.run.smithi049.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-31T05:02:34.637 INFO:teuthology.orchestra.run.smithi049.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-01-31T05:02:35.116 INFO:teuthology.orchestra.run.smithi049.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-31T05:02:35.244 INFO:teuthology.orchestra.run.smithi049.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-31T05:02:35.256 INFO:teuthology.orchestra.run.smithi049.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-31T05:02:35.257 INFO:teuthology.orchestra.run.smithi049.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-31T05:02:35.258 INFO:teuthology.orchestra.run.smithi049.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-31T05:02:35.259 INFO:teuthology.orchestra.run.smithi049.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-31T05:02:35.292 INFO:teuthology.orchestra.run.smithi049.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-31T05:02:35.296 INFO:teuthology.orchestra.run.smithi049.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-31T05:02:35.645 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-31T05:02:35.661 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-31T05:02:35.703 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-31T05:02:35.762 INFO:teuthology.orchestra.run.smithi049.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-31T05:02:35.926 INFO:teuthology.orchestra.run.smithi049.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-31T05:02:36.008 INFO:teuthology.orchestra.run.smithi049.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-31T05:02:36.008 INFO:teuthology.orchestra.run.smithi049.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-31T05:02:36.032 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-31T05:02:36.048 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-31T05:02:36.090 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-31T05:02:36.092 INFO:teuthology.orchestra.run.smithi049.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-31T05:02:36.099 INFO:teuthology.orchestra.run.smithi049.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-31T05:02:36.368 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-31T05:02:36.384 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-31T05:02:36.426 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-31T05:02:36.566 INFO:teuthology.orchestra.run.smithi049.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-31T05:02:36.568 INFO:teuthology.orchestra.run.smithi049.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-31T05:02:36.796 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-31T05:02:36.812 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-31T05:02:36.854 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-31T05:02:36.970 INFO:teuthology.orchestra.run.smithi049.stdout:Preconfiguring packages ... 2024-01-31T05:02:37.120 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 54.6 MB in 5s (11.3 MB/s) 2024-01-31T05:02:37.165 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-31T05:02:37.181 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-31T05:02:37.223 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-31T05:02:37.245 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package flex. 2024-01-31T05:02:37.316 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140578 files and directories currently installed.) 2024-01-31T05:02:37.320 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-31T05:02:37.360 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-31T05:02:37.543 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-31T05:02:37.559 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-31T05:02:37.593 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-31T05:02:37.912 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-31T05:02:37.922 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.13_amd64.deb ... 2024-01-31T05:02:37.928 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-31T05:02:37.971 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-31T05:02:38.091 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.13) over (3.0.2-0ubuntu1.7) ... 2024-01-31T05:02:38.273 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-31T05:02:38.289 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-31T05:02:38.331 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-31T05:02:38.449 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.13) ... 2024-01-31T05:02:38.576 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-31T05:02:38.591 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.13_amd64.deb ... 2024-01-31T05:02:38.651 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.13) ... 2024-01-31T05:02:39.009 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package bison. 2024-01-31T05:02:39.082 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140651 files and directories currently installed.) 2024-01-31T05:02:39.085 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-31T05:02:39.136 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-31T05:02:39.171 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-31T05:02:39.186 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-31T05:02:39.220 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-31T05:02:39.520 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-31T05:02:39.535 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-31T05:02:39.578 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-31T05:02:39.582 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package modemmanager. 2024-01-31T05:02:39.598 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-31T05:02:39.640 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-31T05:02:39.882 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package dump. 2024-01-31T05:02:39.897 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-31T05:02:39.932 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking dump (0.4b47-3) ... 2024-01-31T05:02:40.177 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package indent. 2024-01-31T05:02:40.192 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-31T05:02:40.221 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package network-manager. 2024-01-31T05:02:40.237 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-31T05:02:40.260 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-31T05:02:40.287 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-31T05:02:40.513 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-31T05:02:40.528 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-31T05:02:40.571 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-31T05:02:40.900 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-31T05:02:40.916 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-31T05:02:40.919 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ppp. 2024-01-31T05:02:40.937 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-31T05:02:40.958 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-31T05:02:41.228 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-31T05:02:41.244 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-31T05:02:41.285 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-31T05:02:41.409 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-31T05:02:41.597 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-31T05:02:41.614 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-31T05:02:41.655 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-31T05:02:41.726 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package pptp-linux. 2024-01-31T05:02:41.761 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-31T05:02:41.809 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-31T05:02:41.908 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-31T05:02:41.924 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-31T05:02:41.966 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-31T05:02:42.062 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-31T05:02:42.076 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-31T05:02:42.120 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-31T05:02:42.253 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libjson-perl. 2024-01-31T05:02:42.269 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-31T05:02:42.311 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-31T05:02:42.423 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-31T05:02:42.438 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-31T05:02:42.481 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-client-common (238) ... 2024-01-31T05:02:42.639 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-31T05:02:42.655 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-31T05:02:42.697 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-31T05:02:42.735 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-31T05:02:42.750 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-31T05:02:42.785 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-31T05:02:43.398 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-common. 2024-01-31T05:02:43.413 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-31T05:02:43.474 INFO:teuthology.orchestra.run.smithi195.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-31T05:02:43.505 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-common (238) ... 2024-01-31T05:02:43.972 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-14. 2024-01-31T05:02:43.986 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-31T05:02:44.008 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-31T05:02:44.024 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-31T05:02:44.032 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-31T05:02:44.066 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-31T05:02:44.352 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-31T05:02:44.369 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-31T05:02:44.410 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-31T05:02:44.738 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-31T05:02:44.755 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-31T05:02:44.796 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-31T05:02:45.082 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-31T05:02:45.099 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-31T05:02:45.132 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-31T05:02:45.175 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql. 2024-01-31T05:02:45.189 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-31T05:02:45.233 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql (14+238) ... 2024-01-31T05:02:45.452 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-client. 2024-01-31T05:02:45.452 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-31T05:02:45.467 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-31T05:02:45.469 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-31T05:02:45.502 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-client (14+238) ... 2024-01-31T05:02:45.510 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-31T05:02:45.754 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-31T05:02:45.768 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-31T05:02:45.812 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-31T05:02:45.871 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-31T05:02:45.887 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-31T05:02:45.929 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-31T05:02:46.249 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-31T05:02:46.265 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-31T05:02:46.324 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-31T05:02:46.513 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package tcl8.6. 2024-01-31T05:02:46.528 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-31T05:02:46.573 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-31T05:02:46.612 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-31T05:02:46.628 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-31T05:02:46.670 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-31T05:02:46.875 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package tcl. 2024-01-31T05:02:46.891 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-31T05:02:46.931 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-31T05:02:46.946 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-31T05:02:46.947 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.13_amd64.deb ... 2024-01-31T05:02:46.989 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.13) ... 2024-01-31T05:02:47.237 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package wpasupplicant. 2024-01-31T05:02:47.253 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-31T05:02:47.295 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-31T05:02:47.468 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-31T05:02:47.483 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-31T05:02:47.525 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-31T05:02:47.649 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-31T05:02:47.664 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-31T05:02:47.708 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-31T05:02:47.879 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package modemmanager. 2024-01-31T05:02:47.894 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-31T05:02:47.937 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-31T05:02:48.061 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-31T05:02:48.076 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-31T05:02:48.144 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-31T05:02:48.396 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-client-common (238) ... 2024-01-31T05:02:48.608 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-31T05:02:48.626 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package network-manager. 2024-01-31T05:02:48.642 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-31T05:02:48.685 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-31T05:02:48.736 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-31T05:02:48.846 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-31T05:02:48.947 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-31T05:02:49.073 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-31T05:02:49.198 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-31T05:02:49.284 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ppp. 2024-01-31T05:02:49.300 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-31T05:02:49.651 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-31T05:02:49.997 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package pptp-linux. 2024-01-31T05:02:50.012 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-31T05:02:50.055 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-31T05:02:50.168 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-31T05:02:50.263 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-31T05:02:50.308 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-31T05:02:50.322 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-31T05:02:50.366 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-31T05:02:50.631 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-31T05:02:50.631 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-31T05:02:50.652 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-31T05:02:50.667 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-31T05:02:50.710 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql-client-common (238) ... 2024-01-31T05:02:51.015 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-31T05:02:51.029 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-31T05:02:51.073 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-31T05:02:51.332 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-31T05:02:51.467 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.13) ... 2024-01-31T05:02:51.592 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-31T05:02:51.694 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql-common. 2024-01-31T05:02:51.709 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-31T05:02:51.718 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-31T05:02:51.770 INFO:teuthology.orchestra.run.smithi049.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-31T05:02:51.801 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql-common (238) ... 2024-01-31T05:02:51.845 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-31T05:02:51.987 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-31T05:02:52.089 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-31T05:02:52.293 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql-14. 2024-01-31T05:02:52.308 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-31T05:02:52.354 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-31T05:02:52.844 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-31T05:02:52.970 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up dump (0.4b47-3) ... 2024-01-31T05:02:53.056 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-31T05:02:53.113 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-31T05:02:53.256 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-31T05:02:53.382 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-31T05:02:53.414 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql. 2024-01-31T05:02:53.429 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-31T05:02:53.497 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql (14+238) ... 2024-01-31T05:02:53.508 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-31T05:02:53.633 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-31T05:02:53.723 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-31T05:02:53.749 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql-client. 2024-01-31T05:02:53.764 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-31T05:02:53.793 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-31T05:02:53.807 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql-client (14+238) ... 2024-01-31T05:02:53.920 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-31T05:02:54.051 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-31T05:02:54.066 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-31T05:02:54.079 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-31T05:02:54.109 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-31T05:02:54.180 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-31T05:02:54.289 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-31T05:02:54.370 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package tcl8.6. 2024-01-31T05:02:54.386 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-31T05:02:54.428 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-31T05:02:54.482 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-client (14+238) ... 2024-01-31T05:02:54.608 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-31T05:02:54.698 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package tcl. 2024-01-31T05:02:54.714 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-31T05:02:54.761 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-31T05:02:55.101 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package wpasupplicant. 2024-01-31T05:02:55.117 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-31T05:02:55.159 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-31T05:02:55.160 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:02:55.161 INFO:teuthology.orchestra.run.smithi195.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-31T05:02:55.161 INFO:teuthology.orchestra.run.smithi195.stdout:which means they are currently configured by ifupdown: 2024-01-31T05:02:55.161 INFO:teuthology.orchestra.run.smithi195.stdout:- enp3s0f1 2024-01-31T05:02:55.161 INFO:teuthology.orchestra.run.smithi195.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-31T05:02:55.161 INFO:teuthology.orchestra.run.smithi195.stdout:remove their configuration from /etc/network/interfaces. 2024-01-31T05:02:55.161 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:02:55.292 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-31T05:02:55.505 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-31T05:02:55.521 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-31T05:02:55.563 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-31T05:02:55.670 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-31T05:02:55.891 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-31T05:02:55.908 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-31T05:02:55.958 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-31T05:02:56.065 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-31T05:02:56.252 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql-client-common (238) ... 2024-01-31T05:02:56.464 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-31T05:02:56.590 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-31T05:02:56.716 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-31T05:02:56.834 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-31T05:02:56.935 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-31T05:02:56.953 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-31T05:02:57.061 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-31T05:02:57.080 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-31T05:02:57.197 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-31T05:02:57.314 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-common (238) ... 2024-01-31T05:02:58.030 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-31T05:02:58.265 INFO:teuthology.orchestra.run.smithi195.stdout:Adding user postgres to group ssl-cert 2024-01-31T05:02:58.266 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-31T05:02:58.545 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:02:58.545 INFO:teuthology.orchestra.run.smithi195.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-31T05:02:58.634 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-31T05:02:58.634 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-31T05:02:58.785 INFO:teuthology.orchestra.run.smithi195.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-31T05:02:58.785 INFO:teuthology.orchestra.run.smithi195.stdout:Removing obsolete dictionary files: 2024-01-31T05:02:59.303 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-31T05:02:59.429 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.13) ... 2024-01-31T05:02:59.451 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-31T05:02:59.555 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-31T05:02:59.681 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-31T05:02:59.807 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-31T05:02:59.925 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-31T05:03:00.042 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-31T05:03:00.049 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-31T05:03:00.396 INFO:teuthology.orchestra.run.smithi195.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-31T05:03:00.414 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-31T05:03:00.467 INFO:teuthology.orchestra.run.smithi195.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-31T05:03:00.467 INFO:teuthology.orchestra.run.smithi195.stdout:This user must also own the server process. 2024-01-31T05:03:00.467 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:00.467 INFO:teuthology.orchestra.run.smithi195.stdout:The database cluster will be initialized with locale "en_US". 2024-01-31T05:03:00.467 INFO:teuthology.orchestra.run.smithi195.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-31T05:03:00.468 INFO:teuthology.orchestra.run.smithi195.stdout:The default text search configuration will be set to "english". 2024-01-31T05:03:00.468 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:00.468 INFO:teuthology.orchestra.run.smithi195.stdout:Data page checksums are disabled. 2024-01-31T05:03:00.468 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:00.468 INFO:teuthology.orchestra.run.smithi195.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-31T05:03:00.468 INFO:teuthology.orchestra.run.smithi195.stdout:creating subdirectories ... ok 2024-01-31T05:03:00.468 INFO:teuthology.orchestra.run.smithi195.stdout:selecting dynamic shared memory implementation ... posix 2024-01-31T05:03:00.492 INFO:teuthology.orchestra.run.smithi195.stdout:selecting default max_connections ... 100 2024-01-31T05:03:00.525 INFO:teuthology.orchestra.run.smithi195.stdout:selecting default shared_buffers ... 128MB 2024-01-31T05:03:00.539 INFO:teuthology.orchestra.run.smithi195.stdout:selecting default time zone ... Etc/UTC 2024-01-31T05:03:00.540 INFO:teuthology.orchestra.run.smithi195.stdout:creating configuration files ... ok 2024-01-31T05:03:00.698 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-31T05:03:00.704 INFO:teuthology.orchestra.run.smithi195.stdout:running bootstrap script ... ok 2024-01-31T05:03:00.824 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up dump (0.4b47-3) ... 2024-01-31T05:03:00.919 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-31T05:03:00.975 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-31T05:03:01.077 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-31T05:03:01.203 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-31T05:03:01.329 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-31T05:03:01.334 INFO:teuthology.orchestra.run.smithi195.stdout:performing post-bootstrap initialization ... ok 2024-01-31T05:03:01.480 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-31T05:03:01.570 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-31T05:03:01.631 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-31T05:03:01.757 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-31T05:03:01.917 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-31T05:03:01.956 INFO:teuthology.orchestra.run.smithi195.stdout:syncing data to disk ... ok 2024-01-31T05:03:02.026 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-31T05:03:02.144 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-31T05:03:02.313 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql-client (14+238) ... 2024-01-31T05:03:02.438 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-31T05:03:02.439 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-31T05:03:03.019 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:03.019 INFO:teuthology.orchestra.run.smithi049.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-31T05:03:03.019 INFO:teuthology.orchestra.run.smithi049.stdout:which means they are currently configured by ifupdown: 2024-01-31T05:03:03.019 INFO:teuthology.orchestra.run.smithi049.stdout:- ens1f0 2024-01-31T05:03:03.019 INFO:teuthology.orchestra.run.smithi049.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-31T05:03:03.019 INFO:teuthology.orchestra.run.smithi049.stdout:remove their configuration from /etc/network/interfaces. 2024-01-31T05:03:03.019 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:03.157 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-31T05:03:03.567 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-31T05:03:03.956 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-31T05:03:04.658 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-31T05:03:04.801 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-31T05:03:04.927 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-31T05:03:05.053 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql-common (238) ... 2024-01-31T05:03:05.482 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-31T05:03:05.608 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-31T05:03:05.767 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql (14+238) ... 2024-01-31T05:03:05.893 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-31T05:03:05.953 INFO:teuthology.orchestra.run.smithi049.stdout:Adding user postgres to group ssl-cert 2024-01-31T05:03:06.027 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-31T05:03:06.204 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:06.204 INFO:teuthology.orchestra.run.smithi049.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-31T05:03:06.287 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-31T05:03:06.287 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-31T05:03:06.474 INFO:teuthology.orchestra.run.smithi049.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-31T05:03:06.474 INFO:teuthology.orchestra.run.smithi049.stdout:Removing obsolete dictionary files: 2024-01-31T05:03:07.013 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-31T05:03:07.193 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-31T05:03:07.332 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-31T05:03:07.508 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-31T05:03:07.629 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-31T05:03:07.974 INFO:teuthology.orchestra.run.smithi049.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-31T05:03:07.991 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-31T05:03:08.036 INFO:teuthology.orchestra.run.smithi049.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-31T05:03:08.037 INFO:teuthology.orchestra.run.smithi049.stdout:This user must also own the server process. 2024-01-31T05:03:08.037 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:08.037 INFO:teuthology.orchestra.run.smithi049.stdout:The database cluster will be initialized with locale "en_US". 2024-01-31T05:03:08.037 INFO:teuthology.orchestra.run.smithi049.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-31T05:03:08.037 INFO:teuthology.orchestra.run.smithi049.stdout:The default text search configuration will be set to "english". 2024-01-31T05:03:08.037 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:08.037 INFO:teuthology.orchestra.run.smithi049.stdout:Data page checksums are disabled. 2024-01-31T05:03:08.037 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:08.037 INFO:teuthology.orchestra.run.smithi049.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-31T05:03:08.038 INFO:teuthology.orchestra.run.smithi049.stdout:creating subdirectories ... ok 2024-01-31T05:03:08.038 INFO:teuthology.orchestra.run.smithi049.stdout:selecting dynamic shared memory implementation ... posix 2024-01-31T05:03:08.062 INFO:teuthology.orchestra.run.smithi049.stdout:selecting default max_connections ... 100 2024-01-31T05:03:08.096 INFO:teuthology.orchestra.run.smithi049.stdout:selecting default shared_buffers ... 128MB 2024-01-31T05:03:08.111 INFO:teuthology.orchestra.run.smithi049.stdout:selecting default time zone ... Etc/UTC 2024-01-31T05:03:08.112 INFO:teuthology.orchestra.run.smithi049.stdout:creating configuration files ... ok 2024-01-31T05:03:08.287 INFO:teuthology.orchestra.run.smithi049.stdout:running bootstrap script ... ok 2024-01-31T05:03:08.903 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-31T05:03:08.915 INFO:teuthology.orchestra.run.smithi049.stdout:performing post-bootstrap initialization ... ok 2024-01-31T05:03:09.012 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-31T05:03:09.425 INFO:teuthology.orchestra.run.smithi049.stdout:syncing data to disk ... ok 2024-01-31T05:03:09.529 INFO:teuthology.orchestra.run.smithi195.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-31T05:03:09.537 DEBUG:teuthology.parallel:result is None 2024-01-31T05:03:09.950 INFO:teuthology.orchestra.run.smithi049.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-31T05:03:12.928 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-31T05:03:13.063 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-31T05:03:13.180 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up postgresql (14+238) ... 2024-01-31T05:03:13.306 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-31T05:03:13.433 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-31T05:03:13.700 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-31T05:03:13.700 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-31T05:03:14.418 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-31T05:03:14.753 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-31T05:03:14.913 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-31T05:03:16.350 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-31T05:03:16.450 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-31T05:03:16.993 INFO:teuthology.orchestra.run.smithi049.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-31T05:03:17.000 DEBUG:teuthology.parallel:result is None 2024-01-31T05:03:17.001 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-31T05:03:17.142 DEBUG:teuthology.orchestra.run.smithi049:> dpkg-query -W -f '${Version}' ceph 2024-01-31T05:03:17.165 INFO:teuthology.orchestra.run.smithi049.stdout:19.0.0-885-g661946e7-1jammy 2024-01-31T05:03:17.165 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-885-g661946e7-1jammy 2024-01-31T05:03:17.165 INFO:teuthology.task.install:The correct ceph version 19.0.0-885-g661946e7-1jammy is installed. 2024-01-31T05:03:17.167 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-31T05:03:17.311 DEBUG:teuthology.orchestra.run.smithi195:> dpkg-query -W -f '${Version}' ceph 2024-01-31T05:03:17.335 INFO:teuthology.orchestra.run.smithi195.stdout:19.0.0-885-g661946e7-1jammy 2024-01-31T05:03:17.335 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-885-g661946e7-1jammy 2024-01-31T05:03:17.335 INFO:teuthology.task.install:The correct ceph version 19.0.0-885-g661946e7-1jammy is installed. 2024-01-31T05:03:17.336 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-31T05:03:17.337 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:17.337 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-31T05:03:17.357 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:17.357 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-31T05:03:17.399 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-31T05:03:17.399 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:17.399 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/daemon-helper 2024-01-31T05:03:17.420 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-31T05:03:17.479 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:17.479 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2024-01-31T05:03:17.499 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-31T05:03:17.565 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-31T05:03:17.565 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:17.565 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-31T05:03:17.584 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-31T05:03:17.651 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:17.651 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-31T05:03:17.671 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-31T05:03:17.737 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-31T05:03:17.737 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:17.737 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/stdin-killer 2024-01-31T05:03:17.757 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-31T05:03:17.823 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:17.823 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2024-01-31T05:03:17.843 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-31T05:03:17.910 INFO:teuthology.run_tasks:Running task ceph... 2024-01-31T05:03:17.991 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-31T05:03:17.991 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 777 /var/log/ceph 2024-01-31T05:03:17.995 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /var/log/ceph 2024-01-31T05:03:18.015 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-31T05:03:18.015 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-31T05:03:18.055 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-31T05:03:18.077 INFO:tasks.ceph:Creating extra log directories... 2024-01-31T05:03:18.077 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-31T05:03:18.115 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-31T05:03:18.148 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-31T05:03:18.148 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-31T05:03:18.148 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-31T05:03:18.148 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:18.148 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-31T05:03:18.188 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-31T05:03:18.275 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:18.275 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-31T05:03:18.284 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-31T05:03:18.381 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-31T05:03:18.381 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-31T05:03:18.381 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539483', 'branch': 'wip-vshankar-testing-20240125.044502', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7539483', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'cd42140e628558a450ba1d39a9d0835a2fa62cda'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240125.044502'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '661946e7044723130c03627323f6a879a9848cb5'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '661946e7044723130c03627323f6a879a9848cb5'}}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240125.044502', 'sha1': '661946e7044723130c03627323f6a879a9848cb5'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9619, 'sha1': '661946e7044723130c03627323f6a879a9848cb5', 'sleep_before_teardown': 0, 'subset': '293/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240125.044502', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '661946e7044723130c03627323f6a879a9848cb5', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi049.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPFxmT4wC/zThucb9khkDkUHR3lKlMB/awM8/KXblCtL1201ldkv8uxM3iAzdMJb468Vp9CPethCr0crd0/SJPw=', 'smithi195.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEupds0LOIiCuVGxS99rzAnFhSRtCQ38YtaVzvSc9IwsznDlXx+gUEfrFIkgXUYMscxQ8OtkQpuwPo7TKEtACqw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'cd42140e628558a450ba1d39a9d0835a2fa62cda'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '661946e7044723130c03627323f6a879a9848cb5'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '661946e7044723130c03627323f6a879a9848cb5', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'd9fdb2209e15b39d9f061fd85399f352ce0f0894', 'timestamp': '2024-01-31_04:15:12', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-31T05:03:18.382 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-31T05:03:18.385 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-31T05:03:18.394 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/run/ceph 2024-01-31T05:03:18.435 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/run/ceph 2024-01-31T05:03:18.458 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:18.458 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/scratch_devs of=/dev/stdout 2024-01-31T05:03:18.505 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-31T05:03:18.505 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_1 2024-01-31T05:03:18.557 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-31T05:03:18.557 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:18.557 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 884 Links: 1 2024-01-31T05:03:18.557 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:18.557 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-01-31 04:56:50.703175640 +0000 2024-01-31T05:03:18.558 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-01-31 04:56:50.439177994 +0000 2024-01-31T05:03:18.558 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-01-31 04:56:50.439177994 +0000 2024-01-31T05:03:18.558 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-01-31 04:56:50.439177994 +0000 2024-01-31T05:03:18.558 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-31T05:03:18.618 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-31T05:03:18.618 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-31T05:03:18.618 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000236492 s, 2.2 MB/s 2024-01-31T05:03:18.620 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-31T05:03:18.670 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_2 2024-01-31T05:03:18.721 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-31T05:03:18.721 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:18.721 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 901 Links: 1 2024-01-31T05:03:18.721 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:18.721 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-01-31 04:56:51.215171076 +0000 2024-01-31T05:03:18.721 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-01-31 04:56:50.947173466 +0000 2024-01-31T05:03:18.721 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-01-31 04:56:50.947173466 +0000 2024-01-31T05:03:18.721 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-01-31 04:56:50.947173466 +0000 2024-01-31T05:03:18.722 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-31T05:03:18.781 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-31T05:03:18.782 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-31T05:03:18.782 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000236432 s, 2.2 MB/s 2024-01-31T05:03:18.783 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-31T05:03:18.834 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_3 2024-01-31T05:03:18.885 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-31T05:03:18.885 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:18.885 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 918 Links: 1 2024-01-31T05:03:18.885 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:18.885 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-01-31 04:56:51.467168830 +0000 2024-01-31T05:03:18.885 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-01-31 04:56:51.463168865 +0000 2024-01-31T05:03:18.886 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-01-31 04:56:51.463168865 +0000 2024-01-31T05:03:18.886 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-01-31 04:56:51.463168865 +0000 2024-01-31T05:03:18.886 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-31T05:03:18.946 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-31T05:03:18.946 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-31T05:03:18.946 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000235093 s, 2.2 MB/s 2024-01-31T05:03:18.948 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-31T05:03:19.002 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_4 2024-01-31T05:03:19.053 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-31T05:03:19.053 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:19.053 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 932 Links: 1 2024-01-31T05:03:19.053 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:19.053 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-01-31 04:56:52.243161912 +0000 2024-01-31T05:03:19.053 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-01-31 04:56:51.967164372 +0000 2024-01-31T05:03:19.053 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-01-31 04:56:51.967164372 +0000 2024-01-31T05:03:19.053 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-01-31 04:56:51.967164372 +0000 2024-01-31T05:03:19.053 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-31T05:03:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-01-31T05:03:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-01-31T05:03:19.114 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000245098 s, 2.1 MB/s 2024-01-31T05:03:19.116 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-31T05:03:19.171 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-31T05:03:19.172 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:19.172 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2024-01-31T05:03:19.181 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-31T05:03:19.181 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2024-01-31T05:03:19.230 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-31T05:03:19.230 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:19.230 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-01-31T05:03:19.230 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:19.230 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-01-31 04:56:48.149940279 +0000 2024-01-31T05:03:19.230 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-01-31 04:56:48.145940316 +0000 2024-01-31T05:03:19.230 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-01-31 04:56:48.145940316 +0000 2024-01-31T05:03:19.230 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-01-31 04:56:48.145940316 +0000 2024-01-31T05:03:19.231 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-31T05:03:19.291 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-01-31T05:03:19.291 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-01-31T05:03:19.292 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000280254 s, 1.8 MB/s 2024-01-31T05:03:19.294 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-31T05:03:19.348 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2024-01-31T05:03:19.397 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-31T05:03:19.397 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:19.397 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-01-31T05:03:19.397 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:19.397 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-01-31 04:56:48.929933315 +0000 2024-01-31T05:03:19.397 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-01-31 04:56:48.665935674 +0000 2024-01-31T05:03:19.397 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-01-31 04:56:48.665935674 +0000 2024-01-31T05:03:19.398 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-01-31 04:56:48.665935674 +0000 2024-01-31T05:03:19.398 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-31T05:03:19.459 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-01-31T05:03:19.459 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-01-31T05:03:19.459 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000237552 s, 2.2 MB/s 2024-01-31T05:03:19.461 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-31T05:03:19.511 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2024-01-31T05:03:19.561 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-31T05:03:19.561 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:19.561 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 919 Links: 1 2024-01-31T05:03:19.562 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:19.562 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-01-31 04:56:49.417928955 +0000 2024-01-31T05:03:19.562 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-01-31 04:56:49.165931207 +0000 2024-01-31T05:03:19.562 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-01-31 04:56:49.165931207 +0000 2024-01-31T05:03:19.562 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-01-31 04:56:49.165931207 +0000 2024-01-31T05:03:19.562 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-31T05:03:19.623 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-01-31T05:03:19.623 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-01-31T05:03:19.623 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000251767 s, 2.0 MB/s 2024-01-31T05:03:19.625 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-31T05:03:19.675 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2024-01-31T05:03:19.725 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-31T05:03:19.725 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:19.725 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-01-31T05:03:19.725 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:19.726 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-01-31 04:56:49.941924275 +0000 2024-01-31T05:03:19.726 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-01-31 04:56:49.665926742 +0000 2024-01-31T05:03:19.726 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-01-31 04:56:49.665926742 +0000 2024-01-31T05:03:19.726 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-01-31 04:56:49.665926742 +0000 2024-01-31T05:03:19.726 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-31T05:03:19.787 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-01-31T05:03:19.787 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-01-31T05:03:19.788 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000260795 s, 2.0 MB/s 2024-01-31T05:03:19.789 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-31T05:03:19.843 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-31T05:03:19.843 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-31T05:03:19.843 INFO:tasks.ceph:Generating config... 2024-01-31T05:03:19.845 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-31T05:03:19.845 INFO:tasks.ceph:[client] debug client = 20 2024-01-31T05:03:19.845 INFO:tasks.ceph:[client] debug ms = 1 2024-01-31T05:03:19.845 INFO:tasks.ceph:[client] pid file = 2024-01-31T05:03:19.845 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-31T05:03:19.845 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-31T05:03:19.845 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-31T05:03:19.845 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-31T05:03:19.845 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-31T05:03:19.845 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-31T05:03:19.845 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-31T05:03:19.845 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-31T05:03:19.845 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-31T05:03:19.845 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-31T05:03:19.845 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-31T05:03:19.845 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-31T05:03:19.846 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-31T05:03:19.846 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-31T05:03:19.846 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-31T05:03:19.846 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-31T05:03:19.846 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-31T05:03:19.846 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-31T05:03:19.846 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-31T05:03:19.846 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-31T05:03:19.846 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-01-31T05:03:19.846 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-01-31T05:03:19.846 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-31T05:03:19.846 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-31T05:03:19.846 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-01-31T05:03:19.846 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-31T05:03:19.846 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-31T05:03:19.846 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-31T05:03:19.846 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-31T05:03:19.847 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-31T05:03:19.847 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-31T05:03:19.847 INFO:tasks.ceph:Setting up mon.a... 2024-01-31T05:03:19.847 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-31T05:03:19.894 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.keyring 2024-01-31T05:03:19.907 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-31T05:03:19.956 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-31T05:03:19.976 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.49'), ('mon.b', '172.21.15.195'), ('mon.c', '[v2:172.21.15.195:3301,v1:172.21.15.195:6790]')] 2024-01-31T05:03:19.977 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.49,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-31T05:03:19.977 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:19.977 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-31T05:03:20.029 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.49 --add b 172.21.15.195 --addv c '[v2:172.21.15.195:3301,v1:172.21.15.195:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-31T05:03:20.119 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-31T05:03:20.120 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: generated fsid 3d27a9c0-c28e-4304-958f-ef21a88f4ab5 2024-01-31T05:03:20.120 INFO:teuthology.orchestra.run.smithi049.stdout:setting min_mon_release = quincy 2024-01-31T05:03:20.120 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 0 2024-01-31T05:03:20.120 INFO:teuthology.orchestra.run.smithi049.stdout:fsid 3d27a9c0-c28e-4304-958f-ef21a88f4ab5 2024-01-31T05:03:20.120 INFO:teuthology.orchestra.run.smithi049.stdout:last_changed 2024-01-31T05:03:20.124963+0000 2024-01-31T05:03:20.120 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-01-31T05:03:20.124963+0000 2024-01-31T05:03:20.120 INFO:teuthology.orchestra.run.smithi049.stdout:min_mon_release 17 (quincy) 2024-01-31T05:03:20.120 INFO:teuthology.orchestra.run.smithi049.stdout:election_strategy: 1 2024-01-31T05:03:20.120 INFO:teuthology.orchestra.run.smithi049.stdout:0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2024-01-31T05:03:20.120 INFO:teuthology.orchestra.run.smithi049.stdout:1: [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon.b 2024-01-31T05:03:20.120 INFO:teuthology.orchestra.run.smithi049.stdout:2: [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] mon.c 2024-01-31T05:03:20.120 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-31T05:03:20.123 DEBUG:teuthology.orchestra.run.smithi049:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-31T05:03:20.131 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3d27a9c0-c28e-4304-958f-ef21a88f4ab5... 2024-01-31T05:03:20.132 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-31T05:03:20.175 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-31T05:03:20.215 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2024-01-31T05:03:20.215 INFO:teuthology.orchestra.run.smithi049.stdout: chdir = "" 2024-01-31T05:03:20.215 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-31T05:03:20.215 INFO:teuthology.orchestra.run.smithi049.stdout: auth supported = cephx 2024-01-31T05:03:20.215 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: filestore xattr use omap = true 2024-01-31T05:03:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: mon clock drift allowed = 1.000 2024-01-31T05:03:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: osd crush chooseleaf type = 0 2024-01-31T05:03:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: auth debug = true 2024-01-31T05:03:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on old message = true 2024-01-31T05:03:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on bug = true 2024-01-31T05:03:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-31T05:03:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: mon pg warn max object skew = 0 2024-01-31T05:03:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: # disable pg_autoscaler by default for new pools 2024-01-31T05:03:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-31T05:03:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default size = 2 2024-01-31T05:03:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow primary affinity = true 2024-01-31T05:03:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow pg remap = true 2024-01-31T05:03:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on legacy crush tunables = false 2024-01-31T05:03:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on crush straw calc version zero = false 2024-01-31T05:03:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on no sortbitwise = false 2024-01-31T05:03:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on osd down out interval zero = false 2024-01-31T05:03:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on too few osds = false 2024-01-31T05:03:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-31T05:03:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-31T05:03:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: mon_allow_pool_size_one = true 2024-01-31T05:03:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.218 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-31T05:03:20.218 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.218 INFO:teuthology.orchestra.run.smithi049.stdout: osd default data pool replay window = 5 2024-01-31T05:03:20.218 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.218 INFO:teuthology.orchestra.run.smithi049.stdout: mon allow pool delete = true 2024-01-31T05:03:20.218 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.218 INFO:teuthology.orchestra.run.smithi049.stdout: mon cluster log file level = debug 2024-01-31T05:03:20.218 INFO:teuthology.orchestra.run.smithi049.stdout: debug asserts on shutdown = true 2024-01-31T05:03:20.218 INFO:teuthology.orchestra.run.smithi049.stdout: mon health detail to clog = false 2024-01-31T05:03:20.218 INFO:teuthology.orchestra.run.smithi049.stdout: mon host = "172.21.15.49,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2024-01-31T05:03:20.218 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = 3d27a9c0-c28e-4304-958f-ef21a88f4ab5 2024-01-31T05:03:20.218 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.218 INFO:teuthology.orchestra.run.smithi049.stdout:[osd] 2024-01-31T05:03:20.218 INFO:teuthology.orchestra.run.smithi049.stdout: osd journal size = 100 2024-01-31T05:03:20.219 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.219 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub load threshold = 5.0 2024-01-31T05:03:20.219 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub max interval = 600 2024-01-31T05:03:20.219 INFO:teuthology.orchestra.run.smithi049.stdout: osd mclock profile = high_recovery_ops 2024-01-31T05:03:20.219 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.219 INFO:teuthology.orchestra.run.smithi049.stdout: osd recover clone overlap = true 2024-01-31T05:03:20.219 INFO:teuthology.orchestra.run.smithi049.stdout: osd recovery max chunk = 1048576 2024-01-31T05:03:20.219 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.219 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug shutdown = true 2024-01-31T05:03:20.219 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug op order = true 2024-01-31T05:03:20.219 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug verify stray on activate = true 2024-01-31T05:03:20.219 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug trim objects = true 2024-01-31T05:03:20.219 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.219 INFO:teuthology.orchestra.run.smithi049.stdout: osd open classes on start = true 2024-01-31T05:03:20.219 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug pg log writeout = true 2024-01-31T05:03:20.220 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.220 INFO:teuthology.orchestra.run.smithi049.stdout: osd deep scrub update digest min age = 30 2024-01-31T05:03:20.220 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.220 INFO:teuthology.orchestra.run.smithi049.stdout: osd map max advance = 10 2024-01-31T05:03:20.220 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.220 INFO:teuthology.orchestra.run.smithi049.stdout: journal zero on create = true 2024-01-31T05:03:20.220 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.220 INFO:teuthology.orchestra.run.smithi049.stdout: filestore ondisk finisher threads = 3 2024-01-31T05:03:20.220 INFO:teuthology.orchestra.run.smithi049.stdout: filestore apply finisher threads = 3 2024-01-31T05:03:20.220 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.220 INFO:teuthology.orchestra.run.smithi049.stdout: bdev debug aio = true 2024-01-31T05:03:20.220 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug misdirected ops = true 2024-01-31T05:03:20.220 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore block size = 96636764160 2024-01-31T05:03:20.220 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore fsck on mount = True 2024-01-31T05:03:20.220 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluefs = 20 2024-01-31T05:03:20.220 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluestore = 20 2024-01-31T05:03:20.221 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-31T05:03:20.221 INFO:teuthology.orchestra.run.smithi049.stdout: debug osd = 20 2024-01-31T05:03:20.221 INFO:teuthology.orchestra.run.smithi049.stdout: debug rocksdb = 10 2024-01-31T05:03:20.221 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd backfillfull_ratio = 0.85 2024-01-31T05:03:20.221 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd full ratio = 0.9 2024-01-31T05:03:20.221 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd nearfull ratio = 0.8 2024-01-31T05:03:20.221 INFO:teuthology.orchestra.run.smithi049.stdout: osd failsafe full ratio = 0.95 2024-01-31T05:03:20.221 INFO:teuthology.orchestra.run.smithi049.stdout: osd objectstore = bluestore 2024-01-31T05:03:20.221 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2024-01-31T05:03:20.221 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.221 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr] 2024-01-31T05:03:20.221 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-31T05:03:20.221 INFO:teuthology.orchestra.run.smithi049.stdout: debug mgr = 20 2024-01-31T05:03:20.221 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2024-01-31T05:03:20.221 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2024-01-31T05:03:20.221 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2024-01-31T05:03:20.221 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2024-01-31T05:03:20.222 INFO:teuthology.orchestra.run.smithi049.stdout: mgr/telemetry/nag = false 2024-01-31T05:03:20.222 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.222 INFO:teuthology.orchestra.run.smithi049.stdout:[mon] 2024-01-31T05:03:20.222 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-31T05:03:20.222 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2024-01-31T05:03:20.222 INFO:teuthology.orchestra.run.smithi049.stdout: debug paxos = 20 2024-01-31T05:03:20.222 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2024-01-31T05:03:20.222 INFO:teuthology.orchestra.run.smithi049.stdout: mon data avail warn = 5 2024-01-31T05:03:20.222 INFO:teuthology.orchestra.run.smithi049.stdout: mon mgr mkfs grace = 240 2024-01-31T05:03:20.222 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2024-01-31T05:03:20.222 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd reporter subtree level = osd 2024-01-31T05:03:20.222 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd prime pg temp = true 2024-01-31T05:03:20.222 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2024-01-31T05:03:20.222 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.222 INFO:teuthology.orchestra.run.smithi049.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-31T05:03:20.222 INFO:teuthology.orchestra.run.smithi049.stdout: auth mon ticket ttl = 660 # 11m 2024-01-31T05:03:20.223 INFO:teuthology.orchestra.run.smithi049.stdout: auth service ticket ttl = 240 # 4m 2024-01-31T05:03:20.223 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.223 INFO:teuthology.orchestra.run.smithi049.stdout: # don't complain about insecure global_id in the test suite 2024-01-31T05:03:20.223 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-31T05:03:20.223 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-31T05:03:20.223 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.223 INFO:teuthology.orchestra.run.smithi049.stdout: # 1m isn't quite enough 2024-01-31T05:03:20.223 INFO:teuthology.orchestra.run.smithi049.stdout: mon_down_mkfs_grace = 2m 2024-01-31T05:03:20.223 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.223 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_filestore_osds = false 2024-01-31T05:03:20.223 INFO:teuthology.orchestra.run.smithi049.stdout: mon op complaint time = 120 2024-01-31T05:03:20.223 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:20.223 INFO:teuthology.orchestra.run.smithi049.stdout:[client] 2024-01-31T05:03:20.223 INFO:teuthology.orchestra.run.smithi049.stdout: rgw cache enabled = true 2024-01-31T05:03:20.223 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable ops log = true 2024-01-31T05:03:20.223 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable usage log = true 2024-01-31T05:03:20.223 INFO:teuthology.orchestra.run.smithi049.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-31T05:03:20.223 INFO:teuthology.orchestra.run.smithi049.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-31T05:03:20.224 INFO:teuthology.orchestra.run.smithi049.stdout: client mount timeout = 600 2024-01-31T05:03:20.224 INFO:teuthology.orchestra.run.smithi049.stdout: debug client = 20 2024-01-31T05:03:20.224 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-31T05:03:20.224 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = "" 2024-01-31T05:03:20.224 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2024-01-31T05:03:20.224 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2024-01-31T05:03:20.224 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.a] 2024-01-31T05:03:20.224 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.b] 2024-01-31T05:03:20.224 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.c] 2024-01-31T05:03:20.224 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2024-01-31T05:03:20.224 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2024-01-31T05:03:20.224 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2024-01-31T05:03:20.224 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2024-01-31T05:03:20.224 INFO:teuthology.orchestra.run.smithi049.stdout:[mds] 2024-01-31T05:03:20.224 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds = 20 2024-01-31T05:03:20.224 INFO:teuthology.orchestra.run.smithi049.stdout: debug mds balancer = 20 2024-01-31T05:03:20.225 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-01-31T05:03:20.225 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug frag = True 2024-01-31T05:03:20.225 INFO:teuthology.orchestra.run.smithi049.stdout: mds debug scatterstat = True 2024-01-31T05:03:20.225 INFO:teuthology.orchestra.run.smithi049.stdout: mds op complaint time = 180 2024-01-31T05:03:20.225 INFO:teuthology.orchestra.run.smithi049.stdout: mds verify scatter = True 2024-01-31T05:03:20.225 INFO:teuthology.orchestra.run.smithi049.stdout: osd op complaint time = 180 2024-01-31T05:03:20.225 INFO:teuthology.orchestra.run.smithi049.stdout: rados mon op timeout = 900 2024-01-31T05:03:20.225 INFO:teuthology.orchestra.run.smithi049.stdout: rados osd op timeout = 900 2024-01-31T05:03:20.225 INFO:teuthology.orchestra.run.smithi195.stdout:[global] 2024-01-31T05:03:20.225 INFO:teuthology.orchestra.run.smithi195.stdout: chdir = "" 2024-01-31T05:03:20.225 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-31T05:03:20.225 INFO:teuthology.orchestra.run.smithi195.stdout: auth supported = cephx 2024-01-31T05:03:20.226 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.226 INFO:teuthology.orchestra.run.smithi195.stdout: filestore xattr use omap = true 2024-01-31T05:03:20.226 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.226 INFO:teuthology.orchestra.run.smithi195.stdout: mon clock drift allowed = 1.000 2024-01-31T05:03:20.226 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.226 INFO:teuthology.orchestra.run.smithi195.stdout: osd crush chooseleaf type = 0 2024-01-31T05:03:20.226 INFO:teuthology.orchestra.run.smithi195.stdout: auth debug = true 2024-01-31T05:03:20.226 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.226 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on old message = true 2024-01-31T05:03:20.226 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on bug = true 2024-01-31T05:03:20.226 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.226 INFO:teuthology.orchestra.run.smithi195.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-31T05:03:20.226 INFO:teuthology.orchestra.run.smithi195.stdout: mon pg warn max object skew = 0 2024-01-31T05:03:20.226 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.226 INFO:teuthology.orchestra.run.smithi195.stdout: # disable pg_autoscaler by default for new pools 2024-01-31T05:03:20.227 INFO:teuthology.orchestra.run.smithi195.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-31T05:03:20.227 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.227 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default size = 2 2024-01-31T05:03:20.227 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.227 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow primary affinity = true 2024-01-31T05:03:20.227 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow pg remap = true 2024-01-31T05:03:20.227 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on legacy crush tunables = false 2024-01-31T05:03:20.227 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on crush straw calc version zero = false 2024-01-31T05:03:20.227 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on no sortbitwise = false 2024-01-31T05:03:20.227 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on osd down out interval zero = false 2024-01-31T05:03:20.227 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on too few osds = false 2024-01-31T05:03:20.227 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-31T05:03:20.227 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-31T05:03:20.227 INFO:teuthology.orchestra.run.smithi195.stdout: mon_allow_pool_size_one = true 2024-01-31T05:03:20.228 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.228 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-31T05:03:20.228 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.228 INFO:teuthology.orchestra.run.smithi195.stdout: osd default data pool replay window = 5 2024-01-31T05:03:20.228 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.228 INFO:teuthology.orchestra.run.smithi195.stdout: mon allow pool delete = true 2024-01-31T05:03:20.228 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.228 INFO:teuthology.orchestra.run.smithi195.stdout: mon cluster log file level = debug 2024-01-31T05:03:20.228 INFO:teuthology.orchestra.run.smithi195.stdout: debug asserts on shutdown = true 2024-01-31T05:03:20.228 INFO:teuthology.orchestra.run.smithi195.stdout: mon health detail to clog = false 2024-01-31T05:03:20.228 INFO:teuthology.orchestra.run.smithi195.stdout: mon host = "172.21.15.49,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2024-01-31T05:03:20.228 INFO:teuthology.orchestra.run.smithi195.stdout: fsid = 3d27a9c0-c28e-4304-958f-ef21a88f4ab5 2024-01-31T05:03:20.228 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.228 INFO:teuthology.orchestra.run.smithi195.stdout:[osd] 2024-01-31T05:03:20.229 INFO:teuthology.orchestra.run.smithi195.stdout: osd journal size = 100 2024-01-31T05:03:20.229 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.229 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub load threshold = 5.0 2024-01-31T05:03:20.229 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub max interval = 600 2024-01-31T05:03:20.229 INFO:teuthology.orchestra.run.smithi195.stdout: osd mclock profile = high_recovery_ops 2024-01-31T05:03:20.229 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.229 INFO:teuthology.orchestra.run.smithi195.stdout: osd recover clone overlap = true 2024-01-31T05:03:20.229 INFO:teuthology.orchestra.run.smithi195.stdout: osd recovery max chunk = 1048576 2024-01-31T05:03:20.229 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.229 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug shutdown = true 2024-01-31T05:03:20.229 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug op order = true 2024-01-31T05:03:20.229 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug verify stray on activate = true 2024-01-31T05:03:20.229 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug trim objects = true 2024-01-31T05:03:20.229 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.229 INFO:teuthology.orchestra.run.smithi195.stdout: osd open classes on start = true 2024-01-31T05:03:20.230 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug pg log writeout = true 2024-01-31T05:03:20.230 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.230 INFO:teuthology.orchestra.run.smithi195.stdout: osd deep scrub update digest min age = 30 2024-01-31T05:03:20.230 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.230 INFO:teuthology.orchestra.run.smithi195.stdout: osd map max advance = 10 2024-01-31T05:03:20.230 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.230 INFO:teuthology.orchestra.run.smithi195.stdout: journal zero on create = true 2024-01-31T05:03:20.230 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.230 INFO:teuthology.orchestra.run.smithi195.stdout: filestore ondisk finisher threads = 3 2024-01-31T05:03:20.230 INFO:teuthology.orchestra.run.smithi195.stdout: filestore apply finisher threads = 3 2024-01-31T05:03:20.230 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.230 INFO:teuthology.orchestra.run.smithi195.stdout: bdev debug aio = true 2024-01-31T05:03:20.230 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug misdirected ops = true 2024-01-31T05:03:20.230 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore block size = 96636764160 2024-01-31T05:03:20.231 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore fsck on mount = True 2024-01-31T05:03:20.231 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluefs = 20 2024-01-31T05:03:20.231 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluestore = 20 2024-01-31T05:03:20.231 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-01-31T05:03:20.231 INFO:teuthology.orchestra.run.smithi195.stdout: debug osd = 20 2024-01-31T05:03:20.231 INFO:teuthology.orchestra.run.smithi195.stdout: debug rocksdb = 10 2024-01-31T05:03:20.231 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd backfillfull_ratio = 0.85 2024-01-31T05:03:20.231 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd full ratio = 0.9 2024-01-31T05:03:20.231 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd nearfull ratio = 0.8 2024-01-31T05:03:20.231 INFO:teuthology.orchestra.run.smithi195.stdout: osd failsafe full ratio = 0.95 2024-01-31T05:03:20.231 INFO:teuthology.orchestra.run.smithi195.stdout: osd objectstore = bluestore 2024-01-31T05:03:20.231 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-01-31T05:03:20.231 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.231 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr] 2024-01-31T05:03:20.231 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-01-31T05:03:20.232 INFO:teuthology.orchestra.run.smithi195.stdout: debug mgr = 20 2024-01-31T05:03:20.232 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-01-31T05:03:20.232 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-01-31T05:03:20.232 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-01-31T05:03:20.232 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-01-31T05:03:20.232 INFO:teuthology.orchestra.run.smithi195.stdout: mgr/telemetry/nag = false 2024-01-31T05:03:20.232 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.232 INFO:teuthology.orchestra.run.smithi195.stdout:[mon] 2024-01-31T05:03:20.232 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-01-31T05:03:20.232 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-01-31T05:03:20.232 INFO:teuthology.orchestra.run.smithi195.stdout: debug paxos = 20 2024-01-31T05:03:20.232 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-01-31T05:03:20.232 INFO:teuthology.orchestra.run.smithi195.stdout: mon data avail warn = 5 2024-01-31T05:03:20.232 INFO:teuthology.orchestra.run.smithi195.stdout: mon mgr mkfs grace = 240 2024-01-31T05:03:20.232 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-01-31T05:03:20.233 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd reporter subtree level = osd 2024-01-31T05:03:20.233 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd prime pg temp = true 2024-01-31T05:03:20.233 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-01-31T05:03:20.233 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.233 INFO:teuthology.orchestra.run.smithi195.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-31T05:03:20.233 INFO:teuthology.orchestra.run.smithi195.stdout: auth mon ticket ttl = 660 # 11m 2024-01-31T05:03:20.233 INFO:teuthology.orchestra.run.smithi195.stdout: auth service ticket ttl = 240 # 4m 2024-01-31T05:03:20.233 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.233 INFO:teuthology.orchestra.run.smithi195.stdout: # don't complain about insecure global_id in the test suite 2024-01-31T05:03:20.233 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-31T05:03:20.233 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-31T05:03:20.233 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.233 INFO:teuthology.orchestra.run.smithi195.stdout: # 1m isn't quite enough 2024-01-31T05:03:20.233 INFO:teuthology.orchestra.run.smithi195.stdout: mon_down_mkfs_grace = 2m 2024-01-31T05:03:20.233 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.233 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_filestore_osds = false 2024-01-31T05:03:20.234 INFO:teuthology.orchestra.run.smithi195.stdout: mon op complaint time = 120 2024-01-31T05:03:20.234 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-31T05:03:20.234 INFO:teuthology.orchestra.run.smithi195.stdout:[client] 2024-01-31T05:03:20.234 INFO:teuthology.orchestra.run.smithi195.stdout: rgw cache enabled = true 2024-01-31T05:03:20.234 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable ops log = true 2024-01-31T05:03:20.234 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable usage log = true 2024-01-31T05:03:20.234 INFO:teuthology.orchestra.run.smithi195.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-31T05:03:20.234 INFO:teuthology.orchestra.run.smithi195.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-31T05:03:20.234 INFO:teuthology.orchestra.run.smithi195.stdout: client mount timeout = 600 2024-01-31T05:03:20.234 INFO:teuthology.orchestra.run.smithi195.stdout: debug client = 20 2024-01-31T05:03:20.234 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-01-31T05:03:20.234 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = "" 2024-01-31T05:03:20.234 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-01-31T05:03:20.234 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-01-31T05:03:20.234 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.a] 2024-01-31T05:03:20.234 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.b] 2024-01-31T05:03:20.235 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.c] 2024-01-31T05:03:20.235 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2024-01-31T05:03:20.235 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.c] 2024-01-31T05:03:20.235 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.b] 2024-01-31T05:03:20.235 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.d] 2024-01-31T05:03:20.235 INFO:teuthology.orchestra.run.smithi195.stdout:[mds] 2024-01-31T05:03:20.235 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds = 20 2024-01-31T05:03:20.235 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds balancer = 20 2024-01-31T05:03:20.235 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-01-31T05:03:20.235 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug frag = True 2024-01-31T05:03:20.235 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug scatterstat = True 2024-01-31T05:03:20.235 INFO:teuthology.orchestra.run.smithi195.stdout: mds op complaint time = 180 2024-01-31T05:03:20.235 INFO:teuthology.orchestra.run.smithi195.stdout: mds verify scatter = True 2024-01-31T05:03:20.235 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-01-31T05:03:20.235 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-01-31T05:03:20.235 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-01-31T05:03:20.237 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-31T05:03:20.237 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-31T05:03:20.337 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-31T05:03:20.337 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:20.338 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-31T05:03:20.346 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:20.346 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-31T05:03:20.396 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi049.front.sepia.ceph.com 2024-01-31T05:03:20.396 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:20.396 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-31T05:03:20.396 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-31T05:03:20.468 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:20.468 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-31T05:03:20.520 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi195.front.sepia.ceph.com 2024-01-31T05:03:20.520 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:20.520 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-31T05:03:20.521 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-31T05:03:20.555 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:20.555 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-31T05:03:20.609 INFO:tasks.ceph:Setting up mon nodes... 2024-01-31T05:03:20.610 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-31T05:03:20.610 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-31T05:03:20.666 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-31T05:03:20.671 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-31T05:03:20.730 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-31T05:03:20.757 INFO:tasks.ceph:Setting up mds nodes... 2024-01-31T05:03:20.758 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-31T05:03:20.815 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-31T05:03:20.820 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-31T05:03:20.840 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-31T05:03:20.936 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-31T05:03:20.941 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-31T05:03:20.960 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-31T05:03:21.020 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-31T05:03:21.025 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-31T05:03:21.045 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-01-31T05:03:21.144 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-01-31T05:03:21.149 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-01-31T05:03:21.168 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-31T05:03:21.168 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-31T05:03:21.212 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-31T05:03:21.229 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-01-31T05:03:21.315 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-01-31T05:03:21.332 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-01-31T05:03:21.375 INFO:teuthology.orchestra.run.smithi195.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-01-31T05:03:21.391 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-01-31T05:03:21.474 INFO:teuthology.orchestra.run.smithi195.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-01-31T05:03:21.491 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-31T05:03:21.491 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-31T05:03:21.491 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-31T05:03:21.510 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-31T05:03:21.510 INFO:tasks.ceph:role: osd.0 2024-01-31T05:03:21.511 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi049.front.sepia.ceph.com 2024-01-31T05:03:21.511 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-31T05:03:21.571 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-31T05:03:21.571 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-31T05:03:21.571 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-31T05:03:21.571 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-31T05:03:21.571 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-31T05:03:21.571 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2024-01-31T05:03:21.571 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-31T05:03:21.571 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-31T05:03:21.571 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-31T05:03:21.571 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-31T05:03:21.595 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2024-01-31T05:03:21.597 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2024-01-31T05:03:21.598 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-31T05:03:21.670 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-31T05:03:21.732 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: /sbin/restorecon: command not found 2024-01-31T05:03:21.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T05:03:21.733 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-31T05:03:21.795 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-31T05:03:21.796 INFO:tasks.ceph:role: osd.1 2024-01-31T05:03:21.796 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi049.front.sepia.ceph.com 2024-01-31T05:03:21.796 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-31T05:03:21.855 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-31T05:03:21.855 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-31T05:03:21.855 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-31T05:03:21.856 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-31T05:03:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-31T05:03:21.856 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2024-01-31T05:03:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-31T05:03:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-31T05:03:21.856 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-31T05:03:21.856 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-31T05:03:21.880 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2024-01-31T05:03:21.883 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2024-01-31T05:03:21.883 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-31T05:03:21.949 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-31T05:03:22.007 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: /sbin/restorecon: command not found 2024-01-31T05:03:22.008 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T05:03:22.009 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-31T05:03:22.071 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-31T05:03:22.072 INFO:tasks.ceph:role: osd.2 2024-01-31T05:03:22.072 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi049.front.sepia.ceph.com 2024-01-31T05:03:22.072 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-31T05:03:22.131 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-31T05:03:22.132 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-31T05:03:22.132 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-31T05:03:22.132 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-31T05:03:22.132 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-31T05:03:22.132 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2024-01-31T05:03:22.132 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-31T05:03:22.132 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-31T05:03:22.132 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-31T05:03:22.132 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-31T05:03:22.156 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2024-01-31T05:03:22.159 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2024-01-31T05:03:22.159 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-31T05:03:22.224 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-31T05:03:22.287 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: /sbin/restorecon: command not found 2024-01-31T05:03:22.288 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T05:03:22.288 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-31T05:03:22.351 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-31T05:03:22.351 INFO:tasks.ceph:role: osd.3 2024-01-31T05:03:22.351 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi049.front.sepia.ceph.com 2024-01-31T05:03:22.351 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-31T05:03:22.411 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-31T05:03:22.411 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-31T05:03:22.411 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-31T05:03:22.412 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-31T05:03:22.412 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-31T05:03:22.412 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2024-01-31T05:03:22.412 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-31T05:03:22.412 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-31T05:03:22.412 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-31T05:03:22.412 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-31T05:03:22.435 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2024-01-31T05:03:22.438 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2024-01-31T05:03:22.438 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-31T05:03:22.509 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-31T05:03:22.567 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: /sbin/restorecon: command not found 2024-01-31T05:03:22.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T05:03:22.569 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-31T05:03:22.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:22.695+0000 7ff909c6b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-31T05:03:22.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:22.695+0000 7ff909c6b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-31T05:03:22.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:22.695+0000 7ff909c6b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-31T05:03:22.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:22.695+0000 7ff909c6b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-31T05:03:22.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:22.695+0000 7ff909c6b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-31T05:03:22.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:22.695+0000 7ff909c6b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-31T05:03:25.667 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-31T05:03:25.688 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-31T05:03:25.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:25.787+0000 7f562d02f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-31T05:03:25.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:25.787+0000 7f562d02f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-31T05:03:25.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:25.787+0000 7f562d02f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-31T05:03:25.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:25.787+0000 7f562d02f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-31T05:03:25.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:25.787+0000 7f562d02f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-31T05:03:25.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:25.787+0000 7f562d02f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-31T05:03:28.775 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-31T05:03:28.796 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-31T05:03:28.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:28.895+0000 7f3a87bd37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-31T05:03:28.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:28.895+0000 7f3a87bd37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-31T05:03:28.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:28.895+0000 7f3a87bd37c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-31T05:03:28.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:28.895+0000 7f3a87bd37c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-31T05:03:28.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:28.895+0000 7f3a87bd37c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-31T05:03:28.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:28.895+0000 7f3a87bd37c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-31T05:03:31.849 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-31T05:03:31.870 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-31T05:03:31.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:31.971+0000 7f1836d967c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-31T05:03:31.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:31.971+0000 7f1836d967c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-31T05:03:31.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:31.971+0000 7f1836d967c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-31T05:03:31.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:31.971+0000 7f1836d967c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-31T05:03:31.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:31.971+0000 7f1836d967c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-31T05:03:31.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:31.971+0000 7f1836d967c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-31T05:03:35.021 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-31T05:03:35.042 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-31T05:03:35.064 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-31T05:03:35.064 INFO:tasks.ceph:role: osd.4 2024-01-31T05:03:35.064 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com 2024-01-31T05:03:35.064 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-31T05:03:35.126 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-31T05:03:35.126 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-31T05:03:35.126 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-31T05:03:35.126 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-31T05:03:35.126 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-31T05:03:35.126 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-01-31T05:03:35.126 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-31T05:03:35.126 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-31T05:03:35.126 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-31T05:03:35.126 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-31T05:03:35.151 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-01-31T05:03:35.153 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-01-31T05:03:35.153 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-31T05:03:35.221 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-31T05:03:35.285 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: /sbin/restorecon: command not found 2024-01-31T05:03:35.286 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T05:03:35.286 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-31T05:03:35.353 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-31T05:03:35.353 INFO:tasks.ceph:role: osd.5 2024-01-31T05:03:35.353 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi195.front.sepia.ceph.com 2024-01-31T05:03:35.353 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-31T05:03:35.415 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-31T05:03:35.416 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-31T05:03:35.416 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-31T05:03:35.416 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-31T05:03:35.416 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-31T05:03:35.416 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-01-31T05:03:35.416 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-31T05:03:35.416 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-31T05:03:35.416 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-31T05:03:35.416 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-31T05:03:35.439 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-01-31T05:03:35.442 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-01-31T05:03:35.442 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-31T05:03:35.508 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-31T05:03:35.568 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: /sbin/restorecon: command not found 2024-01-31T05:03:35.569 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T05:03:35.569 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-31T05:03:35.636 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-31T05:03:35.636 INFO:tasks.ceph:role: osd.6 2024-01-31T05:03:35.636 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi195.front.sepia.ceph.com 2024-01-31T05:03:35.636 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-31T05:03:35.699 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-31T05:03:35.699 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-31T05:03:35.699 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-31T05:03:35.699 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-31T05:03:35.700 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-31T05:03:35.700 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-01-31T05:03:35.700 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-31T05:03:35.700 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-31T05:03:35.700 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-31T05:03:35.700 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-31T05:03:35.724 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-01-31T05:03:35.727 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-01-31T05:03:35.728 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-31T05:03:35.796 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-31T05:03:35.856 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: /sbin/restorecon: command not found 2024-01-31T05:03:35.856 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T05:03:35.857 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-31T05:03:35.919 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-31T05:03:35.920 INFO:tasks.ceph:role: osd.7 2024-01-31T05:03:35.920 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi195.front.sepia.ceph.com 2024-01-31T05:03:35.920 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-31T05:03:35.979 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-31T05:03:35.979 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-31T05:03:35.979 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-31T05:03:35.979 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-31T05:03:35.980 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-31T05:03:35.980 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-01-31T05:03:35.980 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-31T05:03:35.980 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-31T05:03:35.980 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-31T05:03:35.980 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-31T05:03:36.006 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-01-31T05:03:36.008 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-01-31T05:03:36.008 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-31T05:03:36.076 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-31T05:03:36.136 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: /sbin/restorecon: command not found 2024-01-31T05:03:36.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T05:03:36.137 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-31T05:03:36.261 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:36.263+0000 7f0c86e547c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-31T05:03:36.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:36.263+0000 7f0c86e547c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-31T05:03:36.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:36.263+0000 7f0c86e547c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-31T05:03:36.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:36.263+0000 7f0c86e547c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-31T05:03:36.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:36.263+0000 7f0c86e547c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-31T05:03:36.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:36.263+0000 7f0c86e547c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-31T05:03:39.232 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-31T05:03:39.253 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-31T05:03:39.351 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:39.351+0000 7f01b6cd57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-31T05:03:39.352 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:39.351+0000 7f01b6cd57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-31T05:03:39.352 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:39.351+0000 7f01b6cd57c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-31T05:03:39.352 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:39.351+0000 7f01b6cd57c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-31T05:03:39.352 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:39.351+0000 7f01b6cd57c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-31T05:03:39.353 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:39.351+0000 7f01b6cd57c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-31T05:03:42.333 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-31T05:03:42.352 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-31T05:03:42.445 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:42.443+0000 7ff1bda3d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-31T05:03:42.445 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:42.443+0000 7ff1bda3d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-31T05:03:42.445 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:42.443+0000 7ff1bda3d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-31T05:03:42.445 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:42.443+0000 7ff1bda3d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-31T05:03:42.445 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:42.443+0000 7ff1bda3d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-31T05:03:42.446 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:42.447+0000 7ff1bda3d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-31T05:03:45.399 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-31T05:03:45.419 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-31T05:03:45.512 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:45.511+0000 7f737fa2b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-31T05:03:45.513 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:45.511+0000 7f737fa2b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-31T05:03:45.513 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:45.511+0000 7f737fa2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-31T05:03:45.513 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:45.511+0000 7f737fa2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-31T05:03:45.513 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:45.511+0000 7f737fa2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-31T05:03:45.514 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:45.515+0000 7f737fa2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-31T05:03:48.383 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:03:48.387 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:03:48.487 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-31T05:03:48.549 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-31T05:03:48.549 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:48.549 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-31T05:03:48.571 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:48.571 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-31T05:03:48.633 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:48.633 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-31T05:03:48.697 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:48.697 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-31T05:03:48.761 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:48.761 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-31T05:03:48.827 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:48.827 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-31T05:03:48.887 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:48.887 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-31T05:03:48.951 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:48.951 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-31T05:03:48.972 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:48.972 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-31T05:03:49.033 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:49.033 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-01-31T05:03:49.093 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:49.093 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-31T05:03:49.152 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:49.152 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-31T05:03:49.212 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:49.213 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-31T05:03:49.273 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:49.273 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-31T05:03:49.333 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:49.333 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-31T05:03:49.342 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:49.342 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-01-31T05:03:49.392 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:49.392 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-01-31T05:03:49.400 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:49.400 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-01-31T05:03:49.450 INFO:tasks.ceph:Adding keys to all mons... 2024-01-31T05:03:49.450 DEBUG:teuthology.orchestra.run.smithi049:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-31T05:03:49.453 DEBUG:teuthology.orchestra.run.smithi195:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-31T05:03:49.496 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr.y] 2024-01-31T05:03:49.496 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCY1LllNLwKKBAAGbZbP+wNmgFEpzAlJnGsqA== 2024-01-31T05:03:49.496 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2024-01-31T05:03:49.496 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCY1LllRgvnMBAA3BYWBC0/fl5Gvll899MD7g== 2024-01-31T05:03:49.496 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2024-01-31T05:03:49.496 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCY1LllJZAcOBAAwMq+vcaQl51OdBxerAztrw== 2024-01-31T05:03:49.497 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.0] 2024-01-31T05:03:49.497 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCa1LllZHqtKRAACPOUV8UQ0O2ckzyKxtvbuA== 2024-01-31T05:03:49.497 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.1] 2024-01-31T05:03:49.497 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCd1Lll87olLxAAxTUbY3RQ3f3Ad3RBKSskWw== 2024-01-31T05:03:49.497 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.2] 2024-01-31T05:03:49.497 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCg1LllsbmTNRAA5FXB5wozClzv8BDzzj3QQA== 2024-01-31T05:03:49.497 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.3] 2024-01-31T05:03:49.497 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCj1Lllh70gOhAA+ug2f/03UDSwOrz+8wQDtA== 2024-01-31T05:03:49.497 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr.x] 2024-01-31T05:03:49.497 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCY1LllXivLKxAAk40AEztys39yvVrD50oDPw== 2024-01-31T05:03:49.497 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2024-01-31T05:03:49.497 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCZ1Lll23dwARAAkG3+e6MVVJF8LxeTyNwB0A== 2024-01-31T05:03:49.497 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2024-01-31T05:03:49.497 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCZ1LlljVHWCBAAAVFPnilNINqpiIXsukKEww== 2024-01-31T05:03:49.498 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.4] 2024-01-31T05:03:49.498 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCo1Lll/xTaDxAAIwRUvkJ+eKmVrkoTDAzsPw== 2024-01-31T05:03:49.498 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.5] 2024-01-31T05:03:49.498 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCr1Lll/28nFRAAuSRVwgj9fiyojsjOXHsfKQ== 2024-01-31T05:03:49.498 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.6] 2024-01-31T05:03:49.498 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCu1Lll7HS9GhAA9bHLgNVDAWqfnX/PQRJyZg== 2024-01-31T05:03:49.498 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.7] 2024-01-31T05:03:49.498 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCx1LlliWHJHhAAZC9SvJsq4VwFmuwwkfWy1g== 2024-01-31T05:03:49.498 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2024-01-31T05:03:49.498 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCZ1LllVFD5DBAAC6IpXFam5AMJ6kFP7OS6Wg== 2024-01-31T05:03:49.498 INFO:teuthology.orchestra.run.smithi049.stdout:[client.2] 2024-01-31T05:03:49.498 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCZ1Llla+AgExAA8SBK+4ozSAndiZJJDqMTSQ== 2024-01-31T05:03:49.498 INFO:teuthology.orchestra.run.smithi049.stdout:[client.1] 2024-01-31T05:03:49.498 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCZ1LllpR6ZFhAA1+zpPPhNi9ueSvfdXPBx9A== 2024-01-31T05:03:49.499 INFO:teuthology.orchestra.run.smithi049.stdout:[client.3] 2024-01-31T05:03:49.499 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCZ1LllY9OEHBAAXZhj3vXeFuhEOpqWNMZf0A== 2024-01-31T05:03:49.511 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr.y] 2024-01-31T05:03:49.511 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCY1LllNLwKKBAAGbZbP+wNmgFEpzAlJnGsqA== 2024-01-31T05:03:49.511 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2024-01-31T05:03:49.511 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCY1LllRgvnMBAA3BYWBC0/fl5Gvll899MD7g== 2024-01-31T05:03:49.511 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.c] 2024-01-31T05:03:49.511 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCY1LllJZAcOBAAwMq+vcaQl51OdBxerAztrw== 2024-01-31T05:03:49.511 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.0] 2024-01-31T05:03:49.511 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCa1LllZHqtKRAACPOUV8UQ0O2ckzyKxtvbuA== 2024-01-31T05:03:49.511 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.1] 2024-01-31T05:03:49.511 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCd1Lll87olLxAAxTUbY3RQ3f3Ad3RBKSskWw== 2024-01-31T05:03:49.511 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.2] 2024-01-31T05:03:49.511 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCg1LllsbmTNRAA5FXB5wozClzv8BDzzj3QQA== 2024-01-31T05:03:49.511 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.3] 2024-01-31T05:03:49.511 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCj1Lllh70gOhAA+ug2f/03UDSwOrz+8wQDtA== 2024-01-31T05:03:49.512 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr.x] 2024-01-31T05:03:49.512 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCY1LllXivLKxAAk40AEztys39yvVrD50oDPw== 2024-01-31T05:03:49.512 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.b] 2024-01-31T05:03:49.512 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCZ1Lll23dwARAAkG3+e6MVVJF8LxeTyNwB0A== 2024-01-31T05:03:49.512 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.d] 2024-01-31T05:03:49.512 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCZ1LlljVHWCBAAAVFPnilNINqpiIXsukKEww== 2024-01-31T05:03:49.512 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.4] 2024-01-31T05:03:49.512 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCo1Lll/xTaDxAAIwRUvkJ+eKmVrkoTDAzsPw== 2024-01-31T05:03:49.512 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.5] 2024-01-31T05:03:49.512 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCr1Lll/28nFRAAuSRVwgj9fiyojsjOXHsfKQ== 2024-01-31T05:03:49.512 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.6] 2024-01-31T05:03:49.512 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCu1Lll7HS9GhAA9bHLgNVDAWqfnX/PQRJyZg== 2024-01-31T05:03:49.512 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.7] 2024-01-31T05:03:49.512 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCx1LlliWHJHhAAZC9SvJsq4VwFmuwwkfWy1g== 2024-01-31T05:03:49.512 INFO:teuthology.orchestra.run.smithi195.stdout:[client.0] 2024-01-31T05:03:49.513 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCZ1LllVFD5DBAAC6IpXFam5AMJ6kFP7OS6Wg== 2024-01-31T05:03:49.513 INFO:teuthology.orchestra.run.smithi195.stdout:[client.2] 2024-01-31T05:03:49.513 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCZ1Llla+AgExAA8SBK+4ozSAndiZJJDqMTSQ== 2024-01-31T05:03:49.513 INFO:teuthology.orchestra.run.smithi195.stdout:[client.1] 2024-01-31T05:03:49.513 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCZ1LllpR6ZFhAA1+zpPPhNi9ueSvfdXPBx9A== 2024-01-31T05:03:49.513 INFO:teuthology.orchestra.run.smithi195.stdout:[client.3] 2024-01-31T05:03:49.513 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCZ1LllY9OEHBAAXZhj3vXeFuhEOpqWNMZf0A== 2024-01-31T05:03:49.514 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-31T05:03:49.547 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-31T05:03:49.614 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-31T05:03:49.618 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-31T05:03:49.676 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-31T05:03:49.679 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-31T05:03:49.736 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-31T05:03:49.739 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-31T05:03:49.792 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-31T05:03:49.796 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-31T05:03:49.849 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-31T05:03:49.852 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-31T05:03:49.906 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-31T05:03:49.909 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-31T05:03:49.962 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-31T05:03:49.965 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-31T05:03:50.020 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-31T05:03:50.023 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-31T05:03:50.079 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-31T05:03:50.082 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-31T05:03:50.138 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-31T05:03:50.141 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-31T05:03:50.195 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-31T05:03:50.198 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-31T05:03:50.251 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-31T05:03:50.254 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-31T05:03:50.307 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-31T05:03:50.310 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-31T05:03:50.364 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-31T05:03:50.367 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-31T05:03:50.424 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-31T05:03:50.428 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-31T05:03:50.484 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-31T05:03:50.487 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-31T05:03:50.543 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-31T05:03:50.547 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-31T05:03:50.603 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-31T05:03:50.603 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-31T05:03:50.623 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-31T05:03:50.734 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-31T05:03:50.755 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-31T05:03:50.774 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-31T05:03:50.886 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-31T05:03:50.906 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-31T05:03:50.968 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-31T05:03:51.075 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-31T05:03:51.096 DEBUG:teuthology.orchestra.run.smithi049:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-31T05:03:51.100 DEBUG:teuthology.orchestra.run.smithi195:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-31T05:03:51.148 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-31T05:03:51.149 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-31T05:03:51.149 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-01-31T05:03:51.153 INFO:tasks.ceph.mon.a:Started 2024-01-31T05:03:51.153 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-31T05:03:51.153 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-01-31T05:03:51.196 INFO:tasks.ceph.mon.b:Started 2024-01-31T05:03:51.196 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-31T05:03:51.196 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-01-31T05:03:51.199 INFO:tasks.ceph.mon.c:Started 2024-01-31T05:03:51.199 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-31T05:03:51.199 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-31T05:03:51.199 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-01-31T05:03:51.202 INFO:tasks.ceph.mgr.y:Started 2024-01-31T05:03:51.202 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-31T05:03:51.203 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-01-31T05:03:51.206 INFO:tasks.ceph.mgr.x:Started 2024-01-31T05:03:51.206 INFO:tasks.ceph:Setting crush tunables to default 2024-01-31T05:03:51.206 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd crush tunables default 2024-01-31T05:03:51.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.351+0000 7f10fc600640 1 Processor -- start 2024-01-31T05:03:51.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.351+0000 7f10fc600640 1 -- start start 2024-01-31T05:03:51.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.351+0000 7f10fc600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f10f406fe70 0x7f10f406e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:51.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.351+0000 7f10fc600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10f40703c0 0x7f10f406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:51.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.351+0000 7f10fc600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f40d1e00 con 0x7f10f415e770 2024-01-31T05:03:51.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.351+0000 7f10fc600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f406fcc0 con 0x7f10f406fe70 2024-01-31T05:03:51.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.351+0000 7f10fc600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f406f6a0 con 0x7f10f40703c0 2024-01-31T05:03:51.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.351+0000 7f10fa600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10f40703c0 0x7f10f406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:51.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.351+0000 7f10fa600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10f40703c0 0x7f10f406eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:56098/0 (socket says 172.21.15.49:56098) 2024-01-31T05:03:51.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.351+0000 7f10fa600640 1 -- 172.21.15.49:0/4154529347 learned_addr learned my addr 172.21.15.49:0/4154529347 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:03:51.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.351+0000 7f10f9200640 1 --2- 172.21.15.49:0/4154529347 >> v2:172.21.15.195:3300/0 conn(0x7f10f406fe70 0x7f10f406e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:51.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.351+0000 7f10fa600640 1 -- 172.21.15.49:0/4154529347 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10f40703c0 msgr2=0x7f10f406eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-31T05:03:51.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.351+0000 7f10fa600640 1 -- 172.21.15.49:0/4154529347 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10f40703c0 msgr2=0x7f10f406eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-31T05:03:51.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.351+0000 7f10fa600640 1 --2- 172.21.15.49:0/4154529347 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10f40703c0 0x7f10f406eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-31T05:03:51.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.351+0000 7f10fa600640 1 --2- 172.21.15.49:0/4154529347 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10f40703c0 0x7f10f406eb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-31T05:03:51.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.351+0000 7f10f9200640 1 -- 172.21.15.49:0/4154529347 >> v2:172.21.15.195:3300/0 conn(0x7f10f406fe70 msgr2=0x7f10f406e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-31T05:03:51.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.351+0000 7f10f9200640 1 -- 172.21.15.49:0/4154529347 >> v2:172.21.15.195:3300/0 conn(0x7f10f406fe70 msgr2=0x7f10f406e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-31T05:03:51.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.351+0000 7f10f9200640 1 --2- 172.21.15.49:0/4154529347 >> v2:172.21.15.195:3300/0 conn(0x7f10f406fe70 0x7f10f406e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-31T05:03:51.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.351+0000 7f10f9200640 1 --2- 172.21.15.49:0/4154529347 >> v2:172.21.15.195:3300/0 conn(0x7f10f406fe70 0x7f10f406e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-31T05:03:51.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.479+0000 7f10f3e00640 1 -- 172.21.15.49:0/4154529347 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27131650 0 0) 0x7f10f40d1e00 con 0x7f10f415e770 2024-01-31T05:03:51.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.479+0000 7f10f3e00640 1 -- 172.21.15.49:0/4154529347 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10d4003530 con 0x7f10f415e770 2024-01-31T05:03:51.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f3e00640 1 -- 172.21.15.49:0/4154529347 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1521492301 0 0) 0x7f10d4003530 con 0x7f10f415e770 2024-01-31T05:03:51.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f3e00640 1 -- 172.21.15.49:0/4154529347 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10f40703c0 msgr2=0x7f10f406eb30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-31T05:03:51.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f3e00640 1 --2- 172.21.15.49:0/4154529347 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10f40703c0 0x7f10f406eb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:51.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f3e00640 1 -- 172.21.15.49:0/4154529347 >> v2:172.21.15.195:3300/0 conn(0x7f10f406fe70 msgr2=0x7f10f406e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-31T05:03:51.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f3e00640 1 --2- 172.21.15.49:0/4154529347 >> v2:172.21.15.195:3300/0 conn(0x7f10f406fe70 0x7f10f406e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:51.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f3e00640 1 -- 172.21.15.49:0/4154529347 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f40cf220 con 0x7f10f415e770 2024-01-31T05:03:51.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f3e00640 1 -- 172.21.15.49:0/4154529347 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7f10e4001680 con 0x7f10f415e770 2024-01-31T05:03:51.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f3e00640 1 -- 172.21.15.49:0/4154529347 >> v1:172.21.15.195:6789/0 conn(0x7f10f415e770 legacy=0x7f10f40cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:51.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f3e00640 1 --2- 172.21.15.49:0/4154529347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d4003980 0x7f10d4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:51.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f3e00640 1 --2- 172.21.15.49:0/4154529347 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10f40703c0 0x7f10d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:51.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f3e00640 1 --2- 172.21.15.49:0/4154529347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d4004d10 0x7f10d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:51.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f3e00640 1 -- 172.21.15.49:0/4154529347 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f406fcc0 con 0x7f10d4004d10 2024-01-31T05:03:51.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f3e00640 1 -- 172.21.15.49:0/4154529347 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f406f6a0 con 0x7f10d4003980 2024-01-31T05:03:51.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f3e00640 1 -- 172.21.15.49:0/4154529347 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d400ba40 con 0x7f10f40703c0 2024-01-31T05:03:51.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f9200640 1 --2- 172.21.15.49:0/4154529347 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10f40703c0 0x7f10d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:51.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f9c00640 1 --2- 172.21.15.49:0/4154529347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d4003980 0x7f10d4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:51.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10fa600640 1 --2- 172.21.15.49:0/4154529347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d4004d10 0x7f10d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:51.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f9c00640 1 -- 172.21.15.49:0/4154529347 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10f40703c0 msgr2=0x7f10d40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:03:51.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f9c00640 1 --2- 172.21.15.49:0/4154529347 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10f40703c0 0x7f10d40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:51.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f9c00640 1 -- 172.21.15.49:0/4154529347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d4004d10 msgr2=0x7f10d4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:03:51.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f9c00640 1 --2- 172.21.15.49:0/4154529347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d4004d10 0x7f10d4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:51.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.483+0000 7f10f9c00640 1 -- 172.21.15.49:0/4154529347 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d4003530 con 0x7f10d4003980 2024-01-31T05:03:51.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.487+0000 7f10f9c00640 1 --2- 172.21.15.49:0/4154529347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d4003980 0x7f10d4003da0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f10e4007c10 tx=0x7f10e4020fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58447f4410edf6cb server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:51.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.487+0000 7f10f3e00640 1 -- 172.21.15.49:0/4154529347 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e40b1440 con 0x7f10d4003980 2024-01-31T05:03:51.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.487+0000 7f10f3e00640 1 -- 172.21.15.49:0/4154529347 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e40b15c0 con 0x7f10d4003980 2024-01-31T05:03:51.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.487+0000 7f10f3e00640 1 -- 172.21.15.49:0/4154529347 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e40b1970 con 0x7f10d4003980 2024-01-31T05:03:51.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.487+0000 7f10fc600640 1 -- 172.21.15.49:0/4154529347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d4003980 msgr2=0x7f10d4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:51.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.487+0000 7f10fc600640 1 --2- 172.21.15.49:0/4154529347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d4003980 0x7f10d4003da0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f10e4007c10 tx=0x7f10e4020fd0 comp rx=0 tx=0).stop 2024-01-31T05:03:51.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.487+0000 7f10fa600640 1 -- 172.21.15.49:0/4154529347 reap_dead start 2024-01-31T05:03:51.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.487+0000 7f10fc600640 1 -- 172.21.15.49:0/4154529347 shutdown_connections 2024-01-31T05:03:51.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.487+0000 7f10fc600640 1 -- 172.21.15.49:0/4154529347 >> 172.21.15.49:0/4154529347 conn(0x7f10f40d0e60 msgr2=0x7f10f40d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:51.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.491+0000 7f10fc600640 1 -- 172.21.15.49:0/4154529347 shutdown_connections 2024-01-31T05:03:51.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.491+0000 7f10fc600640 1 -- 172.21.15.49:0/4154529347 wait complete. 2024-01-31T05:03:51.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.491+0000 7f10fc600640 1 Processor -- start 2024-01-31T05:03:51.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.491+0000 7f10fc600640 1 -- start start 2024-01-31T05:03:51.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10fc600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d4003980 0x7f10f41535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:51.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10fc600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f414ff50 0x7f10f4152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:51.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10fc600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10f41564f0 0x7f10f415af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:51.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10fc600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f4153de0 con 0x7f10f414ff50 2024-01-31T05:03:51.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10fc600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f40c5150 con 0x7f10d4003980 2024-01-31T05:03:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10fc600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f40c5430 con 0x7f10f41564f0 2024-01-31T05:03:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10f9c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d4003980 0x7f10f41535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10f9200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f414ff50 0x7f10f4152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10f9c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d4003980 0x7f10f41535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:52430/0 (socket says 172.21.15.49:52430) 2024-01-31T05:03:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10f9c00640 1 -- 172.21.15.49:0/1067293922 learned_addr learned my addr 172.21.15.49:0/1067293922 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:03:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10fa600640 1 --2- 172.21.15.49:0/1067293922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10f41564f0 0x7f10f415af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10f9200640 1 -- 172.21.15.49:0/1067293922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10f41564f0 msgr2=0x7f10f415af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10f9200640 1 --2- 172.21.15.49:0/1067293922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10f41564f0 0x7f10f415af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10f9200640 1 -- 172.21.15.49:0/1067293922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d4003980 msgr2=0x7f10f41535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10f9200640 1 --2- 172.21.15.49:0/1067293922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d4003980 0x7f10f41535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10f9200640 1 -- 172.21.15.49:0/1067293922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f40c5710 con 0x7f10f414ff50 2024-01-31T05:03:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10f9c00640 1 --2- 172.21.15.49:0/1067293922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d4003980 0x7f10f41535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:03:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10f9200640 1 --2- 172.21.15.49:0/1067293922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f414ff50 0x7f10f4152c00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0115b0 tx=0x7f10dc011a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10f1600640 1 -- 172.21.15.49:0/1067293922 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc004500 con 0x7f10f414ff50 2024-01-31T05:03:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10f1600640 1 -- 172.21.15.49:0/1067293922 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc003620 con 0x7f10f414ff50 2024-01-31T05:03:51.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10f1600640 1 -- 172.21.15.49:0/1067293922 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc0039b0 con 0x7f10f414ff50 2024-01-31T05:03:51.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10fc600640 1 -- 172.21.15.49:0/1067293922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f4153af0 con 0x7f10f414ff50 2024-01-31T05:03:51.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10fc600640 1 -- 172.21.15.49:0/1067293922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f4153140 con 0x7f10f414ff50 2024-01-31T05:03:51.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10f1600640 1 -- 172.21.15.49:0/1067293922 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f10dc015480 con 0x7f10f414ff50 2024-01-31T05:03:51.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10f1600640 1 -- 172.21.15.49:0/1067293922 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f10dc00f810 con 0x7f10f414ff50 2024-01-31T05:03:51.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.495+0000 7f10fc600640 1 -- 172.21.15.49:0/1067293922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f4068070 con 0x7f10f414ff50 2024-01-31T05:03:51.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.535+0000 7f10f1600640 1 -- 172.21.15.49:0/1067293922 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f10dc03ddb0 con 0x7f10f414ff50 2024-01-31T05:03:51.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.595+0000 7f10fc600640 1 -- 172.21.15.49:0/1067293922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f10f4074860 con 0x7f10f414ff50 2024-01-31T05:03:51.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.599+0000 7f10f1600640 1 -- 172.21.15.49:0/1067293922 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f10dc02c020 con 0x7f10f414ff50 2024-01-31T05:03:51.597 INFO:teuthology.orchestra.run.smithi049.stderr:adjusted tunables profile to default 2024-01-31T05:03:51.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.599+0000 7f10fc600640 1 -- 172.21.15.49:0/1067293922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f414ff50 msgr2=0x7f10f4152c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:51.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.599+0000 7f10fc600640 1 --2- 172.21.15.49:0/1067293922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f414ff50 0x7f10f4152c00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0115b0 tx=0x7f10dc011a70 comp rx=0 tx=0).stop 2024-01-31T05:03:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.599+0000 7f10fc600640 1 -- 172.21.15.49:0/1067293922 shutdown_connections 2024-01-31T05:03:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.599+0000 7f10fc600640 1 --2- 172.21.15.49:0/1067293922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10f41564f0 0x7f10f415af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.599+0000 7f10fc600640 1 --2- 172.21.15.49:0/1067293922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f414ff50 0x7f10f4152c00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.599+0000 7f10fc600640 1 --2- 172.21.15.49:0/1067293922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d4003980 0x7f10f41535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.599+0000 7f10fc600640 1 -- 172.21.15.49:0/1067293922 >> 172.21.15.49:0/1067293922 conn(0x7f10f40d0e60 msgr2=0x7f10f4073e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.599+0000 7f10fc600640 1 -- 172.21.15.49:0/1067293922 shutdown_connections 2024-01-31T05:03:51.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:51.599+0000 7f10fc600640 1 -- 172.21.15.49:0/1067293922 wait complete. 2024-01-31T05:03:51.619 INFO:tasks.ceph:check_enable_crimson: False 2024-01-31T05:03:51.619 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-31T05:03:51.619 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:51.619 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-31T05:03:51.639 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:51.639 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-31T05:03:51.678 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:51.678+0000 7feb06049180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-31T05:03:51.688 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:51.687+0000 7f1f0cdd4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-31T05:03:51.703 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:51.704 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-31T05:03:51.768 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:03:51.768 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-31T05:03:51.828 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:51.828 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-31T05:03:51.848 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:51.848 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-31T05:03:51.912 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:51.913 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-31T05:03:51.976 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:03:51.976 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-31T05:03:52.036 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 90693ba8-1d6e-48a5-a1e8-a4b15d70038f 0 2024-01-31T05:03:52.180 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:52.178+0000 7feb06049180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-31T05:03:52.205 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:52.207+0000 7f1f0cdd4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-31T05:03:52.212 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.210+0000 7fa7cc400640 1 Processor -- start 2024-01-31T05:03:52.212 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.210+0000 7fa7cc400640 1 -- start start 2024-01-31T05:03:52.214 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.214+0000 7fa7cc400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa7c40cff70 0x7fa7c40cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:52.214 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.214+0000 7fa7cc400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c40cef80 con 0x7fa7c415d540 2024-01-31T05:03:52.214 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.214+0000 7fa7cc400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c406cae0 con 0x7fa7c40cb9f0 2024-01-31T05:03:52.214 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.214+0000 7fa7cc400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c40d03d0 con 0x7fa7c40cff70 2024-01-31T05:03:52.214 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.214+0000 7fa7ca400640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fa7c40cb9f0 0x7fa7c415d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:44292/0 (socket says 172.21.15.195:44292) 2024-01-31T05:03:52.214 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.214+0000 7fa7ca400640 1 -- 172.21.15.195:0/3640021823 learned_addr learned my addr 172.21.15.195:0/3640021823 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-01-31T05:03:52.214 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.214+0000 7fa7c9000640 1 --2- 172.21.15.195:0/3640021823 >> v2:172.21.15.49:3300/0 conn(0x7fa7c40cff70 0x7fa7c40cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:52.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.214+0000 7fa7c3e00640 1 -- 172.21.15.195:0/3640021823 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161538986 0 0) 0x7fa7c406cae0 con 0x7fa7c40cb9f0 2024-01-31T05:03:52.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.214+0000 7fa7c3e00640 1 -- 172.21.15.195:0/3640021823 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7a4003530 con 0x7fa7c40cb9f0 2024-01-31T05:03:52.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.214+0000 7fa7c3e00640 1 -- 172.21.15.195:0/3640021823 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885797435 0 0) 0x7fa7c40cef80 con 0x7fa7c415d540 2024-01-31T05:03:52.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.214+0000 7fa7c3e00640 1 -- 172.21.15.195:0/3640021823 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7c406cae0 con 0x7fa7c415d540 2024-01-31T05:03:52.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.214+0000 7fa7c9000640 1 -- 172.21.15.195:0/3640021823 >> v1:172.21.15.195:6789/0 conn(0x7fa7c40cb9f0 legacy=0x7fa7c415d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.214+0000 7fa7c9000640 1 -- 172.21.15.195:0/3640021823 >> v1:172.21.15.49:6789/0 conn(0x7fa7c415d540 legacy=0x7fa7c406c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.215 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.214+0000 7fa7c9000640 1 -- 172.21.15.195:0/3640021823 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c40cf1b0 con 0x7fa7c40cff70 2024-01-31T05:03:52.217 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.218+0000 7fa7c9000640 1 --2- 172.21.15.195:0/3640021823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7c40cff70 0x7fa7c40cb4b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0097c0 tx=0x7fa7ac01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e958721235f3f0b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:52.218 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.218+0000 7fa7c3e00640 1 -- 172.21.15.195:0/3640021823 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac0ad660 con 0x7fa7c40cff70 2024-01-31T05:03:52.218 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.218+0000 7fa7c3e00640 1 -- 172.21.15.195:0/3640021823 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ac0ad7c0 con 0x7fa7c40cff70 2024-01-31T05:03:52.218 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.218+0000 7fa7c3e00640 1 -- 172.21.15.195:0/3640021823 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac0adb50 con 0x7fa7c40cff70 2024-01-31T05:03:52.218 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.218+0000 7fa7cc400640 1 -- 172.21.15.195:0/3640021823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7c40cff70 msgr2=0x7fa7c40cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.218 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.218+0000 7fa7cc400640 1 --2- 172.21.15.195:0/3640021823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7c40cff70 0x7fa7c40cb4b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0097c0 tx=0x7fa7ac01c450 comp rx=0 tx=0).stop 2024-01-31T05:03:52.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.218+0000 7fa7cc400640 1 -- 172.21.15.195:0/3640021823 shutdown_connections 2024-01-31T05:03:52.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.218+0000 7fa7cc400640 1 --2- 172.21.15.195:0/3640021823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7c40cff70 0x7fa7c40cb4b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.218+0000 7fa7cc400640 1 -- 172.21.15.195:0/3640021823 >> 172.21.15.195:0/3640021823 conn(0x7fa7c40d0e60 msgr2=0x7fa7c40d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:52.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.218+0000 7fa7cc400640 1 -- 172.21.15.195:0/3640021823 shutdown_connections 2024-01-31T05:03:52.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.218+0000 7fa7cc400640 1 -- 172.21.15.195:0/3640021823 wait complete. 2024-01-31T05:03:52.220 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.218+0000 7fa7cc400640 1 Processor -- start 2024-01-31T05:03:52.221 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.218+0000 7fa7cc400640 1 -- start start 2024-01-31T05:03:52.222 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7cc400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7c40cb9f0 0x7fa7c40c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:52.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7cc400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7c40cff70 0x7fa7c4150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:52.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7cc400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7c415d540 0x7fa7c41506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:52.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7cc400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c40b6a40 con 0x7fa7c415d540 2024-01-31T05:03:52.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7cc400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c4150c00 con 0x7fa7c40cff70 2024-01-31T05:03:52.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7cc400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c40b4bd0 con 0x7fa7c40cb9f0 2024-01-31T05:03:52.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7c9000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7c40cff70 0x7fa7c4150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:52.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7c9a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7c40cb9f0 0x7fa7c40c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:52.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7c9000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7c40cff70 0x7fa7c4150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:47284/0 (socket says 172.21.15.195:47284) 2024-01-31T05:03:52.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7c9000640 1 -- 172.21.15.195:0/2934560384 learned_addr learned my addr 172.21.15.195:0/2934560384 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-01-31T05:03:52.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7ca400640 1 --2- 172.21.15.195:0/2934560384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7c415d540 0x7fa7c41506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:52.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7c9000640 1 -- 172.21.15.195:0/2934560384 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7c40cb9f0 msgr2=0x7fa7c40c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7c9000640 1 --2- 172.21.15.195:0/2934560384 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7c40cb9f0 0x7fa7c40c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.223 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7c9000640 1 -- 172.21.15.195:0/2934560384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7c415d540 msgr2=0x7fa7c41506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.224 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7c9000640 1 --2- 172.21.15.195:0/2934560384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7c415d540 0x7fa7c41506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.224 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7c9000640 1 -- 172.21.15.195:0/2934560384 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac009420 con 0x7fa7c40cff70 2024-01-31T05:03:52.224 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7c9000640 1 --2- 172.21.15.195:0/2934560384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7c40cff70 0x7fa7c4150180 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0b0040 tx=0x7fa7ac0191f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:52.225 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7c1600640 1 -- 172.21.15.195:0/2934560384 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac0b6630 con 0x7fa7c40cff70 2024-01-31T05:03:52.225 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7c1600640 1 -- 172.21.15.195:0/2934560384 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ac0b67d0 con 0x7fa7c40cff70 2024-01-31T05:03:52.225 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7c1600640 1 -- 172.21.15.195:0/2934560384 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac0b6b80 con 0x7fa7c40cff70 2024-01-31T05:03:52.225 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7cc400640 1 -- 172.21.15.195:0/2934560384 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c40b6760 con 0x7fa7c40cff70 2024-01-31T05:03:52.225 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7cc400640 1 -- 172.21.15.195:0/2934560384 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c40b4860 con 0x7fa7c40cff70 2024-01-31T05:03:52.225 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7c1600640 1 -- 172.21.15.195:0/2934560384 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa7ac0b4040 con 0x7fa7c40cff70 2024-01-31T05:03:52.225 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7c1600640 1 -- 172.21.15.195:0/2934560384 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa7ac0c0c30 con 0x7fa7c40cff70 2024-01-31T05:03:52.225 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.222+0000 7fa7cc400640 1 -- 172.21.15.195:0/2934560384 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c40ce880 con 0x7fa7c40cff70 2024-01-31T05:03:52.229 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.226+0000 7fa7c1600640 1 -- 172.21.15.195:0/2934560384 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fa7ac0b2070 con 0x7fa7c40cff70 2024-01-31T05:03:52.296 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.294+0000 7fa7cc400640 1 -- 172.21.15.195:0/2934560384 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "90693ba8-1d6e-48a5-a1e8-a4b15d70038f", "id": 0} v 0) v1 -- 0x7fa7c40b43e0 con 0x7fa7c40cff70 2024-01-31T05:03:52.300 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.298+0000 7fa7c1600640 1 -- 172.21.15.195:0/2934560384 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "90693ba8-1d6e-48a5-a1e8-a4b15d70038f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa7c40b43e0 con 0x7fa7c40cff70 2024-01-31T05:03:52.300 INFO:teuthology.orchestra.run.smithi195.stdout:0 2024-01-31T05:03:52.301 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.298+0000 7fa7cc400640 1 -- 172.21.15.195:0/2934560384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7c40cff70 msgr2=0x7fa7c4150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.301 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.298+0000 7fa7cc400640 1 --2- 172.21.15.195:0/2934560384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7c40cff70 0x7fa7c4150180 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0b0040 tx=0x7fa7ac0191f0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.301 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.298+0000 7fa7cc400640 1 -- 172.21.15.195:0/2934560384 shutdown_connections 2024-01-31T05:03:52.301 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.298+0000 7fa7cc400640 1 --2- 172.21.15.195:0/2934560384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7c415d540 0x7fa7c41506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.302 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.298+0000 7fa7cc400640 1 --2- 172.21.15.195:0/2934560384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7c40cff70 0x7fa7c4150180 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.302 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.298+0000 7fa7cc400640 1 --2- 172.21.15.195:0/2934560384 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7c40cb9f0 0x7fa7c40c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.302 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.298+0000 7fa7cc400640 1 -- 172.21.15.195:0/2934560384 >> 172.21.15.195:0/2934560384 conn(0x7fa7c40d0e60 msgr2=0x7fa7c415bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:52.302 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.298+0000 7fa7cc400640 1 -- 172.21.15.195:0/2934560384 shutdown_connections 2024-01-31T05:03:52.302 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.298+0000 7fa7cc400640 1 -- 172.21.15.195:0/2934560384 wait complete. 2024-01-31T05:03:52.320 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 2b5d75dc-9b9a-4640-b966-c46e98849877 1 2024-01-31T05:03:52.395 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:52.394+0000 7feb06049180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-31T05:03:52.426 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:52.427+0000 7f1f0cdd4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-31T05:03:52.456 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.454+0000 7fab55400640 1 Processor -- start 2024-01-31T05:03:52.456 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.454+0000 7fab55400640 1 -- start start 2024-01-31T05:03:52.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.454+0000 7fab55400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fab500c3e40 0x7fab500d0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:52.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.458+0000 7fab55400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fab500b0790 0x7fab500b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:52.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.458+0000 7fab55400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab500b1f50 con 0x7fab500b1af0 2024-01-31T05:03:52.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.458+0000 7fab55400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab500b2260 con 0x7fab500c3e40 2024-01-31T05:03:52.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.458+0000 7fab55400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab50166170 con 0x7fab500b0790 2024-01-31T05:03:52.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.458+0000 7fab4f200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fab500b0790 0x7fab500b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:52.459 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.458+0000 7fab4de00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fab500b1af0 0x7fab500c4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:44296/0 (socket says 172.21.15.195:44296) 2024-01-31T05:03:52.459 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.458+0000 7fab4de00640 1 -- 172.21.15.195:0/426297895 learned_addr learned my addr 172.21.15.195:0/426297895 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-01-31T05:03:52.459 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.458+0000 7fab4e800640 1 --2- 172.21.15.195:0/426297895 >> v2:172.21.15.49:3300/0 conn(0x7fab500c3e40 0x7fab500d0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:52.459 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.458+0000 7fab4f200640 1 -- 172.21.15.195:0/426297895 >> v2:172.21.15.49:3300/0 conn(0x7fab500c3e40 msgr2=0x7fab500d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:03:52.459 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.458+0000 7fab4f200640 1 --2- 172.21.15.195:0/426297895 >> v2:172.21.15.49:3300/0 conn(0x7fab500c3e40 0x7fab500d0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.459 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.458+0000 7fab4f200640 1 -- 172.21.15.195:0/426297895 >> v1:172.21.15.195:6789/0 conn(0x7fab500b1af0 legacy=0x7fab500c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.459 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.458+0000 7fab4f200640 1 -- 172.21.15.195:0/426297895 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab50165e90 con 0x7fab500b0790 2024-01-31T05:03:52.459 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.458+0000 7fab4d400640 1 -- 172.21.15.195:0/426297895 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006544468 0 0) 0x7fab500b1f50 con 0x7fab500b1af0 2024-01-31T05:03:52.461 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.458+0000 7fab4f200640 1 --2- 172.21.15.195:0/426297895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab500b0790 0x7fab500b0c00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fab50071bd0 tx=0x7fab4801c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdbd3877cc9b1e37 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:52.461 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.462+0000 7fab4d400640 1 -- 172.21.15.195:0/426297895 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab480a58c0 con 0x7fab500b0790 2024-01-31T05:03:52.461 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.462+0000 7fab4d400640 1 -- 172.21.15.195:0/426297895 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab480a5a20 con 0x7fab500b0790 2024-01-31T05:03:52.462 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.462+0000 7fab4d400640 1 -- 172.21.15.195:0/426297895 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab480a5db0 con 0x7fab500b0790 2024-01-31T05:03:52.462 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.462+0000 7fab55400640 1 -- 172.21.15.195:0/426297895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab500b0790 msgr2=0x7fab500b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.462 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.462+0000 7fab55400640 1 --2- 172.21.15.195:0/426297895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab500b0790 0x7fab500b0c00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fab50071bd0 tx=0x7fab4801c910 comp rx=0 tx=0).stop 2024-01-31T05:03:52.463 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.462+0000 7fab55400640 1 -- 172.21.15.195:0/426297895 shutdown_connections 2024-01-31T05:03:52.463 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.462+0000 7fab55400640 1 --2- 172.21.15.195:0/426297895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab500b0790 0x7fab500b0c00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.463 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.462+0000 7fab55400640 1 --2- 172.21.15.195:0/426297895 >> v2:172.21.15.49:3300/0 conn(0x7fab500c3e40 0x7fab500d0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.463 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.462+0000 7fab55400640 1 -- 172.21.15.195:0/426297895 >> 172.21.15.195:0/426297895 conn(0x7fab500d0e70 msgr2=0x7fab500d1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:52.463 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.462+0000 7fab55400640 1 -- 172.21.15.195:0/426297895 shutdown_connections 2024-01-31T05:03:52.463 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.462+0000 7fab55400640 1 -- 172.21.15.195:0/426297895 wait complete. 2024-01-31T05:03:52.464 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.462+0000 7fab55400640 1 Processor -- start 2024-01-31T05:03:52.464 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.462+0000 7fab55400640 1 -- start start 2024-01-31T05:03:52.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab55400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab500b0790 0x7fab500c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:52.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab55400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab500b1af0 0x7fab500cd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:52.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab55400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab500c3e40 0x7fab500c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:52.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab55400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab500c5c90 con 0x7fab500c3e40 2024-01-31T05:03:52.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab55400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab500c6170 con 0x7fab500b0790 2024-01-31T05:03:52.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab55400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab500c6450 con 0x7fab500b1af0 2024-01-31T05:03:52.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab4de00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab500b1af0 0x7fab500cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:52.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab4e800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab500b0790 0x7fab500c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:52.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab4de00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab500b1af0 0x7fab500cd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:58292/0 (socket says 172.21.15.195:58292) 2024-01-31T05:03:52.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab4de00640 1 -- 172.21.15.195:0/364936507 learned_addr learned my addr 172.21.15.195:0/364936507 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-01-31T05:03:52.468 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab4f200640 1 --2- 172.21.15.195:0/364936507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab500c3e40 0x7fab500c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:52.469 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab4e800640 1 -- 172.21.15.195:0/364936507 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab500b1af0 msgr2=0x7fab500cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.469 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab4e800640 1 --2- 172.21.15.195:0/364936507 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab500b1af0 0x7fab500cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.469 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab4e800640 1 -- 172.21.15.195:0/364936507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab500c3e40 msgr2=0x7fab500c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.469 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab4e800640 1 --2- 172.21.15.195:0/364936507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab500c3e40 0x7fab500c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.469 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab4e800640 1 -- 172.21.15.195:0/364936507 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab48009a70 con 0x7fab500b0790 2024-01-31T05:03:52.469 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab4e800640 1 --2- 172.21.15.195:0/364936507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab500b0790 0x7fab500c53b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fab4000e870 tx=0x7fab4000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:52.469 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab46a00640 1 -- 172.21.15.195:0/364936507 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab400095d0 con 0x7fab500b0790 2024-01-31T05:03:52.469 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab46a00640 1 -- 172.21.15.195:0/364936507 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4000c940 con 0x7fab500b0790 2024-01-31T05:03:52.469 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab55400640 1 -- 172.21.15.195:0/364936507 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab500c6730 con 0x7fab500b0790 2024-01-31T05:03:52.469 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab46a00640 1 -- 172.21.15.195:0/364936507 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000ccb0 con 0x7fab500b0790 2024-01-31T05:03:52.469 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab55400640 1 -- 172.21.15.195:0/364936507 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab500c58f0 con 0x7fab500b0790 2024-01-31T05:03:52.469 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab46a00640 1 -- 172.21.15.195:0/364936507 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fab400059a0 con 0x7fab500b0790 2024-01-31T05:03:52.469 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab46a00640 1 -- 172.21.15.195:0/364936507 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fab40013820 con 0x7fab500b0790 2024-01-31T05:03:52.470 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.466+0000 7fab55400640 1 -- 172.21.15.195:0/364936507 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab50164ea0 con 0x7fab500b0790 2024-01-31T05:03:52.470 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.470+0000 7fab46a00640 1 -- 172.21.15.195:0/364936507 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fab40021060 con 0x7fab500b0790 2024-01-31T05:03:52.539 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.538+0000 7fab55400640 1 -- 172.21.15.195:0/364936507 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2b5d75dc-9b9a-4640-b966-c46e98849877", "id": 1} v 0) v1 -- 0x7fab50073760 con 0x7fab500b0790 2024-01-31T05:03:52.542 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.542+0000 7fab46a00640 1 -- 172.21.15.195:0/364936507 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2b5d75dc-9b9a-4640-b966-c46e98849877", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fab40017070 con 0x7fab500b0790 2024-01-31T05:03:52.543 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-01-31T05:03:52.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.542+0000 7fab55400640 1 -- 172.21.15.195:0/364936507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab500b0790 msgr2=0x7fab500c53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.542+0000 7fab55400640 1 --2- 172.21.15.195:0/364936507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab500b0790 0x7fab500c53b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fab4000e870 tx=0x7fab4000ed30 comp rx=0 tx=0).stop 2024-01-31T05:03:52.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.542+0000 7fab55400640 1 -- 172.21.15.195:0/364936507 shutdown_connections 2024-01-31T05:03:52.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.542+0000 7fab55400640 1 --2- 172.21.15.195:0/364936507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab500c3e40 0x7fab500c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.542+0000 7fab55400640 1 --2- 172.21.15.195:0/364936507 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab500b1af0 0x7fab500cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.542+0000 7fab55400640 1 --2- 172.21.15.195:0/364936507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab500b0790 0x7fab500c53b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.542+0000 7fab55400640 1 -- 172.21.15.195:0/364936507 >> 172.21.15.195:0/364936507 conn(0x7fab500d0e70 msgr2=0x7fab501630c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:52.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.542+0000 7fab55400640 1 -- 172.21.15.195:0/364936507 shutdown_connections 2024-01-31T05:03:52.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.542+0000 7fab55400640 1 -- 172.21.15.195:0/364936507 wait complete. 2024-01-31T05:03:52.562 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new e856a6de-31fb-49e3-a1a3-3466b082d382 2 2024-01-31T05:03:52.697 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.694+0000 7fe9d8c00640 1 Processor -- start 2024-01-31T05:03:52.697 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.694+0000 7fe9d8c00640 1 -- start start 2024-01-31T05:03:52.699 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.698+0000 7fe9d8c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe9d40b2410 0x7fe9d406d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:52.699 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.698+0000 7fe9d8c00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d40b49a0 con 0x7fe9d4161430 2024-01-31T05:03:52.699 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.698+0000 7fe9d8c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d406d790 con 0x7fe9d415d2b0 2024-01-31T05:03:52.699 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.698+0000 7fe9d8c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d415d690 con 0x7fe9d40b2410 2024-01-31T05:03:52.699 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.698+0000 7fe9d1400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe9d40b2410 0x7fe9d406d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:52.699 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.698+0000 7fe9d1e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fe9d415d2b0 0x7fe9d40ac8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:44302/0 (socket says 172.21.15.195:44302) 2024-01-31T05:03:52.699 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.698+0000 7fe9d1e00640 1 -- 172.21.15.195:0/1920934175 learned_addr learned my addr 172.21.15.195:0/1920934175 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-01-31T05:03:52.700 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.698+0000 7fe9d1400640 1 -- 172.21.15.195:0/1920934175 >> v1:172.21.15.195:6789/0 conn(0x7fe9d415d2b0 legacy=0x7fe9d40ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.700 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.698+0000 7fe9d1400640 1 -- 172.21.15.195:0/1920934175 >> v1:172.21.15.49:6789/0 conn(0x7fe9d4161430 legacy=0x7fe9d40cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.700 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.698+0000 7fe9d0a00640 1 -- 172.21.15.195:0/1920934175 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095001833 0 0) 0x7fe9d406d790 con 0x7fe9d415d2b0 2024-01-31T05:03:52.700 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.698+0000 7fe9d1400640 1 -- 172.21.15.195:0/1920934175 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d406da70 con 0x7fe9d40b2410 2024-01-31T05:03:52.702 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.702+0000 7fe9d1400640 1 --2- 172.21.15.195:0/1920934175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9d40b2410 0x7fe9d406d090 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0097c0 tx=0x7fe9bc01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5327db6ceecf9067 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:52.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.702+0000 7fe9d0a00640 1 -- 172.21.15.195:0/1920934175 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc0ab610 con 0x7fe9d40b2410 2024-01-31T05:03:52.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.702+0000 7fe9d0a00640 1 -- 172.21.15.195:0/1920934175 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9bc0ab770 con 0x7fe9d40b2410 2024-01-31T05:03:52.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.702+0000 7fe9d0a00640 1 -- 172.21.15.195:0/1920934175 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc0abb00 con 0x7fe9d40b2410 2024-01-31T05:03:52.709 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.702+0000 7fe9d8c00640 1 -- 172.21.15.195:0/1920934175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9d40b2410 msgr2=0x7fe9d406d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.709 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.702+0000 7fe9d8c00640 1 --2- 172.21.15.195:0/1920934175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9d40b2410 0x7fe9d406d090 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0097c0 tx=0x7fe9bc01c3f0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.709 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.702+0000 7fe9d8c00640 1 -- 172.21.15.195:0/1920934175 shutdown_connections 2024-01-31T05:03:52.709 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.702+0000 7fe9d8c00640 1 --2- 172.21.15.195:0/1920934175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9d40b2410 0x7fe9d406d090 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.709 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.702+0000 7fe9d8c00640 1 -- 172.21.15.195:0/1920934175 >> 172.21.15.195:0/1920934175 conn(0x7fe9d40668d0 msgr2=0x7fe9d406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:52.709 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.702+0000 7fe9d8c00640 1 -- 172.21.15.195:0/1920934175 shutdown_connections 2024-01-31T05:03:52.710 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.702+0000 7fe9d8c00640 1 -- 172.21.15.195:0/1920934175 wait complete. 2024-01-31T05:03:52.710 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d8c00640 1 Processor -- start 2024-01-31T05:03:52.710 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d8c00640 1 -- start start 2024-01-31T05:03:52.710 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d8c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9d40b2410 0x7fe9d40af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:52.710 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d8c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9d415d2b0 0x7fe9d414b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:52.710 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d8c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9d4161430 0x7fe9d414b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:52.710 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d8c00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d414ed30 con 0x7fe9d4161430 2024-01-31T05:03:52.710 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d8c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d415bdd0 con 0x7fe9d415d2b0 2024-01-31T05:03:52.710 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d8c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d414e390 con 0x7fe9d40b2410 2024-01-31T05:03:52.710 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d1400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9d415d2b0 0x7fe9d414b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:52.710 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d1e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9d40b2410 0x7fe9d40af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:52.710 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d1400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9d415d2b0 0x7fe9d414b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:47324/0 (socket says 172.21.15.195:47324) 2024-01-31T05:03:52.710 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d1400640 1 -- 172.21.15.195:0/1369774234 learned_addr learned my addr 172.21.15.195:0/1369774234 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-01-31T05:03:52.710 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d2800640 1 --2- 172.21.15.195:0/1369774234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9d4161430 0x7fe9d414b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:52.711 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d1400640 1 -- 172.21.15.195:0/1369774234 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9d40b2410 msgr2=0x7fe9d40af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.711 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d1400640 1 --2- 172.21.15.195:0/1369774234 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9d40b2410 0x7fe9d40af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.711 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d1400640 1 -- 172.21.15.195:0/1369774234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9d4161430 msgr2=0x7fe9d414b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.711 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d1400640 1 --2- 172.21.15.195:0/1369774234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9d4161430 0x7fe9d414b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.711 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d1400640 1 -- 172.21.15.195:0/1369774234 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9bc009420 con 0x7fe9d415d2b0 2024-01-31T05:03:52.711 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d1e00640 1 --2- 172.21.15.195:0/1369774234 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9d40b2410 0x7fe9d40af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:03:52.711 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d1400640 1 --2- 172.21.15.195:0/1369774234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9d415d2b0 0x7fe9d414b370 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc019000 tx=0x7fe9bc01ac30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:52.711 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9ca000640 1 -- 172.21.15.195:0/1369774234 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc0b5810 con 0x7fe9d415d2b0 2024-01-31T05:03:52.711 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9ca000640 1 -- 172.21.15.195:0/1369774234 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9bc0b5990 con 0x7fe9d415d2b0 2024-01-31T05:03:52.711 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9ca000640 1 -- 172.21.15.195:0/1369774234 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc0b5d40 con 0x7fe9d415d2b0 2024-01-31T05:03:52.711 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d8c00640 1 -- 172.21.15.195:0/1369774234 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d40ad150 con 0x7fe9d415d2b0 2024-01-31T05:03:52.711 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9d8c00640 1 -- 172.21.15.195:0/1369774234 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d414e950 con 0x7fe9d415d2b0 2024-01-31T05:03:52.711 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9ca000640 1 -- 172.21.15.195:0/1369774234 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe9bc0bf7a0 con 0x7fe9d415d2b0 2024-01-31T05:03:52.711 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.706+0000 7fe9ca000640 1 -- 172.21.15.195:0/1369774234 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fe9bc0c9c70 con 0x7fe9d415d2b0 2024-01-31T05:03:52.712 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.710+0000 7fe9d8c00640 1 -- 172.21.15.195:0/1369774234 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d4074860 con 0x7fe9d415d2b0 2024-01-31T05:03:52.712 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.710+0000 7fe9ca000640 1 -- 172.21.15.195:0/1369774234 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fe9bc0c4020 con 0x7fe9d415d2b0 2024-01-31T05:03:52.788 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.786+0000 7fe9d8c00640 1 -- 172.21.15.195:0/1369774234 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e856a6de-31fb-49e3-a1a3-3466b082d382", "id": 2} v 0) v1 -- 0x7fe9d40732c0 con 0x7fe9d415d2b0 2024-01-31T05:03:52.792 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.790+0000 7fe9ca000640 1 -- 172.21.15.195:0/1369774234 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e856a6de-31fb-49e3-a1a3-3466b082d382", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe9bc0c93f0 con 0x7fe9d415d2b0 2024-01-31T05:03:52.792 INFO:teuthology.orchestra.run.smithi195.stdout:2 2024-01-31T05:03:52.793 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.790+0000 7fe9d8c00640 1 -- 172.21.15.195:0/1369774234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9d415d2b0 msgr2=0x7fe9d414b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.793 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.790+0000 7fe9d8c00640 1 --2- 172.21.15.195:0/1369774234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9d415d2b0 0x7fe9d414b370 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc019000 tx=0x7fe9bc01ac30 comp rx=0 tx=0).stop 2024-01-31T05:03:52.794 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.794+0000 7fe9d8c00640 1 -- 172.21.15.195:0/1369774234 shutdown_connections 2024-01-31T05:03:52.794 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.794+0000 7fe9d8c00640 1 --2- 172.21.15.195:0/1369774234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9d4161430 0x7fe9d414b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.794 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.794+0000 7fe9d8c00640 1 --2- 172.21.15.195:0/1369774234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9d415d2b0 0x7fe9d414b370 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.794 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.794+0000 7fe9d8c00640 1 --2- 172.21.15.195:0/1369774234 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9d40b2410 0x7fe9d40af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.794 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.794+0000 7fe9d8c00640 1 -- 172.21.15.195:0/1369774234 >> 172.21.15.195:0/1369774234 conn(0x7fe9d40668d0 msgr2=0x7fe9d4156170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:52.794 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.794+0000 7fe9d8c00640 1 -- 172.21.15.195:0/1369774234 shutdown_connections 2024-01-31T05:03:52.794 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.794+0000 7fe9d8c00640 1 -- 172.21.15.195:0/1369774234 wait complete. 2024-01-31T05:03:52.812 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 3f50e95f-4597-42eb-98be-b6d8ab4d21c7 3 2024-01-31T05:03:52.948 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.946+0000 7fc87fc00640 1 Processor -- start 2024-01-31T05:03:52.948 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.946+0000 7fc87fc00640 1 -- start start 2024-01-31T05:03:52.950 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.950+0000 7fc87fc00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc878159fd0 0x7fc8780b2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:52.950 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.950+0000 7fc87fc00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc8780718f0 0x7fc8780ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:52.950 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.950+0000 7fc87fc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8780cd020 0x7fc878070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:52.950 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.950+0000 7fc87fc00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc87806d040 con 0x7fc878159fd0 2024-01-31T05:03:52.950 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.950+0000 7fc87fc00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8780b3340 con 0x7fc8780718f0 2024-01-31T05:03:52.950 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.950+0000 7fc87fc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8780b2d80 con 0x7fc8780cd020 2024-01-31T05:03:52.950 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.950+0000 7fc877e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc8780718f0 0x7fc8780ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:52.950 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.950+0000 7fc87dc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8780cd020 0x7fc878070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:52.950 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.950+0000 7fc877e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc8780718f0 0x7fc8780ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:47330/0 (socket says 172.21.15.195:47330) 2024-01-31T05:03:52.950 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.950+0000 7fc877e00640 1 -- 172.21.15.195:0/606437805 learned_addr learned my addr 172.21.15.195:0/606437805 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-01-31T05:03:52.950 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.950+0000 7fc87d200640 1 --2- 172.21.15.195:0/606437805 >> v2:172.21.15.49:3300/0 conn(0x7fc878159fd0 0x7fc8780b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:52.951 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.950+0000 7fc877e00640 1 -- 172.21.15.195:0/606437805 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8780cd020 msgr2=0x7fc878070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:03:52.951 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.950+0000 7fc877e00640 1 --2- 172.21.15.195:0/606437805 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8780cd020 0x7fc878070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.951 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.950+0000 7fc877e00640 1 -- 172.21.15.195:0/606437805 >> v2:172.21.15.49:3300/0 conn(0x7fc878159fd0 msgr2=0x7fc8780b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:03:52.951 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.950+0000 7fc877e00640 1 --2- 172.21.15.195:0/606437805 >> v2:172.21.15.49:3300/0 conn(0x7fc878159fd0 0x7fc8780b2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.951 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.950+0000 7fc877e00640 1 -- 172.21.15.195:0/606437805 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8780b3060 con 0x7fc8780718f0 2024-01-31T05:03:52.951 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.950+0000 7fc87dc00640 1 --2- 172.21.15.195:0/606437805 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8780cd020 0x7fc878070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:03:52.953 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.950+0000 7fc877e00640 1 --2- 172.21.15.195:0/606437805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8780718f0 0x7fc8780ccae0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc8780cc290 tx=0x7fc86001c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebaa00eb1da048cc server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:52.954 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.954+0000 7fc877400640 1 -- 172.21.15.195:0/606437805 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8600a5920 con 0x7fc8780718f0 2024-01-31T05:03:52.954 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.954+0000 7fc877400640 1 -- 172.21.15.195:0/606437805 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8600a5a80 con 0x7fc8780718f0 2024-01-31T05:03:52.954 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.954+0000 7fc877400640 1 -- 172.21.15.195:0/606437805 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8600a5e10 con 0x7fc8780718f0 2024-01-31T05:03:52.954 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.954+0000 7fc87fc00640 1 -- 172.21.15.195:0/606437805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8780718f0 msgr2=0x7fc8780ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.954 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.954+0000 7fc87fc00640 1 --2- 172.21.15.195:0/606437805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8780718f0 0x7fc8780ccae0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc8780cc290 tx=0x7fc86001c990 comp rx=0 tx=0).stop 2024-01-31T05:03:52.955 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.954+0000 7fc87fc00640 1 -- 172.21.15.195:0/606437805 shutdown_connections 2024-01-31T05:03:52.955 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.954+0000 7fc87fc00640 1 --2- 172.21.15.195:0/606437805 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8780cd020 0x7fc878070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.955 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.954+0000 7fc87fc00640 1 --2- 172.21.15.195:0/606437805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8780718f0 0x7fc8780ccae0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.955 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.954+0000 7fc87fc00640 1 --2- 172.21.15.195:0/606437805 >> v2:172.21.15.49:3300/0 conn(0x7fc878159fd0 0x7fc8780b2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.955 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.954+0000 7fc87fc00640 1 -- 172.21.15.195:0/606437805 >> 172.21.15.195:0/606437805 conn(0x7fc8780668d0 msgr2=0x7fc87806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:52.955 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.954+0000 7fc87fc00640 1 -- 172.21.15.195:0/606437805 shutdown_connections 2024-01-31T05:03:52.955 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.954+0000 7fc87fc00640 1 -- 172.21.15.195:0/606437805 wait complete. 2024-01-31T05:03:52.956 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.954+0000 7fc87fc00640 1 Processor -- start 2024-01-31T05:03:52.956 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.954+0000 7fc87fc00640 1 -- start start 2024-01-31T05:03:52.958 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc87fc00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8780718f0 0x7fc87814c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:52.958 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc87fc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8780cd020 0x7fc8780ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:52.958 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc87fc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc878159fd0 0x7fc8781575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:52.958 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc87fc00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87814ca20 con 0x7fc8780718f0 2024-01-31T05:03:52.958 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc87fc00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87814cd00 con 0x7fc878159fd0 2024-01-31T05:03:52.958 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc87fc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc878152fa0 con 0x7fc8780cd020 2024-01-31T05:03:52.958 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc877e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8780cd020 0x7fc8780ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:52.958 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc87dc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc878159fd0 0x7fc8781575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:52.959 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc877e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8780cd020 0x7fc8780ce590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:58318/0 (socket says 172.21.15.195:58318) 2024-01-31T05:03:52.959 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc877e00640 1 -- 172.21.15.195:0/3231193673 learned_addr learned my addr 172.21.15.195:0/3231193673 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-01-31T05:03:52.959 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc87d200640 1 --2- 172.21.15.195:0/3231193673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8780718f0 0x7fc87814c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:52.960 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc877e00640 1 -- 172.21.15.195:0/3231193673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc878159fd0 msgr2=0x7fc8781575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.960 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc877e00640 1 --2- 172.21.15.195:0/3231193673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc878159fd0 0x7fc8781575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.960 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc877e00640 1 -- 172.21.15.195:0/3231193673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8780718f0 msgr2=0x7fc87814c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:52.961 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc877e00640 1 --2- 172.21.15.195:0/3231193673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8780718f0 0x7fc87814c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:52.961 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc877e00640 1 -- 172.21.15.195:0/3231193673 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87000f050 con 0x7fc8780cd020 2024-01-31T05:03:52.961 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc877e00640 1 --2- 172.21.15.195:0/3231193673 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8780cd020 0x7fc8780ce590 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc86000b2c0 tx=0x7fc860019730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:52.961 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc874c00640 1 -- 172.21.15.195:0/3231193673 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8600add20 con 0x7fc8780cd020 2024-01-31T05:03:52.961 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc874c00640 1 -- 172.21.15.195:0/3231193673 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8600b6460 con 0x7fc8780cd020 2024-01-31T05:03:52.961 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc87fc00640 1 -- 172.21.15.195:0/3231193673 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86000b580 con 0x7fc8780cd020 2024-01-31T05:03:52.961 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc874c00640 1 -- 172.21.15.195:0/3231193673 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8600adea0 con 0x7fc8780cd020 2024-01-31T05:03:52.961 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc87fc00640 1 -- 172.21.15.195:0/3231193673 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc878153560 con 0x7fc8780cd020 2024-01-31T05:03:52.961 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc874c00640 1 -- 172.21.15.195:0/3231193673 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc8600b4070 con 0x7fc8780cd020 2024-01-31T05:03:52.961 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc874c00640 1 -- 172.21.15.195:0/3231193673 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fc8600b88c0 con 0x7fc8780cd020 2024-01-31T05:03:52.961 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.958+0000 7fc87fc00640 1 -- 172.21.15.195:0/3231193673 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8780cf420 con 0x7fc8780cd020 2024-01-31T05:03:52.963 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:52.962+0000 7fc874c00640 1 -- 172.21.15.195:0/3231193673 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fc8600be070 con 0x7fc8780cd020 2024-01-31T05:03:53.030 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.030+0000 7fc87fc00640 1 -- 172.21.15.195:0/3231193673 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3f50e95f-4597-42eb-98be-b6d8ab4d21c7", "id": 3} v 0) v1 -- 0x7fc878074860 con 0x7fc8780cd020 2024-01-31T05:03:53.034 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.034+0000 7fc874c00640 1 -- 172.21.15.195:0/3231193673 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3f50e95f-4597-42eb-98be-b6d8ab4d21c7", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc8600b2070 con 0x7fc8780cd020 2024-01-31T05:03:53.034 INFO:teuthology.orchestra.run.smithi195.stdout:3 2024-01-31T05:03:53.035 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:53.034+0000 7feb06049180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-31T05:03:53.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.034+0000 7fc87fc00640 1 -- 172.21.15.195:0/3231193673 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8780cd020 msgr2=0x7fc8780ce590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.034+0000 7fc87fc00640 1 --2- 172.21.15.195:0/3231193673 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8780cd020 0x7fc8780ce590 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc86000b2c0 tx=0x7fc860019730 comp rx=0 tx=0).stop 2024-01-31T05:03:53.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.034+0000 7fc87fc00640 1 -- 172.21.15.195:0/3231193673 shutdown_connections 2024-01-31T05:03:53.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.034+0000 7fc87fc00640 1 --2- 172.21.15.195:0/3231193673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc878159fd0 0x7fc8781575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.034+0000 7fc87fc00640 1 --2- 172.21.15.195:0/3231193673 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8780cd020 0x7fc8780ce590 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.034+0000 7fc87fc00640 1 --2- 172.21.15.195:0/3231193673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8780718f0 0x7fc87814c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.034+0000 7fc87fc00640 1 -- 172.21.15.195:0/3231193673 >> 172.21.15.195:0/3231193673 conn(0x7fc8780668d0 msgr2=0x7fc8780c5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:53.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.034+0000 7fc87fc00640 1 -- 172.21.15.195:0/3231193673 shutdown_connections 2024-01-31T05:03:53.037 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.034+0000 7fc87fc00640 1 -- 172.21.15.195:0/3231193673 wait complete. 2024-01-31T05:03:53.063 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new fd4f0aa2-91d0-417e-9ef6-264932a2f796 4 2024-01-31T05:03:53.064 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:53.062+0000 7f1f0cdd4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-31T05:03:53.109 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:53.106+0000 7feb06049180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-31T05:03:53.128 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:53.126+0000 7f1f0cdd4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-31T05:03:53.171 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:53.170+0000 7feb06049180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-31T05:03:53.192 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:53.190+0000 7f1f0cdd4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-31T05:03:53.200 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.198+0000 7f52a3600640 1 Processor -- start 2024-01-31T05:03:53.200 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.198+0000 7f52a3600640 1 -- start start 2024-01-31T05:03:53.201 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.198+0000 7f52a3600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529c15d540 0x7f529c0cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:53.201 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.202+0000 7f52a3600640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529c0cef80 con 0x7f529c0cbbc0 2024-01-31T05:03:53.202 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.202+0000 7f52a3600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529c06cae0 con 0x7f529c06c290 2024-01-31T05:03:53.202 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.202+0000 7f52a3600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529c0cf1b0 con 0x7f529c15d540 2024-01-31T05:03:53.202 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.202+0000 7f529be00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f529c06c290 0x7f529c0cb4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:44304/0 (socket says 172.21.15.195:44304) 2024-01-31T05:03:53.202 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.202+0000 7f52a0c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529c15d540 0x7f529c0cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:53.202 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.202+0000 7f529be00640 1 -- 172.21.15.195:0/2221237935 learned_addr learned my addr 172.21.15.195:0/2221237935 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-01-31T05:03:53.202 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.202+0000 7f52a0c00640 1 -- 172.21.15.195:0/2221237935 >> v1:172.21.15.195:6789/0 conn(0x7f529c06c290 legacy=0x7f529c0cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.203 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.202+0000 7f52a0c00640 1 -- 172.21.15.195:0/2221237935 >> v1:172.21.15.49:6789/0 conn(0x7f529c0cbbc0 legacy=0x7f529c15d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.203 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.202+0000 7f52a0c00640 1 -- 172.21.15.195:0/2221237935 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c0cf490 con 0x7f529c15d540 2024-01-31T05:03:53.205 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.202+0000 7f52a0c00640 1 --2- 172.21.15.195:0/2221237935 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529c15d540 0x7f529c0cff70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f528c009770 tx=0x7f528c01c2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f86cce057ce42f0c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:53.205 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.202+0000 7f529b400640 1 -- 172.21.15.195:0/2221237935 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0ac640 con 0x7f529c15d540 2024-01-31T05:03:53.205 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.206+0000 7f529b400640 1 -- 172.21.15.195:0/2221237935 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c0ac7a0 con 0x7f529c15d540 2024-01-31T05:03:53.205 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.206+0000 7f529b400640 1 -- 172.21.15.195:0/2221237935 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0acb30 con 0x7f529c15d540 2024-01-31T05:03:53.206 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.206+0000 7f52a3600640 1 -- 172.21.15.195:0/2221237935 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529c15d540 msgr2=0x7f529c0cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.206 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.206+0000 7f52a3600640 1 --2- 172.21.15.195:0/2221237935 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529c15d540 0x7f529c0cff70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f528c009770 tx=0x7f528c01c2f0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.206 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.206+0000 7f52a3600640 1 -- 172.21.15.195:0/2221237935 shutdown_connections 2024-01-31T05:03:53.206 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.206+0000 7f52a3600640 1 --2- 172.21.15.195:0/2221237935 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529c15d540 0x7f529c0cff70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.207 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.206+0000 7f52a3600640 1 -- 172.21.15.195:0/2221237935 >> 172.21.15.195:0/2221237935 conn(0x7f529c0d0e60 msgr2=0x7f529c0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:53.207 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.206+0000 7f52a3600640 1 -- 172.21.15.195:0/2221237935 shutdown_connections 2024-01-31T05:03:53.207 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.206+0000 7f52a3600640 1 -- 172.21.15.195:0/2221237935 wait complete. 2024-01-31T05:03:53.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.206+0000 7f52a3600640 1 Processor -- start 2024-01-31T05:03:53.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.206+0000 7f52a3600640 1 -- start start 2024-01-31T05:03:53.211 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.206+0000 7f52a3600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f529c06c290 0x7f529c14d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:53.211 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.206+0000 7f52a3600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529c0cbbc0 0x7f529c0b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:53.211 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.206+0000 7f52a3600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f529c15d540 0x7f529c0b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:53.211 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.206+0000 7f52a3600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c1599f0 con 0x7f529c06c290 2024-01-31T05:03:53.211 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.206+0000 7f52a3600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c0b65a0 con 0x7f529c15d540 2024-01-31T05:03:53.211 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f52a3600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529c0b5fe0 con 0x7f529c0cbbc0 2024-01-31T05:03:53.211 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f529be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529c0cbbc0 0x7f529c0b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:53.211 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f52a1600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f529c15d540 0x7f529c0b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:53.211 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f529be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529c0cbbc0 0x7f529c0b5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:58344/0 (socket says 172.21.15.195:58344) 2024-01-31T05:03:53.211 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f529be00640 1 -- 172.21.15.195:0/2080977717 learned_addr learned my addr 172.21.15.195:0/2080977717 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-01-31T05:03:53.211 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f52a0c00640 1 --2- 172.21.15.195:0/2080977717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f529c06c290 0x7f529c14d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:53.211 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f529be00640 1 -- 172.21.15.195:0/2080977717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f529c15d540 msgr2=0x7f529c0b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.212 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f529be00640 1 --2- 172.21.15.195:0/2080977717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f529c15d540 0x7f529c0b59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.212 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f529be00640 1 -- 172.21.15.195:0/2080977717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f529c06c290 msgr2=0x7f529c14d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.212 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f529be00640 1 --2- 172.21.15.195:0/2080977717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f529c06c290 0x7f529c14d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.212 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f529be00640 1 -- 172.21.15.195:0/2080977717 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528c009420 con 0x7f529c0cbbc0 2024-01-31T05:03:53.212 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f529be00640 1 --2- 172.21.15.195:0/2080977717 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529c0cbbc0 0x7f529c0b5470 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5284009e20 tx=0x7f528400c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:53.212 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f5298c00640 1 -- 172.21.15.195:0/2080977717 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5284007af0 con 0x7f529c0cbbc0 2024-01-31T05:03:53.212 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f5298c00640 1 -- 172.21.15.195:0/2080977717 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5284007c50 con 0x7f529c0cbbc0 2024-01-31T05:03:53.212 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f5298c00640 1 -- 172.21.15.195:0/2080977717 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528400ce10 con 0x7f529c0cbbc0 2024-01-31T05:03:53.212 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f52a3600640 1 -- 172.21.15.195:0/2080977717 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529c0b62c0 con 0x7f529c0cbbc0 2024-01-31T05:03:53.212 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f52a3600640 1 -- 172.21.15.195:0/2080977717 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529c0c8320 con 0x7f529c0cbbc0 2024-01-31T05:03:53.212 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f5298c00640 1 -- 172.21.15.195:0/2080977717 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5284009070 con 0x7f529c0cbbc0 2024-01-31T05:03:53.213 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f5298c00640 1 -- 172.21.15.195:0/2080977717 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f5284014ce0 con 0x7f529c0cbbc0 2024-01-31T05:03:53.213 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.210+0000 7f52a3600640 1 -- 172.21.15.195:0/2080977717 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529c0ce880 con 0x7f529c0cbbc0 2024-01-31T05:03:53.214 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.214+0000 7f5298c00640 1 -- 172.21.15.195:0/2080977717 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f5284023060 con 0x7f529c0cbbc0 2024-01-31T05:03:53.263 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:53.262+0000 7feb06049180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-31T05:03:53.280 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.278+0000 7f52a3600640 1 -- 172.21.15.195:0/2080977717 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fd4f0aa2-91d0-417e-9ef6-264932a2f796", "id": 4} v 0) v1 -- 0x7f529c074860 con 0x7f529c0cbbc0 2024-01-31T05:03:53.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.282+0000 7f5298c00640 1 -- 172.21.15.195:0/2080977717 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fd4f0aa2-91d0-417e-9ef6-264932a2f796", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5284019070 con 0x7f529c0cbbc0 2024-01-31T05:03:53.284 INFO:teuthology.orchestra.run.smithi195.stdout:4 2024-01-31T05:03:53.285 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:53.286+0000 7f1f0cdd4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-31T05:03:53.286 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.282+0000 7f52a3600640 1 -- 172.21.15.195:0/2080977717 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529c0cbbc0 msgr2=0x7f529c0b5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.286 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.282+0000 7f52a3600640 1 --2- 172.21.15.195:0/2080977717 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529c0cbbc0 0x7f529c0b5470 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5284009e20 tx=0x7f528400c430 comp rx=0 tx=0).stop 2024-01-31T05:03:53.286 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.286+0000 7f52a3600640 1 -- 172.21.15.195:0/2080977717 shutdown_connections 2024-01-31T05:03:53.286 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.286+0000 7f52a3600640 1 --2- 172.21.15.195:0/2080977717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f529c15d540 0x7f529c0b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.286 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.286+0000 7f52a3600640 1 --2- 172.21.15.195:0/2080977717 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529c0cbbc0 0x7f529c0b5470 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.286 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.286+0000 7f52a3600640 1 --2- 172.21.15.195:0/2080977717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f529c06c290 0x7f529c14d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.286 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.286+0000 7f52a3600640 1 -- 172.21.15.195:0/2080977717 >> 172.21.15.195:0/2080977717 conn(0x7f529c0d0e60 msgr2=0x7f529c15e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:53.286 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.286+0000 7f52a3600640 1 -- 172.21.15.195:0/2080977717 shutdown_connections 2024-01-31T05:03:53.286 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.286+0000 7f52a3600640 1 -- 172.21.15.195:0/2080977717 wait complete. 2024-01-31T05:03:53.304 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 1db1184e-4b43-4add-ba72-7da0fe4c549e 5 2024-01-31T05:03:53.326 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:53.326+0000 7feb06049180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-31T05:03:53.348 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:53.346+0000 7f1f0cdd4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-31T05:03:53.418 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:53.418+0000 7feb06049180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-31T05:03:53.471 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:53.442+0000 7f1f0cdd4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-31T05:03:53.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.462+0000 7fa264200640 1 Processor -- start 2024-01-31T05:03:53.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.462+0000 7fa264200640 1 -- start start 2024-01-31T05:03:53.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.462+0000 7fa264200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa25c15d540 0x7fa25c0cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:53.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.462+0000 7fa264200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa25c06c290 0x7fa25c0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:53.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.462+0000 7fa264200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa25c0cb9f0 0x7fa25c0cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:53.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.462+0000 7fa264200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa25c0cef80 con 0x7fa25c15d540 2024-01-31T05:03:53.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.462+0000 7fa264200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa25c06cae0 con 0x7fa25c0cb9f0 2024-01-31T05:03:53.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.462+0000 7fa264200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0cf1b0 con 0x7fa25c06c290 2024-01-31T05:03:53.477 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.462+0000 7fa260e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa25c06c290 0x7fa25c0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:53.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.462+0000 7fa262200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa25c0cb9f0 0x7fa25c0cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:53.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.462+0000 7fa260e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa25c06c290 0x7fa25c0cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:58354/0 (socket says 172.21.15.195:58354) 2024-01-31T05:03:53.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.462+0000 7fa260e00640 1 -- 172.21.15.195:0/3212530678 learned_addr learned my addr 172.21.15.195:0/3212530678 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-01-31T05:03:53.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.462+0000 7fa261800640 1 --2- 172.21.15.195:0/3212530678 >> v2:172.21.15.49:3300/0 conn(0x7fa25c15d540 0x7fa25c0cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:53.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.462+0000 7fa261800640 1 -- 172.21.15.195:0/3212530678 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa25c06c290 msgr2=0x7fa25c0cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:03:53.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.462+0000 7fa261800640 1 --2- 172.21.15.195:0/3212530678 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa25c06c290 0x7fa25c0cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.462+0000 7fa261800640 1 -- 172.21.15.195:0/3212530678 >> v2:172.21.15.195:3300/0 conn(0x7fa25c0cb9f0 msgr2=0x7fa25c0cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:03:53.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.462+0000 7fa261800640 1 --2- 172.21.15.195:0/3212530678 >> v2:172.21.15.195:3300/0 conn(0x7fa25c0cb9f0 0x7fa25c0cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.462+0000 7fa261800640 1 -- 172.21.15.195:0/3212530678 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c0cf490 con 0x7fa25c15d540 2024-01-31T05:03:53.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.462+0000 7fa262200640 1 --2- 172.21.15.195:0/3212530678 >> v2:172.21.15.195:3300/0 conn(0x7fa25c0cb9f0 0x7fa25c0cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:03:53.478 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.466+0000 7fa261800640 1 --2- 172.21.15.195:0/3212530678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa25c15d540 0x7fa25c0cff70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa25c06b750 tx=0x7fa24c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0375bd6a43c374 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:53.479 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.466+0000 7fa25be00640 1 -- 172.21.15.195:0/3212530678 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c0ab5f0 con 0x7fa25c15d540 2024-01-31T05:03:53.479 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.466+0000 7fa25be00640 1 -- 172.21.15.195:0/3212530678 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24c0ab750 con 0x7fa25c15d540 2024-01-31T05:03:53.479 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.466+0000 7fa25be00640 1 -- 172.21.15.195:0/3212530678 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c0abae0 con 0x7fa25c15d540 2024-01-31T05:03:53.479 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.466+0000 7fa264200640 1 -- 172.21.15.195:0/3212530678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa25c15d540 msgr2=0x7fa25c0cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.479 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.466+0000 7fa264200640 1 --2- 172.21.15.195:0/3212530678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa25c15d540 0x7fa25c0cff70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa25c06b750 tx=0x7fa24c01c430 comp rx=0 tx=0).stop 2024-01-31T05:03:53.479 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa264200640 1 -- 172.21.15.195:0/3212530678 shutdown_connections 2024-01-31T05:03:53.479 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa264200640 1 --2- 172.21.15.195:0/3212530678 >> v2:172.21.15.195:3300/0 conn(0x7fa25c0cb9f0 0x7fa25c0cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.479 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa264200640 1 --2- 172.21.15.195:0/3212530678 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa25c06c290 0x7fa25c0cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.479 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa264200640 1 --2- 172.21.15.195:0/3212530678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa25c15d540 0x7fa25c0cff70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.479 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa264200640 1 -- 172.21.15.195:0/3212530678 >> 172.21.15.195:0/3212530678 conn(0x7fa25c0d0e60 msgr2=0x7fa25c0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:53.480 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa264200640 1 -- 172.21.15.195:0/3212530678 shutdown_connections 2024-01-31T05:03:53.480 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa264200640 1 -- 172.21.15.195:0/3212530678 wait complete. 2024-01-31T05:03:53.480 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa264200640 1 Processor -- start 2024-01-31T05:03:53.480 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa264200640 1 -- start start 2024-01-31T05:03:53.480 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa264200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa25c06c290 0x7fa25c0c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:53.480 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa264200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa25c0cb9f0 0x7fa25c15b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:53.480 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa264200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa25c15d540 0x7fa25c0b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:53.480 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa264200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0c53a0 con 0x7fa25c15d540 2024-01-31T05:03:53.480 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa264200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0c5680 con 0x7fa25c06c290 2024-01-31T05:03:53.480 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa264200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c1550a0 con 0x7fa25c0cb9f0 2024-01-31T05:03:53.480 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa261800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa25c06c290 0x7fa25c0c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:53.481 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa260e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa25c0cb9f0 0x7fa25c15b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:53.481 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa261800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa25c06c290 0x7fa25c0c4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:47366/0 (socket says 172.21.15.195:47366) 2024-01-31T05:03:53.481 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa261800640 1 -- 172.21.15.195:0/3746935008 learned_addr learned my addr 172.21.15.195:0/3746935008 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-01-31T05:03:53.481 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa262200640 1 --2- 172.21.15.195:0/3746935008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa25c15d540 0x7fa25c0b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:53.481 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa260e00640 1 -- 172.21.15.195:0/3746935008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa25c06c290 msgr2=0x7fa25c0c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.481 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa260e00640 1 --2- 172.21.15.195:0/3746935008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa25c06c290 0x7fa25c0c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.481 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa260e00640 1 -- 172.21.15.195:0/3746935008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa25c15d540 msgr2=0x7fa25c0b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.481 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa260e00640 1 --2- 172.21.15.195:0/3746935008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa25c15d540 0x7fa25c0b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.481 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa260e00640 1 -- 172.21.15.195:0/3746935008 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa254009a70 con 0x7fa25c0cb9f0 2024-01-31T05:03:53.481 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.470+0000 7fa261800640 1 --2- 172.21.15.195:0/3746935008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa25c06c290 0x7fa25c0c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:03:53.481 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.474+0000 7fa260e00640 1 --2- 172.21.15.195:0/3746935008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa25c0cb9f0 0x7fa25c15b530 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa24400e870 tx=0x7fa24400ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:53.482 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.474+0000 7fa259600640 1 -- 172.21.15.195:0/3746935008 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24400eec0 con 0x7fa25c0cb9f0 2024-01-31T05:03:53.482 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.474+0000 7fa259600640 1 -- 172.21.15.195:0/3746935008 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24400c940 con 0x7fa25c0cb9f0 2024-01-31T05:03:53.482 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.474+0000 7fa264200640 1 -- 172.21.15.195:0/3746935008 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24c009420 con 0x7fa25c0cb9f0 2024-01-31T05:03:53.482 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.474+0000 7fa259600640 1 -- 172.21.15.195:0/3746935008 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24400ccb0 con 0x7fa25c0cb9f0 2024-01-31T05:03:53.482 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.474+0000 7fa264200640 1 -- 172.21.15.195:0/3746935008 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25c155660 con 0x7fa25c0cb9f0 2024-01-31T05:03:53.482 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.474+0000 7fa259600640 1 -- 172.21.15.195:0/3746935008 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa2440059a0 con 0x7fa25c0cb9f0 2024-01-31T05:03:53.482 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.474+0000 7fa259600640 1 -- 172.21.15.195:0/3746935008 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fa244005c50 con 0x7fa25c0cb9f0 2024-01-31T05:03:53.482 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.474+0000 7fa264200640 1 -- 172.21.15.195:0/3746935008 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25c0ce880 con 0x7fa25c0cb9f0 2024-01-31T05:03:53.483 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.478+0000 7fa259600640 1 -- 172.21.15.195:0/3746935008 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fa244021060 con 0x7fa25c0cb9f0 2024-01-31T05:03:53.483 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:53.482+0000 7feb06049180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-31T05:03:53.503 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:53.502+0000 7f1f0cdd4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-31T05:03:53.546 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.546+0000 7fa264200640 1 -- 172.21.15.195:0/3746935008 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1db1184e-4b43-4add-ba72-7da0fe4c549e", "id": 5} v 0) v1 -- 0x7fa25c0ce4e0 con 0x7fa25c0cb9f0 2024-01-31T05:03:53.550 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.550+0000 7fa259600640 1 -- 172.21.15.195:0/3746935008 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1db1184e-4b43-4add-ba72-7da0fe4c549e", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa244029020 con 0x7fa25c0cb9f0 2024-01-31T05:03:53.550 INFO:teuthology.orchestra.run.smithi195.stdout:5 2024-01-31T05:03:53.551 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.550+0000 7fa264200640 1 -- 172.21.15.195:0/3746935008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa25c0cb9f0 msgr2=0x7fa25c15b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.551 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.550+0000 7fa264200640 1 --2- 172.21.15.195:0/3746935008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa25c0cb9f0 0x7fa25c15b530 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa24400e870 tx=0x7fa24400ec70 comp rx=0 tx=0).stop 2024-01-31T05:03:53.551 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.550+0000 7fa264200640 1 -- 172.21.15.195:0/3746935008 shutdown_connections 2024-01-31T05:03:53.551 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.550+0000 7fa264200640 1 --2- 172.21.15.195:0/3746935008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa25c15d540 0x7fa25c0b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.552 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.550+0000 7fa264200640 1 --2- 172.21.15.195:0/3746935008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa25c0cb9f0 0x7fa25c15b530 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.552 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.550+0000 7fa264200640 1 --2- 172.21.15.195:0/3746935008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa25c06c290 0x7fa25c0c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.552 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.550+0000 7fa264200640 1 -- 172.21.15.195:0/3746935008 >> 172.21.15.195:0/3746935008 conn(0x7fa25c0d0e60 msgr2=0x7fa25c0d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:53.552 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.550+0000 7fa264200640 1 -- 172.21.15.195:0/3746935008 shutdown_connections 2024-01-31T05:03:53.552 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.550+0000 7fa264200640 1 -- 172.21.15.195:0/3746935008 wait complete. 2024-01-31T05:03:53.570 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new bf8ae0f1-81cc-494e-aa41-55a500276942 6 2024-01-31T05:03:53.644 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:53.642+0000 7feb06049180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-31T05:03:53.672 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:53.674+0000 7f1f0cdd4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-31T05:03:53.706 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.706+0000 7fdbf6e00640 1 Processor -- start 2024-01-31T05:03:53.706 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.706+0000 7fdbf6e00640 1 -- start start 2024-01-31T05:03:53.708 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.706+0000 7fdbf6e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdbf006ae80 0x7fdbf0072000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:53.708 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.706+0000 7fdbf6e00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf00cb140 con 0x7fdbf015ae90 2024-01-31T05:03:53.708 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.706+0000 7fdbf6e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf015e3a0 con 0x7fdbf015d720 2024-01-31T05:03:53.708 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.706+0000 7fdbf6e00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf00af490 con 0x7fdbf006ae80 2024-01-31T05:03:53.708 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.706+0000 7fdbf4e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fdbf015d720 0x7fdbf015db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:44320/0 (socket says 172.21.15.195:44320) 2024-01-31T05:03:53.708 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.706+0000 7fdbf4e00640 1 -- 172.21.15.195:0/4143500232 learned_addr learned my addr 172.21.15.195:0/4143500232 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-01-31T05:03:53.708 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.706+0000 7fdbef400640 1 --2- 172.21.15.195:0/4143500232 >> v2:172.21.15.49:3300/0 conn(0x7fdbf006ae80 0x7fdbf0072000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:53.709 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.706+0000 7fdbeea00640 1 -- 172.21.15.195:0/4143500232 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954337513 0 0) 0x7fdbf015e3a0 con 0x7fdbf015d720 2024-01-31T05:03:53.709 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.706+0000 7fdbeea00640 1 -- 172.21.15.195:0/4143500232 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbd0003530 con 0x7fdbf015d720 2024-01-31T05:03:53.709 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.706+0000 7fdbeea00640 1 -- 172.21.15.195:0/4143500232 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2738494474 0 0) 0x7fdbe0001120 con 0x7fdbf015ae90 2024-01-31T05:03:53.709 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.706+0000 7fdbeea00640 1 -- 172.21.15.195:0/4143500232 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbf015e3a0 con 0x7fdbf015ae90 2024-01-31T05:03:53.709 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.706+0000 7fdbef400640 1 -- 172.21.15.195:0/4143500232 >> v1:172.21.15.195:6789/0 conn(0x7fdbf015d720 legacy=0x7fdbf015db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.709 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.706+0000 7fdbef400640 1 -- 172.21.15.195:0/4143500232 >> v1:172.21.15.49:6789/0 conn(0x7fdbf015ae90 legacy=0x7fdbf006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.709 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.706+0000 7fdbef400640 1 -- 172.21.15.195:0/4143500232 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf015e680 con 0x7fdbf006ae80 2024-01-31T05:03:53.711 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.710+0000 7fdbef400640 1 --2- 172.21.15.195:0/4143500232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbf006ae80 0x7fdbf0072000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80097c0 tx=0x7fdbd801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fabca5fc037bc22c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:53.711 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.710+0000 7fdbeea00640 1 -- 172.21.15.195:0/4143500232 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd80ab600 con 0x7fdbf006ae80 2024-01-31T05:03:53.711 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.710+0000 7fdbeea00640 1 -- 172.21.15.195:0/4143500232 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd80a7050 con 0x7fdbf006ae80 2024-01-31T05:03:53.711 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.710+0000 7fdbeea00640 1 -- 172.21.15.195:0/4143500232 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd80ab980 con 0x7fdbf006ae80 2024-01-31T05:03:53.712 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.710+0000 7fdbf6e00640 1 -- 172.21.15.195:0/4143500232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbf006ae80 msgr2=0x7fdbf0072000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.712 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.710+0000 7fdbf6e00640 1 --2- 172.21.15.195:0/4143500232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbf006ae80 0x7fdbf0072000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80097c0 tx=0x7fdbd801c3f0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.712 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.710+0000 7fdbf6e00640 1 -- 172.21.15.195:0/4143500232 shutdown_connections 2024-01-31T05:03:53.712 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.710+0000 7fdbf6e00640 1 --2- 172.21.15.195:0/4143500232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbf006ae80 0x7fdbf0072000 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.713 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.710+0000 7fdbf6e00640 1 -- 172.21.15.195:0/4143500232 >> 172.21.15.195:0/4143500232 conn(0x7fdbf00cfda0 msgr2=0x7fdbf00d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:53.713 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.710+0000 7fdbf6e00640 1 -- 172.21.15.195:0/4143500232 shutdown_connections 2024-01-31T05:03:53.713 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.710+0000 7fdbf6e00640 1 -- 172.21.15.195:0/4143500232 wait complete. 2024-01-31T05:03:53.714 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbf6e00640 1 Processor -- start 2024-01-31T05:03:53.714 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbf6e00640 1 -- start start 2024-01-31T05:03:53.716 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbf6e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdbf006ae80 0x7fdbf00b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:53.716 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbf6e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbf015ae90 0x7fdbf00af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:53.716 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbf6e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbf015d720 0x7fdbf01585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:53.716 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbf6e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf00b1e60 con 0x7fdbf015d720 2024-01-31T05:03:53.716 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbf6e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf01572d0 con 0x7fdbf015ae90 2024-01-31T05:03:53.716 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbf6e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf0157520 con 0x7fdbf006ae80 2024-01-31T05:03:53.717 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbef400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbf015ae90 0x7fdbf00af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:53.717 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbefe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdbf006ae80 0x7fdbf00b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:53.717 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbef400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbf015ae90 0x7fdbf00af9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:47376/0 (socket says 172.21.15.195:47376) 2024-01-31T05:03:53.717 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbef400640 1 -- 172.21.15.195:0/1703241523 learned_addr learned my addr 172.21.15.195:0/1703241523 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-01-31T05:03:53.717 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbf4e00640 1 --2- 172.21.15.195:0/1703241523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbf015d720 0x7fdbf01585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:53.717 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbef400640 1 -- 172.21.15.195:0/1703241523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdbf006ae80 msgr2=0x7fdbf00b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.717 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbef400640 1 --2- 172.21.15.195:0/1703241523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdbf006ae80 0x7fdbf00b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.717 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbef400640 1 -- 172.21.15.195:0/1703241523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbf015d720 msgr2=0x7fdbf01585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.717 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbef400640 1 --2- 172.21.15.195:0/1703241523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbf015d720 0x7fdbf01585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.717 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbef400640 1 -- 172.21.15.195:0/1703241523 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd8009420 con 0x7fdbf015ae90 2024-01-31T05:03:53.717 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbefe00640 1 --2- 172.21.15.195:0/1703241523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdbf006ae80 0x7fdbf00b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:03:53.717 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbf4e00640 1 --2- 172.21.15.195:0/1703241523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbf015d720 0x7fdbf01585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:03:53.718 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:53.714+0000 7feb06049180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-31T05:03:53.719 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbef400640 1 --2- 172.21.15.195:0/1703241523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbf015ae90 0x7fdbf00af9e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8019000 tx=0x7fdbd8019190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:53.719 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbe7e00640 1 -- 172.21.15.195:0/1703241523 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd80abea0 con 0x7fdbf015ae90 2024-01-31T05:03:53.719 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbe7e00640 1 -- 172.21.15.195:0/1703241523 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd80b4430 con 0x7fdbf015ae90 2024-01-31T05:03:53.719 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbf6e00640 1 -- 172.21.15.195:0/1703241523 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf0157800 con 0x7fdbf015ae90 2024-01-31T05:03:53.719 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbe7e00640 1 -- 172.21.15.195:0/1703241523 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd80b47c0 con 0x7fdbf015ae90 2024-01-31T05:03:53.719 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbf6e00640 1 -- 172.21.15.195:0/1703241523 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf0157dc0 con 0x7fdbf015ae90 2024-01-31T05:03:53.719 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbe7e00640 1 -- 172.21.15.195:0/1703241523 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fdbd80b2040 con 0x7fdbf015ae90 2024-01-31T05:03:53.719 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.714+0000 7fdbe7e00640 1 -- 172.21.15.195:0/1703241523 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fdbd80bd3c0 con 0x7fdbf015ae90 2024-01-31T05:03:53.719 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.718+0000 7fdbf6e00640 1 -- 172.21.15.195:0/1703241523 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf006fbe0 con 0x7fdbf015ae90 2024-01-31T05:03:53.721 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.722+0000 7fdbe7e00640 1 -- 172.21.15.195:0/1703241523 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fdbd80b0070 con 0x7fdbf015ae90 2024-01-31T05:03:53.745 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:53.746+0000 7f1f0cdd4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-31T05:03:53.788 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.786+0000 7fdbf6e00640 1 -- 172.21.15.195:0/1703241523 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bf8ae0f1-81cc-494e-aa41-55a500276942", "id": 6} v 0) v1 -- 0x7fdbf0074860 con 0x7fdbf015ae90 2024-01-31T05:03:53.792 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.790+0000 7fdbe7e00640 1 -- 172.21.15.195:0/1703241523 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bf8ae0f1-81cc-494e-aa41-55a500276942", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdbd80be460 con 0x7fdbf015ae90 2024-01-31T05:03:53.793 INFO:teuthology.orchestra.run.smithi195.stdout:6 2024-01-31T05:03:53.794 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.794+0000 7fdbf6e00640 1 -- 172.21.15.195:0/1703241523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbf015ae90 msgr2=0x7fdbf00af9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.794 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.794+0000 7fdbf6e00640 1 --2- 172.21.15.195:0/1703241523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbf015ae90 0x7fdbf00af9e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8019000 tx=0x7fdbd8019190 comp rx=0 tx=0).stop 2024-01-31T05:03:53.794 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.794+0000 7fdbf6e00640 1 -- 172.21.15.195:0/1703241523 shutdown_connections 2024-01-31T05:03:53.794 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.794+0000 7fdbf6e00640 1 --2- 172.21.15.195:0/1703241523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbf015d720 0x7fdbf01585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.794 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.794+0000 7fdbf6e00640 1 --2- 172.21.15.195:0/1703241523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbf015ae90 0x7fdbf00af9e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.794 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.794+0000 7fdbf6e00640 1 --2- 172.21.15.195:0/1703241523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdbf006ae80 0x7fdbf00b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.795 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.794+0000 7fdbf6e00640 1 -- 172.21.15.195:0/1703241523 >> 172.21.15.195:0/1703241523 conn(0x7fdbf00cfda0 msgr2=0x7fdbf015f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:53.795 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.794+0000 7fdbf6e00640 1 -- 172.21.15.195:0/1703241523 shutdown_connections 2024-01-31T05:03:53.795 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.794+0000 7fdbf6e00640 1 -- 172.21.15.195:0/1703241523 wait complete. 2024-01-31T05:03:53.813 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 1bafefb2-47d4-4989-912f-44c50633498f 7 2024-01-31T05:03:53.946 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.946+0000 7fa53f800640 1 Processor -- start 2024-01-31T05:03:53.947 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.946+0000 7fa53f800640 1 -- start start 2024-01-31T05:03:53.949 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.946+0000 7fa53f800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa53815a050 0x7fa5380cc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:53.949 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.946+0000 7fa53f800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa5380ade90 0x7fa538071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:53.949 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.946+0000 7fa53f800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5380af260 con 0x7fa5380719a0 2024-01-31T05:03:53.949 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.946+0000 7fa53f800640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53806d1e0 con 0x7fa5380ade90 2024-01-31T05:03:53.949 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.946+0000 7fa53f800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53815a430 con 0x7fa53815a050 2024-01-31T05:03:53.949 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.946+0000 7fa53ce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa53815a050 0x7fa5380cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:53.949 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.946+0000 7fa53d800640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fa5380719a0 0x7fa5380ca430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:44334/0 (socket says 172.21.15.195:44334) 2024-01-31T05:03:53.949 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.946+0000 7fa53d800640 1 -- 172.21.15.195:0/1530068452 learned_addr learned my addr 172.21.15.195:0/1530068452 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-01-31T05:03:53.949 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.946+0000 7fa537e00640 1 --2- 172.21.15.195:0/1530068452 >> v2:172.21.15.49:3300/0 conn(0x7fa5380ade90 0x7fa538071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:53.949 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.946+0000 7fa537400640 1 -- 172.21.15.195:0/1530068452 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346028823 0 0) 0x7fa5380af260 con 0x7fa5380719a0 2024-01-31T05:03:53.950 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.946+0000 7fa537400640 1 -- 172.21.15.195:0/1530068452 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa518005740 con 0x7fa5380719a0 2024-01-31T05:03:53.950 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.946+0000 7fa53ce00640 1 -- 172.21.15.195:0/1530068452 >> v2:172.21.15.49:3300/0 conn(0x7fa5380ade90 msgr2=0x7fa538071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:03:53.950 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.946+0000 7fa53ce00640 1 --2- 172.21.15.195:0/1530068452 >> v2:172.21.15.49:3300/0 conn(0x7fa5380ade90 0x7fa538071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.950 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.946+0000 7fa53ce00640 1 -- 172.21.15.195:0/1530068452 >> v1:172.21.15.195:6789/0 conn(0x7fa5380719a0 legacy=0x7fa5380ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.950 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.946+0000 7fa53ce00640 1 -- 172.21.15.195:0/1530068452 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5380ae6e0 con 0x7fa53815a050 2024-01-31T05:03:53.952 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.950+0000 7fa53ce00640 1 --2- 172.21.15.195:0/1530068452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa53815a050 0x7fa5380cc030 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa5280097c0 tx=0x7fa52801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=351c4da955ece946 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:53.952 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.950+0000 7fa537400640 1 -- 172.21.15.195:0/1530068452 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5280ab600 con 0x7fa53815a050 2024-01-31T05:03:53.952 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.950+0000 7fa537400640 1 -- 172.21.15.195:0/1530068452 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5280a7050 con 0x7fa53815a050 2024-01-31T05:03:53.952 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.950+0000 7fa537400640 1 -- 172.21.15.195:0/1530068452 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5280ab980 con 0x7fa53815a050 2024-01-31T05:03:53.953 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.950+0000 7fa53f800640 1 -- 172.21.15.195:0/1530068452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa53815a050 msgr2=0x7fa5380cc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.953 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.950+0000 7fa53f800640 1 --2- 172.21.15.195:0/1530068452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa53815a050 0x7fa5380cc030 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa5280097c0 tx=0x7fa52801c3f0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.953 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.950+0000 7fa53f800640 1 -- 172.21.15.195:0/1530068452 shutdown_connections 2024-01-31T05:03:53.953 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.950+0000 7fa53f800640 1 --2- 172.21.15.195:0/1530068452 >> v2:172.21.15.49:3300/0 conn(0x7fa5380ade90 0x7fa538071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.953 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.950+0000 7fa53f800640 1 --2- 172.21.15.195:0/1530068452 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa53815a050 0x7fa5380cc030 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.953 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.950+0000 7fa53f800640 1 -- 172.21.15.195:0/1530068452 >> 172.21.15.195:0/1530068452 conn(0x7fa5380cfde0 msgr2=0x7fa5380d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:53.953 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.950+0000 7fa53f800640 1 -- 172.21.15.195:0/1530068452 shutdown_connections 2024-01-31T05:03:53.953 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.950+0000 7fa53f800640 1 -- 172.21.15.195:0/1530068452 wait complete. 2024-01-31T05:03:53.955 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa53f800640 1 Processor -- start 2024-01-31T05:03:53.955 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa53f800640 1 -- start start 2024-01-31T05:03:53.956 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa53f800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5380719a0 0x7fa53814c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:53.956 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa53f800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5380ade90 0x7fa5380c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:53.956 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa53f800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa53815a050 0x7fa5380b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:53.956 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa53f800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5381f5ac0 con 0x7fa5380719a0 2024-01-31T05:03:53.956 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa53f800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53806d330 con 0x7fa53815a050 2024-01-31T05:03:53.956 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa53f800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5381f5d30 con 0x7fa5380ade90 2024-01-31T05:03:53.956 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa537e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5380ade90 0x7fa5380c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:53.957 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa53d800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa53815a050 0x7fa5380b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:53.957 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa537e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5380ade90 0x7fa5380c38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:58392/0 (socket says 172.21.15.195:58392) 2024-01-31T05:03:53.957 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa537e00640 1 -- 172.21.15.195:0/2486828528 learned_addr learned my addr 172.21.15.195:0/2486828528 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-01-31T05:03:53.957 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa53ce00640 1 --2- 172.21.15.195:0/2486828528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5380719a0 0x7fa53814c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:53.958 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa53d800640 1 -- 172.21.15.195:0/2486828528 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5380ade90 msgr2=0x7fa5380c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.958 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa53d800640 1 --2- 172.21.15.195:0/2486828528 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5380ade90 0x7fa5380c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.958 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa53d800640 1 -- 172.21.15.195:0/2486828528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5380719a0 msgr2=0x7fa53814c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:53.958 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa53d800640 1 --2- 172.21.15.195:0/2486828528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5380719a0 0x7fa53814c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:53.959 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa53d800640 1 -- 172.21.15.195:0/2486828528 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa528009420 con 0x7fa53815a050 2024-01-31T05:03:53.959 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa537e00640 1 --2- 172.21.15.195:0/2486828528 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5380ade90 0x7fa5380c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:03:53.959 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa53d800640 1 --2- 172.21.15.195:0/2486828528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa53815a050 0x7fa5380b05a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa53000ca80 tx=0x7fa53000cf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:53.959 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa534c00640 1 -- 172.21.15.195:0/2486828528 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53000ac30 con 0x7fa53815a050 2024-01-31T05:03:53.959 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa534c00640 1 -- 172.21.15.195:0/2486828528 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53000ad90 con 0x7fa53815a050 2024-01-31T05:03:53.959 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa53f800640 1 -- 172.21.15.195:0/2486828528 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5381f6010 con 0x7fa53815a050 2024-01-31T05:03:53.959 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa534c00640 1 -- 172.21.15.195:0/2486828528 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530012600 con 0x7fa53815a050 2024-01-31T05:03:53.959 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa53f800640 1 -- 172.21.15.195:0/2486828528 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5381f6810 con 0x7fa53815a050 2024-01-31T05:03:53.959 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.954+0000 7fa534c00640 1 -- 172.21.15.195:0/2486828528 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa530012760 con 0x7fa53815a050 2024-01-31T05:03:53.959 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.958+0000 7fa534c00640 1 -- 172.21.15.195:0/2486828528 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fa53001c440 con 0x7fa53815a050 2024-01-31T05:03:53.959 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.958+0000 7fa53f800640 1 -- 172.21.15.195:0/2486828528 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa538074860 con 0x7fa53815a050 2024-01-31T05:03:53.960 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:53.958+0000 7fa534c00640 1 -- 172.21.15.195:0/2486828528 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fa530021060 con 0x7fa53815a050 2024-01-31T05:03:54.026 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:54.026+0000 7fa53f800640 1 -- 172.21.15.195:0/2486828528 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1bafefb2-47d4-4989-912f-44c50633498f", "id": 7} v 0) v1 -- 0x7fa5381f64c0 con 0x7fa53815a050 2024-01-31T05:03:54.030 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:54.030+0000 7fa534c00640 1 -- 172.21.15.195:0/2486828528 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1bafefb2-47d4-4989-912f-44c50633498f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa530017070 con 0x7fa53815a050 2024-01-31T05:03:54.031 INFO:teuthology.orchestra.run.smithi195.stdout:7 2024-01-31T05:03:54.032 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:54.030+0000 7fa53f800640 1 -- 172.21.15.195:0/2486828528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa53815a050 msgr2=0x7fa5380b05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:54.032 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:54.030+0000 7fa53f800640 1 --2- 172.21.15.195:0/2486828528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa53815a050 0x7fa5380b05a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa53000ca80 tx=0x7fa53000cf40 comp rx=0 tx=0).stop 2024-01-31T05:03:54.032 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:54.030+0000 7fa53f800640 1 -- 172.21.15.195:0/2486828528 shutdown_connections 2024-01-31T05:03:54.032 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:54.030+0000 7fa53f800640 1 --2- 172.21.15.195:0/2486828528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa53815a050 0x7fa5380b05a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:54.032 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:54.030+0000 7fa53f800640 1 --2- 172.21.15.195:0/2486828528 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5380ade90 0x7fa5380c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:54.032 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:54.030+0000 7fa53f800640 1 --2- 172.21.15.195:0/2486828528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5380719a0 0x7fa53814c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:54.032 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:54.030+0000 7fa53f800640 1 -- 172.21.15.195:0/2486828528 >> 172.21.15.195:0/2486828528 conn(0x7fa5380cfde0 msgr2=0x7fa538159290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:54.032 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:54.030+0000 7fa53f800640 1 -- 172.21.15.195:0/2486828528 shutdown_connections 2024-01-31T05:03:54.032 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:03:54.030+0000 7fa53f800640 1 -- 172.21.15.195:0/2486828528 wait complete. 2024-01-31T05:03:54.050 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-31T05:03:54.050 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-01-31T05:03:54.055 INFO:tasks.ceph.osd.0:Started 2024-01-31T05:03:54.055 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-31T05:03:54.055 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-01-31T05:03:54.065 INFO:tasks.ceph.osd.1:Started 2024-01-31T05:03:54.065 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-31T05:03:54.065 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-01-31T05:03:54.070 INFO:tasks.ceph.osd.2:Started 2024-01-31T05:03:54.070 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-31T05:03:54.070 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-01-31T05:03:54.081 INFO:tasks.ceph.osd.3:Started 2024-01-31T05:03:54.081 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-31T05:03:54.081 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-01-31T05:03:54.086 INFO:tasks.ceph.osd.4:Started 2024-01-31T05:03:54.086 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-31T05:03:54.086 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-01-31T05:03:54.093 INFO:tasks.ceph.osd.5:Started 2024-01-31T05:03:54.093 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-31T05:03:54.093 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-01-31T05:03:54.105 INFO:tasks.ceph.osd.6:Started 2024-01-31T05:03:54.105 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-31T05:03:54.105 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-01-31T05:03:54.118 INFO:tasks.ceph.osd.7:Started 2024-01-31T05:03:54.119 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:03:54.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.270+0000 7f4b10e00640 1 Processor -- start 2024-01-31T05:03:54.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.270+0000 7f4b10e00640 1 -- start start 2024-01-31T05:03:54.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.270+0000 7f4b10e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4b0c15e7e0 0x7f4b0c0b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:54.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.270+0000 7f4b10e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0cf670 0x7f4b0c0cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:54.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.270+0000 7f4b10e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0c0c67f0 con 0x7f4b0c0c63d0 2024-01-31T05:03:54.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.270+0000 7f4b10e00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0c0d1d40 con 0x7f4b0c15e7e0 2024-01-31T05:03:54.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.270+0000 7f4b10e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c0c6ab0 con 0x7f4b0c0cf670 2024-01-31T05:03:54.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.270+0000 7f4b09e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4b0c15e7e0 0x7f4b0c0b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:54.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.270+0000 7f4b09e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4b0c15e7e0 0x7f4b0c0b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59656/0 (socket says 172.21.15.49:59656) 2024-01-31T05:03:54.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.270+0000 7f4b09e00640 1 -- 172.21.15.49:0/2419320065 learned_addr learned my addr 172.21.15.49:0/2419320065 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:03:54.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.270+0000 7f4b0a800640 1 --2- 172.21.15.49:0/2419320065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0cf670 0x7f4b0c0cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:54.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.274+0000 7f4b09e00640 1 -- 172.21.15.49:0/2419320065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0cf670 msgr2=0x7f4b0c0cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:03:54.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.274+0000 7f4b09e00640 1 --2- 172.21.15.49:0/2419320065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0cf670 0x7f4b0c0cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:54.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.274+0000 7f4b09e00640 1 -- 172.21.15.49:0/2419320065 >> v1:172.21.15.195:6789/0 conn(0x7f4b0c0c63d0 legacy=0x7f4b0c0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:54.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.274+0000 7f4b09e00640 1 -- 172.21.15.49:0/2419320065 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c0c6d90 con 0x7f4b0c15e7e0 2024-01-31T05:03:54.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.274+0000 7f4b08a00640 1 -- 172.21.15.49:0/2419320065 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302424473 0 0) 0x7f4b0c0c67f0 con 0x7f4b0c0c63d0 2024-01-31T05:03:54.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.274+0000 7f4b09e00640 1 --2- 172.21.15.49:0/2419320065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b0c15e7e0 0x7f4b0c0b2370 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009870 tx=0x7f4afc01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6828fedd167d152 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:54.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.274+0000 7f4b08a00640 1 -- 172.21.15.49:0/2419320065 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc0a8a30 con 0x7f4b0c15e7e0 2024-01-31T05:03:54.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.274+0000 7f4b08a00640 1 -- 172.21.15.49:0/2419320065 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc0a8b90 con 0x7f4b0c15e7e0 2024-01-31T05:03:54.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.274+0000 7f4b08a00640 1 -- 172.21.15.49:0/2419320065 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc0b0440 con 0x7f4b0c15e7e0 2024-01-31T05:03:54.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.274+0000 7f4b10e00640 1 -- 172.21.15.49:0/2419320065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b0c15e7e0 msgr2=0x7f4b0c0b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:54.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.274+0000 7f4b10e00640 1 --2- 172.21.15.49:0/2419320065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b0c15e7e0 0x7f4b0c0b2370 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009870 tx=0x7f4afc01ed30 comp rx=0 tx=0).stop 2024-01-31T05:03:54.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b10e00640 1 -- 172.21.15.49:0/2419320065 shutdown_connections 2024-01-31T05:03:54.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b10e00640 1 --2- 172.21.15.49:0/2419320065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0cf670 0x7f4b0c0cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:54.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b10e00640 1 --2- 172.21.15.49:0/2419320065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b0c15e7e0 0x7f4b0c0b2370 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:54.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b10e00640 1 -- 172.21.15.49:0/2419320065 >> 172.21.15.49:0/2419320065 conn(0x7f4b0c0d0e60 msgr2=0x7f4b0c0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:54.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b10e00640 1 -- 172.21.15.49:0/2419320065 shutdown_connections 2024-01-31T05:03:54.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b10e00640 1 -- 172.21.15.49:0/2419320065 wait complete. 2024-01-31T05:03:54.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b10e00640 1 Processor -- start 2024-01-31T05:03:54.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b10e00640 1 -- start start 2024-01-31T05:03:54.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b10e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b0c0c63d0 0x7f4b0c0b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:54.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b10e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0cf670 0x7f4b0c156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:54.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b10e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b0c15e7e0 0x7f4b0c15b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:54.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b10e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c0b5970 con 0x7f4b0c0c63d0 2024-01-31T05:03:54.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b10e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c0b3b70 con 0x7f4b0c15e7e0 2024-01-31T05:03:54.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b10e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c1574b0 con 0x7f4b0c0cf670 2024-01-31T05:03:54.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b09e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b0c0c63d0 0x7f4b0c0b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:54.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b09e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b0c0c63d0 0x7f4b0c0b4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59662/0 (socket says 172.21.15.49:59662) 2024-01-31T05:03:54.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b09e00640 1 -- 172.21.15.49:0/1350250151 learned_addr learned my addr 172.21.15.49:0/1350250151 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:03:54.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b09400640 1 --2- 172.21.15.49:0/1350250151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0cf670 0x7f4b0c156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:54.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b0a800640 1 --2- 172.21.15.49:0/1350250151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b0c15e7e0 0x7f4b0c15b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:54.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b09e00640 1 -- 172.21.15.49:0/1350250151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0cf670 msgr2=0x7f4b0c156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:54.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b09e00640 1 --2- 172.21.15.49:0/1350250151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0cf670 0x7f4b0c156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:54.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b09e00640 1 -- 172.21.15.49:0/1350250151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b0c15e7e0 msgr2=0x7f4b0c15b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:54.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b09e00640 1 --2- 172.21.15.49:0/1350250151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b0c15e7e0 0x7f4b0c15b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:54.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.278+0000 7f4b09e00640 1 -- 172.21.15.49:0/1350250151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc0094d0 con 0x7f4b0c0c63d0 2024-01-31T05:03:54.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.282+0000 7f4b09e00640 1 --2- 172.21.15.49:0/1350250151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b0c0c63d0 0x7f4b0c0b4710 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4afc0b3040 tx=0x7f4afc01bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:54.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.282+0000 7f4b02000640 1 -- 172.21.15.49:0/1350250151 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc0a8a30 con 0x7f4b0c0c63d0 2024-01-31T05:03:54.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.282+0000 7f4b02000640 1 -- 172.21.15.49:0/1350250151 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc0bb480 con 0x7f4b0c0c63d0 2024-01-31T05:03:54.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.282+0000 7f4b10e00640 1 -- 172.21.15.49:0/1350250151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0c0b4cf0 con 0x7f4b0c0c63d0 2024-01-31T05:03:54.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.282+0000 7f4b02000640 1 -- 172.21.15.49:0/1350250151 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc0bb830 con 0x7f4b0c0c63d0 2024-01-31T05:03:54.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.282+0000 7f4b10e00640 1 -- 172.21.15.49:0/1350250151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0c0b52b0 con 0x7f4b0c0c63d0 2024-01-31T05:03:54.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.282+0000 7f4b02000640 1 -- 172.21.15.49:0/1350250151 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f4afc0bb990 con 0x7f4b0c0c63d0 2024-01-31T05:03:54.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.282+0000 7f4b02000640 1 -- 172.21.15.49:0/1350250151 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f4afc0bbc40 con 0x7f4b0c0c63d0 2024-01-31T05:03:54.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.282+0000 7f4b10e00640 1 -- 172.21.15.49:0/1350250151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0c067c80 con 0x7f4b0c0c63d0 2024-01-31T05:03:54.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.286+0000 7f4b02000640 1 -- 172.21.15.49:0/1350250151 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f4afc0b5070 con 0x7f4b0c0c63d0 2024-01-31T05:03:54.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.342+0000 7f4b10e00640 1 -- 172.21.15.49:0/1350250151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b0c074860 con 0x7f4b0c0c63d0 2024-01-31T05:03:54.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.342+0000 7f4b02000640 1 -- 172.21.15.49:0/1350250151 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f4afc0c5460 con 0x7f4b0c0c63d0 2024-01-31T05:03:54.344 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:03:54.344 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":10,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:03:54.032746+0000","last_up_change":"0.000000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:03:54.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.342+0000 7f4b10e00640 1 -- 172.21.15.49:0/1350250151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b0c0c63d0 msgr2=0x7f4b0c0b4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:54.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.342+0000 7f4b10e00640 1 --2- 172.21.15.49:0/1350250151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b0c0c63d0 0x7f4b0c0b4710 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4afc0b3040 tx=0x7f4afc01bad0 comp rx=0 tx=0).stop 2024-01-31T05:03:54.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.342+0000 7f4b10e00640 1 -- 172.21.15.49:0/1350250151 shutdown_connections 2024-01-31T05:03:54.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.342+0000 7f4b10e00640 1 --2- 172.21.15.49:0/1350250151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b0c15e7e0 0x7f4b0c15b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:54.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.342+0000 7f4b10e00640 1 --2- 172.21.15.49:0/1350250151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b0c0cf670 0x7f4b0c156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:54.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.342+0000 7f4b10e00640 1 --2- 172.21.15.49:0/1350250151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b0c0c63d0 0x7f4b0c0b4710 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:54.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.342+0000 7f4b10e00640 1 -- 172.21.15.49:0/1350250151 >> 172.21.15.49:0/1350250151 conn(0x7f4b0c0d0e60 msgr2=0x7f4b0c06e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:54.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.346+0000 7f4b10e00640 1 -- 172.21.15.49:0/1350250151 shutdown_connections 2024-01-31T05:03:54.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:03:54.346+0000 7f4b10e00640 1 -- 172.21.15.49:0/1350250151 wait complete. 2024-01-31T05:03:54.364 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-31T05:03:54.364 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-31T05:03:54.402 INFO:tasks.ceph.mgr.x.smithi195.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-31T05:03:54.402 INFO:tasks.ceph.mgr.x.smithi195.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-31T05:03:54.402 INFO:tasks.ceph.mgr.x.smithi195.stderr: from numpy import show_config as show_numpy_config 2024-01-31T05:03:54.424 INFO:tasks.ceph.mgr.y.smithi049.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-31T05:03:54.425 INFO:tasks.ceph.mgr.y.smithi049.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-31T05:03:54.425 INFO:tasks.ceph.mgr.y.smithi049.stderr: from numpy import show_config as show_numpy_config 2024-01-31T05:03:54.444 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:54.442+0000 7feb06049180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-31T05:03:54.476 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:54.474+0000 7f1f0cdd4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-31T05:03:54.579 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:54.578+0000 7feb06049180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-31T05:03:54.619 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:54.618+0000 7f1f0cdd4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-31T05:03:54.743 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:54.742+0000 7feb06049180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-31T05:03:54.767 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T05:03:54.766+0000 7f96d20297c0 -1 Falling back to public interface 2024-01-31T05:03:54.767 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T05:03:54.766+0000 7f79d64f37c0 -1 Falling back to public interface 2024-01-31T05:03:54.770 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T05:03:54.770+0000 7f74bf1867c0 -1 Falling back to public interface 2024-01-31T05:03:54.771 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T05:03:54.770+0000 7fd728ffd7c0 -1 Falling back to public interface 2024-01-31T05:03:54.772 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T05:03:54.770+0000 7fc63bb637c0 -1 Falling back to public interface 2024-01-31T05:03:54.774 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T05:03:54.774+0000 7f4ab35537c0 -1 Falling back to public interface 2024-01-31T05:03:54.790 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T05:03:54.790+0000 7fc3524287c0 -1 Falling back to public interface 2024-01-31T05:03:54.794 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:54.794+0000 7f1f0cdd4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-31T05:03:54.810 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T05:03:54.810+0000 7f91cfd6e7c0 -1 Falling back to public interface 2024-01-31T05:03:54.822 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:54.822+0000 7feb06049180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-31T05:03:54.870 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:54.870+0000 7f1f0cdd4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-31T05:03:54.959 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:54.958+0000 7feb06049180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-31T05:03:55.016 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:55.014+0000 7f1f0cdd4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-31T05:03:55.170 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-31T05:03:55.301 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.302+0000 7f06eea00640 1 Processor -- start 2024-01-31T05:03:55.302 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.302+0000 7f06eea00640 1 -- start start 2024-01-31T05:03:55.303 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.302+0000 7f06eea00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f06e815b0a0 0x7f06e80cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:55.303 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.302+0000 7f06eea00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f06e80d1950 0x7f06e80ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:55.304 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.302+0000 7f06eea00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e80cf1f0 con 0x7f06e80cd7b0 2024-01-31T05:03:55.304 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.302+0000 7f06eea00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e80cef40 con 0x7f06e815b0a0 2024-01-31T05:03:55.304 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.302+0000 7f06eea00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e80cbe50 con 0x7f06e80d1950 2024-01-31T05:03:55.304 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.302+0000 7f06e7e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f06e815b0a0 0x7f06e80cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:55.304 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.302+0000 7f06eca00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f06e80cd7b0 0x7f06e80cdbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:47514/0 (socket says 172.21.15.49:47514) 2024-01-31T05:03:55.304 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.302+0000 7f06eca00640 1 -- 172.21.15.49:0/1968037796 learned_addr learned my addr 172.21.15.49:0/1968037796 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:03:55.304 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.302+0000 7f06e7400640 1 --2- 172.21.15.49:0/1968037796 >> v2:172.21.15.195:3300/0 conn(0x7f06e80d1950 0x7f06e80ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:55.304 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.302+0000 7f06e7e00640 1 -- 172.21.15.49:0/1968037796 >> v2:172.21.15.195:3300/0 conn(0x7f06e80d1950 msgr2=0x7f06e80ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:03:55.304 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.302+0000 7f06e7e00640 1 --2- 172.21.15.49:0/1968037796 >> v2:172.21.15.195:3300/0 conn(0x7f06e80d1950 0x7f06e80ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:55.304 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.302+0000 7f06e7e00640 1 -- 172.21.15.49:0/1968037796 >> v1:172.21.15.49:6789/0 conn(0x7f06e80cd7b0 legacy=0x7f06e80cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:55.304 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.302+0000 7f06e6a00640 1 -- 172.21.15.49:0/1968037796 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6902074 0 0) 0x7f06e80cf1f0 con 0x7f06e80cd7b0 2024-01-31T05:03:55.304 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.302+0000 7f06e7e00640 1 -- 172.21.15.49:0/1968037796 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e80cc130 con 0x7f06e815b0a0 2024-01-31T05:03:55.306 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.306+0000 7f06e7e00640 1 --2- 172.21.15.49:0/1968037796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e815b0a0 0x7f06e80cea00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f06e809a930 tx=0x7f06d801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3866758ebcc235 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:55.307 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.306+0000 7f06e6a00640 1 -- 172.21.15.49:0/1968037796 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d80a8930 con 0x7f06e815b0a0 2024-01-31T05:03:55.307 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.306+0000 7f06e6a00640 1 -- 172.21.15.49:0/1968037796 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d80a8a90 con 0x7f06e815b0a0 2024-01-31T05:03:55.307 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.306+0000 7f06e6a00640 1 -- 172.21.15.49:0/1968037796 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d80a8e20 con 0x7f06e815b0a0 2024-01-31T05:03:55.307 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.306+0000 7f06eea00640 1 -- 172.21.15.49:0/1968037796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e815b0a0 msgr2=0x7f06e80cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:55.307 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.306+0000 7f06eea00640 1 --2- 172.21.15.49:0/1968037796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e815b0a0 0x7f06e80cea00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f06e809a930 tx=0x7f06d801ec30 comp rx=0 tx=0).stop 2024-01-31T05:03:55.308 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.306+0000 7f06eea00640 1 -- 172.21.15.49:0/1968037796 shutdown_connections 2024-01-31T05:03:55.308 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.306+0000 7f06eea00640 1 --2- 172.21.15.49:0/1968037796 >> v2:172.21.15.195:3300/0 conn(0x7f06e80d1950 0x7f06e80ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:55.308 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.306+0000 7f06eea00640 1 --2- 172.21.15.49:0/1968037796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e815b0a0 0x7f06e80cea00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:55.308 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.306+0000 7f06eea00640 1 -- 172.21.15.49:0/1968037796 >> 172.21.15.49:0/1968037796 conn(0x7f06e80d0e30 msgr2=0x7f06e80d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:55.308 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.306+0000 7f06eea00640 1 -- 172.21.15.49:0/1968037796 shutdown_connections 2024-01-31T05:03:55.308 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.306+0000 7f06eea00640 1 -- 172.21.15.49:0/1968037796 wait complete. 2024-01-31T05:03:55.309 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06eea00640 1 Processor -- start 2024-01-31T05:03:55.309 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06eea00640 1 -- start start 2024-01-31T05:03:55.311 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06eea00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06e80cd7b0 0x7f06e81f6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:55.311 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06eea00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e80d1950 0x7f06e8150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:55.312 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06eea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06e815b0a0 0x7f06e80af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:55.312 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06eea00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e8151c50 con 0x7f06e80d1950 2024-01-31T05:03:55.312 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06eea00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e81f7230 con 0x7f06e80cd7b0 2024-01-31T05:03:55.312 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06eea00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e815b780 con 0x7f06e815b0a0 2024-01-31T05:03:55.312 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06e7400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e80d1950 0x7f06e8150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:55.312 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06e7400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e80d1950 0x7f06e8150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59682/0 (socket says 172.21.15.49:59682) 2024-01-31T05:03:55.312 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06e7400640 1 -- 172.21.15.49:0/2968960256 learned_addr learned my addr 172.21.15.49:0/2968960256 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:03:55.312 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06eca00640 1 --2- 172.21.15.49:0/2968960256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06e815b0a0 0x7f06e80af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:55.312 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06e7e00640 1 --2- 172.21.15.49:0/2968960256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06e80cd7b0 0x7f06e81f6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:55.312 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06e7400640 1 -- 172.21.15.49:0/2968960256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06e815b0a0 msgr2=0x7f06e80af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:55.312 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06e7400640 1 --2- 172.21.15.49:0/2968960256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06e815b0a0 0x7f06e80af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:55.312 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06e7400640 1 -- 172.21.15.49:0/2968960256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06e80cd7b0 msgr2=0x7f06e81f6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:55.312 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06e7400640 1 --2- 172.21.15.49:0/2968960256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06e80cd7b0 0x7f06e81f6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:55.313 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06e7400640 1 -- 172.21.15.49:0/2968960256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d80093b0 con 0x7f06e80d1950 2024-01-31T05:03:55.314 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06e7400640 1 --2- 172.21.15.49:0/2968960256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e80d1950 0x7f06e8150180 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f06d000d830 tx=0x7f06d000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:55.314 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06dfe00640 1 -- 172.21.15.49:0/2968960256 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d000b6c0 con 0x7f06e80d1950 2024-01-31T05:03:55.314 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06dfe00640 1 -- 172.21.15.49:0/2968960256 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d000b820 con 0x7f06e80d1950 2024-01-31T05:03:55.314 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06eea00640 1 -- 172.21.15.49:0/2968960256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e80c6d90 con 0x7f06e80d1950 2024-01-31T05:03:55.314 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06dfe00640 1 -- 172.21.15.49:0/2968960256 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d000bb90 con 0x7f06e80d1950 2024-01-31T05:03:55.314 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.310+0000 7f06eea00640 1 -- 172.21.15.49:0/2968960256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e8151320 con 0x7f06e80d1950 2024-01-31T05:03:55.314 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.314+0000 7f06dfe00640 1 -- 172.21.15.49:0/2968960256 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f06d001e460 con 0x7f06e80d1950 2024-01-31T05:03:55.314 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.314+0000 7f06dfe00640 1 -- 172.21.15.49:0/2968960256 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f06d00123e0 con 0x7f06e80d1950 2024-01-31T05:03:55.314 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.314+0000 7f06eea00640 1 -- 172.21.15.49:0/2968960256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e8151e00 con 0x7f06e80d1950 2024-01-31T05:03:55.316 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.314+0000 7f06dfe00640 1 -- 172.21.15.49:0/2968960256 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f06e8151e00 con 0x7f06e80d1950 2024-01-31T05:03:55.374 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.374+0000 7f06eea00640 1 -- 172.21.15.49:0/2968960256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06e804ead0 con 0x7f06e80d1950 2024-01-31T05:03:55.375 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.374+0000 7f06dfe00640 1 -- 172.21.15.49:0/2968960256 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f06d00147a0 con 0x7f06e80d1950 2024-01-31T05:03:55.375 INFO:teuthology.misc.health.smithi049.stdout: 2024-01-31T05:03:55.376 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":10,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:03:54.032746+0000","last_up_change":"0.000000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:03:55.376 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.374+0000 7f06eea00640 1 -- 172.21.15.49:0/2968960256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e80d1950 msgr2=0x7f06e8150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:55.377 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.374+0000 7f06eea00640 1 --2- 172.21.15.49:0/2968960256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e80d1950 0x7f06e8150180 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f06d000d830 tx=0x7f06d000dcf0 comp rx=0 tx=0).stop 2024-01-31T05:03:55.377 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.374+0000 7f06eea00640 1 -- 172.21.15.49:0/2968960256 shutdown_connections 2024-01-31T05:03:55.377 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.374+0000 7f06eea00640 1 --2- 172.21.15.49:0/2968960256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06e815b0a0 0x7f06e80af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:55.377 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.374+0000 7f06eea00640 1 --2- 172.21.15.49:0/2968960256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e80d1950 0x7f06e8150180 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:55.377 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.374+0000 7f06eea00640 1 --2- 172.21.15.49:0/2968960256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06e80cd7b0 0x7f06e81f6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:55.377 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.374+0000 7f06eea00640 1 -- 172.21.15.49:0/2968960256 >> 172.21.15.49:0/2968960256 conn(0x7f06e80d0e30 msgr2=0x7f06e80ada60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:55.377 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.374+0000 7f06eea00640 1 -- 172.21.15.49:0/2968960256 shutdown_connections 2024-01-31T05:03:55.377 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:03:55.374+0000 7f06eea00640 1 -- 172.21.15.49:0/2968960256 wait complete. 2024-01-31T05:03:55.393 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-31T05:03:55.645 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:55.642+0000 7feb06049180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-31T05:03:55.721 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:55.718+0000 7f1f0cdd4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-31T05:03:55.732 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:55.730+0000 7feb06049180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-31T05:03:55.812 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:55.810+0000 7f1f0cdd4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-31T05:03:55.920 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:55.918+0000 7feb06049180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-31T05:03:56.006 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:56.006+0000 7feb06049180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-31T05:03:56.012 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:56.010+0000 7f1f0cdd4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-31T05:03:56.102 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:56.102+0000 7f1f0cdd4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-31T05:03:56.329 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:56.326+0000 7feb06049180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-31T05:03:56.398 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:56.398+0000 7feb06049180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-31T05:03:56.449 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:56.446+0000 7f1f0cdd4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-31T05:03:56.523 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-01-31T05:03:56.522+0000 7f1f0cdd4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-31T05:03:57.421 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:57.418+0000 7feaaba00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-31T05:03:57.421 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-01-31T05:03:57.418+0000 7feaaba00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-31T05:03:58.610 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T05:03:58.610+0000 7fd728ffd7c0 -1 osd.6 0 log_to_monitors true 2024-01-31T05:03:58.618 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T05:03:58.618+0000 7f4ab35537c0 -1 osd.2 0 log_to_monitors true 2024-01-31T05:03:58.666 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T05:03:58.666+0000 7f79d64f37c0 -1 osd.3 0 log_to_monitors true 2024-01-31T05:03:58.685 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T05:03:58.682+0000 7fc3524287c0 -1 osd.4 0 log_to_monitors true 2024-01-31T05:03:58.692 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T05:03:58.690+0000 7f96d20297c0 -1 osd.0 0 log_to_monitors true 2024-01-31T05:03:58.783 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T05:03:58.782+0000 7f91cfd6e7c0 -1 osd.1 0 log_to_monitors true 2024-01-31T05:03:58.947 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T05:03:58.946+0000 7fc63bb637c0 -1 osd.7 0 log_to_monitors true 2024-01-31T05:03:58.952 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T05:03:58.950+0000 7f74bf1867c0 -1 osd.5 0 log_to_monitors true 2024-01-31T05:04:02.157 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T05:04:02.154+0000 7fc636a00640 -1 osd.7 0 waiting for initial osdmap 2024-01-31T05:04:02.163 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T05:04:02.165+0000 7f79d1400640 -1 osd.3 0 waiting for initial osdmap 2024-01-31T05:04:02.169 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T05:04:02.173+0000 7f4aae400640 -1 osd.2 0 waiting for initial osdmap 2024-01-31T05:04:02.181 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T05:04:02.174+0000 7f74ba000640 -1 osd.5 0 waiting for initial osdmap 2024-01-31T05:04:02.187 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T05:04:02.186+0000 7fc62ca00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:04:02.195 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T05:04:02.197+0000 7f79c7400640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:04:02.200 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-31T05:04:02.203 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T05:04:02.202+0000 7f74b0000640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:04:02.205 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T05:04:02.205+0000 7f96cce00640 -1 osd.0 0 waiting for initial osdmap 2024-01-31T05:04:02.211 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T05:04:02.213+0000 7f4aa4400640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:04:02.214 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T05:04:02.217+0000 7f91cb600640 -1 osd.1 0 waiting for initial osdmap 2024-01-31T05:04:02.217 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T05:04:02.214+0000 7fd723e00640 -1 osd.6 0 waiting for initial osdmap 2024-01-31T05:04:02.234 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T05:04:02.237+0000 7f96c2e00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:04:02.247 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T05:04:02.246+0000 7fc34d200640 -1 osd.4 0 waiting for initial osdmap 2024-01-31T05:04:02.247 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T05:04:02.249+0000 7f91c0c00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:04:02.263 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T05:04:02.262+0000 7fd719e00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:04:02.275 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T05:04:02.274+0000 7fc343200640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:04:02.341 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.341+0000 7fca02400640 1 Processor -- start 2024-01-31T05:04:02.341 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.341+0000 7fca02400640 1 -- start start 2024-01-31T05:04:02.341 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.341+0000 7fca02400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc9fc0b0b10 0x7fc9fc169e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:02.342 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.341+0000 7fca02400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9fc082a80 con 0x7fc9fc0c9270 2024-01-31T05:04:02.342 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.341+0000 7fca02400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9fc082430 con 0x7fc9fc0b06a0 2024-01-31T05:04:02.342 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.341+0000 7fca02400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9fc0cdb30 con 0x7fc9fc0b0b10 2024-01-31T05:04:02.342 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.345+0000 7fc9fb400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc9fc0c9270 0x7fc9fc085b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:50552/0 (socket says 172.21.15.49:50552) 2024-01-31T05:04:02.342 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.345+0000 7fc9fb400640 1 -- 172.21.15.49:0/824324882 learned_addr learned my addr 172.21.15.49:0/824324882 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:02.342 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.345+0000 7fc9fbe00640 1 --2- 172.21.15.49:0/824324882 >> v2:172.21.15.195:3300/0 conn(0x7fc9fc0b0b10 0x7fc9fc169e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:02.343 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.345+0000 7fc9fa000640 1 -- 172.21.15.49:0/824324882 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545794303 0 0) 0x7fc9fc082a80 con 0x7fc9fc0c9270 2024-01-31T05:04:02.343 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.345+0000 7fc9fa000640 1 -- 172.21.15.49:0/824324882 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9dc003530 con 0x7fc9fc0c9270 2024-01-31T05:04:02.343 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.345+0000 7fc9fbe00640 1 -- 172.21.15.49:0/824324882 >> v1:172.21.15.195:6789/0 conn(0x7fc9fc0b06a0 legacy=0x7fc9fc169770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:02.343 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.345+0000 7fc9fbe00640 1 -- 172.21.15.49:0/824324882 >> v1:172.21.15.49:6789/0 conn(0x7fc9fc0c9270 legacy=0x7fc9fc085b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:02.343 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.345+0000 7fc9fbe00640 1 -- 172.21.15.49:0/824324882 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc082710 con 0x7fc9fc0b0b10 2024-01-31T05:04:02.345 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.345+0000 7fc9fbe00640 1 --2- 172.21.15.49:0/824324882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9fc0b0b10 0x7fc9fc169e80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4009d90 tx=0x7fc9f401f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9639ebb3105de56 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:02.345 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.349+0000 7fc9fa000640 1 -- 172.21.15.49:0/824324882 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f40af600 con 0x7fc9fc0b0b10 2024-01-31T05:04:02.345 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.349+0000 7fc9fa000640 1 -- 172.21.15.49:0/824324882 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f40ab050 con 0x7fc9fc0b0b10 2024-01-31T05:04:02.345 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.349+0000 7fc9fa000640 1 -- 172.21.15.49:0/824324882 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f40af980 con 0x7fc9fc0b0b10 2024-01-31T05:04:02.346 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.349+0000 7fca02400640 1 -- 172.21.15.49:0/824324882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9fc0b0b10 msgr2=0x7fc9fc169e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:02.346 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.349+0000 7fca02400640 1 --2- 172.21.15.49:0/824324882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9fc0b0b10 0x7fc9fc169e80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4009d90 tx=0x7fc9f401f130 comp rx=0 tx=0).stop 2024-01-31T05:04:02.347 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.349+0000 7fca02400640 1 -- 172.21.15.49:0/824324882 shutdown_connections 2024-01-31T05:04:02.347 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.349+0000 7fca02400640 1 --2- 172.21.15.49:0/824324882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9fc0b0b10 0x7fc9fc169e80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:02.347 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.349+0000 7fca02400640 1 -- 172.21.15.49:0/824324882 >> 172.21.15.49:0/824324882 conn(0x7fc9fc0cb6a0 msgr2=0x7fc9fc0cbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:02.347 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.349+0000 7fca02400640 1 -- 172.21.15.49:0/824324882 shutdown_connections 2024-01-31T05:04:02.347 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.349+0000 7fca02400640 1 -- 172.21.15.49:0/824324882 wait complete. 2024-01-31T05:04:02.348 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.349+0000 7fca02400640 1 Processor -- start 2024-01-31T05:04:02.348 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.349+0000 7fca02400640 1 -- start start 2024-01-31T05:04:02.351 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fca02400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9fc0b06a0 0x7fc9fc0c1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:02.351 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fca02400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9fc0b0b10 0x7fc9fc170b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:02.351 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fca02400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9fc0c9270 0x7fc9fc0b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:02.351 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fca02400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc0b2a90 con 0x7fc9fc0b06a0 2024-01-31T05:04:02.351 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fca02400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc0c8dc0 con 0x7fc9fc0c9270 2024-01-31T05:04:02.352 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fca02400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc178fa0 con 0x7fc9fc0b0b10 2024-01-31T05:04:02.352 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fc9fb400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9fc0b06a0 0x7fc9fc0c1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:02.352 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fc9fb400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9fc0b06a0 0x7fc9fc0c1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41930/0 (socket says 172.21.15.49:41930) 2024-01-31T05:04:02.352 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fc9fb400640 1 -- 172.21.15.49:0/3271392441 learned_addr learned my addr 172.21.15.49:0/3271392441 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:02.352 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fc9faa00640 1 --2- 172.21.15.49:0/3271392441 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9fc0b0b10 0x7fc9fc170b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:02.352 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fc9fbe00640 1 --2- 172.21.15.49:0/3271392441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9fc0c9270 0x7fc9fc0b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:02.352 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fc9fb400640 1 -- 172.21.15.49:0/3271392441 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9fc0b0b10 msgr2=0x7fc9fc170b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:02.352 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fc9fb400640 1 --2- 172.21.15.49:0/3271392441 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9fc0b0b10 0x7fc9fc170b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:02.352 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fc9fb400640 1 -- 172.21.15.49:0/3271392441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9fc0c9270 msgr2=0x7fc9fc0b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:02.352 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fc9fb400640 1 --2- 172.21.15.49:0/3271392441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9fc0c9270 0x7fc9fc0b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:02.352 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fc9fb400640 1 -- 172.21.15.49:0/3271392441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f4009a70 con 0x7fc9fc0b06a0 2024-01-31T05:04:02.353 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fc9faa00640 1 --2- 172.21.15.49:0/3271392441 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9fc0b0b10 0x7fc9fc170b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:02.353 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fc9fbe00640 1 --2- 172.21.15.49:0/3271392441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9fc0c9270 0x7fc9fc0b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:02.353 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fc9fb400640 1 --2- 172.21.15.49:0/3271392441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9fc0b06a0 0x7fc9fc0c1160 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec00c4d0 tx=0x7fc9ec00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:02.353 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fc9f3400640 1 -- 172.21.15.49:0/3271392441 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec005cf0 con 0x7fc9fc0b06a0 2024-01-31T05:04:02.353 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fc9f3400640 1 -- 172.21.15.49:0/3271392441 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ec005e50 con 0x7fc9fc0b06a0 2024-01-31T05:04:02.353 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fc9f3400640 1 -- 172.21.15.49:0/3271392441 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec007270 con 0x7fc9fc0b06a0 2024-01-31T05:04:02.353 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fca02400640 1 -- 172.21.15.49:0/3271392441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9fc179280 con 0x7fc9fc0b06a0 2024-01-31T05:04:02.353 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fca02400640 1 -- 172.21.15.49:0/3271392441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9fc0c18e0 con 0x7fc9fc0b06a0 2024-01-31T05:04:02.354 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fca02400640 1 -- 172.21.15.49:0/3271392441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9fc04ead0 con 0x7fc9fc0b06a0 2024-01-31T05:04:02.354 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.353+0000 7fc9f3400640 1 -- 172.21.15.49:0/3271392441 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 85771+0+0 (secure 0 0 0) 0x7fc9ec0073d0 con 0x7fc9fc0b06a0 2024-01-31T05:04:02.354 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.357+0000 7fc9f3400640 1 --2- 172.21.15.49:0/3271392441 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc9d4066470 0x7fc9d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:02.354 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.357+0000 7fc9f3400640 1 -- 172.21.15.49:0/3271392441 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fc9ec082570 con 0x7fc9fc0b06a0 2024-01-31T05:04:02.355 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.357+0000 7fc9faa00640 1 --2- 172.21.15.49:0/3271392441 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc9d4066470 0x7fc9d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:02.355 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.357+0000 7fc9faa00640 1 --2- 172.21.15.49:0/3271392441 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc9d4066470 0x7fc9d4068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0cf380 tx=0x7fc9e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:02.363 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.365+0000 7fc9f3400640 1 -- 172.21.15.49:0/3271392441 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fc9ec050690 con 0x7fc9fc0b06a0 2024-01-31T05:04:02.527 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.529+0000 7fca02400640 1 -- 172.21.15.49:0/3271392441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9fc0c8f80 con 0x7fc9fc0b06a0 2024-01-31T05:04:02.527 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.529+0000 7fc9f3400640 1 -- 172.21.15.49:0/3271392441 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fc9ec017070 con 0x7fc9fc0b06a0 2024-01-31T05:04:02.528 INFO:teuthology.misc.health.smithi049.stdout: 2024-01-31T05:04:02.528 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":12,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:00.424409+0000","last_up_change":"0.000000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:04:02.529 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.529+0000 7fca02400640 1 -- 172.21.15.49:0/3271392441 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc9d4066470 msgr2=0x7fc9d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:02.529 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.529+0000 7fca02400640 1 --2- 172.21.15.49:0/3271392441 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc9d4066470 0x7fc9d4068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0cf380 tx=0x7fc9e4009040 comp rx=0 tx=0).stop 2024-01-31T05:04:02.529 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.529+0000 7fca02400640 1 -- 172.21.15.49:0/3271392441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9fc0b06a0 msgr2=0x7fc9fc0c1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:02.529 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.529+0000 7fca02400640 1 --2- 172.21.15.49:0/3271392441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9fc0b06a0 0x7fc9fc0c1160 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec00c4d0 tx=0x7fc9ec00c990 comp rx=0 tx=0).stop 2024-01-31T05:04:02.529 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.529+0000 7fca02400640 1 -- 172.21.15.49:0/3271392441 shutdown_connections 2024-01-31T05:04:02.529 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.529+0000 7fca02400640 1 --2- 172.21.15.49:0/3271392441 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc9d4066470 0x7fc9d4068930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:02.529 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.529+0000 7fca02400640 1 --2- 172.21.15.49:0/3271392441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9fc0c9270 0x7fc9fc0b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:02.529 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.529+0000 7fca02400640 1 --2- 172.21.15.49:0/3271392441 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9fc0b0b10 0x7fc9fc170b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:02.530 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.529+0000 7fca02400640 1 --2- 172.21.15.49:0/3271392441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9fc0b06a0 0x7fc9fc0c1160 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:02.530 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.529+0000 7fca02400640 1 -- 172.21.15.49:0/3271392441 >> 172.21.15.49:0/3271392441 conn(0x7fc9fc0cb6a0 msgr2=0x7fc9fc0cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:02.530 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.529+0000 7fca02400640 1 -- 172.21.15.49:0/3271392441 shutdown_connections 2024-01-31T05:04:02.530 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:02.529+0000 7fca02400640 1 -- 172.21.15.49:0/3271392441 wait complete. 2024-01-31T05:04:02.546 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-31T05:04:09.353 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-31T05:04:09.495 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.497+0000 7f3d8cc00640 1 Processor -- start 2024-01-31T05:04:09.495 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.497+0000 7f3d8cc00640 1 -- start start 2024-01-31T05:04:09.496 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.497+0000 7f3d8cc00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3d881611f0 0x7f3d881615d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:09.496 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.497+0000 7f3d8cc00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3d88161b10 0x7f3d8806c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:09.496 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.497+0000 7f3d8cc00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8806cc70 con 0x7f3d8806c820 2024-01-31T05:04:09.496 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.497+0000 7f3d8cc00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d880cc490 con 0x7f3d881611f0 2024-01-31T05:04:09.496 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.497+0000 7f3d8cc00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d880cf710 con 0x7f3d88161b10 2024-01-31T05:04:09.496 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.497+0000 7f3d85e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3d881611f0 0x7f3d881615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:09.497 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.497+0000 7f3d85e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3d881611f0 0x7f3d881615d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38588/0 (socket says 172.21.15.49:38588) 2024-01-31T05:04:09.497 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.497+0000 7f3d85e00640 1 -- 172.21.15.49:0/916530863 learned_addr learned my addr 172.21.15.49:0/916530863 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:09.500 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.497+0000 7f3d85400640 1 --2- 172.21.15.49:0/916530863 >> v2:172.21.15.195:3300/0 conn(0x7f3d88161b10 0x7f3d8806c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:09.500 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.497+0000 7f3d85e00640 1 -- 172.21.15.49:0/916530863 >> v2:172.21.15.195:3300/0 conn(0x7f3d88161b10 msgr2=0x7f3d8806c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:09.500 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.497+0000 7f3d85e00640 1 --2- 172.21.15.49:0/916530863 >> v2:172.21.15.195:3300/0 conn(0x7f3d88161b10 0x7f3d8806c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:09.500 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.497+0000 7f3d85e00640 1 -- 172.21.15.49:0/916530863 >> v1:172.21.15.195:6789/0 conn(0x7f3d8806c820 legacy=0x7f3d8815caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:09.500 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.497+0000 7f3d85e00640 1 -- 172.21.15.49:0/916530863 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d880cf9f0 con 0x7f3d881611f0 2024-01-31T05:04:09.500 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.497+0000 7f3d85400640 1 --2- 172.21.15.49:0/916530863 >> v2:172.21.15.195:3300/0 conn(0x7f3d88161b10 0x7f3d8806c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:09.500 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.501+0000 7f3d85e00640 1 --2- 172.21.15.49:0/916530863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d881611f0 0x7f3d881615d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3d880ce890 tx=0x7f3d7801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e3c26dc257427c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:09.500 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.501+0000 7f3d84a00640 1 -- 172.21.15.49:0/916530863 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d780a89b0 con 0x7f3d881611f0 2024-01-31T05:04:09.500 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.501+0000 7f3d84a00640 1 -- 172.21.15.49:0/916530863 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d780a8b10 con 0x7f3d881611f0 2024-01-31T05:04:09.501 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.501+0000 7f3d84a00640 1 -- 172.21.15.49:0/916530863 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d780a8ea0 con 0x7f3d881611f0 2024-01-31T05:04:09.501 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.501+0000 7f3d8cc00640 1 -- 172.21.15.49:0/916530863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d881611f0 msgr2=0x7f3d881615d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:09.501 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.501+0000 7f3d8cc00640 1 --2- 172.21.15.49:0/916530863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d881611f0 0x7f3d881615d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3d880ce890 tx=0x7f3d7801ecb0 comp rx=0 tx=0).stop 2024-01-31T05:04:09.501 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.501+0000 7f3d8cc00640 1 -- 172.21.15.49:0/916530863 shutdown_connections 2024-01-31T05:04:09.502 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.501+0000 7f3d8cc00640 1 --2- 172.21.15.49:0/916530863 >> v2:172.21.15.195:3300/0 conn(0x7f3d88161b10 0x7f3d8806c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:09.502 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.501+0000 7f3d8cc00640 1 --2- 172.21.15.49:0/916530863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d881611f0 0x7f3d881615d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:09.502 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.501+0000 7f3d8cc00640 1 -- 172.21.15.49:0/916530863 >> 172.21.15.49:0/916530863 conn(0x7f3d880d0e30 msgr2=0x7f3d880d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:09.502 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.501+0000 7f3d8cc00640 1 -- 172.21.15.49:0/916530863 shutdown_connections 2024-01-31T05:04:09.502 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.501+0000 7f3d8cc00640 1 -- 172.21.15.49:0/916530863 wait complete. 2024-01-31T05:04:09.503 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d8cc00640 1 Processor -- start 2024-01-31T05:04:09.503 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d8cc00640 1 -- start start 2024-01-31T05:04:09.505 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d8cc00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d8806c820 0x7f3d880b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:09.505 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d8cc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d881611f0 0x7f3d880af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:09.505 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d8cc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d88161b10 0x7f3d8814c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:09.505 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d8cc00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880c77e0 con 0x7f3d8806c820 2024-01-31T05:04:09.505 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d8cc00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880afdf0 con 0x7f3d881611f0 2024-01-31T05:04:09.505 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d8cc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880b0020 con 0x7f3d88161b10 2024-01-31T05:04:09.505 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d85e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d8806c820 0x7f3d880b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:09.505 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d85e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d8806c820 0x7f3d880b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38594/0 (socket says 172.21.15.49:38594) 2024-01-31T05:04:09.506 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d85e00640 1 -- 172.21.15.49:0/560021326 learned_addr learned my addr 172.21.15.49:0/560021326 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:09.506 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d85400640 1 --2- 172.21.15.49:0/560021326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d881611f0 0x7f3d880af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:09.506 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d86800640 1 --2- 172.21.15.49:0/560021326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d88161b10 0x7f3d8814c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:09.506 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d85e00640 1 -- 172.21.15.49:0/560021326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d88161b10 msgr2=0x7f3d8814c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:09.506 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d85e00640 1 --2- 172.21.15.49:0/560021326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d88161b10 0x7f3d8814c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:09.506 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d85e00640 1 -- 172.21.15.49:0/560021326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d881611f0 msgr2=0x7f3d880af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:09.506 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d85e00640 1 --2- 172.21.15.49:0/560021326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d881611f0 0x7f3d880af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:09.506 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d85e00640 1 -- 172.21.15.49:0/560021326 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d78009480 con 0x7f3d8806c820 2024-01-31T05:04:09.506 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d85400640 1 --2- 172.21.15.49:0/560021326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d881611f0 0x7f3d880af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:09.506 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d85e00640 1 --2- 172.21.15.49:0/560021326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d8806c820 0x7f3d880b2270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3d7801c8e0 tx=0x7f3d7801ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:09.506 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d7e000640 1 -- 172.21.15.49:0/560021326 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78003a30 con 0x7f3d8806c820 2024-01-31T05:04:09.506 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d7e000640 1 -- 172.21.15.49:0/560021326 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d78003b90 con 0x7f3d8806c820 2024-01-31T05:04:09.506 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d7e000640 1 -- 172.21.15.49:0/560021326 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d780b0440 con 0x7f3d8806c820 2024-01-31T05:04:09.507 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d8cc00640 1 -- 172.21.15.49:0/560021326 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d880c6f40 con 0x7f3d8806c820 2024-01-31T05:04:09.507 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.505+0000 7f3d8cc00640 1 -- 172.21.15.49:0/560021326 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d880c7500 con 0x7f3d8806c820 2024-01-31T05:04:09.507 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.509+0000 7f3d8cc00640 1 -- 172.21.15.49:0/560021326 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8804ead0 con 0x7f3d8806c820 2024-01-31T05:04:09.507 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.509+0000 7f3d7e000640 1 -- 172.21.15.49:0/560021326 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f3d780b7070 con 0x7f3d8806c820 2024-01-31T05:04:09.508 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.509+0000 7f3d7e000640 1 --2- 172.21.15.49:0/560021326 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3d60066500 0x7f3d600689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:09.508 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.509+0000 7f3d7e000640 1 -- 172.21.15.49:0/560021326 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3d78120960 con 0x7f3d8806c820 2024-01-31T05:04:09.508 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.509+0000 7f3d85400640 1 --2- 172.21.15.49:0/560021326 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3d60066500 0x7f3d600689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:09.509 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.509+0000 7f3d85400640 1 --2- 172.21.15.49:0/560021326 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3d60066500 0x7f3d600689c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3d70006fd0 tx=0x7f3d70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:09.513 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.513+0000 7f3d7e000640 1 -- 172.21.15.49:0/560021326 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f3d780edf40 con 0x7f3d8806c820 2024-01-31T05:04:09.672 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.673+0000 7f3d8cc00640 1 -- 172.21.15.49:0/560021326 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d8806cc70 con 0x7f3d8806c820 2024-01-31T05:04:09.673 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.673+0000 7f3d7e000640 1 -- 172.21.15.49:0/560021326 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12827 (secure 0 0 0) 0x7f3d8806cc70 con 0x7f3d8806c820 2024-01-31T05:04:09.673 INFO:teuthology.misc.health.smithi049.stdout: 2024-01-31T05:04:09.674 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":16,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:06.496120+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:04:09.676 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.677+0000 7f3d8cc00640 1 -- 172.21.15.49:0/560021326 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3d60066500 msgr2=0x7f3d600689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:09.676 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.677+0000 7f3d8cc00640 1 --2- 172.21.15.49:0/560021326 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3d60066500 0x7f3d600689c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3d70006fd0 tx=0x7f3d70008040 comp rx=0 tx=0).stop 2024-01-31T05:04:09.676 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.677+0000 7f3d8cc00640 1 -- 172.21.15.49:0/560021326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d8806c820 msgr2=0x7f3d880b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:09.676 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.677+0000 7f3d8cc00640 1 --2- 172.21.15.49:0/560021326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d8806c820 0x7f3d880b2270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3d7801c8e0 tx=0x7f3d7801ba50 comp rx=0 tx=0).stop 2024-01-31T05:04:09.676 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.677+0000 7f3d8cc00640 1 -- 172.21.15.49:0/560021326 shutdown_connections 2024-01-31T05:04:09.676 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.677+0000 7f3d8cc00640 1 --2- 172.21.15.49:0/560021326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d88161b10 0x7f3d8814c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:09.676 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.677+0000 7f3d8cc00640 1 --2- 172.21.15.49:0/560021326 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3d60066500 0x7f3d600689c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:09.676 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.677+0000 7f3d8cc00640 1 --2- 172.21.15.49:0/560021326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d881611f0 0x7f3d880af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:09.676 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.677+0000 7f3d8cc00640 1 --2- 172.21.15.49:0/560021326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d8806c820 0x7f3d880b2270 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:09.676 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.677+0000 7f3d8cc00640 1 -- 172.21.15.49:0/560021326 >> 172.21.15.49:0/560021326 conn(0x7f3d880d0e30 msgr2=0x7f3d8806e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:09.676 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.677+0000 7f3d8cc00640 1 -- 172.21.15.49:0/560021326 shutdown_connections 2024-01-31T05:04:09.676 INFO:teuthology.misc.health.smithi049.stderr:2024-01-31T05:04:09.677+0000 7f3d8cc00640 1 -- 172.21.15.49:0/560021326 wait complete. 2024-01-31T05:04:09.693 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-31T05:04:09.693 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-31T05:04:09.694 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-31T05:04:09.694 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-31T05:04:09.697 INFO:tasks.ceph.mds.a:Started 2024-01-31T05:04:09.697 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-31T05:04:09.697 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-31T05:04:09.700 INFO:tasks.ceph.mds.c:Started 2024-01-31T05:04:09.700 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-31T05:04:09.700 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-31T05:04:09.704 INFO:tasks.ceph.mds.b:Started 2024-01-31T05:04:09.704 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-31T05:04:09.704 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-31T05:04:09.707 INFO:tasks.ceph.mds.d:Started 2024-01-31T05:04:09.708 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-31T05:04:09.708 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:04:09.797 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-31T05:04:09.797 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-31T05:04:09.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.857+0000 7fcc25200640 1 Processor -- start 2024-01-31T05:04:09.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.857+0000 7fcc25200640 1 -- start start 2024-01-31T05:04:09.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.857+0000 7fcc25200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc2015d540 0x7fcc200cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:09.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.857+0000 7fcc25200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcc200cbbc0 0x7fcc2015d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:09.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.857+0000 7fcc25200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc200cef80 con 0x7fcc2006c290 2024-01-31T05:04:09.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.857+0000 7fcc25200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2006cae0 con 0x7fcc200cbbc0 2024-01-31T05:04:09.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.857+0000 7fcc25200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc200cf1b0 con 0x7fcc2015d540 2024-01-31T05:04:09.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.857+0000 7fcc1e800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcc200cbbc0 0x7fcc2015d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:09.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.857+0000 7fcc1e800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcc200cbbc0 0x7fcc2015d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38632/0 (socket says 172.21.15.49:38632) 2024-01-31T05:04:09.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.857+0000 7fcc1e800640 1 -- 172.21.15.49:0/184694227 learned_addr learned my addr 172.21.15.49:0/184694227 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:09.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.857+0000 7fcc1de00640 1 --2- 172.21.15.49:0/184694227 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc2015d540 0x7fcc200cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:09.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.857+0000 7fcc1e800640 1 -- 172.21.15.49:0/184694227 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc2015d540 msgr2=0x7fcc200cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:09.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.857+0000 7fcc1e800640 1 --2- 172.21.15.49:0/184694227 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc2015d540 0x7fcc200cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:09.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.861+0000 7fcc1e800640 1 -- 172.21.15.49:0/184694227 >> v1:172.21.15.195:6789/0 conn(0x7fcc2006c290 legacy=0x7fcc200cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:09.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.861+0000 7fcc1e800640 1 -- 172.21.15.49:0/184694227 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc200cf490 con 0x7fcc200cbbc0 2024-01-31T05:04:09.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.861+0000 7fcc1de00640 1 --2- 172.21.15.49:0/184694227 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc2015d540 0x7fcc200cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:09.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.861+0000 7fcc1e800640 1 --2- 172.21.15.49:0/184694227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc200cbbc0 0x7fcc2015d920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009e50 tx=0x7fcc1801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a0f829f588f6cb server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:09.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.861+0000 7fcc1ca00640 1 -- 172.21.15.49:0/184694227 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc180a58a0 con 0x7fcc200cbbc0 2024-01-31T05:04:09.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.861+0000 7fcc1ca00640 1 -- 172.21.15.49:0/184694227 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc180a5a00 con 0x7fcc200cbbc0 2024-01-31T05:04:09.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.861+0000 7fcc1ca00640 1 -- 172.21.15.49:0/184694227 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc180a5d90 con 0x7fcc200cbbc0 2024-01-31T05:04:09.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.861+0000 7fcc25200640 1 -- 172.21.15.49:0/184694227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc200cbbc0 msgr2=0x7fcc2015d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:09.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.861+0000 7fcc25200640 1 --2- 172.21.15.49:0/184694227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc200cbbc0 0x7fcc2015d920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009e50 tx=0x7fcc1801c9e0 comp rx=0 tx=0).stop 2024-01-31T05:04:09.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc25200640 1 -- 172.21.15.49:0/184694227 shutdown_connections 2024-01-31T05:04:09.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc25200640 1 --2- 172.21.15.49:0/184694227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc200cbbc0 0x7fcc2015d920 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:09.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc25200640 1 --2- 172.21.15.49:0/184694227 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc2015d540 0x7fcc200cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:09.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc25200640 1 -- 172.21.15.49:0/184694227 >> 172.21.15.49:0/184694227 conn(0x7fcc200d0e60 msgr2=0x7fcc200d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:09.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc25200640 1 -- 172.21.15.49:0/184694227 shutdown_connections 2024-01-31T05:04:09.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc25200640 1 -- 172.21.15.49:0/184694227 wait complete. 2024-01-31T05:04:09.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc25200640 1 Processor -- start 2024-01-31T05:04:09.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc25200640 1 -- start start 2024-01-31T05:04:09.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc25200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc2006c290 0x7fcc200c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:09.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc25200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc200cbbc0 0x7fcc201584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:09.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc25200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc2015d540 0x7fcc200c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:09.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc25200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc200cb180 con 0x7fcc2006c290 2024-01-31T05:04:09.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc25200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc200ca0e0 con 0x7fcc200cbbc0 2024-01-31T05:04:09.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc25200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc200ca3c0 con 0x7fcc2015d540 2024-01-31T05:04:09.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc1de00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc2006c290 0x7fcc200c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:09.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc1de00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc2006c290 0x7fcc200c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38648/0 (socket says 172.21.15.49:38648) 2024-01-31T05:04:09.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc1de00640 1 -- 172.21.15.49:0/2934033203 learned_addr learned my addr 172.21.15.49:0/2934033203 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:09.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc1d400640 1 --2- 172.21.15.49:0/2934033203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc200cbbc0 0x7fcc201584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:09.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc1e800640 1 --2- 172.21.15.49:0/2934033203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc2015d540 0x7fcc200c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:09.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc1de00640 1 -- 172.21.15.49:0/2934033203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc2015d540 msgr2=0x7fcc200c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:09.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc1de00640 1 --2- 172.21.15.49:0/2934033203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc2015d540 0x7fcc200c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:09.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc1de00640 1 -- 172.21.15.49:0/2934033203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc200cbbc0 msgr2=0x7fcc201584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:09.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc1de00640 1 --2- 172.21.15.49:0/2934033203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc200cbbc0 0x7fcc201584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:09.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.865+0000 7fcc1de00640 1 -- 172.21.15.49:0/2934033203 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc18009b30 con 0x7fcc2006c290 2024-01-31T05:04:09.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.869+0000 7fcc1de00640 1 --2- 172.21.15.49:0/2934033203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc2006c290 0x7fcc200c9ae0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000c7f0 tx=0x7fcc1000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:09.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.869+0000 7fcc16000640 1 -- 172.21.15.49:0/2934033203 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10007820 con 0x7fcc2006c290 2024-01-31T05:04:09.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.869+0000 7fcc16000640 1 -- 172.21.15.49:0/2934033203 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc10007980 con 0x7fcc2006c290 2024-01-31T05:04:09.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.869+0000 7fcc16000640 1 -- 172.21.15.49:0/2934033203 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10007d30 con 0x7fcc2006c290 2024-01-31T05:04:09.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.869+0000 7fcc25200640 1 -- 172.21.15.49:0/2934033203 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc200ca6a0 con 0x7fcc2006c290 2024-01-31T05:04:09.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.869+0000 7fcc25200640 1 -- 172.21.15.49:0/2934033203 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc200cac60 con 0x7fcc2006c290 2024-01-31T05:04:09.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.869+0000 7fcc25200640 1 -- 172.21.15.49:0/2934033203 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc200ce880 con 0x7fcc2006c290 2024-01-31T05:04:09.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.869+0000 7fcc16000640 1 -- 172.21.15.49:0/2934033203 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fcc100113f0 con 0x7fcc2006c290 2024-01-31T05:04:09.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.869+0000 7fcc16000640 1 --2- 172.21.15.49:0/2934033203 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcbf8066500 0x7fcbf80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:09.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.869+0000 7fcc16000640 1 -- 172.21.15.49:0/2934033203 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcc10083dc0 con 0x7fcc2006c290 2024-01-31T05:04:09.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.869+0000 7fcc1d400640 1 --2- 172.21.15.49:0/2934033203 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcbf8066500 0x7fcbf80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:09.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.873+0000 7fcc1d400640 1 --2- 172.21.15.49:0/2934033203 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcbf8066500 0x7fcbf80689c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcc200ce360 tx=0x7fcc08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:09.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:09.873+0000 7fcc16000640 1 -- 172.21.15.49:0/2934033203 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fcc10051450 con 0x7fcc2006c290 2024-01-31T05:04:10.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.033+0000 7fcc25200640 1 -- 172.21.15.49:0/2934033203 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc200cae80 con 0x7fcc2006c290 2024-01-31T05:04:10.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.033+0000 7fcc16000640 1 -- 172.21.15.49:0/2934033203 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12827 (secure 0 0 0) 0x7fcc10054a70 con 0x7fcc2006c290 2024-01-31T05:04:10.033 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:10.033 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:06.496120+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:04:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.037+0000 7fcc25200640 1 -- 172.21.15.49:0/2934033203 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcbf8066500 msgr2=0x7fcbf80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.037+0000 7fcc25200640 1 --2- 172.21.15.49:0/2934033203 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcbf8066500 0x7fcbf80689c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcc200ce360 tx=0x7fcc08009040 comp rx=0 tx=0).stop 2024-01-31T05:04:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.037+0000 7fcc25200640 1 -- 172.21.15.49:0/2934033203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc2006c290 msgr2=0x7fcc200c9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.037+0000 7fcc25200640 1 --2- 172.21.15.49:0/2934033203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc2006c290 0x7fcc200c9ae0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000c7f0 tx=0x7fcc1000ccb0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.037+0000 7fcc25200640 1 -- 172.21.15.49:0/2934033203 shutdown_connections 2024-01-31T05:04:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.037+0000 7fcc25200640 1 --2- 172.21.15.49:0/2934033203 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc2015d540 0x7fcc200c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.037+0000 7fcc25200640 1 --2- 172.21.15.49:0/2934033203 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcbf8066500 0x7fcbf80689c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.037+0000 7fcc25200640 1 --2- 172.21.15.49:0/2934033203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc200cbbc0 0x7fcc201584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.037+0000 7fcc25200640 1 --2- 172.21.15.49:0/2934033203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc2006c290 0x7fcc200c9ae0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.037+0000 7fcc25200640 1 -- 172.21.15.49:0/2934033203 >> 172.21.15.49:0/2934033203 conn(0x7fcc200d0e60 msgr2=0x7fcc2015bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.037+0000 7fcc25200640 1 -- 172.21.15.49:0/2934033203 shutdown_connections 2024-01-31T05:04:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.037+0000 7fcc25200640 1 -- 172.21.15.49:0/2934033203 wait complete. 2024-01-31T05:04:10.055 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-31T05:04:10.055 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:04:10.167 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2024-01-31T05:04:10.167 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2024-01-31T05:04:10.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.201+0000 7f76fda00640 1 Processor -- start 2024-01-31T05:04:10.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.201+0000 7f76fda00640 1 -- start start 2024-01-31T05:04:10.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.201+0000 7f76fda00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f76f815a000 0x7f76f80cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:10.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.201+0000 7f76fda00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76f806c2d0 0x7f76f8070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:10.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.201+0000 7f76fda00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f76f8071410 0x7f76f80b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:10.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.201+0000 7f76fda00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f80b3760 con 0x7f76f815a000 2024-01-31T05:04:10.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.201+0000 7f76fda00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f80718a0 con 0x7f76f8071410 2024-01-31T05:04:10.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.201+0000 7f76fda00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f806c750 con 0x7f76f806c2d0 2024-01-31T05:04:10.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.201+0000 7f76f6a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f76f815a000 0x7f76f80cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:10.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.201+0000 7f76f6a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f76f815a000 0x7f76f80cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38652/0 (socket says 172.21.15.49:38652) 2024-01-31T05:04:10.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.201+0000 7f76f6a00640 1 -- 172.21.15.49:0/2249448824 learned_addr learned my addr 172.21.15.49:0/2249448824 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:10.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.201+0000 7f76f7400640 1 --2- 172.21.15.49:0/2249448824 >> v2:172.21.15.195:3300/0 conn(0x7f76f8071410 0x7f76f80b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:10.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.201+0000 7f76f6000640 1 --2- 172.21.15.49:0/2249448824 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76f806c2d0 0x7f76f8070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:10.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.201+0000 7f76f6a00640 1 -- 172.21.15.49:0/2249448824 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76f806c2d0 msgr2=0x7f76f8070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:10.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.201+0000 7f76f6a00640 1 --2- 172.21.15.49:0/2249448824 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76f806c2d0 0x7f76f8070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.201+0000 7f76f6a00640 1 -- 172.21.15.49:0/2249448824 >> v2:172.21.15.195:3300/0 conn(0x7f76f8071410 msgr2=0x7f76f80b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:10.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.201+0000 7f76f6a00640 1 --2- 172.21.15.49:0/2249448824 >> v2:172.21.15.195:3300/0 conn(0x7f76f8071410 0x7f76f80b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.201+0000 7f76f6a00640 1 -- 172.21.15.49:0/2249448824 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f8071e40 con 0x7f76f815a000 2024-01-31T05:04:10.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.201+0000 7f76f7400640 1 --2- 172.21.15.49:0/2249448824 >> v2:172.21.15.195:3300/0 conn(0x7f76f8071410 0x7f76f80b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:10.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.205+0000 7f76f6a00640 1 --2- 172.21.15.49:0/2249448824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76f815a000 0x7f76f80cb040 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f76f80b19b0 tx=0x7f76e801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8bf424d46399d99 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:10.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.205+0000 7f76f5600640 1 -- 172.21.15.49:0/2249448824 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e80ac410 con 0x7f76f815a000 2024-01-31T05:04:10.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.205+0000 7f76f5600640 1 -- 172.21.15.49:0/2249448824 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e80ac570 con 0x7f76f815a000 2024-01-31T05:04:10.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.205+0000 7f76f5600640 1 -- 172.21.15.49:0/2249448824 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e80ac900 con 0x7f76f815a000 2024-01-31T05:04:10.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.205+0000 7f76fda00640 1 -- 172.21.15.49:0/2249448824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76f815a000 msgr2=0x7f76f80cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:10.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.205+0000 7f76fda00640 1 --2- 172.21.15.49:0/2249448824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76f815a000 0x7f76f80cb040 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f76f80b19b0 tx=0x7f76e801c500 comp rx=0 tx=0).stop 2024-01-31T05:04:10.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.205+0000 7f76fda00640 1 -- 172.21.15.49:0/2249448824 shutdown_connections 2024-01-31T05:04:10.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.205+0000 7f76fda00640 1 --2- 172.21.15.49:0/2249448824 >> v2:172.21.15.195:3300/0 conn(0x7f76f8071410 0x7f76f80b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.205+0000 7f76fda00640 1 --2- 172.21.15.49:0/2249448824 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76f806c2d0 0x7f76f8070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.205+0000 7f76fda00640 1 --2- 172.21.15.49:0/2249448824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76f815a000 0x7f76f80cb040 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.205+0000 7f76fda00640 1 -- 172.21.15.49:0/2249448824 >> 172.21.15.49:0/2249448824 conn(0x7f76f80b09a0 msgr2=0x7f76f80b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:10.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.205+0000 7f76fda00640 1 -- 172.21.15.49:0/2249448824 shutdown_connections 2024-01-31T05:04:10.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.205+0000 7f76fda00640 1 -- 172.21.15.49:0/2249448824 wait complete. 2024-01-31T05:04:10.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76fda00640 1 Processor -- start 2024-01-31T05:04:10.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76fda00640 1 -- start start 2024-01-31T05:04:10.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76fda00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76f806c2d0 0x7f76f814fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:10.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76fda00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76f8071410 0x7f76f8163c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:10.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76fda00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76f815a000 0x7f76f80cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:10.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76fda00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f81503a0 con 0x7f76f806c2d0 2024-01-31T05:04:10.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76fda00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f81641a0 con 0x7f76f815a000 2024-01-31T05:04:10.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76fda00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f8162bc0 con 0x7f76f8071410 2024-01-31T05:04:10.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76f6a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76f806c2d0 0x7f76f814fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:10.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76f6a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76f806c2d0 0x7f76f814fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38664/0 (socket says 172.21.15.49:38664) 2024-01-31T05:04:10.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76f6a00640 1 -- 172.21.15.49:0/4050426163 learned_addr learned my addr 172.21.15.49:0/4050426163 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:10.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76f7400640 1 --2- 172.21.15.49:0/4050426163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76f815a000 0x7f76f80cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:10.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76f6000640 1 --2- 172.21.15.49:0/4050426163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76f8071410 0x7f76f8163c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:10.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76f6a00640 1 -- 172.21.15.49:0/4050426163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76f8071410 msgr2=0x7f76f8163c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:10.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76f6a00640 1 --2- 172.21.15.49:0/4050426163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76f8071410 0x7f76f8163c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76f6a00640 1 -- 172.21.15.49:0/4050426163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76f815a000 msgr2=0x7f76f80cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:10.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76f6a00640 1 --2- 172.21.15.49:0/4050426163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76f815a000 0x7f76f80cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76f6a00640 1 -- 172.21.15.49:0/4050426163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e80094d0 con 0x7f76f806c2d0 2024-01-31T05:04:10.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76f6a00640 1 --2- 172.21.15.49:0/4050426163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76f806c2d0 0x7f76f814fe60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f76e80af040 tx=0x7f76e80192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:10.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76eea00640 1 -- 172.21.15.49:0/4050426163 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e80b66b0 con 0x7f76f806c2d0 2024-01-31T05:04:10.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76eea00640 1 -- 172.21.15.49:0/4050426163 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e80b6810 con 0x7f76f806c2d0 2024-01-31T05:04:10.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76fda00640 1 -- 172.21.15.49:0/4050426163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f8162ea0 con 0x7f76f806c2d0 2024-01-31T05:04:10.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76eea00640 1 -- 172.21.15.49:0/4050426163 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e80b6bc0 con 0x7f76f806c2d0 2024-01-31T05:04:10.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.209+0000 7f76fda00640 1 -- 172.21.15.49:0/4050426163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f8163460 con 0x7f76f806c2d0 2024-01-31T05:04:10.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.213+0000 7f76fda00640 1 -- 172.21.15.49:0/4050426163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f8074860 con 0x7f76f806c2d0 2024-01-31T05:04:10.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.213+0000 7f76eea00640 1 -- 172.21.15.49:0/4050426163 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f76e80b6d20 con 0x7f76f806c2d0 2024-01-31T05:04:10.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.213+0000 7f76eea00640 1 --2- 172.21.15.49:0/4050426163 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f76d0066500 0x7f76d00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:10.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.213+0000 7f76eea00640 1 -- 172.21.15.49:0/4050426163 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f76e811e5c0 con 0x7f76f806c2d0 2024-01-31T05:04:10.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.213+0000 7f76f6000640 1 --2- 172.21.15.49:0/4050426163 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f76d0066500 0x7f76d00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:10.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.213+0000 7f76f6000640 1 --2- 172.21.15.49:0/4050426163 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f76d0066500 0x7f76d00689c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f76f8164500 tx=0x7f76e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:10.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.217+0000 7f76eea00640 1 -- 172.21.15.49:0/4050426163 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f76e80ebd80 con 0x7f76f806c2d0 2024-01-31T05:04:10.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.381+0000 7f76fda00640 1 -- 172.21.15.49:0/4050426163 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76f80cb360 con 0x7f76f806c2d0 2024-01-31T05:04:10.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.381+0000 7f76eea00640 1 -- 172.21.15.49:0/4050426163 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76e80ef3a0 con 0x7f76f806c2d0 2024-01-31T05:04:10.380 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:04:10.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.385+0000 7f76fda00640 1 -- 172.21.15.49:0/4050426163 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f76d0066500 msgr2=0x7f76d00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:10.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.385+0000 7f76fda00640 1 --2- 172.21.15.49:0/4050426163 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f76d0066500 0x7f76d00689c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f76f8164500 tx=0x7f76e0008040 comp rx=0 tx=0).stop 2024-01-31T05:04:10.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.385+0000 7f76fda00640 1 -- 172.21.15.49:0/4050426163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76f806c2d0 msgr2=0x7f76f814fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:10.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.385+0000 7f76fda00640 1 --2- 172.21.15.49:0/4050426163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76f806c2d0 0x7f76f814fe60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f76e80af040 tx=0x7f76e80192a0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.385+0000 7f76fda00640 1 -- 172.21.15.49:0/4050426163 shutdown_connections 2024-01-31T05:04:10.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.385+0000 7f76fda00640 1 --2- 172.21.15.49:0/4050426163 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f76d0066500 0x7f76d00689c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.385+0000 7f76fda00640 1 --2- 172.21.15.49:0/4050426163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76f815a000 0x7f76f80cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.385+0000 7f76fda00640 1 --2- 172.21.15.49:0/4050426163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f76f8071410 0x7f76f8163c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.385+0000 7f76fda00640 1 --2- 172.21.15.49:0/4050426163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76f806c2d0 0x7f76f814fe60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.385+0000 7f76fda00640 1 -- 172.21.15.49:0/4050426163 >> 172.21.15.49:0/4050426163 conn(0x7f76f80b09a0 msgr2=0x7f76f806d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:10.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.385+0000 7f76fda00640 1 -- 172.21.15.49:0/4050426163 shutdown_connections 2024-01-31T05:04:10.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.385+0000 7f76fda00640 1 -- 172.21.15.49:0/4050426163 wait complete. 2024-01-31T05:04:10.402 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:04:10.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.545+0000 7f3c7c600640 1 Processor -- start 2024-01-31T05:04:10.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.545+0000 7f3c7c600640 1 -- start start 2024-01-31T05:04:10.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.545+0000 7f3c7c600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c7415e7e0 0x7f3c740b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:10.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.545+0000 7f3c7c600640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c740c67f0 con 0x7f3c740cf670 2024-01-31T05:04:10.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.545+0000 7f3c7c600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c740c6ab0 con 0x7f3c740c63d0 2024-01-31T05:04:10.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.545+0000 7f3c7c600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c740d1d40 con 0x7f3c7415e7e0 2024-01-31T05:04:10.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.545+0000 7f3c7a600640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3c740cf670 0x7f3c740cbab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45414/0 (socket says 172.21.15.49:45414) 2024-01-31T05:04:10.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.545+0000 7f3c7a600640 1 -- 172.21.15.49:0/2833768401 learned_addr learned my addr 172.21.15.49:0/2833768401 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:10.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.545+0000 7f3c79c00640 1 --2- 172.21.15.49:0/2833768401 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c7415e7e0 0x7f3c740b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:10.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.545+0000 7f3c73e00640 1 -- 172.21.15.49:0/2833768401 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431796341 0 0) 0x7f3c740c67f0 con 0x7f3c740cf670 2024-01-31T05:04:10.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.545+0000 7f3c73e00640 1 -- 172.21.15.49:0/2833768401 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c54003530 con 0x7f3c740cf670 2024-01-31T05:04:10.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.545+0000 7f3c73e00640 1 -- 172.21.15.49:0/2833768401 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3252463733 0 0) 0x7f3c740c6ab0 con 0x7f3c740c63d0 2024-01-31T05:04:10.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.545+0000 7f3c73e00640 1 -- 172.21.15.49:0/2833768401 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c740c67f0 con 0x7f3c740c63d0 2024-01-31T05:04:10.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.545+0000 7f3c79c00640 1 -- 172.21.15.49:0/2833768401 >> v1:172.21.15.195:6789/0 conn(0x7f3c740c63d0 legacy=0x7f3c740cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:10.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.545+0000 7f3c79c00640 1 -- 172.21.15.49:0/2833768401 >> v1:172.21.15.49:6789/0 conn(0x7f3c740cf670 legacy=0x7f3c740cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:10.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.545+0000 7f3c79c00640 1 -- 172.21.15.49:0/2833768401 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c740c6d90 con 0x7f3c7415e7e0 2024-01-31T05:04:10.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.549+0000 7f3c79c00640 1 --2- 172.21.15.49:0/2833768401 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c7415e7e0 0x7f3c740b2370 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3c640097f0 tx=0x7f3c6401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4beeeac3b5333b7f server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:10.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.549+0000 7f3c73e00640 1 -- 172.21.15.49:0/2833768401 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c640a89b0 con 0x7f3c7415e7e0 2024-01-31T05:04:10.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.549+0000 7f3c73e00640 1 -- 172.21.15.49:0/2833768401 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c640a8b10 con 0x7f3c7415e7e0 2024-01-31T05:04:10.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.549+0000 7f3c73e00640 1 -- 172.21.15.49:0/2833768401 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c640a8e80 con 0x7f3c7415e7e0 2024-01-31T05:04:10.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c7c600640 1 -- 172.21.15.49:0/2833768401 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c7415e7e0 msgr2=0x7f3c740b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:10.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c7c600640 1 --2- 172.21.15.49:0/2833768401 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c7415e7e0 0x7f3c740b2370 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3c640097f0 tx=0x7f3c6401ecb0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c7c600640 1 -- 172.21.15.49:0/2833768401 shutdown_connections 2024-01-31T05:04:10.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c7c600640 1 --2- 172.21.15.49:0/2833768401 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c7415e7e0 0x7f3c740b2370 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c7c600640 1 -- 172.21.15.49:0/2833768401 >> 172.21.15.49:0/2833768401 conn(0x7f3c740d0e60 msgr2=0x7f3c740d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:10.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c7c600640 1 -- 172.21.15.49:0/2833768401 shutdown_connections 2024-01-31T05:04:10.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c7c600640 1 -- 172.21.15.49:0/2833768401 wait complete. 2024-01-31T05:04:10.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c7c600640 1 Processor -- start 2024-01-31T05:04:10.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c7c600640 1 -- start start 2024-01-31T05:04:10.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c7c600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c740c63d0 0x7f3c74147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:10.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c7c600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c740cf670 0x7f3c740b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:10.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c7c600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c7415e7e0 0x7f3c7415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:10.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c7c600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c740cda90 con 0x7f3c7415e7e0 2024-01-31T05:04:10.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c7c600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c740cd7b0 con 0x7f3c740cf670 2024-01-31T05:04:10.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c7c600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c740b55b0 con 0x7f3c740c63d0 2024-01-31T05:04:10.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c7a600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c7415e7e0 0x7f3c7415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:10.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c7a600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c7415e7e0 0x7f3c7415c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38678/0 (socket says 172.21.15.49:38678) 2024-01-31T05:04:10.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c7a600640 1 -- 172.21.15.49:0/2903506513 learned_addr learned my addr 172.21.15.49:0/2903506513 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:10.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c79200640 1 --2- 172.21.15.49:0/2903506513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c740cf670 0x7f3c740b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:10.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.553+0000 7f3c79c00640 1 --2- 172.21.15.49:0/2903506513 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c740c63d0 0x7f3c74147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:10.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.557+0000 7f3c7a600640 1 -- 172.21.15.49:0/2903506513 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c740c63d0 msgr2=0x7f3c74147dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:10.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.557+0000 7f3c7a600640 1 --2- 172.21.15.49:0/2903506513 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c740c63d0 0x7f3c74147dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.557+0000 7f3c7a600640 1 -- 172.21.15.49:0/2903506513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c740cf670 msgr2=0x7f3c740b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:10.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.557+0000 7f3c7a600640 1 --2- 172.21.15.49:0/2903506513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c740cf670 0x7f3c740b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.557+0000 7f3c7a600640 1 -- 172.21.15.49:0/2903506513 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c64009420 con 0x7f3c7415e7e0 2024-01-31T05:04:10.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.557+0000 7f3c7a600640 1 --2- 172.21.15.49:0/2903506513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c7415e7e0 0x7f3c7415c3e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c00cba0 tx=0x7f3c6c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:10.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.557+0000 7f3c71600640 1 -- 172.21.15.49:0/2903506513 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c00ac40 con 0x7f3c7415e7e0 2024-01-31T05:04:10.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.557+0000 7f3c71600640 1 -- 172.21.15.49:0/2903506513 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c00ada0 con 0x7f3c7415e7e0 2024-01-31T05:04:10.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.557+0000 7f3c71600640 1 -- 172.21.15.49:0/2903506513 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c012620 con 0x7f3c7415e7e0 2024-01-31T05:04:10.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.557+0000 7f3c7c600640 1 -- 172.21.15.49:0/2903506513 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c740b5890 con 0x7f3c7415e7e0 2024-01-31T05:04:10.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.557+0000 7f3c7c600640 1 -- 172.21.15.49:0/2903506513 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c740b3ed0 con 0x7f3c7415e7e0 2024-01-31T05:04:10.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.557+0000 7f3c7c600640 1 -- 172.21.15.49:0/2903506513 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c740c4380 con 0x7f3c7415e7e0 2024-01-31T05:04:10.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.557+0000 7f3c71600640 1 -- 172.21.15.49:0/2903506513 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f3c6c007070 con 0x7f3c7415e7e0 2024-01-31T05:04:10.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.561+0000 7f3c71600640 1 --2- 172.21.15.49:0/2903506513 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3c4c066500 0x7f3c4c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:10.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.561+0000 7f3c71600640 1 -- 172.21.15.49:0/2903506513 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3c6c083ad0 con 0x7f3c7415e7e0 2024-01-31T05:04:10.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.561+0000 7f3c79c00640 1 --2- 172.21.15.49:0/2903506513 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3c4c066500 0x7f3c4c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:10.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.561+0000 7f3c79c00640 1 --2- 172.21.15.49:0/2903506513 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3c4c066500 0x7f3c4c0689c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3c640b2000 tx=0x7f3c640aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:10.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.565+0000 7f3c71600640 1 -- 172.21.15.49:0/2903506513 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f3c6c051160 con 0x7f3c7415e7e0 2024-01-31T05:04:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.757+0000 7f3c7c600640 1 -- 172.21.15.49:0/2903506513 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c740b5410 con 0x7f3c7415e7e0 2024-01-31T05:04:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.757+0000 7f3c71600640 1 -- 172.21.15.49:0/2903506513 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f3c740b5410 con 0x7f3c7415e7e0 2024-01-31T05:04:10.758 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:10.758 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/4254852793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4254852793},{"type":"v1","addr":"172.21.15.49:6834","nonce":4254852793}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-31T05:04:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 2 2024-01-31T05:04:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.761+0000 7f3c7c600640 1 -- 172.21.15.49:0/2903506513 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3c4c066500 msgr2=0x7f3c4c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.761+0000 7f3c7c600640 1 --2- 172.21.15.49:0/2903506513 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3c4c066500 0x7f3c4c0689c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3c640b2000 tx=0x7f3c640aa070 comp rx=0 tx=0).stop 2024-01-31T05:04:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.761+0000 7f3c7c600640 1 -- 172.21.15.49:0/2903506513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c7415e7e0 msgr2=0x7f3c7415c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.761+0000 7f3c7c600640 1 --2- 172.21.15.49:0/2903506513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c7415e7e0 0x7f3c7415c3e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c00cba0 tx=0x7f3c6c00a060 comp rx=0 tx=0).stop 2024-01-31T05:04:10.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.761+0000 7f3c7c600640 1 -- 172.21.15.49:0/2903506513 shutdown_connections 2024-01-31T05:04:10.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.761+0000 7f3c7c600640 1 --2- 172.21.15.49:0/2903506513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c7415e7e0 0x7f3c7415c3e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.761+0000 7f3c7c600640 1 --2- 172.21.15.49:0/2903506513 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3c4c066500 0x7f3c4c0689c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.761+0000 7f3c7c600640 1 --2- 172.21.15.49:0/2903506513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c740cf670 0x7f3c740b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.761+0000 7f3c7c600640 1 --2- 172.21.15.49:0/2903506513 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c740c63d0 0x7f3c74147dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:10.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.761+0000 7f3c7c600640 1 -- 172.21.15.49:0/2903506513 >> 172.21.15.49:0/2903506513 conn(0x7f3c740d0e60 msgr2=0x7f3c7415d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:10.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.761+0000 7f3c7c600640 1 -- 172.21.15.49:0/2903506513 shutdown_connections 2024-01-31T05:04:10.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:10.761+0000 7f3c7c600640 1 -- 172.21.15.49:0/2903506513 wait complete. 2024-01-31T05:04:12.780 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:04:12.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.936+0000 7f7788000640 1 Processor -- start 2024-01-31T05:04:12.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.936+0000 7f7788000640 1 -- start start 2024-01-31T05:04:12.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.936+0000 7f7788000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f778015b3e0 0x7f77800ce170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:12.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.936+0000 7f7788000640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77800ccd50 con 0x7f77800cd680 2024-01-31T05:04:12.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.936+0000 7f7788000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77800cc790 con 0x7f77800ae4d0 2024-01-31T05:04:12.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.936+0000 7f7788000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77800cca70 con 0x7f778015b3e0 2024-01-31T05:04:12.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.936+0000 7f7784c00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f778015b3e0 0x7f77800ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:12.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.936+0000 7f7785600640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f77800cd680 0x7f77800cda60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45422/0 (socket says 172.21.15.49:45422) 2024-01-31T05:04:12.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.936+0000 7f7785600640 1 -- 172.21.15.49:0/837125458 learned_addr learned my addr 172.21.15.49:0/837125458 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:12.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.936+0000 7f7784c00640 1 -- 172.21.15.49:0/837125458 >> v1:172.21.15.195:6789/0 conn(0x7f77800ae4d0 legacy=0x7f77800ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:12.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.936+0000 7f7784c00640 1 -- 172.21.15.49:0/837125458 >> v1:172.21.15.49:6789/0 conn(0x7f77800cd680 legacy=0x7f77800cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:12.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.936+0000 7f7784c00640 1 -- 172.21.15.49:0/837125458 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77800adcd0 con 0x7f778015b3e0 2024-01-31T05:04:12.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.936+0000 7f777fe00640 1 -- 172.21.15.49:0/837125458 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104590093 0 0) 0x7f77800ccd50 con 0x7f77800cd680 2024-01-31T05:04:12.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.940+0000 7f7784c00640 1 --2- 172.21.15.49:0/837125458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f778015b3e0 0x7f77800ce170 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f77680097c0 tx=0x7f776801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea06daff2833321 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:12.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.940+0000 7f777fe00640 1 -- 172.21.15.49:0/837125458 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77680ab600 con 0x7f778015b3e0 2024-01-31T05:04:12.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.940+0000 7f777fe00640 1 -- 172.21.15.49:0/837125458 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77680a7050 con 0x7f778015b3e0 2024-01-31T05:04:12.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.940+0000 7f777fe00640 1 -- 172.21.15.49:0/837125458 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77680ab980 con 0x7f778015b3e0 2024-01-31T05:04:12.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.940+0000 7f7788000640 1 -- 172.21.15.49:0/837125458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f778015b3e0 msgr2=0x7f77800ce170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:12.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.940+0000 7f7788000640 1 --2- 172.21.15.49:0/837125458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f778015b3e0 0x7f77800ce170 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f77680097c0 tx=0x7f776801c380 comp rx=0 tx=0).stop 2024-01-31T05:04:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.940+0000 7f7788000640 1 -- 172.21.15.49:0/837125458 shutdown_connections 2024-01-31T05:04:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.940+0000 7f7788000640 1 --2- 172.21.15.49:0/837125458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f778015b3e0 0x7f77800ce170 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.940+0000 7f7788000640 1 -- 172.21.15.49:0/837125458 >> 172.21.15.49:0/837125458 conn(0x7f77800b28e0 msgr2=0x7f77800b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.940+0000 7f7788000640 1 -- 172.21.15.49:0/837125458 shutdown_connections 2024-01-31T05:04:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.940+0000 7f7788000640 1 -- 172.21.15.49:0/837125458 wait complete. 2024-01-31T05:04:12.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7788000640 1 Processor -- start 2024-01-31T05:04:12.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7788000640 1 -- start start 2024-01-31T05:04:12.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7788000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77800ae4d0 0x7f7780159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:12.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7788000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77800cd680 0x7f778015c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:12.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7788000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f778015b3e0 0x7f77800ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:12.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7788000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77800c9130 con 0x7f77800cd680 2024-01-31T05:04:12.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7788000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77800c9380 con 0x7f778015b3e0 2024-01-31T05:04:12.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7788000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77800c9660 con 0x7f77800ae4d0 2024-01-31T05:04:12.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7784c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77800cd680 0x7f778015c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:12.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7784c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77800cd680 0x7f778015c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38694/0 (socket says 172.21.15.49:38694) 2024-01-31T05:04:12.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7784c00640 1 -- 172.21.15.49:0/3932644395 learned_addr learned my addr 172.21.15.49:0/3932644395 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:12.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7785600640 1 --2- 172.21.15.49:0/3932644395 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77800ae4d0 0x7f7780159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:12.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7786000640 1 --2- 172.21.15.49:0/3932644395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f778015b3e0 0x7f77800ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:12.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7784c00640 1 -- 172.21.15.49:0/3932644395 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77800ae4d0 msgr2=0x7f7780159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:12.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7784c00640 1 --2- 172.21.15.49:0/3932644395 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77800ae4d0 0x7f7780159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:12.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7784c00640 1 -- 172.21.15.49:0/3932644395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f778015b3e0 msgr2=0x7f77800ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:12.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7784c00640 1 --2- 172.21.15.49:0/3932644395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f778015b3e0 0x7f77800ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:12.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7784c00640 1 -- 172.21.15.49:0/3932644395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7768009420 con 0x7f77800cd680 2024-01-31T05:04:12.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7784c00640 1 --2- 172.21.15.49:0/3932644395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77800cd680 0x7f778015c900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7768018f90 tx=0x7f7768019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:12.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f777d600640 1 -- 172.21.15.49:0/3932644395 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77680b4600 con 0x7f77800cd680 2024-01-31T05:04:12.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f777d600640 1 -- 172.21.15.49:0/3932644395 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77680b47a0 con 0x7f77800cd680 2024-01-31T05:04:12.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7788000640 1 -- 172.21.15.49:0/3932644395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77800c9940 con 0x7f77800cd680 2024-01-31T05:04:12.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f777d600640 1 -- 172.21.15.49:0/3932644395 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77680b4b50 con 0x7f77800cd680 2024-01-31T05:04:12.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.944+0000 7f7788000640 1 -- 172.21.15.49:0/3932644395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77800c9f00 con 0x7f77800cd680 2024-01-31T05:04:12.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.948+0000 7f7788000640 1 -- 172.21.15.49:0/3932644395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77800c97a0 con 0x7f77800cd680 2024-01-31T05:04:12.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.948+0000 7f777d600640 1 -- 172.21.15.49:0/3932644395 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f77680b2040 con 0x7f77800cd680 2024-01-31T05:04:12.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.948+0000 7f777d600640 1 --2- 172.21.15.49:0/3932644395 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7758066500 0x7f77580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:12.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.948+0000 7f777d600640 1 -- 172.21.15.49:0/3932644395 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f776811d9a0 con 0x7f77800cd680 2024-01-31T05:04:12.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.948+0000 7f7785600640 1 --2- 172.21.15.49:0/3932644395 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7758066500 0x7f77580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:12.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.948+0000 7f7785600640 1 --2- 172.21.15.49:0/3932644395 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7758066500 0x7f77580689c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7770007fd0 tx=0x7f7770007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:12.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:12.952+0000 7f777d600640 1 -- 172.21.15.49:0/3932644395 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f77800c97a0 con 0x7f77800cd680 2024-01-31T05:04:13.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.144+0000 7f7788000640 1 -- 172.21.15.49:0/3932644395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77800af800 con 0x7f77800cd680 2024-01-31T05:04:13.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.148+0000 7f777d600640 1 -- 172.21.15.49:0/3932644395 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7f77800af800 con 0x7f77800cd680 2024-01-31T05:04:13.146 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:13.146 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2308601440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2308601440},{"type":"v1","addr":"172.21.15.49:6835","nonce":2308601440}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2920530340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":2920530340},{"type":"v1","addr":"172.21.15.195:6836","nonce":2920530340}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3114317228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3114317228},{"type":"v1","addr":"172.21.15.195:6837","nonce":3114317228}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/4254852793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4254852793},{"type":"v1","addr":"172.21.15.49:6834","nonce":4254852793}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-31T05:04:13.147 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 3 2024-01-31T05:04:13.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.148+0000 7f7788000640 1 -- 172.21.15.49:0/3932644395 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7758066500 msgr2=0x7f77580689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:13.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.148+0000 7f7788000640 1 --2- 172.21.15.49:0/3932644395 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7758066500 0x7f77580689c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7770007fd0 tx=0x7f7770007d60 comp rx=0 tx=0).stop 2024-01-31T05:04:13.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.148+0000 7f7788000640 1 -- 172.21.15.49:0/3932644395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77800cd680 msgr2=0x7f778015c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:13.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.148+0000 7f7788000640 1 --2- 172.21.15.49:0/3932644395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77800cd680 0x7f778015c900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7768018f90 tx=0x7f7768019120 comp rx=0 tx=0).stop 2024-01-31T05:04:13.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.148+0000 7f7788000640 1 -- 172.21.15.49:0/3932644395 shutdown_connections 2024-01-31T05:04:13.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.148+0000 7f7788000640 1 --2- 172.21.15.49:0/3932644395 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7758066500 0x7f77580689c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.148+0000 7f7788000640 1 --2- 172.21.15.49:0/3932644395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f778015b3e0 0x7f77800ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.148+0000 7f7788000640 1 --2- 172.21.15.49:0/3932644395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77800cd680 0x7f778015c900 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.148+0000 7f7788000640 1 --2- 172.21.15.49:0/3932644395 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f77800ae4d0 0x7f7780159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.148+0000 7f7788000640 1 -- 172.21.15.49:0/3932644395 >> 172.21.15.49:0/3932644395 conn(0x7f77800b28e0 msgr2=0x7f778006fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:13.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.148+0000 7f7788000640 1 -- 172.21.15.49:0/3932644395 shutdown_connections 2024-01-31T05:04:13.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.148+0000 7f7788000640 1 -- 172.21.15.49:0/3932644395 wait complete. 2024-01-31T05:04:13.169 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:04:13.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.308+0000 7f8559c00640 1 Processor -- start 2024-01-31T05:04:13.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.308+0000 7f8559c00640 1 -- start start 2024-01-31T05:04:13.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.312+0000 7f8559c00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f85540cd680 0x7f85540cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:13.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.312+0000 7f8559c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f85540ae4d0 0x7f85540ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:13.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.312+0000 7f8559c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85540ccd50 con 0x7f855415b3e0 2024-01-31T05:04:13.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.312+0000 7f8559c00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85540cc790 con 0x7f85540cd680 2024-01-31T05:04:13.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.312+0000 7f8559c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85540cca70 con 0x7f85540ae4d0 2024-01-31T05:04:13.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.312+0000 7f8552a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f85540cd680 0x7f85540cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:13.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.312+0000 7f8552a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f85540cd680 0x7f85540cda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38702/0 (socket says 172.21.15.49:38702) 2024-01-31T05:04:13.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.312+0000 7f8552a00640 1 -- 172.21.15.49:0/964861309 learned_addr learned my addr 172.21.15.49:0/964861309 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:13.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.312+0000 7f8553400640 1 --2- 172.21.15.49:0/964861309 >> v2:172.21.15.195:3300/0 conn(0x7f85540ae4d0 0x7f85540ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:13.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.312+0000 7f8552a00640 1 -- 172.21.15.49:0/964861309 >> v2:172.21.15.195:3300/0 conn(0x7f85540ae4d0 msgr2=0x7f85540ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:13.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.312+0000 7f8552a00640 1 --2- 172.21.15.49:0/964861309 >> v2:172.21.15.195:3300/0 conn(0x7f85540ae4d0 0x7f85540ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.312+0000 7f8552a00640 1 -- 172.21.15.49:0/964861309 >> v1:172.21.15.195:6789/0 conn(0x7f855415b3e0 legacy=0x7f85540cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:13.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.312+0000 7f8552a00640 1 -- 172.21.15.49:0/964861309 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85540adcd0 con 0x7f85540cd680 2024-01-31T05:04:13.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.312+0000 7f8552a00640 1 --2- 172.21.15.49:0/964861309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85540cd680 0x7f85540cda60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8554068100 tx=0x7f854401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7bf14eae4f31699 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:13.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.316+0000 7f8551600640 1 -- 172.21.15.49:0/964861309 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85440ab600 con 0x7f85540cd680 2024-01-31T05:04:13.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.316+0000 7f8551600640 1 -- 172.21.15.49:0/964861309 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85440ab760 con 0x7f85540cd680 2024-01-31T05:04:13.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.316+0000 7f8551600640 1 -- 172.21.15.49:0/964861309 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85440abaf0 con 0x7f85540cd680 2024-01-31T05:04:13.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.316+0000 7f8559c00640 1 -- 172.21.15.49:0/964861309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85540cd680 msgr2=0x7f85540cda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:13.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.316+0000 7f8559c00640 1 --2- 172.21.15.49:0/964861309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85540cd680 0x7f85540cda60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8554068100 tx=0x7f854401c440 comp rx=0 tx=0).stop 2024-01-31T05:04:13.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.316+0000 7f8559c00640 1 -- 172.21.15.49:0/964861309 shutdown_connections 2024-01-31T05:04:13.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.316+0000 7f8559c00640 1 --2- 172.21.15.49:0/964861309 >> v2:172.21.15.195:3300/0 conn(0x7f85540ae4d0 0x7f85540ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.316+0000 7f8559c00640 1 --2- 172.21.15.49:0/964861309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85540cd680 0x7f85540cda60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.316+0000 7f8559c00640 1 -- 172.21.15.49:0/964861309 >> 172.21.15.49:0/964861309 conn(0x7f85540b28e0 msgr2=0x7f85540b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:13.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.316+0000 7f8559c00640 1 -- 172.21.15.49:0/964861309 shutdown_connections 2024-01-31T05:04:13.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.316+0000 7f8559c00640 1 -- 172.21.15.49:0/964861309 wait complete. 2024-01-31T05:04:13.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.316+0000 7f8559c00640 1 Processor -- start 2024-01-31T05:04:13.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.316+0000 7f8559c00640 1 -- start start 2024-01-31T05:04:13.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.316+0000 7f8559c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85540ae4d0 0x7f85541535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:13.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.316+0000 7f8559c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85540cd680 0x7f8554140250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:13.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f8559c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f855415b3e0 0x7f85540ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f8559c00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85540c5380 con 0x7f855415b3e0 2024-01-31T05:04:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f8559c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8554153380 con 0x7f85540ae4d0 2024-01-31T05:04:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f8559c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85540c50a0 con 0x7f85540cd680 2024-01-31T05:04:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f8553400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f855415b3e0 0x7f85540ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f8553400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f855415b3e0 0x7f85540ca8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38704/0 (socket says 172.21.15.49:38704) 2024-01-31T05:04:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f8553400640 1 -- 172.21.15.49:0/3612050335 learned_addr learned my addr 172.21.15.49:0/3612050335 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f8552a00640 1 --2- 172.21.15.49:0/3612050335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85540ae4d0 0x7f85541535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f8552000640 1 --2- 172.21.15.49:0/3612050335 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85540cd680 0x7f8554140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f8553400640 1 -- 172.21.15.49:0/3612050335 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85540cd680 msgr2=0x7f8554140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f8553400640 1 --2- 172.21.15.49:0/3612050335 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85540cd680 0x7f8554140250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f8553400640 1 -- 172.21.15.49:0/3612050335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85540ae4d0 msgr2=0x7f85541535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f8553400640 1 --2- 172.21.15.49:0/3612050335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85540ae4d0 0x7f85541535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f8553400640 1 -- 172.21.15.49:0/3612050335 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85440094d0 con 0x7f855415b3e0 2024-01-31T05:04:13.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f8553400640 1 --2- 172.21.15.49:0/3612050335 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f855415b3e0 0x7f85540ca8c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f854c007e60 tx=0x7f854c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:13.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f854aa00640 1 -- 172.21.15.49:0/3612050335 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c014420 con 0x7f855415b3e0 2024-01-31T05:04:13.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f854aa00640 1 -- 172.21.15.49:0/3612050335 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c0145a0 con 0x7f855415b3e0 2024-01-31T05:04:13.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f854aa00640 1 -- 172.21.15.49:0/3612050335 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c014950 con 0x7f855415b3e0 2024-01-31T05:04:13.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f8559c00640 1 -- 172.21.15.49:0/3612050335 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85540c7fb0 con 0x7f855415b3e0 2024-01-31T05:04:13.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f8559c00640 1 -- 172.21.15.49:0/3612050335 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85540c8570 con 0x7f855415b3e0 2024-01-31T05:04:13.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f8559c00640 1 -- 172.21.15.49:0/3612050335 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85540c54f0 con 0x7f855415b3e0 2024-01-31T05:04:13.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.320+0000 7f854aa00640 1 -- 172.21.15.49:0/3612050335 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f854c014ab0 con 0x7f855415b3e0 2024-01-31T05:04:13.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.324+0000 7f854aa00640 1 --2- 172.21.15.49:0/3612050335 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f852c066500 0x7f852c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:13.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.324+0000 7f854aa00640 1 -- 172.21.15.49:0/3612050335 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f854c0843d0 con 0x7f855415b3e0 2024-01-31T05:04:13.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.324+0000 7f8552a00640 1 --2- 172.21.15.49:0/3612050335 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f852c066500 0x7f852c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:13.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.324+0000 7f8552a00640 1 --2- 172.21.15.49:0/3612050335 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f852c066500 0x7f852c0689c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f85440af000 tx=0x7f85440b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:13.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.328+0000 7f854aa00640 1 -- 172.21.15.49:0/3612050335 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f85540c54f0 con 0x7f855415b3e0 2024-01-31T05:04:13.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.488+0000 7f8559c00640 1 -- 172.21.15.49:0/3612050335 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85540c54c0 con 0x7f855415b3e0 2024-01-31T05:04:13.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.488+0000 7f854aa00640 1 -- 172.21.15.49:0/3612050335 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12827 (secure 0 0 0) 0x7f854c055460 con 0x7f855415b3e0 2024-01-31T05:04:13.489 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:13.489 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:06.496120+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:04:13.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.492+0000 7f8559c00640 1 -- 172.21.15.49:0/3612050335 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f852c066500 msgr2=0x7f852c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:13.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.492+0000 7f8559c00640 1 --2- 172.21.15.49:0/3612050335 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f852c066500 0x7f852c0689c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f85440af000 tx=0x7f85440b6040 comp rx=0 tx=0).stop 2024-01-31T05:04:13.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.492+0000 7f8559c00640 1 -- 172.21.15.49:0/3612050335 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f855415b3e0 msgr2=0x7f85540ca8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:13.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.492+0000 7f8559c00640 1 --2- 172.21.15.49:0/3612050335 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f855415b3e0 0x7f85540ca8c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f854c007e60 tx=0x7f854c00e4b0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.492+0000 7f8559c00640 1 -- 172.21.15.49:0/3612050335 shutdown_connections 2024-01-31T05:04:13.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.492+0000 7f8559c00640 1 --2- 172.21.15.49:0/3612050335 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f855415b3e0 0x7f85540ca8c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.492+0000 7f8559c00640 1 --2- 172.21.15.49:0/3612050335 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85540cd680 0x7f8554140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.492+0000 7f8559c00640 1 --2- 172.21.15.49:0/3612050335 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f852c066500 0x7f852c0689c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.492+0000 7f8559c00640 1 --2- 172.21.15.49:0/3612050335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85540ae4d0 0x7f85541535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.492+0000 7f8559c00640 1 -- 172.21.15.49:0/3612050335 >> 172.21.15.49:0/3612050335 conn(0x7f85540b28e0 msgr2=0x7f85540cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:13.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.492+0000 7f8559c00640 1 -- 172.21.15.49:0/3612050335 shutdown_connections 2024-01-31T05:04:13.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.492+0000 7f8559c00640 1 -- 172.21.15.49:0/3612050335 wait complete. 2024-01-31T05:04:13.511 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-31T05:04:13.511 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:04:13.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.656+0000 7f5464a00640 1 Processor -- start 2024-01-31T05:04:13.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.656+0000 7f5464a00640 1 -- start start 2024-01-31T05:04:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.656+0000 7f5464a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f545c15e1c0 0x7f545c0720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.656+0000 7f5464a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f545c06c2d0 0x7f545c0b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.656+0000 7f5464a00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545c0703c0 con 0x7f545c0b30e0 2024-01-31T05:04:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.656+0000 7f5464a00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f545c15e670 con 0x7f545c15e1c0 2024-01-31T05:04:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.656+0000 7f5464a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545c0b1dd0 con 0x7f545c06c2d0 2024-01-31T05:04:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.656+0000 7f5461600640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f545c15e1c0 0x7f545c0720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.656+0000 7f5461600640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f545c15e1c0 0x7f545c0720e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38712/0 (socket says 172.21.15.49:38712) 2024-01-31T05:04:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.656+0000 7f5461600640 1 -- 172.21.15.49:0/4003687185 learned_addr learned my addr 172.21.15.49:0/4003687185 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.656+0000 7f5462000640 1 --1- 172.21.15.49:0/4003687185 >> v1:172.21.15.49:6789/0 conn(0x7f545c0b30e0 0x7f545c0b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45438/0 (socket says 172.21.15.49:45438) 2024-01-31T05:04:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.656+0000 7f5462a00640 1 --2- 172.21.15.49:0/4003687185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f545c06c2d0 0x7f545c0b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.656+0000 7f5461600640 1 -- 172.21.15.49:0/4003687185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f545c06c2d0 msgr2=0x7f545c0b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.656+0000 7f5461600640 1 --2- 172.21.15.49:0/4003687185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f545c06c2d0 0x7f545c0b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.656+0000 7f5461600640 1 -- 172.21.15.49:0/4003687185 >> v1:172.21.15.49:6789/0 conn(0x7f545c0b30e0 legacy=0x7f545c0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:13.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.656+0000 7f5460c00640 1 -- 172.21.15.49:0/4003687185 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758580468 0 0) 0x7f545c0703c0 con 0x7f545c0b30e0 2024-01-31T05:04:13.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.656+0000 7f5461600640 1 -- 172.21.15.49:0/4003687185 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c070610 con 0x7f545c15e1c0 2024-01-31T05:04:13.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.660+0000 7f5461600640 1 --2- 172.21.15.49:0/4003687185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f545c15e1c0 0x7f545c0720e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5444009870 tx=0x7f544401ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2558eccb4d0a051 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:13.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.660+0000 7f5460c00640 1 -- 172.21.15.49:0/4003687185 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54440ab610 con 0x7f545c15e1c0 2024-01-31T05:04:13.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.660+0000 7f5460c00640 1 -- 172.21.15.49:0/4003687185 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54440ab770 con 0x7f545c15e1c0 2024-01-31T05:04:13.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.660+0000 7f5460c00640 1 -- 172.21.15.49:0/4003687185 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54440abb00 con 0x7f545c15e1c0 2024-01-31T05:04:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.660+0000 7f5464a00640 1 -- 172.21.15.49:0/4003687185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f545c15e1c0 msgr2=0x7f545c0720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.660+0000 7f5464a00640 1 --2- 172.21.15.49:0/4003687185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f545c15e1c0 0x7f545c0720e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5444009870 tx=0x7f544401ce50 comp rx=0 tx=0).stop 2024-01-31T05:04:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.660+0000 7f5464a00640 1 -- 172.21.15.49:0/4003687185 shutdown_connections 2024-01-31T05:04:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.660+0000 7f5464a00640 1 --2- 172.21.15.49:0/4003687185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f545c06c2d0 0x7f545c0b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.660+0000 7f5464a00640 1 --2- 172.21.15.49:0/4003687185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f545c15e1c0 0x7f545c0720e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.660+0000 7f5464a00640 1 -- 172.21.15.49:0/4003687185 >> 172.21.15.49:0/4003687185 conn(0x7f545c0b09a0 msgr2=0x7f545c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.660+0000 7f5464a00640 1 -- 172.21.15.49:0/4003687185 shutdown_connections 2024-01-31T05:04:13.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.660+0000 7f5464a00640 1 -- 172.21.15.49:0/4003687185 wait complete. 2024-01-31T05:04:13.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5464a00640 1 Processor -- start 2024-01-31T05:04:13.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5464a00640 1 -- start start 2024-01-31T05:04:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5464a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f545c06c2d0 0x7f545c09c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5464a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f545c0b30e0 0x7f545c152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5464a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f545c15e1c0 0x7f545c14d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5464a00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c09c910 con 0x7f545c15e1c0 2024-01-31T05:04:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5464a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c09b860 con 0x7f545c0b30e0 2024-01-31T05:04:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5464a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545c1552e0 con 0x7f545c06c2d0 2024-01-31T05:04:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5462a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f545c15e1c0 0x7f545c14d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5462a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f545c15e1c0 0x7f545c14d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38724/0 (socket says 172.21.15.49:38724) 2024-01-31T05:04:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5462a00640 1 -- 172.21.15.49:0/216495024 learned_addr learned my addr 172.21.15.49:0/216495024 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5461600640 1 --2- 172.21.15.49:0/216495024 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f545c0b30e0 0x7f545c152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5462000640 1 --2- 172.21.15.49:0/216495024 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f545c06c2d0 0x7f545c09c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5462a00640 1 -- 172.21.15.49:0/216495024 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f545c06c2d0 msgr2=0x7f545c09c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:13.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5462a00640 1 --2- 172.21.15.49:0/216495024 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f545c06c2d0 0x7f545c09c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5462a00640 1 -- 172.21.15.49:0/216495024 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f545c0b30e0 msgr2=0x7f545c152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5462a00640 1 --2- 172.21.15.49:0/216495024 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f545c0b30e0 0x7f545c152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5462a00640 1 -- 172.21.15.49:0/216495024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54440094d0 con 0x7f545c15e1c0 2024-01-31T05:04:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5462000640 1 --2- 172.21.15.49:0/216495024 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f545c06c2d0 0x7f545c09c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5462a00640 1 --2- 172.21.15.49:0/216495024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f545c15e1c0 0x7f545c14d360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5454007e60 tx=0x7f545400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f545a000640 1 -- 172.21.15.49:0/216495024 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5454014420 con 0x7f545c15e1c0 2024-01-31T05:04:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f545a000640 1 -- 172.21.15.49:0/216495024 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54540145a0 con 0x7f545c15e1c0 2024-01-31T05:04:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5464a00640 1 -- 172.21.15.49:0/216495024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f545c1555c0 con 0x7f545c15e1c0 2024-01-31T05:04:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f545a000640 1 -- 172.21.15.49:0/216495024 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5454014950 con 0x7f545c15e1c0 2024-01-31T05:04:13.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5464a00640 1 -- 172.21.15.49:0/216495024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545c09bb40 con 0x7f545c15e1c0 2024-01-31T05:04:13.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.664+0000 7f5464a00640 1 -- 172.21.15.49:0/216495024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f545c074860 con 0x7f545c15e1c0 2024-01-31T05:04:13.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.668+0000 7f545a000640 1 -- 172.21.15.49:0/216495024 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f5454014ab0 con 0x7f545c15e1c0 2024-01-31T05:04:13.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.668+0000 7f545a000640 1 --2- 172.21.15.49:0/216495024 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5434066530 0x7f54340689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:13.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.668+0000 7f545a000640 1 -- 172.21.15.49:0/216495024 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5454084450 con 0x7f545c15e1c0 2024-01-31T05:04:13.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.668+0000 7f5462000640 1 --2- 172.21.15.49:0/216495024 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5434066530 0x7f54340689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:13.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.668+0000 7f5462000640 1 --2- 172.21.15.49:0/216495024 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5434066530 0x7f54340689f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f544c000f70 tx=0x7f544c007cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:13.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.672+0000 7f545a000640 1 -- 172.21.15.49:0/216495024 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f54540519a0 con 0x7f545c15e1c0 2024-01-31T05:04:13.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.832+0000 7f5464a00640 1 -- 172.21.15.49:0/216495024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f545c0abf20 con 0x7f545c15e1c0 2024-01-31T05:04:13.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.832+0000 7f545a000640 1 -- 172.21.15.49:0/216495024 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5454054fc0 con 0x7f545c15e1c0 2024-01-31T05:04:13.831 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:04:13.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.832+0000 7f5464a00640 1 -- 172.21.15.49:0/216495024 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5434066530 msgr2=0x7f54340689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:13.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.832+0000 7f5464a00640 1 --2- 172.21.15.49:0/216495024 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5434066530 0x7f54340689f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f544c000f70 tx=0x7f544c007cd0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.832+0000 7f5464a00640 1 -- 172.21.15.49:0/216495024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f545c15e1c0 msgr2=0x7f545c14d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:13.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.832+0000 7f5464a00640 1 --2- 172.21.15.49:0/216495024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f545c15e1c0 0x7f545c14d360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5454007e60 tx=0x7f545400e4b0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.832+0000 7f5464a00640 1 -- 172.21.15.49:0/216495024 shutdown_connections 2024-01-31T05:04:13.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.832+0000 7f5464a00640 1 --2- 172.21.15.49:0/216495024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f545c15e1c0 0x7f545c14d360 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.832+0000 7f5464a00640 1 --2- 172.21.15.49:0/216495024 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5434066530 0x7f54340689f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.832+0000 7f5464a00640 1 --2- 172.21.15.49:0/216495024 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f545c0b30e0 0x7f545c152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.832+0000 7f5464a00640 1 --2- 172.21.15.49:0/216495024 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f545c06c2d0 0x7f545c09c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:13.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.832+0000 7f5464a00640 1 -- 172.21.15.49:0/216495024 >> 172.21.15.49:0/216495024 conn(0x7f545c0b09a0 msgr2=0x7f545c0b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:13.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.832+0000 7f5464a00640 1 -- 172.21.15.49:0/216495024 shutdown_connections 2024-01-31T05:04:13.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.832+0000 7f5464a00640 1 -- 172.21.15.49:0/216495024 wait complete. 2024-01-31T05:04:13.853 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-31T05:04:13.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.992+0000 7fdab2600640 1 Processor -- start 2024-01-31T05:04:13.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.992+0000 7fdab2600640 1 -- start start 2024-01-31T05:04:13.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.996+0000 7fdab2600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdaac070ac0 0x7fdaac0ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:13.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.996+0000 7fdab2600640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaac159b70 con 0x7fdaac159790 2024-01-31T05:04:13.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.996+0000 7fdab2600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaac0b2750 con 0x7fdaac070660 2024-01-31T05:04:13.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.996+0000 7fdab2600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaac0b2a30 con 0x7fdaac070ac0 2024-01-31T05:04:13.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.996+0000 7fdaab400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdaac159790 0x7fdaac0b37c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45450/0 (socket says 172.21.15.49:45450) 2024-01-31T05:04:13.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.996+0000 7fdaab400640 1 -- 172.21.15.49:0/677639052 learned_addr learned my addr 172.21.15.49:0/677639052 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:13.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.996+0000 7fdaabe00640 1 --2- 172.21.15.49:0/677639052 >> v2:172.21.15.195:3300/0 conn(0x7fdaac070ac0 0x7fdaac0ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:13.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.996+0000 7fdaaa000640 1 -- 172.21.15.49:0/677639052 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3384879753 0 0) 0x7fdaac159b70 con 0x7fdaac159790 2024-01-31T05:04:13.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.996+0000 7fdaaa000640 1 -- 172.21.15.49:0/677639052 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda8c003530 con 0x7fdaac159790 2024-01-31T05:04:13.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.996+0000 7fdaaa000640 1 -- 172.21.15.49:0/677639052 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457856181 0 0) 0x7fdaac0b2750 con 0x7fdaac070660 2024-01-31T05:04:13.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.996+0000 7fdaaa000640 1 -- 172.21.15.49:0/677639052 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaac159b70 con 0x7fdaac070660 2024-01-31T05:04:13.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.996+0000 7fdaaa000640 1 -- 172.21.15.49:0/677639052 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1206025266 0 0) 0x7fda8c003530 con 0x7fdaac159790 2024-01-31T05:04:13.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.996+0000 7fdaabe00640 1 -- 172.21.15.49:0/677639052 >> v1:172.21.15.195:6789/0 conn(0x7fdaac070660 legacy=0x7fdaac0ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:13.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.996+0000 7fdaabe00640 1 -- 172.21.15.49:0/677639052 >> v1:172.21.15.49:6789/0 conn(0x7fdaac159790 legacy=0x7fdaac0b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:13.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:13.996+0000 7fdaabe00640 1 -- 172.21.15.49:0/677639052 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac0b2d10 con 0x7fdaac070ac0 2024-01-31T05:04:13.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.000+0000 7fdaabe00640 1 --2- 172.21.15.49:0/677639052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdaac070ac0 0x7fdaac0ac760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009d90 tx=0x7fdaa401c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6963b7847dbe118 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:13.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.000+0000 7fdaaa000640 1 -- 172.21.15.49:0/677639052 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c001680 con 0x7fdaac070ac0 2024-01-31T05:04:13.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.000+0000 7fdaaa000640 1 -- 172.21.15.49:0/677639052 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa40a55c0 con 0x7fdaac070ac0 2024-01-31T05:04:13.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.000+0000 7fdaaa000640 1 -- 172.21.15.49:0/677639052 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa40a5950 con 0x7fdaac070ac0 2024-01-31T05:04:14.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.000+0000 7fdab2600640 1 -- 172.21.15.49:0/677639052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdaac070ac0 msgr2=0x7fdaac0ac760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:14.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.000+0000 7fdab2600640 1 --2- 172.21.15.49:0/677639052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdaac070ac0 0x7fdaac0ac760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009d90 tx=0x7fdaa401c810 comp rx=0 tx=0).stop 2024-01-31T05:04:14.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.000+0000 7fdab2600640 1 -- 172.21.15.49:0/677639052 shutdown_connections 2024-01-31T05:04:14.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.000+0000 7fdab2600640 1 --2- 172.21.15.49:0/677639052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdaac070ac0 0x7fdaac0ac760 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:14.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.000+0000 7fdab2600640 1 -- 172.21.15.49:0/677639052 >> 172.21.15.49:0/677639052 conn(0x7fdaac0b09a0 msgr2=0x7fdaac0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:14.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.000+0000 7fdab2600640 1 -- 172.21.15.49:0/677639052 shutdown_connections 2024-01-31T05:04:14.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.000+0000 7fdab2600640 1 -- 172.21.15.49:0/677639052 wait complete. 2024-01-31T05:04:14.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.000+0000 7fdab2600640 1 Processor -- start 2024-01-31T05:04:14.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdab2600640 1 -- start start 2024-01-31T05:04:14.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdab2600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdaac070660 0x7fdaac15c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:14.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdab2600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaac070ac0 0x7fdaac154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:14.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdab2600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdaac159790 0x7fdaac1363e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:14.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdab2600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac156370 con 0x7fdaac070ac0 2024-01-31T05:04:14.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdab2600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac1552d0 con 0x7fdaac159790 2024-01-31T05:04:14.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdab2600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac1555b0 con 0x7fdaac070660 2024-01-31T05:04:14.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdaaaa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaac070ac0 0x7fdaac154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:14.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdaaaa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaac070ac0 0x7fdaac154820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38738/0 (socket says 172.21.15.49:38738) 2024-01-31T05:04:14.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdaaaa00640 1 -- 172.21.15.49:0/3661744650 learned_addr learned my addr 172.21.15.49:0/3661744650 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:14.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdaab400640 1 --2- 172.21.15.49:0/3661744650 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdaac070660 0x7fdaac15c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:14.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdaabe00640 1 --2- 172.21.15.49:0/3661744650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdaac159790 0x7fdaac1363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:14.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdaaaa00640 1 -- 172.21.15.49:0/3661744650 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdaac070660 msgr2=0x7fdaac15c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:14.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdaaaa00640 1 --2- 172.21.15.49:0/3661744650 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdaac070660 0x7fdaac15c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:14.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdaaaa00640 1 -- 172.21.15.49:0/3661744650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdaac159790 msgr2=0x7fdaac1363e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:14.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdaaaa00640 1 --2- 172.21.15.49:0/3661744650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdaac159790 0x7fdaac1363e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:14.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdaaaa00640 1 -- 172.21.15.49:0/3661744650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa4009a70 con 0x7fdaac070ac0 2024-01-31T05:04:14.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdaabe00640 1 --2- 172.21.15.49:0/3661744650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdaac159790 0x7fdaac1363e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:14.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdaaaa00640 1 --2- 172.21.15.49:0/3661744650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaac070ac0 0x7fdaac154820 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fda9400c490 tx=0x7fda9400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:14.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdaa3400640 1 -- 172.21.15.49:0/3661744650 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda940052d0 con 0x7fdaac070ac0 2024-01-31T05:04:14.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdaa3400640 1 -- 172.21.15.49:0/3661744650 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda94005430 con 0x7fdaac070ac0 2024-01-31T05:04:14.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdab2600640 1 -- 172.21.15.49:0/3661744650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaac155890 con 0x7fdaac070ac0 2024-01-31T05:04:14.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdaa3400640 1 -- 172.21.15.49:0/3661744650 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda94012870 con 0x7fdaac070ac0 2024-01-31T05:04:14.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdab2600640 1 -- 172.21.15.49:0/3661744650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaac155e50 con 0x7fdaac070ac0 2024-01-31T05:04:14.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.004+0000 7fdab2600640 1 -- 172.21.15.49:0/3661744650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaac074860 con 0x7fdaac070ac0 2024-01-31T05:04:14.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.008+0000 7fdaa3400640 1 -- 172.21.15.49:0/3661744650 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fda940129d0 con 0x7fdaac070ac0 2024-01-31T05:04:14.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.008+0000 7fdaa3400640 1 --2- 172.21.15.49:0/3661744650 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fda84066530 0x7fda840689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:14.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.008+0000 7fdaa3400640 1 -- 172.21.15.49:0/3661744650 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fda940837b0 con 0x7fdaac070ac0 2024-01-31T05:04:14.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.008+0000 7fdaab400640 1 --2- 172.21.15.49:0/3661744650 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fda84066530 0x7fda840689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:14.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.008+0000 7fdaab400640 1 --2- 172.21.15.49:0/3661744650 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fda84066530 0x7fda840689f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0011f0 tx=0x7fda9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:14.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.012+0000 7fdaa3400640 1 -- 172.21.15.49:0/3661744650 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fda94050d00 con 0x7fdaac070ac0 2024-01-31T05:04:14.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.172+0000 7fdab2600640 1 -- 172.21.15.49:0/3661744650 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdaac06caa0 con 0x7fdaac070ac0 2024-01-31T05:04:14.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.172+0000 7fdaa3400640 1 -- 172.21.15.49:0/3661744650 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fda94054320 con 0x7fdaac070ac0 2024-01-31T05:04:14.173 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:14.173 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-01-31T05:04:14.173 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:04:14.173 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-01-31T05:04:14.173 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-01-31T05:04:14.173 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:04:14.173 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-01-31T05:04:14.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.176+0000 7fdab2600640 1 -- 172.21.15.49:0/3661744650 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fda84066530 msgr2=0x7fda840689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:14.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.176+0000 7fdab2600640 1 --2- 172.21.15.49:0/3661744650 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fda84066530 0x7fda840689f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0011f0 tx=0x7fda9c009040 comp rx=0 tx=0).stop 2024-01-31T05:04:14.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.176+0000 7fdab2600640 1 -- 172.21.15.49:0/3661744650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaac070ac0 msgr2=0x7fdaac154820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:14.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.176+0000 7fdab2600640 1 --2- 172.21.15.49:0/3661744650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaac070ac0 0x7fdaac154820 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fda9400c490 tx=0x7fda9400c950 comp rx=0 tx=0).stop 2024-01-31T05:04:14.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.176+0000 7fdab2600640 1 -- 172.21.15.49:0/3661744650 shutdown_connections 2024-01-31T05:04:14.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.176+0000 7fdab2600640 1 --2- 172.21.15.49:0/3661744650 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fda84066530 0x7fda840689f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:14.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.176+0000 7fdab2600640 1 --2- 172.21.15.49:0/3661744650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdaac159790 0x7fdaac1363e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:14.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.176+0000 7fdab2600640 1 --2- 172.21.15.49:0/3661744650 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdaac070ac0 0x7fdaac154820 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:14.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.176+0000 7fdab2600640 1 --2- 172.21.15.49:0/3661744650 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdaac070660 0x7fdaac15c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:14.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.176+0000 7fdab2600640 1 -- 172.21.15.49:0/3661744650 >> 172.21.15.49:0/3661744650 conn(0x7fdaac0b09a0 msgr2=0x7fdaac06ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:14.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.176+0000 7fdab2600640 1 -- 172.21.15.49:0/3661744650 shutdown_connections 2024-01-31T05:04:14.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.176+0000 7fdab2600640 1 -- 172.21.15.49:0/3661744650 wait complete. 2024-01-31T05:04:14.195 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-31T05:04:14.195 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-31T05:04:14.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.340+0000 7fe998c00640 1 Processor -- start 2024-01-31T05:04:14.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.340+0000 7fe998c00640 1 -- start start 2024-01-31T05:04:14.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.340+0000 7fe998c00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe99415b110 0x7fe99406c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:14.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.340+0000 7fe998c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe9940cdf10 0x7fe994070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:14.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.340+0000 7fe998c00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe99415b4f0 con 0x7fe9940ce610 2024-01-31T05:04:14.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.340+0000 7fe998c00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9940ce460 con 0x7fe99415b110 2024-01-31T05:04:14.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.340+0000 7fe998c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9940abf20 con 0x7fe9940cdf10 2024-01-31T05:04:14.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.340+0000 7fe991e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe99415b110 0x7fe99406c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:14.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.340+0000 7fe991e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe99415b110 0x7fe99406c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38740/0 (socket says 172.21.15.49:38740) 2024-01-31T05:04:14.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.340+0000 7fe991e00640 1 -- 172.21.15.49:0/1168263445 learned_addr learned my addr 172.21.15.49:0/1168263445 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:14.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.340+0000 7fe992800640 1 --1- 172.21.15.49:0/1168263445 >> v1:172.21.15.49:6789/0 conn(0x7fe9940ce610 0x7fe9940ad800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45462/0 (socket says 172.21.15.49:45462) 2024-01-31T05:04:14.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.340+0000 7fe991400640 1 --2- 172.21.15.49:0/1168263445 >> v2:172.21.15.195:3300/0 conn(0x7fe9940cdf10 0x7fe994070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:14.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.340+0000 7fe991e00640 1 -- 172.21.15.49:0/1168263445 >> v2:172.21.15.195:3300/0 conn(0x7fe9940cdf10 msgr2=0x7fe994070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:14.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.340+0000 7fe991e00640 1 --2- 172.21.15.49:0/1168263445 >> v2:172.21.15.195:3300/0 conn(0x7fe9940cdf10 0x7fe994070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:14.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.340+0000 7fe991e00640 1 -- 172.21.15.49:0/1168263445 >> v1:172.21.15.49:6789/0 conn(0x7fe9940ce610 legacy=0x7fe9940ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:14.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.340+0000 7fe991e00640 1 -- 172.21.15.49:0/1168263445 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9940ac200 con 0x7fe99415b110 2024-01-31T05:04:14.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.344+0000 7fe991e00640 1 --2- 172.21.15.49:0/1168263445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe99415b110 0x7fe99406c2d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe994072c60 tx=0x7fe98401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6495a5aba7a640 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:14.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.344+0000 7fe990a00640 1 -- 172.21.15.49:0/1168263445 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9840ac640 con 0x7fe99415b110 2024-01-31T05:04:14.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.344+0000 7fe990a00640 1 -- 172.21.15.49:0/1168263445 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9840ac7a0 con 0x7fe99415b110 2024-01-31T05:04:14.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.344+0000 7fe990a00640 1 -- 172.21.15.49:0/1168263445 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9840acb30 con 0x7fe99415b110 2024-01-31T05:04:14.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.344+0000 7fe998c00640 1 -- 172.21.15.49:0/1168263445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe99415b110 msgr2=0x7fe99406c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:14.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.344+0000 7fe998c00640 1 --2- 172.21.15.49:0/1168263445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe99415b110 0x7fe99406c2d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe994072c60 tx=0x7fe98401c4d0 comp rx=0 tx=0).stop 2024-01-31T05:04:14.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.344+0000 7fe998c00640 1 -- 172.21.15.49:0/1168263445 shutdown_connections 2024-01-31T05:04:14.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.344+0000 7fe998c00640 1 --2- 172.21.15.49:0/1168263445 >> v2:172.21.15.195:3300/0 conn(0x7fe9940cdf10 0x7fe994070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:14.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.344+0000 7fe998c00640 1 --2- 172.21.15.49:0/1168263445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe99415b110 0x7fe99406c2d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:14.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.344+0000 7fe998c00640 1 -- 172.21.15.49:0/1168263445 >> 172.21.15.49:0/1168263445 conn(0x7fe9940b09a0 msgr2=0x7fe9940b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:14.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.344+0000 7fe998c00640 1 -- 172.21.15.49:0/1168263445 shutdown_connections 2024-01-31T05:04:14.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.344+0000 7fe998c00640 1 -- 172.21.15.49:0/1168263445 wait complete. 2024-01-31T05:04:14.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe998c00640 1 Processor -- start 2024-01-31T05:04:14.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe998c00640 1 -- start start 2024-01-31T05:04:14.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe998c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9940cdf10 0x7fe99414bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:14.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe998c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9940ce610 0x7fe994145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:14.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe998c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe99415b110 0x7fe994146330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:14.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe998c00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe994146870 con 0x7fe9940ce610 2024-01-31T05:04:14.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe998c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99409a770 con 0x7fe99415b110 2024-01-31T05:04:14.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe998c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe994099b60 con 0x7fe9940cdf10 2024-01-31T05:04:14.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe991400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9940ce610 0x7fe994145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:14.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe991400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9940ce610 0x7fe994145df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38742/0 (socket says 172.21.15.49:38742) 2024-01-31T05:04:14.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe991400640 1 -- 172.21.15.49:0/2173895890 learned_addr learned my addr 172.21.15.49:0/2173895890 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:14.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe991400640 1 -- 172.21.15.49:0/2173895890 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9940cdf10 msgr2=0x7fe99414bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:14.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe992800640 1 --2- 172.21.15.49:0/2173895890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe99415b110 0x7fe994146330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:14.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe991400640 1 --2- 172.21.15.49:0/2173895890 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9940cdf10 0x7fe99414bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:14.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe991400640 1 -- 172.21.15.49:0/2173895890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe99415b110 msgr2=0x7fe994146330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:14.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe991400640 1 --2- 172.21.15.49:0/2173895890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe99415b110 0x7fe994146330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:14.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe991400640 1 -- 172.21.15.49:0/2173895890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9840094d0 con 0x7fe9940ce610 2024-01-31T05:04:14.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe992800640 1 --2- 172.21.15.49:0/2173895890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe99415b110 0x7fe994146330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:14.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe991400640 1 --2- 172.21.15.49:0/2173895890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9940ce610 0x7fe994145df0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00d5f0 tx=0x7fe97c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:14.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.348+0000 7fe98a000640 1 -- 172.21.15.49:0/2173895890 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c0125f0 con 0x7fe9940ce610 2024-01-31T05:04:14.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.352+0000 7fe98a000640 1 -- 172.21.15.49:0/2173895890 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97c012750 con 0x7fe9940ce610 2024-01-31T05:04:14.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.352+0000 7fe998c00640 1 -- 172.21.15.49:0/2173895890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe994099e40 con 0x7fe9940ce610 2024-01-31T05:04:14.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.352+0000 7fe98a000640 1 -- 172.21.15.49:0/2173895890 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c012ae0 con 0x7fe9940ce610 2024-01-31T05:04:14.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.352+0000 7fe998c00640 1 -- 172.21.15.49:0/2173895890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99409a400 con 0x7fe9940ce610 2024-01-31T05:04:14.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.352+0000 7fe998c00640 1 -- 172.21.15.49:0/2173895890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe994074860 con 0x7fe9940ce610 2024-01-31T05:04:14.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.352+0000 7fe98a000640 1 -- 172.21.15.49:0/2173895890 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fe97c012c40 con 0x7fe9940ce610 2024-01-31T05:04:14.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.352+0000 7fe98a000640 1 --2- 172.21.15.49:0/2173895890 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe96c066500 0x7fe96c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:14.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.352+0000 7fe98a000640 1 -- 172.21.15.49:0/2173895890 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe97c0840c0 con 0x7fe9940ce610 2024-01-31T05:04:14.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.352+0000 7fe991e00640 1 --2- 172.21.15.49:0/2173895890 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe96c066500 0x7fe96c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:14.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.356+0000 7fe991e00640 1 --2- 172.21.15.49:0/2173895890 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe96c066500 0x7fe96c0689c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe9840ae000 tx=0x7fe984008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:14.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.356+0000 7fe98a000640 1 -- 172.21.15.49:0/2173895890 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fe97c051610 con 0x7fe9940ce610 2024-01-31T05:04:14.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.516+0000 7fe998c00640 1 -- 172.21.15.49:0/2173895890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe9940b17d0 con 0x7fe9940ce610 2024-01-31T05:04:14.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.828+0000 7fe98a000640 1 -- 172.21.15.49:0/2173895890 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe97c007380 con 0x7fe9940ce610 2024-01-31T05:04:14.828 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-01-31T05:04:14.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.832+0000 7fe998c00640 1 -- 172.21.15.49:0/2173895890 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe96c066500 msgr2=0x7fe96c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:14.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.832+0000 7fe998c00640 1 --2- 172.21.15.49:0/2173895890 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe96c066500 0x7fe96c0689c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe9840ae000 tx=0x7fe984008040 comp rx=0 tx=0).stop 2024-01-31T05:04:14.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.832+0000 7fe998c00640 1 -- 172.21.15.49:0/2173895890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9940ce610 msgr2=0x7fe994145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:14.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.832+0000 7fe998c00640 1 --2- 172.21.15.49:0/2173895890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9940ce610 0x7fe994145df0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00d5f0 tx=0x7fe97c00dab0 comp rx=0 tx=0).stop 2024-01-31T05:04:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.832+0000 7fe998c00640 1 -- 172.21.15.49:0/2173895890 shutdown_connections 2024-01-31T05:04:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.832+0000 7fe998c00640 1 --2- 172.21.15.49:0/2173895890 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe96c066500 0x7fe96c0689c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.832+0000 7fe998c00640 1 --2- 172.21.15.49:0/2173895890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe99415b110 0x7fe994146330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.832+0000 7fe998c00640 1 --2- 172.21.15.49:0/2173895890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9940ce610 0x7fe994145df0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.832+0000 7fe998c00640 1 --2- 172.21.15.49:0/2173895890 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9940cdf10 0x7fe99414bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.832+0000 7fe998c00640 1 -- 172.21.15.49:0/2173895890 >> 172.21.15.49:0/2173895890 conn(0x7fe9940b09a0 msgr2=0x7fe9940ae7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:14.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.832+0000 7fe998c00640 1 -- 172.21.15.49:0/2173895890 shutdown_connections 2024-01-31T05:04:14.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:14.832+0000 7fe998c00640 1 -- 172.21.15.49:0/2173895890 wait complete. 2024-01-31T05:04:14.857 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-01-31T05:04:15.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.004+0000 7f0b97a00640 1 Processor -- start 2024-01-31T05:04:15.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.004+0000 7f0b97a00640 1 -- start start 2024-01-31T05:04:15.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.004+0000 7f0b97a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0b9006ba90 0x7f0b900cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:15.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.004+0000 7f0b97a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0b900cbf80 0x7f0b900cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:15.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.004+0000 7f0b97a00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9015d7e0 con 0x7f0b9006c290 2024-01-31T05:04:15.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.004+0000 7f0b97a00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b900d0470 con 0x7f0b9006ba90 2024-01-31T05:04:15.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.004+0000 7f0b97a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b900d0190 con 0x7f0b900cbf80 2024-01-31T05:04:15.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.008+0000 7f0b8fe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0b9006ba90 0x7f0b900cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:15.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.008+0000 7f0b95000640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0b9006c290 0x7f0b9006c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45470/0 (socket says 172.21.15.49:45470) 2024-01-31T05:04:15.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.008+0000 7f0b95000640 1 -- 172.21.15.49:0/685545784 learned_addr learned my addr 172.21.15.49:0/685545784 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:15.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.008+0000 7f0b95a00640 1 --2- 172.21.15.49:0/685545784 >> v2:172.21.15.195:3300/0 conn(0x7f0b900cbf80 0x7f0b900cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:15.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.008+0000 7f0b8fe00640 1 -- 172.21.15.49:0/685545784 >> v2:172.21.15.195:3300/0 conn(0x7f0b900cbf80 msgr2=0x7f0b900cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:15.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.008+0000 7f0b8fe00640 1 --2- 172.21.15.49:0/685545784 >> v2:172.21.15.195:3300/0 conn(0x7f0b900cbf80 0x7f0b900cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:15.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.008+0000 7f0b8fe00640 1 -- 172.21.15.49:0/685545784 >> v1:172.21.15.49:6789/0 conn(0x7f0b9006c290 legacy=0x7f0b9006c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:15.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.008+0000 7f0b8fe00640 1 -- 172.21.15.49:0/685545784 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b900cb4a0 con 0x7f0b9006ba90 2024-01-31T05:04:15.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.008+0000 7f0b8f400640 1 -- 172.21.15.49:0/685545784 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332969997 0 0) 0x7f0b9015d7e0 con 0x7f0b9006c290 2024-01-31T05:04:15.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.008+0000 7f0b8fe00640 1 --2- 172.21.15.49:0/685545784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b9006ba90 0x7f0b900cfad0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0b900721d0 tx=0x7f0b7801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834e5b090d3e3dd5 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:15.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.008+0000 7f0b8f400640 1 -- 172.21.15.49:0/685545784 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b780ac600 con 0x7f0b9006ba90 2024-01-31T05:04:15.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.008+0000 7f0b8f400640 1 -- 172.21.15.49:0/685545784 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b780a8050 con 0x7f0b9006ba90 2024-01-31T05:04:15.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.008+0000 7f0b8f400640 1 -- 172.21.15.49:0/685545784 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b780ac980 con 0x7f0b9006ba90 2024-01-31T05:04:15.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.012+0000 7f0b97a00640 1 -- 172.21.15.49:0/685545784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b9006ba90 msgr2=0x7f0b900cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:15.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.012+0000 7f0b97a00640 1 --2- 172.21.15.49:0/685545784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b9006ba90 0x7f0b900cfad0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0b900721d0 tx=0x7f0b7801c3a0 comp rx=0 tx=0).stop 2024-01-31T05:04:15.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.012+0000 7f0b97a00640 1 -- 172.21.15.49:0/685545784 shutdown_connections 2024-01-31T05:04:15.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.012+0000 7f0b97a00640 1 --2- 172.21.15.49:0/685545784 >> v2:172.21.15.195:3300/0 conn(0x7f0b900cbf80 0x7f0b900cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:15.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.012+0000 7f0b97a00640 1 --2- 172.21.15.49:0/685545784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b9006ba90 0x7f0b900cfad0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:15.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.012+0000 7f0b97a00640 1 -- 172.21.15.49:0/685545784 >> 172.21.15.49:0/685545784 conn(0x7f0b900b28e0 msgr2=0x7f0b900b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:15.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.012+0000 7f0b97a00640 1 -- 172.21.15.49:0/685545784 shutdown_connections 2024-01-31T05:04:15.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.012+0000 7f0b97a00640 1 -- 172.21.15.49:0/685545784 wait complete. 2024-01-31T05:04:15.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.012+0000 7f0b97a00640 1 Processor -- start 2024-01-31T05:04:15.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.012+0000 7f0b97a00640 1 -- start start 2024-01-31T05:04:15.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.012+0000 7f0b97a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b9006ba90 0x7f0b900af960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:15.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.012+0000 7f0b97a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b9006c290 0x7f0b901597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:15.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.012+0000 7f0b97a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b900cbf80 0x7f0b901553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:15.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.012+0000 7f0b97a00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b90156f00 con 0x7f0b9006ba90 2024-01-31T05:04:15.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.012+0000 7f0b97a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b901577e0 con 0x7f0b9006c290 2024-01-31T05:04:15.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.012+0000 7f0b97a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b901562f0 con 0x7f0b900cbf80 2024-01-31T05:04:15.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.012+0000 7f0b95000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b9006ba90 0x7f0b900af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:15.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.012+0000 7f0b95000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b9006ba90 0x7f0b900af960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38758/0 (socket says 172.21.15.49:38758) 2024-01-31T05:04:15.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.012+0000 7f0b95000640 1 -- 172.21.15.49:0/3941261367 learned_addr learned my addr 172.21.15.49:0/3941261367 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:15.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.016+0000 7f0b95a00640 1 --2- 172.21.15.49:0/3941261367 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b900cbf80 0x7f0b901553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:15.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.016+0000 7f0b8fe00640 1 --2- 172.21.15.49:0/3941261367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b9006c290 0x7f0b901597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:15.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.016+0000 7f0b95000640 1 -- 172.21.15.49:0/3941261367 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b900cbf80 msgr2=0x7f0b901553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:15.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.016+0000 7f0b95000640 1 --2- 172.21.15.49:0/3941261367 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b900cbf80 0x7f0b901553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:15.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.016+0000 7f0b95000640 1 -- 172.21.15.49:0/3941261367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b9006c290 msgr2=0x7f0b901597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:15.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.016+0000 7f0b95000640 1 --2- 172.21.15.49:0/3941261367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b9006c290 0x7f0b901597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:15.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.016+0000 7f0b95000640 1 -- 172.21.15.49:0/3941261367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b78009420 con 0x7f0b9006ba90 2024-01-31T05:04:15.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.016+0000 7f0b8fe00640 1 --2- 172.21.15.49:0/3941261367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b9006c290 0x7f0b901597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:15.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.016+0000 7f0b95000640 1 --2- 172.21.15.49:0/3941261367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b9006ba90 0x7f0b900af960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000c480 tx=0x7f0b8000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:15.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.016+0000 7f0b8cc00640 1 -- 172.21.15.49:0/3941261367 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b800074e0 con 0x7f0b9006ba90 2024-01-31T05:04:15.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.016+0000 7f0b8cc00640 1 -- 172.21.15.49:0/3941261367 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b80007660 con 0x7f0b9006ba90 2024-01-31T05:04:15.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.016+0000 7f0b8cc00640 1 -- 172.21.15.49:0/3941261367 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b80004a30 con 0x7f0b9006ba90 2024-01-31T05:04:15.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.016+0000 7f0b97a00640 1 -- 172.21.15.49:0/3941261367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b901565d0 con 0x7f0b9006ba90 2024-01-31T05:04:15.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.016+0000 7f0b97a00640 1 -- 172.21.15.49:0/3941261367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b90156b90 con 0x7f0b9006ba90 2024-01-31T05:04:15.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.016+0000 7f0b97a00640 1 -- 172.21.15.49:0/3941261367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b90067c80 con 0x7f0b9006ba90 2024-01-31T05:04:15.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.016+0000 7f0b8cc00640 1 -- 172.21.15.49:0/3941261367 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f0b80004b90 con 0x7f0b9006ba90 2024-01-31T05:04:15.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.020+0000 7f0b8cc00640 1 --2- 172.21.15.49:0/3941261367 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0b68066500 0x7f0b680689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:15.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.020+0000 7f0b8cc00640 1 -- 172.21.15.49:0/3941261367 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f0b80082ee0 con 0x7f0b9006ba90 2024-01-31T05:04:15.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.020+0000 7f0b8fe00640 1 --2- 172.21.15.49:0/3941261367 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0b68066500 0x7f0b680689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:15.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.020+0000 7f0b8fe00640 1 --2- 172.21.15.49:0/3941261367 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0b68066500 0x7f0b680689c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0b780ae000 tx=0x7f0b78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:15.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.024+0000 7f0b8cc00640 1 -- 172.21.15.49:0/3941261367 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f0b80053de0 con 0x7f0b9006ba90 2024-01-31T05:04:15.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.184+0000 7f0b97a00640 1 -- 172.21.15.49:0/3941261367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f0b90074860 con 0x7f0b9006ba90 2024-01-31T05:04:15.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.836+0000 7f0b8cc00640 1 -- 172.21.15.49:0/3941261367 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f0b800180d0 con 0x7f0b9006ba90 2024-01-31T05:04:15.835 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-01-31T05:04:15.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.840+0000 7f0b97a00640 1 -- 172.21.15.49:0/3941261367 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0b68066500 msgr2=0x7f0b680689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:15.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.840+0000 7f0b97a00640 1 --2- 172.21.15.49:0/3941261367 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0b68066500 0x7f0b680689c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0b780ae000 tx=0x7f0b78008040 comp rx=0 tx=0).stop 2024-01-31T05:04:15.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.840+0000 7f0b97a00640 1 -- 172.21.15.49:0/3941261367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b9006ba90 msgr2=0x7f0b900af960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:15.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.840+0000 7f0b97a00640 1 --2- 172.21.15.49:0/3941261367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b9006ba90 0x7f0b900af960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000c480 tx=0x7f0b8000c940 comp rx=0 tx=0).stop 2024-01-31T05:04:15.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.840+0000 7f0b97a00640 1 -- 172.21.15.49:0/3941261367 shutdown_connections 2024-01-31T05:04:15.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.840+0000 7f0b97a00640 1 --2- 172.21.15.49:0/3941261367 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b900cbf80 0x7f0b901553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:15.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.840+0000 7f0b97a00640 1 --2- 172.21.15.49:0/3941261367 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0b68066500 0x7f0b680689c0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0b780ae000 tx=0x7f0b78008040 comp rx=0 tx=0).stop 2024-01-31T05:04:15.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.840+0000 7f0b97a00640 1 --2- 172.21.15.49:0/3941261367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b9006c290 0x7f0b901597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:15.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.840+0000 7f0b97a00640 1 --2- 172.21.15.49:0/3941261367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b9006ba90 0x7f0b900af960 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000c480 tx=0x7f0b8000c940 comp rx=0 tx=0).stop 2024-01-31T05:04:15.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.840+0000 7f0b97a00640 1 -- 172.21.15.49:0/3941261367 >> 172.21.15.49:0/3941261367 conn(0x7f0b900b28e0 msgr2=0x7f0b90073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:15.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.844+0000 7f0b97a00640 1 -- 172.21.15.49:0/3941261367 shutdown_connections 2024-01-31T05:04:15.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:15.848+0000 7f0b97a00640 1 -- 172.21.15.49:0/3941261367 wait complete. 2024-01-31T05:04:15.884 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-31T05:04:16.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.028+0000 7f8f4b600640 1 Processor -- start 2024-01-31T05:04:16.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.028+0000 7f8f4b600640 1 -- start start 2024-01-31T05:04:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.032+0000 7f8f4b600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f4415b190 0x7f8f4415b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.032+0000 7f8f4b600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8f4406cde0 0x7f8f4406d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.032+0000 7f8f4b600640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f44070fe0 0x7f8f44071440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.032+0000 7f8f4b600640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f44071980 con 0x7f8f44070fe0 2024-01-31T05:04:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.032+0000 7f8f4b600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4406e0d0 con 0x7f8f4406cde0 2024-01-31T05:04:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.032+0000 7f8f4b600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4406d830 con 0x7f8f4415b190 2024-01-31T05:04:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.032+0000 7f8f49600640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f44070fe0 0x7f8f44071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.032+0000 7f8f49600640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8f44070fe0 0x7f8f44071440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38766/0 (socket says 172.21.15.49:38766) 2024-01-31T05:04:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.032+0000 7f8f49600640 1 -- 172.21.15.49:0/767243315 learned_addr learned my addr 172.21.15.49:0/767243315 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.032+0000 7f8f48c00640 1 --2- 172.21.15.49:0/767243315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f4415b190 0x7f8f4415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.032+0000 7f8f43e00640 1 --2- 172.21.15.49:0/767243315 >> v2:172.21.15.195:3300/0 conn(0x7f8f4406cde0 0x7f8f4406d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.032+0000 7f8f49600640 1 -- 172.21.15.49:0/767243315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f4415b190 msgr2=0x7f8f4415b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.032+0000 7f8f49600640 1 --2- 172.21.15.49:0/767243315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f4415b190 0x7f8f4415b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.032+0000 7f8f49600640 1 -- 172.21.15.49:0/767243315 >> v2:172.21.15.195:3300/0 conn(0x7f8f4406cde0 msgr2=0x7f8f4406d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.032+0000 7f8f49600640 1 --2- 172.21.15.49:0/767243315 >> v2:172.21.15.195:3300/0 conn(0x7f8f4406cde0 0x7f8f4406d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.032+0000 7f8f49600640 1 -- 172.21.15.49:0/767243315 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4406db10 con 0x7f8f44070fe0 2024-01-31T05:04:16.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.032+0000 7f8f43e00640 1 --2- 172.21.15.49:0/767243315 >> v2:172.21.15.195:3300/0 conn(0x7f8f4406cde0 0x7f8f4406d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:16.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.036+0000 7f8f49600640 1 --2- 172.21.15.49:0/767243315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f44070fe0 0x7f8f44071440 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8f440b4d80 tx=0x7f8f3c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbd2654234d21be server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:16.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.036+0000 7f8f43400640 1 -- 172.21.15.49:0/767243315 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c0a5820 con 0x7f8f44070fe0 2024-01-31T05:04:16.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.036+0000 7f8f43400640 1 -- 172.21.15.49:0/767243315 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c0a5980 con 0x7f8f44070fe0 2024-01-31T05:04:16.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.036+0000 7f8f43400640 1 -- 172.21.15.49:0/767243315 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c0a5d10 con 0x7f8f44070fe0 2024-01-31T05:04:16.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.036+0000 7f8f4b600640 1 -- 172.21.15.49:0/767243315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f44070fe0 msgr2=0x7f8f44071440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:16.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.036+0000 7f8f4b600640 1 --2- 172.21.15.49:0/767243315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f44070fe0 0x7f8f44071440 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8f440b4d80 tx=0x7f8f3c01c9a0 comp rx=0 tx=0).stop 2024-01-31T05:04:16.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.036+0000 7f8f4b600640 1 -- 172.21.15.49:0/767243315 shutdown_connections 2024-01-31T05:04:16.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.036+0000 7f8f4b600640 1 --2- 172.21.15.49:0/767243315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f44070fe0 0x7f8f44071440 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:16.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.036+0000 7f8f4b600640 1 --2- 172.21.15.49:0/767243315 >> v2:172.21.15.195:3300/0 conn(0x7f8f4406cde0 0x7f8f4406d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:16.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.036+0000 7f8f4b600640 1 --2- 172.21.15.49:0/767243315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f4415b190 0x7f8f4415b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:16.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.036+0000 7f8f4b600640 1 -- 172.21.15.49:0/767243315 >> 172.21.15.49:0/767243315 conn(0x7f8f4406a940 msgr2=0x7f8f4406ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:16.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.036+0000 7f8f4b600640 1 -- 172.21.15.49:0/767243315 shutdown_connections 2024-01-31T05:04:16.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.036+0000 7f8f4b600640 1 -- 172.21.15.49:0/767243315 wait complete. 2024-01-31T05:04:16.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.036+0000 7f8f4b600640 1 Processor -- start 2024-01-31T05:04:16.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.036+0000 7f8f4b600640 1 -- start start 2024-01-31T05:04:16.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f4b600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f4406cde0 0x7f8f4414c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:16.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f4b600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f44070fe0 0x7f8f44154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:16.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f4b600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f4415b190 0x7f8f44156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:16.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f4b600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440af320 con 0x7f8f44070fe0 2024-01-31T05:04:16.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f4b600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4414c770 con 0x7f8f4406cde0 2024-01-31T05:04:16.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f4b600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f44153c00 con 0x7f8f4415b190 2024-01-31T05:04:16.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f43e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f44070fe0 0x7f8f44154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:16.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f43e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f44070fe0 0x7f8f44154c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38774/0 (socket says 172.21.15.49:38774) 2024-01-31T05:04:16.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f43e00640 1 -- 172.21.15.49:0/3822122137 learned_addr learned my addr 172.21.15.49:0/3822122137 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:16.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f48c00640 1 --2- 172.21.15.49:0/3822122137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f4406cde0 0x7f8f4414c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:16.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f49600640 1 --2- 172.21.15.49:0/3822122137 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f4415b190 0x7f8f44156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:16.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f43e00640 1 -- 172.21.15.49:0/3822122137 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f4415b190 msgr2=0x7f8f44156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:16.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f43e00640 1 --2- 172.21.15.49:0/3822122137 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f4415b190 0x7f8f44156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:16.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f43e00640 1 -- 172.21.15.49:0/3822122137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f4406cde0 msgr2=0x7f8f4414c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:16.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f43e00640 1 --2- 172.21.15.49:0/3822122137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f4406cde0 0x7f8f4414c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:16.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f43e00640 1 -- 172.21.15.49:0/3822122137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c009b30 con 0x7f8f44070fe0 2024-01-31T05:04:16.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f49600640 1 --2- 172.21.15.49:0/3822122137 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f4415b190 0x7f8f44156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:16.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f43e00640 1 --2- 172.21.15.49:0/3822122137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f44070fe0 0x7f8f44154c00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00e840 tx=0x7f8f2c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f40c00640 1 -- 172.21.15.49:0/3822122137 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c00c8d0 con 0x7f8f44070fe0 2024-01-31T05:04:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f40c00640 1 -- 172.21.15.49:0/3822122137 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c00ca30 con 0x7f8f44070fe0 2024-01-31T05:04:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f4b600640 1 -- 172.21.15.49:0/3822122137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f44153ee0 con 0x7f8f44070fe0 2024-01-31T05:04:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f40c00640 1 -- 172.21.15.49:0/3822122137 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c00cdc0 con 0x7f8f44070fe0 2024-01-31T05:04:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f4b600640 1 -- 172.21.15.49:0/3822122137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f441544a0 con 0x7f8f44070fe0 2024-01-31T05:04:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.040+0000 7f8f4b600640 1 -- 172.21.15.49:0/3822122137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f44074860 con 0x7f8f44070fe0 2024-01-31T05:04:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.044+0000 7f8f40c00640 1 -- 172.21.15.49:0/3822122137 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f8f2c026480 con 0x7f8f44070fe0 2024-01-31T05:04:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.044+0000 7f8f40c00640 1 --2- 172.21.15.49:0/3822122137 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8f1c066500 0x7f8f1c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.044+0000 7f8f40c00640 1 -- 172.21.15.49:0/3822122137 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f8f2c084110 con 0x7f8f44070fe0 2024-01-31T05:04:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.044+0000 7f8f48c00640 1 --2- 172.21.15.49:0/3822122137 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8f1c066500 0x7f8f1c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:16.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.044+0000 7f8f48c00640 1 --2- 172.21.15.49:0/3822122137 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8f1c066500 0x7f8f1c0689c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009a40 tx=0x7f8f34009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:16.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.048+0000 7f8f40c00640 1 -- 172.21.15.49:0/3822122137 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f8f2c051420 con 0x7f8f44070fe0 2024-01-31T05:04:16.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.244+0000 7f8f4b600640 1 -- 172.21.15.49:0/3822122137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8f440af460 con 0x7f8f44070fe0 2024-01-31T05:04:16.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.836+0000 7f8f40c00640 1 -- 172.21.15.49:0/3822122137 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8f2c009480 con 0x7f8f44070fe0 2024-01-31T05:04:16.837 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 2 and data pool 3 2024-01-31T05:04:16.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.840+0000 7f8f4b600640 1 -- 172.21.15.49:0/3822122137 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8f1c066500 msgr2=0x7f8f1c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:16.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.840+0000 7f8f4b600640 1 --2- 172.21.15.49:0/3822122137 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8f1c066500 0x7f8f1c0689c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009a40 tx=0x7f8f34009190 comp rx=0 tx=0).stop 2024-01-31T05:04:16.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.840+0000 7f8f4b600640 1 -- 172.21.15.49:0/3822122137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f44070fe0 msgr2=0x7f8f44154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:16.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.840+0000 7f8f4b600640 1 --2- 172.21.15.49:0/3822122137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f44070fe0 0x7f8f44154c00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00e840 tx=0x7f8f2c00ed00 comp rx=0 tx=0).stop 2024-01-31T05:04:16.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.840+0000 7f8f4b600640 1 -- 172.21.15.49:0/3822122137 shutdown_connections 2024-01-31T05:04:16.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.840+0000 7f8f4b600640 1 --2- 172.21.15.49:0/3822122137 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f4415b190 0x7f8f44156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:16.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.840+0000 7f8f4b600640 1 --2- 172.21.15.49:0/3822122137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f44070fe0 0x7f8f44154c00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:16.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.840+0000 7f8f4b600640 1 --2- 172.21.15.49:0/3822122137 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8f1c066500 0x7f8f1c0689c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:16.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.840+0000 7f8f4b600640 1 --2- 172.21.15.49:0/3822122137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f4406cde0 0x7f8f4414c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:16.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.840+0000 7f8f4b600640 1 -- 172.21.15.49:0/3822122137 >> 172.21.15.49:0/3822122137 conn(0x7f8f4406a940 msgr2=0x7f8f4415a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:16.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.840+0000 7f8f4b600640 1 -- 172.21.15.49:0/3822122137 shutdown_connections 2024-01-31T05:04:16.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:16.840+0000 7f8f4b600640 1 -- 172.21.15.49:0/3822122137 wait complete. 2024-01-31T05:04:16.873 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-01-31T05:04:16.873 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-01-31T05:04:17.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.020+0000 7f8acfe00640 1 Processor -- start 2024-01-31T05:04:17.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.024+0000 7f8acfe00640 1 -- start start 2024-01-31T05:04:17.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.024+0000 7f8acfe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ac80cf0f0 0x7f8ac815d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:17.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.024+0000 7f8acfe00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac80cf660 con 0x7f8ac80cde80 2024-01-31T05:04:17.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.024+0000 7f8acfe00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac80cf940 con 0x7f8ac80cd0c0 2024-01-31T05:04:17.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.024+0000 7f8acfe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac80d02e0 con 0x7f8ac80cf0f0 2024-01-31T05:04:17.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.024+0000 7f8acca00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8ac80cde80 0x7f8ac815cb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45484/0 (socket says 172.21.15.49:45484) 2024-01-31T05:04:17.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.024+0000 7f8acca00640 1 -- 172.21.15.49:0/1490840018 learned_addr learned my addr 172.21.15.49:0/1490840018 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:17.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.024+0000 7f8acde00640 1 --2- 172.21.15.49:0/1490840018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ac80cf0f0 0x7f8ac815d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:17.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.024+0000 7f8ac7e00640 1 -- 172.21.15.49:0/1490840018 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3211192661 0 0) 0x7f8ac80cf660 con 0x7f8ac80cde80 2024-01-31T05:04:17.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.024+0000 7f8ac7e00640 1 -- 172.21.15.49:0/1490840018 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aa8003530 con 0x7f8ac80cde80 2024-01-31T05:04:17.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.024+0000 7f8ac7e00640 1 -- 172.21.15.49:0/1490840018 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616717409 0 0) 0x7f8ac80cf940 con 0x7f8ac80cd0c0 2024-01-31T05:04:17.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.024+0000 7f8ac7e00640 1 -- 172.21.15.49:0/1490840018 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ac80cf660 con 0x7f8ac80cd0c0 2024-01-31T05:04:17.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.024+0000 7f8acde00640 1 -- 172.21.15.49:0/1490840018 >> v1:172.21.15.195:6789/0 conn(0x7f8ac80cd0c0 legacy=0x7f8ac80cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:17.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.024+0000 7f8acde00640 1 -- 172.21.15.49:0/1490840018 >> v1:172.21.15.49:6789/0 conn(0x7f8ac80cde80 legacy=0x7f8ac815cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:17.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.024+0000 7f8acde00640 1 -- 172.21.15.49:0/1490840018 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac80cfc20 con 0x7f8ac80cf0f0 2024-01-31T05:04:17.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.028+0000 7f8acde00640 1 --2- 172.21.15.49:0/1490840018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ac80cf0f0 0x7f8ac815d270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009dc0 tx=0x7f8ac001c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f3a582d81fd7965 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:17.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.028+0000 7f8ac7e00640 1 -- 172.21.15.49:0/1490840018 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00a5990 con 0x7f8ac80cf0f0 2024-01-31T05:04:17.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.028+0000 7f8ac7e00640 1 -- 172.21.15.49:0/1490840018 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac00a5af0 con 0x7f8ac80cf0f0 2024-01-31T05:04:17.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.028+0000 7f8ac7e00640 1 -- 172.21.15.49:0/1490840018 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00a5e80 con 0x7f8ac80cf0f0 2024-01-31T05:04:17.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.028+0000 7f8acfe00640 1 -- 172.21.15.49:0/1490840018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ac80cf0f0 msgr2=0x7f8ac815d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:17.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.028+0000 7f8acfe00640 1 --2- 172.21.15.49:0/1490840018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ac80cf0f0 0x7f8ac815d270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009dc0 tx=0x7f8ac001c8b0 comp rx=0 tx=0).stop 2024-01-31T05:04:17.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.028+0000 7f8acfe00640 1 -- 172.21.15.49:0/1490840018 shutdown_connections 2024-01-31T05:04:17.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.028+0000 7f8acfe00640 1 --2- 172.21.15.49:0/1490840018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ac80cf0f0 0x7f8ac815d270 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:17.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.028+0000 7f8acfe00640 1 -- 172.21.15.49:0/1490840018 >> 172.21.15.49:0/1490840018 conn(0x7f8ac80d0ef0 msgr2=0x7f8ac80d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:17.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.028+0000 7f8acfe00640 1 -- 172.21.15.49:0/1490840018 shutdown_connections 2024-01-31T05:04:17.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.028+0000 7f8acfe00640 1 -- 172.21.15.49:0/1490840018 wait complete. 2024-01-31T05:04:17.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acfe00640 1 Processor -- start 2024-01-31T05:04:17.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acfe00640 1 -- start start 2024-01-31T05:04:17.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acfe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac80cd0c0 0x7f8ac80b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:17.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acfe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ac80cde80 0x7f8ac806c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:17.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acfe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ac80cf0f0 0x7f8ac806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:17.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acfe00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac80b2880 con 0x7f8ac80cd0c0 2024-01-31T05:04:17.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acfe00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac8151a00 con 0x7f8ac80cf0f0 2024-01-31T05:04:17.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acfe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac80b3550 con 0x7f8ac80cde80 2024-01-31T05:04:17.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acd400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac80cd0c0 0x7f8ac80b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:17.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acd400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac80cd0c0 0x7f8ac80b5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38780/0 (socket says 172.21.15.49:38780) 2024-01-31T05:04:17.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acd400640 1 -- 172.21.15.49:0/3357944216 learned_addr learned my addr 172.21.15.49:0/3357944216 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:17.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acca00640 1 --2- 172.21.15.49:0/3357944216 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ac80cde80 0x7f8ac806c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:17.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acde00640 1 --2- 172.21.15.49:0/3357944216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ac80cf0f0 0x7f8ac806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:17.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acd400640 1 -- 172.21.15.49:0/3357944216 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ac80cde80 msgr2=0x7f8ac806c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:17.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acd400640 1 --2- 172.21.15.49:0/3357944216 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ac80cde80 0x7f8ac806c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:17.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acd400640 1 -- 172.21.15.49:0/3357944216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ac80cf0f0 msgr2=0x7f8ac806c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:17.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acd400640 1 --2- 172.21.15.49:0/3357944216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ac80cf0f0 0x7f8ac806c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:17.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acd400640 1 -- 172.21.15.49:0/3357944216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac0009a70 con 0x7f8ac80cd0c0 2024-01-31T05:04:17.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acd400640 1 --2- 172.21.15.49:0/3357944216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac80cd0c0 0x7f8ac80b5e30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800c460 tx=0x7f8ab800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:17.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8ac5600640 1 -- 172.21.15.49:0/3357944216 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80052d0 con 0x7f8ac80cd0c0 2024-01-31T05:04:17.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8ac5600640 1 -- 172.21.15.49:0/3357944216 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab8005450 con 0x7f8ac80cd0c0 2024-01-31T05:04:17.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8ac5600640 1 -- 172.21.15.49:0/3357944216 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8003840 con 0x7f8ac80cd0c0 2024-01-31T05:04:17.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acfe00640 1 -- 172.21.15.49:0/3357944216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac80b30e0 con 0x7f8ac80cd0c0 2024-01-31T05:04:17.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acfe00640 1 -- 172.21.15.49:0/3357944216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac80b2a90 con 0x7f8ac80cd0c0 2024-01-31T05:04:17.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.032+0000 7f8acfe00640 1 -- 172.21.15.49:0/3357944216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac8074860 con 0x7f8ac80cd0c0 2024-01-31T05:04:17.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.036+0000 7f8ac5600640 1 -- 172.21.15.49:0/3357944216 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f8ab80039a0 con 0x7f8ac80cd0c0 2024-01-31T05:04:17.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.036+0000 7f8ac5600640 1 --2- 172.21.15.49:0/3357944216 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8aa0066500 0x7f8aa00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:17.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.036+0000 7f8ac5600640 1 -- 172.21.15.49:0/3357944216 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ab8083470 con 0x7f8ac80cd0c0 2024-01-31T05:04:17.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.036+0000 7f8acca00640 1 --2- 172.21.15.49:0/3357944216 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8aa0066500 0x7f8aa00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:17.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.036+0000 7f8acca00640 1 --2- 172.21.15.49:0/3357944216 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8aa0066500 0x7f8aa00689c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80d0dd0 tx=0x7f8ab0007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:17.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.040+0000 7f8ac5600640 1 -- 172.21.15.49:0/3357944216 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f8ab8050720 con 0x7f8ac80cd0c0 2024-01-31T05:04:17.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.208+0000 7f8acfe00640 1 -- 172.21.15.49:0/3357944216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f8ac80c8270 con 0x7f8ac80cd0c0 2024-01-31T05:04:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.264+0000 7f8ac5600640 1 -- 172.21.15.49:0/3357944216 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f8ab8053d40 con 0x7f8ac80cd0c0 2024-01-31T05:04:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.268+0000 7f8acfe00640 1 -- 172.21.15.49:0/3357944216 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8aa0066500 msgr2=0x7f8aa00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.268+0000 7f8acfe00640 1 --2- 172.21.15.49:0/3357944216 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8aa0066500 0x7f8aa00689c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80d0dd0 tx=0x7f8ab0007d40 comp rx=0 tx=0).stop 2024-01-31T05:04:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.268+0000 7f8acfe00640 1 -- 172.21.15.49:0/3357944216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac80cd0c0 msgr2=0x7f8ac80b5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.268+0000 7f8acfe00640 1 --2- 172.21.15.49:0/3357944216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac80cd0c0 0x7f8ac80b5e30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800c460 tx=0x7f8ab800c920 comp rx=0 tx=0).stop 2024-01-31T05:04:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.268+0000 7f8acfe00640 1 -- 172.21.15.49:0/3357944216 shutdown_connections 2024-01-31T05:04:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.268+0000 7f8acfe00640 1 --2- 172.21.15.49:0/3357944216 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8aa0066500 0x7f8aa00689c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.268+0000 7f8acfe00640 1 --2- 172.21.15.49:0/3357944216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ac80cf0f0 0x7f8ac806c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.268+0000 7f8acfe00640 1 --2- 172.21.15.49:0/3357944216 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ac80cde80 0x7f8ac806c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.268+0000 7f8acfe00640 1 --2- 172.21.15.49:0/3357944216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac80cd0c0 0x7f8ac80b5e30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.268+0000 7f8acfe00640 1 -- 172.21.15.49:0/3357944216 >> 172.21.15.49:0/3357944216 conn(0x7f8ac80d0ef0 msgr2=0x7f8ac8073bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.268+0000 7f8acfe00640 1 -- 172.21.15.49:0/3357944216 shutdown_connections 2024-01-31T05:04:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.268+0000 7f8acfe00640 1 -- 172.21.15.49:0/3357944216 wait complete. 2024-01-31T05:04:17.287 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-01-31T05:04:17.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.436+0000 7fb439a00640 1 Processor -- start 2024-01-31T05:04:17.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.436+0000 7fb439a00640 1 -- start start 2024-01-31T05:04:17.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.436+0000 7fb439a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb43406c8d0 0x7fb43415e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:17.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.436+0000 7fb439a00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43406ccb0 con 0x7fb434160e50 2024-01-31T05:04:17.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.436+0000 7fb439a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb434161880 con 0x7fb4340cf780 2024-01-31T05:04:17.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.436+0000 7fb439a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb434161e40 con 0x7fb43406c8d0 2024-01-31T05:04:17.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.436+0000 7fb432000640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb434160e50 0x7fb4340cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:45496/0 (socket says 172.21.15.49:45496) 2024-01-31T05:04:17.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.436+0000 7fb432000640 1 -- 172.21.15.49:0/2593362599 learned_addr learned my addr 172.21.15.49:0/2593362599 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:17.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.440+0000 7fb432a00640 1 --2- 172.21.15.49:0/2593362599 >> v2:172.21.15.195:3300/0 conn(0x7fb43406c8d0 0x7fb43415e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:17.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.440+0000 7fb431600640 1 -- 172.21.15.49:0/2593362599 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3196719601 0 0) 0x7fb43406ccb0 con 0x7fb434160e50 2024-01-31T05:04:17.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.440+0000 7fb431600640 1 -- 172.21.15.49:0/2593362599 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb414003530 con 0x7fb434160e50 2024-01-31T05:04:17.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.440+0000 7fb431600640 1 -- 172.21.15.49:0/2593362599 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542353653 0 0) 0x7fb434161880 con 0x7fb4340cf780 2024-01-31T05:04:17.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.440+0000 7fb431600640 1 -- 172.21.15.49:0/2593362599 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb43406ccb0 con 0x7fb4340cf780 2024-01-31T05:04:17.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.440+0000 7fb432a00640 1 -- 172.21.15.49:0/2593362599 >> v1:172.21.15.195:6789/0 conn(0x7fb4340cf780 legacy=0x7fb4340b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:17.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.440+0000 7fb432a00640 1 -- 172.21.15.49:0/2593362599 >> v1:172.21.15.49:6789/0 conn(0x7fb434160e50 legacy=0x7fb4340cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:17.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.440+0000 7fb432a00640 1 -- 172.21.15.49:0/2593362599 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb434161b60 con 0x7fb43406c8d0 2024-01-31T05:04:17.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.440+0000 7fb432a00640 1 --2- 172.21.15.49:0/2593362599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb43406c8d0 0x7fb43415e270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb4240097c0 tx=0x7fb42401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=127bab94208ca964 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:17.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.440+0000 7fb431600640 1 -- 172.21.15.49:0/2593362599 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4240ab600 con 0x7fb43406c8d0 2024-01-31T05:04:17.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.440+0000 7fb431600640 1 -- 172.21.15.49:0/2593362599 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4240a7050 con 0x7fb43406c8d0 2024-01-31T05:04:17.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.440+0000 7fb431600640 1 -- 172.21.15.49:0/2593362599 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4240ab980 con 0x7fb43406c8d0 2024-01-31T05:04:17.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.444+0000 7fb439a00640 1 -- 172.21.15.49:0/2593362599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb43406c8d0 msgr2=0x7fb43415e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:17.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.444+0000 7fb439a00640 1 --2- 172.21.15.49:0/2593362599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb43406c8d0 0x7fb43415e270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb4240097c0 tx=0x7fb42401c480 comp rx=0 tx=0).stop 2024-01-31T05:04:17.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.444+0000 7fb439a00640 1 -- 172.21.15.49:0/2593362599 shutdown_connections 2024-01-31T05:04:17.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.444+0000 7fb439a00640 1 --2- 172.21.15.49:0/2593362599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb43406c8d0 0x7fb43415e270 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:17.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.444+0000 7fb439a00640 1 -- 172.21.15.49:0/2593362599 >> 172.21.15.49:0/2593362599 conn(0x7fb43406aba0 msgr2=0x7fb43406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:17.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.444+0000 7fb439a00640 1 -- 172.21.15.49:0/2593362599 shutdown_connections 2024-01-31T05:04:17.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.444+0000 7fb439a00640 1 -- 172.21.15.49:0/2593362599 wait complete. 2024-01-31T05:04:17.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.444+0000 7fb439a00640 1 Processor -- start 2024-01-31T05:04:17.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.444+0000 7fb439a00640 1 -- start start 2024-01-31T05:04:17.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.444+0000 7fb439a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb43406c8d0 0x7fb434156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:17.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.444+0000 7fb439a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4340cf780 0x7fb434127c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:17.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.444+0000 7fb439a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb434160e50 0x7fb43409bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:17.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.444+0000 7fb439a00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb434144bb0 con 0x7fb4340cf780 2024-01-31T05:04:17.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.444+0000 7fb439a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb434144e90 con 0x7fb434160e50 2024-01-31T05:04:17.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.444+0000 7fb439a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb434128680 con 0x7fb43406c8d0 2024-01-31T05:04:17.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.444+0000 7fb432000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4340cf780 0x7fb434127c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:17.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.444+0000 7fb432000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4340cf780 0x7fb434127c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38790/0 (socket says 172.21.15.49:38790) 2024-01-31T05:04:17.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.448+0000 7fb432000640 1 -- 172.21.15.49:0/1324640054 learned_addr learned my addr 172.21.15.49:0/1324640054 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:17.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.448+0000 7fb432a00640 1 --2- 172.21.15.49:0/1324640054 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb43406c8d0 0x7fb434156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:17.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.448+0000 7fb433400640 1 --2- 172.21.15.49:0/1324640054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb434160e50 0x7fb43409bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:17.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.448+0000 7fb432000640 1 -- 172.21.15.49:0/1324640054 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb43406c8d0 msgr2=0x7fb434156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:17.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.448+0000 7fb432000640 1 --2- 172.21.15.49:0/1324640054 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb43406c8d0 0x7fb434156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:17.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.448+0000 7fb432000640 1 -- 172.21.15.49:0/1324640054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb434160e50 msgr2=0x7fb43409bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:17.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.448+0000 7fb432000640 1 --2- 172.21.15.49:0/1324640054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb434160e50 0x7fb43409bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.448+0000 7fb432000640 1 -- 172.21.15.49:0/1324640054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb424009420 con 0x7fb4340cf780 2024-01-31T05:04:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.448+0000 7fb432000640 1 --2- 172.21.15.49:0/1324640054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4340cf780 0x7fb434127c30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00c450 tx=0x7fb41c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.448+0000 7fb42aa00640 1 -- 172.21.15.49:0/1324640054 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c005cf0 con 0x7fb4340cf780 2024-01-31T05:04:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.448+0000 7fb42aa00640 1 -- 172.21.15.49:0/1324640054 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41c005e50 con 0x7fb4340cf780 2024-01-31T05:04:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.448+0000 7fb42aa00640 1 -- 172.21.15.49:0/1324640054 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c007290 con 0x7fb4340cf780 2024-01-31T05:04:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.448+0000 7fb439a00640 1 -- 172.21.15.49:0/1324640054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb434128960 con 0x7fb4340cf780 2024-01-31T05:04:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.448+0000 7fb439a00640 1 -- 172.21.15.49:0/1324640054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb434156ff0 con 0x7fb4340cf780 2024-01-31T05:04:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.448+0000 7fb439a00640 1 -- 172.21.15.49:0/1324640054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb434074900 con 0x7fb4340cf780 2024-01-31T05:04:17.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.448+0000 7fb42aa00640 1 -- 172.21.15.49:0/1324640054 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb41c0073f0 con 0x7fb4340cf780 2024-01-31T05:04:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.448+0000 7fb42aa00640 1 --2- 172.21.15.49:0/1324640054 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb40c066530 0x7fb40c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.452+0000 7fb42aa00640 1 -- 172.21.15.49:0/1324640054 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fb41c0834c0 con 0x7fb4340cf780 2024-01-31T05:04:17.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.452+0000 7fb432a00640 1 --2- 172.21.15.49:0/1324640054 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb40c066530 0x7fb40c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:17.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.452+0000 7fb432a00640 1 --2- 172.21.15.49:0/1324640054 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb40c066530 0x7fb40c0689f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb4240ad000 tx=0x7fb4240a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:17.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.456+0000 7fb42aa00640 1 -- 172.21.15.49:0/1324640054 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fb41c050670 con 0x7fb4340cf780 2024-01-31T05:04:17.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:17.612+0000 7fb439a00640 1 -- 172.21.15.49:0/1324640054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb434144fd0 con 0x7fb4340cf780 2024-01-31T05:04:18.473 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:04:18.476 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:04:19.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.272+0000 7fb42aa00640 1 -- 172.21.15.49:0/1324640054 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7fb41c053c90 con 0x7fb4340cf780 2024-01-31T05:04:19.272 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data_ec' created 2024-01-31T05:04:19.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.276+0000 7fb439a00640 1 -- 172.21.15.49:0/1324640054 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb40c066530 msgr2=0x7fb40c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:19.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.276+0000 7fb439a00640 1 --2- 172.21.15.49:0/1324640054 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb40c066530 0x7fb40c0689f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb4240ad000 tx=0x7fb4240a6000 comp rx=0 tx=0).stop 2024-01-31T05:04:19.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.276+0000 7fb439a00640 1 -- 172.21.15.49:0/1324640054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4340cf780 msgr2=0x7fb434127c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:19.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.276+0000 7fb439a00640 1 --2- 172.21.15.49:0/1324640054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4340cf780 0x7fb434127c30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00c450 tx=0x7fb41c00c910 comp rx=0 tx=0).stop 2024-01-31T05:04:19.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.276+0000 7fb439a00640 1 -- 172.21.15.49:0/1324640054 shutdown_connections 2024-01-31T05:04:19.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.276+0000 7fb439a00640 1 --2- 172.21.15.49:0/1324640054 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb40c066530 0x7fb40c0689f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:19.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.276+0000 7fb439a00640 1 --2- 172.21.15.49:0/1324640054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb434160e50 0x7fb43409bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:19.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.276+0000 7fb439a00640 1 --2- 172.21.15.49:0/1324640054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4340cf780 0x7fb434127c30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:19.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.276+0000 7fb439a00640 1 --2- 172.21.15.49:0/1324640054 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb43406c8d0 0x7fb434156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:19.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.276+0000 7fb439a00640 1 -- 172.21.15.49:0/1324640054 >> 172.21.15.49:0/1324640054 conn(0x7fb43406aba0 msgr2=0x7fb43406af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:19.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.276+0000 7fb439a00640 1 -- 172.21.15.49:0/1324640054 shutdown_connections 2024-01-31T05:04:19.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.276+0000 7fb439a00640 1 -- 172.21.15.49:0/1324640054 wait complete. 2024-01-31T05:04:19.310 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-01-31T05:04:19.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.456+0000 7f3d4de00640 1 Processor -- start 2024-01-31T05:04:19.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.456+0000 7f3d4de00640 1 -- start start 2024-01-31T05:04:19.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.460+0000 7f3d4de00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d48159790 0x7f3d480b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:19.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.460+0000 7f3d4de00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3d48070d70 0x7f3d480ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:19.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.460+0000 7f3d4de00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d48159b70 con 0x7f3d480b3d00 2024-01-31T05:04:19.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.460+0000 7f3d4de00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d480b2750 con 0x7f3d48070d70 2024-01-31T05:04:19.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.460+0000 7f3d4de00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d480b2a30 con 0x7f3d48159790 2024-01-31T05:04:19.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.460+0000 7f3d47400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3d48070d70 0x7f3d480ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:19.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.460+0000 7f3d47400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3d48070d70 0x7f3d480ac050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:55418/0 (socket says 172.21.15.49:55418) 2024-01-31T05:04:19.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.460+0000 7f3d47400640 1 -- 172.21.15.49:0/3033321663 learned_addr learned my addr 172.21.15.49:0/3033321663 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:19.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.460+0000 7f3d46a00640 1 --2- 172.21.15.49:0/3033321663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d48159790 0x7f3d480b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:19.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.460+0000 7f3d47400640 1 -- 172.21.15.49:0/3033321663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d48159790 msgr2=0x7f3d480b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:19.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.460+0000 7f3d47400640 1 --2- 172.21.15.49:0/3033321663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d48159790 0x7f3d480b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:19.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.460+0000 7f3d47400640 1 -- 172.21.15.49:0/3033321663 >> v1:172.21.15.195:6789/0 conn(0x7f3d480b3d00 legacy=0x7f3d48070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:19.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.460+0000 7f3d47400640 1 -- 172.21.15.49:0/3033321663 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d480b2d10 con 0x7f3d48070d70 2024-01-31T05:04:19.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.464+0000 7f3d47400640 1 --2- 172.21.15.49:0/3033321663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d48070d70 0x7f3d480ac050 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000af60 tx=0x7f3d4001dae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6cdc743647690d6 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:19.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.464+0000 7f3d45600640 1 -- 172.21.15.49:0/3033321663 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4000a2d0 con 0x7f3d48070d70 2024-01-31T05:04:19.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.464+0000 7f3d45600640 1 -- 172.21.15.49:0/3033321663 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d400a6920 con 0x7f3d48070d70 2024-01-31T05:04:19.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.464+0000 7f3d45600640 1 -- 172.21.15.49:0/3033321663 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d400a6cb0 con 0x7f3d48070d70 2024-01-31T05:04:19.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.464+0000 7f3d4de00640 1 -- 172.21.15.49:0/3033321663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d48070d70 msgr2=0x7f3d480ac050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:19.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.464+0000 7f3d4de00640 1 --2- 172.21.15.49:0/3033321663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d48070d70 0x7f3d480ac050 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000af60 tx=0x7f3d4001dae0 comp rx=0 tx=0).stop 2024-01-31T05:04:19.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.464+0000 7f3d4de00640 1 -- 172.21.15.49:0/3033321663 shutdown_connections 2024-01-31T05:04:19.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.464+0000 7f3d4de00640 1 --2- 172.21.15.49:0/3033321663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d48070d70 0x7f3d480ac050 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:19.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.464+0000 7f3d4de00640 1 --2- 172.21.15.49:0/3033321663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d48159790 0x7f3d480b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:19.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.464+0000 7f3d4de00640 1 -- 172.21.15.49:0/3033321663 >> 172.21.15.49:0/3033321663 conn(0x7f3d480b09a0 msgr2=0x7f3d480b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:19.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.464+0000 7f3d4de00640 1 -- 172.21.15.49:0/3033321663 shutdown_connections 2024-01-31T05:04:19.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.464+0000 7f3d4de00640 1 -- 172.21.15.49:0/3033321663 wait complete. 2024-01-31T05:04:19.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.464+0000 7f3d4de00640 1 Processor -- start 2024-01-31T05:04:19.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.464+0000 7f3d4de00640 1 -- start start 2024-01-31T05:04:19.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d4de00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d48070d70 0x7f3d4814e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:19.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d4de00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d480b3d00 0x7f3d480b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:19.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d4de00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d48159790 0x7f3d480b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:19.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d4de00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4815bf00 con 0x7f3d48159790 2024-01-31T05:04:19.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d4de00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4815b940 con 0x7f3d480b3d00 2024-01-31T05:04:19.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d4de00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4815bc20 con 0x7f3d48070d70 2024-01-31T05:04:19.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d47400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d48159790 0x7f3d480b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:19.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d47400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d48159790 0x7f3d480b1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33922/0 (socket says 172.21.15.49:33922) 2024-01-31T05:04:19.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d47400640 1 -- 172.21.15.49:0/2535384599 learned_addr learned my addr 172.21.15.49:0/2535384599 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:19.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d46a00640 1 --2- 172.21.15.49:0/2535384599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d48070d70 0x7f3d4814e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:19.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d46000640 1 --2- 172.21.15.49:0/2535384599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d480b3d00 0x7f3d480b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:19.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d47400640 1 -- 172.21.15.49:0/2535384599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d48070d70 msgr2=0x7f3d4814e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:19.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d47400640 1 --2- 172.21.15.49:0/2535384599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d48070d70 0x7f3d4814e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:19.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d47400640 1 -- 172.21.15.49:0/2535384599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d480b3d00 msgr2=0x7f3d480b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:19.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d47400640 1 --2- 172.21.15.49:0/2535384599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d480b3d00 0x7f3d480b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:19.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d47400640 1 -- 172.21.15.49:0/2535384599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4000ac40 con 0x7f3d48159790 2024-01-31T05:04:19.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d47400640 1 --2- 172.21.15.49:0/2535384599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d48159790 0x7f3d480b1fd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3d400b0040 tx=0x7f3d4001a880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:19.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d3f400640 1 -- 172.21.15.49:0/2535384599 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40008700 con 0x7f3d48159790 2024-01-31T05:04:19.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d3f400640 1 -- 172.21.15.49:0/2535384599 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d400088a0 con 0x7f3d48159790 2024-01-31T05:04:19.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d4de00640 1 -- 172.21.15.49:0/2535384599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d480cbd40 con 0x7f3d48159790 2024-01-31T05:04:19.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d3f400640 1 -- 172.21.15.49:0/2535384599 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40008c50 con 0x7f3d48159790 2024-01-31T05:04:19.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d4de00640 1 -- 172.21.15.49:0/2535384599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4814e630 con 0x7f3d48159790 2024-01-31T05:04:19.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.468+0000 7f3d4de00640 1 -- 172.21.15.49:0/2535384599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d480cbba0 con 0x7f3d48159790 2024-01-31T05:04:19.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.472+0000 7f3d3f400640 1 -- 172.21.15.49:0/2535384599 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f3d400b7480 con 0x7f3d48159790 2024-01-31T05:04:19.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.472+0000 7f3d3f400640 1 --2- 172.21.15.49:0/2535384599 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3d20066500 0x7f3d200689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:19.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.472+0000 7f3d3f400640 1 -- 172.21.15.49:0/2535384599 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f3d4011f630 con 0x7f3d48159790 2024-01-31T05:04:19.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.472+0000 7f3d46a00640 1 --2- 172.21.15.49:0/2535384599 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3d20066500 0x7f3d200689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:19.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.472+0000 7f3d46a00640 1 --2- 172.21.15.49:0/2535384599 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3d20066500 0x7f3d200689c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009ac0 tx=0x7f3d38009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:19.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.476+0000 7f3d3f400640 1 -- 172.21.15.49:0/2535384599 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f3d480cbba0 con 0x7f3d48159790 2024-01-31T05:04:19.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:19.632+0000 7f3d4de00640 1 -- 172.21.15.49:0/2535384599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f3d480cbba0 con 0x7f3d48159790 2024-01-31T05:04:19.814 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-31T05:04:19.812+0000 7f7e3d200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-31T05:04:20.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.272+0000 7f3d3f400640 1 -- 172.21.15.49:0/2535384599 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3d480cbba0 con 0x7f3d48159790 2024-01-31T05:04:20.274 INFO:teuthology.orchestra.run.smithi049.stderr:set pool 4 allow_ec_overwrites to true 2024-01-31T05:04:20.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.280+0000 7f3d4de00640 1 -- 172.21.15.49:0/2535384599 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3d20066500 msgr2=0x7f3d200689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:20.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.280+0000 7f3d4de00640 1 --2- 172.21.15.49:0/2535384599 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3d20066500 0x7f3d200689c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009ac0 tx=0x7f3d38009190 comp rx=0 tx=0).stop 2024-01-31T05:04:20.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.280+0000 7f3d4de00640 1 -- 172.21.15.49:0/2535384599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d48159790 msgr2=0x7f3d480b1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:20.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.280+0000 7f3d4de00640 1 --2- 172.21.15.49:0/2535384599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d48159790 0x7f3d480b1fd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3d400b0040 tx=0x7f3d4001a880 comp rx=0 tx=0).stop 2024-01-31T05:04:20.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.288+0000 7f3d4de00640 1 -- 172.21.15.49:0/2535384599 shutdown_connections 2024-01-31T05:04:20.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.288+0000 7f3d4de00640 1 --2- 172.21.15.49:0/2535384599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d48159790 0x7f3d480b1fd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:20.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.288+0000 7f3d4de00640 1 --2- 172.21.15.49:0/2535384599 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3d20066500 0x7f3d200689c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:20.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.288+0000 7f3d4de00640 1 --2- 172.21.15.49:0/2535384599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d480b3d00 0x7f3d480b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:20.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.288+0000 7f3d4de00640 1 --2- 172.21.15.49:0/2535384599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d48070d70 0x7f3d4814e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:20.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.288+0000 7f3d4de00640 1 -- 172.21.15.49:0/2535384599 >> 172.21.15.49:0/2535384599 conn(0x7f3d480b09a0 msgr2=0x7f3d481586a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:20.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.288+0000 7f3d4de00640 1 -- 172.21.15.49:0/2535384599 shutdown_connections 2024-01-31T05:04:20.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.288+0000 7f3d4de00640 1 -- 172.21.15.49:0/2535384599 wait complete. 2024-01-31T05:04:20.327 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-01-31T05:04:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.476+0000 7f3d09400640 1 Processor -- start 2024-01-31T05:04:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.476+0000 7f3d09400640 1 -- start start 2024-01-31T05:04:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.476+0000 7f3d09400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d0406c290 0x7f3d040cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.476+0000 7f3d09400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3d0406ba90 0x7f3d0406c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.476+0000 7f3d09400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3d040cd630 0x7f3d040cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.476+0000 7f3d09400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0406cbb0 con 0x7f3d040cd630 2024-01-31T05:04:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.476+0000 7f3d09400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0415d7e0 con 0x7f3d0406ba90 2024-01-31T05:04:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.476+0000 7f3d09400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d040d0470 con 0x7f3d0406c290 2024-01-31T05:04:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.476+0000 7f3d03200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3d040cd630 0x7f3d040cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.476+0000 7f3d03200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f3d040cd630 0x7f3d040cdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33936/0 (socket says 172.21.15.49:33936) 2024-01-31T05:04:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.476+0000 7f3d03200640 1 -- 172.21.15.49:0/1831881022 learned_addr learned my addr 172.21.15.49:0/1831881022 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.480+0000 7f3d01e00640 1 --2- 172.21.15.49:0/1831881022 >> v2:172.21.15.195:3300/0 conn(0x7f3d0406ba90 0x7f3d0406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.480+0000 7f3d02800640 1 --2- 172.21.15.49:0/1831881022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d0406c290 0x7f3d040cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:20.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.480+0000 7f3d03200640 1 -- 172.21.15.49:0/1831881022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d0406c290 msgr2=0x7f3d040cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:20.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.480+0000 7f3d03200640 1 --2- 172.21.15.49:0/1831881022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d0406c290 0x7f3d040cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:20.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.480+0000 7f3d03200640 1 -- 172.21.15.49:0/1831881022 >> v2:172.21.15.195:3300/0 conn(0x7f3d0406ba90 msgr2=0x7f3d0406c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:20.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.480+0000 7f3d03200640 1 --2- 172.21.15.49:0/1831881022 >> v2:172.21.15.195:3300/0 conn(0x7f3d0406ba90 0x7f3d0406c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:20.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.480+0000 7f3d03200640 1 -- 172.21.15.49:0/1831881022 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d040d0190 con 0x7f3d040cd630 2024-01-31T05:04:20.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.480+0000 7f3d02800640 1 --2- 172.21.15.49:0/1831881022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d0406c290 0x7f3d040cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:20.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.480+0000 7f3d03200640 1 --2- 172.21.15.49:0/1831881022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d040cd630 0x7f3d040cdac0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3d04071d70 tx=0x7f3cfc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e65dad6a8788e1 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:20.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.480+0000 7f3d01400640 1 -- 172.21.15.49:0/1831881022 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc0a56a0 con 0x7f3d040cd630 2024-01-31T05:04:20.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.480+0000 7f3d01400640 1 -- 172.21.15.49:0/1831881022 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cfc0a5800 con 0x7f3d040cd630 2024-01-31T05:04:20.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.480+0000 7f3d01400640 1 -- 172.21.15.49:0/1831881022 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc0a5b90 con 0x7f3d040cd630 2024-01-31T05:04:20.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d09400640 1 -- 172.21.15.49:0/1831881022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d040cd630 msgr2=0x7f3d040cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:20.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d09400640 1 --2- 172.21.15.49:0/1831881022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d040cd630 0x7f3d040cdac0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3d04071d70 tx=0x7f3cfc01c910 comp rx=0 tx=0).stop 2024-01-31T05:04:20.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d09400640 1 -- 172.21.15.49:0/1831881022 shutdown_connections 2024-01-31T05:04:20.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d09400640 1 --2- 172.21.15.49:0/1831881022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d040cd630 0x7f3d040cdac0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:20.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d09400640 1 --2- 172.21.15.49:0/1831881022 >> v2:172.21.15.195:3300/0 conn(0x7f3d0406ba90 0x7f3d0406c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:20.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d09400640 1 --2- 172.21.15.49:0/1831881022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d0406c290 0x7f3d040cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:20.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d09400640 1 -- 172.21.15.49:0/1831881022 >> 172.21.15.49:0/1831881022 conn(0x7f3d040b28e0 msgr2=0x7f3d040b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:20.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d09400640 1 -- 172.21.15.49:0/1831881022 shutdown_connections 2024-01-31T05:04:20.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d09400640 1 -- 172.21.15.49:0/1831881022 wait complete. 2024-01-31T05:04:20.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d09400640 1 Processor -- start 2024-01-31T05:04:20.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d09400640 1 -- start start 2024-01-31T05:04:20.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d09400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d0406ba90 0x7f3d040b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:20.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d09400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d0406c290 0x7f3d04157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:20.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d09400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d040cd630 0x7f3d04157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:20.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d09400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d040b2740 con 0x7f3d0406ba90 2024-01-31T05:04:20.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d09400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d040b0c90 con 0x7f3d040cd630 2024-01-31T05:04:20.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d09400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d040b2460 con 0x7f3d0406c290 2024-01-31T05:04:20.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d02800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d0406ba90 0x7f3d040b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:20.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d02800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d0406ba90 0x7f3d040b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33940/0 (socket says 172.21.15.49:33940) 2024-01-31T05:04:20.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d02800640 1 -- 172.21.15.49:0/2777097323 learned_addr learned my addr 172.21.15.49:0/2777097323 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:20.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d03200640 1 --2- 172.21.15.49:0/2777097323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d040cd630 0x7f3d04157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:20.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.484+0000 7f3d01e00640 1 --2- 172.21.15.49:0/2777097323 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d0406c290 0x7f3d04157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:20.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.488+0000 7f3d02800640 1 -- 172.21.15.49:0/2777097323 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d0406c290 msgr2=0x7f3d04157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:20.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.488+0000 7f3d02800640 1 --2- 172.21.15.49:0/2777097323 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d0406c290 0x7f3d04157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:20.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.488+0000 7f3d02800640 1 -- 172.21.15.49:0/2777097323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d040cd630 msgr2=0x7f3d04157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:20.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.488+0000 7f3d02800640 1 --2- 172.21.15.49:0/2777097323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d040cd630 0x7f3d04157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:20.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.488+0000 7f3d02800640 1 -- 172.21.15.49:0/2777097323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cfc009b30 con 0x7f3d0406ba90 2024-01-31T05:04:20.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.488+0000 7f3d02800640 1 --2- 172.21.15.49:0/2777097323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d0406ba90 0x7f3d040b10b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400e810 tx=0x7f3cf400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:20.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.488+0000 7f3cfaa00640 1 -- 172.21.15.49:0/2777097323 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf400c8d0 con 0x7f3d0406ba90 2024-01-31T05:04:20.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.488+0000 7f3cfaa00640 1 -- 172.21.15.49:0/2777097323 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf400ca30 con 0x7f3d0406ba90 2024-01-31T05:04:20.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.488+0000 7f3d09400640 1 -- 172.21.15.49:0/2777097323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d040b05d0 con 0x7f3d0406ba90 2024-01-31T05:04:20.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.488+0000 7f3cfaa00640 1 -- 172.21.15.49:0/2777097323 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf400cde0 con 0x7f3d0406ba90 2024-01-31T05:04:20.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.488+0000 7f3d09400640 1 -- 172.21.15.49:0/2777097323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d04150640 con 0x7f3d0406ba90 2024-01-31T05:04:20.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.488+0000 7f3d09400640 1 -- 172.21.15.49:0/2777097323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d040b0430 con 0x7f3d0406ba90 2024-01-31T05:04:20.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.488+0000 7f3cfaa00640 1 -- 172.21.15.49:0/2777097323 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f3cf4013410 con 0x7f3d0406ba90 2024-01-31T05:04:20.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.488+0000 7f3cfaa00640 1 --2- 172.21.15.49:0/2777097323 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3cdc066530 0x7f3cdc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:20.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.492+0000 7f3cfaa00640 1 -- 172.21.15.49:0/2777097323 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f3cf4083ae0 con 0x7f3d0406ba90 2024-01-31T05:04:20.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.492+0000 7f3d01e00640 1 --2- 172.21.15.49:0/2777097323 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3cdc066530 0x7f3cdc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:20.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.492+0000 7f3d01e00640 1 --2- 172.21.15.49:0/2777097323 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3cdc066530 0x7f3cdc0689f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3d041510c0 tx=0x7f3cec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:20.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.496+0000 7f3cfaa00640 1 -- 172.21.15.49:0/2777097323 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f3d040b0430 con 0x7f3d0406ba90 2024-01-31T05:04:20.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:20.692+0000 7f3d09400640 1 -- 172.21.15.49:0/2777097323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f3d040b0430 con 0x7f3d0406ba90 2024-01-31T05:04:21.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.284+0000 7f3cfaa00640 1 -- 172.21.15.49:0/2777097323 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f3d040b0430 con 0x7f3d0406ba90 2024-01-31T05:04:21.286 INFO:teuthology.orchestra.run.smithi049.stderr:added data pool 4 to fsmap 2024-01-31T05:04:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.288+0000 7f3d09400640 1 -- 172.21.15.49:0/2777097323 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3cdc066530 msgr2=0x7f3cdc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.288+0000 7f3d09400640 1 --2- 172.21.15.49:0/2777097323 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3cdc066530 0x7f3cdc0689f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3d041510c0 tx=0x7f3cec008040 comp rx=0 tx=0).stop 2024-01-31T05:04:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.288+0000 7f3d09400640 1 -- 172.21.15.49:0/2777097323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d0406ba90 msgr2=0x7f3d040b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.288+0000 7f3d09400640 1 --2- 172.21.15.49:0/2777097323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d0406ba90 0x7f3d040b10b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400e810 tx=0x7f3cf400ecd0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.288+0000 7f3d09400640 1 -- 172.21.15.49:0/2777097323 shutdown_connections 2024-01-31T05:04:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.288+0000 7f3d09400640 1 --2- 172.21.15.49:0/2777097323 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3cdc066530 0x7f3cdc0689f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.288+0000 7f3d09400640 1 --2- 172.21.15.49:0/2777097323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d040cd630 0x7f3d04157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.288+0000 7f3d09400640 1 --2- 172.21.15.49:0/2777097323 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d0406c290 0x7f3d04157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.288+0000 7f3d09400640 1 --2- 172.21.15.49:0/2777097323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d0406ba90 0x7f3d040b10b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.288+0000 7f3d09400640 1 -- 172.21.15.49:0/2777097323 >> 172.21.15.49:0/2777097323 conn(0x7f3d040b28e0 msgr2=0x7f3d0415c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.288+0000 7f3d09400640 1 -- 172.21.15.49:0/2777097323 shutdown_connections 2024-01-31T05:04:21.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.288+0000 7f3d09400640 1 -- 172.21.15.49:0/2777097323 wait complete. 2024-01-31T05:04:21.310 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:04:21.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.452+0000 7f9777e00640 1 Processor -- start 2024-01-31T05:04:21.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.452+0000 7f9777e00640 1 -- start start 2024-01-31T05:04:21.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.452+0000 7f9777e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f977015a000 0x7f97700cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:21.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.452+0000 7f9777e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f977006c2d0 0x7f9770070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:21.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.452+0000 7f9777e00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977006c750 con 0x7f9770071410 2024-01-31T05:04:21.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.452+0000 7f9777e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97700b3760 con 0x7f977006c2d0 2024-01-31T05:04:21.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.452+0000 7f9777e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97700718a0 con 0x7f977015a000 2024-01-31T05:04:21.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.452+0000 7f9775e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9770071410 0x7f97700b1ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34694/0 (socket says 172.21.15.49:34694) 2024-01-31T05:04:21.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.452+0000 7f9775e00640 1 -- 172.21.15.49:0/86230333 learned_addr learned my addr 172.21.15.49:0/86230333 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:21.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.452+0000 7f9774a00640 1 --2- 172.21.15.49:0/86230333 >> v2:172.21.15.195:3300/0 conn(0x7f977006c2d0 0x7f9770070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:21.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.452+0000 7f9775400640 1 --2- 172.21.15.49:0/86230333 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f977015a000 0x7f97700cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:21.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.452+0000 7f976fe00640 1 -- 172.21.15.49:0/86230333 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139123140 0 0) 0x7f97680014a0 con 0x7f9770071410 2024-01-31T05:04:21.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.452+0000 7f976fe00640 1 -- 172.21.15.49:0/86230333 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9750003530 con 0x7f9770071410 2024-01-31T05:04:21.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.452+0000 7f9774a00640 1 -- 172.21.15.49:0/86230333 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f977015a000 msgr2=0x7f97700cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:21.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.452+0000 7f9774a00640 1 --2- 172.21.15.49:0/86230333 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f977015a000 0x7f97700cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.452+0000 7f9774a00640 1 -- 172.21.15.49:0/86230333 >> v1:172.21.15.49:6789/0 conn(0x7f9770071410 legacy=0x7f97700b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:21.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.452+0000 7f9774a00640 1 -- 172.21.15.49:0/86230333 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9770071e40 con 0x7f977006c2d0 2024-01-31T05:04:21.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.456+0000 7f9774a00640 1 --2- 172.21.15.49:0/86230333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f977006c2d0 0x7f9770070ed0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f97580097f0 tx=0x7f975801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e9da6cc25ee54ad server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:21.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.456+0000 7f976fe00640 1 -- 172.21.15.49:0/86230333 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97700b2bc0 con 0x7f977006c2d0 2024-01-31T05:04:21.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.456+0000 7f976fe00640 1 -- 172.21.15.49:0/86230333 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97580a7050 con 0x7f977006c2d0 2024-01-31T05:04:21.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.456+0000 7f976fe00640 1 -- 172.21.15.49:0/86230333 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97580ab820 con 0x7f977006c2d0 2024-01-31T05:04:21.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.456+0000 7f9777e00640 1 -- 172.21.15.49:0/86230333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f977006c2d0 msgr2=0x7f9770070ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:21.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.456+0000 7f9777e00640 1 --2- 172.21.15.49:0/86230333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f977006c2d0 0x7f9770070ed0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f97580097f0 tx=0x7f975801c480 comp rx=0 tx=0).stop 2024-01-31T05:04:21.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.456+0000 7f9777e00640 1 -- 172.21.15.49:0/86230333 shutdown_connections 2024-01-31T05:04:21.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.456+0000 7f9777e00640 1 --2- 172.21.15.49:0/86230333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f977006c2d0 0x7f9770070ed0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.456+0000 7f9777e00640 1 --2- 172.21.15.49:0/86230333 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f977015a000 0x7f97700cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.456+0000 7f9777e00640 1 -- 172.21.15.49:0/86230333 >> 172.21.15.49:0/86230333 conn(0x7f97700b09a0 msgr2=0x7f97700b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:21.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9777e00640 1 -- 172.21.15.49:0/86230333 shutdown_connections 2024-01-31T05:04:21.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9777e00640 1 -- 172.21.15.49:0/86230333 wait complete. 2024-01-31T05:04:21.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9777e00640 1 Processor -- start 2024-01-31T05:04:21.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9777e00640 1 -- start start 2024-01-31T05:04:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9777e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f977006c2d0 0x7f977015b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9777e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9770071410 0x7f9770157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9777e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f977015a000 0x7f977015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9777e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977015c500 con 0x7f977006c2d0 2024-01-31T05:04:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9777e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977015a6a0 con 0x7f977015a000 2024-01-31T05:04:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9777e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977015a980 con 0x7f9770071410 2024-01-31T05:04:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9775400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f977006c2d0 0x7f977015b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9775400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f977006c2d0 0x7f977015b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33954/0 (socket says 172.21.15.49:33954) 2024-01-31T05:04:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9775400640 1 -- 172.21.15.49:0/4232637653 learned_addr learned my addr 172.21.15.49:0/4232637653 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9775e00640 1 --2- 172.21.15.49:0/4232637653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f977015a000 0x7f977015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9774a00640 1 --2- 172.21.15.49:0/4232637653 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9770071410 0x7f9770157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:21.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9775400640 1 -- 172.21.15.49:0/4232637653 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9770071410 msgr2=0x7f9770157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:21.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9775400640 1 --2- 172.21.15.49:0/4232637653 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9770071410 0x7f9770157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9775400640 1 -- 172.21.15.49:0/4232637653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f977015a000 msgr2=0x7f977015bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:21.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9775400640 1 --2- 172.21.15.49:0/4232637653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f977015a000 0x7f977015bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9775400640 1 -- 172.21.15.49:0/4232637653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9758009420 con 0x7f977006c2d0 2024-01-31T05:04:21.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.460+0000 7f9775400640 1 --2- 172.21.15.49:0/4232637653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f977006c2d0 0x7f977015b460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f976000e930 tx=0x7f976000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:21.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.464+0000 7f976d600640 1 -- 172.21.15.49:0/4232637653 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9760009690 con 0x7f977006c2d0 2024-01-31T05:04:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.464+0000 7f976d600640 1 -- 172.21.15.49:0/4232637653 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976000ca00 con 0x7f977006c2d0 2024-01-31T05:04:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.464+0000 7f976d600640 1 -- 172.21.15.49:0/4232637653 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976000cd70 con 0x7f977006c2d0 2024-01-31T05:04:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.464+0000 7f9777e00640 1 -- 172.21.15.49:0/4232637653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977015ac60 con 0x7f977006c2d0 2024-01-31T05:04:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.464+0000 7f9777e00640 1 -- 172.21.15.49:0/4232637653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9770157ed0 con 0x7f977006c2d0 2024-01-31T05:04:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.464+0000 7f9777e00640 1 -- 172.21.15.49:0/4232637653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9770074860 con 0x7f977006c2d0 2024-01-31T05:04:21.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.464+0000 7f976d600640 1 -- 172.21.15.49:0/4232637653 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f9760013470 con 0x7f977006c2d0 2024-01-31T05:04:21.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.464+0000 7f976d600640 1 --2- 172.21.15.49:0/4232637653 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9748066500 0x7f97480689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:21.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.464+0000 7f976d600640 1 -- 172.21.15.49:0/4232637653 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9760084490 con 0x7f977006c2d0 2024-01-31T05:04:21.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.464+0000 7f9774a00640 1 --2- 172.21.15.49:0/4232637653 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9748066500 0x7f97480689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:21.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.468+0000 7f9774a00640 1 --2- 172.21.15.49:0/4232637653 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9748066500 0x7f97480689c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f97580ad000 tx=0x7f9758008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:21.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.468+0000 7f976d600640 1 -- 172.21.15.49:0/4232637653 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9760051460 con 0x7f977006c2d0 2024-01-31T05:04:21.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.664+0000 7f9777e00640 1 -- 172.21.15.49:0/4232637653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9770073740 con 0x7f977006c2d0 2024-01-31T05:04:21.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.668+0000 7f976d600640 1 -- 172.21.15.49:0/4232637653 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4940 (secure 0 0 0) 0x7f9760054a80 con 0x7f977006c2d0 2024-01-31T05:04:21.667 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:21.667 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2308601440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2308601440},{"type":"v1","addr":"172.21.15.49:6835","nonce":2308601440}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2920530340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":2920530340},{"type":"v1","addr":"172.21.15.195:6836","nonce":2920530340}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3114317228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3114317228},{"type":"v1","addr":"172.21.15.195:6837","nonce":3114317228}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-31T05:04:16.248649+0000","modified":"2024-01-31T05:04:20.696004+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/4254852793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4254852793},{"type":"v1","addr":"172.21.15.49:6834","nonce":4254852793}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-31T05:04:21.667 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 7 2024-01-31T05:04:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.668+0000 7f9777e00640 1 -- 172.21.15.49:0/4232637653 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9748066500 msgr2=0x7f97480689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.668+0000 7f9777e00640 1 --2- 172.21.15.49:0/4232637653 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9748066500 0x7f97480689c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f97580ad000 tx=0x7f9758008040 comp rx=0 tx=0).stop 2024-01-31T05:04:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.668+0000 7f9777e00640 1 -- 172.21.15.49:0/4232637653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f977006c2d0 msgr2=0x7f977015b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.668+0000 7f9777e00640 1 --2- 172.21.15.49:0/4232637653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f977006c2d0 0x7f977015b460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f976000e930 tx=0x7f976000edf0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.668+0000 7f9777e00640 1 -- 172.21.15.49:0/4232637653 shutdown_connections 2024-01-31T05:04:21.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.668+0000 7f9777e00640 1 --2- 172.21.15.49:0/4232637653 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9748066500 0x7f97480689c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.668+0000 7f9777e00640 1 --2- 172.21.15.49:0/4232637653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f977015a000 0x7f977015bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.668+0000 7f9777e00640 1 --2- 172.21.15.49:0/4232637653 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9770071410 0x7f9770157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.668+0000 7f9777e00640 1 --2- 172.21.15.49:0/4232637653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f977006c2d0 0x7f977015b460 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.668+0000 7f9777e00640 1 -- 172.21.15.49:0/4232637653 >> 172.21.15.49:0/4232637653 conn(0x7f97700b09a0 msgr2=0x7f97700add80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:21.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.668+0000 7f9777e00640 1 -- 172.21.15.49:0/4232637653 shutdown_connections 2024-01-31T05:04:21.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.668+0000 7f9777e00640 1 -- 172.21.15.49:0/4232637653 wait complete. 2024-01-31T05:04:21.689 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:04:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.828+0000 7f513ac00640 1 Processor -- start 2024-01-31T05:04:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.828+0000 7f513ac00640 1 -- start start 2024-01-31T05:04:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.832+0000 7f513ac00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51340cdf10 0x7f5134070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.832+0000 7f513ac00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f51340ce610 0x7f5134071310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.832+0000 7f513ac00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f513415b4f0 con 0x7f513415b110 2024-01-31T05:04:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.832+0000 7f513ac00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51340ce460 con 0x7f51340ce610 2024-01-31T05:04:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.832+0000 7f513ac00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5134071850 con 0x7f51340cdf10 2024-01-31T05:04:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.832+0000 7f5133400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51340cdf10 0x7f5134070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.832+0000 7f5138c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f51340ce610 0x7f5134071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.832+0000 7f5133400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51340cdf10 0x7f5134070dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:54770/0 (socket says 172.21.15.49:54770) 2024-01-31T05:04:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.832+0000 7f5138c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f51340ce610 0x7f5134071310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:55484/0 (socket says 172.21.15.49:55484) 2024-01-31T05:04:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.832+0000 7f5133400640 1 -- 172.21.15.49:0/1897932121 learned_addr learned my addr 172.21.15.49:0/1897932121 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.832+0000 7f5133400640 1 -- 172.21.15.49:0/1897932121 >> v2:172.21.15.195:3300/0 conn(0x7f51340ce610 msgr2=0x7f5134071310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.832+0000 7f5133400640 1 --2- 172.21.15.49:0/1897932121 >> v2:172.21.15.195:3300/0 conn(0x7f51340ce610 0x7f5134071310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.832+0000 7f5133400640 1 -- 172.21.15.49:0/1897932121 >> v1:172.21.15.195:6789/0 conn(0x7f513415b110 legacy=0x7f513406c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.832+0000 7f5132a00640 1 -- 172.21.15.49:0/1897932121 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810081156 0 0) 0x7f5124001120 con 0x7f513415b110 2024-01-31T05:04:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.832+0000 7f5133400640 1 -- 172.21.15.49:0/1897932121 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51340abf20 con 0x7f51340cdf10 2024-01-31T05:04:21.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.832+0000 7f5138c00640 1 --2- 172.21.15.49:0/1897932121 >> v2:172.21.15.195:3300/0 conn(0x7f51340ce610 0x7f5134071310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:04:21.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.836+0000 7f5133400640 1 --2- 172.21.15.49:0/1897932121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51340cdf10 0x7f5134070dd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f511c009870 tx=0x7f511c01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26166d7dfc83caca server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.836+0000 7f5132a00640 1 -- 172.21.15.49:0/1897932121 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c0a95f0 con 0x7f51340cdf10 2024-01-31T05:04:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.836+0000 7f5132a00640 1 -- 172.21.15.49:0/1897932121 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c0a9750 con 0x7f51340cdf10 2024-01-31T05:04:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.836+0000 7f5132a00640 1 -- 172.21.15.49:0/1897932121 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c0a9ae0 con 0x7f51340cdf10 2024-01-31T05:04:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.836+0000 7f513ac00640 1 -- 172.21.15.49:0/1897932121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51340cdf10 msgr2=0x7f5134070dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.836+0000 7f513ac00640 1 --2- 172.21.15.49:0/1897932121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51340cdf10 0x7f5134070dd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f511c009870 tx=0x7f511c01c510 comp rx=0 tx=0).stop 2024-01-31T05:04:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.836+0000 7f513ac00640 1 -- 172.21.15.49:0/1897932121 shutdown_connections 2024-01-31T05:04:21.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.836+0000 7f513ac00640 1 --2- 172.21.15.49:0/1897932121 >> v2:172.21.15.195:3300/0 conn(0x7f51340ce610 0x7f5134071310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.836+0000 7f513ac00640 1 --2- 172.21.15.49:0/1897932121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51340cdf10 0x7f5134070dd0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.836+0000 7f513ac00640 1 -- 172.21.15.49:0/1897932121 >> 172.21.15.49:0/1897932121 conn(0x7f51340b09a0 msgr2=0x7f51340b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:21.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.836+0000 7f513ac00640 1 -- 172.21.15.49:0/1897932121 shutdown_connections 2024-01-31T05:04:21.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.836+0000 7f513ac00640 1 -- 172.21.15.49:0/1897932121 wait complete. 2024-01-31T05:04:21.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f513ac00640 1 Processor -- start 2024-01-31T05:04:21.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f513ac00640 1 -- start start 2024-01-31T05:04:21.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f513ac00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51340cdf10 0x7f513409bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:21.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f513ac00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51340ce610 0x7f513409c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:21.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f513ac00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f513415b110 0x7f51340b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:21.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f513ac00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5134153150 con 0x7f51340cdf10 2024-01-31T05:04:21.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f513ac00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51341574f0 con 0x7f51340ce610 2024-01-31T05:04:21.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f513ac00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51341577d0 con 0x7f513415b110 2024-01-31T05:04:21.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f5133e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51340cdf10 0x7f513409bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:21.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f5133400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51340ce610 0x7f513409c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f5133e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51340cdf10 0x7f513409bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33970/0 (socket says 172.21.15.49:33970) 2024-01-31T05:04:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f5133e00640 1 -- 172.21.15.49:0/2607116622 learned_addr learned my addr 172.21.15.49:0/2607116622 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f5138c00640 1 --2- 172.21.15.49:0/2607116622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f513415b110 0x7f51340b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f5133e00640 1 -- 172.21.15.49:0/2607116622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f513415b110 msgr2=0x7f51340b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f5133e00640 1 --2- 172.21.15.49:0/2607116622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f513415b110 0x7f51340b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f5133e00640 1 -- 172.21.15.49:0/2607116622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51340ce610 msgr2=0x7f513409c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f5133e00640 1 --2- 172.21.15.49:0/2607116622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51340ce610 0x7f513409c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f5133e00640 1 -- 172.21.15.49:0/2607116622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c009a70 con 0x7f51340cdf10 2024-01-31T05:04:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f5133e00640 1 --2- 172.21.15.49:0/2607116622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51340cdf10 0x7f513409bb40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f512400c410 tx=0x7f512400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f512be00640 1 -- 172.21.15.49:0/2607116622 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51240054e0 con 0x7f51340cdf10 2024-01-31T05:04:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f512be00640 1 -- 172.21.15.49:0/2607116622 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5124003600 con 0x7f51340cdf10 2024-01-31T05:04:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f512be00640 1 -- 172.21.15.49:0/2607116622 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5124003990 con 0x7f51340cdf10 2024-01-31T05:04:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f513ac00640 1 -- 172.21.15.49:0/2607116622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511c0094d0 con 0x7f51340cdf10 2024-01-31T05:04:21.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f513ac00640 1 -- 172.21.15.49:0/2607116622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5134157d90 con 0x7f51340cdf10 2024-01-31T05:04:21.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.840+0000 7f513ac00640 1 -- 172.21.15.49:0/2607116622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5134153290 con 0x7f51340cdf10 2024-01-31T05:04:21.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.844+0000 7f512be00640 1 -- 172.21.15.49:0/2607116622 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f5124003af0 con 0x7f51340cdf10 2024-01-31T05:04:21.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.844+0000 7f512be00640 1 --2- 172.21.15.49:0/2607116622 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f510c066500 0x7f510c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:21.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.844+0000 7f512be00640 1 -- 172.21.15.49:0/2607116622 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f51240834b0 con 0x7f51340cdf10 2024-01-31T05:04:21.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.844+0000 7f5133400640 1 --2- 172.21.15.49:0/2607116622 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f510c066500 0x7f510c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:21.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.844+0000 7f5133400640 1 --2- 172.21.15.49:0/2607116622 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f510c066500 0x7f510c0689c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f511c009870 tx=0x7f511c0b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:21.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:21.848+0000 7f512be00640 1 -- 172.21.15.49:0/2607116622 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f5124050500 con 0x7f51340cdf10 2024-01-31T05:04:22.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.008+0000 7f513ac00640 1 -- 172.21.15.49:0/2607116622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f513415b4f0 con 0x7f51340cdf10 2024-01-31T05:04:22.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.008+0000 7f512be00640 1 -- 172.21.15.49:0/2607116622 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18323 (secure 0 0 0) 0x7f513415b4f0 con 0x7f51340cdf10 2024-01-31T05:04:22.009 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:22.009 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:20.695841+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:04:22.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.012+0000 7f513ac00640 1 -- 172.21.15.49:0/2607116622 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f510c066500 msgr2=0x7f510c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.012+0000 7f513ac00640 1 --2- 172.21.15.49:0/2607116622 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f510c066500 0x7f510c0689c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f511c009870 tx=0x7f511c0b3040 comp rx=0 tx=0).stop 2024-01-31T05:04:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.012+0000 7f513ac00640 1 -- 172.21.15.49:0/2607116622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51340cdf10 msgr2=0x7f513409bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.012+0000 7f513ac00640 1 --2- 172.21.15.49:0/2607116622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51340cdf10 0x7f513409bb40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f512400c410 tx=0x7f512400c810 comp rx=0 tx=0).stop 2024-01-31T05:04:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.012+0000 7f513ac00640 1 -- 172.21.15.49:0/2607116622 shutdown_connections 2024-01-31T05:04:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.012+0000 7f513ac00640 1 --2- 172.21.15.49:0/2607116622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f513415b110 0x7f51340b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.012+0000 7f513ac00640 1 --2- 172.21.15.49:0/2607116622 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f510c066500 0x7f510c0689c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.012+0000 7f513ac00640 1 --2- 172.21.15.49:0/2607116622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51340ce610 0x7f513409c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.012+0000 7f513ac00640 1 --2- 172.21.15.49:0/2607116622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51340cdf10 0x7f513409bb40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.012+0000 7f513ac00640 1 -- 172.21.15.49:0/2607116622 >> 172.21.15.49:0/2607116622 conn(0x7f51340b09a0 msgr2=0x7f51340b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:22.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.012+0000 7f513ac00640 1 -- 172.21.15.49:0/2607116622 shutdown_connections 2024-01-31T05:04:22.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.012+0000 7f513ac00640 1 -- 172.21.15.49:0/2607116622 wait complete. 2024-01-31T05:04:22.031 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:04:22.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.172+0000 7fa7b6600640 1 Processor -- start 2024-01-31T05:04:22.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.172+0000 7fa7b6600640 1 -- start start 2024-01-31T05:04:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.176+0000 7fa7b6600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa7b006c2d0 0x7fa7b00b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.176+0000 7fa7b6600640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b00703c0 con 0x7fa7b015e1c0 2024-01-31T05:04:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.176+0000 7fa7b6600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b00b1dd0 con 0x7fa7b00b30e0 2024-01-31T05:04:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.176+0000 7fa7b6600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b015e670 con 0x7fa7b006c2d0 2024-01-31T05:04:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.176+0000 7fa7aea00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa7b015e1c0 0x7fa7b00720e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34706/0 (socket says 172.21.15.49:34706) 2024-01-31T05:04:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.176+0000 7fa7aea00640 1 -- 172.21.15.49:0/3409475726 learned_addr learned my addr 172.21.15.49:0/3409475726 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.176+0000 7fa7afe00640 1 --2- 172.21.15.49:0/3409475726 >> v2:172.21.15.195:3300/0 conn(0x7fa7b006c2d0 0x7fa7b00b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.176+0000 7fa7ae000640 1 -- 172.21.15.49:0/3409475726 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384081407 0 0) 0x7fa7b00703c0 con 0x7fa7b015e1c0 2024-01-31T05:04:22.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.176+0000 7fa7ae000640 1 -- 172.21.15.49:0/3409475726 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa790003530 con 0x7fa7b015e1c0 2024-01-31T05:04:22.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.176+0000 7fa7afe00640 1 -- 172.21.15.49:0/3409475726 >> v1:172.21.15.195:6789/0 conn(0x7fa7b00b30e0 legacy=0x7fa7b00b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:22.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.176+0000 7fa7ae000640 1 -- 172.21.15.49:0/3409475726 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2039101247 0 0) 0x7fa790003530 con 0x7fa7b015e1c0 2024-01-31T05:04:22.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.176+0000 7fa7afe00640 1 -- 172.21.15.49:0/3409475726 >> v1:172.21.15.49:6789/0 conn(0x7fa7b015e1c0 legacy=0x7fa7b00720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:22.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.176+0000 7fa7afe00640 1 -- 172.21.15.49:0/3409475726 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b0070610 con 0x7fa7b006c2d0 2024-01-31T05:04:22.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.180+0000 7fa7afe00640 1 --2- 172.21.15.49:0/3409475726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7b006c2d0 0x7fa7b00b22b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8009d90 tx=0x7fa7a801c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9e33ab562bd9b03 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:22.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.180+0000 7fa7ae000640 1 -- 172.21.15.49:0/3409475726 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798001680 con 0x7fa7b006c2d0 2024-01-31T05:04:22.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.180+0000 7fa7ae000640 1 -- 172.21.15.49:0/3409475726 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a80a6510 con 0x7fa7b006c2d0 2024-01-31T05:04:22.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.180+0000 7fa7ae000640 1 -- 172.21.15.49:0/3409475726 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a80a68a0 con 0x7fa7b006c2d0 2024-01-31T05:04:22.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.180+0000 7fa7b6600640 1 -- 172.21.15.49:0/3409475726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7b006c2d0 msgr2=0x7fa7b00b22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:22.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.180+0000 7fa7b6600640 1 --2- 172.21.15.49:0/3409475726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7b006c2d0 0x7fa7b00b22b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8009d90 tx=0x7fa7a801c720 comp rx=0 tx=0).stop 2024-01-31T05:04:22.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.180+0000 7fa7b6600640 1 -- 172.21.15.49:0/3409475726 shutdown_connections 2024-01-31T05:04:22.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.180+0000 7fa7b6600640 1 --2- 172.21.15.49:0/3409475726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7b006c2d0 0x7fa7b00b22b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.180+0000 7fa7b6600640 1 -- 172.21.15.49:0/3409475726 >> 172.21.15.49:0/3409475726 conn(0x7fa7b00b09a0 msgr2=0x7fa7b00b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:22.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.180+0000 7fa7b6600640 1 -- 172.21.15.49:0/3409475726 shutdown_connections 2024-01-31T05:04:22.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.180+0000 7fa7b6600640 1 -- 172.21.15.49:0/3409475726 wait complete. 2024-01-31T05:04:22.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.180+0000 7fa7b6600640 1 Processor -- start 2024-01-31T05:04:22.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.180+0000 7fa7b6600640 1 -- start start 2024-01-31T05:04:22.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7b6600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7b006c2d0 0x7fa7b0144180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:22.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7b6600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b00b30e0 0x7fa7b0142640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:22.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7b6600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7b015e1c0 0x7fa7b0099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:22.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7b6600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b01455a0 con 0x7fa7b00b30e0 2024-01-31T05:04:22.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7b6600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b01446c0 con 0x7fa7b015e1c0 2024-01-31T05:04:22.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7b6600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b0144990 con 0x7fa7b006c2d0 2024-01-31T05:04:22.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7aea00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b00b30e0 0x7fa7b0142640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:22.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7aea00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b00b30e0 0x7fa7b0142640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33984/0 (socket says 172.21.15.49:33984) 2024-01-31T05:04:22.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7aea00640 1 -- 172.21.15.49:0/2563148147 learned_addr learned my addr 172.21.15.49:0/2563148147 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:22.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7afe00640 1 --2- 172.21.15.49:0/2563148147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7b015e1c0 0x7fa7b0099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:22.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7af400640 1 --2- 172.21.15.49:0/2563148147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7b006c2d0 0x7fa7b0144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:22.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7aea00640 1 -- 172.21.15.49:0/2563148147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7b006c2d0 msgr2=0x7fa7b0144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:22.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7aea00640 1 --2- 172.21.15.49:0/2563148147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7b006c2d0 0x7fa7b0144180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7aea00640 1 -- 172.21.15.49:0/2563148147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7b015e1c0 msgr2=0x7fa7b0099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:22.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7aea00640 1 --2- 172.21.15.49:0/2563148147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7b015e1c0 0x7fa7b0099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7aea00640 1 -- 172.21.15.49:0/2563148147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a8009a70 con 0x7fa7b00b30e0 2024-01-31T05:04:22.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7aea00640 1 --2- 172.21.15.49:0/2563148147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b00b30e0 0x7fa7b0142640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa7980011f0 tx=0x7fa79800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:22.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7a7400640 1 -- 172.21.15.49:0/2563148147 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798005ae0 con 0x7fa7b00b30e0 2024-01-31T05:04:22.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7a7400640 1 -- 172.21.15.49:0/2563148147 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa798005c40 con 0x7fa7b00b30e0 2024-01-31T05:04:22.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7a7400640 1 -- 172.21.15.49:0/2563148147 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7980072b0 con 0x7fa7b00b30e0 2024-01-31T05:04:22.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7b6600640 1 -- 172.21.15.49:0/2563148147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b0144c70 con 0x7fa7b00b30e0 2024-01-31T05:04:22.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7b6600640 1 -- 172.21.15.49:0/2563148147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b0145230 con 0x7fa7b00b30e0 2024-01-31T05:04:22.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7b6600640 1 -- 172.21.15.49:0/2563148147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b0074860 con 0x7fa7b00b30e0 2024-01-31T05:04:22.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.184+0000 7fa7a7400640 1 -- 172.21.15.49:0/2563148147 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa798007410 con 0x7fa7b00b30e0 2024-01-31T05:04:22.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.188+0000 7fa7a7400640 1 --2- 172.21.15.49:0/2563148147 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa788066500 0x7fa7880689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:22.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.188+0000 7fa7a7400640 1 -- 172.21.15.49:0/2563148147 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa7980838c0 con 0x7fa7b00b30e0 2024-01-31T05:04:22.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.188+0000 7fa7af400640 1 --2- 172.21.15.49:0/2563148147 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa788066500 0x7fa7880689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:22.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.188+0000 7fa7af400640 1 --2- 172.21.15.49:0/2563148147 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa788066500 0x7fa7880689c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0007fd0 tx=0x7fa7a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:22.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.192+0000 7fa7a7400640 1 -- 172.21.15.49:0/2563148147 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa798050880 con 0x7fa7b00b30e0 2024-01-31T05:04:22.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.356+0000 7fa7b6600640 1 -- 172.21.15.49:0/2563148147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7b0146240 con 0x7fa7b00b30e0 2024-01-31T05:04:22.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.356+0000 7fa7a7400640 1 -- 172.21.15.49:0/2563148147 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18323 (secure 0 0 0) 0x7fa798017090 con 0x7fa7b00b30e0 2024-01-31T05:04:22.357 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:22.357 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:20.695841+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:04:22.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.360+0000 7fa7b6600640 1 -- 172.21.15.49:0/2563148147 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa788066500 msgr2=0x7fa7880689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:22.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.360+0000 7fa7b6600640 1 --2- 172.21.15.49:0/2563148147 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa788066500 0x7fa7880689c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0007fd0 tx=0x7fa7a0009040 comp rx=0 tx=0).stop 2024-01-31T05:04:22.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.360+0000 7fa7b6600640 1 -- 172.21.15.49:0/2563148147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b00b30e0 msgr2=0x7fa7b0142640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:22.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.360+0000 7fa7b6600640 1 --2- 172.21.15.49:0/2563148147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b00b30e0 0x7fa7b0142640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa7980011f0 tx=0x7fa79800cbe0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.360+0000 7fa7b6600640 1 -- 172.21.15.49:0/2563148147 shutdown_connections 2024-01-31T05:04:22.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.360+0000 7fa7b6600640 1 --2- 172.21.15.49:0/2563148147 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa788066500 0x7fa7880689c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.360+0000 7fa7b6600640 1 --2- 172.21.15.49:0/2563148147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7b015e1c0 0x7fa7b0099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.360+0000 7fa7b6600640 1 --2- 172.21.15.49:0/2563148147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7b00b30e0 0x7fa7b0142640 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.360+0000 7fa7b6600640 1 --2- 172.21.15.49:0/2563148147 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7b006c2d0 0x7fa7b0144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.360+0000 7fa7b6600640 1 -- 172.21.15.49:0/2563148147 >> 172.21.15.49:0/2563148147 conn(0x7fa7b00b09a0 msgr2=0x7fa7b00b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:22.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.360+0000 7fa7b6600640 1 -- 172.21.15.49:0/2563148147 shutdown_connections 2024-01-31T05:04:22.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.360+0000 7fa7b6600640 1 -- 172.21.15.49:0/2563148147 wait complete. 2024-01-31T05:04:22.394 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:04:22.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.536+0000 7f7ca1400640 1 Processor -- start 2024-01-31T05:04:22.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.536+0000 7f7ca1400640 1 -- start start 2024-01-31T05:04:22.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.536+0000 7f7ca1400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c9c159790 0x7f7c9c0b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:22.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.536+0000 7f7ca1400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7c9c070d70 0x7f7c9c0ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:22.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.536+0000 7f7ca1400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9c159b70 con 0x7f7c9c0b3d00 2024-01-31T05:04:22.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.536+0000 7f7ca1400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9c0b2750 con 0x7f7c9c159790 2024-01-31T05:04:22.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.536+0000 7f7ca1400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9c0b2a30 con 0x7f7c9c070d70 2024-01-31T05:04:22.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.536+0000 7f7c9a800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c9c159790 0x7f7c9c0b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:22.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.536+0000 7f7c9a800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c9c159790 0x7f7c9c0b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33986/0 (socket says 172.21.15.49:33986) 2024-01-31T05:04:22.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.536+0000 7f7c9a800640 1 -- 172.21.15.49:0/379419204 learned_addr learned my addr 172.21.15.49:0/379419204 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:22.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.540+0000 7f7c9b200640 1 --2- 172.21.15.49:0/379419204 >> v2:172.21.15.195:3300/0 conn(0x7f7c9c070d70 0x7f7c9c0ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:22.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.540+0000 7f7c9a800640 1 -- 172.21.15.49:0/379419204 >> v2:172.21.15.195:3300/0 conn(0x7f7c9c070d70 msgr2=0x7f7c9c0ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:22.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.540+0000 7f7c9a800640 1 --2- 172.21.15.49:0/379419204 >> v2:172.21.15.195:3300/0 conn(0x7f7c9c070d70 0x7f7c9c0ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.540+0000 7f7c9a800640 1 -- 172.21.15.49:0/379419204 >> v1:172.21.15.195:6789/0 conn(0x7f7c9c0b3d00 legacy=0x7f7c9c070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:22.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.540+0000 7f7c9a800640 1 -- 172.21.15.49:0/379419204 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c0b2d10 con 0x7f7c9c159790 2024-01-31T05:04:22.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.540+0000 7f7c9a800640 1 --2- 172.21.15.49:0/379419204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c9c159790 0x7f7c9c0b37c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0719a0 tx=0x7f7c8c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e4d9f6b9b2ccb9 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:22.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.540+0000 7f7c99400640 1 -- 172.21.15.49:0/379419204 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c0ac620 con 0x7f7c9c159790 2024-01-31T05:04:22.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.540+0000 7f7c99400640 1 -- 172.21.15.49:0/379419204 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c0ac780 con 0x7f7c9c159790 2024-01-31T05:04:22.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.540+0000 7f7c99400640 1 -- 172.21.15.49:0/379419204 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c0acb10 con 0x7f7c9c159790 2024-01-31T05:04:22.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7ca1400640 1 -- 172.21.15.49:0/379419204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c9c159790 msgr2=0x7f7c9c0b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:22.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7ca1400640 1 --2- 172.21.15.49:0/379419204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c9c159790 0x7f7c9c0b37c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0719a0 tx=0x7f7c8c01c440 comp rx=0 tx=0).stop 2024-01-31T05:04:22.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7ca1400640 1 -- 172.21.15.49:0/379419204 shutdown_connections 2024-01-31T05:04:22.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7ca1400640 1 --2- 172.21.15.49:0/379419204 >> v2:172.21.15.195:3300/0 conn(0x7f7c9c070d70 0x7f7c9c0ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7ca1400640 1 --2- 172.21.15.49:0/379419204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c9c159790 0x7f7c9c0b37c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7ca1400640 1 -- 172.21.15.49:0/379419204 >> 172.21.15.49:0/379419204 conn(0x7f7c9c0b09a0 msgr2=0x7f7c9c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:22.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7ca1400640 1 -- 172.21.15.49:0/379419204 shutdown_connections 2024-01-31T05:04:22.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7ca1400640 1 -- 172.21.15.49:0/379419204 wait complete. 2024-01-31T05:04:22.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7ca1400640 1 Processor -- start 2024-01-31T05:04:22.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7ca1400640 1 -- start start 2024-01-31T05:04:22.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7ca1400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c9c070d70 0x7f7c9c15c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:22.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7ca1400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c9c0b3d00 0x7f7c9c1556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:22.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7ca1400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c9c159790 0x7f7c9c155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:22.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7ca1400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c15aa10 con 0x7f7c9c0b3d00 2024-01-31T05:04:22.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7ca1400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c15acb0 con 0x7f7c9c159790 2024-01-31T05:04:22.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7ca1400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c15af50 con 0x7f7c9c070d70 2024-01-31T05:04:22.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7c99e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c9c0b3d00 0x7f7c9c1556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:22.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7c99e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c9c0b3d00 0x7f7c9c1556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33996/0 (socket says 172.21.15.49:33996) 2024-01-31T05:04:22.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7c9a800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c9c070d70 0x7f7c9c15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:22.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7c99e00640 1 -- 172.21.15.49:0/4165261094 learned_addr learned my addr 172.21.15.49:0/4165261094 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:22.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.544+0000 7f7c9b200640 1 --2- 172.21.15.49:0/4165261094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c9c159790 0x7f7c9c155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:22.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.548+0000 7f7c99e00640 1 -- 172.21.15.49:0/4165261094 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c9c070d70 msgr2=0x7f7c9c15c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:22.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.548+0000 7f7c99e00640 1 --2- 172.21.15.49:0/4165261094 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c9c070d70 0x7f7c9c15c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.548+0000 7f7c99e00640 1 -- 172.21.15.49:0/4165261094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c9c159790 msgr2=0x7f7c9c155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:22.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.548+0000 7f7c99e00640 1 --2- 172.21.15.49:0/4165261094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c9c159790 0x7f7c9c155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.548+0000 7f7c99e00640 1 -- 172.21.15.49:0/4165261094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c0094d0 con 0x7f7c9c0b3d00 2024-01-31T05:04:22.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.548+0000 7f7c9a800640 1 --2- 172.21.15.49:0/4165261094 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c9c070d70 0x7f7c9c15c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:04:22.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.548+0000 7f7c9b200640 1 --2- 172.21.15.49:0/4165261094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c9c159790 0x7f7c9c155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:04:22.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.548+0000 7f7c99e00640 1 --2- 172.21.15.49:0/4165261094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c9c0b3d00 0x7f7c9c1556b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7c8400c420 tx=0x7f7c8400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:22.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.548+0000 7f7c92a00640 1 -- 172.21.15.49:0/4165261094 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c840052d0 con 0x7f7c9c0b3d00 2024-01-31T05:04:22.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.548+0000 7f7c92a00640 1 -- 172.21.15.49:0/4165261094 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c84005430 con 0x7f7c9c0b3d00 2024-01-31T05:04:22.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.548+0000 7f7ca1400640 1 -- 172.21.15.49:0/4165261094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9c15b230 con 0x7f7c9c0b3d00 2024-01-31T05:04:22.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.548+0000 7f7c92a00640 1 -- 172.21.15.49:0/4165261094 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c84007260 con 0x7f7c9c0b3d00 2024-01-31T05:04:22.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.548+0000 7f7ca1400640 1 -- 172.21.15.49:0/4165261094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9c15b7f0 con 0x7f7c9c0b3d00 2024-01-31T05:04:22.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.548+0000 7f7ca1400640 1 -- 172.21.15.49:0/4165261094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9c15b980 con 0x7f7c9c0b3d00 2024-01-31T05:04:22.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.548+0000 7f7c92a00640 1 -- 172.21.15.49:0/4165261094 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f7c840073c0 con 0x7f7c9c0b3d00 2024-01-31T05:04:22.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.548+0000 7f7c92a00640 1 --2- 172.21.15.49:0/4165261094 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7c74066500 0x7f7c740689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:22.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.548+0000 7f7c92a00640 1 -- 172.21.15.49:0/4165261094 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7c84083620 con 0x7f7c9c0b3d00 2024-01-31T05:04:22.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.552+0000 7f7c9a800640 1 --2- 172.21.15.49:0/4165261094 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7c74066500 0x7f7c740689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:22.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.552+0000 7f7c9a800640 1 --2- 172.21.15.49:0/4165261094 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7c74066500 0x7f7c740689c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c0ae000 tx=0x7f7c8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:22.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.556+0000 7f7c92a00640 1 -- 172.21.15.49:0/4165261094 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f7c84050550 con 0x7f7c9c0b3d00 2024-01-31T05:04:22.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.748+0000 7f7ca1400640 1 -- 172.21.15.49:0/4165261094 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c9c074860 con 0x7f7c9c0b3d00 2024-01-31T05:04:22.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.748+0000 7f7c92a00640 1 -- 172.21.15.49:0/4165261094 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4940 (secure 0 0 0) 0x7f7c84053b70 con 0x7f7c9c0b3d00 2024-01-31T05:04:22.750 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:22.750 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2308601440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2308601440},{"type":"v1","addr":"172.21.15.49:6835","nonce":2308601440}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2920530340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":2920530340},{"type":"v1","addr":"172.21.15.195:6836","nonce":2920530340}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3114317228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3114317228},{"type":"v1","addr":"172.21.15.195:6837","nonce":3114317228}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-31T05:04:16.248649+0000","modified":"2024-01-31T05:04:20.696004+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/4254852793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4254852793},{"type":"v1","addr":"172.21.15.49:6834","nonce":4254852793}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-31T05:04:22.750 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 7 2024-01-31T05:04:22.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.752+0000 7f7ca1400640 1 -- 172.21.15.49:0/4165261094 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7c74066500 msgr2=0x7f7c740689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:22.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.752+0000 7f7ca1400640 1 --2- 172.21.15.49:0/4165261094 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7c74066500 0x7f7c740689c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c0ae000 tx=0x7f7c8c008040 comp rx=0 tx=0).stop 2024-01-31T05:04:22.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.752+0000 7f7ca1400640 1 -- 172.21.15.49:0/4165261094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c9c0b3d00 msgr2=0x7f7c9c1556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:22.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.752+0000 7f7ca1400640 1 --2- 172.21.15.49:0/4165261094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c9c0b3d00 0x7f7c9c1556b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7c8400c420 tx=0x7f7c8400c8e0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.752+0000 7f7ca1400640 1 -- 172.21.15.49:0/4165261094 shutdown_connections 2024-01-31T05:04:22.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.752+0000 7f7ca1400640 1 --2- 172.21.15.49:0/4165261094 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7c74066500 0x7f7c740689c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.752+0000 7f7ca1400640 1 --2- 172.21.15.49:0/4165261094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c9c159790 0x7f7c9c155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.752+0000 7f7ca1400640 1 --2- 172.21.15.49:0/4165261094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c9c0b3d00 0x7f7c9c1556b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.752+0000 7f7ca1400640 1 --2- 172.21.15.49:0/4165261094 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c9c070d70 0x7f7c9c15c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.752+0000 7f7ca1400640 1 -- 172.21.15.49:0/4165261094 >> 172.21.15.49:0/4165261094 conn(0x7f7c9c0b09a0 msgr2=0x7f7c9c157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:22.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.752+0000 7f7ca1400640 1 -- 172.21.15.49:0/4165261094 shutdown_connections 2024-01-31T05:04:22.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.752+0000 7f7ca1400640 1 -- 172.21.15.49:0/4165261094 wait complete. 2024-01-31T05:04:22.771 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:04:22.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.912+0000 7f07b6000640 1 Processor -- start 2024-01-31T05:04:22.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.912+0000 7f07b6000640 1 -- start start 2024-01-31T05:04:22.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.912+0000 7f07b6000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f07b015b110 0x7f07b006c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:22.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.912+0000 7f07b6000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f07b00714e0 0x7f07b00ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:22.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.912+0000 7f07b6000640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b015b4f0 con 0x7f07b00cdf10 2024-01-31T05:04:22.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.912+0000 7f07b6000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b00ce460 con 0x7f07b00714e0 2024-01-31T05:04:22.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.912+0000 7f07b6000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b00abf20 con 0x7f07b015b110 2024-01-31T05:04:22.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.912+0000 7f07afe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f07b00714e0 0x7f07b00ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:22.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.912+0000 7f07aea00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f07b00cdf10 0x7f07b0070dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34720/0 (socket says 172.21.15.49:34720) 2024-01-31T05:04:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.912+0000 7f07aea00640 1 -- 172.21.15.49:0/3766686957 learned_addr learned my addr 172.21.15.49:0/3766686957 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.912+0000 7f07af400640 1 --2- 172.21.15.49:0/3766686957 >> v2:172.21.15.195:3300/0 conn(0x7f07b015b110 0x7f07b006c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.912+0000 7f07afe00640 1 -- 172.21.15.49:0/3766686957 >> v2:172.21.15.195:3300/0 conn(0x7f07b015b110 msgr2=0x7f07b006c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.912+0000 7f07afe00640 1 --2- 172.21.15.49:0/3766686957 >> v2:172.21.15.195:3300/0 conn(0x7f07b015b110 0x7f07b006c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.912+0000 7f07afe00640 1 -- 172.21.15.49:0/3766686957 >> v1:172.21.15.49:6789/0 conn(0x7f07b00cdf10 legacy=0x7f07b0070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.912+0000 7f07afe00640 1 -- 172.21.15.49:0/3766686957 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b00ac200 con 0x7f07b00714e0 2024-01-31T05:04:22.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.912+0000 7f07ae000640 1 -- 172.21.15.49:0/3766686957 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573184888 0 0) 0x7f0798001120 con 0x7f07b00cdf10 2024-01-31T05:04:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.916+0000 7f07afe00640 1 --2- 172.21.15.49:0/3766686957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07b00714e0 0x7f07b00ad800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07b00ae7e0 tx=0x7f07a801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8f3c16cb298273 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.916+0000 7f07ae000640 1 -- 172.21.15.49:0/3766686957 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a80a59c0 con 0x7f07b00714e0 2024-01-31T05:04:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.916+0000 7f07ae000640 1 -- 172.21.15.49:0/3766686957 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a80a5b20 con 0x7f07b00714e0 2024-01-31T05:04:22.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.916+0000 7f07ae000640 1 -- 172.21.15.49:0/3766686957 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a80ad440 con 0x7f07b00714e0 2024-01-31T05:04:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.916+0000 7f07b6000640 1 -- 172.21.15.49:0/3766686957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07b00714e0 msgr2=0x7f07b00ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.916+0000 7f07b6000640 1 --2- 172.21.15.49:0/3766686957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07b00714e0 0x7f07b00ad800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07b00ae7e0 tx=0x7f07a801c8e0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.916+0000 7f07b6000640 1 -- 172.21.15.49:0/3766686957 shutdown_connections 2024-01-31T05:04:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.916+0000 7f07b6000640 1 --2- 172.21.15.49:0/3766686957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07b00714e0 0x7f07b00ad800 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.916+0000 7f07b6000640 1 --2- 172.21.15.49:0/3766686957 >> v2:172.21.15.195:3300/0 conn(0x7f07b015b110 0x7f07b006c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.916+0000 7f07b6000640 1 -- 172.21.15.49:0/3766686957 >> 172.21.15.49:0/3766686957 conn(0x7f07b00b09a0 msgr2=0x7f07b00b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:22.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07b6000640 1 -- 172.21.15.49:0/3766686957 shutdown_connections 2024-01-31T05:04:22.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07b6000640 1 -- 172.21.15.49:0/3766686957 wait complete. 2024-01-31T05:04:22.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07b6000640 1 Processor -- start 2024-01-31T05:04:22.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07b6000640 1 -- start start 2024-01-31T05:04:22.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07b6000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07b00714e0 0x7f07b0165550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:22.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07b6000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07b00cdf10 0x7f07b0156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:22.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07b6000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07b015b110 0x7f07b01572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:22.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07b6000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b013ef50 con 0x7f07b00cdf10 2024-01-31T05:04:22.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07b6000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b0150270 con 0x7f07b00714e0 2024-01-31T05:04:22.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07b6000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b0165a90 con 0x7f07b015b110 2024-01-31T05:04:22.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07aea00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07b00cdf10 0x7f07b0156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:22.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07aea00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07b00cdf10 0x7f07b0156d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34018/0 (socket says 172.21.15.49:34018) 2024-01-31T05:04:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07aea00640 1 -- 172.21.15.49:0/3569395102 learned_addr learned my addr 172.21.15.49:0/3569395102 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07af400640 1 --2- 172.21.15.49:0/3569395102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07b00714e0 0x7f07b0165550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07afe00640 1 --2- 172.21.15.49:0/3569395102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07b015b110 0x7f07b01572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07aea00640 1 -- 172.21.15.49:0/3569395102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07b015b110 msgr2=0x7f07b01572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07aea00640 1 --2- 172.21.15.49:0/3569395102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07b015b110 0x7f07b01572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07aea00640 1 -- 172.21.15.49:0/3569395102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07b00714e0 msgr2=0x7f07b0165550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07aea00640 1 --2- 172.21.15.49:0/3569395102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07b00714e0 0x7f07b0165550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07aea00640 1 -- 172.21.15.49:0/3569395102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a8009a70 con 0x7f07b00cdf10 2024-01-31T05:04:22.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.920+0000 7f07aea00640 1 --2- 172.21.15.49:0/3569395102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07b00cdf10 0x7f07b0156d70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f079800c780 tx=0x7f079800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.924+0000 7f07a7400640 1 -- 172.21.15.49:0/3569395102 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07980072d0 con 0x7f07b00cdf10 2024-01-31T05:04:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.924+0000 7f07a7400640 1 -- 172.21.15.49:0/3569395102 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0798007450 con 0x7f07b00cdf10 2024-01-31T05:04:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.924+0000 7f07a7400640 1 -- 172.21.15.49:0/3569395102 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07980047f0 con 0x7f07b00cdf10 2024-01-31T05:04:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.924+0000 7f07b6000640 1 -- 172.21.15.49:0/3569395102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b0159b70 con 0x7f07b00cdf10 2024-01-31T05:04:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.924+0000 7f07b6000640 1 -- 172.21.15.49:0/3569395102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b01504c0 con 0x7f07b00cdf10 2024-01-31T05:04:22.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.924+0000 7f07b6000640 1 -- 172.21.15.49:0/3569395102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b0074860 con 0x7f07b00cdf10 2024-01-31T05:04:22.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.924+0000 7f07a7400640 1 -- 172.21.15.49:0/3569395102 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f0798004950 con 0x7f07b00cdf10 2024-01-31T05:04:22.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.924+0000 7f07a7400640 1 --2- 172.21.15.49:0/3569395102 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0788066500 0x7f07880689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:22.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.924+0000 7f07a7400640 1 -- 172.21.15.49:0/3569395102 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0798083260 con 0x7f07b00cdf10 2024-01-31T05:04:22.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.924+0000 7f07af400640 1 --2- 172.21.15.49:0/3569395102 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0788066500 0x7f07880689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:22.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.928+0000 7f07af400640 1 --2- 172.21.15.49:0/3569395102 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0788066500 0x7f07880689c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f07a0007a60 tx=0x7f07a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:22.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:22.928+0000 7f07a7400640 1 -- 172.21.15.49:0/3569395102 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f07980502b0 con 0x7f07b00cdf10 2024-01-31T05:04:23.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.096+0000 7f07b6000640 1 -- 172.21.15.49:0/3569395102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07b015b4f0 con 0x7f07b00cdf10 2024-01-31T05:04:23.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.096+0000 7f07a7400640 1 -- 172.21.15.49:0/3569395102 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18323 (secure 0 0 0) 0x7f07b015b4f0 con 0x7f07b00cdf10 2024-01-31T05:04:23.096 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:23.096 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:20.695841+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:04:23.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.096+0000 7f07b6000640 1 -- 172.21.15.49:0/3569395102 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0788066500 msgr2=0x7f07880689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:23.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.096+0000 7f07b6000640 1 --2- 172.21.15.49:0/3569395102 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0788066500 0x7f07880689c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f07a0007a60 tx=0x7f07a0008040 comp rx=0 tx=0).stop 2024-01-31T05:04:23.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.096+0000 7f07b6000640 1 -- 172.21.15.49:0/3569395102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07b00cdf10 msgr2=0x7f07b0156d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:23.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.096+0000 7f07b6000640 1 --2- 172.21.15.49:0/3569395102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07b00cdf10 0x7f07b0156d70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f079800c780 tx=0x7f079800cc40 comp rx=0 tx=0).stop 2024-01-31T05:04:23.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.096+0000 7f07b6000640 1 -- 172.21.15.49:0/3569395102 shutdown_connections 2024-01-31T05:04:23.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.096+0000 7f07b6000640 1 --2- 172.21.15.49:0/3569395102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07b015b110 0x7f07b01572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.096+0000 7f07b6000640 1 --2- 172.21.15.49:0/3569395102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07b00cdf10 0x7f07b0156d70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.096+0000 7f07b6000640 1 --2- 172.21.15.49:0/3569395102 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0788066500 0x7f07880689c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.096+0000 7f07b6000640 1 --2- 172.21.15.49:0/3569395102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07b00714e0 0x7f07b0165550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.096+0000 7f07b6000640 1 -- 172.21.15.49:0/3569395102 >> 172.21.15.49:0/3569395102 conn(0x7f07b00b09a0 msgr2=0x7f07b01526c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:23.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.100+0000 7f07b6000640 1 -- 172.21.15.49:0/3569395102 shutdown_connections 2024-01-31T05:04:23.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.100+0000 7f07b6000640 1 -- 172.21.15.49:0/3569395102 wait complete. 2024-01-31T05:04:23.520 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-31T05:04:16.248649+0000', 'modified': '2024-01-31T05:04:20.696004+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4269': {'gid': 4269, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6834/4254852793', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6832', 'nonce': 4254852793}, {'type': 'v1', 'addr': '172.21.15.49:6834', 'nonce': 4254852793}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-01-31T05:04:23.521 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-31T05:04:23.521 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-31T05:04:23.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.664+0000 7f2a14600640 1 Processor -- start 2024-01-31T05:04:23.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.664+0000 7f2a14600640 1 -- start start 2024-01-31T05:04:23.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.664+0000 7f2a14600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a0c15d3a0 0x7f2a0c06e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.664+0000 7f2a14600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2a0c06ee50 0x7f2a0c06f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.664+0000 7f2a14600640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a0c0cb990 con 0x7f2a0c0cd6d0 2024-01-31T05:04:23.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.664+0000 7f2a14600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0c0d1c20 con 0x7f2a0c06ee50 2024-01-31T05:04:23.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.664+0000 7f2a14600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c0cfed0 con 0x7f2a0c15d3a0 2024-01-31T05:04:23.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.664+0000 7f2a12600640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2a0c0cd6d0 0x7f2a0c0cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34732/0 (socket says 172.21.15.49:34732) 2024-01-31T05:04:23.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.664+0000 7f2a12600640 1 -- 172.21.15.49:0/693502037 learned_addr learned my addr 172.21.15.49:0/693502037 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:23.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.664+0000 7f2a11c00640 1 --2- 172.21.15.49:0/693502037 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a0c15d3a0 0x7f2a0c06e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.664+0000 7f2a11200640 1 --2- 172.21.15.49:0/693502037 >> v2:172.21.15.195:3300/0 conn(0x7f2a0c06ee50 0x7f2a0c06f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.668+0000 7f2a0be00640 1 -- 172.21.15.49:0/693502037 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082028530 0 0) 0x7f2a0c0cb990 con 0x7f2a0c0cd6d0 2024-01-31T05:04:23.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.668+0000 7f2a0be00640 1 -- 172.21.15.49:0/693502037 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29ec003530 con 0x7f2a0c0cd6d0 2024-01-31T05:04:23.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.668+0000 7f2a11c00640 1 -- 172.21.15.49:0/693502037 >> v2:172.21.15.195:3300/0 conn(0x7f2a0c06ee50 msgr2=0x7f2a0c06f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:23.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.668+0000 7f2a11c00640 1 --2- 172.21.15.49:0/693502037 >> v2:172.21.15.195:3300/0 conn(0x7f2a0c06ee50 0x7f2a0c06f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.668+0000 7f2a11c00640 1 -- 172.21.15.49:0/693502037 >> v1:172.21.15.49:6789/0 conn(0x7f2a0c0cd6d0 legacy=0x7f2a0c0cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:23.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.668+0000 7f2a0be00640 1 -- 172.21.15.49:0/693502037 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3901474379 0 0) 0x7f29ec003530 con 0x7f2a0c0cd6d0 2024-01-31T05:04:23.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.668+0000 7f2a11c00640 1 -- 172.21.15.49:0/693502037 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0c0d01b0 con 0x7f2a0c15d3a0 2024-01-31T05:04:23.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.668+0000 7f2a11200640 1 --2- 172.21.15.49:0/693502037 >> v2:172.21.15.195:3300/0 conn(0x7f2a0c06ee50 0x7f2a0c06f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:04:23.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.668+0000 7f2a11c00640 1 --2- 172.21.15.49:0/693502037 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a0c15d3a0 0x7f2a0c06e910 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0097c0 tx=0x7f29fc01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89899031a68f5b6e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:23.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.668+0000 7f2a0be00640 1 -- 172.21.15.49:0/693502037 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc0ad640 con 0x7f2a0c15d3a0 2024-01-31T05:04:23.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.668+0000 7f2a0be00640 1 -- 172.21.15.49:0/693502037 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc0ad7a0 con 0x7f2a0c15d3a0 2024-01-31T05:04:23.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.668+0000 7f2a0be00640 1 -- 172.21.15.49:0/693502037 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc0adb30 con 0x7f2a0c15d3a0 2024-01-31T05:04:23.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.672+0000 7f2a14600640 1 -- 172.21.15.49:0/693502037 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a0c15d3a0 msgr2=0x7f2a0c06e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:23.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.672+0000 7f2a14600640 1 --2- 172.21.15.49:0/693502037 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a0c15d3a0 0x7f2a0c06e910 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0097c0 tx=0x7f29fc01c480 comp rx=0 tx=0).stop 2024-01-31T05:04:23.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.672+0000 7f2a14600640 1 -- 172.21.15.49:0/693502037 shutdown_connections 2024-01-31T05:04:23.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.672+0000 7f2a14600640 1 --2- 172.21.15.49:0/693502037 >> v2:172.21.15.195:3300/0 conn(0x7f2a0c06ee50 0x7f2a0c06f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.672+0000 7f2a14600640 1 --2- 172.21.15.49:0/693502037 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a0c15d3a0 0x7f2a0c06e910 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.672+0000 7f2a14600640 1 -- 172.21.15.49:0/693502037 >> 172.21.15.49:0/693502037 conn(0x7f2a0c0d0e50 msgr2=0x7f2a0c0d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:23.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.672+0000 7f2a14600640 1 -- 172.21.15.49:0/693502037 shutdown_connections 2024-01-31T05:04:23.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.672+0000 7f2a14600640 1 -- 172.21.15.49:0/693502037 wait complete. 2024-01-31T05:04:23.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.672+0000 7f2a14600640 1 Processor -- start 2024-01-31T05:04:23.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.672+0000 7f2a14600640 1 -- start start 2024-01-31T05:04:23.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.672+0000 7f2a14600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a0c06ee50 0x7f2a0c15b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.672+0000 7f2a14600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a0c0cd6d0 0x7f2a0c15bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.672+0000 7f2a14600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a0c15d3a0 0x7f2a0c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.672+0000 7f2a14600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c155960 con 0x7f2a0c15d3a0 2024-01-31T05:04:23.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.672+0000 7f2a14600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c154de0 con 0x7f2a0c0cd6d0 2024-01-31T05:04:23.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.672+0000 7f2a14600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c1550c0 con 0x7f2a0c06ee50 2024-01-31T05:04:23.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.672+0000 7f2a12600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a0c15d3a0 0x7f2a0c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.672+0000 7f2a12600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a0c15d3a0 0x7f2a0c0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34034/0 (socket says 172.21.15.49:34034) 2024-01-31T05:04:23.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.672+0000 7f2a12600640 1 -- 172.21.15.49:0/3962788186 learned_addr learned my addr 172.21.15.49:0/3962788186 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:23.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.676+0000 7f2a11200640 1 --2- 172.21.15.49:0/3962788186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a0c0cd6d0 0x7f2a0c15bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.676+0000 7f2a11c00640 1 --2- 172.21.15.49:0/3962788186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a0c06ee50 0x7f2a0c15b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.676+0000 7f2a12600640 1 -- 172.21.15.49:0/3962788186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a0c06ee50 msgr2=0x7f2a0c15b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:23.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.676+0000 7f2a12600640 1 --2- 172.21.15.49:0/3962788186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a0c06ee50 0x7f2a0c15b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.676+0000 7f2a12600640 1 -- 172.21.15.49:0/3962788186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a0c0cd6d0 msgr2=0x7f2a0c15bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:23.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.676+0000 7f2a12600640 1 --2- 172.21.15.49:0/3962788186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a0c0cd6d0 0x7f2a0c15bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.676+0000 7f2a12600640 1 -- 172.21.15.49:0/3962788186 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f4009420 con 0x7f2a0c15d3a0 2024-01-31T05:04:23.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.676+0000 7f2a11200640 1 --2- 172.21.15.49:0/3962788186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a0c0cd6d0 0x7f2a0c15bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:23.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.676+0000 7f2a11c00640 1 --2- 172.21.15.49:0/3962788186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a0c06ee50 0x7f2a0c15b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:23.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.676+0000 7f2a12600640 1 --2- 172.21.15.49:0/3962788186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a0c15d3a0 0x7f2a0c0adf10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400cb10 tx=0x7f2a0400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:23.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.676+0000 7f2a09600640 1 -- 172.21.15.49:0/3962788186 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0400ac70 con 0x7f2a0c15d3a0 2024-01-31T05:04:23.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.676+0000 7f2a09600640 1 -- 172.21.15.49:0/3962788186 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0400adf0 con 0x7f2a0c15d3a0 2024-01-31T05:04:23.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.676+0000 7f2a14600640 1 -- 172.21.15.49:0/3962788186 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29fc009420 con 0x7f2a0c15d3a0 2024-01-31T05:04:23.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.676+0000 7f2a09600640 1 -- 172.21.15.49:0/3962788186 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a04012640 con 0x7f2a0c15d3a0 2024-01-31T05:04:23.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.676+0000 7f2a14600640 1 -- 172.21.15.49:0/3962788186 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a0c155680 con 0x7f2a0c15d3a0 2024-01-31T05:04:23.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.676+0000 7f2a09600640 1 -- 172.21.15.49:0/3962788186 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f2a040127a0 con 0x7f2a0c15d3a0 2024-01-31T05:04:23.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a09600640 1 --2- 172.21.15.49:0/3962788186 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f29e4066530 0x7f29e40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a09600640 1 -- 172.21.15.49:0/3962788186 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2a040847a0 con 0x7f2a0c15d3a0 2024-01-31T05:04:23.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a11c00640 1 --2- 172.21.15.49:0/3962788186 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f29e4066530 0x7f29e40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a17adf000 1 Processor -- start 2024-01-31T05:04:23.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a17adf000 1 -- start start 2024-01-31T05:04:23.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a11c00640 1 --2- 172.21.15.49:0/3962788186 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f29e4066530 0x7f29e40689f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0af000 tx=0x7f29fc0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:23.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a17adf000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 0x564fd9ca4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a17adf000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fd9ca48a0 0x564fd9c516d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a17adf000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564fd9c51c10 0x564fd9c51ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a17adf000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd9abb720 con 0x564fd9ca3f80 2024-01-31T05:04:23.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a17adf000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd9aa9d70 con 0x564fd9ca48a0 2024-01-31T05:04:23.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a17adf000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x564fd9aa72a0 con 0x564fd9c51c10 2024-01-31T05:04:23.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a11c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 0x564fd9ca4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a11c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 0x564fd9ca4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34040/0 (socket says 172.21.15.49:34040) 2024-01-31T05:04:23.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a11c00640 1 -- 172.21.15.49:0/838076577 learned_addr learned my addr 172.21.15.49:0/838076577 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:23.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a11200640 1 --2- 172.21.15.49:0/838076577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fd9ca48a0 0x564fd9c516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a12600640 1 --2- 172.21.15.49:0/838076577 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564fd9c51c10 0x564fd9c51ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a11c00640 1 -- 172.21.15.49:0/838076577 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564fd9c51c10 msgr2=0x564fd9c51ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:23.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a11c00640 1 --2- 172.21.15.49:0/838076577 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564fd9c51c10 0x564fd9c51ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a11c00640 1 -- 172.21.15.49:0/838076577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fd9ca48a0 msgr2=0x564fd9c516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:23.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a11c00640 1 --2- 172.21.15.49:0/838076577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fd9ca48a0 0x564fd9c516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a11c00640 1 -- 172.21.15.49:0/838076577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fd9799890 con 0x564fd9ca3f80 2024-01-31T05:04:23.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a11c00640 1 --2- 172.21.15.49:0/838076577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 0x564fd9ca4360 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f29fc01c960 tx=0x7f29fc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a14076d09bfac9 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:23.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a02000640 1 -- 172.21.15.49:0/838076577 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc0cc660 con 0x564fd9ca3f80 2024-01-31T05:04:23.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a02000640 1 -- 172.21.15.49:0/838076577 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc0a6040 con 0x564fd9ca3f80 2024-01-31T05:04:23.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.680+0000 7f2a02000640 1 -- 172.21.15.49:0/838076577 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc0cc9c0 con 0x564fd9ca3f80 2024-01-31T05:04:23.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a17adf000 1 -- 172.21.15.49:0/838076577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 msgr2=0x564fd9ca4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:23.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a17adf000 1 --2- 172.21.15.49:0/838076577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 0x564fd9ca4360 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f29fc01c960 tx=0x7f29fc004740 comp rx=0 tx=0).stop 2024-01-31T05:04:23.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a17adf000 1 -- 172.21.15.49:0/838076577 shutdown_connections 2024-01-31T05:04:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a17adf000 1 --2- 172.21.15.49:0/838076577 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564fd9c51c10 0x564fd9c51ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a17adf000 1 --2- 172.21.15.49:0/838076577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fd9ca48a0 0x564fd9c516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a17adf000 1 --2- 172.21.15.49:0/838076577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 0x564fd9ca4360 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a17adf000 1 -- 172.21.15.49:0/838076577 >> 172.21.15.49:0/838076577 conn(0x564fd9c57f80 msgr2=0x564fd9c4ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a17adf000 1 -- 172.21.15.49:0/838076577 shutdown_connections 2024-01-31T05:04:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a17adf000 1 -- 172.21.15.49:0/838076577 wait complete. 2024-01-31T05:04:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a17adf000 1 -- start start 2024-01-31T05:04:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a17adf000 1 Processor -- start 2024-01-31T05:04:23.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a17adf000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fd9c51c10 0x564fd9cab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a17adf000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 0x564fd9cab820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a17adf000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564fd9ca48a0 0x564fd9c64f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a17adf000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd9aa2b90 con 0x564fd9ca3f80 2024-01-31T05:04:23.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a17adf000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd9a5f4c0 con 0x564fd9c51c10 2024-01-31T05:04:23.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a17adf000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x564fd9a5de10 con 0x564fd9ca48a0 2024-01-31T05:04:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a17adf000 10 client.0 _ll_register_callbacks cb 0x564fd9a58be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:04:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a11200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 0x564fd9cab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a11200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 0x564fd9cab820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34050/0 (socket says 172.21.15.49:34050) 2024-01-31T05:04:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a11c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fd9c51c10 0x564fd9cab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a11200640 1 -- 172.21.15.49:0/2598818068 learned_addr learned my addr 172.21.15.49:0/2598818068 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a12600640 1 --2- 172.21.15.49:0/2598818068 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564fd9ca48a0 0x564fd9c64f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a11200640 1 -- 172.21.15.49:0/2598818068 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564fd9ca48a0 msgr2=0x564fd9c64f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a11200640 1 --2- 172.21.15.49:0/2598818068 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564fd9ca48a0 0x564fd9c64f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a11200640 1 -- 172.21.15.49:0/2598818068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fd9c51c10 msgr2=0x564fd9cab2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a11200640 1 --2- 172.21.15.49:0/2598818068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fd9c51c10 0x564fd9cab2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a11200640 1 -- 172.21.15.49:0/2598818068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a0c0d01b0 con 0x564fd9ca3f80 2024-01-31T05:04:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f2a11200640 1 --2- 172.21.15.49:0/2598818068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 0x564fd9cab820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f29f4014660 tx=0x7f29f4014b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205d6a2ea8572170 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f29faa00640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-31T05:04:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.684+0000 7f29faa00640 1 -- 172.21.15.49:0/2598818068 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f4004230 con 0x564fd9ca3f80 2024-01-31T05:04:23.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f29faa00640 1 -- 172.21.15.49:0/2598818068 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f29f401a030 con 0x564fd9ca3f80 2024-01-31T05:04:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 1 -- 172.21.15.49:0/2598818068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564fd9a28e30 con 0x564fd9ca3f80 2024-01-31T05:04:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f29faa00640 1 -- 172.21.15.49:0/2598818068 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29f4004390 con 0x564fd9ca3f80 2024-01-31T05:04:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 10 client.4419 fetch_fsmap learned FSMap version 7 2024-01-31T05:04:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 1 -- 172.21.15.49:0/2598818068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x564fd9a62b80 con 0x564fd9ca3f80 2024-01-31T05:04:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f29faa00640 1 -- 172.21.15.49:0/2598818068 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564fd9a28e30 con 0x564fd9ca3f80 2024-01-31T05:04:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f29faa00640 1 -- 172.21.15.49:0/2598818068 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f29f40128b0 con 0x564fd9ca3f80 2024-01-31T05:04:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 10 client.4419 fetch_fsmap finished waiting for FSMap version 7 2024-01-31T05:04:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 10 client.4419 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-31T05:04:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 20 client.4419 populate_metadata read hostname 'smithi049' 2024-01-31T05:04:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 1 --2- 172.21.15.49:0/2598818068 >> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] conn(0x564fd9c65ce0 0x564fd9c660c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 4 client.4419 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:04:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 1 -- 172.21.15.49:0/2598818068 --> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564fd9acfbd0 con 0x564fd9c65ce0 2024-01-31T05:04:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a11c00640 1 --2- 172.21.15.49:0/2598818068 >> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] conn(0x564fd9c65ce0 0x564fd9c660c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a11c00640 1 --2- 172.21.15.49:0/2598818068 >> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] conn(0x564fd9c65ce0 0x564fd9c660c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8ebea9b4d428063 server_cookie=2cfad759dcb5ff74 in_seq=0 out_seq=0 2024-01-31T05:04:23.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f29faa00640 10 client.4419 ms_handle_connect on v2:172.21.15.49:6832/4254852793 2024-01-31T05:04:23.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f29faa00640 1 -- 172.21.15.49:0/2598818068 <== mds.0 v2:172.21.15.49:6832/4254852793 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564fd9acfbd0 con 0x564fd9c65ce0 2024-01-31T05:04:23.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f29faa00640 10 client.4419 handle_command_reply: tid=0 2024-01-31T05:04:23.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 1 client.4419 shutdown 2024-01-31T05:04:23.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 1 -- 172.21.15.49:0/2598818068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 msgr2=0x564fd9cab820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:23.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 1 --2- 172.21.15.49:0/2598818068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 0x564fd9cab820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f29f4014660 tx=0x7f29f4014b20 comp rx=0 tx=0).stop 2024-01-31T05:04:23.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 1 -- 172.21.15.49:0/2598818068 shutdown_connections 2024-01-31T05:04:23.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 1 --2- 172.21.15.49:0/2598818068 >> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] conn(0x564fd9c65ce0 0x564fd9c660c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 1 --2- 172.21.15.49:0/2598818068 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564fd9ca48a0 0x564fd9c64f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 1 --2- 172.21.15.49:0/2598818068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 0x564fd9cab820 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 1 --2- 172.21.15.49:0/2598818068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fd9c51c10 0x564fd9cab2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f29faa00640 0 client.4419 ms_handle_reset on v2:172.21.15.49:6832/4254852793 2024-01-31T05:04:23.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 1 -- 172.21.15.49:0/2598818068 >> 172.21.15.49:0/2598818068 conn(0x564fd9c57f80 msgr2=0x564fd9c506c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:23.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 1 -- 172.21.15.49:0/2598818068 shutdown_connections 2024-01-31T05:04:23.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 1 -- 172.21.15.49:0/2598818068 wait complete. 2024-01-31T05:04:23.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.688+0000 7f2a17adf000 20 client.4419 trim_cache size 0 max 16384 2024-01-31T05:04:23.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.704+0000 7f2a17adf000 1 Processor -- start 2024-01-31T05:04:23.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.704+0000 7f2a17adf000 1 -- start start 2024-01-31T05:04:23.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fd9c51c10 0x564fd9cfffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 0x564fd9d004e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564fd9ca48a0 0x564fd9d00a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd975a940 con 0x564fd9ca3f80 2024-01-31T05:04:23.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd9c54a40 con 0x564fd9c51c10 2024-01-31T05:04:23.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x564fd9a9ce90 con 0x564fd9ca48a0 2024-01-31T05:04:23.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a11200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 0x564fd9d004e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a11200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 0x564fd9d004e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34060/0 (socket says 172.21.15.49:34060) 2024-01-31T05:04:23.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a11200640 1 -- 172.21.15.49:0/2761138335 learned_addr learned my addr 172.21.15.49:0/2761138335 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:23.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a11200640 1 -- 172.21.15.49:0/2761138335 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564fd9ca48a0 msgr2=0x564fd9d00a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:23.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a11200640 1 --2- 172.21.15.49:0/2761138335 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564fd9ca48a0 0x564fd9d00a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a11200640 1 -- 172.21.15.49:0/2761138335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fd9c51c10 msgr2=0x564fd9cfffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:23.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a11200640 1 --2- 172.21.15.49:0/2761138335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fd9c51c10 0x564fd9cfffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a11200640 1 -- 172.21.15.49:0/2761138335 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fd9caad60 con 0x564fd9ca3f80 2024-01-31T05:04:23.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a11200640 1 --2- 172.21.15.49:0/2761138335 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 0x564fd9d004e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f29f4014b60 tx=0x7f29f4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce1339cb683b8aa server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:23.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a01600640 1 -- 172.21.15.49:0/2761138335 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f40097a0 con 0x564fd9ca3f80 2024-01-31T05:04:23.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a01600640 1 -- 172.21.15.49:0/2761138335 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f40128b0 con 0x564fd9ca3f80 2024-01-31T05:04:23.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a01600640 1 -- 172.21.15.49:0/2761138335 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f402b680 con 0x564fd9ca3f80 2024-01-31T05:04:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 -- 172.21.15.49:0/2761138335 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 msgr2=0x564fd9d004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 --2- 172.21.15.49:0/2761138335 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 0x564fd9d004e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f29f4014b60 tx=0x7f29f4019000 comp rx=0 tx=0).stop 2024-01-31T05:04:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 -- 172.21.15.49:0/2761138335 shutdown_connections 2024-01-31T05:04:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 --2- 172.21.15.49:0/2761138335 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564fd9ca48a0 0x564fd9d00a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 --2- 172.21.15.49:0/2761138335 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9ca3f80 0x564fd9d004e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 --2- 172.21.15.49:0/2761138335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fd9c51c10 0x564fd9cfffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 -- 172.21.15.49:0/2761138335 >> 172.21.15.49:0/2761138335 conn(0x564fd9c57f80 msgr2=0x564fd9c55e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 -- 172.21.15.49:0/2761138335 shutdown_connections 2024-01-31T05:04:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 -- 172.21.15.49:0/2761138335 wait complete. 2024-01-31T05:04:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 -- start start 2024-01-31T05:04:23.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 Processor -- start 2024-01-31T05:04:23.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9c51c10 0x564fd9d04290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564fd9ca3f80 0x564fd9d047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fd9ca48a0 0x564fd9cbf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd9a54b40 con 0x564fd9c51c10 2024-01-31T05:04:23.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd9aaa7c0 con 0x564fd9ca48a0 2024-01-31T05:04:23.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x564fd9cbac00 con 0x564fd9ca3f80 2024-01-31T05:04:23.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.708+0000 7f2a17adf000 10 client.0 _ll_register_callbacks cb 0x564fd9a9c300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:04:23.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a11c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9c51c10 0x564fd9d04290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a11c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9c51c10 0x564fd9d04290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34064/0 (socket says 172.21.15.49:34064) 2024-01-31T05:04:23.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a11c00640 1 -- 172.21.15.49:0/376816217 learned_addr learned my addr 172.21.15.49:0/376816217 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:23.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a11c00640 1 -- 172.21.15.49:0/376816217 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564fd9ca3f80 msgr2=0x564fd9d047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:23.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a11c00640 1 --2- 172.21.15.49:0/376816217 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564fd9ca3f80 0x564fd9d047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a11c00640 1 -- 172.21.15.49:0/376816217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fd9ca48a0 msgr2=0x564fd9cbf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:23.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a11c00640 1 --2- 172.21.15.49:0/376816217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fd9ca48a0 0x564fd9cbf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a11c00640 1 -- 172.21.15.49:0/376816217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f4000e70 con 0x564fd9c51c10 2024-01-31T05:04:23.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a11c00640 1 --2- 172.21.15.49:0/376816217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9c51c10 0x564fd9d04290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f29fc01ab30 tx=0x7f29fc019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9eacd5c2553a9 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:23.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f29faa00640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-31T05:04:23.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f29faa00640 1 -- 172.21.15.49:0/376816217 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc0de070 con 0x564fd9c51c10 2024-01-31T05:04:23.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f29faa00640 1 -- 172.21.15.49:0/376816217 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f29fc0cc600 con 0x564fd9c51c10 2024-01-31T05:04:23.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 1 -- 172.21.15.49:0/376816217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564fd9a56640 con 0x564fd9c51c10 2024-01-31T05:04:23.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f29faa00640 1 -- 172.21.15.49:0/376816217 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29fc006e20 con 0x564fd9c51c10 2024-01-31T05:04:23.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 10 client.4425 fetch_fsmap learned FSMap version 7 2024-01-31T05:04:23.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 1 -- 172.21.15.49:0/376816217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x7f2a0c14c090 con 0x564fd9c51c10 2024-01-31T05:04:23.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f29faa00640 1 -- 172.21.15.49:0/376816217 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564fd9a56640 con 0x564fd9c51c10 2024-01-31T05:04:23.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f29faa00640 1 -- 172.21.15.49:0/376816217 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f29fc0bf070 con 0x564fd9c51c10 2024-01-31T05:04:23.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 10 client.4425 fetch_fsmap finished waiting for FSMap version 7 2024-01-31T05:04:23.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 10 client.4425 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-31T05:04:23.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 20 client.4425 populate_metadata read hostname 'smithi049' 2024-01-31T05:04:23.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 1 --2- 172.21.15.49:0/376816217 >> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] conn(0x564fd9cc0350 0x564fd9cc0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 4 client.4425 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-31T05:04:23.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 1 -- 172.21.15.49:0/376816217 --> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564fd9a9ba20 con 0x564fd9cc0350 2024-01-31T05:04:23.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a11200640 1 --2- 172.21.15.49:0/376816217 >> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] conn(0x564fd9cc0350 0x564fd9cc0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a11200640 1 --2- 172.21.15.49:0/376816217 >> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] conn(0x564fd9cc0350 0x564fd9cc0730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f281b9767b6b0aa4 server_cookie=dd5b5cfdbd024ef8 in_seq=0 out_seq=0 2024-01-31T05:04:23.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f29faa00640 10 client.4425 ms_handle_connect on v2:172.21.15.49:6832/4254852793 2024-01-31T05:04:23.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f29faa00640 1 -- 172.21.15.49:0/376816217 <== mds.0 v2:172.21.15.49:6832/4254852793 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x564fd9a9ba20 con 0x564fd9cc0350 2024-01-31T05:04:23.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f29faa00640 10 client.4425 handle_command_reply: tid=0 2024-01-31T05:04:23.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 1 client.4425 shutdown 2024-01-31T05:04:23.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 1 -- 172.21.15.49:0/376816217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9c51c10 msgr2=0x564fd9d04290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:23.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 1 --2- 172.21.15.49:0/376816217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9c51c10 0x564fd9d04290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f29fc01ab30 tx=0x7f29fc019220 comp rx=0 tx=0).stop 2024-01-31T05:04:23.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 1 -- 172.21.15.49:0/376816217 shutdown_connections 2024-01-31T05:04:23.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 1 --2- 172.21.15.49:0/376816217 >> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] conn(0x564fd9cc0350 0x564fd9cc0730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 1 --2- 172.21.15.49:0/376816217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fd9ca48a0 0x564fd9cbf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 1 --2- 172.21.15.49:0/376816217 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x564fd9ca3f80 0x564fd9d047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 1 --2- 172.21.15.49:0/376816217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564fd9c51c10 0x564fd9d04290 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f29faa00640 0 client.4425 ms_handle_reset on v2:172.21.15.49:6832/4254852793 2024-01-31T05:04:23.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 1 -- 172.21.15.49:0/376816217 >> 172.21.15.49:0/376816217 conn(0x564fd9c57f80 msgr2=0x564fd9c56720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:23.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 1 -- 172.21.15.49:0/376816217 shutdown_connections 2024-01-31T05:04:23.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 1 -- 172.21.15.49:0/376816217 wait complete. 2024-01-31T05:04:23.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.712+0000 7f2a17adf000 20 client.4425 trim_cache size 0 max 16384 2024-01-31T05:04:23.717 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-31T05:04:23.717 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "3d27a9c0-c28e-4304-958f-ef21a88f4ab5", 2024-01-31T05:04:23.717 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-31T05:04:23.718 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4269, 2024-01-31T05:04:23.718 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-31T05:04:23.718 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-31T05:04:23.718 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-31T05:04:23.718 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 6.8752768169999996, 2024-01-31T05:04:23.718 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 7, 2024-01-31T05:04:23.718 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 24, 2024-01-31T05:04:23.718 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 24, 2024-01-31T05:04:23.718 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 13.911562076999999 2024-01-31T05:04:23.718 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-31T05:04:23.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.716+0000 7f2a14600640 1 -- 172.21.15.49:0/3962788186 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f29e4066530 msgr2=0x7f29e40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:23.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.716+0000 7f2a14600640 1 --2- 172.21.15.49:0/3962788186 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f29e4066530 0x7f29e40689f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0af000 tx=0x7f29fc0a7070 comp rx=0 tx=0).stop 2024-01-31T05:04:23.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.716+0000 7f2a14600640 1 -- 172.21.15.49:0/3962788186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a0c15d3a0 msgr2=0x7f2a0c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:23.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.716+0000 7f2a14600640 1 --2- 172.21.15.49:0/3962788186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a0c15d3a0 0x7f2a0c0adf10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400cb10 tx=0x7f2a0400a060 comp rx=0 tx=0).stop 2024-01-31T05:04:23.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.716+0000 7f2a14600640 1 -- 172.21.15.49:0/3962788186 shutdown_connections 2024-01-31T05:04:23.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.716+0000 7f2a14600640 1 --2- 172.21.15.49:0/3962788186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a0c15d3a0 0x7f2a0c0adf10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.716+0000 7f2a14600640 1 --2- 172.21.15.49:0/3962788186 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f29e4066530 0x7f29e40689f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.716+0000 7f2a14600640 1 --2- 172.21.15.49:0/3962788186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a0c0cd6d0 0x7f2a0c15bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.716+0000 7f2a14600640 1 --2- 172.21.15.49:0/3962788186 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a0c06ee50 0x7f2a0c15b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.716+0000 7f2a14600640 1 -- 172.21.15.49:0/3962788186 >> 172.21.15.49:0/3962788186 conn(0x7f2a0c0d0e50 msgr2=0x7f2a0c06b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:23.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.716+0000 7f2a14600640 1 -- 172.21.15.49:0/3962788186 shutdown_connections 2024-01-31T05:04:23.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.716+0000 7f2a14600640 1 -- 172.21.15.49:0/3962788186 wait complete. 2024-01-31T05:04:23.734 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-31T05:04:23.734 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-31T05:04:23.735 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-31T05:04:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.876+0000 7fd1b2400640 1 Processor -- start 2024-01-31T05:04:23.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.876+0000 7fd1b2400640 1 -- start start 2024-01-31T05:04:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.880+0000 7fd1b2400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1ac15a000 0x7fd1ac0cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.880+0000 7fd1b2400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd1ac06c2d0 0x7fd1ac070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.880+0000 7fd1b2400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd1ac071410 0x7fd1ac0b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.880+0000 7fd1b2400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ac0b3760 con 0x7fd1ac071410 2024-01-31T05:04:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.880+0000 7fd1b2400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ac0718a0 con 0x7fd1ac06c2d0 2024-01-31T05:04:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.880+0000 7fd1b2400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac06c750 con 0x7fd1ac15a000 2024-01-31T05:04:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.880+0000 7fd1abe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd1ac071410 0x7fd1ac0b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.880+0000 7fd1abe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd1ac071410 0x7fd1ac0b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34068/0 (socket says 172.21.15.49:34068) 2024-01-31T05:04:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.880+0000 7fd1abe00640 1 -- 172.21.15.49:0/1435849073 learned_addr learned my addr 172.21.15.49:0/1435849073 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.880+0000 7fd1ab400640 1 --2- 172.21.15.49:0/1435849073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1ac15a000 0x7fd1ac0cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.880+0000 7fd1aaa00640 1 --2- 172.21.15.49:0/1435849073 >> v2:172.21.15.195:3300/0 conn(0x7fd1ac06c2d0 0x7fd1ac070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.880+0000 7fd1abe00640 1 -- 172.21.15.49:0/1435849073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1ac15a000 msgr2=0x7fd1ac0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.880+0000 7fd1abe00640 1 --2- 172.21.15.49:0/1435849073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1ac15a000 0x7fd1ac0cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.880+0000 7fd1abe00640 1 -- 172.21.15.49:0/1435849073 >> v2:172.21.15.195:3300/0 conn(0x7fd1ac06c2d0 msgr2=0x7fd1ac070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.880+0000 7fd1abe00640 1 --2- 172.21.15.49:0/1435849073 >> v2:172.21.15.195:3300/0 conn(0x7fd1ac06c2d0 0x7fd1ac070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.880+0000 7fd1abe00640 1 -- 172.21.15.49:0/1435849073 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac071e40 con 0x7fd1ac071410 2024-01-31T05:04:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.880+0000 7fd1aaa00640 1 --2- 172.21.15.49:0/1435849073 >> v2:172.21.15.195:3300/0 conn(0x7fd1ac06c2d0 0x7fd1ac070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:23.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.880+0000 7fd1abe00640 1 --2- 172.21.15.49:0/1435849073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1ac071410 0x7fd1ac0b1ca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac06b770 tx=0x7fd1a401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f2d7983488e440 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:23.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1aa000640 1 -- 172.21.15.49:0/1435849073 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a40a5740 con 0x7fd1ac071410 2024-01-31T05:04:23.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1aa000640 1 -- 172.21.15.49:0/1435849073 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a40a58a0 con 0x7fd1ac071410 2024-01-31T05:04:23.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1aa000640 1 -- 172.21.15.49:0/1435849073 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a40a5c30 con 0x7fd1ac071410 2024-01-31T05:04:23.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1b2400640 1 -- 172.21.15.49:0/1435849073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1ac071410 msgr2=0x7fd1ac0b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:23.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1b2400640 1 --2- 172.21.15.49:0/1435849073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1ac071410 0x7fd1ac0b1ca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac06b770 tx=0x7fd1a401c9d0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1b2400640 1 -- 172.21.15.49:0/1435849073 shutdown_connections 2024-01-31T05:04:23.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1b2400640 1 --2- 172.21.15.49:0/1435849073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1ac071410 0x7fd1ac0b1ca0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1b2400640 1 --2- 172.21.15.49:0/1435849073 >> v2:172.21.15.195:3300/0 conn(0x7fd1ac06c2d0 0x7fd1ac070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1b2400640 1 --2- 172.21.15.49:0/1435849073 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1ac15a000 0x7fd1ac0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1b2400640 1 -- 172.21.15.49:0/1435849073 >> 172.21.15.49:0/1435849073 conn(0x7fd1ac0b09a0 msgr2=0x7fd1ac0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:23.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1b2400640 1 -- 172.21.15.49:0/1435849073 shutdown_connections 2024-01-31T05:04:23.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1b2400640 1 -- 172.21.15.49:0/1435849073 wait complete. 2024-01-31T05:04:23.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1b2400640 1 Processor -- start 2024-01-31T05:04:23.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1b2400640 1 -- start start 2024-01-31T05:04:23.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1b2400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1ac06c2d0 0x7fd1ac14c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1b2400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1ac071410 0x7fd1ac15bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1b2400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1ac15a000 0x7fd1ac0ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1b2400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac1638e0 con 0x7fd1ac06c2d0 2024-01-31T05:04:23.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1b2400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac14cd20 con 0x7fd1ac071410 2024-01-31T05:04:23.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.884+0000 7fd1b2400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac162fb0 con 0x7fd1ac15a000 2024-01-31T05:04:23.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.888+0000 7fd1ab400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1ac06c2d0 0x7fd1ac14c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.888+0000 7fd1ab400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1ac06c2d0 0x7fd1ac14c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34076/0 (socket says 172.21.15.49:34076) 2024-01-31T05:04:23.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.888+0000 7fd1ab400640 1 -- 172.21.15.49:0/3092541446 learned_addr learned my addr 172.21.15.49:0/3092541446 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:23.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.888+0000 7fd1abe00640 1 --2- 172.21.15.49:0/3092541446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1ac15a000 0x7fd1ac0ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.888+0000 7fd1aaa00640 1 --2- 172.21.15.49:0/3092541446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1ac071410 0x7fd1ac15bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.888+0000 7fd1ab400640 1 -- 172.21.15.49:0/3092541446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1ac15a000 msgr2=0x7fd1ac0ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:23.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.888+0000 7fd1ab400640 1 --2- 172.21.15.49:0/3092541446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1ac15a000 0x7fd1ac0ace30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.888+0000 7fd1ab400640 1 -- 172.21.15.49:0/3092541446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1ac071410 msgr2=0x7fd1ac15bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:23.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.888+0000 7fd1ab400640 1 --2- 172.21.15.49:0/3092541446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1ac071410 0x7fd1ac15bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.888+0000 7fd1ab400640 1 -- 172.21.15.49:0/3092541446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a4009b30 con 0x7fd1ac06c2d0 2024-01-31T05:04:23.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.888+0000 7fd1ab400640 1 --2- 172.21.15.49:0/3092541446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1ac06c2d0 0x7fd1ac14c7e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00e870 tx=0x7fd19c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:23.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.888+0000 7fd1a3400640 1 -- 172.21.15.49:0/3092541446 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c009530 con 0x7fd1ac06c2d0 2024-01-31T05:04:23.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.888+0000 7fd1a3400640 1 -- 172.21.15.49:0/3092541446 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19c00c940 con 0x7fd1ac06c2d0 2024-01-31T05:04:23.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.888+0000 7fd1b2400640 1 -- 172.21.15.49:0/3092541446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ac163290 con 0x7fd1ac06c2d0 2024-01-31T05:04:23.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.888+0000 7fd1a3400640 1 -- 172.21.15.49:0/3092541446 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c00ccd0 con 0x7fd1ac06c2d0 2024-01-31T05:04:23.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.888+0000 7fd1b2400640 1 -- 172.21.15.49:0/3092541446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ac162c60 con 0x7fd1ac06c2d0 2024-01-31T05:04:23.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.888+0000 7fd1b2400640 1 -- 172.21.15.49:0/3092541446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ac074860 con 0x7fd1ac06c2d0 2024-01-31T05:04:23.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.888+0000 7fd1a3400640 1 -- 172.21.15.49:0/3092541446 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd19c013470 con 0x7fd1ac06c2d0 2024-01-31T05:04:23.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.892+0000 7fd1a3400640 1 --2- 172.21.15.49:0/3092541446 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd184066530 0x7fd1840689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.892+0000 7fd1a3400640 1 -- 172.21.15.49:0/3092541446 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd19c084220 con 0x7fd1ac06c2d0 2024-01-31T05:04:23.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.892+0000 7fd1aaa00640 1 --2- 172.21.15.49:0/3092541446 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd184066530 0x7fd1840689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.892+0000 7fd1aaa00640 1 --2- 172.21.15.49:0/3092541446 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd184066530 0x7fd1840689f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac164450 tx=0x7fd194008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:23.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:23.892+0000 7fd1a3400640 1 -- 172.21.15.49:0/3092541446 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd19c051270 con 0x7fd1ac06c2d0 2024-01-31T05:04:24.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:24.088+0000 7fd1b2400640 1 -- 172.21.15.49:0/3092541446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd1ac1579d0 con 0x7fd1ac06c2d0 2024-01-31T05:04:24.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:24.088+0000 7fd1a3400640 1 -- 172.21.15.49:0/3092541446 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd19c054890 con 0x7fd1ac06c2d0 2024-01-31T05:04:24.088 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-31T05:04:24.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:24.088+0000 7fd1b2400640 1 -- 172.21.15.49:0/3092541446 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd184066530 msgr2=0x7fd1840689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:24.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:24.088+0000 7fd1b2400640 1 --2- 172.21.15.49:0/3092541446 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd184066530 0x7fd1840689f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac164450 tx=0x7fd194008040 comp rx=0 tx=0).stop 2024-01-31T05:04:24.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:24.088+0000 7fd1b2400640 1 -- 172.21.15.49:0/3092541446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1ac06c2d0 msgr2=0x7fd1ac14c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:24.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:24.088+0000 7fd1b2400640 1 --2- 172.21.15.49:0/3092541446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1ac06c2d0 0x7fd1ac14c7e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00e870 tx=0x7fd19c00ed30 comp rx=0 tx=0).stop 2024-01-31T05:04:24.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:24.088+0000 7fd1b2400640 1 -- 172.21.15.49:0/3092541446 shutdown_connections 2024-01-31T05:04:24.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:24.088+0000 7fd1b2400640 1 --2- 172.21.15.49:0/3092541446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1ac15a000 0x7fd1ac0ace30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:24.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:24.088+0000 7fd1b2400640 1 --2- 172.21.15.49:0/3092541446 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd184066530 0x7fd1840689f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:24.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:24.088+0000 7fd1b2400640 1 --2- 172.21.15.49:0/3092541446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1ac071410 0x7fd1ac15bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:24.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:24.088+0000 7fd1b2400640 1 --2- 172.21.15.49:0/3092541446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1ac06c2d0 0x7fd1ac14c7e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:24.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:24.088+0000 7fd1b2400640 1 -- 172.21.15.49:0/3092541446 >> 172.21.15.49:0/3092541446 conn(0x7fd1ac0b09a0 msgr2=0x7fd1ac0b0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:24.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:24.088+0000 7fd1b2400640 1 -- 172.21.15.49:0/3092541446 shutdown_connections 2024-01-31T05:04:24.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:24.088+0000 7fd1b2400640 1 -- 172.21.15.49:0/3092541446 wait complete. 2024-01-31T05:04:24.110 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-31T05:04:24.110 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-31T05:04:24.110 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-31T05:04:24.110 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-01-31T05:04:24.110 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-31T05:04:24.110 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-31T05:04:24.110 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-31T05:04:24.110 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-31T05:04:24.110 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-01-31T05:04:24.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:24.111 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-31T05:04:24.120 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-31T05:04:24.120 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-31T05:04:24.120 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-31T05:04:24.120 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:24.120 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-31T05:04:24.120 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:24.121 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-31T05:04:24.121 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:24.121 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-31T05:04:24.121 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-31T05:04:24.121 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:24.121 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-31T05:04:24.121 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-31T05:04:24.121 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:24.121 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-31T05:04:24.121 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-31T05:04:24.121 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42496sec preferred_lft 42496sec 2024-01-31T05:04:24.121 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-31T05:04:24.121 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:24.121 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-31T05:04:24.121 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:24.121 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-31T05:04:24.122 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-31T05:04:24.122 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:b9:ff:e5:3e brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:24.122 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-31T05:04:24.122 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:24.122 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-31T05:04:24.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:24.122 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-31T05:04:24.122 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-31T05:04:24.123 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2024-01-31T05:04:24.123 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2024-01-31T05:04:24.123 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2024-01-31T05:04:24.123 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-31T05:04:24.123 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-31T05:04:24.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:24.235 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-31T05:04:24.253 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-31T05:04:24.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:24.256 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-31T05:04:24.321 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-31T05:04:24.321 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-31T05:04:24.321 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-31T05:04:24.321 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-31T05:04:24.321 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-31T05:04:24.321 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-31T05:04:24.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:24.322 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-31T05:04:24.322 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-31T05:04:24.322 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-31T05:04:24.322 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-31T05:04:24.322 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-31T05:04:24.322 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-31T05:04:24.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:24.417 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-31T05:04:24.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:24.427 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2024-01-31T05:04:24.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:24.483 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-31T05:04:24.483 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-31T05:04:24.483 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-31T05:04:24.483 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-01-31T05:04:24.483 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-31T05:04:24.566 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-01-31T05:04:24.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:24.567 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-31T05:04:24.567 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-31T05:04:24.567 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-01-31T05:04:24.567 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-31T05:04:24.567 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-01-31T05:04:24.567 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-01-31T05:04:24.567 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-01-31T05:04:24.567 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-31T05:04:24.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:24.732 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-31T05:04:24.732 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-31T05:04:24.732 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-01-31T05:04:24.732 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2024-01-31T05:04:24.732 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-31T05:04:24.772 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-01-31T05:04:24.773 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-31T05:04:24.773 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-01-31T05:04:24.826 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-01-31T05:04:24.826 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-31T05:04:24.826 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-01-31T05:04:24.877 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-01-31T05:04:24.939 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-01-31T05:04:24.991 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-01-31T05:04:24.992 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-01-31T05:04:24.992 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-01-31T05:04:24.992 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-01-31T05:04:24.992 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-01-31T05:04:24.992 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-01-31T05:04:24.992 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-01-31T05:04:24.992 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-01-31T05:04:24.992 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2024-01-31T05:04:24.992 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-01-31T05:04:24.992 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-01-31T05:04:24.992 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-01-31T05:04:24.992 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-01-31T05:04:24.992 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-01-31T05:04:24.993 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-01-31T05:04:24.993 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-01-31T05:04:24.993 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-01-31T05:04:24.993 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2024-01-31T05:04:24.993 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-01-31T05:04:24.993 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-01-31T05:04:24.993 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2024-01-31T05:04:24.993 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2024-01-31T05:04:24.993 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-01-31T05:04:24.993 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-01-31T05:04:24.993 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-01-31T05:04:24.993 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-01-31T05:04:24.993 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-01-31T05:04:24.993 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2024-01-31T05:04:24.993 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-01-31T05:04:24.993 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-31T05:04:24.994 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-31T05:04:24.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:24.994 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-01-31T05:04:25.050 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-31T05:04:25.050 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-01-31T05:04:25.097 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-01-31T05:04:25.118 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-01-31T05:04:25.173 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-01-31T05:04:25.173 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-01-31T05:04:25.173 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-01-31T05:04:25.173 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-01-31T05:04:25.173 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-01-31T05:04:25.173 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-01-31T05:04:25.173 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-01-31T05:04:25.173 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-01-31T05:04:25.173 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2024-01-31T05:04:25.174 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-01-31T05:04:25.174 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-01-31T05:04:25.174 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-01-31T05:04:25.174 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-01-31T05:04:25.174 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-01-31T05:04:25.174 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-01-31T05:04:25.174 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-01-31T05:04:25.174 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-01-31T05:04:25.174 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2024-01-31T05:04:25.174 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-01-31T05:04:25.174 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-01-31T05:04:25.174 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2024-01-31T05:04:25.174 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2024-01-31T05:04:25.174 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-01-31T05:04:25.175 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-01-31T05:04:25.175 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-01-31T05:04:25.175 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-01-31T05:04:25.175 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-01-31T05:04:25.175 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2024-01-31T05:04:25.175 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-01-31T05:04:25.175 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-31T05:04:25.175 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-31T05:04:25.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:25.176 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-01-31T05:04:25.201 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:2024-01-31T05:04:25.200+0000 7fac6a17e580 -1 init, newargv = 0x55f052574b10 newargc=15 2024-01-31T05:04:25.201 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:ceph-fuse[31968]: starting ceph client 2024-01-31T05:04:25.212 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:ceph-fuse[31968]: starting fuse 2024-01-31T05:04:26.312 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-01-31T05:04:26.336 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-01-31T05:04:26.393 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-01-31T05:04:26.393 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-01-31T05:04:26.393 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-01-31T05:04:26.393 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-01-31T05:04:26.393 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-01-31T05:04:26.393 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-01-31T05:04:26.393 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-01-31T05:04:26.394 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-01-31T05:04:26.394 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2024-01-31T05:04:26.394 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-01-31T05:04:26.394 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-01-31T05:04:26.394 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-01-31T05:04:26.394 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-01-31T05:04:26.394 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-01-31T05:04:26.394 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-01-31T05:04:26.394 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-01-31T05:04:26.394 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-01-31T05:04:26.394 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2024-01-31T05:04:26.394 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-01-31T05:04:26.394 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-01-31T05:04:26.394 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2024-01-31T05:04:26.394 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2024-01-31T05:04:26.395 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-01-31T05:04:26.395 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-01-31T05:04:26.395 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-01-31T05:04:26.395 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-01-31T05:04:26.395 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-01-31T05:04:26.395 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2024-01-31T05:04:26.395 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-01-31T05:04:26.395 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-31T05:04:26.395 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-31T05:04:26.395 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.admin 2024-01-31T05:04:26.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:26.399 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-01-31T05:04:26.447 INFO:teuthology.orchestra.run.smithi049.stdout:43 2024-01-31T05:04:26.447 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-31T05:04:26.447 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-01-31T05:04:26.448 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-01-31T05:04:26.448 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-01-31T05:04:26.448 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-01-31T05:04:26.448 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-01-31T05:04:26.448 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-31T05:04:26.448 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-01-31T05:04:26.448 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-01-31T05:04:26.448 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-01-31T05:04:26.448 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-01-31T05:04:26.448 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-31T05:04:26.448 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-01-31T05:04:26.448 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-01-31T05:04:26.448 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-01-31T05:04:26.448 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-01-31T05:04:26.448 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-31T05:04:26.448 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-01-31T05:04:26.449 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-31T05:04:26.449 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-31T05:04:26.449 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-31T05:04:26.449 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-01-31T05:04:26.449 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-01-31T05:04:26.449 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-01-31T05:04:26.449 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-31T05:04:26.449 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-31T05:04:26.449 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.admin")) 2024-01-31T05:04:26.449 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-01-31T05:04:26.582 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.admin.31968.asok 2024-01-31T05:04:26.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-31T05:04:26.594 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.31968.asok 2024-01-31T05:04:26.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:26.594 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.31968.asok status 2024-01-31T05:04:26.776 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-31T05:04:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-01-31T05:04:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "661946e7044723130c03627323f6a879a9848cb5", 2024-01-31T05:04:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev)", 2024-01-31T05:04:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "admin", 2024-01-31T05:04:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-01-31T05:04:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-01-31T05:04:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "31968", 2024-01-31T05:04:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-01-31T05:04:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:04:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-01-31T05:04:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-01-31T05:04:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4437, 2024-01-31T05:04:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-01-31T05:04:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-01-31T05:04:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-01-31T05:04:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 4437 2024-01-31T05:04:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:04:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-01-31T05:04:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-01-31T05:04:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-01-31T05:04:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 102532494 2024-01-31T05:04:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:04:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:04:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-01-31T05:04:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-01-31T05:04:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-01-31T05:04:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 102532494 2024-01-31T05:04:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:04:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.4437 192.168.0.1:0/102532494", 2024-01-31T05:04:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/102532494", 2024-01-31T05:04:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-01-31T05:04:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 7, 2024-01-31T05:04:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 24, 2024-01-31T05:04:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-01-31T05:04:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-01-31T05:04:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-01-31T05:04:26.778 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-31T05:04:26.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:26.791 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-01-31T05:04:26.791 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-01-31T05:04:26.801 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-01-31T05:04:26.801 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-01-31T05:04:26.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:26.801 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-01-31T05:04:26.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:26.862 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-01-31T05:04:26.940 INFO:teuthology.orchestra.run.smithi049.stdout:# file: . 2024-01-31T05:04:26.940 INFO:teuthology.orchestra.run.smithi049.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-01-31T05:04:26.940 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:26.941 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:04:26.941 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T05:04:26.991 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:04:27.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.172+0000 7f0146200640 1 Processor -- start 2024-01-31T05:04:27.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.172+0000 7f0146200640 1 -- start start 2024-01-31T05:04:27.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.176+0000 7f0146200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0140159790 0x7f01400b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:27.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.176+0000 7f0146200640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0140159b70 con 0x7f01400b3d00 2024-01-31T05:04:27.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.176+0000 7f0146200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01400b2750 con 0x7f0140070d70 2024-01-31T05:04:27.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.176+0000 7f0146200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01400b2a30 con 0x7f0140159790 2024-01-31T05:04:27.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.176+0000 7f013f400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0140159790 0x7f01400b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:27.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.176+0000 7f013ea00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f01400b3d00 0x7f0140070660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34742/0 (socket says 172.21.15.49:34742) 2024-01-31T05:04:27.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.176+0000 7f013ea00640 1 -- 172.21.15.49:0/1249218919 learned_addr learned my addr 172.21.15.49:0/1249218919 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:27.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.176+0000 7f013f400640 1 -- 172.21.15.49:0/1249218919 >> v1:172.21.15.195:6789/0 conn(0x7f0140070d70 legacy=0x7f01400ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:27.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.176+0000 7f013f400640 1 -- 172.21.15.49:0/1249218919 >> v1:172.21.15.49:6789/0 conn(0x7f01400b3d00 legacy=0x7f0140070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:27.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.176+0000 7f013f400640 1 -- 172.21.15.49:0/1249218919 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01400b2d10 con 0x7f0140159790 2024-01-31T05:04:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.180+0000 7f013f400640 1 --2- 172.21.15.49:0/1249218919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0140159790 0x7f01400b37c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f01300097c0 tx=0x7f013001d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578c17447e6827b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.180+0000 7f013e000640 1 -- 172.21.15.49:0/1249218919 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01300ac640 con 0x7f0140159790 2024-01-31T05:04:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.180+0000 7f013e000640 1 -- 172.21.15.49:0/1249218919 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01300a8070 con 0x7f0140159790 2024-01-31T05:04:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.180+0000 7f013e000640 1 -- 172.21.15.49:0/1249218919 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01300ac9c0 con 0x7f0140159790 2024-01-31T05:04:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.180+0000 7f0146200640 1 -- 172.21.15.49:0/1249218919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0140159790 msgr2=0x7f01400b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.180+0000 7f0146200640 1 --2- 172.21.15.49:0/1249218919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0140159790 0x7f01400b37c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f01300097c0 tx=0x7f013001d4d0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.180+0000 7f0146200640 1 -- 172.21.15.49:0/1249218919 shutdown_connections 2024-01-31T05:04:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.180+0000 7f0146200640 1 --2- 172.21.15.49:0/1249218919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0140159790 0x7f01400b37c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.180+0000 7f0146200640 1 -- 172.21.15.49:0/1249218919 >> 172.21.15.49:0/1249218919 conn(0x7f01400b09a0 msgr2=0x7f01400b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.180+0000 7f0146200640 1 -- 172.21.15.49:0/1249218919 shutdown_connections 2024-01-31T05:04:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.180+0000 7f0146200640 1 -- 172.21.15.49:0/1249218919 wait complete. 2024-01-31T05:04:27.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.180+0000 7f0146200640 1 Processor -- start 2024-01-31T05:04:27.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.180+0000 7f0146200640 1 -- start start 2024-01-31T05:04:27.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f0146200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0140070d70 0x7f014015a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:27.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f0146200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01400b3d00 0x7f0140143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:27.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f0146200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0140159790 0x7f01400af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:27.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f0146200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01400cb680 con 0x7f01400b3d00 2024-01-31T05:04:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f0146200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0140150e30 con 0x7f0140159790 2024-01-31T05:04:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f0146200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01400cb8b0 con 0x7f0140070d70 2024-01-31T05:04:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f013ea00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01400b3d00 0x7f0140143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f013ea00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01400b3d00 0x7f0140143600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34096/0 (socket says 172.21.15.49:34096) 2024-01-31T05:04:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f013ea00640 1 -- 172.21.15.49:0/2635118979 learned_addr learned my addr 172.21.15.49:0/2635118979 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f013f400640 1 --2- 172.21.15.49:0/2635118979 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0140070d70 0x7f014015a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f013fe00640 1 --2- 172.21.15.49:0/2635118979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0140159790 0x7f01400af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f013ea00640 1 -- 172.21.15.49:0/2635118979 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0140070d70 msgr2=0x7f014015a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f013ea00640 1 --2- 172.21.15.49:0/2635118979 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0140070d70 0x7f014015a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f013ea00640 1 -- 172.21.15.49:0/2635118979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0140159790 msgr2=0x7f01400af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f013ea00640 1 --2- 172.21.15.49:0/2635118979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0140159790 0x7f01400af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f013ea00640 1 -- 172.21.15.49:0/2635118979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0130009420 con 0x7f01400b3d00 2024-01-31T05:04:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f013ea00640 1 --2- 172.21.15.49:0/2635118979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01400b3d00 0x7f0140143600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f012800c500 tx=0x7f012800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:27.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f0137400640 1 -- 172.21.15.49:0/2635118979 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0128005cf0 con 0x7f01400b3d00 2024-01-31T05:04:27.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f0137400640 1 -- 172.21.15.49:0/2635118979 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0128005e50 con 0x7f01400b3d00 2024-01-31T05:04:27.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f0137400640 1 -- 172.21.15.49:0/2635118979 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01280072f0 con 0x7f01400b3d00 2024-01-31T05:04:27.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f0146200640 1 -- 172.21.15.49:0/2635118979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014015ac90 con 0x7f01400b3d00 2024-01-31T05:04:27.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f0146200640 1 -- 172.21.15.49:0/2635118979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014015b250 con 0x7f01400b3d00 2024-01-31T05:04:27.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f0146200640 1 -- 172.21.15.49:0/2635118979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0140074860 con 0x7f01400b3d00 2024-01-31T05:04:27.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.184+0000 7f0137400640 1 -- 172.21.15.49:0/2635118979 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f0128007450 con 0x7f01400b3d00 2024-01-31T05:04:27.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.188+0000 7f0137400640 1 --2- 172.21.15.49:0/2635118979 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0118066500 0x7f01180689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:27.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.188+0000 7f0137400640 1 -- 172.21.15.49:0/2635118979 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0128083640 con 0x7f01400b3d00 2024-01-31T05:04:27.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.188+0000 7f013f400640 1 --2- 172.21.15.49:0/2635118979 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0118066500 0x7f01180689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:27.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.188+0000 7f013f400640 1 --2- 172.21.15.49:0/2635118979 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0118066500 0x7f01180689c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f01300b0000 tx=0x7f0130008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:27.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.192+0000 7f0137400640 1 -- 172.21.15.49:0/2635118979 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f0128050690 con 0x7f01400b3d00 2024-01-31T05:04:27.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.356+0000 7f0146200640 1 -- 172.21.15.49:0/2635118979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01400ac0f0 con 0x7f01400b3d00 2024-01-31T05:04:27.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.356+0000 7f0137400640 1 -- 172.21.15.49:0/2635118979 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18323 (secure 0 0 0) 0x7f0128053cb0 con 0x7f01400b3d00 2024-01-31T05:04:27.356 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:27.356 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:20.695841+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:04:27.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.356+0000 7f0146200640 1 -- 172.21.15.49:0/2635118979 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0118066500 msgr2=0x7f01180689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:27.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.356+0000 7f0146200640 1 --2- 172.21.15.49:0/2635118979 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0118066500 0x7f01180689c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f01300b0000 tx=0x7f0130008040 comp rx=0 tx=0).stop 2024-01-31T05:04:27.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.356+0000 7f0146200640 1 -- 172.21.15.49:0/2635118979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01400b3d00 msgr2=0x7f0140143600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:27.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.356+0000 7f0146200640 1 --2- 172.21.15.49:0/2635118979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01400b3d00 0x7f0140143600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f012800c500 tx=0x7f012800c9c0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.356+0000 7f0146200640 1 -- 172.21.15.49:0/2635118979 shutdown_connections 2024-01-31T05:04:27.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.356+0000 7f0146200640 1 --2- 172.21.15.49:0/2635118979 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0118066500 0x7f01180689c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.356+0000 7f0146200640 1 --2- 172.21.15.49:0/2635118979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0140159790 0x7f01400af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.356+0000 7f0146200640 1 --2- 172.21.15.49:0/2635118979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01400b3d00 0x7f0140143600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.356+0000 7f0146200640 1 --2- 172.21.15.49:0/2635118979 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0140070d70 0x7f014015a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.356+0000 7f0146200640 1 -- 172.21.15.49:0/2635118979 >> 172.21.15.49:0/2635118979 conn(0x7f01400b09a0 msgr2=0x7f0140073e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:27.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.356+0000 7f0146200640 1 -- 172.21.15.49:0/2635118979 shutdown_connections 2024-01-31T05:04:27.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.356+0000 7f0146200640 1 -- 172.21.15.49:0/2635118979 wait complete. 2024-01-31T05:04:27.378 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:04:14.566345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:04:15.231265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-31T05:04:18.316756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-31T05:04:27.379 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:04:27.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.519+0000 7fad88e00640 1 Processor -- start 2024-01-31T05:04:27.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.523+0000 7fad88e00640 1 -- start start 2024-01-31T05:04:27.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.523+0000 7fad88e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fad840cfad0 0x7fad840cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:27.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.523+0000 7fad88e00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad840cff60 con 0x7fad8406c290 2024-01-31T05:04:27.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.523+0000 7fad88e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad8415d7e0 con 0x7fad8406ba90 2024-01-31T05:04:27.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.523+0000 7fad88e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad840d0470 con 0x7fad840cfad0 2024-01-31T05:04:27.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.523+0000 7fad81e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fad8406c290 0x7fad8406c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34744/0 (socket says 172.21.15.49:34744) 2024-01-31T05:04:27.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.523+0000 7fad81e00640 1 -- 172.21.15.49:0/2711282893 learned_addr learned my addr 172.21.15.49:0/2711282893 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:27.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.523+0000 7fad82800640 1 --2- 172.21.15.49:0/2711282893 >> v2:172.21.15.195:3300/0 conn(0x7fad840cfad0 0x7fad840cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:27.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.523+0000 7fad80a00640 1 -- 172.21.15.49:0/2711282893 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1101728724 0 0) 0x7fad840cff60 con 0x7fad8406c290 2024-01-31T05:04:27.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.523+0000 7fad80a00640 1 -- 172.21.15.49:0/2711282893 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad64003530 con 0x7fad8406c290 2024-01-31T05:04:27.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.523+0000 7fad80a00640 1 -- 172.21.15.49:0/2711282893 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932555160 0 0) 0x7fad8415d7e0 con 0x7fad8406ba90 2024-01-31T05:04:27.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.523+0000 7fad80a00640 1 -- 172.21.15.49:0/2711282893 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad840cff60 con 0x7fad8406ba90 2024-01-31T05:04:27.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.523+0000 7fad82800640 1 -- 172.21.15.49:0/2711282893 >> v1:172.21.15.195:6789/0 conn(0x7fad8406ba90 legacy=0x7fad840cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:27.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.523+0000 7fad82800640 1 -- 172.21.15.49:0/2711282893 >> v1:172.21.15.49:6789/0 conn(0x7fad8406c290 legacy=0x7fad8406c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:27.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.523+0000 7fad80a00640 1 -- 172.21.15.49:0/2711282893 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3259382915 0 0) 0x7fad64003530 con 0x7fad8406c290 2024-01-31T05:04:27.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.523+0000 7fad82800640 1 -- 172.21.15.49:0/2711282893 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad840d0190 con 0x7fad840cfad0 2024-01-31T05:04:27.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.527+0000 7fad82800640 1 --2- 172.21.15.49:0/2711282893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad840cfad0 0x7fad840cc690 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009d90 tx=0x7fad7c01c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3576f404d341d296 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:27.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.527+0000 7fad80a00640 1 -- 172.21.15.49:0/2711282893 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad74001680 con 0x7fad840cfad0 2024-01-31T05:04:27.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.527+0000 7fad80a00640 1 -- 172.21.15.49:0/2711282893 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c0a6510 con 0x7fad840cfad0 2024-01-31T05:04:27.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.527+0000 7fad80a00640 1 -- 172.21.15.49:0/2711282893 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c0a68a0 con 0x7fad840cfad0 2024-01-31T05:04:27.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.527+0000 7fad88e00640 1 -- 172.21.15.49:0/2711282893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad840cfad0 msgr2=0x7fad840cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:27.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.527+0000 7fad88e00640 1 --2- 172.21.15.49:0/2711282893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad840cfad0 0x7fad840cc690 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009d90 tx=0x7fad7c01c7b0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.527+0000 7fad88e00640 1 -- 172.21.15.49:0/2711282893 shutdown_connections 2024-01-31T05:04:27.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.527+0000 7fad88e00640 1 --2- 172.21.15.49:0/2711282893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad840cfad0 0x7fad840cc690 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.527+0000 7fad88e00640 1 -- 172.21.15.49:0/2711282893 >> 172.21.15.49:0/2711282893 conn(0x7fad840b28e0 msgr2=0x7fad840b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:27.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.527+0000 7fad88e00640 1 -- 172.21.15.49:0/2711282893 shutdown_connections 2024-01-31T05:04:27.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.527+0000 7fad88e00640 1 -- 172.21.15.49:0/2711282893 wait complete. 2024-01-31T05:04:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad88e00640 1 Processor -- start 2024-01-31T05:04:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad88e00640 1 -- start start 2024-01-31T05:04:27.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad88e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad8406ba90 0x7fad84152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:27.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad88e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad8406c290 0x7fad840ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:27.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad88e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad840cfad0 0x7fad840cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:27.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad88e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad840aeb30 con 0x7fad840cfad0 2024-01-31T05:04:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad88e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad840aee10 con 0x7fad8406ba90 2024-01-31T05:04:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad88e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad840af0f0 con 0x7fad8406c290 2024-01-31T05:04:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad82800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad840cfad0 0x7fad840cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad82800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad840cfad0 0x7fad840cdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34104/0 (socket says 172.21.15.49:34104) 2024-01-31T05:04:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad82800640 1 -- 172.21.15.49:0/1180859552 learned_addr learned my addr 172.21.15.49:0/1180859552 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad81e00640 1 --2- 172.21.15.49:0/1180859552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad8406ba90 0x7fad84152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad81400640 1 --2- 172.21.15.49:0/1180859552 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad8406c290 0x7fad840ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad82800640 1 -- 172.21.15.49:0/1180859552 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad8406c290 msgr2=0x7fad840ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad82800640 1 --2- 172.21.15.49:0/1180859552 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad8406c290 0x7fad840ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad82800640 1 -- 172.21.15.49:0/1180859552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad8406ba90 msgr2=0x7fad84152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad82800640 1 --2- 172.21.15.49:0/1180859552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad8406ba90 0x7fad84152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad82800640 1 -- 172.21.15.49:0/1180859552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7c009a70 con 0x7fad840cfad0 2024-01-31T05:04:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad81e00640 1 --2- 172.21.15.49:0/1180859552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad8406ba90 0x7fad84152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad82800640 1 --2- 172.21.15.49:0/1180859552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad840cfad0 0x7fad840cdb60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fad7c0b0040 tx=0x7fad7c019550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad7a000640 1 -- 172.21.15.49:0/1180859552 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c003ba0 con 0x7fad840cfad0 2024-01-31T05:04:27.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad7a000640 1 -- 172.21.15.49:0/1180859552 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c003d00 con 0x7fad840cfad0 2024-01-31T05:04:27.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad7a000640 1 -- 172.21.15.49:0/1180859552 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c004260 con 0x7fad840cfad0 2024-01-31T05:04:27.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad88e00640 1 -- 172.21.15.49:0/1180859552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad840af3d0 con 0x7fad840cfad0 2024-01-31T05:04:27.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad88e00640 1 -- 172.21.15.49:0/1180859552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad84152790 con 0x7fad840cfad0 2024-01-31T05:04:27.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.531+0000 7fad88e00640 1 -- 172.21.15.49:0/1180859552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad840af8f0 con 0x7fad840cfad0 2024-01-31T05:04:27.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.535+0000 7fad7a000640 1 -- 172.21.15.49:0/1180859552 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fad7c0043c0 con 0x7fad840cfad0 2024-01-31T05:04:27.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.535+0000 7fad7a000640 1 --2- 172.21.15.49:0/1180859552 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fad5c066500 0x7fad5c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:27.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.535+0000 7fad7a000640 1 -- 172.21.15.49:0/1180859552 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fad7c0aa070 con 0x7fad840cfad0 2024-01-31T05:04:27.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.535+0000 7fad81e00640 1 --2- 172.21.15.49:0/1180859552 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fad5c066500 0x7fad5c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:27.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.535+0000 7fad81e00640 1 --2- 172.21.15.49:0/1180859552 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fad5c066500 0x7fad5c0689c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fad74000fc0 tx=0x7fad74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.539+0000 7fad7a000640 1 -- 172.21.15.49:0/1180859552 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fad840af8f0 con 0x7fad840cfad0 2024-01-31T05:04:27.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.699+0000 7fad88e00640 1 -- 172.21.15.49:0/1180859552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad840af8f0 con 0x7fad840cfad0 2024-01-31T05:04:27.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.699+0000 7fad7a000640 1 -- 172.21.15.49:0/1180859552 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad840af8f0 con 0x7fad840cfad0 2024-01-31T05:04:27.700 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:04:27.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.699+0000 7fad88e00640 1 -- 172.21.15.49:0/1180859552 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fad5c066500 msgr2=0x7fad5c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:27.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.699+0000 7fad88e00640 1 --2- 172.21.15.49:0/1180859552 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fad5c066500 0x7fad5c0689c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fad74000fc0 tx=0x7fad74009040 comp rx=0 tx=0).stop 2024-01-31T05:04:27.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.699+0000 7fad88e00640 1 -- 172.21.15.49:0/1180859552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad840cfad0 msgr2=0x7fad840cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:27.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.699+0000 7fad88e00640 1 --2- 172.21.15.49:0/1180859552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad840cfad0 0x7fad840cdb60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fad7c0b0040 tx=0x7fad7c019550 comp rx=0 tx=0).stop 2024-01-31T05:04:27.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.699+0000 7fad88e00640 1 -- 172.21.15.49:0/1180859552 shutdown_connections 2024-01-31T05:04:27.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.699+0000 7fad88e00640 1 --2- 172.21.15.49:0/1180859552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad840cfad0 0x7fad840cdb60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.699+0000 7fad88e00640 1 --2- 172.21.15.49:0/1180859552 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad8406c290 0x7fad840ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.699+0000 7fad88e00640 1 --2- 172.21.15.49:0/1180859552 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fad5c066500 0x7fad5c0689c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.699+0000 7fad88e00640 1 --2- 172.21.15.49:0/1180859552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad8406ba90 0x7fad84152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.699+0000 7fad88e00640 1 -- 172.21.15.49:0/1180859552 >> 172.21.15.49:0/1180859552 conn(0x7fad840b28e0 msgr2=0x7fad840cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:27.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.699+0000 7fad88e00640 1 -- 172.21.15.49:0/1180859552 shutdown_connections 2024-01-31T05:04:27.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.699+0000 7fad88e00640 1 -- 172.21.15.49:0/1180859552 wait complete. 2024-01-31T05:04:27.721 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:04:27.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.863+0000 7fcec3000640 1 Processor -- start 2024-01-31T05:04:27.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.863+0000 7fcec3000640 1 -- start start 2024-01-31T05:04:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.867+0000 7fcec3000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcebc0cde80 0x7fcebc15cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.867+0000 7fcec3000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcebc0cf0f0 0x7fcebc15d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.867+0000 7fcec3000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcebc0cf660 con 0x7fcebc0cd0c0 2024-01-31T05:04:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.867+0000 7fcec3000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcebc0d02e0 con 0x7fcebc0cf0f0 2024-01-31T05:04:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.867+0000 7fcec3000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0cf940 con 0x7fcebc0cde80 2024-01-31T05:04:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.867+0000 7fcebb400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcebc0cde80 0x7fcebc15cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.867+0000 7fcebbe00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fcebc0cd0c0 0x7fcebc0cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:33880/0 (socket says 172.21.15.49:33880) 2024-01-31T05:04:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.867+0000 7fcec1000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcebc0cf0f0 0x7fcebc15d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.867+0000 7fcebbe00640 1 -- 172.21.15.49:0/3596076194 learned_addr learned my addr 172.21.15.49:0/3596076194 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.867+0000 7fcebaa00640 1 -- 172.21.15.49:0/3596076194 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3558746073 0 0) 0x7fcebc0cf660 con 0x7fcebc0cd0c0 2024-01-31T05:04:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.867+0000 7fcebaa00640 1 -- 172.21.15.49:0/3596076194 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce9c003530 con 0x7fcebc0cd0c0 2024-01-31T05:04:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.867+0000 7fcebb400640 1 -- 172.21.15.49:0/3596076194 >> v2:172.21.15.195:3300/0 conn(0x7fcebc0cf0f0 msgr2=0x7fcebc15d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.867+0000 7fcebb400640 1 --2- 172.21.15.49:0/3596076194 >> v2:172.21.15.195:3300/0 conn(0x7fcebc0cf0f0 0x7fcebc15d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.867+0000 7fcebb400640 1 -- 172.21.15.49:0/3596076194 >> v1:172.21.15.195:6789/0 conn(0x7fcebc0cd0c0 legacy=0x7fcebc0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.867+0000 7fcebb400640 1 -- 172.21.15.49:0/3596076194 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc0cfc20 con 0x7fcebc0cde80 2024-01-31T05:04:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.867+0000 7fcec1000640 1 --2- 172.21.15.49:0/3596076194 >> v2:172.21.15.195:3300/0 conn(0x7fcebc0cf0f0 0x7fcebc15d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:04:27.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.871+0000 7fcebb400640 1 --2- 172.21.15.49:0/3596076194 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcebc0cde80 0x7fcebc15cb60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcea40097c0 tx=0x7fcea401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aff5975b897454a1 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.871+0000 7fcebaa00640 1 -- 172.21.15.49:0/3596076194 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40ad660 con 0x7fcebc0cde80 2024-01-31T05:04:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.871+0000 7fcebaa00640 1 -- 172.21.15.49:0/3596076194 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea40ad7c0 con 0x7fcebc0cde80 2024-01-31T05:04:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.871+0000 7fcebaa00640 1 -- 172.21.15.49:0/3596076194 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40adb30 con 0x7fcebc0cde80 2024-01-31T05:04:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.871+0000 7fcec3000640 1 -- 172.21.15.49:0/3596076194 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcebc0cde80 msgr2=0x7fcebc15cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.871+0000 7fcec3000640 1 --2- 172.21.15.49:0/3596076194 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcebc0cde80 0x7fcebc15cb60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcea40097c0 tx=0x7fcea401c3c0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.871+0000 7fcec3000640 1 -- 172.21.15.49:0/3596076194 shutdown_connections 2024-01-31T05:04:27.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.871+0000 7fcec3000640 1 --2- 172.21.15.49:0/3596076194 >> v2:172.21.15.195:3300/0 conn(0x7fcebc0cf0f0 0x7fcebc15d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.871+0000 7fcec3000640 1 --2- 172.21.15.49:0/3596076194 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcebc0cde80 0x7fcebc15cb60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.871+0000 7fcec3000640 1 -- 172.21.15.49:0/3596076194 >> 172.21.15.49:0/3596076194 conn(0x7fcebc0d0ef0 msgr2=0x7fcebc0d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:27.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.871+0000 7fcec3000640 1 -- 172.21.15.49:0/3596076194 shutdown_connections 2024-01-31T05:04:27.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.871+0000 7fcec3000640 1 -- 172.21.15.49:0/3596076194 wait complete. 2024-01-31T05:04:27.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcec3000640 1 Processor -- start 2024-01-31T05:04:27.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcec3000640 1 -- start start 2024-01-31T05:04:27.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcec3000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcebc0cd0c0 0x7fcebc1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:27.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcec3000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcebc0cde80 0x7fcebc14a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:27.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcec3000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcebc0cf0f0 0x7fcebc155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:27.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcec3000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc14aae0 con 0x7fcebc0cde80 2024-01-31T05:04:27.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcec3000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0b5490 con 0x7fcebc0cf0f0 2024-01-31T05:04:27.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcec3000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc1547c0 con 0x7fcebc0cd0c0 2024-01-31T05:04:27.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcebb400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcebc0cde80 0x7fcebc14a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:27.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcebb400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcebc0cde80 0x7fcebc14a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34116/0 (socket says 172.21.15.49:34116) 2024-01-31T05:04:27.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcebb400640 1 -- 172.21.15.49:0/4030337413 learned_addr learned my addr 172.21.15.49:0/4030337413 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:27.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcec1000640 1 --2- 172.21.15.49:0/4030337413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcebc0cf0f0 0x7fcebc155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:27.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcebbe00640 1 --2- 172.21.15.49:0/4030337413 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcebc0cd0c0 0x7fcebc1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:27.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcebb400640 1 -- 172.21.15.49:0/4030337413 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcebc0cd0c0 msgr2=0x7fcebc1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:27.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcebb400640 1 --2- 172.21.15.49:0/4030337413 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcebc0cd0c0 0x7fcebc1561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcebb400640 1 -- 172.21.15.49:0/4030337413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcebc0cf0f0 msgr2=0x7fcebc155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:27.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcebb400640 1 --2- 172.21.15.49:0/4030337413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcebc0cf0f0 0x7fcebc155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:27.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcebb400640 1 -- 172.21.15.49:0/4030337413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb4009a70 con 0x7fcebc0cde80 2024-01-31T05:04:27.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcec1000640 1 --2- 172.21.15.49:0/4030337413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcebc0cf0f0 0x7fcebc155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:27.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcebb400640 1 --2- 172.21.15.49:0/4030337413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcebc0cde80 0x7fcebc14a5a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcea4000c10 tx=0x7fcea4019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:27.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fceb3e00640 1 -- 172.21.15.49:0/4030337413 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40adb30 con 0x7fcebc0cde80 2024-01-31T05:04:27.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fceb3e00640 1 -- 172.21.15.49:0/4030337413 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea40adc90 con 0x7fcebc0cde80 2024-01-31T05:04:27.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcec3000640 1 -- 172.21.15.49:0/4030337413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea4009420 con 0x7fcebc0cde80 2024-01-31T05:04:27.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fceb3e00640 1 -- 172.21.15.49:0/4030337413 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4003620 con 0x7fcebc0cde80 2024-01-31T05:04:27.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcec3000640 1 -- 172.21.15.49:0/4030337413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcebc154d40 con 0x7fcebc0cde80 2024-01-31T05:04:27.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.875+0000 7fcec3000640 1 -- 172.21.15.49:0/4030337413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcebc074860 con 0x7fcebc0cde80 2024-01-31T05:04:27.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.879+0000 7fceb3e00640 1 -- 172.21.15.49:0/4030337413 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fcea40b4040 con 0x7fcebc0cde80 2024-01-31T05:04:27.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.879+0000 7fceb3e00640 1 --2- 172.21.15.49:0/4030337413 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fce94066500 0x7fce940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:27.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.879+0000 7fceb3e00640 1 -- 172.21.15.49:0/4030337413 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcea411e460 con 0x7fcebc0cde80 2024-01-31T05:04:27.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.879+0000 7fcebbe00640 1 --2- 172.21.15.49:0/4030337413 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fce94066500 0x7fce940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:27.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.879+0000 7fcebbe00640 1 --2- 172.21.15.49:0/4030337413 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fce94066500 0x7fce940689c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fceac005890 tx=0x7fceac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:27.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:27.883+0000 7fceb3e00640 1 -- 172.21.15.49:0/4030337413 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fcea40eb490 con 0x7fcebc0cde80 2024-01-31T05:04:28.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.047+0000 7fcec3000640 1 -- 172.21.15.49:0/4030337413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcebc0b6e70 con 0x7fcebc0cde80 2024-01-31T05:04:28.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.047+0000 7fceb3e00640 1 -- 172.21.15.49:0/4030337413 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcea40eeab0 con 0x7fcebc0cde80 2024-01-31T05:04:28.048 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:04:28.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.047+0000 7fcec3000640 1 -- 172.21.15.49:0/4030337413 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fce94066500 msgr2=0x7fce940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:28.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.047+0000 7fcec3000640 1 --2- 172.21.15.49:0/4030337413 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fce94066500 0x7fce940689c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fceac005890 tx=0x7fceac009040 comp rx=0 tx=0).stop 2024-01-31T05:04:28.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.047+0000 7fcec3000640 1 -- 172.21.15.49:0/4030337413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcebc0cde80 msgr2=0x7fcebc14a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:28.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.047+0000 7fcec3000640 1 --2- 172.21.15.49:0/4030337413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcebc0cde80 0x7fcebc14a5a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcea4000c10 tx=0x7fcea4019160 comp rx=0 tx=0).stop 2024-01-31T05:04:28.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.047+0000 7fcec3000640 1 -- 172.21.15.49:0/4030337413 shutdown_connections 2024-01-31T05:04:28.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.047+0000 7fcec3000640 1 --2- 172.21.15.49:0/4030337413 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fce94066500 0x7fce940689c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.047+0000 7fcec3000640 1 --2- 172.21.15.49:0/4030337413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcebc0cf0f0 0x7fcebc155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.047+0000 7fcec3000640 1 --2- 172.21.15.49:0/4030337413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcebc0cde80 0x7fcebc14a5a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.047+0000 7fcec3000640 1 --2- 172.21.15.49:0/4030337413 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcebc0cd0c0 0x7fcebc1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.047+0000 7fcec3000640 1 -- 172.21.15.49:0/4030337413 >> 172.21.15.49:0/4030337413 conn(0x7fcebc0d0ef0 msgr2=0x7fcebc0af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:28.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.047+0000 7fcec3000640 1 -- 172.21.15.49:0/4030337413 shutdown_connections 2024-01-31T05:04:28.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.047+0000 7fcec3000640 1 -- 172.21.15.49:0/4030337413 wait complete. 2024-01-31T05:04:28.070 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:04:28.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.211+0000 7fa344a00640 1 Processor -- start 2024-01-31T05:04:28.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.211+0000 7fa344a00640 1 -- start start 2024-01-31T05:04:28.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.215+0000 7fa344a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa33c159790 0x7fa33c0b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:28.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.215+0000 7fa344a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa33c070d70 0x7fa33c0ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:28.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.215+0000 7fa344a00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33c159b70 con 0x7fa33c0b3d00 2024-01-31T05:04:28.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.215+0000 7fa344a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa33c0b2750 con 0x7fa33c159790 2024-01-31T05:04:28.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.215+0000 7fa344a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c0b2a30 con 0x7fa33c070d70 2024-01-31T05:04:28.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.215+0000 7fa341600640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa33c0b3d00 0x7fa33c070660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34750/0 (socket says 172.21.15.49:34750) 2024-01-31T05:04:28.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.215+0000 7fa341600640 1 -- 172.21.15.49:0/3706916954 learned_addr learned my addr 172.21.15.49:0/3706916954 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:28.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.215+0000 7fa342a00640 1 --2- 172.21.15.49:0/3706916954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa33c070d70 0x7fa33c0ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:28.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.215+0000 7fa342000640 1 --2- 172.21.15.49:0/3706916954 >> v2:172.21.15.195:3300/0 conn(0x7fa33c159790 0x7fa33c0b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:28.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.215+0000 7fa340c00640 1 -- 172.21.15.49:0/3706916954 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057846380 0 0) 0x7fa33c159b70 con 0x7fa33c0b3d00 2024-01-31T05:04:28.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.215+0000 7fa340c00640 1 -- 172.21.15.49:0/3706916954 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa31c003530 con 0x7fa33c0b3d00 2024-01-31T05:04:28.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.215+0000 7fa342a00640 1 -- 172.21.15.49:0/3706916954 >> v2:172.21.15.195:3300/0 conn(0x7fa33c159790 msgr2=0x7fa33c0b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:28.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.215+0000 7fa340c00640 1 -- 172.21.15.49:0/3706916954 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2726751638 0 0) 0x7fa31c003530 con 0x7fa33c0b3d00 2024-01-31T05:04:28.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.215+0000 7fa342a00640 1 --2- 172.21.15.49:0/3706916954 >> v2:172.21.15.195:3300/0 conn(0x7fa33c159790 0x7fa33c0b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.215+0000 7fa342a00640 1 -- 172.21.15.49:0/3706916954 >> v1:172.21.15.49:6789/0 conn(0x7fa33c0b3d00 legacy=0x7fa33c070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:28.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.215+0000 7fa342a00640 1 -- 172.21.15.49:0/3706916954 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33c0b2d10 con 0x7fa33c070d70 2024-01-31T05:04:28.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.219+0000 7fa342a00640 1 --2- 172.21.15.49:0/3706916954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa33c070d70 0x7fa33c0ac050 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa334009d90 tx=0x7fa33401c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d86ebc3d3a5950c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:28.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.219+0000 7fa340c00640 1 -- 172.21.15.49:0/3706916954 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3240016a0 con 0x7fa33c070d70 2024-01-31T05:04:28.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.219+0000 7fa340c00640 1 -- 172.21.15.49:0/3706916954 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3340a64c0 con 0x7fa33c070d70 2024-01-31T05:04:28.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.219+0000 7fa340c00640 1 -- 172.21.15.49:0/3706916954 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3340a6850 con 0x7fa33c070d70 2024-01-31T05:04:28.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.219+0000 7fa344a00640 1 -- 172.21.15.49:0/3706916954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa33c070d70 msgr2=0x7fa33c0ac050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:28.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.219+0000 7fa344a00640 1 --2- 172.21.15.49:0/3706916954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa33c070d70 0x7fa33c0ac050 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa334009d90 tx=0x7fa33401c840 comp rx=0 tx=0).stop 2024-01-31T05:04:28.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.219+0000 7fa344a00640 1 -- 172.21.15.49:0/3706916954 shutdown_connections 2024-01-31T05:04:28.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.219+0000 7fa344a00640 1 --2- 172.21.15.49:0/3706916954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa33c070d70 0x7fa33c0ac050 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.219+0000 7fa344a00640 1 --2- 172.21.15.49:0/3706916954 >> v2:172.21.15.195:3300/0 conn(0x7fa33c159790 0x7fa33c0b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.219+0000 7fa344a00640 1 -- 172.21.15.49:0/3706916954 >> 172.21.15.49:0/3706916954 conn(0x7fa33c0b09a0 msgr2=0x7fa33c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:28.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.219+0000 7fa344a00640 1 -- 172.21.15.49:0/3706916954 shutdown_connections 2024-01-31T05:04:28.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.219+0000 7fa344a00640 1 -- 172.21.15.49:0/3706916954 wait complete. 2024-01-31T05:04:28.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.219+0000 7fa344a00640 1 Processor -- start 2024-01-31T05:04:28.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.219+0000 7fa344a00640 1 -- start start 2024-01-31T05:04:28.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa344a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa33c070d70 0x7fa33c167c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:28.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa344a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa33c0b3d00 0x7fa33c166e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:28.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa344a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa33c159790 0x7fa33c14b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:28.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa344a00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c0c9e40 con 0x7fa33c0b3d00 2024-01-31T05:04:28.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa344a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c14fd90 con 0x7fa33c070d70 2024-01-31T05:04:28.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa344a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c150070 con 0x7fa33c159790 2024-01-31T05:04:28.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa341600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa33c0b3d00 0x7fa33c166e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:28.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa341600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa33c0b3d00 0x7fa33c166e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34126/0 (socket says 172.21.15.49:34126) 2024-01-31T05:04:28.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa341600640 1 -- 172.21.15.49:0/2288664860 learned_addr learned my addr 172.21.15.49:0/2288664860 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:28.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa342000640 1 --2- 172.21.15.49:0/2288664860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa33c070d70 0x7fa33c167c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:28.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa342a00640 1 --2- 172.21.15.49:0/2288664860 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa33c159790 0x7fa33c14b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:28.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa341600640 1 -- 172.21.15.49:0/2288664860 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa33c159790 msgr2=0x7fa33c14b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:28.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa341600640 1 --2- 172.21.15.49:0/2288664860 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa33c159790 0x7fa33c14b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa341600640 1 -- 172.21.15.49:0/2288664860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa33c070d70 msgr2=0x7fa33c167c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:28.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa341600640 1 --2- 172.21.15.49:0/2288664860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa33c070d70 0x7fa33c167c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa341600640 1 -- 172.21.15.49:0/2288664860 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa334009a70 con 0x7fa33c0b3d00 2024-01-31T05:04:28.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa342000640 1 --2- 172.21.15.49:0/2288664860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa33c070d70 0x7fa33c167c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:28.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa341600640 1 --2- 172.21.15.49:0/2288664860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa33c0b3d00 0x7fa33c166e00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa324007fd0 tx=0x7fa32400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:28.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa33a000640 1 -- 172.21.15.49:0/2288664860 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3240072d0 con 0x7fa33c0b3d00 2024-01-31T05:04:28.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa33a000640 1 -- 172.21.15.49:0/2288664860 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa324007450 con 0x7fa33c0b3d00 2024-01-31T05:04:28.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa33a000640 1 -- 172.21.15.49:0/2288664860 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3240047f0 con 0x7fa33c0b3d00 2024-01-31T05:04:28.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa344a00640 1 -- 172.21.15.49:0/2288664860 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33c150350 con 0x7fa33c0b3d00 2024-01-31T05:04:28.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa344a00640 1 -- 172.21.15.49:0/2288664860 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33c168180 con 0x7fa33c0b3d00 2024-01-31T05:04:28.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.223+0000 7fa344a00640 1 -- 172.21.15.49:0/2288664860 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33c074860 con 0x7fa33c0b3d00 2024-01-31T05:04:28.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.227+0000 7fa33a000640 1 -- 172.21.15.49:0/2288664860 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa324004950 con 0x7fa33c0b3d00 2024-01-31T05:04:28.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.227+0000 7fa33a000640 1 --2- 172.21.15.49:0/2288664860 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa314066500 0x7fa3140689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:28.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.227+0000 7fa33a000640 1 -- 172.21.15.49:0/2288664860 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa324083490 con 0x7fa33c0b3d00 2024-01-31T05:04:28.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.227+0000 7fa342000640 1 --2- 172.21.15.49:0/2288664860 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa314066500 0x7fa3140689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:28.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.227+0000 7fa342000640 1 --2- 172.21.15.49:0/2288664860 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa314066500 0x7fa3140689c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009b10 tx=0x7fa32c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:28.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.231+0000 7fa33a000640 1 -- 172.21.15.49:0/2288664860 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa324050430 con 0x7fa33c0b3d00 2024-01-31T05:04:28.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.391+0000 7fa344a00640 1 -- 172.21.15.49:0/2288664860 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa33c0cf8b0 con 0x7fa33c0b3d00 2024-01-31T05:04:28.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.391+0000 7fa33a000640 1 -- 172.21.15.49:0/2288664860 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa324053a50 con 0x7fa33c0b3d00 2024-01-31T05:04:28.395 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-31T05:04:28.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.395+0000 7fa344a00640 1 -- 172.21.15.49:0/2288664860 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa314066500 msgr2=0x7fa3140689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:28.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.395+0000 7fa344a00640 1 --2- 172.21.15.49:0/2288664860 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa314066500 0x7fa3140689c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009b10 tx=0x7fa32c008040 comp rx=0 tx=0).stop 2024-01-31T05:04:28.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.395+0000 7fa344a00640 1 -- 172.21.15.49:0/2288664860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa33c0b3d00 msgr2=0x7fa33c166e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:28.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.395+0000 7fa344a00640 1 --2- 172.21.15.49:0/2288664860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa33c0b3d00 0x7fa33c166e00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa324007fd0 tx=0x7fa32400cbe0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.395+0000 7fa344a00640 1 -- 172.21.15.49:0/2288664860 shutdown_connections 2024-01-31T05:04:28.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.395+0000 7fa344a00640 1 --2- 172.21.15.49:0/2288664860 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa33c159790 0x7fa33c14b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.395+0000 7fa344a00640 1 --2- 172.21.15.49:0/2288664860 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa33c0b3d00 0x7fa33c166e00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.395+0000 7fa344a00640 1 --2- 172.21.15.49:0/2288664860 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa314066500 0x7fa3140689c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.395+0000 7fa344a00640 1 --2- 172.21.15.49:0/2288664860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa33c070d70 0x7fa33c167c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.395+0000 7fa344a00640 1 -- 172.21.15.49:0/2288664860 >> 172.21.15.49:0/2288664860 conn(0x7fa33c0b09a0 msgr2=0x7fa33c157da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:28.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.395+0000 7fa344a00640 1 -- 172.21.15.49:0/2288664860 shutdown_connections 2024-01-31T05:04:28.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.395+0000 7fa344a00640 1 -- 172.21.15.49:0/2288664860 wait complete. 2024-01-31T05:04:28.418 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-31T05:04:28.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.563+0000 7f5b63800640 1 Processor -- start 2024-01-31T05:04:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.563+0000 7f5b63800640 1 -- start start 2024-01-31T05:04:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.563+0000 7f5b63800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b5c0703c0 0x7f5b5c0707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.563+0000 7f5b63800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5b5c16a2d0 0x7f5b5c0b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.563+0000 7f5b63800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5b5c0b2580 0x7f5b5c16dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.563+0000 7f5b63800640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5c0b3170 con 0x7f5b5c16a2d0 2024-01-31T05:04:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.563+0000 7f5b63800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5c06c7e0 con 0x7f5b5c0b2580 2024-01-31T05:04:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.563+0000 7f5b63800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c070ce0 con 0x7f5b5c0703c0 2024-01-31T05:04:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.563+0000 7f5b5be00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5b5c16a2d0 0x7f5b5c0b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.563+0000 7f5b5be00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5b5c16a2d0 0x7f5b5c0b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42660/0 (socket says 172.21.15.49:42660) 2024-01-31T05:04:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.567+0000 7f5b60e00640 1 --2- 172.21.15.49:0/3874981764 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b5c0703c0 0x7f5b5c0707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.567+0000 7f5b61800640 1 --2- 172.21.15.49:0/3874981764 >> v2:172.21.15.195:3300/0 conn(0x7f5b5c0b2580 0x7f5b5c16dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.563+0000 7f5b5be00640 1 -- 172.21.15.49:0/3874981764 learned_addr learned my addr 172.21.15.49:0/3874981764 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.707+0000 7f5b60e00640 1 -- 172.21.15.49:0/3874981764 >> v2:172.21.15.195:3300/0 conn(0x7f5b5c0b2580 msgr2=0x7f5b5c16dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.707+0000 7f5b60e00640 1 --2- 172.21.15.49:0/3874981764 >> v2:172.21.15.195:3300/0 conn(0x7f5b5c0b2580 0x7f5b5c16dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.707+0000 7f5b60e00640 1 -- 172.21.15.49:0/3874981764 >> v2:172.21.15.49:3300/0 conn(0x7f5b5c16a2d0 msgr2=0x7f5b5c0b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.707+0000 7f5b60e00640 1 --2- 172.21.15.49:0/3874981764 >> v2:172.21.15.49:3300/0 conn(0x7f5b5c16a2d0 0x7f5b5c0b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.707+0000 7f5b60e00640 1 -- 172.21.15.49:0/3874981764 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c0abd80 con 0x7f5b5c0703c0 2024-01-31T05:04:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.707+0000 7f5b61800640 1 --2- 172.21.15.49:0/3874981764 >> v2:172.21.15.195:3300/0 conn(0x7f5b5c0b2580 0x7f5b5c16dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:04:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.707+0000 7f5b5be00640 1 --2- 172.21.15.49:0/3874981764 >> v2:172.21.15.49:3300/0 conn(0x7f5b5c16a2d0 0x7f5b5c0b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:04:28.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.707+0000 7f5b60e00640 1 --2- 172.21.15.49:0/3874981764 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b5c0703c0 0x7f5b5c0707a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c073560 tx=0x7f5b4c01e410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a605fe1f8ec84b18 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:28.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.711+0000 7f5b5b400640 1 -- 172.21.15.49:0/3874981764 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c0af410 con 0x7f5b5c0703c0 2024-01-31T05:04:28.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.711+0000 7f5b5b400640 1 -- 172.21.15.49:0/3874981764 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4c0a9030 con 0x7f5b5c0703c0 2024-01-31T05:04:28.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.711+0000 7f5b5b400640 1 -- 172.21.15.49:0/3874981764 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c0af7d0 con 0x7f5b5c0703c0 2024-01-31T05:04:28.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.711+0000 7f5b63800640 1 -- 172.21.15.49:0/3874981764 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b5c0703c0 msgr2=0x7f5b5c0707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:28.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.711+0000 7f5b63800640 1 --2- 172.21.15.49:0/3874981764 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b5c0703c0 0x7f5b5c0707a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c073560 tx=0x7f5b4c01e410 comp rx=0 tx=0).stop 2024-01-31T05:04:28.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.711+0000 7f5b63800640 1 -- 172.21.15.49:0/3874981764 shutdown_connections 2024-01-31T05:04:28.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.711+0000 7f5b63800640 1 --2- 172.21.15.49:0/3874981764 >> v2:172.21.15.195:3300/0 conn(0x7f5b5c0b2580 0x7f5b5c16dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.711+0000 7f5b63800640 1 --2- 172.21.15.49:0/3874981764 >> v2:172.21.15.49:3300/0 conn(0x7f5b5c16a2d0 0x7f5b5c0b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.711+0000 7f5b63800640 1 --2- 172.21.15.49:0/3874981764 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b5c0703c0 0x7f5b5c0707a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.711+0000 7f5b63800640 1 -- 172.21.15.49:0/3874981764 >> 172.21.15.49:0/3874981764 conn(0x7f5b5c0b09a0 msgr2=0x7f5b5c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:28.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.711+0000 7f5b63800640 1 -- 172.21.15.49:0/3874981764 shutdown_connections 2024-01-31T05:04:28.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.711+0000 7f5b63800640 1 -- 172.21.15.49:0/3874981764 wait complete. 2024-01-31T05:04:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.711+0000 7f5b63800640 1 Processor -- start 2024-01-31T05:04:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.711+0000 7f5b63800640 1 -- start start 2024-01-31T05:04:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b63800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b5c0703c0 0x7f5b5c09c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b63800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b5c0b2580 0x7f5b5c0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b63800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b5c16a2d0 0x7f5b5c158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b63800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c16c630 con 0x7f5b5c0703c0 2024-01-31T05:04:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b63800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c09cb80 con 0x7f5b5c16a2d0 2024-01-31T05:04:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b63800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c16ba20 con 0x7f5b5c0b2580 2024-01-31T05:04:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b60e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b5c0703c0 0x7f5b5c09c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b60e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b5c0703c0 0x7f5b5c09c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42676/0 (socket says 172.21.15.49:42676) 2024-01-31T05:04:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b60e00640 1 -- 172.21.15.49:0/2094740733 learned_addr learned my addr 172.21.15.49:0/2094740733 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b5be00640 1 --2- 172.21.15.49:0/2094740733 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b5c0b2580 0x7f5b5c0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b61800640 1 --2- 172.21.15.49:0/2094740733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b5c16a2d0 0x7f5b5c158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b60e00640 1 -- 172.21.15.49:0/2094740733 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b5c0b2580 msgr2=0x7f5b5c0cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b60e00640 1 --2- 172.21.15.49:0/2094740733 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b5c0b2580 0x7f5b5c0cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b60e00640 1 -- 172.21.15.49:0/2094740733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b5c16a2d0 msgr2=0x7f5b5c158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b60e00640 1 --2- 172.21.15.49:0/2094740733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b5c16a2d0 0x7f5b5c158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b60e00640 1 -- 172.21.15.49:0/2094740733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b54007740 con 0x7f5b5c0703c0 2024-01-31T05:04:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b60e00640 1 --2- 172.21.15.49:0/2094740733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b5c0703c0 0x7f5b5c09c640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c01cac0 tx=0x7f5b4c01b1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b58c00640 1 -- 172.21.15.49:0/2094740733 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c0bd070 con 0x7f5b5c0703c0 2024-01-31T05:04:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b58c00640 1 -- 172.21.15.49:0/2094740733 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4c005bf0 con 0x7f5b5c0703c0 2024-01-31T05:04:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b58c00640 1 -- 172.21.15.49:0/2094740733 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c003a70 con 0x7f5b5c0703c0 2024-01-31T05:04:28.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b63800640 1 -- 172.21.15.49:0/2094740733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b440094d0 con 0x7f5b5c0703c0 2024-01-31T05:04:28.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.715+0000 7f5b63800640 1 -- 172.21.15.49:0/2094740733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4c00b840 con 0x7f5b5c0703c0 2024-01-31T05:04:28.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.719+0000 7f5b63800640 1 -- 172.21.15.49:0/2094740733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5c06b660 con 0x7f5b5c0703c0 2024-01-31T05:04:28.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.719+0000 7f5b58c00640 1 -- 172.21.15.49:0/2094740733 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f5b4c00b030 con 0x7f5b5c0703c0 2024-01-31T05:04:28.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.719+0000 7f5b58c00640 1 --2- 172.21.15.49:0/2094740733 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5b34066530 0x7f5b340689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:28.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.719+0000 7f5b58c00640 1 -- 172.21.15.49:0/2094740733 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5b4c11e610 con 0x7f5b5c0703c0 2024-01-31T05:04:28.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.719+0000 7f5b5be00640 1 --2- 172.21.15.49:0/2094740733 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5b34066530 0x7f5b340689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:28.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.719+0000 7f5b5be00640 1 --2- 172.21.15.49:0/2094740733 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5b34066530 0x7f5b340689f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c15cbb0 tx=0x7f5b44009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:28.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.727+0000 7f5b58c00640 1 -- 172.21.15.49:0/2094740733 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f5b4c0eb640 con 0x7f5b5c0703c0 2024-01-31T05:04:28.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.887+0000 7f5b63800640 1 -- 172.21.15.49:0/2094740733 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5b5c074860 con 0x7f5b5c0703c0 2024-01-31T05:04:28.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.887+0000 7f5b58c00640 1 -- 172.21.15.49:0/2094740733 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5b4c0eec60 con 0x7f5b5c0703c0 2024-01-31T05:04:28.889 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:04:28.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.891+0000 7f5b63800640 1 -- 172.21.15.49:0/2094740733 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5b34066530 msgr2=0x7f5b340689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:28.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.891+0000 7f5b63800640 1 --2- 172.21.15.49:0/2094740733 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5b34066530 0x7f5b340689f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c15cbb0 tx=0x7f5b44009240 comp rx=0 tx=0).stop 2024-01-31T05:04:28.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.891+0000 7f5b63800640 1 -- 172.21.15.49:0/2094740733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b5c0703c0 msgr2=0x7f5b5c09c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:28.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.891+0000 7f5b63800640 1 --2- 172.21.15.49:0/2094740733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b5c0703c0 0x7f5b5c09c640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c01cac0 tx=0x7f5b4c01b1b0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.891+0000 7f5b63800640 1 -- 172.21.15.49:0/2094740733 shutdown_connections 2024-01-31T05:04:28.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.891+0000 7f5b63800640 1 --2- 172.21.15.49:0/2094740733 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5b34066530 0x7f5b340689f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.891+0000 7f5b63800640 1 --2- 172.21.15.49:0/2094740733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b5c16a2d0 0x7f5b5c158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.891+0000 7f5b63800640 1 --2- 172.21.15.49:0/2094740733 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5b5c0b2580 0x7f5b5c0cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.891+0000 7f5b63800640 1 --2- 172.21.15.49:0/2094740733 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b5c0703c0 0x7f5b5c09c640 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:28.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.891+0000 7f5b63800640 1 -- 172.21.15.49:0/2094740733 >> 172.21.15.49:0/2094740733 conn(0x7f5b5c0b09a0 msgr2=0x7f5b5c0af5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:28.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.891+0000 7f5b63800640 1 -- 172.21.15.49:0/2094740733 shutdown_connections 2024-01-31T05:04:28.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:28.891+0000 7f5b63800640 1 -- 172.21.15.49:0/2094740733 wait complete. 2024-01-31T05:04:28.912 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-31T05:04:29.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.055+0000 7f0192a00640 1 Processor -- start 2024-01-31T05:04:29.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.055+0000 7f0192a00640 1 -- start start 2024-01-31T05:04:29.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.055+0000 7f0192a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f018c15e770 0x7f018c0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:29.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.055+0000 7f0192a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f018c0703c0 0x7f018c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:29.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.055+0000 7f0192a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f018c0d1e00 con 0x7f018c06fe70 2024-01-31T05:04:29.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.055+0000 7f0192a00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f018c06fcc0 con 0x7f018c15e770 2024-01-31T05:04:29.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.055+0000 7f0192a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018c06f6a0 con 0x7f018c0703c0 2024-01-31T05:04:29.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.055+0000 7f018be00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f018c15e770 0x7f018c0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:29.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.055+0000 7f018be00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f018c15e770 0x7f018c0cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42690/0 (socket says 172.21.15.49:42690) 2024-01-31T05:04:29.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.055+0000 7f018be00640 1 -- 172.21.15.49:0/4219319265 learned_addr learned my addr 172.21.15.49:0/4219319265 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:29.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.059+0000 7f0190a00640 1 --2- 172.21.15.49:0/4219319265 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f018c0703c0 0x7f018c0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:29.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.059+0000 7f018be00640 1 -- 172.21.15.49:0/4219319265 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f018c0703c0 msgr2=0x7f018c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:29.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.059+0000 7f018be00640 1 --2- 172.21.15.49:0/4219319265 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f018c0703c0 0x7f018c0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.059+0000 7f018be00640 1 -- 172.21.15.49:0/4219319265 >> v1:172.21.15.195:6789/0 conn(0x7f018c06fe70 legacy=0x7f018c06e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:29.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.059+0000 7f018be00640 1 -- 172.21.15.49:0/4219319265 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018c0cf220 con 0x7f018c15e770 2024-01-31T05:04:29.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.059+0000 7f018be00640 1 --2- 172.21.15.49:0/4219319265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c15e770 0x7f018c0cf5f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f017c009870 tx=0x7f017c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12bd2b3837ccbcb5 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:29.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.059+0000 7f018aa00640 1 -- 172.21.15.49:0/4219319265 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c0ac600 con 0x7f018c15e770 2024-01-31T05:04:29.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.059+0000 7f018aa00640 1 -- 172.21.15.49:0/4219319265 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c0a8050 con 0x7f018c15e770 2024-01-31T05:04:29.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.059+0000 7f018aa00640 1 -- 172.21.15.49:0/4219319265 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c0ac980 con 0x7f018c15e770 2024-01-31T05:04:29.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f0192a00640 1 -- 172.21.15.49:0/4219319265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c15e770 msgr2=0x7f018c0cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:29.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f0192a00640 1 --2- 172.21.15.49:0/4219319265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c15e770 0x7f018c0cf5f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f017c009870 tx=0x7f017c01c4d0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f0192a00640 1 -- 172.21.15.49:0/4219319265 shutdown_connections 2024-01-31T05:04:29.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f0192a00640 1 --2- 172.21.15.49:0/4219319265 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f018c0703c0 0x7f018c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f0192a00640 1 --2- 172.21.15.49:0/4219319265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c15e770 0x7f018c0cf5f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f0192a00640 1 -- 172.21.15.49:0/4219319265 >> 172.21.15.49:0/4219319265 conn(0x7f018c0d0e60 msgr2=0x7f018c0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:29.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f0192a00640 1 -- 172.21.15.49:0/4219319265 shutdown_connections 2024-01-31T05:04:29.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f0192a00640 1 -- 172.21.15.49:0/4219319265 wait complete. 2024-01-31T05:04:29.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f0192a00640 1 Processor -- start 2024-01-31T05:04:29.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f0192a00640 1 -- start start 2024-01-31T05:04:29.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f0192a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f018c06fe70 0x7f018c14d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:29.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f0192a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f018c0703c0 0x7f018c0b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:29.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f0192a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c15e770 0x7f018c155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:29.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f0192a00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018c15d3a0 con 0x7f018c15e770 2024-01-31T05:04:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f0192a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018c15c790 con 0x7f018c06fe70 2024-01-31T05:04:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f0192a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018c15ca70 con 0x7f018c0703c0 2024-01-31T05:04:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f0190a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c15e770 0x7f018c155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f0190a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c15e770 0x7f018c155b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42700/0 (socket says 172.21.15.49:42700) 2024-01-31T05:04:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f018be00640 1 --2- 172.21.15.49:0/874497910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f018c06fe70 0x7f018c14d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f0190a00640 1 -- 172.21.15.49:0/874497910 learned_addr learned my addr 172.21.15.49:0/874497910 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.063+0000 7f018b400640 1 --2- 172.21.15.49:0/874497910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f018c0703c0 0x7f018c0b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.067+0000 7f0190a00640 1 -- 172.21.15.49:0/874497910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f018c0703c0 msgr2=0x7f018c0b5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.067+0000 7f0190a00640 1 --2- 172.21.15.49:0/874497910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f018c0703c0 0x7f018c0b5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.067+0000 7f0190a00640 1 -- 172.21.15.49:0/874497910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f018c06fe70 msgr2=0x7f018c14d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.067+0000 7f0190a00640 1 --2- 172.21.15.49:0/874497910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f018c06fe70 0x7f018c14d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.067+0000 7f0190a00640 1 -- 172.21.15.49:0/874497910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017c0094d0 con 0x7f018c15e770 2024-01-31T05:04:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.067+0000 7f018be00640 1 --2- 172.21.15.49:0/874497910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f018c06fe70 0x7f018c14d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:04:29.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.067+0000 7f0190a00640 1 --2- 172.21.15.49:0/874497910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c15e770 0x7f018c155b20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0184007e60 tx=0x7f018400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:29.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.067+0000 7f0183e00640 1 -- 172.21.15.49:0/874497910 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0184014420 con 0x7f018c15e770 2024-01-31T05:04:29.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.067+0000 7f0183e00640 1 -- 172.21.15.49:0/874497910 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01840145a0 con 0x7f018c15e770 2024-01-31T05:04:29.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.067+0000 7f0192a00640 1 -- 172.21.15.49:0/874497910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f018c15cd50 con 0x7f018c15e770 2024-01-31T05:04:29.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.067+0000 7f0183e00640 1 -- 172.21.15.49:0/874497910 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0184014950 con 0x7f018c15e770 2024-01-31T05:04:29.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.067+0000 7f0192a00640 1 -- 172.21.15.49:0/874497910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f018c15c390 con 0x7f018c15e770 2024-01-31T05:04:29.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.067+0000 7f0192a00640 1 -- 172.21.15.49:0/874497910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f018c068070 con 0x7f018c15e770 2024-01-31T05:04:29.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.067+0000 7f0183e00640 1 -- 172.21.15.49:0/874497910 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f0184014ab0 con 0x7f018c15e770 2024-01-31T05:04:29.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.067+0000 7f0183e00640 1 --2- 172.21.15.49:0/874497910 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0164066500 0x7f01640689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:29.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.067+0000 7f0183e00640 1 -- 172.21.15.49:0/874497910 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0184084ab0 con 0x7f018c15e770 2024-01-31T05:04:29.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.071+0000 7f018be00640 1 --2- 172.21.15.49:0/874497910 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0164066500 0x7f01640689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:29.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.071+0000 7f018be00640 1 --2- 172.21.15.49:0/874497910 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0164066500 0x7f01640689c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f017c0ae000 tx=0x7f017c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:29.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.071+0000 7f0183e00640 1 -- 172.21.15.49:0/874497910 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f01840519f0 con 0x7f018c15e770 2024-01-31T05:04:29.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.243+0000 7f0192a00640 1 -- 172.21.15.49:0/874497910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f018c15d4e0 con 0x7f018c15e770 2024-01-31T05:04:29.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.243+0000 7f0183e00640 1 -- 172.21.15.49:0/874497910 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f018c15d4e0 con 0x7f018c15e770 2024-01-31T05:04:29.246 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2024-01-31T05:04:29.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.247+0000 7f0192a00640 1 -- 172.21.15.49:0/874497910 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0164066500 msgr2=0x7f01640689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:29.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.247+0000 7f0192a00640 1 --2- 172.21.15.49:0/874497910 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0164066500 0x7f01640689c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f017c0ae000 tx=0x7f017c0a7000 comp rx=0 tx=0).stop 2024-01-31T05:04:29.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.247+0000 7f0192a00640 1 -- 172.21.15.49:0/874497910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c15e770 msgr2=0x7f018c155b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:29.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.247+0000 7f0192a00640 1 --2- 172.21.15.49:0/874497910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c15e770 0x7f018c155b20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0184007e60 tx=0x7f018400e4b0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.247+0000 7f0192a00640 1 -- 172.21.15.49:0/874497910 shutdown_connections 2024-01-31T05:04:29.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.247+0000 7f0192a00640 1 --2- 172.21.15.49:0/874497910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c15e770 0x7f018c155b20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.247+0000 7f0192a00640 1 --2- 172.21.15.49:0/874497910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f018c0703c0 0x7f018c0b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.247+0000 7f0192a00640 1 --2- 172.21.15.49:0/874497910 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0164066500 0x7f01640689c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.247+0000 7f0192a00640 1 --2- 172.21.15.49:0/874497910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f018c06fe70 0x7f018c14d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.247+0000 7f0192a00640 1 -- 172.21.15.49:0/874497910 >> 172.21.15.49:0/874497910 conn(0x7f018c0d0e60 msgr2=0x7f018c0cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:29.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.247+0000 7f0192a00640 1 -- 172.21.15.49:0/874497910 shutdown_connections 2024-01-31T05:04:29.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.247+0000 7f0192a00640 1 -- 172.21.15.49:0/874497910 wait complete. 2024-01-31T05:04:29.268 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:04:29.268 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T05:04:29.277 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:04:29.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.463+0000 7f58faa00640 1 Processor -- start 2024-01-31T05:04:29.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.463+0000 7f58faa00640 1 -- start start 2024-01-31T05:04:29.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.463+0000 7f58faa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58f415d3a0 0x7f58f406e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:29.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.463+0000 7f58faa00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f58f406ee50 0x7f58f406f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:29.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.463+0000 7f58faa00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f40cb990 con 0x7f58f40cd6d0 2024-01-31T05:04:29.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.463+0000 7f58faa00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f40d1c20 con 0x7f58f406ee50 2024-01-31T05:04:29.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.463+0000 7f58faa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40cfed0 con 0x7f58f415d3a0 2024-01-31T05:04:29.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.463+0000 7f58f8a00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f58f40cd6d0 0x7f58f40cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35156/0 (socket says 172.21.15.49:35156) 2024-01-31T05:04:29.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.463+0000 7f58f3400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f58f406ee50 0x7f58f406f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:29.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.463+0000 7f58f8a00640 1 -- 172.21.15.49:0/3592406953 learned_addr learned my addr 172.21.15.49:0/3592406953 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:29.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.463+0000 7f58f3e00640 1 --2- 172.21.15.49:0/3592406953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58f415d3a0 0x7f58f406e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:29.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.463+0000 7f58f3400640 1 -- 172.21.15.49:0/3592406953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58f415d3a0 msgr2=0x7f58f406e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:29.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.463+0000 7f58f3400640 1 --2- 172.21.15.49:0/3592406953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58f415d3a0 0x7f58f406e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.463+0000 7f58f3400640 1 -- 172.21.15.49:0/3592406953 >> v1:172.21.15.49:6789/0 conn(0x7f58f40cd6d0 legacy=0x7f58f40cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:29.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.463+0000 7f58f3400640 1 -- 172.21.15.49:0/3592406953 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f40d01b0 con 0x7f58f406ee50 2024-01-31T05:04:29.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.463+0000 7f58f2a00640 1 -- 172.21.15.49:0/3592406953 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308553771 0 0) 0x7f58f40cb990 con 0x7f58f40cd6d0 2024-01-31T05:04:29.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.467+0000 7f58f3400640 1 --2- 172.21.15.49:0/3592406953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f406ee50 0x7f58f406f2b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f58dc0097c0 tx=0x7f58dc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ecabe3c45f5ace1 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:29.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.467+0000 7f58f2a00640 1 -- 172.21.15.49:0/3592406953 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc0ad640 con 0x7f58f406ee50 2024-01-31T05:04:29.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.467+0000 7f58f2a00640 1 -- 172.21.15.49:0/3592406953 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc0ad7a0 con 0x7f58f406ee50 2024-01-31T05:04:29.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.467+0000 7f58f2a00640 1 -- 172.21.15.49:0/3592406953 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc0adb30 con 0x7f58f406ee50 2024-01-31T05:04:29.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.467+0000 7f58faa00640 1 -- 172.21.15.49:0/3592406953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f406ee50 msgr2=0x7f58f406f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:29.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.467+0000 7f58faa00640 1 --2- 172.21.15.49:0/3592406953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f406ee50 0x7f58f406f2b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f58dc0097c0 tx=0x7f58dc01c480 comp rx=0 tx=0).stop 2024-01-31T05:04:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.467+0000 7f58faa00640 1 -- 172.21.15.49:0/3592406953 shutdown_connections 2024-01-31T05:04:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.467+0000 7f58faa00640 1 --2- 172.21.15.49:0/3592406953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f406ee50 0x7f58f406f2b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.467+0000 7f58faa00640 1 --2- 172.21.15.49:0/3592406953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58f415d3a0 0x7f58f406e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.467+0000 7f58faa00640 1 -- 172.21.15.49:0/3592406953 >> 172.21.15.49:0/3592406953 conn(0x7f58f40d0e50 msgr2=0x7f58f40d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.467+0000 7f58faa00640 1 -- 172.21.15.49:0/3592406953 shutdown_connections 2024-01-31T05:04:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.467+0000 7f58faa00640 1 -- 172.21.15.49:0/3592406953 wait complete. 2024-01-31T05:04:29.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58faa00640 1 Processor -- start 2024-01-31T05:04:29.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58faa00640 1 -- start start 2024-01-31T05:04:29.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58faa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f406ee50 0x7f58f40afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:29.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58faa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58f40cd6d0 0x7f58f414c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:29.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58faa00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58f415d3a0 0x7f58f4154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:29.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58faa00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40af3e0 con 0x7f58f406ee50 2024-01-31T05:04:29.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58faa00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f4153d90 con 0x7f58f415d3a0 2024-01-31T05:04:29.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58faa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f4154070 con 0x7f58f40cd6d0 2024-01-31T05:04:29.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58f3e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f406ee50 0x7f58f40afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58f3e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f406ee50 0x7f58f40afbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42728/0 (socket says 172.21.15.49:42728) 2024-01-31T05:04:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58f3e00640 1 -- 172.21.15.49:0/321346932 learned_addr learned my addr 172.21.15.49:0/321346932 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58f3400640 1 --2- 172.21.15.49:0/321346932 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58f40cd6d0 0x7f58f414c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58f8a00640 1 --2- 172.21.15.49:0/321346932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58f415d3a0 0x7f58f4154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58f3e00640 1 -- 172.21.15.49:0/321346932 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58f40cd6d0 msgr2=0x7f58f414c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58f3e00640 1 --2- 172.21.15.49:0/321346932 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58f40cd6d0 0x7f58f414c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58f3e00640 1 -- 172.21.15.49:0/321346932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58f415d3a0 msgr2=0x7f58f4154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58f3e00640 1 --2- 172.21.15.49:0/321346932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58f415d3a0 0x7f58f4154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58f3e00640 1 -- 172.21.15.49:0/321346932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc009420 con 0x7f58f406ee50 2024-01-31T05:04:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58f3e00640 1 --2- 172.21.15.49:0/321346932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f406ee50 0x7f58f40afbb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f58e400e870 tx=0x7f58e400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58ebe00640 1 -- 172.21.15.49:0/321346932 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e4009510 con 0x7f58f406ee50 2024-01-31T05:04:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58ebe00640 1 -- 172.21.15.49:0/321346932 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e400eec0 con 0x7f58f406ee50 2024-01-31T05:04:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58faa00640 1 -- 172.21.15.49:0/321346932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f4154350 con 0x7f58f406ee50 2024-01-31T05:04:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58ebe00640 1 -- 172.21.15.49:0/321346932 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e400cb40 con 0x7f58f406ee50 2024-01-31T05:04:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58faa00640 1 -- 172.21.15.49:0/321346932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f415a090 con 0x7f58f406ee50 2024-01-31T05:04:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.471+0000 7f58faa00640 1 -- 172.21.15.49:0/321346932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f406fdb0 con 0x7f58f406ee50 2024-01-31T05:04:29.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.475+0000 7f58ebe00640 1 -- 172.21.15.49:0/321346932 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f58e400cca0 con 0x7f58f406ee50 2024-01-31T05:04:29.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.475+0000 7f58ebe00640 1 --2- 172.21.15.49:0/321346932 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f58cc066530 0x7f58cc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:29.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.475+0000 7f58ebe00640 1 -- 172.21.15.49:0/321346932 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f58e4084260 con 0x7f58f406ee50 2024-01-31T05:04:29.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.475+0000 7f58f3400640 1 --2- 172.21.15.49:0/321346932 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f58cc066530 0x7f58cc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:29.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.475+0000 7f58f3400640 1 --2- 172.21.15.49:0/321346932 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f58cc066530 0x7f58cc0689f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f58dc0af000 tx=0x7f58dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:29.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.479+0000 7f58ebe00640 1 -- 172.21.15.49:0/321346932 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f58e4051200 con 0x7f58f406ee50 2024-01-31T05:04:29.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.639+0000 7f58faa00640 1 -- 172.21.15.49:0/321346932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58f4074860 con 0x7f58f406ee50 2024-01-31T05:04:29.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.639+0000 7f58ebe00640 1 -- 172.21.15.49:0/321346932 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18323 (secure 0 0 0) 0x7f58e4054820 con 0x7f58f406ee50 2024-01-31T05:04:29.642 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:29.642 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:20.695841+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:04:29.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.643+0000 7f58faa00640 1 -- 172.21.15.49:0/321346932 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f58cc066530 msgr2=0x7f58cc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:29.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.643+0000 7f58faa00640 1 --2- 172.21.15.49:0/321346932 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f58cc066530 0x7f58cc0689f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f58dc0af000 tx=0x7f58dc008040 comp rx=0 tx=0).stop 2024-01-31T05:04:29.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.643+0000 7f58faa00640 1 -- 172.21.15.49:0/321346932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f406ee50 msgr2=0x7f58f40afbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:29.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.643+0000 7f58faa00640 1 --2- 172.21.15.49:0/321346932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f406ee50 0x7f58f40afbb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f58e400e870 tx=0x7f58e400ec70 comp rx=0 tx=0).stop 2024-01-31T05:04:29.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.643+0000 7f58faa00640 1 -- 172.21.15.49:0/321346932 shutdown_connections 2024-01-31T05:04:29.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.643+0000 7f58faa00640 1 --2- 172.21.15.49:0/321346932 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f58cc066530 0x7f58cc0689f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.643+0000 7f58faa00640 1 --2- 172.21.15.49:0/321346932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58f415d3a0 0x7f58f4154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.643+0000 7f58faa00640 1 --2- 172.21.15.49:0/321346932 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58f40cd6d0 0x7f58f414c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.643+0000 7f58faa00640 1 --2- 172.21.15.49:0/321346932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f406ee50 0x7f58f40afbb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.643+0000 7f58faa00640 1 -- 172.21.15.49:0/321346932 >> 172.21.15.49:0/321346932 conn(0x7f58f40d0e50 msgr2=0x7f58f415c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:29.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.643+0000 7f58faa00640 1 -- 172.21.15.49:0/321346932 shutdown_connections 2024-01-31T05:04:29.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.643+0000 7f58faa00640 1 -- 172.21.15.49:0/321346932 wait complete. 2024-01-31T05:04:29.664 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:04:14.566345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:04:15.231265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-31T05:04:18.316756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-31T05:04:29.665 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:04:29.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.807+0000 7ff3ce600640 1 Processor -- start 2024-01-31T05:04:29.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.807+0000 7ff3ce600640 1 -- start start 2024-01-31T05:04:29.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.807+0000 7ff3ce600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3c8159790 0x7ff3c80b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:29.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.807+0000 7ff3ce600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff3c8070d70 0x7ff3c80ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:29.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.807+0000 7ff3ce600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c8159b70 con 0x7ff3c80b3d00 2024-01-31T05:04:29.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.807+0000 7ff3ce600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c80b2750 con 0x7ff3c8070d70 2024-01-31T05:04:29.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.807+0000 7ff3ce600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c80b2a30 con 0x7ff3c8159790 2024-01-31T05:04:29.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.811+0000 7ff3c7400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3c8159790 0x7ff3c80b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:29.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.811+0000 7ff3c7e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff3c8070d70 0x7ff3c80ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:29.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.811+0000 7ff3c7400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3c8159790 0x7ff3c80b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:36032/0 (socket says 172.21.15.49:36032) 2024-01-31T05:04:29.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.811+0000 7ff3c6a00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7ff3c80b3d00 0x7ff3c8070660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:38808/0 (socket says 172.21.15.49:38808) 2024-01-31T05:04:29.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.811+0000 7ff3c7400640 1 -- 172.21.15.49:0/4181621392 learned_addr learned my addr 172.21.15.49:0/4181621392 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:29.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.811+0000 7ff3c7e00640 1 -- 172.21.15.49:0/4181621392 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3c8159790 msgr2=0x7ff3c80b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:29.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.811+0000 7ff3c7e00640 1 --2- 172.21.15.49:0/4181621392 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3c8159790 0x7ff3c80b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.811+0000 7ff3c7e00640 1 -- 172.21.15.49:0/4181621392 >> v1:172.21.15.195:6789/0 conn(0x7ff3c80b3d00 legacy=0x7ff3c8070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:29.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.811+0000 7ff3c6000640 1 -- 172.21.15.49:0/4181621392 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109257794 0 0) 0x7ff3c8159b70 con 0x7ff3c80b3d00 2024-01-31T05:04:29.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.811+0000 7ff3c7e00640 1 -- 172.21.15.49:0/4181621392 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c80b2d10 con 0x7ff3c8070d70 2024-01-31T05:04:29.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.811+0000 7ff3c7e00640 1 --2- 172.21.15.49:0/4181621392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3c8070d70 0x7ff3c80ac050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009d90 tx=0x7ff3c001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2184fbd2bd4e2807 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:29.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.811+0000 7ff3c6000640 1 -- 172.21.15.49:0/4181621392 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c00a5960 con 0x7ff3c8070d70 2024-01-31T05:04:29.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.811+0000 7ff3c6000640 1 -- 172.21.15.49:0/4181621392 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c00a5ac0 con 0x7ff3c8070d70 2024-01-31T05:04:29.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.811+0000 7ff3c6000640 1 -- 172.21.15.49:0/4181621392 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c00a5e50 con 0x7ff3c8070d70 2024-01-31T05:04:29.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.815+0000 7ff3ce600640 1 -- 172.21.15.49:0/4181621392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3c8070d70 msgr2=0x7ff3c80ac050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:29.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.815+0000 7ff3ce600640 1 --2- 172.21.15.49:0/4181621392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3c8070d70 0x7ff3c80ac050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009d90 tx=0x7ff3c001c920 comp rx=0 tx=0).stop 2024-01-31T05:04:29.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.815+0000 7ff3ce600640 1 -- 172.21.15.49:0/4181621392 shutdown_connections 2024-01-31T05:04:29.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.815+0000 7ff3ce600640 1 --2- 172.21.15.49:0/4181621392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3c8070d70 0x7ff3c80ac050 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.815+0000 7ff3ce600640 1 --2- 172.21.15.49:0/4181621392 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3c8159790 0x7ff3c80b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.815+0000 7ff3ce600640 1 -- 172.21.15.49:0/4181621392 >> 172.21.15.49:0/4181621392 conn(0x7ff3c80b09a0 msgr2=0x7ff3c80b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:29.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.815+0000 7ff3ce600640 1 -- 172.21.15.49:0/4181621392 shutdown_connections 2024-01-31T05:04:29.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.815+0000 7ff3ce600640 1 -- 172.21.15.49:0/4181621392 wait complete. 2024-01-31T05:04:29.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.815+0000 7ff3ce600640 1 Processor -- start 2024-01-31T05:04:29.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.815+0000 7ff3ce600640 1 -- start start 2024-01-31T05:04:29.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.815+0000 7ff3ce600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c8070d70 0x7ff3c809c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:29.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.815+0000 7ff3ce600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3c80b3d00 0x7ff3c815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:29.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.815+0000 7ff3ce600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3c8159790 0x7ff3c813d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:29.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.815+0000 7ff3ce600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c815bab0 con 0x7ff3c8070d70 2024-01-31T05:04:29.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.815+0000 7ff3ce600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c815af90 con 0x7ff3c8159790 2024-01-31T05:04:29.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.815+0000 7ff3ce600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c815b210 con 0x7ff3c80b3d00 2024-01-31T05:04:29.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.815+0000 7ff3c7400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c8070d70 0x7ff3c809c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:29.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3c7400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c8070d70 0x7ff3c809c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42742/0 (socket says 172.21.15.49:42742) 2024-01-31T05:04:29.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3c7400640 1 -- 172.21.15.49:0/2432110000 learned_addr learned my addr 172.21.15.49:0/2432110000 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:29.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3c7e00640 1 --2- 172.21.15.49:0/2432110000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3c8159790 0x7ff3c813d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:29.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3c6a00640 1 --2- 172.21.15.49:0/2432110000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3c80b3d00 0x7ff3c815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:29.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3c7400640 1 -- 172.21.15.49:0/2432110000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3c80b3d00 msgr2=0x7ff3c815aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:29.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3c7400640 1 --2- 172.21.15.49:0/2432110000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3c80b3d00 0x7ff3c815aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3c7400640 1 -- 172.21.15.49:0/2432110000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3c8159790 msgr2=0x7ff3c813d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:29.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3c7400640 1 --2- 172.21.15.49:0/2432110000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3c8159790 0x7ff3c813d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3c7400640 1 -- 172.21.15.49:0/2432110000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c0009a70 con 0x7ff3c8070d70 2024-01-31T05:04:29.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3c7e00640 1 --2- 172.21.15.49:0/2432110000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3c8159790 0x7ff3c813d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:29.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3c6a00640 1 --2- 172.21.15.49:0/2432110000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3c80b3d00 0x7ff3c815aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:29.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3c7400640 1 --2- 172.21.15.49:0/2432110000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c8070d70 0x7ff3c809c5e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800dd90 tx=0x7ff3b8010490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:29.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3bf400640 1 -- 172.21.15.49:0/2432110000 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8012040 con 0x7ff3c8070d70 2024-01-31T05:04:29.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3bf400640 1 -- 172.21.15.49:0/2432110000 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b800be60 con 0x7ff3c8070d70 2024-01-31T05:04:29.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3bf400640 1 -- 172.21.15.49:0/2432110000 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8018630 con 0x7ff3c8070d70 2024-01-31T05:04:29.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3ce600640 1 -- 172.21.15.49:0/2432110000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c815b4f0 con 0x7ff3c8070d70 2024-01-31T05:04:29.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3ce600640 1 -- 172.21.15.49:0/2432110000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c80cb7b0 con 0x7ff3c8070d70 2024-01-31T05:04:29.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3ce600640 1 -- 172.21.15.49:0/2432110000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c8074860 con 0x7ff3c8070d70 2024-01-31T05:04:29.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3bf400640 1 -- 172.21.15.49:0/2432110000 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff3b8018790 con 0x7ff3c8070d70 2024-01-31T05:04:29.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.819+0000 7ff3bf400640 1 --2- 172.21.15.49:0/2432110000 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff3a0066500 0x7ff3a00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:29.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.823+0000 7ff3bf400640 1 -- 172.21.15.49:0/2432110000 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff3b80868a0 con 0x7ff3c8070d70 2024-01-31T05:04:29.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.823+0000 7ff3c6a00640 1 --2- 172.21.15.49:0/2432110000 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff3a0066500 0x7ff3a00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:29.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.823+0000 7ff3c6a00640 1 --2- 172.21.15.49:0/2432110000 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff3a0066500 0x7ff3a00689c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff3c815bd00 tx=0x7ff3b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:29.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.823+0000 7ff3bf400640 1 -- 172.21.15.49:0/2432110000 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff3b8053840 con 0x7ff3c8070d70 2024-01-31T05:04:29.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.983+0000 7ff3ce600640 1 -- 172.21.15.49:0/2432110000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff3c8156550 con 0x7ff3c8070d70 2024-01-31T05:04:29.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.987+0000 7ff3bf400640 1 -- 172.21.15.49:0/2432110000 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff3b8084e60 con 0x7ff3c8070d70 2024-01-31T05:04:29.987 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:04:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.987+0000 7ff3ce600640 1 -- 172.21.15.49:0/2432110000 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff3a0066500 msgr2=0x7ff3a00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.987+0000 7ff3ce600640 1 --2- 172.21.15.49:0/2432110000 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff3a0066500 0x7ff3a00689c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff3c815bd00 tx=0x7ff3b0009040 comp rx=0 tx=0).stop 2024-01-31T05:04:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.987+0000 7ff3ce600640 1 -- 172.21.15.49:0/2432110000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c8070d70 msgr2=0x7ff3c809c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.987+0000 7ff3ce600640 1 --2- 172.21.15.49:0/2432110000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c8070d70 0x7ff3c809c5e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800dd90 tx=0x7ff3b8010490 comp rx=0 tx=0).stop 2024-01-31T05:04:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.987+0000 7ff3ce600640 1 -- 172.21.15.49:0/2432110000 shutdown_connections 2024-01-31T05:04:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.987+0000 7ff3ce600640 1 --2- 172.21.15.49:0/2432110000 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff3a0066500 0x7ff3a00689c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.987+0000 7ff3ce600640 1 --2- 172.21.15.49:0/2432110000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3c8159790 0x7ff3c813d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.987+0000 7ff3ce600640 1 --2- 172.21.15.49:0/2432110000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3c80b3d00 0x7ff3c815aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.987+0000 7ff3ce600640 1 --2- 172.21.15.49:0/2432110000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c8070d70 0x7ff3c809c5e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.987+0000 7ff3ce600640 1 -- 172.21.15.49:0/2432110000 >> 172.21.15.49:0/2432110000 conn(0x7ff3c80b09a0 msgr2=0x7ff3c8073da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.987+0000 7ff3ce600640 1 -- 172.21.15.49:0/2432110000 shutdown_connections 2024-01-31T05:04:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:29.987+0000 7ff3ce600640 1 -- 172.21.15.49:0/2432110000 wait complete. 2024-01-31T05:04:30.009 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:04:30.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.151+0000 7f4acae00640 1 Processor -- start 2024-01-31T05:04:30.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.151+0000 7f4acae00640 1 -- start start 2024-01-31T05:04:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.151+0000 7f4acae00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4ac40b30e0 0x7f4ac415e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.151+0000 7f4acae00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4ac40b34c0 0x7f4ac40720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.151+0000 7f4acae00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac40703c0 con 0x7f4ac406c2d0 2024-01-31T05:04:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.151+0000 7f4acae00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac40b1dd0 con 0x7f4ac40b30e0 2024-01-31T05:04:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.151+0000 7f4acae00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac4070610 con 0x7f4ac40b34c0 2024-01-31T05:04:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.151+0000 7f4ac3e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4ac40b30e0 0x7f4ac415e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.151+0000 7f4ac3e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4ac40b30e0 0x7f4ac415e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42758/0 (socket says 172.21.15.49:42758) 2024-01-31T05:04:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.151+0000 7f4ac3e00640 1 -- 172.21.15.49:0/4035266399 learned_addr learned my addr 172.21.15.49:0/4035266399 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.151+0000 7f4ac3400640 1 --2- 172.21.15.49:0/4035266399 >> v2:172.21.15.195:3300/0 conn(0x7f4ac40b34c0 0x7f4ac40720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.151+0000 7f4ac3e00640 1 -- 172.21.15.49:0/4035266399 >> v2:172.21.15.195:3300/0 conn(0x7f4ac40b34c0 msgr2=0x7f4ac40720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.151+0000 7f4ac3e00640 1 --2- 172.21.15.49:0/4035266399 >> v2:172.21.15.195:3300/0 conn(0x7f4ac40b34c0 0x7f4ac40720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.151+0000 7f4ac3e00640 1 -- 172.21.15.49:0/4035266399 >> v1:172.21.15.195:6789/0 conn(0x7f4ac406c2d0 legacy=0x7f4ac40b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:30.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.151+0000 7f4ac3e00640 1 -- 172.21.15.49:0/4035266399 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac40708f0 con 0x7f4ac40b30e0 2024-01-31T05:04:30.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.155+0000 7f4ac3e00640 1 --2- 172.21.15.49:0/4035266399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac40b30e0 0x7f4ac415e1c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4ac409d0d0 tx=0x7f4ab401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41770933561f0b7d server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:30.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.155+0000 7f4ac2a00640 1 -- 172.21.15.49:0/4035266399 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab40ad680 con 0x7f4ac40b30e0 2024-01-31T05:04:30.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.155+0000 7f4ac2a00640 1 -- 172.21.15.49:0/4035266399 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab40ad7e0 con 0x7f4ac40b30e0 2024-01-31T05:04:30.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.155+0000 7f4ac2a00640 1 -- 172.21.15.49:0/4035266399 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab40adb70 con 0x7f4ac40b30e0 2024-01-31T05:04:30.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.155+0000 7f4acae00640 1 -- 172.21.15.49:0/4035266399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac40b30e0 msgr2=0x7f4ac415e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:30.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.155+0000 7f4acae00640 1 --2- 172.21.15.49:0/4035266399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac40b30e0 0x7f4ac415e1c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4ac409d0d0 tx=0x7f4ab401c3e0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.155+0000 7f4acae00640 1 -- 172.21.15.49:0/4035266399 shutdown_connections 2024-01-31T05:04:30.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.155+0000 7f4acae00640 1 --2- 172.21.15.49:0/4035266399 >> v2:172.21.15.195:3300/0 conn(0x7f4ac40b34c0 0x7f4ac40720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.155+0000 7f4acae00640 1 --2- 172.21.15.49:0/4035266399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac40b30e0 0x7f4ac415e1c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.155+0000 7f4acae00640 1 -- 172.21.15.49:0/4035266399 >> 172.21.15.49:0/4035266399 conn(0x7f4ac40b09a0 msgr2=0x7f4ac40b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:30.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.155+0000 7f4acae00640 1 -- 172.21.15.49:0/4035266399 shutdown_connections 2024-01-31T05:04:30.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.155+0000 7f4acae00640 1 -- 172.21.15.49:0/4035266399 wait complete. 2024-01-31T05:04:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4acae00640 1 Processor -- start 2024-01-31T05:04:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4acae00640 1 -- start start 2024-01-31T05:04:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4acae00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac406c2d0 0x7f4ac414a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4acae00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ac40b30e0 0x7f4ac4150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4acae00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ac40b34c0 0x7f4ac41507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4acae00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac409a500 con 0x7f4ac406c2d0 2024-01-31T05:04:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4acae00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac4153940 con 0x7f4ac40b34c0 2024-01-31T05:04:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4acae00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac4099b60 con 0x7f4ac40b30e0 2024-01-31T05:04:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4ac3e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac406c2d0 0x7f4ac414a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4ac3e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac406c2d0 0x7f4ac414a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42764/0 (socket says 172.21.15.49:42764) 2024-01-31T05:04:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4ac3e00640 1 -- 172.21.15.49:0/579711608 learned_addr learned my addr 172.21.15.49:0/579711608 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4ac8e00640 1 --2- 172.21.15.49:0/579711608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ac40b34c0 0x7f4ac41507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4ac3400640 1 --2- 172.21.15.49:0/579711608 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ac40b30e0 0x7f4ac4150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4ac3e00640 1 -- 172.21.15.49:0/579711608 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ac40b30e0 msgr2=0x7f4ac4150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4ac3e00640 1 --2- 172.21.15.49:0/579711608 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ac40b30e0 0x7f4ac4150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4ac3e00640 1 -- 172.21.15.49:0/579711608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ac40b34c0 msgr2=0x7f4ac41507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4ac3e00640 1 --2- 172.21.15.49:0/579711608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ac40b34c0 0x7f4ac41507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4ac3e00640 1 -- 172.21.15.49:0/579711608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab40094d0 con 0x7f4ac406c2d0 2024-01-31T05:04:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4ac3400640 1 --2- 172.21.15.49:0/579711608 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ac40b30e0 0x7f4ac4150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4ac3e00640 1 --2- 172.21.15.49:0/579711608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac406c2d0 0x7f4ac414a5e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4018ff0 tx=0x7f4ab4019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4abbe00640 1 -- 172.21.15.49:0/579711608 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab40ade60 con 0x7f4ac406c2d0 2024-01-31T05:04:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4abbe00640 1 -- 172.21.15.49:0/579711608 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab40b8450 con 0x7f4ac406c2d0 2024-01-31T05:04:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4acae00640 1 -- 172.21.15.49:0/579711608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac4099e40 con 0x7f4ac406c2d0 2024-01-31T05:04:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4abbe00640 1 -- 172.21.15.49:0/579711608 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab40b87c0 con 0x7f4ac406c2d0 2024-01-31T05:04:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.159+0000 7f4acae00640 1 -- 172.21.15.49:0/579711608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac414ab20 con 0x7f4ac406c2d0 2024-01-31T05:04:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.163+0000 7f4acae00640 1 -- 172.21.15.49:0/579711608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac4074860 con 0x7f4ac406c2d0 2024-01-31T05:04:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.163+0000 7f4abbe00640 1 -- 172.21.15.49:0/579711608 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f4ab40b4070 con 0x7f4ac406c2d0 2024-01-31T05:04:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.163+0000 7f4abbe00640 1 --2- 172.21.15.49:0/579711608 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4a9c066530 0x7f4a9c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.163+0000 7f4abbe00640 1 -- 172.21.15.49:0/579711608 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4ab411e7d0 con 0x7f4ac406c2d0 2024-01-31T05:04:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.163+0000 7f4ac3400640 1 --2- 172.21.15.49:0/579711608 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4a9c066530 0x7f4a9c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.163+0000 7f4ac3400640 1 --2- 172.21.15.49:0/579711608 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4a9c066530 0x7f4a9c0689f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4157c80 tx=0x7f4aac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:30.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.167+0000 7f4abbe00640 1 -- 172.21.15.49:0/579711608 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f4ab40eb6f0 con 0x7f4ac406c2d0 2024-01-31T05:04:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.327+0000 7f4acae00640 1 -- 172.21.15.49:0/579711608 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ac40b1040 con 0x7f4ac406c2d0 2024-01-31T05:04:30.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.327+0000 7f4abbe00640 1 -- 172.21.15.49:0/579711608 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4ab40eed10 con 0x7f4ac406c2d0 2024-01-31T05:04:30.328 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:04:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.327+0000 7f4acae00640 1 -- 172.21.15.49:0/579711608 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4a9c066530 msgr2=0x7f4a9c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.327+0000 7f4acae00640 1 --2- 172.21.15.49:0/579711608 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4a9c066530 0x7f4a9c0689f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4157c80 tx=0x7f4aac008040 comp rx=0 tx=0).stop 2024-01-31T05:04:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.327+0000 7f4acae00640 1 -- 172.21.15.49:0/579711608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac406c2d0 msgr2=0x7f4ac414a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.327+0000 7f4acae00640 1 --2- 172.21.15.49:0/579711608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac406c2d0 0x7f4ac414a5e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4018ff0 tx=0x7f4ab4019180 comp rx=0 tx=0).stop 2024-01-31T05:04:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.327+0000 7f4acae00640 1 -- 172.21.15.49:0/579711608 shutdown_connections 2024-01-31T05:04:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.327+0000 7f4acae00640 1 --2- 172.21.15.49:0/579711608 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4a9c066530 0x7f4a9c0689f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.327+0000 7f4acae00640 1 --2- 172.21.15.49:0/579711608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ac40b34c0 0x7f4ac41507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.327+0000 7f4acae00640 1 --2- 172.21.15.49:0/579711608 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ac40b30e0 0x7f4ac4150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.327+0000 7f4acae00640 1 --2- 172.21.15.49:0/579711608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac406c2d0 0x7f4ac414a5e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.327+0000 7f4acae00640 1 -- 172.21.15.49:0/579711608 >> 172.21.15.49:0/579711608 conn(0x7f4ac40b09a0 msgr2=0x7f4ac406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.331+0000 7f4acae00640 1 -- 172.21.15.49:0/579711608 shutdown_connections 2024-01-31T05:04:30.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.331+0000 7f4acae00640 1 -- 172.21.15.49:0/579711608 wait complete. 2024-01-31T05:04:30.350 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:04:30.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.491+0000 7f0eea000640 1 Processor -- start 2024-01-31T05:04:30.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.491+0000 7f0eea000640 1 -- start start 2024-01-31T05:04:30.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.495+0000 7f0eea000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ee415b110 0x7f0ee406c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:30.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.495+0000 7f0eea000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee40714e0 0x7f0ee40ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:30.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.495+0000 7f0eea000640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee415b4f0 con 0x7f0ee40cdf10 2024-01-31T05:04:30.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.495+0000 7f0eea000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee40ce460 con 0x7f0ee415b110 2024-01-31T05:04:30.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.495+0000 7f0eea000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40abf20 con 0x7f0ee40714e0 2024-01-31T05:04:30.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.495+0000 7f0ee3400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0ee415b110 0x7f0ee406c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:30.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.495+0000 7f0ee2a00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0ee40cdf10 0x7f0ee4070dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35170/0 (socket says 172.21.15.49:35170) 2024-01-31T05:04:30.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.495+0000 7f0ee2a00640 1 -- 172.21.15.49:0/843281521 learned_addr learned my addr 172.21.15.49:0/843281521 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:30.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.495+0000 7f0ee3e00640 1 --2- 172.21.15.49:0/843281521 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee40714e0 0x7f0ee40ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:30.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.495+0000 7f0ee3400640 1 -- 172.21.15.49:0/843281521 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee40714e0 msgr2=0x7f0ee40ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:30.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.495+0000 7f0ee3400640 1 --2- 172.21.15.49:0/843281521 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee40714e0 0x7f0ee40ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.495+0000 7f0ee3400640 1 -- 172.21.15.49:0/843281521 >> v1:172.21.15.49:6789/0 conn(0x7f0ee40cdf10 legacy=0x7f0ee4070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:30.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.495+0000 7f0ee3400640 1 -- 172.21.15.49:0/843281521 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee40ac200 con 0x7f0ee415b110 2024-01-31T05:04:30.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.495+0000 7f0ee2000640 1 -- 172.21.15.49:0/843281521 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132257247 0 0) 0x7f0ecc001120 con 0x7f0ee40cdf10 2024-01-31T05:04:30.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.495+0000 7f0ee3e00640 1 --2- 172.21.15.49:0/843281521 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee40714e0 0x7f0ee40ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:30.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.499+0000 7f0ee3400640 1 --2- 172.21.15.49:0/843281521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ee415b110 0x7f0ee406c2d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40097c0 tx=0x7f0ed401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebbdc416c035f5f3 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:30.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.499+0000 7f0ee2000640 1 -- 172.21.15.49:0/843281521 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40ab670 con 0x7f0ee415b110 2024-01-31T05:04:30.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.499+0000 7f0ee2000640 1 -- 172.21.15.49:0/843281521 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed40ab7d0 con 0x7f0ee415b110 2024-01-31T05:04:30.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.499+0000 7f0ee2000640 1 -- 172.21.15.49:0/843281521 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40abb60 con 0x7f0ee415b110 2024-01-31T05:04:30.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.499+0000 7f0eea000640 1 -- 172.21.15.49:0/843281521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ee415b110 msgr2=0x7f0ee406c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:30.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.499+0000 7f0eea000640 1 --2- 172.21.15.49:0/843281521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ee415b110 0x7f0ee406c2d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40097c0 tx=0x7f0ed401c450 comp rx=0 tx=0).stop 2024-01-31T05:04:30.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.499+0000 7f0eea000640 1 -- 172.21.15.49:0/843281521 shutdown_connections 2024-01-31T05:04:30.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.499+0000 7f0eea000640 1 --2- 172.21.15.49:0/843281521 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee40714e0 0x7f0ee40ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.499+0000 7f0eea000640 1 --2- 172.21.15.49:0/843281521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ee415b110 0x7f0ee406c2d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.499+0000 7f0eea000640 1 -- 172.21.15.49:0/843281521 >> 172.21.15.49:0/843281521 conn(0x7f0ee40b09a0 msgr2=0x7f0ee40b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:30.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.499+0000 7f0eea000640 1 -- 172.21.15.49:0/843281521 shutdown_connections 2024-01-31T05:04:30.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.499+0000 7f0eea000640 1 -- 172.21.15.49:0/843281521 wait complete. 2024-01-31T05:04:30.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.499+0000 7f0eea000640 1 Processor -- start 2024-01-31T05:04:30.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.499+0000 7f0eea000640 1 -- start start 2024-01-31T05:04:30.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0eea000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ee40714e0 0x7f0ee40b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:30.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0eea000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee40cdf10 0x7f0ee40b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:30.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0eea000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ee415b110 0x7f0ee414f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:30.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0eea000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40b34d0 con 0x7f0ee40714e0 2024-01-31T05:04:30.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0eea000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40b3e10 con 0x7f0ee415b110 2024-01-31T05:04:30.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0eea000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40b2850 con 0x7f0ee40cdf10 2024-01-31T05:04:30.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0ee3400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ee40714e0 0x7f0ee40b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:30.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0ee3400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ee40714e0 0x7f0ee40b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42780/0 (socket says 172.21.15.49:42780) 2024-01-31T05:04:30.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0ee3400640 1 -- 172.21.15.49:0/3908998906 learned_addr learned my addr 172.21.15.49:0/3908998906 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:30.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0ee3400640 1 -- 172.21.15.49:0/3908998906 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee40cdf10 msgr2=0x7f0ee40b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:30.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0ee3400640 1 --2- 172.21.15.49:0/3908998906 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee40cdf10 0x7f0ee40b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0ee3400640 1 -- 172.21.15.49:0/3908998906 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ee415b110 msgr2=0x7f0ee414f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:30.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0ee3400640 1 --2- 172.21.15.49:0/3908998906 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ee415b110 0x7f0ee414f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0ee3400640 1 -- 172.21.15.49:0/3908998906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed4009420 con 0x7f0ee40714e0 2024-01-31T05:04:30.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0ee3400640 1 --2- 172.21.15.49:0/3908998906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ee40714e0 0x7f0ee40b38d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0ed401ab00 tx=0x7f0ed401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:30.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0edb400640 1 -- 172.21.15.49:0/3908998906 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40b5810 con 0x7f0ee40714e0 2024-01-31T05:04:30.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0edb400640 1 -- 172.21.15.49:0/3908998906 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed40b5970 con 0x7f0ee40714e0 2024-01-31T05:04:30.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0edb400640 1 -- 172.21.15.49:0/3908998906 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40b5d20 con 0x7f0ee40714e0 2024-01-31T05:04:30.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0eea000640 1 -- 172.21.15.49:0/3908998906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee40b2b30 con 0x7f0ee40714e0 2024-01-31T05:04:30.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0eea000640 1 -- 172.21.15.49:0/3908998906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee40b30f0 con 0x7f0ee40714e0 2024-01-31T05:04:30.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.503+0000 7f0eea000640 1 -- 172.21.15.49:0/3908998906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee4074860 con 0x7f0ee40714e0 2024-01-31T05:04:30.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.507+0000 7f0edb400640 1 -- 172.21.15.49:0/3908998906 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f0ed40b4390 con 0x7f0ee40714e0 2024-01-31T05:04:30.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.507+0000 7f0edb400640 1 --2- 172.21.15.49:0/3908998906 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0ebc066500 0x7f0ebc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:30.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.507+0000 7f0edb400640 1 -- 172.21.15.49:0/3908998906 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0ed411e6b0 con 0x7f0ee40714e0 2024-01-31T05:04:30.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.507+0000 7f0ee2a00640 1 --2- 172.21.15.49:0/3908998906 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0ebc066500 0x7f0ebc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:30.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.507+0000 7f0ee2a00640 1 --2- 172.21.15.49:0/3908998906 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0ebc066500 0x7f0ebc0689c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0ee414d2f0 tx=0x7f0ecc007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:30.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.511+0000 7f0edb400640 1 -- 172.21.15.49:0/3908998906 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f0ed40eb650 con 0x7f0ee40714e0 2024-01-31T05:04:30.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.667+0000 7f0eea000640 1 -- 172.21.15.49:0/3908998906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ee40b17d0 con 0x7f0ee40714e0 2024-01-31T05:04:30.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.671+0000 7f0edb400640 1 -- 172.21.15.49:0/3908998906 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ed40eec70 con 0x7f0ee40714e0 2024-01-31T05:04:30.671 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-31T05:04:30.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.671+0000 7f0eea000640 1 -- 172.21.15.49:0/3908998906 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0ebc066500 msgr2=0x7f0ebc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:30.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.671+0000 7f0eea000640 1 --2- 172.21.15.49:0/3908998906 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0ebc066500 0x7f0ebc0689c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0ee414d2f0 tx=0x7f0ecc007970 comp rx=0 tx=0).stop 2024-01-31T05:04:30.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.671+0000 7f0eea000640 1 -- 172.21.15.49:0/3908998906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ee40714e0 msgr2=0x7f0ee40b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:30.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.671+0000 7f0eea000640 1 --2- 172.21.15.49:0/3908998906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ee40714e0 0x7f0ee40b38d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0ed401ab00 tx=0x7f0ed401ac90 comp rx=0 tx=0).stop 2024-01-31T05:04:30.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.671+0000 7f0eea000640 1 -- 172.21.15.49:0/3908998906 shutdown_connections 2024-01-31T05:04:30.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.671+0000 7f0eea000640 1 --2- 172.21.15.49:0/3908998906 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0ebc066500 0x7f0ebc0689c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.671+0000 7f0eea000640 1 --2- 172.21.15.49:0/3908998906 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ee415b110 0x7f0ee414f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.671+0000 7f0eea000640 1 --2- 172.21.15.49:0/3908998906 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee40cdf10 0x7f0ee40b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.671+0000 7f0eea000640 1 --2- 172.21.15.49:0/3908998906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ee40714e0 0x7f0ee40b38d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.671+0000 7f0eea000640 1 -- 172.21.15.49:0/3908998906 >> 172.21.15.49:0/3908998906 conn(0x7f0ee40b09a0 msgr2=0x7f0ee414e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.671+0000 7f0eea000640 1 -- 172.21.15.49:0/3908998906 shutdown_connections 2024-01-31T05:04:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.671+0000 7f0eea000640 1 -- 172.21.15.49:0/3908998906 wait complete. 2024-01-31T05:04:30.693 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-31T05:04:30.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.835+0000 7f2350c00640 1 Processor -- start 2024-01-31T05:04:30.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.835+0000 7f2350c00640 1 -- start start 2024-01-31T05:04:30.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.835+0000 7f2350c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f234c0cbbc0 0x7f234c168190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:30.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.835+0000 7f2350c00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234c0cef80 con 0x7f234c15d540 2024-01-31T05:04:30.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.835+0000 7f2350c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234c06cae0 con 0x7f234c0cff70 2024-01-31T05:04:30.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.835+0000 7f2350c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234c0d03d0 con 0x7f234c0cbbc0 2024-01-31T05:04:30.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.835+0000 7f2349e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f234c15d540 0x7f234c06c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:35172/0 (socket says 172.21.15.49:35172) 2024-01-31T05:04:30.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.835+0000 7f2349e00640 1 -- 172.21.15.49:0/2550652190 learned_addr learned my addr 172.21.15.49:0/2550652190 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:30.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.839+0000 7f234a800640 1 --2- 172.21.15.49:0/2550652190 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f234c0cbbc0 0x7f234c168190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:30.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.839+0000 7f2348a00640 1 -- 172.21.15.49:0/2550652190 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738107994 0 0) 0x7f234c0cef80 con 0x7f234c15d540 2024-01-31T05:04:30.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.839+0000 7f2348a00640 1 -- 172.21.15.49:0/2550652190 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f232c003530 con 0x7f234c15d540 2024-01-31T05:04:30.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.839+0000 7f2348a00640 1 -- 172.21.15.49:0/2550652190 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231477998 0 0) 0x7f234c06cae0 con 0x7f234c0cff70 2024-01-31T05:04:30.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.839+0000 7f2348a00640 1 -- 172.21.15.49:0/2550652190 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f234c0cef80 con 0x7f234c0cff70 2024-01-31T05:04:30.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.839+0000 7f234a800640 1 -- 172.21.15.49:0/2550652190 >> v1:172.21.15.195:6789/0 conn(0x7f234c0cff70 legacy=0x7f234c0cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:30.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.839+0000 7f234a800640 1 -- 172.21.15.49:0/2550652190 >> v1:172.21.15.49:6789/0 conn(0x7f234c15d540 legacy=0x7f234c06c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:30.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.839+0000 7f234a800640 1 -- 172.21.15.49:0/2550652190 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c0cf1b0 con 0x7f234c0cbbc0 2024-01-31T05:04:30.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.839+0000 7f234a800640 1 --2- 172.21.15.49:0/2550652190 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f234c0cbbc0 0x7f234c168190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2344009dc0 tx=0x7f234401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27d93e57afb377f7 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:30.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.839+0000 7f2348a00640 1 -- 172.21.15.49:0/2550652190 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23440a5a00 con 0x7f234c0cbbc0 2024-01-31T05:04:30.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.843+0000 7f2348a00640 1 -- 172.21.15.49:0/2550652190 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23440a5b60 con 0x7f234c0cbbc0 2024-01-31T05:04:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.843+0000 7f2348a00640 1 -- 172.21.15.49:0/2550652190 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23440ad440 con 0x7f234c0cbbc0 2024-01-31T05:04:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.843+0000 7f2350c00640 1 -- 172.21.15.49:0/2550652190 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f234c0cbbc0 msgr2=0x7f234c168190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.843+0000 7f2350c00640 1 --2- 172.21.15.49:0/2550652190 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f234c0cbbc0 0x7f234c168190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2344009dc0 tx=0x7f234401c940 comp rx=0 tx=0).stop 2024-01-31T05:04:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.843+0000 7f2350c00640 1 -- 172.21.15.49:0/2550652190 shutdown_connections 2024-01-31T05:04:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.843+0000 7f2350c00640 1 --2- 172.21.15.49:0/2550652190 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f234c0cbbc0 0x7f234c168190 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.843+0000 7f2350c00640 1 -- 172.21.15.49:0/2550652190 >> 172.21.15.49:0/2550652190 conn(0x7f234c0d0e60 msgr2=0x7f234c0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:30.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.843+0000 7f2350c00640 1 -- 172.21.15.49:0/2550652190 shutdown_connections 2024-01-31T05:04:30.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.843+0000 7f2350c00640 1 -- 172.21.15.49:0/2550652190 wait complete. 2024-01-31T05:04:30.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.843+0000 7f2350c00640 1 Processor -- start 2024-01-31T05:04:30.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.843+0000 7f2350c00640 1 -- start start 2024-01-31T05:04:30.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.843+0000 7f2350c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f234c0cbbc0 0x7f234c157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:30.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.843+0000 7f2350c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f234c0cff70 0x7f234c0c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:30.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.843+0000 7f2350c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f234c15d540 0x7f234c0c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:30.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.843+0000 7f2350c00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c1f6ca0 con 0x7f234c0cff70 2024-01-31T05:04:30.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.843+0000 7f2350c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c1f5dd0 con 0x7f234c15d540 2024-01-31T05:04:30.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.843+0000 7f2350c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234c1f6090 con 0x7f234c0cbbc0 2024-01-31T05:04:30.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.847+0000 7f2349400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f234c0cff70 0x7f234c0c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:30.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.847+0000 7f2349400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f234c0cff70 0x7f234c0c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42784/0 (socket says 172.21.15.49:42784) 2024-01-31T05:04:30.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.847+0000 7f2349400640 1 -- 172.21.15.49:0/545337589 learned_addr learned my addr 172.21.15.49:0/545337589 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:30.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.847+0000 7f234a800640 1 --2- 172.21.15.49:0/545337589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f234c15d540 0x7f234c0c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:30.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.847+0000 7f2349e00640 1 --2- 172.21.15.49:0/545337589 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f234c0cbbc0 0x7f234c157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:30.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.847+0000 7f2349400640 1 -- 172.21.15.49:0/545337589 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f234c0cbbc0 msgr2=0x7f234c157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:30.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.847+0000 7f2349400640 1 --2- 172.21.15.49:0/545337589 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f234c0cbbc0 0x7f234c157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.847+0000 7f2349400640 1 -- 172.21.15.49:0/545337589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f234c15d540 msgr2=0x7f234c0c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:30.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.847+0000 7f2349400640 1 --2- 172.21.15.49:0/545337589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f234c15d540 0x7f234c0c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:30.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.847+0000 7f2349400640 1 -- 172.21.15.49:0/545337589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2344009a70 con 0x7f234c0cff70 2024-01-31T05:04:30.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.847+0000 7f2349e00640 1 --2- 172.21.15.49:0/545337589 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f234c0cbbc0 0x7f234c157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:30.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.847+0000 7f2349400640 1 --2- 172.21.15.49:0/545337589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f234c0cff70 0x7f234c0c66c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f233400c500 tx=0x7f233400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:30.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.847+0000 7f2342000640 1 -- 172.21.15.49:0/545337589 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23340052d0 con 0x7f234c0cff70 2024-01-31T05:04:30.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.847+0000 7f2342000640 1 -- 172.21.15.49:0/545337589 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2334005450 con 0x7f234c0cff70 2024-01-31T05:04:30.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.847+0000 7f2342000640 1 -- 172.21.15.49:0/545337589 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334012870 con 0x7f234c0cff70 2024-01-31T05:04:30.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.847+0000 7f2350c00640 1 -- 172.21.15.49:0/545337589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234c1f6370 con 0x7f234c0cff70 2024-01-31T05:04:30.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.847+0000 7f2350c00640 1 -- 172.21.15.49:0/545337589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234c1f6930 con 0x7f234c0cff70 2024-01-31T05:04:30.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.847+0000 7f2350c00640 1 -- 172.21.15.49:0/545337589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f234c0ce880 con 0x7f234c0cff70 2024-01-31T05:04:30.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.847+0000 7f2342000640 1 -- 172.21.15.49:0/545337589 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f23340129d0 con 0x7f234c0cff70 2024-01-31T05:04:30.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.851+0000 7f2342000640 1 --2- 172.21.15.49:0/545337589 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2324066500 0x7f23240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:30.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.851+0000 7f2342000640 1 -- 172.21.15.49:0/545337589 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2334083e30 con 0x7f234c0cff70 2024-01-31T05:04:30.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.851+0000 7f2349e00640 1 --2- 172.21.15.49:0/545337589 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2324066500 0x7f23240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:30.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.851+0000 7f2349e00640 1 --2- 172.21.15.49:0/545337589 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2324066500 0x7f23240689c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f233c0011f0 tx=0x7f233c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:30.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:30.855+0000 7f2342000640 1 -- 172.21.15.49:0/545337589 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f2334050d50 con 0x7f234c0cff70 2024-01-31T05:04:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.011+0000 7f2350c00640 1 -- 172.21.15.49:0/545337589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f234c067c80 con 0x7f234c0cff70 2024-01-31T05:04:31.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.011+0000 7f2342000640 1 -- 172.21.15.49:0/545337589 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2334054370 con 0x7f234c0cff70 2024-01-31T05:04:31.014 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:04:31.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.015+0000 7f2350c00640 1 -- 172.21.15.49:0/545337589 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2324066500 msgr2=0x7f23240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:31.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.015+0000 7f2350c00640 1 --2- 172.21.15.49:0/545337589 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2324066500 0x7f23240689c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f233c0011f0 tx=0x7f233c009040 comp rx=0 tx=0).stop 2024-01-31T05:04:31.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.015+0000 7f2350c00640 1 -- 172.21.15.49:0/545337589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f234c0cff70 msgr2=0x7f234c0c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:31.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.015+0000 7f2350c00640 1 --2- 172.21.15.49:0/545337589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f234c0cff70 0x7f234c0c66c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f233400c500 tx=0x7f233400c9c0 comp rx=0 tx=0).stop 2024-01-31T05:04:31.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.015+0000 7f2350c00640 1 -- 172.21.15.49:0/545337589 shutdown_connections 2024-01-31T05:04:31.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.015+0000 7f2350c00640 1 --2- 172.21.15.49:0/545337589 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2324066500 0x7f23240689c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:31.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.015+0000 7f2350c00640 1 --2- 172.21.15.49:0/545337589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f234c15d540 0x7f234c0c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:31.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.015+0000 7f2350c00640 1 --2- 172.21.15.49:0/545337589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f234c0cff70 0x7f234c0c66c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:31.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.015+0000 7f2350c00640 1 --2- 172.21.15.49:0/545337589 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f234c0cbbc0 0x7f234c157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:31.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.015+0000 7f2350c00640 1 -- 172.21.15.49:0/545337589 >> 172.21.15.49:0/545337589 conn(0x7f234c0d0e60 msgr2=0x7f234c0b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:31.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.015+0000 7f2350c00640 1 -- 172.21.15.49:0/545337589 shutdown_connections 2024-01-31T05:04:31.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.015+0000 7f2350c00640 1 -- 172.21.15.49:0/545337589 wait complete. 2024-01-31T05:04:31.036 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-31T05:04:31.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.175+0000 7f2f1a200640 1 Processor -- start 2024-01-31T05:04:31.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.175+0000 7f2f1a200640 1 -- start start 2024-01-31T05:04:31.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.175+0000 7f2f1a200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f140b30e0 0x7f2f1415e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:31.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.175+0000 7f2f1a200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2f140b34c0 0x7f2f140720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:31.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.175+0000 7f2f1a200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f1406c2d0 0x7f2f140b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:31.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.175+0000 7f2f1a200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f140703c0 con 0x7f2f140b30e0 2024-01-31T05:04:31.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.175+0000 7f2f1a200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f140b1dd0 con 0x7f2f140b34c0 2024-01-31T05:04:31.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.175+0000 7f2f1a200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f14070610 con 0x7f2f1406c2d0 2024-01-31T05:04:31.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.175+0000 7f2f13400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f140b30e0 0x7f2f1415e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:31.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.175+0000 7f2f13400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f140b30e0 0x7f2f1415e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42796/0 (socket says 172.21.15.49:42796) 2024-01-31T05:04:31.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.175+0000 7f2f13400640 1 -- 172.21.15.49:0/672693925 learned_addr learned my addr 172.21.15.49:0/672693925 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:31.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.175+0000 7f2f13e00640 1 --2- 172.21.15.49:0/672693925 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f1406c2d0 0x7f2f140b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:31.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.175+0000 7f2f12a00640 1 --2- 172.21.15.49:0/672693925 >> v2:172.21.15.195:3300/0 conn(0x7f2f140b34c0 0x7f2f140720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:31.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.179+0000 7f2f13400640 1 -- 172.21.15.49:0/672693925 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f1406c2d0 msgr2=0x7f2f140b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:31.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.179+0000 7f2f13400640 1 --2- 172.21.15.49:0/672693925 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f1406c2d0 0x7f2f140b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:31.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.179+0000 7f2f13400640 1 -- 172.21.15.49:0/672693925 >> v2:172.21.15.195:3300/0 conn(0x7f2f140b34c0 msgr2=0x7f2f140720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:31.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.179+0000 7f2f13400640 1 --2- 172.21.15.49:0/672693925 >> v2:172.21.15.195:3300/0 conn(0x7f2f140b34c0 0x7f2f140720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:31.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.179+0000 7f2f13400640 1 -- 172.21.15.49:0/672693925 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f140708f0 con 0x7f2f140b30e0 2024-01-31T05:04:31.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.179+0000 7f2f12a00640 1 --2- 172.21.15.49:0/672693925 >> v2:172.21.15.195:3300/0 conn(0x7f2f140b34c0 0x7f2f140720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:31.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.179+0000 7f2f13400640 1 --2- 172.21.15.49:0/672693925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f140b30e0 0x7f2f1415e1c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2f1409d0d0 tx=0x7f2f0401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17db973543da7017 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:31.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.179+0000 7f2f12000640 1 -- 172.21.15.49:0/672693925 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f040ab600 con 0x7f2f140b30e0 2024-01-31T05:04:31.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.179+0000 7f2f12000640 1 -- 172.21.15.49:0/672693925 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f040a7050 con 0x7f2f140b30e0 2024-01-31T05:04:31.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.179+0000 7f2f12000640 1 -- 172.21.15.49:0/672693925 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f040ab980 con 0x7f2f140b30e0 2024-01-31T05:04:31.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f1a200640 1 -- 172.21.15.49:0/672693925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f140b30e0 msgr2=0x7f2f1415e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:31.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f1a200640 1 --2- 172.21.15.49:0/672693925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f140b30e0 0x7f2f1415e1c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2f1409d0d0 tx=0x7f2f0401c3e0 comp rx=0 tx=0).stop 2024-01-31T05:04:31.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f1a200640 1 -- 172.21.15.49:0/672693925 shutdown_connections 2024-01-31T05:04:31.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f1a200640 1 --2- 172.21.15.49:0/672693925 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f1406c2d0 0x7f2f140b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:31.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f1a200640 1 --2- 172.21.15.49:0/672693925 >> v2:172.21.15.195:3300/0 conn(0x7f2f140b34c0 0x7f2f140720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:31.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f1a200640 1 --2- 172.21.15.49:0/672693925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f140b30e0 0x7f2f1415e1c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:31.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f1a200640 1 -- 172.21.15.49:0/672693925 >> 172.21.15.49:0/672693925 conn(0x7f2f140b09a0 msgr2=0x7f2f140b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:31.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f1a200640 1 -- 172.21.15.49:0/672693925 shutdown_connections 2024-01-31T05:04:31.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f1a200640 1 -- 172.21.15.49:0/672693925 wait complete. 2024-01-31T05:04:31.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f1a200640 1 Processor -- start 2024-01-31T05:04:31.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f1a200640 1 -- start start 2024-01-31T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f1a200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f1406c2d0 0x7f2f14156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f1a200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f140b30e0 0x7f2f1414ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f1a200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f140b34c0 0x7f2f1409be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f1a200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f140ade50 con 0x7f2f140b30e0 2024-01-31T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f1a200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1414e810 con 0x7f2f1406c2d0 2024-01-31T05:04:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f1a200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1414eaf0 con 0x7f2f140b34c0 2024-01-31T05:04:31.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f12a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f140b30e0 0x7f2f1414ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:31.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f12a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f140b30e0 0x7f2f1414ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42808/0 (socket says 172.21.15.49:42808) 2024-01-31T05:04:31.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f12a00640 1 -- 172.21.15.49:0/2968280459 learned_addr learned my addr 172.21.15.49:0/2968280459 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:31.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f13e00640 1 --2- 172.21.15.49:0/2968280459 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f140b34c0 0x7f2f1409be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:31.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f13400640 1 --2- 172.21.15.49:0/2968280459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f1406c2d0 0x7f2f14156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:31.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f12a00640 1 -- 172.21.15.49:0/2968280459 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f140b34c0 msgr2=0x7f2f1409be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:31.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f12a00640 1 --2- 172.21.15.49:0/2968280459 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f140b34c0 0x7f2f1409be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:31.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f12a00640 1 -- 172.21.15.49:0/2968280459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f1406c2d0 msgr2=0x7f2f14156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:31.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f12a00640 1 --2- 172.21.15.49:0/2968280459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f1406c2d0 0x7f2f14156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:31.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.183+0000 7f2f12a00640 1 -- 172.21.15.49:0/2968280459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f040094d0 con 0x7f2f140b30e0 2024-01-31T05:04:31.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.187+0000 7f2f12a00640 1 --2- 172.21.15.49:0/2968280459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f140b30e0 0x7f2f1414ddc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00d800 tx=0x7f2efc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:31.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.187+0000 7f2f0b400640 1 -- 172.21.15.49:0/2968280459 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0096c0 con 0x7f2f140b30e0 2024-01-31T05:04:31.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.187+0000 7f2f0b400640 1 -- 172.21.15.49:0/2968280459 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc009820 con 0x7f2f140b30e0 2024-01-31T05:04:31.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.187+0000 7f2f1a200640 1 -- 172.21.15.49:0/2968280459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f140adae0 con 0x7f2f140b30e0 2024-01-31T05:04:31.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.187+0000 7f2f0b400640 1 -- 172.21.15.49:0/2968280459 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc009bd0 con 0x7f2f140b30e0 2024-01-31T05:04:31.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.187+0000 7f2f1a200640 1 -- 172.21.15.49:0/2968280459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f14146090 con 0x7f2f140b30e0 2024-01-31T05:04:31.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.187+0000 7f2f1a200640 1 -- 172.21.15.49:0/2968280459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f140adfc0 con 0x7f2f140b30e0 2024-01-31T05:04:31.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.187+0000 7f2f0b400640 1 -- 172.21.15.49:0/2968280459 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f2efc009d30 con 0x7f2f140b30e0 2024-01-31T05:04:31.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.187+0000 7f2f0b400640 1 --2- 172.21.15.49:0/2968280459 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2eec066530 0x7f2eec0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:31.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.187+0000 7f2f0b400640 1 -- 172.21.15.49:0/2968280459 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2efc084750 con 0x7f2f140b30e0 2024-01-31T05:04:31.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.187+0000 7f2f13400640 1 --2- 172.21.15.49:0/2968280459 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2eec066530 0x7f2eec0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:31.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.191+0000 7f2f13400640 1 --2- 172.21.15.49:0/2968280459 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2eec066530 0x7f2eec0689f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2f14072e10 tx=0x7f2f04008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:31.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.191+0000 7f2f0b400640 1 -- 172.21.15.49:0/2968280459 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f2efc051840 con 0x7f2f140b30e0 2024-01-31T05:04:31.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.363+0000 7f2f1a200640 1 -- 172.21.15.49:0/2968280459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2f140adc70 con 0x7f2f140b30e0 2024-01-31T05:04:31.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.363+0000 7f2f0b400640 1 -- 172.21.15.49:0/2968280459 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2efc054e60 con 0x7f2f140b30e0 2024-01-31T05:04:31.364 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2024-01-31T05:04:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.363+0000 7f2f1a200640 1 -- 172.21.15.49:0/2968280459 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2eec066530 msgr2=0x7f2eec0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.363+0000 7f2f1a200640 1 --2- 172.21.15.49:0/2968280459 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2eec066530 0x7f2eec0689f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2f14072e10 tx=0x7f2f04008040 comp rx=0 tx=0).stop 2024-01-31T05:04:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.363+0000 7f2f1a200640 1 -- 172.21.15.49:0/2968280459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f140b30e0 msgr2=0x7f2f1414ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.363+0000 7f2f1a200640 1 --2- 172.21.15.49:0/2968280459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f140b30e0 0x7f2f1414ddc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00d800 tx=0x7f2efc00dcc0 comp rx=0 tx=0).stop 2024-01-31T05:04:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.363+0000 7f2f1a200640 1 -- 172.21.15.49:0/2968280459 shutdown_connections 2024-01-31T05:04:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.363+0000 7f2f1a200640 1 --2- 172.21.15.49:0/2968280459 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f140b34c0 0x7f2f1409be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.363+0000 7f2f1a200640 1 --2- 172.21.15.49:0/2968280459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f140b30e0 0x7f2f1414ddc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.363+0000 7f2f1a200640 1 --2- 172.21.15.49:0/2968280459 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2eec066530 0x7f2eec0689f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.363+0000 7f2f1a200640 1 --2- 172.21.15.49:0/2968280459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f1406c2d0 0x7f2f14156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:31.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.363+0000 7f2f1a200640 1 -- 172.21.15.49:0/2968280459 >> 172.21.15.49:0/2968280459 conn(0x7f2f140b09a0 msgr2=0x7f2f140b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:31.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.363+0000 7f2f1a200640 1 -- 172.21.15.49:0/2968280459 shutdown_connections 2024-01-31T05:04:31.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:31.363+0000 7f2f1a200640 1 -- 172.21.15.49:0/2968280459 wait complete. 2024-01-31T05:04:31.386 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-01-31T05:04:31.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:31.386 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-01-31T05:04:31.417 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi049.stderr:ceph-fuse[31968]: fuse finished with error 0 and tester_r 0 2024-01-31T05:04:31.420 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T05:04:37.521 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-31T05:04:37.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:37.522 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-01-31T05:04:37.542 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:04:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.731+0000 7f7201400640 1 Processor -- start 2024-01-31T05:04:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.731+0000 7f7201400640 1 -- start start 2024-01-31T05:04:37.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.731+0000 7f7201400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f71fc0b30e0 0x7f71fc15e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:37.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.731+0000 7f7201400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f71fc0b34c0 0x7f71fc0720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:37.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.731+0000 7f7201400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71fc06c2d0 0x7f71fc0b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:37.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.731+0000 7f7201400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71fc0703c0 con 0x7f71fc0b34c0 2024-01-31T05:04:37.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.731+0000 7f7201400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71fc0b1dd0 con 0x7f71fc0b30e0 2024-01-31T05:04:37.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.731+0000 7f7201400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc070610 con 0x7f71fc06c2d0 2024-01-31T05:04:37.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.731+0000 7f71f9e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f71fc0b34c0 0x7f71fc0720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:37.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.731+0000 7f71f9e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f71fc0b34c0 0x7f71fc0720e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42818/0 (socket says 172.21.15.49:42818) 2024-01-31T05:04:37.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.731+0000 7f71f9e00640 1 -- 172.21.15.49:0/1414824683 learned_addr learned my addr 172.21.15.49:0/1414824683 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:37.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.735+0000 7f71fa800640 1 --2- 172.21.15.49:0/1414824683 >> v2:172.21.15.195:3300/0 conn(0x7f71fc0b30e0 0x7f71fc15e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:37.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.735+0000 7f71fb200640 1 --2- 172.21.15.49:0/1414824683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71fc06c2d0 0x7f71fc0b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:37.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.735+0000 7f71f9e00640 1 -- 172.21.15.49:0/1414824683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71fc06c2d0 msgr2=0x7f71fc0b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:37.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.735+0000 7f71f9e00640 1 --2- 172.21.15.49:0/1414824683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71fc06c2d0 0x7f71fc0b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:37.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.735+0000 7f71f9e00640 1 -- 172.21.15.49:0/1414824683 >> v2:172.21.15.195:3300/0 conn(0x7f71fc0b30e0 msgr2=0x7f71fc15e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:37.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.735+0000 7f71f9e00640 1 --2- 172.21.15.49:0/1414824683 >> v2:172.21.15.195:3300/0 conn(0x7f71fc0b30e0 0x7f71fc15e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:37.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.735+0000 7f71f9e00640 1 -- 172.21.15.49:0/1414824683 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc0708f0 con 0x7f71fc0b34c0 2024-01-31T05:04:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.735+0000 7f71f9e00640 1 --2- 172.21.15.49:0/1414824683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc0b34c0 0x7f71fc0720e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f71fc072e10 tx=0x7f71e401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66d5eb893198954 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.735+0000 7f71f9400640 1 -- 172.21.15.49:0/1414824683 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40ab600 con 0x7f71fc0b34c0 2024-01-31T05:04:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.735+0000 7f71f9400640 1 -- 172.21.15.49:0/1414824683 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e40a7050 con 0x7f71fc0b34c0 2024-01-31T05:04:37.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.735+0000 7f71f9400640 1 -- 172.21.15.49:0/1414824683 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40ab980 con 0x7f71fc0b34c0 2024-01-31T05:04:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f7201400640 1 -- 172.21.15.49:0/1414824683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc0b34c0 msgr2=0x7f71fc0720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f7201400640 1 --2- 172.21.15.49:0/1414824683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc0b34c0 0x7f71fc0720e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f71fc072e10 tx=0x7f71e401c3e0 comp rx=0 tx=0).stop 2024-01-31T05:04:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f7201400640 1 -- 172.21.15.49:0/1414824683 shutdown_connections 2024-01-31T05:04:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f7201400640 1 --2- 172.21.15.49:0/1414824683 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71fc06c2d0 0x7f71fc0b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f7201400640 1 --2- 172.21.15.49:0/1414824683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc0b34c0 0x7f71fc0720e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f7201400640 1 --2- 172.21.15.49:0/1414824683 >> v2:172.21.15.195:3300/0 conn(0x7f71fc0b30e0 0x7f71fc15e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f7201400640 1 -- 172.21.15.49:0/1414824683 >> 172.21.15.49:0/1414824683 conn(0x7f71fc0b09a0 msgr2=0x7f71fc0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f7201400640 1 -- 172.21.15.49:0/1414824683 shutdown_connections 2024-01-31T05:04:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f7201400640 1 -- 172.21.15.49:0/1414824683 wait complete. 2024-01-31T05:04:37.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f7201400640 1 Processor -- start 2024-01-31T05:04:37.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f7201400640 1 -- start start 2024-01-31T05:04:37.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f7201400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71fc06c2d0 0x7f71fc14c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:37.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f7201400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc0b30e0 0x7f71fc09bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f7201400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71fc0b34c0 0x7f71fc0ae970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f7201400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc09b950 con 0x7f71fc0b30e0 2024-01-31T05:04:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f7201400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc14cd90 con 0x7f71fc06c2d0 2024-01-31T05:04:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f7201400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc0addc0 con 0x7f71fc0b34c0 2024-01-31T05:04:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f71f9e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc0b30e0 0x7f71fc09bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f71f9e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc0b30e0 0x7f71fc09bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42828/0 (socket says 172.21.15.49:42828) 2024-01-31T05:04:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f71f9e00640 1 -- 172.21.15.49:0/275796530 learned_addr learned my addr 172.21.15.49:0/275796530 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f71fb200640 1 --2- 172.21.15.49:0/275796530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71fc0b34c0 0x7f71fc0ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f71fa800640 1 --2- 172.21.15.49:0/275796530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71fc06c2d0 0x7f71fc14c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f71f9e00640 1 -- 172.21.15.49:0/275796530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71fc0b34c0 msgr2=0x7f71fc0ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:37.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f71f9e00640 1 --2- 172.21.15.49:0/275796530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71fc0b34c0 0x7f71fc0ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:37.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f71f9e00640 1 -- 172.21.15.49:0/275796530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71fc06c2d0 msgr2=0x7f71fc14c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:37.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f71f9e00640 1 --2- 172.21.15.49:0/275796530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71fc06c2d0 0x7f71fc14c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:37.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.739+0000 7f71f9e00640 1 -- 172.21.15.49:0/275796530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e40094d0 con 0x7f71fc0b30e0 2024-01-31T05:04:37.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.743+0000 7f71f9e00640 1 --2- 172.21.15.49:0/275796530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc0b30e0 0x7f71fc09bde0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f71e401aa90 tx=0x7f71fc072830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:37.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.743+0000 7f71f2a00640 1 -- 172.21.15.49:0/275796530 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40ac220 con 0x7f71fc0b30e0 2024-01-31T05:04:37.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.743+0000 7f71f2a00640 1 -- 172.21.15.49:0/275796530 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e40aa5b0 con 0x7f71fc0b30e0 2024-01-31T05:04:37.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.743+0000 7f7201400640 1 -- 172.21.15.49:0/275796530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71fc0ad800 con 0x7f71fc0b30e0 2024-01-31T05:04:37.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.743+0000 7f71f2a00640 1 -- 172.21.15.49:0/275796530 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40aa960 con 0x7f71fc0b30e0 2024-01-31T05:04:37.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.743+0000 7f7201400640 1 -- 172.21.15.49:0/275796530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71fc09b5e0 con 0x7f71fc0b30e0 2024-01-31T05:04:37.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.743+0000 7f7201400640 1 -- 172.21.15.49:0/275796530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71fc074860 con 0x7f71fc0b30e0 2024-01-31T05:04:37.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.743+0000 7f71f2a00640 1 -- 172.21.15.49:0/275796530 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f71e40b2070 con 0x7f71fc0b30e0 2024-01-31T05:04:37.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.743+0000 7f71f2a00640 1 --2- 172.21.15.49:0/275796530 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f71d4066500 0x7f71d40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:37.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.747+0000 7f71f2a00640 1 -- 172.21.15.49:0/275796530 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f71e411df90 con 0x7f71fc0b30e0 2024-01-31T05:04:37.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.747+0000 7f71fa800640 1 --2- 172.21.15.49:0/275796530 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f71d4066500 0x7f71d40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:37.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.747+0000 7f71fa800640 1 --2- 172.21.15.49:0/275796530 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f71d4066500 0x7f71d40689c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00b930 tx=0x7f71ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:37.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.751+0000 7f71f2a00640 1 -- 172.21.15.49:0/275796530 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f71e40eaf30 con 0x7f71fc0b30e0 2024-01-31T05:04:37.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.911+0000 7f7201400640 1 -- 172.21.15.49:0/275796530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71fc15e270 con 0x7f71fc0b30e0 2024-01-31T05:04:37.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.911+0000 7f71f2a00640 1 -- 172.21.15.49:0/275796530 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18323 (secure 0 0 0) 0x7f71e40ee550 con 0x7f71fc0b30e0 2024-01-31T05:04:37.913 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:37.914 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:20.695841+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:04:37.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.915+0000 7f7201400640 1 -- 172.21.15.49:0/275796530 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f71d4066500 msgr2=0x7f71d40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:37.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.915+0000 7f7201400640 1 --2- 172.21.15.49:0/275796530 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f71d4066500 0x7f71d40689c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00b930 tx=0x7f71ec008040 comp rx=0 tx=0).stop 2024-01-31T05:04:37.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.915+0000 7f7201400640 1 -- 172.21.15.49:0/275796530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc0b30e0 msgr2=0x7f71fc09bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:37.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.915+0000 7f7201400640 1 --2- 172.21.15.49:0/275796530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc0b30e0 0x7f71fc09bde0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f71e401aa90 tx=0x7f71fc072830 comp rx=0 tx=0).stop 2024-01-31T05:04:37.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.915+0000 7f7201400640 1 -- 172.21.15.49:0/275796530 shutdown_connections 2024-01-31T05:04:37.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.915+0000 7f7201400640 1 --2- 172.21.15.49:0/275796530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71fc0b34c0 0x7f71fc0ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:37.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.915+0000 7f7201400640 1 --2- 172.21.15.49:0/275796530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc0b30e0 0x7f71fc09bde0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:37.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.915+0000 7f7201400640 1 --2- 172.21.15.49:0/275796530 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f71d4066500 0x7f71d40689c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:37.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.915+0000 7f7201400640 1 --2- 172.21.15.49:0/275796530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71fc06c2d0 0x7f71fc14c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:37.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.915+0000 7f7201400640 1 -- 172.21.15.49:0/275796530 >> 172.21.15.49:0/275796530 conn(0x7f71fc0b09a0 msgr2=0x7f71fc151300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:37.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.915+0000 7f7201400640 1 -- 172.21.15.49:0/275796530 shutdown_connections 2024-01-31T05:04:37.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:37.915+0000 7f7201400640 1 -- 172.21.15.49:0/275796530 wait complete. 2024-01-31T05:04:37.936 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:04:38.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.075+0000 7fe690200640 1 Processor -- start 2024-01-31T05:04:38.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.075+0000 7fe690200640 1 -- start start 2024-01-31T05:04:38.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.075+0000 7fe690200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe6880715e0 0x7fe6880cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:38.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.075+0000 7fe690200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe68806c2d0 0x7fe6880ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:38.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.075+0000 7fe690200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe688071e40 con 0x7fe68815a000 2024-01-31T05:04:38.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.075+0000 7fe690200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6880b3760 con 0x7fe68806c2d0 2024-01-31T05:04:38.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.075+0000 7fe690200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68806c990 con 0x7fe6880715e0 2024-01-31T05:04:38.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.075+0000 7fe68e200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe68806c2d0 0x7fe6880ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:38.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.075+0000 7fe68e200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fe68806c2d0 0x7fe6880ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42832/0 (socket says 172.21.15.49:42832) 2024-01-31T05:04:38.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.075+0000 7fe68e200640 1 -- 172.21.15.49:0/1956490022 learned_addr learned my addr 172.21.15.49:0/1956490022 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:38.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.079+0000 7fe68ce00640 1 --2- 172.21.15.49:0/1956490022 >> v2:172.21.15.195:3300/0 conn(0x7fe6880715e0 0x7fe6880cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:38.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.079+0000 7fe68e200640 1 -- 172.21.15.49:0/1956490022 >> v2:172.21.15.195:3300/0 conn(0x7fe6880715e0 msgr2=0x7fe6880cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:38.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.079+0000 7fe68e200640 1 --2- 172.21.15.49:0/1956490022 >> v2:172.21.15.195:3300/0 conn(0x7fe6880715e0 0x7fe6880cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:38.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.079+0000 7fe68e200640 1 -- 172.21.15.49:0/1956490022 >> v1:172.21.15.195:6789/0 conn(0x7fe68815a000 legacy=0x7fe688070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:38.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.079+0000 7fe68e200640 1 -- 172.21.15.49:0/1956490022 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68815a3e0 con 0x7fe68806c2d0 2024-01-31T05:04:38.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.079+0000 7fe68e200640 1 --2- 172.21.15.49:0/1956490022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe68806c2d0 0x7fe6880ac8d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe688072e80 tx=0x7fe68001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2cb335a4a073e50 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:38.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.079+0000 7fe687e00640 1 -- 172.21.15.49:0/1956490022 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6800a5890 con 0x7fe68806c2d0 2024-01-31T05:04:38.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.079+0000 7fe687e00640 1 -- 172.21.15.49:0/1956490022 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6800a59f0 con 0x7fe68806c2d0 2024-01-31T05:04:38.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.079+0000 7fe687e00640 1 -- 172.21.15.49:0/1956490022 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6800a5d80 con 0x7fe68806c2d0 2024-01-31T05:04:38.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe690200640 1 -- 172.21.15.49:0/1956490022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe68806c2d0 msgr2=0x7fe6880ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:38.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe690200640 1 --2- 172.21.15.49:0/1956490022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe68806c2d0 0x7fe6880ac8d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe688072e80 tx=0x7fe68001c9d0 comp rx=0 tx=0).stop 2024-01-31T05:04:38.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe690200640 1 -- 172.21.15.49:0/1956490022 shutdown_connections 2024-01-31T05:04:38.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe690200640 1 --2- 172.21.15.49:0/1956490022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe68806c2d0 0x7fe6880ac8d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:38.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe690200640 1 --2- 172.21.15.49:0/1956490022 >> v2:172.21.15.195:3300/0 conn(0x7fe6880715e0 0x7fe6880cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:38.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe690200640 1 -- 172.21.15.49:0/1956490022 >> 172.21.15.49:0/1956490022 conn(0x7fe6880b09a0 msgr2=0x7fe6880b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:38.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe690200640 1 -- 172.21.15.49:0/1956490022 shutdown_connections 2024-01-31T05:04:38.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe690200640 1 -- 172.21.15.49:0/1956490022 wait complete. 2024-01-31T05:04:38.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe690200640 1 Processor -- start 2024-01-31T05:04:38.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe690200640 1 -- start start 2024-01-31T05:04:38.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe690200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe68806c2d0 0x7fe68814f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:38.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe690200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6880715e0 0x7fe688157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:38.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe690200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe68815a000 0x7fe688158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:38.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe690200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe688162db0 con 0x7fe6880715e0 2024-01-31T05:04:38.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe690200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68814fdc0 con 0x7fe68815a000 2024-01-31T05:04:38.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe690200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe688161ff0 con 0x7fe68806c2d0 2024-01-31T05:04:38.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe68ce00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6880715e0 0x7fe688157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:38.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe68ce00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6880715e0 0x7fe688157e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42840/0 (socket says 172.21.15.49:42840) 2024-01-31T05:04:38.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe68ce00640 1 -- 172.21.15.49:0/1860157072 learned_addr learned my addr 172.21.15.49:0/1860157072 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:38.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe68d800640 1 --2- 172.21.15.49:0/1860157072 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe68806c2d0 0x7fe68814f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:38.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe68e200640 1 --2- 172.21.15.49:0/1860157072 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe68815a000 0x7fe688158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:38.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe68ce00640 1 -- 172.21.15.49:0/1860157072 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe68806c2d0 msgr2=0x7fe68814f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:38.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe68ce00640 1 --2- 172.21.15.49:0/1860157072 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe68806c2d0 0x7fe68814f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:38.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe68ce00640 1 -- 172.21.15.49:0/1860157072 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe68815a000 msgr2=0x7fe688158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:38.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe68ce00640 1 --2- 172.21.15.49:0/1860157072 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe68815a000 0x7fe688158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:38.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.083+0000 7fe68ce00640 1 -- 172.21.15.49:0/1860157072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe680009b30 con 0x7fe6880715e0 2024-01-31T05:04:38.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.087+0000 7fe68ce00640 1 --2- 172.21.15.49:0/1860157072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6880715e0 0x7fe688157e40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe67000d800 tx=0x7fe67000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:38.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.087+0000 7fe685600640 1 -- 172.21.15.49:0/1860157072 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67000b6c0 con 0x7fe6880715e0 2024-01-31T05:04:38.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.087+0000 7fe685600640 1 -- 172.21.15.49:0/1860157072 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67000b860 con 0x7fe6880715e0 2024-01-31T05:04:38.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.087+0000 7fe685600640 1 -- 172.21.15.49:0/1860157072 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67000bc10 con 0x7fe6880715e0 2024-01-31T05:04:38.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.087+0000 7fe690200640 1 -- 172.21.15.49:0/1860157072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6881622d0 con 0x7fe6880715e0 2024-01-31T05:04:38.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.087+0000 7fe690200640 1 -- 172.21.15.49:0/1860157072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe688162890 con 0x7fe6880715e0 2024-01-31T05:04:38.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.087+0000 7fe690200640 1 -- 172.21.15.49:0/1860157072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe688074860 con 0x7fe6880715e0 2024-01-31T05:04:38.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.087+0000 7fe685600640 1 -- 172.21.15.49:0/1860157072 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fe67001e460 con 0x7fe6880715e0 2024-01-31T05:04:38.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.087+0000 7fe685600640 1 --2- 172.21.15.49:0/1860157072 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe660066500 0x7fe6600689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:38.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.087+0000 7fe685600640 1 -- 172.21.15.49:0/1860157072 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe670084620 con 0x7fe6880715e0 2024-01-31T05:04:38.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.087+0000 7fe68d800640 1 --2- 172.21.15.49:0/1860157072 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe660066500 0x7fe6600689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:38.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.091+0000 7fe68d800640 1 --2- 172.21.15.49:0/1860157072 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe660066500 0x7fe6600689c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe6880caf10 tx=0x7fe678009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:38.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.091+0000 7fe685600640 1 -- 172.21.15.49:0/1860157072 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fe670051670 con 0x7fe6880715e0 2024-01-31T05:04:38.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.255+0000 7fe690200640 1 -- 172.21.15.49:0/1860157072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe688156690 con 0x7fe6880715e0 2024-01-31T05:04:38.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.255+0000 7fe685600640 1 -- 172.21.15.49:0/1860157072 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18323 (secure 0 0 0) 0x7fe670054c90 con 0x7fe6880715e0 2024-01-31T05:04:38.257 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:38.257 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:20.695841+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:04:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.259+0000 7fe690200640 1 -- 172.21.15.49:0/1860157072 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe660066500 msgr2=0x7fe6600689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.259+0000 7fe690200640 1 --2- 172.21.15.49:0/1860157072 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe660066500 0x7fe6600689c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe6880caf10 tx=0x7fe678009040 comp rx=0 tx=0).stop 2024-01-31T05:04:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.259+0000 7fe690200640 1 -- 172.21.15.49:0/1860157072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6880715e0 msgr2=0x7fe688157e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.259+0000 7fe690200640 1 --2- 172.21.15.49:0/1860157072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6880715e0 0x7fe688157e40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe67000d800 tx=0x7fe67000dcc0 comp rx=0 tx=0).stop 2024-01-31T05:04:38.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.259+0000 7fe690200640 1 -- 172.21.15.49:0/1860157072 shutdown_connections 2024-01-31T05:04:38.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.259+0000 7fe690200640 1 --2- 172.21.15.49:0/1860157072 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe660066500 0x7fe6600689c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:38.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.259+0000 7fe690200640 1 --2- 172.21.15.49:0/1860157072 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe68815a000 0x7fe688158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:38.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.259+0000 7fe690200640 1 --2- 172.21.15.49:0/1860157072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6880715e0 0x7fe688157e40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:38.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.259+0000 7fe690200640 1 --2- 172.21.15.49:0/1860157072 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe68806c2d0 0x7fe68814f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:38.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.259+0000 7fe690200640 1 -- 172.21.15.49:0/1860157072 >> 172.21.15.49:0/1860157072 conn(0x7fe6880b09a0 msgr2=0x7fe6880703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:38.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.259+0000 7fe690200640 1 -- 172.21.15.49:0/1860157072 shutdown_connections 2024-01-31T05:04:38.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.259+0000 7fe690200640 1 -- 172.21.15.49:0/1860157072 wait complete. 2024-01-31T05:04:38.279 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-31T05:04:38.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.419+0000 7f52abc00640 1 Processor -- start 2024-01-31T05:04:38.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.419+0000 7f52abc00640 1 -- start start 2024-01-31T05:04:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.423+0000 7f52abc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52a4159790 0x7f52a40b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.423+0000 7f52abc00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a4159b70 con 0x7f52a40b3d00 2024-01-31T05:04:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.423+0000 7f52abc00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a40b2750 con 0x7f52a4070d70 2024-01-31T05:04:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.423+0000 7f52abc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a40b2a30 con 0x7f52a4159790 2024-01-31T05:04:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.423+0000 7f52a3e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f52a40b3d00 0x7f52a4070660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57672/0 (socket says 172.21.15.49:57672) 2024-01-31T05:04:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.423+0000 7f52a3e00640 1 -- 172.21.15.49:0/3814338727 learned_addr learned my addr 172.21.15.49:0/3814338727 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.423+0000 7f52a9200640 1 --2- 172.21.15.49:0/3814338727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52a4159790 0x7f52a40b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.423+0000 7f52a3400640 1 -- 172.21.15.49:0/3814338727 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3467627766 0 0) 0x7f52a4159b70 con 0x7f52a40b3d00 2024-01-31T05:04:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.423+0000 7f52a3400640 1 -- 172.21.15.49:0/3814338727 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5284003530 con 0x7f52a40b3d00 2024-01-31T05:04:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.423+0000 7f52a3400640 1 -- 172.21.15.49:0/3814338727 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066848905 0 0) 0x7f52a40b2750 con 0x7f52a4070d70 2024-01-31T05:04:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.423+0000 7f52a3400640 1 -- 172.21.15.49:0/3814338727 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52a4159b70 con 0x7f52a4070d70 2024-01-31T05:04:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.423+0000 7f52a9200640 1 -- 172.21.15.49:0/3814338727 >> v1:172.21.15.195:6789/0 conn(0x7f52a4070d70 legacy=0x7f52a40ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:38.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.423+0000 7f52a9200640 1 -- 172.21.15.49:0/3814338727 >> v1:172.21.15.49:6789/0 conn(0x7f52a40b3d00 legacy=0x7f52a4070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:38.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.423+0000 7f52a9200640 1 -- 172.21.15.49:0/3814338727 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a40b2d10 con 0x7f52a4159790 2024-01-31T05:04:38.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.427+0000 7f52a9200640 1 --2- 172.21.15.49:0/3814338727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52a4159790 0x7f52a40b37c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f529400a990 tx=0x7f529401c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85bd3c167e7536bb server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:38.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.427+0000 7f52a3400640 1 -- 172.21.15.49:0/3814338727 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52940a57a0 con 0x7f52a4159790 2024-01-31T05:04:38.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.427+0000 7f52a3400640 1 -- 172.21.15.49:0/3814338727 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52940a5900 con 0x7f52a4159790 2024-01-31T05:04:38.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.427+0000 7f52a3400640 1 -- 172.21.15.49:0/3814338727 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52940a5c90 con 0x7f52a4159790 2024-01-31T05:04:38.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.427+0000 7f52abc00640 1 -- 172.21.15.49:0/3814338727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52a4159790 msgr2=0x7f52a40b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:38.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.427+0000 7f52abc00640 1 --2- 172.21.15.49:0/3814338727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52a4159790 0x7f52a40b37c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f529400a990 tx=0x7f529401c760 comp rx=0 tx=0).stop 2024-01-31T05:04:38.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.427+0000 7f52abc00640 1 -- 172.21.15.49:0/3814338727 shutdown_connections 2024-01-31T05:04:38.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.427+0000 7f52abc00640 1 --2- 172.21.15.49:0/3814338727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52a4159790 0x7f52a40b37c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:38.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.427+0000 7f52abc00640 1 -- 172.21.15.49:0/3814338727 >> 172.21.15.49:0/3814338727 conn(0x7f52a40b09a0 msgr2=0x7f52a40b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:38.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.427+0000 7f52abc00640 1 -- 172.21.15.49:0/3814338727 shutdown_connections 2024-01-31T05:04:38.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.427+0000 7f52abc00640 1 -- 172.21.15.49:0/3814338727 wait complete. 2024-01-31T05:04:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52abc00640 1 Processor -- start 2024-01-31T05:04:38.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52abc00640 1 -- start start 2024-01-31T05:04:38.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52abc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52a4070d70 0x7f52a4140700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:38.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52abc00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52a40b3d00 0x7f52a40af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:38.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52abc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52a4159790 0x7f52a4099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:38.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52abc00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4140c40 con 0x7f52a40b3d00 2024-01-31T05:04:38.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52abc00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a415b080 con 0x7f52a4159790 2024-01-31T05:04:38.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52abc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a415b360 con 0x7f52a4070d70 2024-01-31T05:04:38.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52a3e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52a40b3d00 0x7f52a40af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:38.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52a3e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52a40b3d00 0x7f52a40af670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38308/0 (socket says 172.21.15.49:38308) 2024-01-31T05:04:38.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52a3e00640 1 -- 172.21.15.49:0/3765412005 learned_addr learned my addr 172.21.15.49:0/3765412005 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:38.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52a9200640 1 --2- 172.21.15.49:0/3765412005 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52a4070d70 0x7f52a4140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:38.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52a9c00640 1 --2- 172.21.15.49:0/3765412005 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52a4159790 0x7f52a4099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:38.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52a3e00640 1 -- 172.21.15.49:0/3765412005 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52a4070d70 msgr2=0x7f52a4140700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:38.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52a3e00640 1 --2- 172.21.15.49:0/3765412005 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52a4070d70 0x7f52a4140700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:38.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52a3e00640 1 -- 172.21.15.49:0/3765412005 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52a4159790 msgr2=0x7f52a4099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:38.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52a3e00640 1 --2- 172.21.15.49:0/3765412005 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52a4159790 0x7f52a4099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:38.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52a3e00640 1 -- 172.21.15.49:0/3765412005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529400a5c0 con 0x7f52a40b3d00 2024-01-31T05:04:38.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52a3e00640 1 --2- 172.21.15.49:0/3765412005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52a40b3d00 0x7f52a40af670 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f528c00c4d0 tx=0x7f528c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:38.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52a0c00640 1 -- 172.21.15.49:0/3765412005 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c005cf0 con 0x7f52a40b3d00 2024-01-31T05:04:38.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52a0c00640 1 -- 172.21.15.49:0/3765412005 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c005e50 con 0x7f52a40b3d00 2024-01-31T05:04:38.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52abc00640 1 -- 172.21.15.49:0/3765412005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a415b640 con 0x7f52a40b3d00 2024-01-31T05:04:38.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52a0c00640 1 -- 172.21.15.49:0/3765412005 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0072b0 con 0x7f52a40b3d00 2024-01-31T05:04:38.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52abc00640 1 -- 172.21.15.49:0/3765412005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a415bc00 con 0x7f52a40b3d00 2024-01-31T05:04:38.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.431+0000 7f52abc00640 1 -- 172.21.15.49:0/3765412005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a415be20 con 0x7f52a40b3d00 2024-01-31T05:04:38.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.435+0000 7f52a0c00640 1 -- 172.21.15.49:0/3765412005 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f528c007410 con 0x7f52a40b3d00 2024-01-31T05:04:38.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.435+0000 7f52a0c00640 1 --2- 172.21.15.49:0/3765412005 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f527c066500 0x7f527c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:38.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.435+0000 7f52a0c00640 1 -- 172.21.15.49:0/3765412005 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f528c083710 con 0x7f52a40b3d00 2024-01-31T05:04:38.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.435+0000 7f52a9200640 1 --2- 172.21.15.49:0/3765412005 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f527c066500 0x7f527c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:38.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.435+0000 7f52a9200640 1 --2- 172.21.15.49:0/3765412005 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f527c066500 0x7f527c0689c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f52940af000 tx=0x7f52940a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:38.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.439+0000 7f52a0c00640 1 -- 172.21.15.49:0/3765412005 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f528c050760 con 0x7f52a40b3d00 2024-01-31T05:04:38.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:38.635+0000 7f52abc00640 1 -- 172.21.15.49:0/3765412005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f52a4074860 con 0x7f52a40b3d00 2024-01-31T05:04:39.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.275+0000 7f52a0c00640 1 -- 172.21.15.49:0/3765412005 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f528c053d80 con 0x7f52a40b3d00 2024-01-31T05:04:39.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.279+0000 7f52abc00640 1 -- 172.21.15.49:0/3765412005 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f527c066500 msgr2=0x7f527c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:39.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.279+0000 7f52abc00640 1 --2- 172.21.15.49:0/3765412005 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f527c066500 0x7f527c0689c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f52940af000 tx=0x7f52940a7070 comp rx=0 tx=0).stop 2024-01-31T05:04:39.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.279+0000 7f52abc00640 1 -- 172.21.15.49:0/3765412005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52a40b3d00 msgr2=0x7f52a40af670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:39.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.279+0000 7f52abc00640 1 --2- 172.21.15.49:0/3765412005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52a40b3d00 0x7f52a40af670 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f528c00c4d0 tx=0x7f528c00c990 comp rx=0 tx=0).stop 2024-01-31T05:04:39.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.279+0000 7f52abc00640 1 -- 172.21.15.49:0/3765412005 shutdown_connections 2024-01-31T05:04:39.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.279+0000 7f52abc00640 1 --2- 172.21.15.49:0/3765412005 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f527c066500 0x7f527c0689c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:39.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.279+0000 7f52abc00640 1 --2- 172.21.15.49:0/3765412005 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52a4159790 0x7f52a4099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:39.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.279+0000 7f52abc00640 1 --2- 172.21.15.49:0/3765412005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52a40b3d00 0x7f52a40af670 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:39.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.279+0000 7f52abc00640 1 --2- 172.21.15.49:0/3765412005 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52a4070d70 0x7f52a4140700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:39.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.279+0000 7f52abc00640 1 -- 172.21.15.49:0/3765412005 >> 172.21.15.49:0/3765412005 conn(0x7f52a40b09a0 msgr2=0x7f52a4158960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:39.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.279+0000 7f52abc00640 1 -- 172.21.15.49:0/3765412005 shutdown_connections 2024-01-31T05:04:39.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.279+0000 7f52abc00640 1 -- 172.21.15.49:0/3765412005 wait complete. 2024-01-31T05:04:39.303 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-01-31T05:04:39.303 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-31T05:04:39.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.451+0000 7fbeb4c00640 1 Processor -- start 2024-01-31T05:04:39.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.451+0000 7fbeb4c00640 1 -- start start 2024-01-31T05:04:39.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.451+0000 7fbeb4c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbeb0070ac0 0x7fbeb00ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:39.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.451+0000 7fbeb4c00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb0159b70 con 0x7fbeb0159790 2024-01-31T05:04:39.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.451+0000 7fbeb4c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb00b2750 con 0x7fbeb0070660 2024-01-31T05:04:39.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.451+0000 7fbeb4c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb00b2a30 con 0x7fbeb0070ac0 2024-01-31T05:04:39.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.451+0000 7fbeade00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbeb0159790 0x7fbeb00b37c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57686/0 (socket says 172.21.15.49:57686) 2024-01-31T05:04:39.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.451+0000 7fbeade00640 1 -- 172.21.15.49:0/471780725 learned_addr learned my addr 172.21.15.49:0/471780725 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:39.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.451+0000 7fbeae800640 1 --2- 172.21.15.49:0/471780725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbeb0070ac0 0x7fbeb00ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:39.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.451+0000 7fbeaca00640 1 -- 172.21.15.49:0/471780725 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943987204 0 0) 0x7fbeb0159b70 con 0x7fbeb0159790 2024-01-31T05:04:39.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.451+0000 7fbeaca00640 1 -- 172.21.15.49:0/471780725 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe90003450 con 0x7fbeb0159790 2024-01-31T05:04:39.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.451+0000 7fbeaca00640 1 -- 172.21.15.49:0/471780725 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979367973 0 0) 0x7fbeb00b2750 con 0x7fbeb0070660 2024-01-31T05:04:39.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.451+0000 7fbeaca00640 1 -- 172.21.15.49:0/471780725 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeb0159b70 con 0x7fbeb0070660 2024-01-31T05:04:39.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.451+0000 7fbeae800640 1 -- 172.21.15.49:0/471780725 >> v1:172.21.15.195:6789/0 conn(0x7fbeb0070660 legacy=0x7fbeb00ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:39.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.451+0000 7fbeae800640 1 -- 172.21.15.49:0/471780725 >> v1:172.21.15.49:6789/0 conn(0x7fbeb0159790 legacy=0x7fbeb00b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:39.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.451+0000 7fbeae800640 1 -- 172.21.15.49:0/471780725 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb00b2d10 con 0x7fbeb0070ac0 2024-01-31T05:04:39.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.455+0000 7fbeae800640 1 --2- 172.21.15.49:0/471780725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbeb0070ac0 0x7fbeb00ac760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbea8009dc0 tx=0x7fbea801c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b915a34112ce3ed4 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:39.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.455+0000 7fbeaca00640 1 -- 172.21.15.49:0/471780725 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea80a5950 con 0x7fbeb0070ac0 2024-01-31T05:04:39.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.455+0000 7fbeaca00640 1 -- 172.21.15.49:0/471780725 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea80a5ab0 con 0x7fbeb0070ac0 2024-01-31T05:04:39.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.455+0000 7fbeaca00640 1 -- 172.21.15.49:0/471780725 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea80a5e40 con 0x7fbeb0070ac0 2024-01-31T05:04:39.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.455+0000 7fbeb4c00640 1 -- 172.21.15.49:0/471780725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbeb0070ac0 msgr2=0x7fbeb00ac760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:39.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.455+0000 7fbeb4c00640 1 --2- 172.21.15.49:0/471780725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbeb0070ac0 0x7fbeb00ac760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbea8009dc0 tx=0x7fbea801c910 comp rx=0 tx=0).stop 2024-01-31T05:04:39.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.455+0000 7fbeb4c00640 1 -- 172.21.15.49:0/471780725 shutdown_connections 2024-01-31T05:04:39.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.455+0000 7fbeb4c00640 1 --2- 172.21.15.49:0/471780725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbeb0070ac0 0x7fbeb00ac760 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:39.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.455+0000 7fbeb4c00640 1 -- 172.21.15.49:0/471780725 >> 172.21.15.49:0/471780725 conn(0x7fbeb00b09a0 msgr2=0x7fbeb00b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:39.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.455+0000 7fbeb4c00640 1 -- 172.21.15.49:0/471780725 shutdown_connections 2024-01-31T05:04:39.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.455+0000 7fbeb4c00640 1 -- 172.21.15.49:0/471780725 wait complete. 2024-01-31T05:04:39.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeb4c00640 1 Processor -- start 2024-01-31T05:04:39.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeb4c00640 1 -- start start 2024-01-31T05:04:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeb4c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbeb0070660 0x7fbeb0159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeb4c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbeb0070ac0 0x7fbeb0155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeb4c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbeb0159790 0x7fbeb0141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeb4c00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb015cbd0 con 0x7fbeb0070660 2024-01-31T05:04:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeb4c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb015c330 con 0x7fbeb0159790 2024-01-31T05:04:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeb4c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb015c610 con 0x7fbeb0070ac0 2024-01-31T05:04:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeade00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbeb0070660 0x7fbeb0159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeade00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbeb0070660 0x7fbeb0159e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38324/0 (socket says 172.21.15.49:38324) 2024-01-31T05:04:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeade00640 1 -- 172.21.15.49:0/2020792341 learned_addr learned my addr 172.21.15.49:0/2020792341 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbead400640 1 --2- 172.21.15.49:0/2020792341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbeb0070ac0 0x7fbeb0155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeae800640 1 --2- 172.21.15.49:0/2020792341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbeb0159790 0x7fbeb0141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeade00640 1 -- 172.21.15.49:0/2020792341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbeb0070ac0 msgr2=0x7fbeb0155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeade00640 1 --2- 172.21.15.49:0/2020792341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbeb0070ac0 0x7fbeb0155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeade00640 1 -- 172.21.15.49:0/2020792341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbeb0159790 msgr2=0x7fbeb0141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeade00640 1 --2- 172.21.15.49:0/2020792341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbeb0159790 0x7fbeb0141ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeade00640 1 -- 172.21.15.49:0/2020792341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea8009a70 con 0x7fbeb0070660 2024-01-31T05:04:39.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeade00640 1 --2- 172.21.15.49:0/2020792341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbeb0070660 0x7fbeb0159e40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbea000c420 tx=0x7fbea000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:39.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbea6000640 1 -- 172.21.15.49:0/2020792341 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea0005cf0 con 0x7fbeb0070660 2024-01-31T05:04:39.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbea6000640 1 -- 172.21.15.49:0/2020792341 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea0005e50 con 0x7fbeb0070660 2024-01-31T05:04:39.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbea6000640 1 -- 172.21.15.49:0/2020792341 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea0007310 con 0x7fbeb0070660 2024-01-31T05:04:39.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeb4c00640 1 -- 172.21.15.49:0/2020792341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb015c8f0 con 0x7fbeb0070660 2024-01-31T05:04:39.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.459+0000 7fbeb4c00640 1 -- 172.21.15.49:0/2020792341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb0142530 con 0x7fbeb0070660 2024-01-31T05:04:39.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.463+0000 7fbeb4c00640 1 -- 172.21.15.49:0/2020792341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb0074840 con 0x7fbeb0070660 2024-01-31T05:04:39.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.463+0000 7fbea6000640 1 -- 172.21.15.49:0/2020792341 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fbea0007470 con 0x7fbeb0070660 2024-01-31T05:04:39.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.463+0000 7fbea6000640 1 --2- 172.21.15.49:0/2020792341 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbe88066500 0x7fbe880689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:39.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.463+0000 7fbea6000640 1 -- 172.21.15.49:0/2020792341 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbea0083710 con 0x7fbeb0070660 2024-01-31T05:04:39.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.463+0000 7fbead400640 1 --2- 172.21.15.49:0/2020792341 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbe88066500 0x7fbe880689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:39.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.467+0000 7fbead400640 1 --2- 172.21.15.49:0/2020792341 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbe88066500 0x7fbe880689c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0149150 tx=0x7fbe98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:39.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.467+0000 7fbea6000640 1 -- 172.21.15.49:0/2020792341 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fbea0050760 con 0x7fbeb0070660 2024-01-31T05:04:39.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:39.663+0000 7fbeb4c00640 1 -- 172.21.15.49:0/2020792341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbeb006d5f0 con 0x7fbeb0070660 2024-01-31T05:04:40.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.275+0000 7fbea6000640 1 -- 172.21.15.49:0/2020792341 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbea0053d80 con 0x7fbeb0070660 2024-01-31T05:04:40.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.279+0000 7fbeb4c00640 1 -- 172.21.15.49:0/2020792341 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbe88066500 msgr2=0x7fbe880689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:40.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.279+0000 7fbeb4c00640 1 --2- 172.21.15.49:0/2020792341 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbe88066500 0x7fbe880689c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0149150 tx=0x7fbe98009040 comp rx=0 tx=0).stop 2024-01-31T05:04:40.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.279+0000 7fbeb4c00640 1 -- 172.21.15.49:0/2020792341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbeb0070660 msgr2=0x7fbeb0159e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:40.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.279+0000 7fbeb4c00640 1 --2- 172.21.15.49:0/2020792341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbeb0070660 0x7fbeb0159e40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbea000c420 tx=0x7fbea000c8e0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.279+0000 7fbeb4c00640 1 -- 172.21.15.49:0/2020792341 shutdown_connections 2024-01-31T05:04:40.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.279+0000 7fbeb4c00640 1 --2- 172.21.15.49:0/2020792341 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbe88066500 0x7fbe880689c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.279+0000 7fbeb4c00640 1 --2- 172.21.15.49:0/2020792341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbeb0159790 0x7fbeb0141ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.279+0000 7fbeb4c00640 1 --2- 172.21.15.49:0/2020792341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbeb0070ac0 0x7fbeb0155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.279+0000 7fbeb4c00640 1 --2- 172.21.15.49:0/2020792341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbeb0070660 0x7fbeb0159e40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.279+0000 7fbeb4c00640 1 -- 172.21.15.49:0/2020792341 >> 172.21.15.49:0/2020792341 conn(0x7fbeb00b09a0 msgr2=0x7fbeb006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:40.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.279+0000 7fbeb4c00640 1 -- 172.21.15.49:0/2020792341 shutdown_connections 2024-01-31T05:04:40.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.279+0000 7fbeb4c00640 1 -- 172.21.15.49:0/2020792341 wait complete. 2024-01-31T05:04:40.304 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-31T05:04:40.304 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:04:40.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.447+0000 7f1dbb400640 1 Processor -- start 2024-01-31T05:04:40.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.447+0000 7f1dbb400640 1 -- start start 2024-01-31T05:04:40.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.447+0000 7f1dbb400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1db415a050 0x7f1db40cc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:40.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.447+0000 7f1dbb400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1db40ade90 0x7f1db4071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:40.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.447+0000 7f1dbb400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db40af260 con 0x7f1db40719a0 2024-01-31T05:04:40.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.447+0000 7f1dbb400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db406d1e0 con 0x7f1db40ade90 2024-01-31T05:04:40.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.447+0000 7f1dbb400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db415a430 con 0x7f1db415a050 2024-01-31T05:04:40.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.447+0000 7f1db3e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1db40ade90 0x7f1db4071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:40.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.447+0000 7f1db3e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1db40ade90 0x7f1db4071460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38332/0 (socket says 172.21.15.49:38332) 2024-01-31T05:04:40.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.447+0000 7f1db3e00640 1 -- 172.21.15.49:0/3641623404 learned_addr learned my addr 172.21.15.49:0/3641623404 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:40.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.447+0000 7f1db9400640 1 --1- 172.21.15.49:0/3641623404 >> v1:172.21.15.49:6789/0 conn(0x7f1db40719a0 0x7f1db40ca430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57702/0 (socket says 172.21.15.49:57702) 2024-01-31T05:04:40.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.447+0000 7f1db8a00640 1 --2- 172.21.15.49:0/3641623404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1db415a050 0x7f1db40cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:40.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.447+0000 7f1db3e00640 1 -- 172.21.15.49:0/3641623404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1db415a050 msgr2=0x7f1db40cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:40.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.447+0000 7f1db3e00640 1 --2- 172.21.15.49:0/3641623404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1db415a050 0x7f1db40cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.447+0000 7f1db3e00640 1 -- 172.21.15.49:0/3641623404 >> v1:172.21.15.49:6789/0 conn(0x7f1db40719a0 legacy=0x7f1db40ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:40.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.447+0000 7f1db3e00640 1 -- 172.21.15.49:0/3641623404 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db40ae6e0 con 0x7f1db40ade90 2024-01-31T05:04:40.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.447+0000 7f1db3400640 1 -- 172.21.15.49:0/3641623404 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998314440 0 0) 0x7f1db40af260 con 0x7f1db40719a0 2024-01-31T05:04:40.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.451+0000 7f1db3e00640 1 --2- 172.21.15.49:0/3641623404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1db40ade90 0x7f1db4071460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0098a0 tx=0x7f1d9c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad8a040dca15c0b server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:40.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.451+0000 7f1db3400640 1 -- 172.21.15.49:0/3641623404 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c0ab600 con 0x7f1db40ade90 2024-01-31T05:04:40.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.451+0000 7f1db3400640 1 -- 172.21.15.49:0/3641623404 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9c0a7050 con 0x7f1db40ade90 2024-01-31T05:04:40.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.451+0000 7f1db3400640 1 -- 172.21.15.49:0/3641623404 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c0ab980 con 0x7f1db40ade90 2024-01-31T05:04:40.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.451+0000 7f1dbb400640 1 -- 172.21.15.49:0/3641623404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1db40ade90 msgr2=0x7f1db4071460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:40.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.451+0000 7f1dbb400640 1 --2- 172.21.15.49:0/3641623404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1db40ade90 0x7f1db4071460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0098a0 tx=0x7f1d9c01c490 comp rx=0 tx=0).stop 2024-01-31T05:04:40.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.451+0000 7f1dbb400640 1 -- 172.21.15.49:0/3641623404 shutdown_connections 2024-01-31T05:04:40.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.451+0000 7f1dbb400640 1 --2- 172.21.15.49:0/3641623404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1db40ade90 0x7f1db4071460 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.451+0000 7f1dbb400640 1 --2- 172.21.15.49:0/3641623404 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1db415a050 0x7f1db40cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.451+0000 7f1dbb400640 1 -- 172.21.15.49:0/3641623404 >> 172.21.15.49:0/3641623404 conn(0x7f1db40cfde0 msgr2=0x7f1db40d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:40.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.451+0000 7f1dbb400640 1 -- 172.21.15.49:0/3641623404 shutdown_connections 2024-01-31T05:04:40.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.451+0000 7f1dbb400640 1 -- 172.21.15.49:0/3641623404 wait complete. 2024-01-31T05:04:40.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1dbb400640 1 Processor -- start 2024-01-31T05:04:40.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1dbb400640 1 -- start start 2024-01-31T05:04:40.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1dbb400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1db40719a0 0x7f1db40c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:40.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1dbb400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1db40ade90 0x7f1db4145230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:40.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1dbb400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1db415a050 0x7f1db40b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:40.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1dbb400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db40c88a0 con 0x7f1db415a050 2024-01-31T05:04:40.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1dbb400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db40c7800 con 0x7f1db40719a0 2024-01-31T05:04:40.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1dbb400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db40c7ae0 con 0x7f1db40ade90 2024-01-31T05:04:40.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1db9400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1db415a050 0x7f1db40b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:40.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1db9400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1db415a050 0x7f1db40b4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38340/0 (socket says 172.21.15.49:38340) 2024-01-31T05:04:40.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1db9400640 1 -- 172.21.15.49:0/2246865151 learned_addr learned my addr 172.21.15.49:0/2246865151 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:40.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1db8a00640 1 --2- 172.21.15.49:0/2246865151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1db40719a0 0x7f1db40c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:40.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1db3e00640 1 --2- 172.21.15.49:0/2246865151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1db40ade90 0x7f1db4145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:40.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1db9400640 1 -- 172.21.15.49:0/2246865151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1db40ade90 msgr2=0x7f1db4145230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:40.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1db9400640 1 --2- 172.21.15.49:0/2246865151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1db40ade90 0x7f1db4145230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1db9400640 1 -- 172.21.15.49:0/2246865151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1db40719a0 msgr2=0x7f1db40c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:40.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1db9400640 1 --2- 172.21.15.49:0/2246865151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1db40719a0 0x7f1db40c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1db9400640 1 -- 172.21.15.49:0/2246865151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c0094d0 con 0x7f1db415a050 2024-01-31T05:04:40.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1db9400640 1 --2- 172.21.15.49:0/2246865151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1db415a050 0x7f1db40b4ab0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00c7a0 tx=0x7f1dac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:40.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1db0c00640 1 -- 172.21.15.49:0/2246865151 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac00a640 con 0x7f1db415a050 2024-01-31T05:04:40.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1db0c00640 1 -- 172.21.15.49:0/2246865151 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac00a7a0 con 0x7f1db415a050 2024-01-31T05:04:40.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1db0c00640 1 -- 172.21.15.49:0/2246865151 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac00abd0 con 0x7f1db415a050 2024-01-31T05:04:40.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1dbb400640 1 -- 172.21.15.49:0/2246865151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db40c7dc0 con 0x7f1db415a050 2024-01-31T05:04:40.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.455+0000 7f1dbb400640 1 -- 172.21.15.49:0/2246865151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db40c8380 con 0x7f1db415a050 2024-01-31T05:04:40.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.459+0000 7f1dbb400640 1 -- 172.21.15.49:0/2246865151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db40c8570 con 0x7f1db415a050 2024-01-31T05:04:40.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.459+0000 7f1db0c00640 1 -- 172.21.15.49:0/2246865151 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1dac00ad30 con 0x7f1db415a050 2024-01-31T05:04:40.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.459+0000 7f1db0c00640 1 --2- 172.21.15.49:0/2246865151 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1d8c066500 0x7f1d8c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:40.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.459+0000 7f1db0c00640 1 -- 172.21.15.49:0/2246865151 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1dac0839c0 con 0x7f1db415a050 2024-01-31T05:04:40.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.459+0000 7f1db8a00640 1 --2- 172.21.15.49:0/2246865151 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1d8c066500 0x7f1d8c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:40.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.459+0000 7f1db8a00640 1 --2- 172.21.15.49:0/2246865151 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1d8c066500 0x7f1d8c0689c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1da40079c0 tx=0x7f1da4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:40.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.463+0000 7f1db0c00640 1 -- 172.21.15.49:0/2246865151 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1dac050980 con 0x7f1db415a050 2024-01-31T05:04:40.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.655+0000 7f1dbb400640 1 -- 172.21.15.49:0/2246865151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1db4074860 con 0x7f1db415a050 2024-01-31T05:04:40.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.655+0000 7f1db0c00640 1 -- 172.21.15.49:0/2246865151 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7f1dac018090 con 0x7f1db415a050 2024-01-31T05:04:40.658 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:40.658 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2308601440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2308601440},{"type":"v1","addr":"172.21.15.49:6835","nonce":2308601440}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2920530340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":2920530340},{"type":"v1","addr":"172.21.15.195:6836","nonce":2920530340}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3114317228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3114317228},{"type":"v1","addr":"172.21.15.195:6837","nonce":3114317228}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-31T05:04:16.248649+0000","modified":"2024-01-31T05:04:39.667986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/4254852793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4254852793},{"type":"v1","addr":"172.21.15.49:6834","nonce":4254852793}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:04:40.658 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2024-01-31T05:04:40.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.659+0000 7f1dbb400640 1 -- 172.21.15.49:0/2246865151 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1d8c066500 msgr2=0x7f1d8c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:40.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.659+0000 7f1dbb400640 1 --2- 172.21.15.49:0/2246865151 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1d8c066500 0x7f1d8c0689c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1da40079c0 tx=0x7f1da4008040 comp rx=0 tx=0).stop 2024-01-31T05:04:40.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.659+0000 7f1dbb400640 1 -- 172.21.15.49:0/2246865151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1db415a050 msgr2=0x7f1db40b4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:40.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.659+0000 7f1dbb400640 1 --2- 172.21.15.49:0/2246865151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1db415a050 0x7f1db40b4ab0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00c7a0 tx=0x7f1dac00cc60 comp rx=0 tx=0).stop 2024-01-31T05:04:40.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.659+0000 7f1dbb400640 1 -- 172.21.15.49:0/2246865151 shutdown_connections 2024-01-31T05:04:40.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.659+0000 7f1dbb400640 1 --2- 172.21.15.49:0/2246865151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1db415a050 0x7f1db40b4ab0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.659+0000 7f1dbb400640 1 --2- 172.21.15.49:0/2246865151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1db40ade90 0x7f1db4145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.659+0000 7f1dbb400640 1 --2- 172.21.15.49:0/2246865151 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1d8c066500 0x7f1d8c0689c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.659+0000 7f1dbb400640 1 --2- 172.21.15.49:0/2246865151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1db40719a0 0x7f1db40c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.659+0000 7f1dbb400640 1 -- 172.21.15.49:0/2246865151 >> 172.21.15.49:0/2246865151 conn(0x7f1db40cfde0 msgr2=0x7f1db40b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:40.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.659+0000 7f1dbb400640 1 -- 172.21.15.49:0/2246865151 shutdown_connections 2024-01-31T05:04:40.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.659+0000 7f1dbb400640 1 -- 172.21.15.49:0/2246865151 wait complete. 2024-01-31T05:04:40.680 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:04:40.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.819+0000 7fae08800640 1 Processor -- start 2024-01-31T05:04:40.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.819+0000 7fae08800640 1 -- start start 2024-01-31T05:04:40.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.819+0000 7fae08800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae0015e7e0 0x7fae000b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:40.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.819+0000 7fae08800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fae000cf670 0x7fae000cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:40.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.819+0000 7fae08800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae000c67f0 con 0x7fae000c63d0 2024-01-31T05:04:40.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.819+0000 7fae08800640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae000d1d40 con 0x7fae000cf670 2024-01-31T05:04:40.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.819+0000 7fae08800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae000c6ab0 con 0x7fae0015e7e0 2024-01-31T05:04:40.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.819+0000 7fae06800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fae000cf670 0x7fae000cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:40.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.819+0000 7fae06800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fae000cf670 0x7fae000cbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38350/0 (socket says 172.21.15.49:38350) 2024-01-31T05:04:40.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.819+0000 7fae06800640 1 -- 172.21.15.49:0/3295177048 learned_addr learned my addr 172.21.15.49:0/3295177048 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:40.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.819+0000 7fae05e00640 1 --2- 172.21.15.49:0/3295177048 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae0015e7e0 0x7fae000b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:40.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.819+0000 7fae06800640 1 -- 172.21.15.49:0/3295177048 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae0015e7e0 msgr2=0x7fae000b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:40.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.819+0000 7fae06800640 1 --2- 172.21.15.49:0/3295177048 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae0015e7e0 0x7fae000b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.819+0000 7fae06800640 1 -- 172.21.15.49:0/3295177048 >> v1:172.21.15.195:6789/0 conn(0x7fae000c63d0 legacy=0x7fae000cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:40.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.819+0000 7fae06800640 1 -- 172.21.15.49:0/3295177048 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae000c6d90 con 0x7fae000cf670 2024-01-31T05:04:40.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.823+0000 7fae06800640 1 --2- 172.21.15.49:0/3295177048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae000cf670 0x7fae000cbab0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009e50 tx=0x7fadf801f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04000ea92faf4da server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:40.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.823+0000 7fae04a00640 1 -- 172.21.15.49:0/3295177048 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf80af400 con 0x7fae000cf670 2024-01-31T05:04:40.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.823+0000 7fae04a00640 1 -- 172.21.15.49:0/3295177048 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf80ab050 con 0x7fae000cf670 2024-01-31T05:04:40.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.823+0000 7fae04a00640 1 -- 172.21.15.49:0/3295177048 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf80af780 con 0x7fae000cf670 2024-01-31T05:04:40.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.823+0000 7fae08800640 1 -- 172.21.15.49:0/3295177048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae000cf670 msgr2=0x7fae000cbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:40.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.823+0000 7fae08800640 1 --2- 172.21.15.49:0/3295177048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae000cf670 0x7fae000cbab0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009e50 tx=0x7fadf801f1f0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.823+0000 7fae08800640 1 -- 172.21.15.49:0/3295177048 shutdown_connections 2024-01-31T05:04:40.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.823+0000 7fae08800640 1 --2- 172.21.15.49:0/3295177048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae000cf670 0x7fae000cbab0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.823+0000 7fae08800640 1 --2- 172.21.15.49:0/3295177048 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae0015e7e0 0x7fae000b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.823+0000 7fae08800640 1 -- 172.21.15.49:0/3295177048 >> 172.21.15.49:0/3295177048 conn(0x7fae000d0e60 msgr2=0x7fae000d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:40.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.823+0000 7fae08800640 1 -- 172.21.15.49:0/3295177048 shutdown_connections 2024-01-31T05:04:40.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.823+0000 7fae08800640 1 -- 172.21.15.49:0/3295177048 wait complete. 2024-01-31T05:04:40.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.827+0000 7fae08800640 1 Processor -- start 2024-01-31T05:04:40.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.827+0000 7fae08800640 1 -- start start 2024-01-31T05:04:40.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.827+0000 7fae08800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae000c63d0 0x7fae00148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:40.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.827+0000 7fae08800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae000cf670 0x7fae000c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:40.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.827+0000 7fae08800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae0015e7e0 0x7fae000c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:40.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.827+0000 7fae08800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae000c8690 con 0x7fae000cf670 2024-01-31T05:04:40.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.827+0000 7fae08800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae000c95a0 con 0x7fae000c63d0 2024-01-31T05:04:40.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.827+0000 7fae08800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae000c9880 con 0x7fae0015e7e0 2024-01-31T05:04:40.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.827+0000 7fae05400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae000cf670 0x7fae000c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:40.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.827+0000 7fae05400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae000cf670 0x7fae000c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38366/0 (socket says 172.21.15.49:38366) 2024-01-31T05:04:40.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.827+0000 7fae05400640 1 -- 172.21.15.49:0/544902687 learned_addr learned my addr 172.21.15.49:0/544902687 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:40.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.827+0000 7fae05e00640 1 --2- 172.21.15.49:0/544902687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae000c63d0 0x7fae00148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:40.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.827+0000 7fae06800640 1 --2- 172.21.15.49:0/544902687 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae0015e7e0 0x7fae000c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:40.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.827+0000 7fae05400640 1 -- 172.21.15.49:0/544902687 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae0015e7e0 msgr2=0x7fae000c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:40.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.827+0000 7fae05400640 1 --2- 172.21.15.49:0/544902687 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae0015e7e0 0x7fae000c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.827+0000 7fae05400640 1 -- 172.21.15.49:0/544902687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae000c63d0 msgr2=0x7fae00148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:40.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.827+0000 7fae05400640 1 --2- 172.21.15.49:0/544902687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae000c63d0 0x7fae00148360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:40.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.827+0000 7fae05400640 1 -- 172.21.15.49:0/544902687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf8009b30 con 0x7fae000cf670 2024-01-31T05:04:40.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.827+0000 7fae05400640 1 --2- 172.21.15.49:0/544902687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae000cf670 0x7fae000c8ab0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fade800c370 tx=0x7fade800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:40.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.831+0000 7fadfe000640 1 -- 172.21.15.49:0/544902687 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade80052d0 con 0x7fae000cf670 2024-01-31T05:04:40.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.831+0000 7fadfe000640 1 -- 172.21.15.49:0/544902687 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade8005430 con 0x7fae000cf670 2024-01-31T05:04:40.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.831+0000 7fadfe000640 1 -- 172.21.15.49:0/544902687 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade8007260 con 0x7fae000cf670 2024-01-31T05:04:40.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.831+0000 7fae08800640 1 -- 172.21.15.49:0/544902687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae000c9b60 con 0x7fae000cf670 2024-01-31T05:04:40.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.831+0000 7fae08800640 1 -- 172.21.15.49:0/544902687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae000c82b0 con 0x7fae000cf670 2024-01-31T05:04:40.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.831+0000 7fae08800640 1 -- 172.21.15.49:0/544902687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae00067c80 con 0x7fae000cf670 2024-01-31T05:04:40.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.831+0000 7fadfe000640 1 -- 172.21.15.49:0/544902687 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fade80073c0 con 0x7fae000cf670 2024-01-31T05:04:40.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.831+0000 7fadfe000640 1 --2- 172.21.15.49:0/544902687 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fadd8066500 0x7fadd80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:40.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.831+0000 7fadfe000640 1 -- 172.21.15.49:0/544902687 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fade8083540 con 0x7fae000cf670 2024-01-31T05:04:40.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.831+0000 7fae05e00640 1 --2- 172.21.15.49:0/544902687 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fadd8066500 0x7fadd80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:40.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.831+0000 7fae05e00640 1 --2- 172.21.15.49:0/544902687 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fadd8066500 0x7fadd80689c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fae000b4a50 tx=0x7fadf0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:40.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.835+0000 7fadfe000640 1 -- 172.21.15.49:0/544902687 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fade8050500 con 0x7fae000cf670 2024-01-31T05:04:41.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.999+0000 7fae08800640 1 -- 172.21.15.49:0/544902687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae0006f820 con 0x7fae000cf670 2024-01-31T05:04:41.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:40.999+0000 7fadfe000640 1 -- 172.21.15.49:0/544902687 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18323 (secure 0 0 0) 0x7fade8053b20 con 0x7fae000cf670 2024-01-31T05:04:41.002 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:41.002 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:20.695841+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:04:41.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.003+0000 7fae08800640 1 -- 172.21.15.49:0/544902687 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fadd8066500 msgr2=0x7fadd80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:41.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.003+0000 7fae08800640 1 --2- 172.21.15.49:0/544902687 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fadd8066500 0x7fadd80689c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fae000b4a50 tx=0x7fadf0009190 comp rx=0 tx=0).stop 2024-01-31T05:04:41.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.003+0000 7fae08800640 1 -- 172.21.15.49:0/544902687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae000cf670 msgr2=0x7fae000c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:41.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.003+0000 7fae08800640 1 --2- 172.21.15.49:0/544902687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae000cf670 0x7fae000c8ab0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fade800c370 tx=0x7fade800c830 comp rx=0 tx=0).stop 2024-01-31T05:04:41.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.003+0000 7fae08800640 1 -- 172.21.15.49:0/544902687 shutdown_connections 2024-01-31T05:04:41.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.003+0000 7fae08800640 1 --2- 172.21.15.49:0/544902687 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae0015e7e0 0x7fae000c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.003+0000 7fae08800640 1 --2- 172.21.15.49:0/544902687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae000cf670 0x7fae000c8ab0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.003+0000 7fae08800640 1 --2- 172.21.15.49:0/544902687 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fadd8066500 0x7fadd80689c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.003+0000 7fae08800640 1 --2- 172.21.15.49:0/544902687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae000c63d0 0x7fae00148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.003+0000 7fae08800640 1 -- 172.21.15.49:0/544902687 >> 172.21.15.49:0/544902687 conn(0x7fae000d0e60 msgr2=0x7fae000cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:41.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.003+0000 7fae08800640 1 -- 172.21.15.49:0/544902687 shutdown_connections 2024-01-31T05:04:41.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.003+0000 7fae08800640 1 -- 172.21.15.49:0/544902687 wait complete. 2024-01-31T05:04:41.024 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-31T05:04:41.025 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-31T05:04:41.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.163+0000 7fdb12600640 1 Processor -- start 2024-01-31T05:04:41.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.163+0000 7fdb12600640 1 -- start start 2024-01-31T05:04:41.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.163+0000 7fdb12600640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdb0c15b110 0x7fdb0c06c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:41.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.163+0000 7fdb12600640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0c15b4f0 con 0x7fdb0c0714e0 2024-01-31T05:04:41.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.163+0000 7fdb12600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0c0abf20 con 0x7fdb0c0cdf10 2024-01-31T05:04:41.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.163+0000 7fdb12600640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c0ce460 con 0x7fdb0c15b110 2024-01-31T05:04:41.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.163+0000 7fdb0b400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdb0c15b110 0x7fdb0c06c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:41.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.163+0000 7fdb0be00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdb0c0714e0 0x7fdb0c0ad800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57718/0 (socket says 172.21.15.49:57718) 2024-01-31T05:04:41.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.163+0000 7fdb0be00640 1 -- 172.21.15.49:0/3692017278 learned_addr learned my addr 172.21.15.49:0/3692017278 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:41.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.163+0000 7fdb0b400640 1 -- 172.21.15.49:0/3692017278 >> v1:172.21.15.195:6789/0 conn(0x7fdb0c0cdf10 legacy=0x7fdb0c070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:41.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.163+0000 7fdb0b400640 1 -- 172.21.15.49:0/3692017278 >> v1:172.21.15.49:6789/0 conn(0x7fdb0c0714e0 legacy=0x7fdb0c0ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:41.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.163+0000 7fdb0b400640 1 -- 172.21.15.49:0/3692017278 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c0ac200 con 0x7fdb0c15b110 2024-01-31T05:04:41.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.167+0000 7fdb0b400640 1 --2- 172.21.15.49:0/3692017278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb0c15b110 0x7fdb0c06c2d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0097c0 tx=0x7fdafc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5495de1ca3fc2719 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:41.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.167+0000 7fdb0a000640 1 -- 172.21.15.49:0/3692017278 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc0ab600 con 0x7fdb0c15b110 2024-01-31T05:04:41.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.167+0000 7fdb0a000640 1 -- 172.21.15.49:0/3692017278 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc0a7050 con 0x7fdb0c15b110 2024-01-31T05:04:41.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.167+0000 7fdb0a000640 1 -- 172.21.15.49:0/3692017278 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc0ab980 con 0x7fdb0c15b110 2024-01-31T05:04:41.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.167+0000 7fdb12600640 1 -- 172.21.15.49:0/3692017278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb0c15b110 msgr2=0x7fdb0c06c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:41.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.167+0000 7fdb12600640 1 --2- 172.21.15.49:0/3692017278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb0c15b110 0x7fdb0c06c2d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0097c0 tx=0x7fdafc01c410 comp rx=0 tx=0).stop 2024-01-31T05:04:41.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.167+0000 7fdb12600640 1 -- 172.21.15.49:0/3692017278 shutdown_connections 2024-01-31T05:04:41.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.167+0000 7fdb12600640 1 --2- 172.21.15.49:0/3692017278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb0c15b110 0x7fdb0c06c2d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.167+0000 7fdb12600640 1 -- 172.21.15.49:0/3692017278 >> 172.21.15.49:0/3692017278 conn(0x7fdb0c0b09a0 msgr2=0x7fdb0c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:41.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb12600640 1 -- 172.21.15.49:0/3692017278 shutdown_connections 2024-01-31T05:04:41.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb12600640 1 -- 172.21.15.49:0/3692017278 wait complete. 2024-01-31T05:04:41.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb12600640 1 Processor -- start 2024-01-31T05:04:41.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb12600640 1 -- start start 2024-01-31T05:04:41.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb12600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb0c0714e0 0x7fdb0c1f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:41.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb12600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb0c0cdf10 0x7fdb0c1668c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:41.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb12600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb0c15b110 0x7fdb0c164430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:41.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb12600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c164970 con 0x7fdb0c0714e0 2024-01-31T05:04:41.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb12600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c1f7580 con 0x7fdb0c0cdf10 2024-01-31T05:04:41.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb12600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c164ba0 con 0x7fdb0c15b110 2024-01-31T05:04:41.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb0b400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb0c0714e0 0x7fdb0c1f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:41.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb0b400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb0c0714e0 0x7fdb0c1f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38386/0 (socket says 172.21.15.49:38386) 2024-01-31T05:04:41.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb0b400640 1 -- 172.21.15.49:0/2618459988 learned_addr learned my addr 172.21.15.49:0/2618459988 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:41.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb0aa00640 1 --2- 172.21.15.49:0/2618459988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb0c0cdf10 0x7fdb0c1668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:41.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb0be00640 1 --2- 172.21.15.49:0/2618459988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb0c15b110 0x7fdb0c164430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:41.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb0b400640 1 -- 172.21.15.49:0/2618459988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb0c15b110 msgr2=0x7fdb0c164430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:41.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb0b400640 1 --2- 172.21.15.49:0/2618459988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb0c15b110 0x7fdb0c164430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb0b400640 1 -- 172.21.15.49:0/2618459988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb0c0cdf10 msgr2=0x7fdb0c1668c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:41.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb0b400640 1 --2- 172.21.15.49:0/2618459988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb0c0cdf10 0x7fdb0c1668c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb0b400640 1 -- 172.21.15.49:0/2618459988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc009420 con 0x7fdb0c0714e0 2024-01-31T05:04:41.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb0be00640 1 --2- 172.21.15.49:0/2618459988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb0c15b110 0x7fdb0c164430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:41.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.171+0000 7fdb0b400640 1 --2- 172.21.15.49:0/2618459988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb0c0714e0 0x7fdb0c1f7a10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdafc01aac0 tx=0x7fdafc01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:41.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.175+0000 7fdb03400640 1 -- 172.21.15.49:0/2618459988 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc0b7650 con 0x7fdb0c0714e0 2024-01-31T05:04:41.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.175+0000 7fdb03400640 1 -- 172.21.15.49:0/2618459988 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc0b77d0 con 0x7fdb0c0714e0 2024-01-31T05:04:41.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.175+0000 7fdb03400640 1 -- 172.21.15.49:0/2618459988 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc0b7b80 con 0x7fdb0c0714e0 2024-01-31T05:04:41.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.175+0000 7fdb12600640 1 -- 172.21.15.49:0/2618459988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0c164e80 con 0x7fdb0c0714e0 2024-01-31T05:04:41.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.175+0000 7fdb12600640 1 -- 172.21.15.49:0/2618459988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0c1f6ec0 con 0x7fdb0c0714e0 2024-01-31T05:04:41.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.175+0000 7fdb12600640 1 -- 172.21.15.49:0/2618459988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0c074860 con 0x7fdb0c0714e0 2024-01-31T05:04:41.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.175+0000 7fdb03400640 1 -- 172.21.15.49:0/2618459988 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fdafc0b7ce0 con 0x7fdb0c0714e0 2024-01-31T05:04:41.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.175+0000 7fdb03400640 1 --2- 172.21.15.49:0/2618459988 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdae4066530 0x7fdae40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:41.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.175+0000 7fdb03400640 1 -- 172.21.15.49:0/2618459988 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdafc11eb20 con 0x7fdb0c0714e0 2024-01-31T05:04:41.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.175+0000 7fdb0aa00640 1 --2- 172.21.15.49:0/2618459988 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdae4066530 0x7fdae40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:41.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.179+0000 7fdb0aa00640 1 --2- 172.21.15.49:0/2618459988 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdae4066530 0x7fdae40689f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0743f0 tx=0x7fdaf4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:41.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.179+0000 7fdb03400640 1 -- 172.21.15.49:0/2618459988 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fdafc0ebbe0 con 0x7fdb0c0714e0 2024-01-31T05:04:41.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.339+0000 7fdb12600640 1 -- 172.21.15.49:0/2618459988 --> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb0c1697d0 con 0x7fdae4066530 2024-01-31T05:04:41.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.403+0000 7fdb03400640 1 -- 172.21.15.49:0/2618459988 <== mgr.4100 v2:172.21.15.195:6832/3035808172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345282 (secure 0 0 0) 0x7fdaf4001490 con 0x7fdae4066530 2024-01-31T05:04:41.406 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:41.411 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-31T05:04:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.407+0000 7fdb12600640 1 -- 172.21.15.49:0/2618459988 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdae4066530 msgr2=0x7fdae40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.407+0000 7fdb12600640 1 --2- 172.21.15.49:0/2618459988 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdae4066530 0x7fdae40689f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0743f0 tx=0x7fdaf4009040 comp rx=0 tx=0).stop 2024-01-31T05:04:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.407+0000 7fdb12600640 1 -- 172.21.15.49:0/2618459988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb0c0714e0 msgr2=0x7fdb0c1f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.407+0000 7fdb12600640 1 --2- 172.21.15.49:0/2618459988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb0c0714e0 0x7fdb0c1f7a10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdafc01aac0 tx=0x7fdafc01ac50 comp rx=0 tx=0).stop 2024-01-31T05:04:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.407+0000 7fdb12600640 1 -- 172.21.15.49:0/2618459988 shutdown_connections 2024-01-31T05:04:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.407+0000 7fdb12600640 1 --2- 172.21.15.49:0/2618459988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb0c15b110 0x7fdb0c164430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.407+0000 7fdb12600640 1 --2- 172.21.15.49:0/2618459988 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdae4066530 0x7fdae40689f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.407+0000 7fdb12600640 1 --2- 172.21.15.49:0/2618459988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb0c0cdf10 0x7fdb0c1668c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.407+0000 7fdb12600640 1 --2- 172.21.15.49:0/2618459988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb0c0714e0 0x7fdb0c1f7a10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.407+0000 7fdb12600640 1 -- 172.21.15.49:0/2618459988 >> 172.21.15.49:0/2618459988 conn(0x7fdb0c0b09a0 msgr2=0x7fdb0c0af7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:41.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.407+0000 7fdb12600640 1 -- 172.21.15.49:0/2618459988 shutdown_connections 2024-01-31T05:04:41.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.407+0000 7fdb12600640 1 -- 172.21.15.49:0/2618459988 wait complete. 2024-01-31T05:04:41.429 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-01-31T05:04:40.425275+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252676,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722044,"statfs":{"total":773094113280,"available":772835373056,"internally_reserved":0,"allocated":3284992,"data_stored":1988350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003341"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581219+0000","last_change":"2024-01-31T05:04:15.868245+0000","last_active":"2024-01-31T05:04:21.581219+0000","last_peered":"2024-01-31T05:04:21.581219+0000","last_clean":"2024-01-31T05:04:21.581219+0000","last_became_active":"2024-01-31T05:04:15.864318+0000","last_became_peered":"2024-01-31T05:04:15.864318+0000","last_unstale":"2024-01-31T05:04:21.581219+0000","last_undegraded":"2024-01-31T05:04:21.581219+0000","last_fullsized":"2024-01-31T05:04:21.581219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:27:44.760988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267122+0000","last_change":"2024-01-31T05:04:16.288950+0000","last_active":"2024-01-31T05:04:21.267122+0000","last_peered":"2024-01-31T05:04:21.267122+0000","last_clean":"2024-01-31T05:04:21.267122+0000","last_became_active":"2024-01-31T05:04:16.288679+0000","last_became_peered":"2024-01-31T05:04:16.288679+0000","last_unstale":"2024-01-31T05:04:21.267122+0000","last_undegraded":"2024-01-31T05:04:21.267122+0000","last_fullsized":"2024-01-31T05:04:21.267122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:10:07.431961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266325+0000","last_change":"2024-01-31T05:04:20.413702+0000","last_active":"2024-01-31T05:04:21.266325+0000","last_peered":"2024-01-31T05:04:21.266325+0000","last_clean":"2024-01-31T05:04:21.266325+0000","last_became_active":"2024-01-31T05:04:20.413348+0000","last_became_peered":"2024-01-31T05:04:20.413348+0000","last_unstale":"2024-01-31T05:04:21.266325+0000","last_undegraded":"2024-01-31T05:04:21.266325+0000","last_fullsized":"2024-01-31T05:04:21.266325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:58:24.669260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267427+0000","last_change":"2024-01-31T05:04:15.865431+0000","last_active":"2024-01-31T05:04:21.267427+0000","last_peered":"2024-01-31T05:04:21.267427+0000","last_clean":"2024-01-31T05:04:21.267427+0000","last_became_active":"2024-01-31T05:04:15.863143+0000","last_became_peered":"2024-01-31T05:04:15.863143+0000","last_unstale":"2024-01-31T05:04:21.267427+0000","last_undegraded":"2024-01-31T05:04:21.267427+0000","last_fullsized":"2024-01-31T05:04:21.267427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:27:44.760988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580949+0000","last_change":"2024-01-31T05:04:16.295890+0000","last_active":"2024-01-31T05:04:21.580949+0000","last_peered":"2024-01-31T05:04:21.580949+0000","last_clean":"2024-01-31T05:04:21.580949+0000","last_became_active":"2024-01-31T05:04:16.295666+0000","last_became_peered":"2024-01-31T05:04:16.295666+0000","last_unstale":"2024-01-31T05:04:21.580949+0000","last_undegraded":"2024-01-31T05:04:21.580949+0000","last_fullsized":"2024-01-31T05:04:21.580949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266605+0000","last_change":"2024-01-31T05:04:20.314420+0000","last_active":"2024-01-31T05:04:21.266605+0000","last_peered":"2024-01-31T05:04:21.266605+0000","last_clean":"2024-01-31T05:04:21.266605+0000","last_became_active":"2024-01-31T05:04:20.314026+0000","last_became_peered":"2024-01-31T05:04:20.314026+0000","last_unstale":"2024-01-31T05:04:21.266605+0000","last_undegraded":"2024-01-31T05:04:21.266605+0000","last_fullsized":"2024-01-31T05:04:21.266605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:25.928105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.582056+0000","last_change":"2024-01-31T05:04:15.872667+0000","last_active":"2024-01-31T05:04:21.582056+0000","last_peered":"2024-01-31T05:04:21.582056+0000","last_clean":"2024-01-31T05:04:21.582056+0000","last_became_active":"2024-01-31T05:04:15.872184+0000","last_became_peered":"2024-01-31T05:04:15.872184+0000","last_unstale":"2024-01-31T05:04:21.582056+0000","last_undegraded":"2024-01-31T05:04:21.582056+0000","last_fullsized":"2024-01-31T05:04:21.582056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:15.850243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579858+0000","last_change":"2024-01-31T05:04:16.291560+0000","last_active":"2024-01-31T05:04:21.579858+0000","last_peered":"2024-01-31T05:04:21.579858+0000","last_clean":"2024-01-31T05:04:21.579858+0000","last_became_active":"2024-01-31T05:04:16.291315+0000","last_became_peered":"2024-01-31T05:04:16.291315+0000","last_unstale":"2024-01-31T05:04:21.579858+0000","last_undegraded":"2024-01-31T05:04:21.579858+0000","last_fullsized":"2024-01-31T05:04:21.579858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:29:14.662909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266987+0000","last_change":"2024-01-31T05:04:20.302441+0000","last_active":"2024-01-31T05:04:21.266987+0000","last_peered":"2024-01-31T05:04:21.266987+0000","last_clean":"2024-01-31T05:04:21.266987+0000","last_became_active":"2024-01-31T05:04:20.302037+0000","last_became_peered":"2024-01-31T05:04:20.302037+0000","last_unstale":"2024-01-31T05:04:21.266987+0000","last_undegraded":"2024-01-31T05:04:21.266987+0000","last_fullsized":"2024-01-31T05:04:21.266987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:10:10.869523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581271+0000","last_change":"2024-01-31T05:04:15.866007+0000","last_active":"2024-01-31T05:04:21.581271+0000","last_peered":"2024-01-31T05:04:21.581271+0000","last_clean":"2024-01-31T05:04:21.581271+0000","last_became_active":"2024-01-31T05:04:15.865702+0000","last_became_peered":"2024-01-31T05:04:15.865702+0000","last_unstale":"2024-01-31T05:04:21.581271+0000","last_undegraded":"2024-01-31T05:04:21.581271+0000","last_fullsized":"2024-01-31T05:04:21.581271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:24:55.108827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580173+0000","last_change":"2024-01-31T05:04:16.295973+0000","last_active":"2024-01-31T05:04:21.580173+0000","last_peered":"2024-01-31T05:04:21.580173+0000","last_clean":"2024-01-31T05:04:21.580173+0000","last_became_active":"2024-01-31T05:04:16.294920+0000","last_became_peered":"2024-01-31T05:04:16.294920+0000","last_unstale":"2024-01-31T05:04:21.580173+0000","last_undegraded":"2024-01-31T05:04:21.580173+0000","last_fullsized":"2024-01-31T05:04:21.580173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:47.781626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266874+0000","last_change":"2024-01-31T05:04:20.306343+0000","last_active":"2024-01-31T05:04:21.266874+0000","last_peered":"2024-01-31T05:04:21.266874+0000","last_clean":"2024-01-31T05:04:21.266874+0000","last_became_active":"2024-01-31T05:04:20.305678+0000","last_became_peered":"2024-01-31T05:04:20.305678+0000","last_unstale":"2024-01-31T05:04:21.266874+0000","last_undegraded":"2024-01-31T05:04:21.266874+0000","last_fullsized":"2024-01-31T05:04:21.266874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:23.877718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580317+0000","last_change":"2024-01-31T05:04:16.292709+0000","last_active":"2024-01-31T05:04:21.580317+0000","last_peered":"2024-01-31T05:04:21.580317+0000","last_clean":"2024-01-31T05:04:21.580317+0000","last_became_active":"2024-01-31T05:04:16.292447+0000","last_became_peered":"2024-01-31T05:04:16.292447+0000","last_unstale":"2024-01-31T05:04:21.580317+0000","last_undegraded":"2024-01-31T05:04:21.580317+0000","last_fullsized":"2024-01-31T05:04:21.580317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:36.794548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581839+0000","last_change":"2024-01-31T05:04:15.864066+0000","last_active":"2024-01-31T05:04:21.581839+0000","last_peered":"2024-01-31T05:04:21.581839+0000","last_clean":"2024-01-31T05:04:21.581839+0000","last_became_active":"2024-01-31T05:04:15.863757+0000","last_became_peered":"2024-01-31T05:04:15.863757+0000","last_unstale":"2024-01-31T05:04:21.581839+0000","last_undegraded":"2024-01-31T05:04:21.581839+0000","last_fullsized":"2024-01-31T05:04:21.581839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:16:26.364453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267538+0000","last_change":"2024-01-31T05:04:20.306016+0000","last_active":"2024-01-31T05:04:21.267538+0000","last_peered":"2024-01-31T05:04:21.267538+0000","last_clean":"2024-01-31T05:04:21.267538+0000","last_became_active":"2024-01-31T05:04:20.305523+0000","last_became_peered":"2024-01-31T05:04:20.305523+0000","last_unstale":"2024-01-31T05:04:21.267538+0000","last_undegraded":"2024-01-31T05:04:21.267538+0000","last_fullsized":"2024-01-31T05:04:21.267538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:44.473185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266570+0000","last_change":"2024-01-31T05:04:16.284277+0000","last_active":"2024-01-31T05:04:21.266570+0000","last_peered":"2024-01-31T05:04:21.266570+0000","last_clean":"2024-01-31T05:04:21.266570+0000","last_became_active":"2024-01-31T05:04:16.283861+0000","last_became_peered":"2024-01-31T05:04:16.283861+0000","last_unstale":"2024-01-31T05:04:21.266570+0000","last_undegraded":"2024-01-31T05:04:21.266570+0000","last_fullsized":"2024-01-31T05:04:21.266570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:59:17.499417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580029+0000","last_change":"2024-01-31T05:04:15.866369+0000","last_active":"2024-01-31T05:04:21.580029+0000","last_peered":"2024-01-31T05:04:21.580029+0000","last_clean":"2024-01-31T05:04:21.580029+0000","last_became_active":"2024-01-31T05:04:15.865958+0000","last_became_peered":"2024-01-31T05:04:15.865958+0000","last_unstale":"2024-01-31T05:04:21.580029+0000","last_undegraded":"2024-01-31T05:04:21.580029+0000","last_fullsized":"2024-01-31T05:04:21.580029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:24:55.108827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267344+0000","last_change":"2024-01-31T05:04:20.306127+0000","last_active":"2024-01-31T05:04:21.267344+0000","last_peered":"2024-01-31T05:04:21.267344+0000","last_clean":"2024-01-31T05:04:21.267344+0000","last_became_active":"2024-01-31T05:04:20.305397+0000","last_became_peered":"2024-01-31T05:04:20.305397+0000","last_unstale":"2024-01-31T05:04:21.267344+0000","last_undegraded":"2024-01-31T05:04:21.267344+0000","last_fullsized":"2024-01-31T05:04:21.267344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:20:14.179731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266407+0000","last_change":"2024-01-31T05:04:16.278338+0000","last_active":"2024-01-31T05:04:21.266407+0000","last_peered":"2024-01-31T05:04:21.266407+0000","last_clean":"2024-01-31T05:04:21.266407+0000","last_became_active":"2024-01-31T05:04:16.277709+0000","last_became_peered":"2024-01-31T05:04:16.277709+0000","last_unstale":"2024-01-31T05:04:21.266407+0000","last_undegraded":"2024-01-31T05:04:21.266407+0000","last_fullsized":"2024-01-31T05:04:21.266407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:38.399003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579843+0000","last_change":"2024-01-31T05:04:15.866645+0000","last_active":"2024-01-31T05:04:21.579843+0000","last_peered":"2024-01-31T05:04:21.579843+0000","last_clean":"2024-01-31T05:04:21.579843+0000","last_became_active":"2024-01-31T05:04:15.866293+0000","last_became_peered":"2024-01-31T05:04:15.866293+0000","last_unstale":"2024-01-31T05:04:21.579843+0000","last_undegraded":"2024-01-31T05:04:21.579843+0000","last_fullsized":"2024-01-31T05:04:21.579843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:16:26.364453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581344+0000","last_change":"2024-01-31T05:04:20.411913+0000","last_active":"2024-01-31T05:04:21.581344+0000","last_peered":"2024-01-31T05:04:21.581344+0000","last_clean":"2024-01-31T05:04:21.581344+0000","last_became_active":"2024-01-31T05:04:20.411469+0000","last_became_peered":"2024-01-31T05:04:20.411469+0000","last_unstale":"2024-01-31T05:04:21.581344+0000","last_undegraded":"2024-01-31T05:04:21.581344+0000","last_fullsized":"2024-01-31T05:04:21.581344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:45.735003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267040+0000","last_change":"2024-01-31T05:04:16.274299+0000","last_active":"2024-01-31T05:04:21.267040+0000","last_peered":"2024-01-31T05:04:21.267040+0000","last_clean":"2024-01-31T05:04:21.267040+0000","last_became_active":"2024-01-31T05:04:16.273410+0000","last_became_peered":"2024-01-31T05:04:16.273410+0000","last_unstale":"2024-01-31T05:04:21.267040+0000","last_undegraded":"2024-01-31T05:04:21.267040+0000","last_fullsized":"2024-01-31T05:04:21.267040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:34.994793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581098+0000","last_change":"2024-01-31T05:04:15.862190+0000","last_active":"2024-01-31T05:04:21.581098+0000","last_peered":"2024-01-31T05:04:21.581098+0000","last_clean":"2024-01-31T05:04:21.581098+0000","last_became_active":"2024-01-31T05:04:15.861894+0000","last_became_peered":"2024-01-31T05:04:15.861894+0000","last_unstale":"2024-01-31T05:04:21.581098+0000","last_undegraded":"2024-01-31T05:04:21.581098+0000","last_fullsized":"2024-01-31T05:04:21.581098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:33.988440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267462+0000","last_change":"2024-01-31T05:04:20.302070+0000","last_active":"2024-01-31T05:04:21.267462+0000","last_peered":"2024-01-31T05:04:21.267462+0000","last_clean":"2024-01-31T05:04:21.267462+0000","last_became_active":"2024-01-31T05:04:20.301514+0000","last_became_peered":"2024-01-31T05:04:20.301514+0000","last_unstale":"2024-01-31T05:04:21.267462+0000","last_undegraded":"2024-01-31T05:04:21.267462+0000","last_fullsized":"2024-01-31T05:04:21.267462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:51.219189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581061+0000","last_change":"2024-01-31T05:04:16.277874+0000","last_active":"2024-01-31T05:04:21.581061+0000","last_peered":"2024-01-31T05:04:21.581061+0000","last_clean":"2024-01-31T05:04:21.581061+0000","last_became_active":"2024-01-31T05:04:16.277627+0000","last_became_peered":"2024-01-31T05:04:16.277627+0000","last_unstale":"2024-01-31T05:04:21.581061+0000","last_undegraded":"2024-01-31T05:04:21.581061+0000","last_fullsized":"2024-01-31T05:04:21.581061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:38.399003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581821+0000","last_change":"2024-01-31T05:04:15.867994+0000","last_active":"2024-01-31T05:04:21.581821+0000","last_peered":"2024-01-31T05:04:21.581821+0000","last_clean":"2024-01-31T05:04:21.581821+0000","last_became_active":"2024-01-31T05:04:15.866731+0000","last_became_peered":"2024-01-31T05:04:15.866731+0000","last_unstale":"2024-01-31T05:04:21.581821+0000","last_undegraded":"2024-01-31T05:04:21.581821+0000","last_fullsized":"2024-01-31T05:04:21.581821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:12:26.990588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266940+0000","last_change":"2024-01-31T05:04:20.410734+0000","last_active":"2024-01-31T05:04:21.266940+0000","last_peered":"2024-01-31T05:04:21.266940+0000","last_clean":"2024-01-31T05:04:21.266940+0000","last_became_active":"2024-01-31T05:04:20.410368+0000","last_became_peered":"2024-01-31T05:04:20.410368+0000","last_unstale":"2024-01-31T05:04:21.266940+0000","last_undegraded":"2024-01-31T05:04:21.266940+0000","last_fullsized":"2024-01-31T05:04:21.266940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:29:18.100472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.268005+0000","last_change":"2024-01-31T05:04:16.283103+0000","last_active":"2024-01-31T05:04:21.268005+0000","last_peered":"2024-01-31T05:04:21.268005+0000","last_clean":"2024-01-31T05:04:21.268005+0000","last_became_active":"2024-01-31T05:04:16.282869+0000","last_became_peered":"2024-01-31T05:04:16.282869+0000","last_unstale":"2024-01-31T05:04:21.268005+0000","last_undegraded":"2024-01-31T05:04:21.268005+0000","last_fullsized":"2024-01-31T05:04:21.268005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:20.440155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581016+0000","last_change":"2024-01-31T05:04:15.872874+0000","last_active":"2024-01-31T05:04:21.581016+0000","last_peered":"2024-01-31T05:04:21.581016+0000","last_clean":"2024-01-31T05:04:21.581016+0000","last_became_active":"2024-01-31T05:04:15.872478+0000","last_became_peered":"2024-01-31T05:04:15.872478+0000","last_unstale":"2024-01-31T05:04:21.581016+0000","last_undegraded":"2024-01-31T05:04:21.581016+0000","last_fullsized":"2024-01-31T05:04:21.581016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:12:26.990588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266215+0000","last_change":"2024-01-31T05:04:20.409515+0000","last_active":"2024-01-31T05:04:21.266215+0000","last_peered":"2024-01-31T05:04:21.266215+0000","last_clean":"2024-01-31T05:04:21.266215+0000","last_became_active":"2024-01-31T05:04:20.409104+0000","last_became_peered":"2024-01-31T05:04:20.409104+0000","last_unstale":"2024-01-31T05:04:21.266215+0000","last_undegraded":"2024-01-31T05:04:21.266215+0000","last_fullsized":"2024-01-31T05:04:21.266215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:26:03.624550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580349+0000","last_change":"2024-01-31T05:04:16.276727+0000","last_active":"2024-01-31T05:04:21.580349+0000","last_peered":"2024-01-31T05:04:21.580349+0000","last_clean":"2024-01-31T05:04:21.580349+0000","last_became_active":"2024-01-31T05:04:16.276429+0000","last_became_peered":"2024-01-31T05:04:16.276429+0000","last_unstale":"2024-01-31T05:04:21.580349+0000","last_undegraded":"2024-01-31T05:04:21.580349+0000","last_fullsized":"2024-01-31T05:04:21.580349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.582205+0000","last_change":"2024-01-31T05:04:15.872449+0000","last_active":"2024-01-31T05:04:21.582205+0000","last_peered":"2024-01-31T05:04:21.582205+0000","last_clean":"2024-01-31T05:04:21.582205+0000","last_became_active":"2024-01-31T05:04:15.871832+0000","last_became_peered":"2024-01-31T05:04:15.871832+0000","last_unstale":"2024-01-31T05:04:21.582205+0000","last_undegraded":"2024-01-31T05:04:21.582205+0000","last_fullsized":"2024-01-31T05:04:21.582205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:18:30.350723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579984+0000","last_change":"2024-01-31T05:04:20.410664+0000","last_active":"2024-01-31T05:04:21.579984+0000","last_peered":"2024-01-31T05:04:21.579984+0000","last_clean":"2024-01-31T05:04:21.579984+0000","last_became_active":"2024-01-31T05:04:20.409595+0000","last_became_peered":"2024-01-31T05:04:20.409595+0000","last_unstale":"2024-01-31T05:04:21.579984+0000","last_undegraded":"2024-01-31T05:04:21.579984+0000","last_fullsized":"2024-01-31T05:04:21.579984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:51.219189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580268+0000","last_change":"2024-01-31T05:04:16.299267+0000","last_active":"2024-01-31T05:04:21.580268+0000","last_peered":"2024-01-31T05:04:21.580268+0000","last_clean":"2024-01-31T05:04:21.580268+0000","last_became_active":"2024-01-31T05:04:16.298919+0000","last_became_peered":"2024-01-31T05:04:16.298919+0000","last_unstale":"2024-01-31T05:04:21.580268+0000","last_undegraded":"2024-01-31T05:04:21.580268+0000","last_fullsized":"2024-01-31T05:04:21.580268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:41.035623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580402+0000","last_change":"2024-01-31T05:04:15.863096+0000","last_active":"2024-01-31T05:04:21.580402+0000","last_peered":"2024-01-31T05:04:21.580402+0000","last_clean":"2024-01-31T05:04:21.580402+0000","last_became_active":"2024-01-31T05:04:15.862799+0000","last_became_peered":"2024-01-31T05:04:15.862799+0000","last_unstale":"2024-01-31T05:04:21.580402+0000","last_undegraded":"2024-01-31T05:04:21.580402+0000","last_fullsized":"2024-01-31T05:04:21.580402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:33.988440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579915+0000","last_change":"2024-01-31T05:04:20.318591+0000","last_active":"2024-01-31T05:04:21.579915+0000","last_peered":"2024-01-31T05:04:21.579915+0000","last_clean":"2024-01-31T05:04:21.579915+0000","last_became_active":"2024-01-31T05:04:20.314906+0000","last_became_peered":"2024-01-31T05:04:20.314906+0000","last_unstale":"2024-01-31T05:04:21.579915+0000","last_undegraded":"2024-01-31T05:04:21.579915+0000","last_fullsized":"2024-01-31T05:04:21.579915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:51.219189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267338+0000","last_change":"2024-01-31T05:04:16.284119+0000","last_active":"2024-01-31T05:04:21.267338+0000","last_peered":"2024-01-31T05:04:21.267338+0000","last_clean":"2024-01-31T05:04:21.267338+0000","last_became_active":"2024-01-31T05:04:16.277112+0000","last_became_peered":"2024-01-31T05:04:16.277112+0000","last_unstale":"2024-01-31T05:04:21.267338+0000","last_undegraded":"2024-01-31T05:04:21.267338+0000","last_fullsized":"2024-01-31T05:04:21.267338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:12.324478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579785+0000","last_change":"2024-01-31T05:04:15.862604+0000","last_active":"2024-01-31T05:04:21.579785+0000","last_peered":"2024-01-31T05:04:21.579785+0000","last_clean":"2024-01-31T05:04:21.579785+0000","last_became_active":"2024-01-31T05:04:15.862119+0000","last_became_peered":"2024-01-31T05:04:15.862119+0000","last_unstale":"2024-01-31T05:04:21.579785+0000","last_undegraded":"2024-01-31T05:04:21.579785+0000","last_fullsized":"2024-01-31T05:04:21.579785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:15.850243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580443+0000","last_change":"2024-01-31T05:04:20.319285+0000","last_active":"2024-01-31T05:04:21.580443+0000","last_peered":"2024-01-31T05:04:21.580443+0000","last_clean":"2024-01-31T05:04:21.580443+0000","last_became_active":"2024-01-31T05:04:20.318678+0000","last_became_peered":"2024-01-31T05:04:20.318678+0000","last_unstale":"2024-01-31T05:04:21.580443+0000","last_undegraded":"2024-01-31T05:04:21.580443+0000","last_fullsized":"2024-01-31T05:04:21.580443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:52:04.324494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579922+0000","last_change":"2024-01-31T05:04:16.277245+0000","last_active":"2024-01-31T05:04:21.579922+0000","last_peered":"2024-01-31T05:04:21.579922+0000","last_clean":"2024-01-31T05:04:21.579922+0000","last_became_active":"2024-01-31T05:04:16.276969+0000","last_became_peered":"2024-01-31T05:04:16.276969+0000","last_unstale":"2024-01-31T05:04:21.579922+0000","last_undegraded":"2024-01-31T05:04:21.579922+0000","last_fullsized":"2024-01-31T05:04:21.579922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:05:32.076479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267230+0000","last_change":"2024-01-31T05:04:15.868758+0000","last_active":"2024-01-31T05:04:21.267230+0000","last_peered":"2024-01-31T05:04:21.267230+0000","last_clean":"2024-01-31T05:04:21.267230+0000","last_became_active":"2024-01-31T05:04:15.868431+0000","last_became_peered":"2024-01-31T05:04:15.868431+0000","last_unstale":"2024-01-31T05:04:21.267230+0000","last_undegraded":"2024-01-31T05:04:21.267230+0000","last_fullsized":"2024-01-31T05:04:21.267230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:38:14.126192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581401+0000","last_change":"2024-01-31T05:04:20.314828+0000","last_active":"2024-01-31T05:04:21.581401+0000","last_peered":"2024-01-31T05:04:21.581401+0000","last_clean":"2024-01-31T05:04:21.581401+0000","last_became_active":"2024-01-31T05:04:20.314407+0000","last_became_peered":"2024-01-31T05:04:20.314407+0000","last_unstale":"2024-01-31T05:04:21.581401+0000","last_undegraded":"2024-01-31T05:04:21.581401+0000","last_fullsized":"2024-01-31T05:04:21.581401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:42:14.408077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579808+0000","last_change":"2024-01-31T05:04:16.274865+0000","last_active":"2024-01-31T05:04:21.579808+0000","last_peered":"2024-01-31T05:04:21.579808+0000","last_clean":"2024-01-31T05:04:21.579808+0000","last_became_active":"2024-01-31T05:04:16.273448+0000","last_became_peered":"2024-01-31T05:04:16.273448+0000","last_unstale":"2024-01-31T05:04:21.579808+0000","last_undegraded":"2024-01-31T05:04:21.579808+0000","last_fullsized":"2024-01-31T05:04:21.579808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:28:15.218916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581205+0000","last_change":"2024-01-31T05:04:15.865828+0000","last_active":"2024-01-31T05:04:21.581205+0000","last_peered":"2024-01-31T05:04:21.581205+0000","last_clean":"2024-01-31T05:04:21.581205+0000","last_became_active":"2024-01-31T05:04:15.865556+0000","last_became_peered":"2024-01-31T05:04:15.865556+0000","last_unstale":"2024-01-31T05:04:21.581205+0000","last_undegraded":"2024-01-31T05:04:21.581205+0000","last_fullsized":"2024-01-31T05:04:21.581205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:11.318125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580994+0000","last_change":"2024-01-31T05:04:20.410795+0000","last_active":"2024-01-31T05:04:21.580994+0000","last_peered":"2024-01-31T05:04:21.580994+0000","last_clean":"2024-01-31T05:04:21.580994+0000","last_became_active":"2024-01-31T05:04:20.409164+0000","last_became_peered":"2024-01-31T05:04:20.409164+0000","last_unstale":"2024-01-31T05:04:21.580994+0000","last_undegraded":"2024-01-31T05:04:21.580994+0000","last_fullsized":"2024-01-31T05:04:21.580994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:42:14.408077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266618+0000","last_change":"2024-01-31T05:04:16.302810+0000","last_active":"2024-01-31T05:04:21.266618+0000","last_peered":"2024-01-31T05:04:21.266618+0000","last_clean":"2024-01-31T05:04:21.266618+0000","last_became_active":"2024-01-31T05:04:16.302580+0000","last_became_peered":"2024-01-31T05:04:16.302580+0000","last_unstale":"2024-01-31T05:04:21.266618+0000","last_undegraded":"2024-01-31T05:04:21.266618+0000","last_fullsized":"2024-01-31T05:04:21.266618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:05:32.076479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579670+0000","last_change":"2024-01-31T05:04:15.859340+0000","last_active":"2024-01-31T05:04:21.579670+0000","last_peered":"2024-01-31T05:04:21.579670+0000","last_clean":"2024-01-31T05:04:21.579670+0000","last_became_active":"2024-01-31T05:04:15.858887+0000","last_became_peered":"2024-01-31T05:04:15.858887+0000","last_unstale":"2024-01-31T05:04:21.579670+0000","last_undegraded":"2024-01-31T05:04:21.579670+0000","last_fullsized":"2024-01-31T05:04:21.579670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:11.318125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581256+0000","last_change":"2024-01-31T05:04:05.699222+0000","last_active":"2024-01-31T05:04:21.581256+0000","last_peered":"2024-01-31T05:04:21.581256+0000","last_clean":"2024-01-31T05:04:21.581256+0000","last_became_active":"2024-01-31T05:04:05.698239+0000","last_became_peered":"2024-01-31T05:04:05.698239+0000","last_unstale":"2024-01-31T05:04:21.581256+0000","last_undegraded":"2024-01-31T05:04:21.581256+0000","last_fullsized":"2024-01-31T05:04:21.581256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_clean_scrub_stamp":"2024-01-31T05:04:04.484734+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:05:13.736598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580928+0000","last_change":"2024-01-31T05:04:20.409212+0000","last_active":"2024-01-31T05:04:21.580928+0000","last_peered":"2024-01-31T05:04:21.580928+0000","last_clean":"2024-01-31T05:04:21.580928+0000","last_became_active":"2024-01-31T05:04:20.408741+0000","last_became_peered":"2024-01-31T05:04:20.408741+0000","last_unstale":"2024-01-31T05:04:21.580928+0000","last_undegraded":"2024-01-31T05:04:21.580928+0000","last_fullsized":"2024-01-31T05:04:21.580928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:20:14.179731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581967+0000","last_change":"2024-01-31T05:04:16.301754+0000","last_active":"2024-01-31T05:04:21.581967+0000","last_peered":"2024-01-31T05:04:21.581967+0000","last_clean":"2024-01-31T05:04:21.581967+0000","last_became_active":"2024-01-31T05:04:16.301449+0000","last_became_peered":"2024-01-31T05:04:16.301449+0000","last_unstale":"2024-01-31T05:04:21.581967+0000","last_undegraded":"2024-01-31T05:04:21.581967+0000","last_fullsized":"2024-01-31T05:04:21.581967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:47.781626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267625+0000","last_change":"2024-01-31T05:04:15.866001+0000","last_active":"2024-01-31T05:04:21.267625+0000","last_peered":"2024-01-31T05:04:21.267625+0000","last_clean":"2024-01-31T05:04:21.267625+0000","last_became_active":"2024-01-31T05:04:15.865731+0000","last_became_peered":"2024-01-31T05:04:15.865731+0000","last_unstale":"2024-01-31T05:04:21.267625+0000","last_undegraded":"2024-01-31T05:04:21.267625+0000","last_fullsized":"2024-01-31T05:04:21.267625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:53.760373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580399+0000","last_change":"2024-01-31T05:04:20.409951+0000","last_active":"2024-01-31T05:04:21.580399+0000","last_peered":"2024-01-31T05:04:21.580399+0000","last_clean":"2024-01-31T05:04:21.580399+0000","last_became_active":"2024-01-31T05:04:20.408740+0000","last_became_peered":"2024-01-31T05:04:20.408740+0000","last_unstale":"2024-01-31T05:04:21.580399+0000","last_undegraded":"2024-01-31T05:04:21.580399+0000","last_fullsized":"2024-01-31T05:04:21.580399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:17:35.221341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579952+0000","last_change":"2024-01-31T05:04:16.290253+0000","last_active":"2024-01-31T05:04:21.579952+0000","last_peered":"2024-01-31T05:04:21.579952+0000","last_clean":"2024-01-31T05:04:21.579952+0000","last_became_active":"2024-01-31T05:04:16.289838+0000","last_became_peered":"2024-01-31T05:04:16.289838+0000","last_unstale":"2024-01-31T05:04:21.579952+0000","last_undegraded":"2024-01-31T05:04:21.579952+0000","last_fullsized":"2024-01-31T05:04:21.579952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:20:10.742169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580789+0000","last_change":"2024-01-31T05:04:15.866801+0000","last_active":"2024-01-31T05:04:21.580789+0000","last_peered":"2024-01-31T05:04:21.580789+0000","last_clean":"2024-01-31T05:04:21.580789+0000","last_became_active":"2024-01-31T05:04:15.866478+0000","last_became_peered":"2024-01-31T05:04:15.866478+0000","last_unstale":"2024-01-31T05:04:21.580789+0000","last_undegraded":"2024-01-31T05:04:21.580789+0000","last_fullsized":"2024-01-31T05:04:21.580789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:11.318125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580174+0000","last_change":"2024-01-31T05:04:20.307543+0000","last_active":"2024-01-31T05:04:21.580174+0000","last_peered":"2024-01-31T05:04:21.580174+0000","last_clean":"2024-01-31T05:04:21.580174+0000","last_became_active":"2024-01-31T05:04:20.307124+0000","last_became_peered":"2024-01-31T05:04:20.307124+0000","last_unstale":"2024-01-31T05:04:21.580174+0000","last_undegraded":"2024-01-31T05:04:21.580174+0000","last_fullsized":"2024-01-31T05:04:21.580174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:44.473185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581703+0000","last_change":"2024-01-31T05:04:16.289496+0000","last_active":"2024-01-31T05:04:21.581703+0000","last_peered":"2024-01-31T05:04:21.581703+0000","last_clean":"2024-01-31T05:04:21.581703+0000","last_became_active":"2024-01-31T05:04:16.288932+0000","last_became_peered":"2024-01-31T05:04:16.288932+0000","last_unstale":"2024-01-31T05:04:21.581703+0000","last_undegraded":"2024-01-31T05:04:21.581703+0000","last_fullsized":"2024-01-31T05:04:21.581703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:26:00.186988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267853+0000","last_change":"2024-01-31T05:04:15.868950+0000","last_active":"2024-01-31T05:04:21.267853+0000","last_peered":"2024-01-31T05:04:21.267853+0000","last_clean":"2024-01-31T05:04:21.267853+0000","last_became_active":"2024-01-31T05:04:15.868416+0000","last_became_peered":"2024-01-31T05:04:15.868416+0000","last_unstale":"2024-01-31T05:04:21.267853+0000","last_undegraded":"2024-01-31T05:04:21.267853+0000","last_fullsized":"2024-01-31T05:04:21.267853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:12:26.990588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579270+0000","last_change":"2024-01-31T05:04:20.412399+0000","last_active":"2024-01-31T05:04:21.579270+0000","last_peered":"2024-01-31T05:04:21.579270+0000","last_clean":"2024-01-31T05:04:21.579270+0000","last_became_active":"2024-01-31T05:04:20.412174+0000","last_became_peered":"2024-01-31T05:04:20.412174+0000","last_unstale":"2024-01-31T05:04:21.579270+0000","last_undegraded":"2024-01-31T05:04:21.579270+0000","last_fullsized":"2024-01-31T05:04:21.579270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:50:26.572528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.582346+0000","last_change":"2024-01-31T05:04:16.291917+0000","last_active":"2024-01-31T05:04:21.582346+0000","last_peered":"2024-01-31T05:04:21.582346+0000","last_clean":"2024-01-31T05:04:21.582346+0000","last_became_active":"2024-01-31T05:04:16.291631+0000","last_became_peered":"2024-01-31T05:04:16.291631+0000","last_unstale":"2024-01-31T05:04:21.582346+0000","last_undegraded":"2024-01-31T05:04:21.582346+0000","last_fullsized":"2024-01-31T05:04:21.582346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:29:14.662909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267621+0000","last_change":"2024-01-31T05:04:15.860520+0000","last_active":"2024-01-31T05:04:21.267621+0000","last_peered":"2024-01-31T05:04:21.267621+0000","last_clean":"2024-01-31T05:04:21.267621+0000","last_became_active":"2024-01-31T05:04:15.860310+0000","last_became_peered":"2024-01-31T05:04:15.860310+0000","last_unstale":"2024-01-31T05:04:21.267621+0000","last_undegraded":"2024-01-31T05:04:21.267621+0000","last_fullsized":"2024-01-31T05:04:21.267621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:05:24.077981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266628+0000","last_change":"2024-01-31T05:04:20.303904+0000","last_active":"2024-01-31T05:04:21.266628+0000","last_peered":"2024-01-31T05:04:21.266628+0000","last_clean":"2024-01-31T05:04:21.266628+0000","last_became_active":"2024-01-31T05:04:20.302675+0000","last_became_peered":"2024-01-31T05:04:20.302675+0000","last_unstale":"2024-01-31T05:04:21.266628+0000","last_undegraded":"2024-01-31T05:04:21.266628+0000","last_fullsized":"2024-01-31T05:04:21.266628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:59:20.936979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581255+0000","last_change":"2024-01-31T05:04:16.293580+0000","last_active":"2024-01-31T05:04:21.581255+0000","last_peered":"2024-01-31T05:04:21.581255+0000","last_clean":"2024-01-31T05:04:21.581255+0000","last_became_active":"2024-01-31T05:04:16.289043+0000","last_became_peered":"2024-01-31T05:04:16.289043+0000","last_unstale":"2024-01-31T05:04:21.581255+0000","last_undegraded":"2024-01-31T05:04:21.581255+0000","last_fullsized":"2024-01-31T05:04:21.581255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:20.440155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266904+0000","last_change":"2024-01-31T05:04:15.858583+0000","last_active":"2024-01-31T05:04:21.266904+0000","last_peered":"2024-01-31T05:04:21.266904+0000","last_clean":"2024-01-31T05:04:21.266904+0000","last_became_active":"2024-01-31T05:04:15.858214+0000","last_became_peered":"2024-01-31T05:04:15.858214+0000","last_unstale":"2024-01-31T05:04:21.266904+0000","last_undegraded":"2024-01-31T05:04:21.266904+0000","last_fullsized":"2024-01-31T05:04:21.266904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:27:44.760988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580996+0000","last_change":"2024-01-31T05:04:20.305474+0000","last_active":"2024-01-31T05:04:21.580996+0000","last_peered":"2024-01-31T05:04:21.580996+0000","last_clean":"2024-01-31T05:04:21.580996+0000","last_became_active":"2024-01-31T05:04:20.304812+0000","last_became_peered":"2024-01-31T05:04:20.304812+0000","last_unstale":"2024-01-31T05:04:21.580996+0000","last_undegraded":"2024-01-31T05:04:21.580996+0000","last_fullsized":"2024-01-31T05:04:21.580996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:45.735003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580086+0000","last_change":"2024-01-31T05:04:16.281029+0000","last_active":"2024-01-31T05:04:21.580086+0000","last_peered":"2024-01-31T05:04:21.580086+0000","last_clean":"2024-01-31T05:04:21.580086+0000","last_became_active":"2024-01-31T05:04:16.280773+0000","last_became_peered":"2024-01-31T05:04:16.280773+0000","last_unstale":"2024-01-31T05:04:21.580086+0000","last_undegraded":"2024-01-31T05:04:21.580086+0000","last_fullsized":"2024-01-31T05:04:21.580086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:44:28.652707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580546+0000","last_change":"2024-01-31T05:04:15.873157+0000","last_active":"2024-01-31T05:04:21.580546+0000","last_peered":"2024-01-31T05:04:21.580546+0000","last_clean":"2024-01-31T05:04:21.580546+0000","last_became_active":"2024-01-31T05:04:15.872851+0000","last_became_peered":"2024-01-31T05:04:15.872851+0000","last_unstale":"2024-01-31T05:04:21.580546+0000","last_undegraded":"2024-01-31T05:04:21.580546+0000","last_fullsized":"2024-01-31T05:04:21.580546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:53.760373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267875+0000","last_change":"2024-01-31T05:04:20.414571+0000","last_active":"2024-01-31T05:04:21.267875+0000","last_peered":"2024-01-31T05:04:21.267875+0000","last_clean":"2024-01-31T05:04:21.267875+0000","last_became_active":"2024-01-31T05:04:20.413308+0000","last_became_peered":"2024-01-31T05:04:20.413308+0000","last_unstale":"2024-01-31T05:04:21.267875+0000","last_undegraded":"2024-01-31T05:04:21.267875+0000","last_fullsized":"2024-01-31T05:04:21.267875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:41:46.079832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581697+0000","last_change":"2024-01-31T05:04:16.289635+0000","last_active":"2024-01-31T05:04:21.581697+0000","last_peered":"2024-01-31T05:04:21.581697+0000","last_clean":"2024-01-31T05:04:21.581697+0000","last_became_active":"2024-01-31T05:04:16.289367+0000","last_became_peered":"2024-01-31T05:04:16.289367+0000","last_unstale":"2024-01-31T05:04:21.581697+0000","last_undegraded":"2024-01-31T05:04:21.581697+0000","last_fullsized":"2024-01-31T05:04:21.581697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:20:10.742169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579673+0000","last_change":"2024-01-31T05:04:15.867802+0000","last_active":"2024-01-31T05:04:21.579673+0000","last_peered":"2024-01-31T05:04:21.579673+0000","last_clean":"2024-01-31T05:04:21.579673+0000","last_became_active":"2024-01-31T05:04:15.867509+0000","last_became_peered":"2024-01-31T05:04:15.867509+0000","last_unstale":"2024-01-31T05:04:21.579673+0000","last_undegraded":"2024-01-31T05:04:21.579673+0000","last_fullsized":"2024-01-31T05:04:21.579673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:12:26.990588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267002+0000","last_change":"2024-01-31T05:04:20.410363+0000","last_active":"2024-01-31T05:04:21.267002+0000","last_peered":"2024-01-31T05:04:21.267002+0000","last_clean":"2024-01-31T05:04:21.267002+0000","last_became_active":"2024-01-31T05:04:20.409349+0000","last_became_peered":"2024-01-31T05:04:20.409349+0000","last_unstale":"2024-01-31T05:04:21.267002+0000","last_undegraded":"2024-01-31T05:04:21.267002+0000","last_fullsized":"2024-01-31T05:04:21.267002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:12:43.831584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580116+0000","last_change":"2024-01-31T05:04:16.279383+0000","last_active":"2024-01-31T05:04:21.580116+0000","last_peered":"2024-01-31T05:04:21.580116+0000","last_clean":"2024-01-31T05:04:21.580116+0000","last_became_active":"2024-01-31T05:04:16.278871+0000","last_became_peered":"2024-01-31T05:04:16.278871+0000","last_unstale":"2024-01-31T05:04:21.580116+0000","last_undegraded":"2024-01-31T05:04:21.580116+0000","last_fullsized":"2024-01-31T05:04:21.580116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:14:16.417240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580394+0000","last_change":"2024-01-31T05:04:15.860246+0000","last_active":"2024-01-31T05:04:21.580394+0000","last_peered":"2024-01-31T05:04:21.580394+0000","last_clean":"2024-01-31T05:04:21.580394+0000","last_became_active":"2024-01-31T05:04:15.860027+0000","last_became_peered":"2024-01-31T05:04:15.860027+0000","last_unstale":"2024-01-31T05:04:21.580394+0000","last_undegraded":"2024-01-31T05:04:21.580394+0000","last_fullsized":"2024-01-31T05:04:21.580394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:00:09.341930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580269+0000","last_change":"2024-01-31T05:04:20.414791+0000","last_active":"2024-01-31T05:04:21.580269+0000","last_peered":"2024-01-31T05:04:21.580269+0000","last_clean":"2024-01-31T05:04:21.580269+0000","last_became_active":"2024-01-31T05:04:20.414082+0000","last_became_peered":"2024-01-31T05:04:20.414082+0000","last_unstale":"2024-01-31T05:04:21.580269+0000","last_undegraded":"2024-01-31T05:04:21.580269+0000","last_fullsized":"2024-01-31T05:04:21.580269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:29:34.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581901+0000","last_change":"2024-01-31T05:04:16.288217+0000","last_active":"2024-01-31T05:04:21.581901+0000","last_peered":"2024-01-31T05:04:21.581901+0000","last_clean":"2024-01-31T05:04:21.581901+0000","last_became_active":"2024-01-31T05:04:16.287855+0000","last_became_peered":"2024-01-31T05:04:16.287855+0000","last_unstale":"2024-01-31T05:04:21.581901+0000","last_undegraded":"2024-01-31T05:04:21.581901+0000","last_fullsized":"2024-01-31T05:04:21.581901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:17:31.783779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:26.937176+0000","last_change":"2024-01-31T05:04:15.871503+0000","last_active":"2024-01-31T05:04:26.937176+0000","last_peered":"2024-01-31T05:04:26.937176+0000","last_clean":"2024-01-31T05:04:26.937176+0000","last_became_active":"2024-01-31T05:04:15.871207+0000","last_became_peered":"2024-01-31T05:04:15.871207+0000","last_unstale":"2024-01-31T05:04:26.937176+0000","last_undegraded":"2024-01-31T05:04:26.937176+0000","last_fullsized":"2024-01-31T05:04:26.937176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:07:45.743062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580076+0000","last_change":"2024-01-31T05:04:20.318951+0000","last_active":"2024-01-31T05:04:21.580076+0000","last_peered":"2024-01-31T05:04:21.580076+0000","last_clean":"2024-01-31T05:04:21.580076+0000","last_became_active":"2024-01-31T05:04:20.315434+0000","last_became_peered":"2024-01-31T05:04:20.315434+0000","last_unstale":"2024-01-31T05:04:21.580076+0000","last_undegraded":"2024-01-31T05:04:21.580076+0000","last_fullsized":"2024-01-31T05:04:21.580076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:44.473185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267446+0000","last_change":"2024-01-31T05:04:16.284047+0000","last_active":"2024-01-31T05:04:21.267446+0000","last_peered":"2024-01-31T05:04:21.267446+0000","last_clean":"2024-01-31T05:04:21.267446+0000","last_became_active":"2024-01-31T05:04:16.283455+0000","last_became_peered":"2024-01-31T05:04:16.283455+0000","last_unstale":"2024-01-31T05:04:21.267446+0000","last_undegraded":"2024-01-31T05:04:21.267446+0000","last_fullsized":"2024-01-31T05:04:21.267446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:24:56.115180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580681+0000","last_change":"2024-01-31T05:04:15.868251+0000","last_active":"2024-01-31T05:04:21.580681+0000","last_peered":"2024-01-31T05:04:21.580681+0000","last_clean":"2024-01-31T05:04:21.580681+0000","last_became_active":"2024-01-31T05:04:15.867924+0000","last_became_peered":"2024-01-31T05:04:15.867924+0000","last_unstale":"2024-01-31T05:04:21.580681+0000","last_undegraded":"2024-01-31T05:04:21.580681+0000","last_fullsized":"2024-01-31T05:04:21.580681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:07:45.743062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267249+0000","last_change":"2024-01-31T05:04:20.302123+0000","last_active":"2024-01-31T05:04:21.267249+0000","last_peered":"2024-01-31T05:04:21.267249+0000","last_clean":"2024-01-31T05:04:21.267249+0000","last_became_active":"2024-01-31T05:04:20.301865+0000","last_became_peered":"2024-01-31T05:04:20.301865+0000","last_unstale":"2024-01-31T05:04:21.267249+0000","last_undegraded":"2024-01-31T05:04:21.267249+0000","last_fullsized":"2024-01-31T05:04:21.267249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:17:35.221341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581093+0000","last_change":"2024-01-31T05:04:16.295806+0000","last_active":"2024-01-31T05:04:21.581093+0000","last_peered":"2024-01-31T05:04:21.581093+0000","last_clean":"2024-01-31T05:04:21.581093+0000","last_became_active":"2024-01-31T05:04:16.295553+0000","last_became_peered":"2024-01-31T05:04:16.295553+0000","last_unstale":"2024-01-31T05:04:21.581093+0000","last_undegraded":"2024-01-31T05:04:21.581093+0000","last_fullsized":"2024-01-31T05:04:21.581093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580840+0000","last_change":"2024-01-31T05:04:15.875006+0000","last_active":"2024-01-31T05:04:21.580840+0000","last_peered":"2024-01-31T05:04:21.580840+0000","last_clean":"2024-01-31T05:04:21.580840+0000","last_became_active":"2024-01-31T05:04:15.874743+0000","last_became_peered":"2024-01-31T05:04:15.874743+0000","last_unstale":"2024-01-31T05:04:21.580840+0000","last_undegraded":"2024-01-31T05:04:21.580840+0000","last_fullsized":"2024-01-31T05:04:21.580840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:37.392650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266837+0000","last_change":"2024-01-31T05:04:20.316263+0000","last_active":"2024-01-31T05:04:21.266837+0000","last_peered":"2024-01-31T05:04:21.266837+0000","last_clean":"2024-01-31T05:04:21.266837+0000","last_became_active":"2024-01-31T05:04:20.315752+0000","last_became_peered":"2024-01-31T05:04:20.315752+0000","last_unstale":"2024-01-31T05:04:21.266837+0000","last_undegraded":"2024-01-31T05:04:21.266837+0000","last_fullsized":"2024-01-31T05:04:21.266837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:29:34.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580744+0000","last_change":"2024-01-31T05:04:16.292783+0000","last_active":"2024-01-31T05:04:21.580744+0000","last_peered":"2024-01-31T05:04:21.580744+0000","last_clean":"2024-01-31T05:04:21.580744+0000","last_became_active":"2024-01-31T05:04:16.292520+0000","last_became_peered":"2024-01-31T05:04:16.292520+0000","last_unstale":"2024-01-31T05:04:21.580744+0000","last_undegraded":"2024-01-31T05:04:21.580744+0000","last_fullsized":"2024-01-31T05:04:21.580744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:52:00.886932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581728+0000","last_change":"2024-01-31T05:04:15.877472+0000","last_active":"2024-01-31T05:04:21.581728+0000","last_peered":"2024-01-31T05:04:21.581728+0000","last_clean":"2024-01-31T05:04:21.581728+0000","last_became_active":"2024-01-31T05:04:15.877195+0000","last_became_peered":"2024-01-31T05:04:15.877195+0000","last_unstale":"2024-01-31T05:04:21.581728+0000","last_undegraded":"2024-01-31T05:04:21.581728+0000","last_fullsized":"2024-01-31T05:04:21.581728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:38:14.126192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266508+0000","last_change":"2024-01-31T05:04:20.410602+0000","last_active":"2024-01-31T05:04:21.266508+0000","last_peered":"2024-01-31T05:04:21.266508+0000","last_clean":"2024-01-31T05:04:21.266508+0000","last_became_active":"2024-01-31T05:04:20.410214+0000","last_became_peered":"2024-01-31T05:04:20.410214+0000","last_unstale":"2024-01-31T05:04:21.266508+0000","last_undegraded":"2024-01-31T05:04:21.266508+0000","last_fullsized":"2024-01-31T05:04:21.266508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:50:26.572528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580777+0000","last_change":"2024-01-31T05:04:20.413035+0000","last_active":"2024-01-31T05:04:21.580777+0000","last_peered":"2024-01-31T05:04:21.580777+0000","last_clean":"2024-01-31T05:04:21.580777+0000","last_became_active":"2024-01-31T05:04:20.409657+0000","last_became_peered":"2024-01-31T05:04:20.409657+0000","last_unstale":"2024-01-31T05:04:21.580777+0000","last_undegraded":"2024-01-31T05:04:21.580777+0000","last_fullsized":"2024-01-31T05:04:21.580777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:52:04.324494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579651+0000","last_change":"2024-01-31T05:04:16.280492+0000","last_active":"2024-01-31T05:04:21.579651+0000","last_peered":"2024-01-31T05:04:21.579651+0000","last_clean":"2024-01-31T05:04:21.579651+0000","last_became_active":"2024-01-31T05:04:16.280274+0000","last_became_peered":"2024-01-31T05:04:16.280274+0000","last_unstale":"2024-01-31T05:04:21.579651+0000","last_undegraded":"2024-01-31T05:04:21.579651+0000","last_fullsized":"2024-01-31T05:04:21.579651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:32:44.394537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579405+0000","last_change":"2024-01-31T05:04:15.861706+0000","last_active":"2024-01-31T05:04:21.579405+0000","last_peered":"2024-01-31T05:04:21.579405+0000","last_clean":"2024-01-31T05:04:21.579405+0000","last_became_active":"2024-01-31T05:04:15.861143+0000","last_became_peered":"2024-01-31T05:04:15.861143+0000","last_unstale":"2024-01-31T05:04:21.579405+0000","last_undegraded":"2024-01-31T05:04:21.579405+0000","last_fullsized":"2024-01-31T05:04:21.579405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:53.760373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581668+0000","last_change":"2024-01-31T05:04:20.314757+0000","last_active":"2024-01-31T05:04:21.581668+0000","last_peered":"2024-01-31T05:04:21.581668+0000","last_clean":"2024-01-31T05:04:21.581668+0000","last_became_active":"2024-01-31T05:04:20.314255+0000","last_became_peered":"2024-01-31T05:04:20.314255+0000","last_unstale":"2024-01-31T05:04:21.581668+0000","last_undegraded":"2024-01-31T05:04:21.581668+0000","last_fullsized":"2024-01-31T05:04:21.581668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:51.219189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266310+0000","last_change":"2024-01-31T05:04:16.283281+0000","last_active":"2024-01-31T05:04:21.266310+0000","last_peered":"2024-01-31T05:04:21.266310+0000","last_clean":"2024-01-31T05:04:21.266310+0000","last_became_active":"2024-01-31T05:04:16.283067+0000","last_became_peered":"2024-01-31T05:04:16.283067+0000","last_unstale":"2024-01-31T05:04:21.266310+0000","last_undegraded":"2024-01-31T05:04:21.266310+0000","last_fullsized":"2024-01-31T05:04:21.266310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:32:44.394537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266680+0000","last_change":"2024-01-31T05:04:15.870556+0000","last_active":"2024-01-31T05:04:21.266680+0000","last_peered":"2024-01-31T05:04:21.266680+0000","last_clean":"2024-01-31T05:04:21.266680+0000","last_became_active":"2024-01-31T05:04:15.870204+0000","last_became_peered":"2024-01-31T05:04:15.870204+0000","last_unstale":"2024-01-31T05:04:21.266680+0000","last_undegraded":"2024-01-31T05:04:21.266680+0000","last_fullsized":"2024-01-31T05:04:21.266680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:53.760373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580467+0000","last_change":"2024-01-31T05:04:15.874785+0000","last_active":"2024-01-31T05:04:21.580467+0000","last_peered":"2024-01-31T05:04:21.580467+0000","last_clean":"2024-01-31T05:04:21.580467+0000","last_became_active":"2024-01-31T05:04:15.874174+0000","last_became_peered":"2024-01-31T05:04:15.874174+0000","last_unstale":"2024-01-31T05:04:21.580467+0000","last_undegraded":"2024-01-31T05:04:21.580467+0000","last_fullsized":"2024-01-31T05:04:21.580467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:11.318125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580306+0000","last_change":"2024-01-31T05:04:16.273656+0000","last_active":"2024-01-31T05:04:21.580306+0000","last_peered":"2024-01-31T05:04:21.580306+0000","last_clean":"2024-01-31T05:04:21.580306+0000","last_became_active":"2024-01-31T05:04:16.273182+0000","last_became_peered":"2024-01-31T05:04:16.273182+0000","last_unstale":"2024-01-31T05:04:21.580306+0000","last_undegraded":"2024-01-31T05:04:21.580306+0000","last_fullsized":"2024-01-31T05:04:21.580306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:32:44.394537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267586+0000","last_change":"2024-01-31T05:04:20.304766+0000","last_active":"2024-01-31T05:04:21.267586+0000","last_peered":"2024-01-31T05:04:21.267586+0000","last_clean":"2024-01-31T05:04:21.267586+0000","last_became_active":"2024-01-31T05:04:20.302194+0000","last_became_peered":"2024-01-31T05:04:20.302194+0000","last_unstale":"2024-01-31T05:04:21.267586+0000","last_undegraded":"2024-01-31T05:04:21.267586+0000","last_fullsized":"2024-01-31T05:04:21.267586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:44:32.090269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266563+0000","last_change":"2024-01-31T05:04:15.863162+0000","last_active":"2024-01-31T05:04:21.266563+0000","last_peered":"2024-01-31T05:04:21.266563+0000","last_clean":"2024-01-31T05:04:21.266563+0000","last_became_active":"2024-01-31T05:04:15.862856+0000","last_became_peered":"2024-01-31T05:04:15.862856+0000","last_unstale":"2024-01-31T05:04:21.266563+0000","last_undegraded":"2024-01-31T05:04:21.266563+0000","last_fullsized":"2024-01-31T05:04:21.266563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:38:14.126192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266991+0000","last_change":"2024-01-31T05:04:16.278690+0000","last_active":"2024-01-31T05:04:21.266991+0000","last_peered":"2024-01-31T05:04:21.266991+0000","last_clean":"2024-01-31T05:04:21.266991+0000","last_became_active":"2024-01-31T05:04:16.277442+0000","last_became_peered":"2024-01-31T05:04:16.277442+0000","last_unstale":"2024-01-31T05:04:21.266991+0000","last_undegraded":"2024-01-31T05:04:21.266991+0000","last_fullsized":"2024-01-31T05:04:21.266991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:07:46.749416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267351+0000","last_change":"2024-01-31T05:04:20.302359+0000","last_active":"2024-01-31T05:04:21.267351+0000","last_peered":"2024-01-31T05:04:21.267351+0000","last_clean":"2024-01-31T05:04:21.267351+0000","last_became_active":"2024-01-31T05:04:20.301989+0000","last_became_peered":"2024-01-31T05:04:20.301989+0000","last_unstale":"2024-01-31T05:04:21.267351+0000","last_undegraded":"2024-01-31T05:04:21.267351+0000","last_fullsized":"2024-01-31T05:04:21.267351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:45:23.064537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579969+0000","last_change":"2024-01-31T05:04:16.281815+0000","last_active":"2024-01-31T05:04:21.579969+0000","last_peered":"2024-01-31T05:04:21.579969+0000","last_clean":"2024-01-31T05:04:21.579969+0000","last_became_active":"2024-01-31T05:04:16.281498+0000","last_became_peered":"2024-01-31T05:04:16.281498+0000","last_unstale":"2024-01-31T05:04:21.579969+0000","last_undegraded":"2024-01-31T05:04:21.579969+0000","last_fullsized":"2024-01-31T05:04:21.579969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267024+0000","last_change":"2024-01-31T05:04:16.295756+0000","last_active":"2024-01-31T05:04:21.267024+0000","last_peered":"2024-01-31T05:04:21.267024+0000","last_clean":"2024-01-31T05:04:21.267024+0000","last_became_active":"2024-01-31T05:04:16.295450+0000","last_became_peered":"2024-01-31T05:04:16.295450+0000","last_unstale":"2024-01-31T05:04:21.267024+0000","last_undegraded":"2024-01-31T05:04:21.267024+0000","last_fullsized":"2024-01-31T05:04:21.267024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:16:27.370806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579563+0000","last_change":"2024-01-31T05:04:16.298362+0000","last_active":"2024-01-31T05:04:21.579563+0000","last_peered":"2024-01-31T05:04:21.579563+0000","last_clean":"2024-01-31T05:04:21.579563+0000","last_became_active":"2024-01-31T05:04:16.297810+0000","last_became_peered":"2024-01-31T05:04:16.297810+0000","last_unstale":"2024-01-31T05:04:21.579563+0000","last_undegraded":"2024-01-31T05:04:21.579563+0000","last_fullsized":"2024-01-31T05:04:21.579563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:10:07.431961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580221+0000","last_change":"2024-01-31T05:04:16.282239+0000","last_active":"2024-01-31T05:04:21.580221+0000","last_peered":"2024-01-31T05:04:21.580221+0000","last_clean":"2024-01-31T05:04:21.580221+0000","last_became_active":"2024-01-31T05:04:16.281895+0000","last_became_peered":"2024-01-31T05:04:16.281895+0000","last_unstale":"2024-01-31T05:04:21.580221+0000","last_undegraded":"2024-01-31T05:04:21.580221+0000","last_fullsized":"2024-01-31T05:04:21.580221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:36.794548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267075+0000","last_change":"2024-01-31T05:04:16.282767+0000","last_active":"2024-01-31T05:04:21.267075+0000","last_peered":"2024-01-31T05:04:21.267075+0000","last_clean":"2024-01-31T05:04:21.267075+0000","last_became_active":"2024-01-31T05:04:16.282281+0000","last_became_peered":"2024-01-31T05:04:16.282281+0000","last_unstale":"2024-01-31T05:04:21.267075+0000","last_undegraded":"2024-01-31T05:04:21.267075+0000","last_fullsized":"2024-01-31T05:04:21.267075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:29:14.662909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580441+0000","last_change":"2024-01-31T05:04:16.281263+0000","last_active":"2024-01-31T05:04:21.580441+0000","last_peered":"2024-01-31T05:04:21.580441+0000","last_clean":"2024-01-31T05:04:21.580441+0000","last_became_active":"2024-01-31T05:04:16.280997+0000","last_became_peered":"2024-01-31T05:04:16.280997+0000","last_unstale":"2024-01-31T05:04:21.580441+0000","last_undegraded":"2024-01-31T05:04:21.580441+0000","last_fullsized":"2024-01-31T05:04:21.580441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:38.399003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581900+0000","last_change":"2024-01-31T05:04:16.287350+0000","last_active":"2024-01-31T05:04:21.581900+0000","last_peered":"2024-01-31T05:04:21.581900+0000","last_clean":"2024-01-31T05:04:21.581900+0000","last_became_active":"2024-01-31T05:04:16.286994+0000","last_became_peered":"2024-01-31T05:04:16.286994+0000","last_unstale":"2024-01-31T05:04:21.581900+0000","last_undegraded":"2024-01-31T05:04:21.581900+0000","last_fullsized":"2024-01-31T05:04:21.581900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:38.399003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267923+0000","last_change":"2024-01-31T05:04:16.281989+0000","last_active":"2024-01-31T05:04:21.267923+0000","last_peered":"2024-01-31T05:04:21.267923+0000","last_clean":"2024-01-31T05:04:21.267923+0000","last_became_active":"2024-01-31T05:04:16.281750+0000","last_became_peered":"2024-01-31T05:04:16.281750+0000","last_unstale":"2024-01-31T05:04:21.267923+0000","last_undegraded":"2024-01-31T05:04:21.267923+0000","last_fullsized":"2024-01-31T05:04:21.267923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579377+0000","last_change":"2024-01-31T05:04:16.294158+0000","last_active":"2024-01-31T05:04:21.579377+0000","last_peered":"2024-01-31T05:04:21.579377+0000","last_clean":"2024-01-31T05:04:21.579377+0000","last_became_active":"2024-01-31T05:04:16.293446+0000","last_became_peered":"2024-01-31T05:04:16.293446+0000","last_unstale":"2024-01-31T05:04:21.579377+0000","last_undegraded":"2024-01-31T05:04:21.579377+0000","last_fullsized":"2024-01-31T05:04:21.579377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:17:31.783779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266570+0000","last_change":"2024-01-31T05:04:16.285685+0000","last_active":"2024-01-31T05:04:21.266570+0000","last_peered":"2024-01-31T05:04:21.266570+0000","last_clean":"2024-01-31T05:04:21.266570+0000","last_became_active":"2024-01-31T05:04:16.285379+0000","last_became_peered":"2024-01-31T05:04:16.285379+0000","last_unstale":"2024-01-31T05:04:21.266570+0000","last_undegraded":"2024-01-31T05:04:21.266570+0000","last_fullsized":"2024-01-31T05:04:21.266570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:36.794548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579467+0000","last_change":"2024-01-31T05:04:16.295065+0000","last_active":"2024-01-31T05:04:21.579467+0000","last_peered":"2024-01-31T05:04:21.579467+0000","last_clean":"2024-01-31T05:04:21.579467+0000","last_became_active":"2024-01-31T05:04:16.294149+0000","last_became_peered":"2024-01-31T05:04:16.294149+0000","last_unstale":"2024-01-31T05:04:21.579467+0000","last_undegraded":"2024-01-31T05:04:21.579467+0000","last_fullsized":"2024-01-31T05:04:21.579467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:20.440155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580011+0000","last_change":"2024-01-31T05:04:16.282035+0000","last_active":"2024-01-31T05:04:21.580011+0000","last_peered":"2024-01-31T05:04:21.580011+0000","last_clean":"2024-01-31T05:04:21.580011+0000","last_became_active":"2024-01-31T05:04:16.281692+0000","last_became_peered":"2024-01-31T05:04:16.281692+0000","last_unstale":"2024-01-31T05:04:21.580011+0000","last_undegraded":"2024-01-31T05:04:21.580011+0000","last_fullsized":"2024-01-31T05:04:21.580011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:44:28.652707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580645+0000","last_change":"2024-01-31T05:04:16.286442+0000","last_active":"2024-01-31T05:04:21.580645+0000","last_peered":"2024-01-31T05:04:21.580645+0000","last_clean":"2024-01-31T05:04:21.580645+0000","last_became_active":"2024-01-31T05:04:16.286105+0000","last_became_peered":"2024-01-31T05:04:16.286105+0000","last_unstale":"2024-01-31T05:04:21.580645+0000","last_undegraded":"2024-01-31T05:04:21.580645+0000","last_fullsized":"2024-01-31T05:04:21.580645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.582060+0000","last_change":"2024-01-31T05:04:16.285693+0000","last_active":"2024-01-31T05:04:21.582060+0000","last_peered":"2024-01-31T05:04:21.582060+0000","last_clean":"2024-01-31T05:04:21.582060+0000","last_became_active":"2024-01-31T05:04:16.285438+0000","last_became_peered":"2024-01-31T05:04:16.285438+0000","last_unstale":"2024-01-31T05:04:21.582060+0000","last_undegraded":"2024-01-31T05:04:21.582060+0000","last_fullsized":"2024-01-31T05:04:21.582060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:41.035623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267794+0000","last_change":"2024-01-31T05:04:16.288398+0000","last_active":"2024-01-31T05:04:21.267794+0000","last_peered":"2024-01-31T05:04:21.267794+0000","last_clean":"2024-01-31T05:04:21.267794+0000","last_became_active":"2024-01-31T05:04:16.288236+0000","last_became_peered":"2024-01-31T05:04:16.288236+0000","last_unstale":"2024-01-31T05:04:21.267794+0000","last_undegraded":"2024-01-31T05:04:21.267794+0000","last_fullsized":"2024-01-31T05:04:21.267794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:24:56.115180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581838+0000","last_change":"2024-01-31T05:04:16.289516+0000","last_active":"2024-01-31T05:04:21.581838+0000","last_peered":"2024-01-31T05:04:21.581838+0000","last_clean":"2024-01-31T05:04:21.581838+0000","last_became_active":"2024-01-31T05:04:16.289233+0000","last_became_peered":"2024-01-31T05:04:16.289233+0000","last_unstale":"2024-01-31T05:04:21.581838+0000","last_undegraded":"2024-01-31T05:04:21.581838+0000","last_fullsized":"2024-01-31T05:04:21.581838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:42.297440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579222+0000","last_change":"2024-01-31T05:04:16.296022+0000","last_active":"2024-01-31T05:04:21.579222+0000","last_peered":"2024-01-31T05:04:21.579222+0000","last_clean":"2024-01-31T05:04:21.579222+0000","last_became_active":"2024-01-31T05:04:16.295742+0000","last_became_peered":"2024-01-31T05:04:16.295742+0000","last_unstale":"2024-01-31T05:04:21.579222+0000","last_undegraded":"2024-01-31T05:04:21.579222+0000","last_fullsized":"2024-01-31T05:04:21.579222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579754+0000","last_change":"2024-01-31T05:04:16.287380+0000","last_active":"2024-01-31T05:04:21.579754+0000","last_peered":"2024-01-31T05:04:21.579754+0000","last_clean":"2024-01-31T05:04:21.579754+0000","last_became_active":"2024-01-31T05:04:16.287109+0000","last_became_peered":"2024-01-31T05:04:16.287109+0000","last_unstale":"2024-01-31T05:04:21.579754+0000","last_undegraded":"2024-01-31T05:04:21.579754+0000","last_fullsized":"2024-01-31T05:04:21.579754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:36.794548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580061+0000","last_change":"2024-01-31T05:04:16.279154+0000","last_active":"2024-01-31T05:04:21.580061+0000","last_peered":"2024-01-31T05:04:21.580061+0000","last_clean":"2024-01-31T05:04:21.580061+0000","last_became_active":"2024-01-31T05:04:16.278567+0000","last_became_peered":"2024-01-31T05:04:16.278567+0000","last_unstale":"2024-01-31T05:04:21.580061+0000","last_undegraded":"2024-01-31T05:04:21.580061+0000","last_fullsized":"2024-01-31T05:04:21.580061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:42:45.290684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266435+0000","last_change":"2024-01-31T05:04:16.297488+0000","last_active":"2024-01-31T05:04:21.266435+0000","last_peered":"2024-01-31T05:04:21.266435+0000","last_clean":"2024-01-31T05:04:21.266435+0000","last_became_active":"2024-01-31T05:04:16.297230+0000","last_became_peered":"2024-01-31T05:04:16.297230+0000","last_unstale":"2024-01-31T05:04:21.266435+0000","last_undegraded":"2024-01-31T05:04:21.266435+0000","last_fullsized":"2024-01-31T05:04:21.266435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267316+0000","last_change":"2024-01-31T05:04:16.288685+0000","last_active":"2024-01-31T05:04:21.267316+0000","last_peered":"2024-01-31T05:04:21.267316+0000","last_clean":"2024-01-31T05:04:21.267316+0000","last_became_active":"2024-01-31T05:04:16.288432+0000","last_became_peered":"2024-01-31T05:04:16.288432+0000","last_unstale":"2024-01-31T05:04:21.267316+0000","last_undegraded":"2024-01-31T05:04:21.267316+0000","last_fullsized":"2024-01-31T05:04:21.267316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:16:27.370806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581061+0000","last_change":"2024-01-31T05:04:16.299989+0000","last_active":"2024-01-31T05:04:21.581061+0000","last_peered":"2024-01-31T05:04:21.581061+0000","last_clean":"2024-01-31T05:04:21.581061+0000","last_became_active":"2024-01-31T05:04:16.299706+0000","last_became_peered":"2024-01-31T05:04:16.299706+0000","last_unstale":"2024-01-31T05:04:21.581061+0000","last_undegraded":"2024-01-31T05:04:21.581061+0000","last_fullsized":"2024-01-31T05:04:21.581061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:32:44.394537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581425+0000","last_change":"2024-01-31T05:04:16.300161+0000","last_active":"2024-01-31T05:04:21.581425+0000","last_peered":"2024-01-31T05:04:21.581425+0000","last_clean":"2024-01-31T05:04:21.581425+0000","last_became_active":"2024-01-31T05:04:16.299891+0000","last_became_peered":"2024-01-31T05:04:16.299891+0000","last_unstale":"2024-01-31T05:04:21.581425+0000","last_undegraded":"2024-01-31T05:04:21.581425+0000","last_fullsized":"2024-01-31T05:04:21.581425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:05:32.076479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581621+0000","last_change":"2024-01-31T05:04:16.296845+0000","last_active":"2024-01-31T05:04:21.581621+0000","last_peered":"2024-01-31T05:04:21.581621+0000","last_clean":"2024-01-31T05:04:21.581621+0000","last_became_active":"2024-01-31T05:04:16.296607+0000","last_became_peered":"2024-01-31T05:04:16.296607+0000","last_unstale":"2024-01-31T05:04:21.581621+0000","last_undegraded":"2024-01-31T05:04:21.581621+0000","last_fullsized":"2024-01-31T05:04:21.581621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:42:10.970514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266165+0000","last_change":"2024-01-31T05:04:16.297713+0000","last_active":"2024-01-31T05:04:21.266165+0000","last_peered":"2024-01-31T05:04:21.266165+0000","last_clean":"2024-01-31T05:04:21.266165+0000","last_became_active":"2024-01-31T05:04:16.297428+0000","last_became_peered":"2024-01-31T05:04:16.297428+0000","last_unstale":"2024-01-31T05:04:21.266165+0000","last_undegraded":"2024-01-31T05:04:21.266165+0000","last_fullsized":"2024-01-31T05:04:21.266165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:44:28.652707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581148+0000","last_change":"2024-01-31T05:04:16.282822+0000","last_active":"2024-01-31T05:04:21.581148+0000","last_peered":"2024-01-31T05:04:21.581148+0000","last_clean":"2024-01-31T05:04:21.581148+0000","last_became_active":"2024-01-31T05:04:16.282537+0000","last_became_peered":"2024-01-31T05:04:16.282537+0000","last_unstale":"2024-01-31T05:04:21.581148+0000","last_undegraded":"2024-01-31T05:04:21.581148+0000","last_fullsized":"2024-01-31T05:04:21.581148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:52:00.886932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579642+0000","last_change":"2024-01-31T05:04:16.298033+0000","last_active":"2024-01-31T05:04:21.579642+0000","last_peered":"2024-01-31T05:04:21.579642+0000","last_clean":"2024-01-31T05:04:21.579642+0000","last_became_active":"2024-01-31T05:04:16.297503+0000","last_became_peered":"2024-01-31T05:04:16.297503+0000","last_unstale":"2024-01-31T05:04:21.579642+0000","last_undegraded":"2024-01-31T05:04:21.579642+0000","last_fullsized":"2024-01-31T05:04:21.579642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581513+0000","last_change":"2024-01-31T05:04:16.284955+0000","last_active":"2024-01-31T05:04:21.581513+0000","last_peered":"2024-01-31T05:04:21.581513+0000","last_clean":"2024-01-31T05:04:21.581513+0000","last_became_active":"2024-01-31T05:04:16.284672+0000","last_became_peered":"2024-01-31T05:04:16.284672+0000","last_unstale":"2024-01-31T05:04:21.581513+0000","last_undegraded":"2024-01-31T05:04:21.581513+0000","last_fullsized":"2024-01-31T05:04:21.581513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:10:07.431961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580116+0000","last_change":"2024-01-31T05:04:16.295273+0000","last_active":"2024-01-31T05:04:21.580116+0000","last_peered":"2024-01-31T05:04:21.580116+0000","last_clean":"2024-01-31T05:04:21.580116+0000","last_became_active":"2024-01-31T05:04:16.294052+0000","last_became_peered":"2024-01-31T05:04:16.294052+0000","last_unstale":"2024-01-31T05:04:21.580116+0000","last_undegraded":"2024-01-31T05:04:21.580116+0000","last_fullsized":"2024-01-31T05:04:21.580116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:59:17.499417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580619+0000","last_change":"2024-01-31T05:04:16.274394+0000","last_active":"2024-01-31T05:04:21.580619+0000","last_peered":"2024-01-31T05:04:21.580619+0000","last_clean":"2024-01-31T05:04:21.580619+0000","last_became_active":"2024-01-31T05:04:16.274092+0000","last_became_peered":"2024-01-31T05:04:16.274092+0000","last_unstale":"2024-01-31T05:04:21.580619+0000","last_undegraded":"2024-01-31T05:04:21.580619+0000","last_fullsized":"2024-01-31T05:04:21.580619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:05:32.076479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580935+0000","last_change":"2024-01-31T05:04:16.276197+0000","last_active":"2024-01-31T05:04:21.580935+0000","last_peered":"2024-01-31T05:04:21.580935+0000","last_clean":"2024-01-31T05:04:21.580935+0000","last_became_active":"2024-01-31T05:04:16.275821+0000","last_became_peered":"2024-01-31T05:04:16.275821+0000","last_unstale":"2024-01-31T05:04:21.580935+0000","last_undegraded":"2024-01-31T05:04:21.580935+0000","last_fullsized":"2024-01-31T05:04:21.580935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581450+0000","last_change":"2024-01-31T05:04:16.289246+0000","last_active":"2024-01-31T05:04:21.581450+0000","last_peered":"2024-01-31T05:04:21.581450+0000","last_clean":"2024-01-31T05:04:21.581450+0000","last_became_active":"2024-01-31T05:04:16.288595+0000","last_became_peered":"2024-01-31T05:04:16.288595+0000","last_unstale":"2024-01-31T05:04:21.581450+0000","last_undegraded":"2024-01-31T05:04:21.581450+0000","last_fullsized":"2024-01-31T05:04:21.581450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:42.297440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":690798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-31T05:04:41.436 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-31T05:04:41.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.611+0000 7f1e8b400640 1 Processor -- start 2024-01-31T05:04:41.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.611+0000 7f1e8b400640 1 -- start start 2024-01-31T05:04:41.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.611+0000 7f1e8b400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e840cdf10 0x7f1e84070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:41.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.611+0000 7f1e8b400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1e840ce610 0x7f1e84071310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:41.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.611+0000 7f1e8b400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8415b4f0 con 0x7f1e8415b110 2024-01-31T05:04:41.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.611+0000 7f1e8b400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e840ce460 con 0x7f1e840ce610 2024-01-31T05:04:41.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.611+0000 7f1e8b400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e84071850 con 0x7f1e840cdf10 2024-01-31T05:04:41.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.611+0000 7f1e89400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1e840ce610 0x7f1e84071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:41.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.611+0000 7f1e83e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e840cdf10 0x7f1e84070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.611+0000 7f1e83e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e840cdf10 0x7f1e84070dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:52770/0 (socket says 172.21.15.49:52770) 2024-01-31T05:04:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.611+0000 7f1e89400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1e840ce610 0x7f1e84071310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41388/0 (socket says 172.21.15.49:41388) 2024-01-31T05:04:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.611+0000 7f1e88a00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f1e8415b110 0x7f1e8406c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:50430/0 (socket says 172.21.15.49:50430) 2024-01-31T05:04:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.611+0000 7f1e83e00640 1 -- 172.21.15.49:0/4254934331 learned_addr learned my addr 172.21.15.49:0/4254934331 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.611+0000 7f1e89400640 1 -- 172.21.15.49:0/4254934331 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e840cdf10 msgr2=0x7f1e84070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.611+0000 7f1e89400640 1 --2- 172.21.15.49:0/4254934331 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e840cdf10 0x7f1e84070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.611+0000 7f1e89400640 1 -- 172.21.15.49:0/4254934331 >> v1:172.21.15.195:6789/0 conn(0x7f1e8415b110 legacy=0x7f1e8406c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.611+0000 7f1e89400640 1 -- 172.21.15.49:0/4254934331 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e840abf20 con 0x7f1e840ce610 2024-01-31T05:04:41.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.611+0000 7f1e83e00640 1 --2- 172.21.15.49:0/4254934331 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e840cdf10 0x7f1e84070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:04:41.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.615+0000 7f1e89400640 1 --2- 172.21.15.49:0/4254934331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e840ce610 0x7f1e84071310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c009dc0 tx=0x7f1e7c01c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3793bad3294ef7f2 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.615+0000 7f1e83400640 1 -- 172.21.15.49:0/4254934331 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c0a59c0 con 0x7f1e840ce610 2024-01-31T05:04:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.615+0000 7f1e83400640 1 -- 172.21.15.49:0/4254934331 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c0a5b20 con 0x7f1e840ce610 2024-01-31T05:04:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.615+0000 7f1e83400640 1 -- 172.21.15.49:0/4254934331 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c0ad440 con 0x7f1e840ce610 2024-01-31T05:04:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.615+0000 7f1e8b400640 1 -- 172.21.15.49:0/4254934331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e840ce610 msgr2=0x7f1e84071310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:41.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.615+0000 7f1e8b400640 1 --2- 172.21.15.49:0/4254934331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e840ce610 0x7f1e84071310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c009dc0 tx=0x7f1e7c01c900 comp rx=0 tx=0).stop 2024-01-31T05:04:41.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.615+0000 7f1e8b400640 1 -- 172.21.15.49:0/4254934331 shutdown_connections 2024-01-31T05:04:41.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.615+0000 7f1e8b400640 1 --2- 172.21.15.49:0/4254934331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e840ce610 0x7f1e84071310 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.615+0000 7f1e8b400640 1 --2- 172.21.15.49:0/4254934331 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e840cdf10 0x7f1e84070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.615+0000 7f1e8b400640 1 -- 172.21.15.49:0/4254934331 >> 172.21.15.49:0/4254934331 conn(0x7f1e840b09a0 msgr2=0x7f1e840b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:41.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.615+0000 7f1e8b400640 1 -- 172.21.15.49:0/4254934331 shutdown_connections 2024-01-31T05:04:41.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.615+0000 7f1e8b400640 1 -- 172.21.15.49:0/4254934331 wait complete. 2024-01-31T05:04:41.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e8b400640 1 Processor -- start 2024-01-31T05:04:41.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e8b400640 1 -- start start 2024-01-31T05:04:41.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e8b400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e840cdf10 0x7f1e840b3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:41.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e8b400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e840ce610 0x7f1e8409a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:41.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e8b400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e8415b110 0x7f1e8409a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:41.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e8b400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840b3760 con 0x7f1e840cdf10 2024-01-31T05:04:41.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e8b400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840b2180 con 0x7f1e8415b110 2024-01-31T05:04:41.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e8b400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840b2460 con 0x7f1e840ce610 2024-01-31T05:04:41.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e88a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e840cdf10 0x7f1e840b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:41.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e88a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e840cdf10 0x7f1e840b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38388/0 (socket says 172.21.15.49:38388) 2024-01-31T05:04:41.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e88a00640 1 -- 172.21.15.49:0/2301118651 learned_addr learned my addr 172.21.15.49:0/2301118651 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:41.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e89400640 1 --2- 172.21.15.49:0/2301118651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e8415b110 0x7f1e8409a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:41.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e83e00640 1 --2- 172.21.15.49:0/2301118651 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e840ce610 0x7f1e8409a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:41.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e88a00640 1 -- 172.21.15.49:0/2301118651 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e840ce610 msgr2=0x7f1e8409a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:41.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e88a00640 1 --2- 172.21.15.49:0/2301118651 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e840ce610 0x7f1e8409a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e88a00640 1 -- 172.21.15.49:0/2301118651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e8415b110 msgr2=0x7f1e8409a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:41.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e88a00640 1 --2- 172.21.15.49:0/2301118651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e8415b110 0x7f1e8409a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e88a00640 1 -- 172.21.15.49:0/2301118651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c0094d0 con 0x7f1e840cdf10 2024-01-31T05:04:41.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e89400640 1 --2- 172.21.15.49:0/2301118651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e8415b110 0x7f1e8409a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:41.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e88a00640 1 --2- 172.21.15.49:0/2301118651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e840cdf10 0x7f1e840b3220 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400c370 tx=0x7f1e7400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:41.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e80c00640 1 -- 172.21.15.49:0/2301118651 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e740074e0 con 0x7f1e840cdf10 2024-01-31T05:04:41.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e80c00640 1 -- 172.21.15.49:0/2301118651 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e74007640 con 0x7f1e840cdf10 2024-01-31T05:04:41.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e8b400640 1 -- 172.21.15.49:0/2301118651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7c009a70 con 0x7f1e840cdf10 2024-01-31T05:04:41.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e80c00640 1 -- 172.21.15.49:0/2301118651 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e74004a30 con 0x7f1e840cdf10 2024-01-31T05:04:41.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.619+0000 7f1e8b400640 1 -- 172.21.15.49:0/2301118651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e840b2a20 con 0x7f1e840cdf10 2024-01-31T05:04:41.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.623+0000 7f1e8b400640 1 -- 172.21.15.49:0/2301118651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e84074860 con 0x7f1e840cdf10 2024-01-31T05:04:41.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.623+0000 7f1e80c00640 1 -- 172.21.15.49:0/2301118651 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1e74004b90 con 0x7f1e840cdf10 2024-01-31T05:04:41.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.623+0000 7f1e80c00640 1 --2- 172.21.15.49:0/2301118651 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1e5c066500 0x7f1e5c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:41.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.623+0000 7f1e80c00640 1 -- 172.21.15.49:0/2301118651 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1e74083a00 con 0x7f1e840cdf10 2024-01-31T05:04:41.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.623+0000 7f1e83e00640 1 --2- 172.21.15.49:0/2301118651 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1e5c066500 0x7f1e5c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:41.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.623+0000 7f1e83e00640 1 --2- 172.21.15.49:0/2301118651 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1e5c066500 0x7f1e5c0689c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1e8414df20 tx=0x7f1e6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:41.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.627+0000 7f1e80c00640 1 -- 172.21.15.49:0/2301118651 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1e740509b0 con 0x7f1e840cdf10 2024-01-31T05:04:41.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.787+0000 7f1e8b400640 1 -- 172.21.15.49:0/2301118651 --> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1e8415b4f0 con 0x7f1e5c066500 2024-01-31T05:04:41.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.795+0000 7f1e80c00640 1 -- 172.21.15.49:0/2301118651 <== mgr.4100 v2:172.21.15.195:6832/3035808172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345282 (secure 0 0 0) 0x7f1e8415b4f0 con 0x7f1e5c066500 2024-01-31T05:04:41.800 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:41.802 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-31T05:04:41.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.799+0000 7f1e8b400640 1 -- 172.21.15.49:0/2301118651 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1e5c066500 msgr2=0x7f1e5c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:41.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.799+0000 7f1e8b400640 1 --2- 172.21.15.49:0/2301118651 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1e5c066500 0x7f1e5c0689c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1e8414df20 tx=0x7f1e6c008040 comp rx=0 tx=0).stop 2024-01-31T05:04:41.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.799+0000 7f1e8b400640 1 -- 172.21.15.49:0/2301118651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e840cdf10 msgr2=0x7f1e840b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:41.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.799+0000 7f1e8b400640 1 --2- 172.21.15.49:0/2301118651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e840cdf10 0x7f1e840b3220 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400c370 tx=0x7f1e7400c830 comp rx=0 tx=0).stop 2024-01-31T05:04:41.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.799+0000 7f1e8b400640 1 -- 172.21.15.49:0/2301118651 shutdown_connections 2024-01-31T05:04:41.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.799+0000 7f1e8b400640 1 --2- 172.21.15.49:0/2301118651 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1e5c066500 0x7f1e5c0689c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.799+0000 7f1e8b400640 1 --2- 172.21.15.49:0/2301118651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e8415b110 0x7f1e8409a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.799+0000 7f1e8b400640 1 --2- 172.21.15.49:0/2301118651 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e840ce610 0x7f1e8409a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.799+0000 7f1e8b400640 1 --2- 172.21.15.49:0/2301118651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e840cdf10 0x7f1e840b3220 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.799+0000 7f1e8b400640 1 -- 172.21.15.49:0/2301118651 >> 172.21.15.49:0/2301118651 conn(0x7f1e840b09a0 msgr2=0x7f1e84070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.799+0000 7f1e8b400640 1 -- 172.21.15.49:0/2301118651 shutdown_connections 2024-01-31T05:04:41.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:41.799+0000 7f1e8b400640 1 -- 172.21.15.49:0/2301118651 wait complete. 2024-01-31T05:04:41.821 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-01-31T05:04:40.425275+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252676,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722044,"statfs":{"total":773094113280,"available":772835373056,"internally_reserved":0,"allocated":3284992,"data_stored":1988350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003341"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581219+0000","last_change":"2024-01-31T05:04:15.868245+0000","last_active":"2024-01-31T05:04:21.581219+0000","last_peered":"2024-01-31T05:04:21.581219+0000","last_clean":"2024-01-31T05:04:21.581219+0000","last_became_active":"2024-01-31T05:04:15.864318+0000","last_became_peered":"2024-01-31T05:04:15.864318+0000","last_unstale":"2024-01-31T05:04:21.581219+0000","last_undegraded":"2024-01-31T05:04:21.581219+0000","last_fullsized":"2024-01-31T05:04:21.581219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:27:44.760988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267122+0000","last_change":"2024-01-31T05:04:16.288950+0000","last_active":"2024-01-31T05:04:21.267122+0000","last_peered":"2024-01-31T05:04:21.267122+0000","last_clean":"2024-01-31T05:04:21.267122+0000","last_became_active":"2024-01-31T05:04:16.288679+0000","last_became_peered":"2024-01-31T05:04:16.288679+0000","last_unstale":"2024-01-31T05:04:21.267122+0000","last_undegraded":"2024-01-31T05:04:21.267122+0000","last_fullsized":"2024-01-31T05:04:21.267122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:10:07.431961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266325+0000","last_change":"2024-01-31T05:04:20.413702+0000","last_active":"2024-01-31T05:04:21.266325+0000","last_peered":"2024-01-31T05:04:21.266325+0000","last_clean":"2024-01-31T05:04:21.266325+0000","last_became_active":"2024-01-31T05:04:20.413348+0000","last_became_peered":"2024-01-31T05:04:20.413348+0000","last_unstale":"2024-01-31T05:04:21.266325+0000","last_undegraded":"2024-01-31T05:04:21.266325+0000","last_fullsized":"2024-01-31T05:04:21.266325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:58:24.669260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267427+0000","last_change":"2024-01-31T05:04:15.865431+0000","last_active":"2024-01-31T05:04:21.267427+0000","last_peered":"2024-01-31T05:04:21.267427+0000","last_clean":"2024-01-31T05:04:21.267427+0000","last_became_active":"2024-01-31T05:04:15.863143+0000","last_became_peered":"2024-01-31T05:04:15.863143+0000","last_unstale":"2024-01-31T05:04:21.267427+0000","last_undegraded":"2024-01-31T05:04:21.267427+0000","last_fullsized":"2024-01-31T05:04:21.267427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:27:44.760988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580949+0000","last_change":"2024-01-31T05:04:16.295890+0000","last_active":"2024-01-31T05:04:21.580949+0000","last_peered":"2024-01-31T05:04:21.580949+0000","last_clean":"2024-01-31T05:04:21.580949+0000","last_became_active":"2024-01-31T05:04:16.295666+0000","last_became_peered":"2024-01-31T05:04:16.295666+0000","last_unstale":"2024-01-31T05:04:21.580949+0000","last_undegraded":"2024-01-31T05:04:21.580949+0000","last_fullsized":"2024-01-31T05:04:21.580949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266605+0000","last_change":"2024-01-31T05:04:20.314420+0000","last_active":"2024-01-31T05:04:21.266605+0000","last_peered":"2024-01-31T05:04:21.266605+0000","last_clean":"2024-01-31T05:04:21.266605+0000","last_became_active":"2024-01-31T05:04:20.314026+0000","last_became_peered":"2024-01-31T05:04:20.314026+0000","last_unstale":"2024-01-31T05:04:21.266605+0000","last_undegraded":"2024-01-31T05:04:21.266605+0000","last_fullsized":"2024-01-31T05:04:21.266605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:25.928105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.582056+0000","last_change":"2024-01-31T05:04:15.872667+0000","last_active":"2024-01-31T05:04:21.582056+0000","last_peered":"2024-01-31T05:04:21.582056+0000","last_clean":"2024-01-31T05:04:21.582056+0000","last_became_active":"2024-01-31T05:04:15.872184+0000","last_became_peered":"2024-01-31T05:04:15.872184+0000","last_unstale":"2024-01-31T05:04:21.582056+0000","last_undegraded":"2024-01-31T05:04:21.582056+0000","last_fullsized":"2024-01-31T05:04:21.582056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:15.850243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579858+0000","last_change":"2024-01-31T05:04:16.291560+0000","last_active":"2024-01-31T05:04:21.579858+0000","last_peered":"2024-01-31T05:04:21.579858+0000","last_clean":"2024-01-31T05:04:21.579858+0000","last_became_active":"2024-01-31T05:04:16.291315+0000","last_became_peered":"2024-01-31T05:04:16.291315+0000","last_unstale":"2024-01-31T05:04:21.579858+0000","last_undegraded":"2024-01-31T05:04:21.579858+0000","last_fullsized":"2024-01-31T05:04:21.579858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:29:14.662909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266987+0000","last_change":"2024-01-31T05:04:20.302441+0000","last_active":"2024-01-31T05:04:21.266987+0000","last_peered":"2024-01-31T05:04:21.266987+0000","last_clean":"2024-01-31T05:04:21.266987+0000","last_became_active":"2024-01-31T05:04:20.302037+0000","last_became_peered":"2024-01-31T05:04:20.302037+0000","last_unstale":"2024-01-31T05:04:21.266987+0000","last_undegraded":"2024-01-31T05:04:21.266987+0000","last_fullsized":"2024-01-31T05:04:21.266987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:10:10.869523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581271+0000","last_change":"2024-01-31T05:04:15.866007+0000","last_active":"2024-01-31T05:04:21.581271+0000","last_peered":"2024-01-31T05:04:21.581271+0000","last_clean":"2024-01-31T05:04:21.581271+0000","last_became_active":"2024-01-31T05:04:15.865702+0000","last_became_peered":"2024-01-31T05:04:15.865702+0000","last_unstale":"2024-01-31T05:04:21.581271+0000","last_undegraded":"2024-01-31T05:04:21.581271+0000","last_fullsized":"2024-01-31T05:04:21.581271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:24:55.108827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580173+0000","last_change":"2024-01-31T05:04:16.295973+0000","last_active":"2024-01-31T05:04:21.580173+0000","last_peered":"2024-01-31T05:04:21.580173+0000","last_clean":"2024-01-31T05:04:21.580173+0000","last_became_active":"2024-01-31T05:04:16.294920+0000","last_became_peered":"2024-01-31T05:04:16.294920+0000","last_unstale":"2024-01-31T05:04:21.580173+0000","last_undegraded":"2024-01-31T05:04:21.580173+0000","last_fullsized":"2024-01-31T05:04:21.580173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:47.781626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266874+0000","last_change":"2024-01-31T05:04:20.306343+0000","last_active":"2024-01-31T05:04:21.266874+0000","last_peered":"2024-01-31T05:04:21.266874+0000","last_clean":"2024-01-31T05:04:21.266874+0000","last_became_active":"2024-01-31T05:04:20.305678+0000","last_became_peered":"2024-01-31T05:04:20.305678+0000","last_unstale":"2024-01-31T05:04:21.266874+0000","last_undegraded":"2024-01-31T05:04:21.266874+0000","last_fullsized":"2024-01-31T05:04:21.266874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:23.877718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580317+0000","last_change":"2024-01-31T05:04:16.292709+0000","last_active":"2024-01-31T05:04:21.580317+0000","last_peered":"2024-01-31T05:04:21.580317+0000","last_clean":"2024-01-31T05:04:21.580317+0000","last_became_active":"2024-01-31T05:04:16.292447+0000","last_became_peered":"2024-01-31T05:04:16.292447+0000","last_unstale":"2024-01-31T05:04:21.580317+0000","last_undegraded":"2024-01-31T05:04:21.580317+0000","last_fullsized":"2024-01-31T05:04:21.580317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:36.794548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581839+0000","last_change":"2024-01-31T05:04:15.864066+0000","last_active":"2024-01-31T05:04:21.581839+0000","last_peered":"2024-01-31T05:04:21.581839+0000","last_clean":"2024-01-31T05:04:21.581839+0000","last_became_active":"2024-01-31T05:04:15.863757+0000","last_became_peered":"2024-01-31T05:04:15.863757+0000","last_unstale":"2024-01-31T05:04:21.581839+0000","last_undegraded":"2024-01-31T05:04:21.581839+0000","last_fullsized":"2024-01-31T05:04:21.581839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:16:26.364453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267538+0000","last_change":"2024-01-31T05:04:20.306016+0000","last_active":"2024-01-31T05:04:21.267538+0000","last_peered":"2024-01-31T05:04:21.267538+0000","last_clean":"2024-01-31T05:04:21.267538+0000","last_became_active":"2024-01-31T05:04:20.305523+0000","last_became_peered":"2024-01-31T05:04:20.305523+0000","last_unstale":"2024-01-31T05:04:21.267538+0000","last_undegraded":"2024-01-31T05:04:21.267538+0000","last_fullsized":"2024-01-31T05:04:21.267538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:44.473185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266570+0000","last_change":"2024-01-31T05:04:16.284277+0000","last_active":"2024-01-31T05:04:21.266570+0000","last_peered":"2024-01-31T05:04:21.266570+0000","last_clean":"2024-01-31T05:04:21.266570+0000","last_became_active":"2024-01-31T05:04:16.283861+0000","last_became_peered":"2024-01-31T05:04:16.283861+0000","last_unstale":"2024-01-31T05:04:21.266570+0000","last_undegraded":"2024-01-31T05:04:21.266570+0000","last_fullsized":"2024-01-31T05:04:21.266570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:59:17.499417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580029+0000","last_change":"2024-01-31T05:04:15.866369+0000","last_active":"2024-01-31T05:04:21.580029+0000","last_peered":"2024-01-31T05:04:21.580029+0000","last_clean":"2024-01-31T05:04:21.580029+0000","last_became_active":"2024-01-31T05:04:15.865958+0000","last_became_peered":"2024-01-31T05:04:15.865958+0000","last_unstale":"2024-01-31T05:04:21.580029+0000","last_undegraded":"2024-01-31T05:04:21.580029+0000","last_fullsized":"2024-01-31T05:04:21.580029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:24:55.108827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267344+0000","last_change":"2024-01-31T05:04:20.306127+0000","last_active":"2024-01-31T05:04:21.267344+0000","last_peered":"2024-01-31T05:04:21.267344+0000","last_clean":"2024-01-31T05:04:21.267344+0000","last_became_active":"2024-01-31T05:04:20.305397+0000","last_became_peered":"2024-01-31T05:04:20.305397+0000","last_unstale":"2024-01-31T05:04:21.267344+0000","last_undegraded":"2024-01-31T05:04:21.267344+0000","last_fullsized":"2024-01-31T05:04:21.267344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:20:14.179731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266407+0000","last_change":"2024-01-31T05:04:16.278338+0000","last_active":"2024-01-31T05:04:21.266407+0000","last_peered":"2024-01-31T05:04:21.266407+0000","last_clean":"2024-01-31T05:04:21.266407+0000","last_became_active":"2024-01-31T05:04:16.277709+0000","last_became_peered":"2024-01-31T05:04:16.277709+0000","last_unstale":"2024-01-31T05:04:21.266407+0000","last_undegraded":"2024-01-31T05:04:21.266407+0000","last_fullsized":"2024-01-31T05:04:21.266407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:38.399003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579843+0000","last_change":"2024-01-31T05:04:15.866645+0000","last_active":"2024-01-31T05:04:21.579843+0000","last_peered":"2024-01-31T05:04:21.579843+0000","last_clean":"2024-01-31T05:04:21.579843+0000","last_became_active":"2024-01-31T05:04:15.866293+0000","last_became_peered":"2024-01-31T05:04:15.866293+0000","last_unstale":"2024-01-31T05:04:21.579843+0000","last_undegraded":"2024-01-31T05:04:21.579843+0000","last_fullsized":"2024-01-31T05:04:21.579843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:16:26.364453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581344+0000","last_change":"2024-01-31T05:04:20.411913+0000","last_active":"2024-01-31T05:04:21.581344+0000","last_peered":"2024-01-31T05:04:21.581344+0000","last_clean":"2024-01-31T05:04:21.581344+0000","last_became_active":"2024-01-31T05:04:20.411469+0000","last_became_peered":"2024-01-31T05:04:20.411469+0000","last_unstale":"2024-01-31T05:04:21.581344+0000","last_undegraded":"2024-01-31T05:04:21.581344+0000","last_fullsized":"2024-01-31T05:04:21.581344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:45.735003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267040+0000","last_change":"2024-01-31T05:04:16.274299+0000","last_active":"2024-01-31T05:04:21.267040+0000","last_peered":"2024-01-31T05:04:21.267040+0000","last_clean":"2024-01-31T05:04:21.267040+0000","last_became_active":"2024-01-31T05:04:16.273410+0000","last_became_peered":"2024-01-31T05:04:16.273410+0000","last_unstale":"2024-01-31T05:04:21.267040+0000","last_undegraded":"2024-01-31T05:04:21.267040+0000","last_fullsized":"2024-01-31T05:04:21.267040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:34.994793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581098+0000","last_change":"2024-01-31T05:04:15.862190+0000","last_active":"2024-01-31T05:04:21.581098+0000","last_peered":"2024-01-31T05:04:21.581098+0000","last_clean":"2024-01-31T05:04:21.581098+0000","last_became_active":"2024-01-31T05:04:15.861894+0000","last_became_peered":"2024-01-31T05:04:15.861894+0000","last_unstale":"2024-01-31T05:04:21.581098+0000","last_undegraded":"2024-01-31T05:04:21.581098+0000","last_fullsized":"2024-01-31T05:04:21.581098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:33.988440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267462+0000","last_change":"2024-01-31T05:04:20.302070+0000","last_active":"2024-01-31T05:04:21.267462+0000","last_peered":"2024-01-31T05:04:21.267462+0000","last_clean":"2024-01-31T05:04:21.267462+0000","last_became_active":"2024-01-31T05:04:20.301514+0000","last_became_peered":"2024-01-31T05:04:20.301514+0000","last_unstale":"2024-01-31T05:04:21.267462+0000","last_undegraded":"2024-01-31T05:04:21.267462+0000","last_fullsized":"2024-01-31T05:04:21.267462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:51.219189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581061+0000","last_change":"2024-01-31T05:04:16.277874+0000","last_active":"2024-01-31T05:04:21.581061+0000","last_peered":"2024-01-31T05:04:21.581061+0000","last_clean":"2024-01-31T05:04:21.581061+0000","last_became_active":"2024-01-31T05:04:16.277627+0000","last_became_peered":"2024-01-31T05:04:16.277627+0000","last_unstale":"2024-01-31T05:04:21.581061+0000","last_undegraded":"2024-01-31T05:04:21.581061+0000","last_fullsized":"2024-01-31T05:04:21.581061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:38.399003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581821+0000","last_change":"2024-01-31T05:04:15.867994+0000","last_active":"2024-01-31T05:04:21.581821+0000","last_peered":"2024-01-31T05:04:21.581821+0000","last_clean":"2024-01-31T05:04:21.581821+0000","last_became_active":"2024-01-31T05:04:15.866731+0000","last_became_peered":"2024-01-31T05:04:15.866731+0000","last_unstale":"2024-01-31T05:04:21.581821+0000","last_undegraded":"2024-01-31T05:04:21.581821+0000","last_fullsized":"2024-01-31T05:04:21.581821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:12:26.990588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266940+0000","last_change":"2024-01-31T05:04:20.410734+0000","last_active":"2024-01-31T05:04:21.266940+0000","last_peered":"2024-01-31T05:04:21.266940+0000","last_clean":"2024-01-31T05:04:21.266940+0000","last_became_active":"2024-01-31T05:04:20.410368+0000","last_became_peered":"2024-01-31T05:04:20.410368+0000","last_unstale":"2024-01-31T05:04:21.266940+0000","last_undegraded":"2024-01-31T05:04:21.266940+0000","last_fullsized":"2024-01-31T05:04:21.266940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:29:18.100472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.268005+0000","last_change":"2024-01-31T05:04:16.283103+0000","last_active":"2024-01-31T05:04:21.268005+0000","last_peered":"2024-01-31T05:04:21.268005+0000","last_clean":"2024-01-31T05:04:21.268005+0000","last_became_active":"2024-01-31T05:04:16.282869+0000","last_became_peered":"2024-01-31T05:04:16.282869+0000","last_unstale":"2024-01-31T05:04:21.268005+0000","last_undegraded":"2024-01-31T05:04:21.268005+0000","last_fullsized":"2024-01-31T05:04:21.268005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:20.440155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581016+0000","last_change":"2024-01-31T05:04:15.872874+0000","last_active":"2024-01-31T05:04:21.581016+0000","last_peered":"2024-01-31T05:04:21.581016+0000","last_clean":"2024-01-31T05:04:21.581016+0000","last_became_active":"2024-01-31T05:04:15.872478+0000","last_became_peered":"2024-01-31T05:04:15.872478+0000","last_unstale":"2024-01-31T05:04:21.581016+0000","last_undegraded":"2024-01-31T05:04:21.581016+0000","last_fullsized":"2024-01-31T05:04:21.581016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:12:26.990588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266215+0000","last_change":"2024-01-31T05:04:20.409515+0000","last_active":"2024-01-31T05:04:21.266215+0000","last_peered":"2024-01-31T05:04:21.266215+0000","last_clean":"2024-01-31T05:04:21.266215+0000","last_became_active":"2024-01-31T05:04:20.409104+0000","last_became_peered":"2024-01-31T05:04:20.409104+0000","last_unstale":"2024-01-31T05:04:21.266215+0000","last_undegraded":"2024-01-31T05:04:21.266215+0000","last_fullsized":"2024-01-31T05:04:21.266215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:26:03.624550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580349+0000","last_change":"2024-01-31T05:04:16.276727+0000","last_active":"2024-01-31T05:04:21.580349+0000","last_peered":"2024-01-31T05:04:21.580349+0000","last_clean":"2024-01-31T05:04:21.580349+0000","last_became_active":"2024-01-31T05:04:16.276429+0000","last_became_peered":"2024-01-31T05:04:16.276429+0000","last_unstale":"2024-01-31T05:04:21.580349+0000","last_undegraded":"2024-01-31T05:04:21.580349+0000","last_fullsized":"2024-01-31T05:04:21.580349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.582205+0000","last_change":"2024-01-31T05:04:15.872449+0000","last_active":"2024-01-31T05:04:21.582205+0000","last_peered":"2024-01-31T05:04:21.582205+0000","last_clean":"2024-01-31T05:04:21.582205+0000","last_became_active":"2024-01-31T05:04:15.871832+0000","last_became_peered":"2024-01-31T05:04:15.871832+0000","last_unstale":"2024-01-31T05:04:21.582205+0000","last_undegraded":"2024-01-31T05:04:21.582205+0000","last_fullsized":"2024-01-31T05:04:21.582205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:18:30.350723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579984+0000","last_change":"2024-01-31T05:04:20.410664+0000","last_active":"2024-01-31T05:04:21.579984+0000","last_peered":"2024-01-31T05:04:21.579984+0000","last_clean":"2024-01-31T05:04:21.579984+0000","last_became_active":"2024-01-31T05:04:20.409595+0000","last_became_peered":"2024-01-31T05:04:20.409595+0000","last_unstale":"2024-01-31T05:04:21.579984+0000","last_undegraded":"2024-01-31T05:04:21.579984+0000","last_fullsized":"2024-01-31T05:04:21.579984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:51.219189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580268+0000","last_change":"2024-01-31T05:04:16.299267+0000","last_active":"2024-01-31T05:04:21.580268+0000","last_peered":"2024-01-31T05:04:21.580268+0000","last_clean":"2024-01-31T05:04:21.580268+0000","last_became_active":"2024-01-31T05:04:16.298919+0000","last_became_peered":"2024-01-31T05:04:16.298919+0000","last_unstale":"2024-01-31T05:04:21.580268+0000","last_undegraded":"2024-01-31T05:04:21.580268+0000","last_fullsized":"2024-01-31T05:04:21.580268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:41.035623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580402+0000","last_change":"2024-01-31T05:04:15.863096+0000","last_active":"2024-01-31T05:04:21.580402+0000","last_peered":"2024-01-31T05:04:21.580402+0000","last_clean":"2024-01-31T05:04:21.580402+0000","last_became_active":"2024-01-31T05:04:15.862799+0000","last_became_peered":"2024-01-31T05:04:15.862799+0000","last_unstale":"2024-01-31T05:04:21.580402+0000","last_undegraded":"2024-01-31T05:04:21.580402+0000","last_fullsized":"2024-01-31T05:04:21.580402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:33.988440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579915+0000","last_change":"2024-01-31T05:04:20.318591+0000","last_active":"2024-01-31T05:04:21.579915+0000","last_peered":"2024-01-31T05:04:21.579915+0000","last_clean":"2024-01-31T05:04:21.579915+0000","last_became_active":"2024-01-31T05:04:20.314906+0000","last_became_peered":"2024-01-31T05:04:20.314906+0000","last_unstale":"2024-01-31T05:04:21.579915+0000","last_undegraded":"2024-01-31T05:04:21.579915+0000","last_fullsized":"2024-01-31T05:04:21.579915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:51.219189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267338+0000","last_change":"2024-01-31T05:04:16.284119+0000","last_active":"2024-01-31T05:04:21.267338+0000","last_peered":"2024-01-31T05:04:21.267338+0000","last_clean":"2024-01-31T05:04:21.267338+0000","last_became_active":"2024-01-31T05:04:16.277112+0000","last_became_peered":"2024-01-31T05:04:16.277112+0000","last_unstale":"2024-01-31T05:04:21.267338+0000","last_undegraded":"2024-01-31T05:04:21.267338+0000","last_fullsized":"2024-01-31T05:04:21.267338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:12.324478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579785+0000","last_change":"2024-01-31T05:04:15.862604+0000","last_active":"2024-01-31T05:04:21.579785+0000","last_peered":"2024-01-31T05:04:21.579785+0000","last_clean":"2024-01-31T05:04:21.579785+0000","last_became_active":"2024-01-31T05:04:15.862119+0000","last_became_peered":"2024-01-31T05:04:15.862119+0000","last_unstale":"2024-01-31T05:04:21.579785+0000","last_undegraded":"2024-01-31T05:04:21.579785+0000","last_fullsized":"2024-01-31T05:04:21.579785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:15.850243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580443+0000","last_change":"2024-01-31T05:04:20.319285+0000","last_active":"2024-01-31T05:04:21.580443+0000","last_peered":"2024-01-31T05:04:21.580443+0000","last_clean":"2024-01-31T05:04:21.580443+0000","last_became_active":"2024-01-31T05:04:20.318678+0000","last_became_peered":"2024-01-31T05:04:20.318678+0000","last_unstale":"2024-01-31T05:04:21.580443+0000","last_undegraded":"2024-01-31T05:04:21.580443+0000","last_fullsized":"2024-01-31T05:04:21.580443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:52:04.324494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579922+0000","last_change":"2024-01-31T05:04:16.277245+0000","last_active":"2024-01-31T05:04:21.579922+0000","last_peered":"2024-01-31T05:04:21.579922+0000","last_clean":"2024-01-31T05:04:21.579922+0000","last_became_active":"2024-01-31T05:04:16.276969+0000","last_became_peered":"2024-01-31T05:04:16.276969+0000","last_unstale":"2024-01-31T05:04:21.579922+0000","last_undegraded":"2024-01-31T05:04:21.579922+0000","last_fullsized":"2024-01-31T05:04:21.579922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:05:32.076479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267230+0000","last_change":"2024-01-31T05:04:15.868758+0000","last_active":"2024-01-31T05:04:21.267230+0000","last_peered":"2024-01-31T05:04:21.267230+0000","last_clean":"2024-01-31T05:04:21.267230+0000","last_became_active":"2024-01-31T05:04:15.868431+0000","last_became_peered":"2024-01-31T05:04:15.868431+0000","last_unstale":"2024-01-31T05:04:21.267230+0000","last_undegraded":"2024-01-31T05:04:21.267230+0000","last_fullsized":"2024-01-31T05:04:21.267230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:38:14.126192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581401+0000","last_change":"2024-01-31T05:04:20.314828+0000","last_active":"2024-01-31T05:04:21.581401+0000","last_peered":"2024-01-31T05:04:21.581401+0000","last_clean":"2024-01-31T05:04:21.581401+0000","last_became_active":"2024-01-31T05:04:20.314407+0000","last_became_peered":"2024-01-31T05:04:20.314407+0000","last_unstale":"2024-01-31T05:04:21.581401+0000","last_undegraded":"2024-01-31T05:04:21.581401+0000","last_fullsized":"2024-01-31T05:04:21.581401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:42:14.408077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579808+0000","last_change":"2024-01-31T05:04:16.274865+0000","last_active":"2024-01-31T05:04:21.579808+0000","last_peered":"2024-01-31T05:04:21.579808+0000","last_clean":"2024-01-31T05:04:21.579808+0000","last_became_active":"2024-01-31T05:04:16.273448+0000","last_became_peered":"2024-01-31T05:04:16.273448+0000","last_unstale":"2024-01-31T05:04:21.579808+0000","last_undegraded":"2024-01-31T05:04:21.579808+0000","last_fullsized":"2024-01-31T05:04:21.579808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:28:15.218916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581205+0000","last_change":"2024-01-31T05:04:15.865828+0000","last_active":"2024-01-31T05:04:21.581205+0000","last_peered":"2024-01-31T05:04:21.581205+0000","last_clean":"2024-01-31T05:04:21.581205+0000","last_became_active":"2024-01-31T05:04:15.865556+0000","last_became_peered":"2024-01-31T05:04:15.865556+0000","last_unstale":"2024-01-31T05:04:21.581205+0000","last_undegraded":"2024-01-31T05:04:21.581205+0000","last_fullsized":"2024-01-31T05:04:21.581205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:11.318125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580994+0000","last_change":"2024-01-31T05:04:20.410795+0000","last_active":"2024-01-31T05:04:21.580994+0000","last_peered":"2024-01-31T05:04:21.580994+0000","last_clean":"2024-01-31T05:04:21.580994+0000","last_became_active":"2024-01-31T05:04:20.409164+0000","last_became_peered":"2024-01-31T05:04:20.409164+0000","last_unstale":"2024-01-31T05:04:21.580994+0000","last_undegraded":"2024-01-31T05:04:21.580994+0000","last_fullsized":"2024-01-31T05:04:21.580994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:42:14.408077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266618+0000","last_change":"2024-01-31T05:04:16.302810+0000","last_active":"2024-01-31T05:04:21.266618+0000","last_peered":"2024-01-31T05:04:21.266618+0000","last_clean":"2024-01-31T05:04:21.266618+0000","last_became_active":"2024-01-31T05:04:16.302580+0000","last_became_peered":"2024-01-31T05:04:16.302580+0000","last_unstale":"2024-01-31T05:04:21.266618+0000","last_undegraded":"2024-01-31T05:04:21.266618+0000","last_fullsized":"2024-01-31T05:04:21.266618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:05:32.076479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579670+0000","last_change":"2024-01-31T05:04:15.859340+0000","last_active":"2024-01-31T05:04:21.579670+0000","last_peered":"2024-01-31T05:04:21.579670+0000","last_clean":"2024-01-31T05:04:21.579670+0000","last_became_active":"2024-01-31T05:04:15.858887+0000","last_became_peered":"2024-01-31T05:04:15.858887+0000","last_unstale":"2024-01-31T05:04:21.579670+0000","last_undegraded":"2024-01-31T05:04:21.579670+0000","last_fullsized":"2024-01-31T05:04:21.579670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:11.318125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581256+0000","last_change":"2024-01-31T05:04:05.699222+0000","last_active":"2024-01-31T05:04:21.581256+0000","last_peered":"2024-01-31T05:04:21.581256+0000","last_clean":"2024-01-31T05:04:21.581256+0000","last_became_active":"2024-01-31T05:04:05.698239+0000","last_became_peered":"2024-01-31T05:04:05.698239+0000","last_unstale":"2024-01-31T05:04:21.581256+0000","last_undegraded":"2024-01-31T05:04:21.581256+0000","last_fullsized":"2024-01-31T05:04:21.581256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_clean_scrub_stamp":"2024-01-31T05:04:04.484734+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:05:13.736598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580928+0000","last_change":"2024-01-31T05:04:20.409212+0000","last_active":"2024-01-31T05:04:21.580928+0000","last_peered":"2024-01-31T05:04:21.580928+0000","last_clean":"2024-01-31T05:04:21.580928+0000","last_became_active":"2024-01-31T05:04:20.408741+0000","last_became_peered":"2024-01-31T05:04:20.408741+0000","last_unstale":"2024-01-31T05:04:21.580928+0000","last_undegraded":"2024-01-31T05:04:21.580928+0000","last_fullsized":"2024-01-31T05:04:21.580928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:20:14.179731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581967+0000","last_change":"2024-01-31T05:04:16.301754+0000","last_active":"2024-01-31T05:04:21.581967+0000","last_peered":"2024-01-31T05:04:21.581967+0000","last_clean":"2024-01-31T05:04:21.581967+0000","last_became_active":"2024-01-31T05:04:16.301449+0000","last_became_peered":"2024-01-31T05:04:16.301449+0000","last_unstale":"2024-01-31T05:04:21.581967+0000","last_undegraded":"2024-01-31T05:04:21.581967+0000","last_fullsized":"2024-01-31T05:04:21.581967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:47.781626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267625+0000","last_change":"2024-01-31T05:04:15.866001+0000","last_active":"2024-01-31T05:04:21.267625+0000","last_peered":"2024-01-31T05:04:21.267625+0000","last_clean":"2024-01-31T05:04:21.267625+0000","last_became_active":"2024-01-31T05:04:15.865731+0000","last_became_peered":"2024-01-31T05:04:15.865731+0000","last_unstale":"2024-01-31T05:04:21.267625+0000","last_undegraded":"2024-01-31T05:04:21.267625+0000","last_fullsized":"2024-01-31T05:04:21.267625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:53.760373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580399+0000","last_change":"2024-01-31T05:04:20.409951+0000","last_active":"2024-01-31T05:04:21.580399+0000","last_peered":"2024-01-31T05:04:21.580399+0000","last_clean":"2024-01-31T05:04:21.580399+0000","last_became_active":"2024-01-31T05:04:20.408740+0000","last_became_peered":"2024-01-31T05:04:20.408740+0000","last_unstale":"2024-01-31T05:04:21.580399+0000","last_undegraded":"2024-01-31T05:04:21.580399+0000","last_fullsized":"2024-01-31T05:04:21.580399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:17:35.221341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579952+0000","last_change":"2024-01-31T05:04:16.290253+0000","last_active":"2024-01-31T05:04:21.579952+0000","last_peered":"2024-01-31T05:04:21.579952+0000","last_clean":"2024-01-31T05:04:21.579952+0000","last_became_active":"2024-01-31T05:04:16.289838+0000","last_became_peered":"2024-01-31T05:04:16.289838+0000","last_unstale":"2024-01-31T05:04:21.579952+0000","last_undegraded":"2024-01-31T05:04:21.579952+0000","last_fullsized":"2024-01-31T05:04:21.579952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:20:10.742169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580789+0000","last_change":"2024-01-31T05:04:15.866801+0000","last_active":"2024-01-31T05:04:21.580789+0000","last_peered":"2024-01-31T05:04:21.580789+0000","last_clean":"2024-01-31T05:04:21.580789+0000","last_became_active":"2024-01-31T05:04:15.866478+0000","last_became_peered":"2024-01-31T05:04:15.866478+0000","last_unstale":"2024-01-31T05:04:21.580789+0000","last_undegraded":"2024-01-31T05:04:21.580789+0000","last_fullsized":"2024-01-31T05:04:21.580789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:11.318125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580174+0000","last_change":"2024-01-31T05:04:20.307543+0000","last_active":"2024-01-31T05:04:21.580174+0000","last_peered":"2024-01-31T05:04:21.580174+0000","last_clean":"2024-01-31T05:04:21.580174+0000","last_became_active":"2024-01-31T05:04:20.307124+0000","last_became_peered":"2024-01-31T05:04:20.307124+0000","last_unstale":"2024-01-31T05:04:21.580174+0000","last_undegraded":"2024-01-31T05:04:21.580174+0000","last_fullsized":"2024-01-31T05:04:21.580174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:44.473185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581703+0000","last_change":"2024-01-31T05:04:16.289496+0000","last_active":"2024-01-31T05:04:21.581703+0000","last_peered":"2024-01-31T05:04:21.581703+0000","last_clean":"2024-01-31T05:04:21.581703+0000","last_became_active":"2024-01-31T05:04:16.288932+0000","last_became_peered":"2024-01-31T05:04:16.288932+0000","last_unstale":"2024-01-31T05:04:21.581703+0000","last_undegraded":"2024-01-31T05:04:21.581703+0000","last_fullsized":"2024-01-31T05:04:21.581703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:26:00.186988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267853+0000","last_change":"2024-01-31T05:04:15.868950+0000","last_active":"2024-01-31T05:04:21.267853+0000","last_peered":"2024-01-31T05:04:21.267853+0000","last_clean":"2024-01-31T05:04:21.267853+0000","last_became_active":"2024-01-31T05:04:15.868416+0000","last_became_peered":"2024-01-31T05:04:15.868416+0000","last_unstale":"2024-01-31T05:04:21.267853+0000","last_undegraded":"2024-01-31T05:04:21.267853+0000","last_fullsized":"2024-01-31T05:04:21.267853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:12:26.990588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579270+0000","last_change":"2024-01-31T05:04:20.412399+0000","last_active":"2024-01-31T05:04:21.579270+0000","last_peered":"2024-01-31T05:04:21.579270+0000","last_clean":"2024-01-31T05:04:21.579270+0000","last_became_active":"2024-01-31T05:04:20.412174+0000","last_became_peered":"2024-01-31T05:04:20.412174+0000","last_unstale":"2024-01-31T05:04:21.579270+0000","last_undegraded":"2024-01-31T05:04:21.579270+0000","last_fullsized":"2024-01-31T05:04:21.579270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:50:26.572528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.582346+0000","last_change":"2024-01-31T05:04:16.291917+0000","last_active":"2024-01-31T05:04:21.582346+0000","last_peered":"2024-01-31T05:04:21.582346+0000","last_clean":"2024-01-31T05:04:21.582346+0000","last_became_active":"2024-01-31T05:04:16.291631+0000","last_became_peered":"2024-01-31T05:04:16.291631+0000","last_unstale":"2024-01-31T05:04:21.582346+0000","last_undegraded":"2024-01-31T05:04:21.582346+0000","last_fullsized":"2024-01-31T05:04:21.582346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:29:14.662909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267621+0000","last_change":"2024-01-31T05:04:15.860520+0000","last_active":"2024-01-31T05:04:21.267621+0000","last_peered":"2024-01-31T05:04:21.267621+0000","last_clean":"2024-01-31T05:04:21.267621+0000","last_became_active":"2024-01-31T05:04:15.860310+0000","last_became_peered":"2024-01-31T05:04:15.860310+0000","last_unstale":"2024-01-31T05:04:21.267621+0000","last_undegraded":"2024-01-31T05:04:21.267621+0000","last_fullsized":"2024-01-31T05:04:21.267621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:05:24.077981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266628+0000","last_change":"2024-01-31T05:04:20.303904+0000","last_active":"2024-01-31T05:04:21.266628+0000","last_peered":"2024-01-31T05:04:21.266628+0000","last_clean":"2024-01-31T05:04:21.266628+0000","last_became_active":"2024-01-31T05:04:20.302675+0000","last_became_peered":"2024-01-31T05:04:20.302675+0000","last_unstale":"2024-01-31T05:04:21.266628+0000","last_undegraded":"2024-01-31T05:04:21.266628+0000","last_fullsized":"2024-01-31T05:04:21.266628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:59:20.936979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581255+0000","last_change":"2024-01-31T05:04:16.293580+0000","last_active":"2024-01-31T05:04:21.581255+0000","last_peered":"2024-01-31T05:04:21.581255+0000","last_clean":"2024-01-31T05:04:21.581255+0000","last_became_active":"2024-01-31T05:04:16.289043+0000","last_became_peered":"2024-01-31T05:04:16.289043+0000","last_unstale":"2024-01-31T05:04:21.581255+0000","last_undegraded":"2024-01-31T05:04:21.581255+0000","last_fullsized":"2024-01-31T05:04:21.581255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:20.440155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266904+0000","last_change":"2024-01-31T05:04:15.858583+0000","last_active":"2024-01-31T05:04:21.266904+0000","last_peered":"2024-01-31T05:04:21.266904+0000","last_clean":"2024-01-31T05:04:21.266904+0000","last_became_active":"2024-01-31T05:04:15.858214+0000","last_became_peered":"2024-01-31T05:04:15.858214+0000","last_unstale":"2024-01-31T05:04:21.266904+0000","last_undegraded":"2024-01-31T05:04:21.266904+0000","last_fullsized":"2024-01-31T05:04:21.266904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:27:44.760988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580996+0000","last_change":"2024-01-31T05:04:20.305474+0000","last_active":"2024-01-31T05:04:21.580996+0000","last_peered":"2024-01-31T05:04:21.580996+0000","last_clean":"2024-01-31T05:04:21.580996+0000","last_became_active":"2024-01-31T05:04:20.304812+0000","last_became_peered":"2024-01-31T05:04:20.304812+0000","last_unstale":"2024-01-31T05:04:21.580996+0000","last_undegraded":"2024-01-31T05:04:21.580996+0000","last_fullsized":"2024-01-31T05:04:21.580996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:45.735003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580086+0000","last_change":"2024-01-31T05:04:16.281029+0000","last_active":"2024-01-31T05:04:21.580086+0000","last_peered":"2024-01-31T05:04:21.580086+0000","last_clean":"2024-01-31T05:04:21.580086+0000","last_became_active":"2024-01-31T05:04:16.280773+0000","last_became_peered":"2024-01-31T05:04:16.280773+0000","last_unstale":"2024-01-31T05:04:21.580086+0000","last_undegraded":"2024-01-31T05:04:21.580086+0000","last_fullsized":"2024-01-31T05:04:21.580086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:44:28.652707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580546+0000","last_change":"2024-01-31T05:04:15.873157+0000","last_active":"2024-01-31T05:04:21.580546+0000","last_peered":"2024-01-31T05:04:21.580546+0000","last_clean":"2024-01-31T05:04:21.580546+0000","last_became_active":"2024-01-31T05:04:15.872851+0000","last_became_peered":"2024-01-31T05:04:15.872851+0000","last_unstale":"2024-01-31T05:04:21.580546+0000","last_undegraded":"2024-01-31T05:04:21.580546+0000","last_fullsized":"2024-01-31T05:04:21.580546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:53.760373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267875+0000","last_change":"2024-01-31T05:04:20.414571+0000","last_active":"2024-01-31T05:04:21.267875+0000","last_peered":"2024-01-31T05:04:21.267875+0000","last_clean":"2024-01-31T05:04:21.267875+0000","last_became_active":"2024-01-31T05:04:20.413308+0000","last_became_peered":"2024-01-31T05:04:20.413308+0000","last_unstale":"2024-01-31T05:04:21.267875+0000","last_undegraded":"2024-01-31T05:04:21.267875+0000","last_fullsized":"2024-01-31T05:04:21.267875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:41:46.079832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581697+0000","last_change":"2024-01-31T05:04:16.289635+0000","last_active":"2024-01-31T05:04:21.581697+0000","last_peered":"2024-01-31T05:04:21.581697+0000","last_clean":"2024-01-31T05:04:21.581697+0000","last_became_active":"2024-01-31T05:04:16.289367+0000","last_became_peered":"2024-01-31T05:04:16.289367+0000","last_unstale":"2024-01-31T05:04:21.581697+0000","last_undegraded":"2024-01-31T05:04:21.581697+0000","last_fullsized":"2024-01-31T05:04:21.581697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:20:10.742169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579673+0000","last_change":"2024-01-31T05:04:15.867802+0000","last_active":"2024-01-31T05:04:21.579673+0000","last_peered":"2024-01-31T05:04:21.579673+0000","last_clean":"2024-01-31T05:04:21.579673+0000","last_became_active":"2024-01-31T05:04:15.867509+0000","last_became_peered":"2024-01-31T05:04:15.867509+0000","last_unstale":"2024-01-31T05:04:21.579673+0000","last_undegraded":"2024-01-31T05:04:21.579673+0000","last_fullsized":"2024-01-31T05:04:21.579673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:12:26.990588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267002+0000","last_change":"2024-01-31T05:04:20.410363+0000","last_active":"2024-01-31T05:04:21.267002+0000","last_peered":"2024-01-31T05:04:21.267002+0000","last_clean":"2024-01-31T05:04:21.267002+0000","last_became_active":"2024-01-31T05:04:20.409349+0000","last_became_peered":"2024-01-31T05:04:20.409349+0000","last_unstale":"2024-01-31T05:04:21.267002+0000","last_undegraded":"2024-01-31T05:04:21.267002+0000","last_fullsized":"2024-01-31T05:04:21.267002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:12:43.831584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580116+0000","last_change":"2024-01-31T05:04:16.279383+0000","last_active":"2024-01-31T05:04:21.580116+0000","last_peered":"2024-01-31T05:04:21.580116+0000","last_clean":"2024-01-31T05:04:21.580116+0000","last_became_active":"2024-01-31T05:04:16.278871+0000","last_became_peered":"2024-01-31T05:04:16.278871+0000","last_unstale":"2024-01-31T05:04:21.580116+0000","last_undegraded":"2024-01-31T05:04:21.580116+0000","last_fullsized":"2024-01-31T05:04:21.580116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:14:16.417240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580394+0000","last_change":"2024-01-31T05:04:15.860246+0000","last_active":"2024-01-31T05:04:21.580394+0000","last_peered":"2024-01-31T05:04:21.580394+0000","last_clean":"2024-01-31T05:04:21.580394+0000","last_became_active":"2024-01-31T05:04:15.860027+0000","last_became_peered":"2024-01-31T05:04:15.860027+0000","last_unstale":"2024-01-31T05:04:21.580394+0000","last_undegraded":"2024-01-31T05:04:21.580394+0000","last_fullsized":"2024-01-31T05:04:21.580394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:00:09.341930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580269+0000","last_change":"2024-01-31T05:04:20.414791+0000","last_active":"2024-01-31T05:04:21.580269+0000","last_peered":"2024-01-31T05:04:21.580269+0000","last_clean":"2024-01-31T05:04:21.580269+0000","last_became_active":"2024-01-31T05:04:20.414082+0000","last_became_peered":"2024-01-31T05:04:20.414082+0000","last_unstale":"2024-01-31T05:04:21.580269+0000","last_undegraded":"2024-01-31T05:04:21.580269+0000","last_fullsized":"2024-01-31T05:04:21.580269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:29:34.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581901+0000","last_change":"2024-01-31T05:04:16.288217+0000","last_active":"2024-01-31T05:04:21.581901+0000","last_peered":"2024-01-31T05:04:21.581901+0000","last_clean":"2024-01-31T05:04:21.581901+0000","last_became_active":"2024-01-31T05:04:16.287855+0000","last_became_peered":"2024-01-31T05:04:16.287855+0000","last_unstale":"2024-01-31T05:04:21.581901+0000","last_undegraded":"2024-01-31T05:04:21.581901+0000","last_fullsized":"2024-01-31T05:04:21.581901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:17:31.783779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:26.937176+0000","last_change":"2024-01-31T05:04:15.871503+0000","last_active":"2024-01-31T05:04:26.937176+0000","last_peered":"2024-01-31T05:04:26.937176+0000","last_clean":"2024-01-31T05:04:26.937176+0000","last_became_active":"2024-01-31T05:04:15.871207+0000","last_became_peered":"2024-01-31T05:04:15.871207+0000","last_unstale":"2024-01-31T05:04:26.937176+0000","last_undegraded":"2024-01-31T05:04:26.937176+0000","last_fullsized":"2024-01-31T05:04:26.937176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:07:45.743062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580076+0000","last_change":"2024-01-31T05:04:20.318951+0000","last_active":"2024-01-31T05:04:21.580076+0000","last_peered":"2024-01-31T05:04:21.580076+0000","last_clean":"2024-01-31T05:04:21.580076+0000","last_became_active":"2024-01-31T05:04:20.315434+0000","last_became_peered":"2024-01-31T05:04:20.315434+0000","last_unstale":"2024-01-31T05:04:21.580076+0000","last_undegraded":"2024-01-31T05:04:21.580076+0000","last_fullsized":"2024-01-31T05:04:21.580076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:44.473185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267446+0000","last_change":"2024-01-31T05:04:16.284047+0000","last_active":"2024-01-31T05:04:21.267446+0000","last_peered":"2024-01-31T05:04:21.267446+0000","last_clean":"2024-01-31T05:04:21.267446+0000","last_became_active":"2024-01-31T05:04:16.283455+0000","last_became_peered":"2024-01-31T05:04:16.283455+0000","last_unstale":"2024-01-31T05:04:21.267446+0000","last_undegraded":"2024-01-31T05:04:21.267446+0000","last_fullsized":"2024-01-31T05:04:21.267446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:24:56.115180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580681+0000","last_change":"2024-01-31T05:04:15.868251+0000","last_active":"2024-01-31T05:04:21.580681+0000","last_peered":"2024-01-31T05:04:21.580681+0000","last_clean":"2024-01-31T05:04:21.580681+0000","last_became_active":"2024-01-31T05:04:15.867924+0000","last_became_peered":"2024-01-31T05:04:15.867924+0000","last_unstale":"2024-01-31T05:04:21.580681+0000","last_undegraded":"2024-01-31T05:04:21.580681+0000","last_fullsized":"2024-01-31T05:04:21.580681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:07:45.743062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267249+0000","last_change":"2024-01-31T05:04:20.302123+0000","last_active":"2024-01-31T05:04:21.267249+0000","last_peered":"2024-01-31T05:04:21.267249+0000","last_clean":"2024-01-31T05:04:21.267249+0000","last_became_active":"2024-01-31T05:04:20.301865+0000","last_became_peered":"2024-01-31T05:04:20.301865+0000","last_unstale":"2024-01-31T05:04:21.267249+0000","last_undegraded":"2024-01-31T05:04:21.267249+0000","last_fullsized":"2024-01-31T05:04:21.267249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:17:35.221341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581093+0000","last_change":"2024-01-31T05:04:16.295806+0000","last_active":"2024-01-31T05:04:21.581093+0000","last_peered":"2024-01-31T05:04:21.581093+0000","last_clean":"2024-01-31T05:04:21.581093+0000","last_became_active":"2024-01-31T05:04:16.295553+0000","last_became_peered":"2024-01-31T05:04:16.295553+0000","last_unstale":"2024-01-31T05:04:21.581093+0000","last_undegraded":"2024-01-31T05:04:21.581093+0000","last_fullsized":"2024-01-31T05:04:21.581093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580840+0000","last_change":"2024-01-31T05:04:15.875006+0000","last_active":"2024-01-31T05:04:21.580840+0000","last_peered":"2024-01-31T05:04:21.580840+0000","last_clean":"2024-01-31T05:04:21.580840+0000","last_became_active":"2024-01-31T05:04:15.874743+0000","last_became_peered":"2024-01-31T05:04:15.874743+0000","last_unstale":"2024-01-31T05:04:21.580840+0000","last_undegraded":"2024-01-31T05:04:21.580840+0000","last_fullsized":"2024-01-31T05:04:21.580840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:37.392650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266837+0000","last_change":"2024-01-31T05:04:20.316263+0000","last_active":"2024-01-31T05:04:21.266837+0000","last_peered":"2024-01-31T05:04:21.266837+0000","last_clean":"2024-01-31T05:04:21.266837+0000","last_became_active":"2024-01-31T05:04:20.315752+0000","last_became_peered":"2024-01-31T05:04:20.315752+0000","last_unstale":"2024-01-31T05:04:21.266837+0000","last_undegraded":"2024-01-31T05:04:21.266837+0000","last_fullsized":"2024-01-31T05:04:21.266837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:29:34.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580744+0000","last_change":"2024-01-31T05:04:16.292783+0000","last_active":"2024-01-31T05:04:21.580744+0000","last_peered":"2024-01-31T05:04:21.580744+0000","last_clean":"2024-01-31T05:04:21.580744+0000","last_became_active":"2024-01-31T05:04:16.292520+0000","last_became_peered":"2024-01-31T05:04:16.292520+0000","last_unstale":"2024-01-31T05:04:21.580744+0000","last_undegraded":"2024-01-31T05:04:21.580744+0000","last_fullsized":"2024-01-31T05:04:21.580744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:52:00.886932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581728+0000","last_change":"2024-01-31T05:04:15.877472+0000","last_active":"2024-01-31T05:04:21.581728+0000","last_peered":"2024-01-31T05:04:21.581728+0000","last_clean":"2024-01-31T05:04:21.581728+0000","last_became_active":"2024-01-31T05:04:15.877195+0000","last_became_peered":"2024-01-31T05:04:15.877195+0000","last_unstale":"2024-01-31T05:04:21.581728+0000","last_undegraded":"2024-01-31T05:04:21.581728+0000","last_fullsized":"2024-01-31T05:04:21.581728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:38:14.126192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266508+0000","last_change":"2024-01-31T05:04:20.410602+0000","last_active":"2024-01-31T05:04:21.266508+0000","last_peered":"2024-01-31T05:04:21.266508+0000","last_clean":"2024-01-31T05:04:21.266508+0000","last_became_active":"2024-01-31T05:04:20.410214+0000","last_became_peered":"2024-01-31T05:04:20.410214+0000","last_unstale":"2024-01-31T05:04:21.266508+0000","last_undegraded":"2024-01-31T05:04:21.266508+0000","last_fullsized":"2024-01-31T05:04:21.266508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:50:26.572528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580777+0000","last_change":"2024-01-31T05:04:20.413035+0000","last_active":"2024-01-31T05:04:21.580777+0000","last_peered":"2024-01-31T05:04:21.580777+0000","last_clean":"2024-01-31T05:04:21.580777+0000","last_became_active":"2024-01-31T05:04:20.409657+0000","last_became_peered":"2024-01-31T05:04:20.409657+0000","last_unstale":"2024-01-31T05:04:21.580777+0000","last_undegraded":"2024-01-31T05:04:21.580777+0000","last_fullsized":"2024-01-31T05:04:21.580777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:52:04.324494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579651+0000","last_change":"2024-01-31T05:04:16.280492+0000","last_active":"2024-01-31T05:04:21.579651+0000","last_peered":"2024-01-31T05:04:21.579651+0000","last_clean":"2024-01-31T05:04:21.579651+0000","last_became_active":"2024-01-31T05:04:16.280274+0000","last_became_peered":"2024-01-31T05:04:16.280274+0000","last_unstale":"2024-01-31T05:04:21.579651+0000","last_undegraded":"2024-01-31T05:04:21.579651+0000","last_fullsized":"2024-01-31T05:04:21.579651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:32:44.394537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579405+0000","last_change":"2024-01-31T05:04:15.861706+0000","last_active":"2024-01-31T05:04:21.579405+0000","last_peered":"2024-01-31T05:04:21.579405+0000","last_clean":"2024-01-31T05:04:21.579405+0000","last_became_active":"2024-01-31T05:04:15.861143+0000","last_became_peered":"2024-01-31T05:04:15.861143+0000","last_unstale":"2024-01-31T05:04:21.579405+0000","last_undegraded":"2024-01-31T05:04:21.579405+0000","last_fullsized":"2024-01-31T05:04:21.579405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:53.760373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581668+0000","last_change":"2024-01-31T05:04:20.314757+0000","last_active":"2024-01-31T05:04:21.581668+0000","last_peered":"2024-01-31T05:04:21.581668+0000","last_clean":"2024-01-31T05:04:21.581668+0000","last_became_active":"2024-01-31T05:04:20.314255+0000","last_became_peered":"2024-01-31T05:04:20.314255+0000","last_unstale":"2024-01-31T05:04:21.581668+0000","last_undegraded":"2024-01-31T05:04:21.581668+0000","last_fullsized":"2024-01-31T05:04:21.581668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:51.219189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266310+0000","last_change":"2024-01-31T05:04:16.283281+0000","last_active":"2024-01-31T05:04:21.266310+0000","last_peered":"2024-01-31T05:04:21.266310+0000","last_clean":"2024-01-31T05:04:21.266310+0000","last_became_active":"2024-01-31T05:04:16.283067+0000","last_became_peered":"2024-01-31T05:04:16.283067+0000","last_unstale":"2024-01-31T05:04:21.266310+0000","last_undegraded":"2024-01-31T05:04:21.266310+0000","last_fullsized":"2024-01-31T05:04:21.266310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:32:44.394537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266680+0000","last_change":"2024-01-31T05:04:15.870556+0000","last_active":"2024-01-31T05:04:21.266680+0000","last_peered":"2024-01-31T05:04:21.266680+0000","last_clean":"2024-01-31T05:04:21.266680+0000","last_became_active":"2024-01-31T05:04:15.870204+0000","last_became_peered":"2024-01-31T05:04:15.870204+0000","last_unstale":"2024-01-31T05:04:21.266680+0000","last_undegraded":"2024-01-31T05:04:21.266680+0000","last_fullsized":"2024-01-31T05:04:21.266680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:53.760373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580467+0000","last_change":"2024-01-31T05:04:15.874785+0000","last_active":"2024-01-31T05:04:21.580467+0000","last_peered":"2024-01-31T05:04:21.580467+0000","last_clean":"2024-01-31T05:04:21.580467+0000","last_became_active":"2024-01-31T05:04:15.874174+0000","last_became_peered":"2024-01-31T05:04:15.874174+0000","last_unstale":"2024-01-31T05:04:21.580467+0000","last_undegraded":"2024-01-31T05:04:21.580467+0000","last_fullsized":"2024-01-31T05:04:21.580467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:11.318125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580306+0000","last_change":"2024-01-31T05:04:16.273656+0000","last_active":"2024-01-31T05:04:21.580306+0000","last_peered":"2024-01-31T05:04:21.580306+0000","last_clean":"2024-01-31T05:04:21.580306+0000","last_became_active":"2024-01-31T05:04:16.273182+0000","last_became_peered":"2024-01-31T05:04:16.273182+0000","last_unstale":"2024-01-31T05:04:21.580306+0000","last_undegraded":"2024-01-31T05:04:21.580306+0000","last_fullsized":"2024-01-31T05:04:21.580306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:32:44.394537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267586+0000","last_change":"2024-01-31T05:04:20.304766+0000","last_active":"2024-01-31T05:04:21.267586+0000","last_peered":"2024-01-31T05:04:21.267586+0000","last_clean":"2024-01-31T05:04:21.267586+0000","last_became_active":"2024-01-31T05:04:20.302194+0000","last_became_peered":"2024-01-31T05:04:20.302194+0000","last_unstale":"2024-01-31T05:04:21.267586+0000","last_undegraded":"2024-01-31T05:04:21.267586+0000","last_fullsized":"2024-01-31T05:04:21.267586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:44:32.090269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266563+0000","last_change":"2024-01-31T05:04:15.863162+0000","last_active":"2024-01-31T05:04:21.266563+0000","last_peered":"2024-01-31T05:04:21.266563+0000","last_clean":"2024-01-31T05:04:21.266563+0000","last_became_active":"2024-01-31T05:04:15.862856+0000","last_became_peered":"2024-01-31T05:04:15.862856+0000","last_unstale":"2024-01-31T05:04:21.266563+0000","last_undegraded":"2024-01-31T05:04:21.266563+0000","last_fullsized":"2024-01-31T05:04:21.266563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:38:14.126192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266991+0000","last_change":"2024-01-31T05:04:16.278690+0000","last_active":"2024-01-31T05:04:21.266991+0000","last_peered":"2024-01-31T05:04:21.266991+0000","last_clean":"2024-01-31T05:04:21.266991+0000","last_became_active":"2024-01-31T05:04:16.277442+0000","last_became_peered":"2024-01-31T05:04:16.277442+0000","last_unstale":"2024-01-31T05:04:21.266991+0000","last_undegraded":"2024-01-31T05:04:21.266991+0000","last_fullsized":"2024-01-31T05:04:21.266991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:07:46.749416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267351+0000","last_change":"2024-01-31T05:04:20.302359+0000","last_active":"2024-01-31T05:04:21.267351+0000","last_peered":"2024-01-31T05:04:21.267351+0000","last_clean":"2024-01-31T05:04:21.267351+0000","last_became_active":"2024-01-31T05:04:20.301989+0000","last_became_peered":"2024-01-31T05:04:20.301989+0000","last_unstale":"2024-01-31T05:04:21.267351+0000","last_undegraded":"2024-01-31T05:04:21.267351+0000","last_fullsized":"2024-01-31T05:04:21.267351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:45:23.064537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579969+0000","last_change":"2024-01-31T05:04:16.281815+0000","last_active":"2024-01-31T05:04:21.579969+0000","last_peered":"2024-01-31T05:04:21.579969+0000","last_clean":"2024-01-31T05:04:21.579969+0000","last_became_active":"2024-01-31T05:04:16.281498+0000","last_became_peered":"2024-01-31T05:04:16.281498+0000","last_unstale":"2024-01-31T05:04:21.579969+0000","last_undegraded":"2024-01-31T05:04:21.579969+0000","last_fullsized":"2024-01-31T05:04:21.579969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267024+0000","last_change":"2024-01-31T05:04:16.295756+0000","last_active":"2024-01-31T05:04:21.267024+0000","last_peered":"2024-01-31T05:04:21.267024+0000","last_clean":"2024-01-31T05:04:21.267024+0000","last_became_active":"2024-01-31T05:04:16.295450+0000","last_became_peered":"2024-01-31T05:04:16.295450+0000","last_unstale":"2024-01-31T05:04:21.267024+0000","last_undegraded":"2024-01-31T05:04:21.267024+0000","last_fullsized":"2024-01-31T05:04:21.267024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:16:27.370806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579563+0000","last_change":"2024-01-31T05:04:16.298362+0000","last_active":"2024-01-31T05:04:21.579563+0000","last_peered":"2024-01-31T05:04:21.579563+0000","last_clean":"2024-01-31T05:04:21.579563+0000","last_became_active":"2024-01-31T05:04:16.297810+0000","last_became_peered":"2024-01-31T05:04:16.297810+0000","last_unstale":"2024-01-31T05:04:21.579563+0000","last_undegraded":"2024-01-31T05:04:21.579563+0000","last_fullsized":"2024-01-31T05:04:21.579563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:10:07.431961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580221+0000","last_change":"2024-01-31T05:04:16.282239+0000","last_active":"2024-01-31T05:04:21.580221+0000","last_peered":"2024-01-31T05:04:21.580221+0000","last_clean":"2024-01-31T05:04:21.580221+0000","last_became_active":"2024-01-31T05:04:16.281895+0000","last_became_peered":"2024-01-31T05:04:16.281895+0000","last_unstale":"2024-01-31T05:04:21.580221+0000","last_undegraded":"2024-01-31T05:04:21.580221+0000","last_fullsized":"2024-01-31T05:04:21.580221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:36.794548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267075+0000","last_change":"2024-01-31T05:04:16.282767+0000","last_active":"2024-01-31T05:04:21.267075+0000","last_peered":"2024-01-31T05:04:21.267075+0000","last_clean":"2024-01-31T05:04:21.267075+0000","last_became_active":"2024-01-31T05:04:16.282281+0000","last_became_peered":"2024-01-31T05:04:16.282281+0000","last_unstale":"2024-01-31T05:04:21.267075+0000","last_undegraded":"2024-01-31T05:04:21.267075+0000","last_fullsized":"2024-01-31T05:04:21.267075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:29:14.662909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580441+0000","last_change":"2024-01-31T05:04:16.281263+0000","last_active":"2024-01-31T05:04:21.580441+0000","last_peered":"2024-01-31T05:04:21.580441+0000","last_clean":"2024-01-31T05:04:21.580441+0000","last_became_active":"2024-01-31T05:04:16.280997+0000","last_became_peered":"2024-01-31T05:04:16.280997+0000","last_unstale":"2024-01-31T05:04:21.580441+0000","last_undegraded":"2024-01-31T05:04:21.580441+0000","last_fullsized":"2024-01-31T05:04:21.580441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:38.399003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581900+0000","last_change":"2024-01-31T05:04:16.287350+0000","last_active":"2024-01-31T05:04:21.581900+0000","last_peered":"2024-01-31T05:04:21.581900+0000","last_clean":"2024-01-31T05:04:21.581900+0000","last_became_active":"2024-01-31T05:04:16.286994+0000","last_became_peered":"2024-01-31T05:04:16.286994+0000","last_unstale":"2024-01-31T05:04:21.581900+0000","last_undegraded":"2024-01-31T05:04:21.581900+0000","last_fullsized":"2024-01-31T05:04:21.581900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:38.399003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267923+0000","last_change":"2024-01-31T05:04:16.281989+0000","last_active":"2024-01-31T05:04:21.267923+0000","last_peered":"2024-01-31T05:04:21.267923+0000","last_clean":"2024-01-31T05:04:21.267923+0000","last_became_active":"2024-01-31T05:04:16.281750+0000","last_became_peered":"2024-01-31T05:04:16.281750+0000","last_unstale":"2024-01-31T05:04:21.267923+0000","last_undegraded":"2024-01-31T05:04:21.267923+0000","last_fullsized":"2024-01-31T05:04:21.267923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579377+0000","last_change":"2024-01-31T05:04:16.294158+0000","last_active":"2024-01-31T05:04:21.579377+0000","last_peered":"2024-01-31T05:04:21.579377+0000","last_clean":"2024-01-31T05:04:21.579377+0000","last_became_active":"2024-01-31T05:04:16.293446+0000","last_became_peered":"2024-01-31T05:04:16.293446+0000","last_unstale":"2024-01-31T05:04:21.579377+0000","last_undegraded":"2024-01-31T05:04:21.579377+0000","last_fullsized":"2024-01-31T05:04:21.579377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:17:31.783779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266570+0000","last_change":"2024-01-31T05:04:16.285685+0000","last_active":"2024-01-31T05:04:21.266570+0000","last_peered":"2024-01-31T05:04:21.266570+0000","last_clean":"2024-01-31T05:04:21.266570+0000","last_became_active":"2024-01-31T05:04:16.285379+0000","last_became_peered":"2024-01-31T05:04:16.285379+0000","last_unstale":"2024-01-31T05:04:21.266570+0000","last_undegraded":"2024-01-31T05:04:21.266570+0000","last_fullsized":"2024-01-31T05:04:21.266570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:36.794548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579467+0000","last_change":"2024-01-31T05:04:16.295065+0000","last_active":"2024-01-31T05:04:21.579467+0000","last_peered":"2024-01-31T05:04:21.579467+0000","last_clean":"2024-01-31T05:04:21.579467+0000","last_became_active":"2024-01-31T05:04:16.294149+0000","last_became_peered":"2024-01-31T05:04:16.294149+0000","last_unstale":"2024-01-31T05:04:21.579467+0000","last_undegraded":"2024-01-31T05:04:21.579467+0000","last_fullsized":"2024-01-31T05:04:21.579467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:20.440155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580011+0000","last_change":"2024-01-31T05:04:16.282035+0000","last_active":"2024-01-31T05:04:21.580011+0000","last_peered":"2024-01-31T05:04:21.580011+0000","last_clean":"2024-01-31T05:04:21.580011+0000","last_became_active":"2024-01-31T05:04:16.281692+0000","last_became_peered":"2024-01-31T05:04:16.281692+0000","last_unstale":"2024-01-31T05:04:21.580011+0000","last_undegraded":"2024-01-31T05:04:21.580011+0000","last_fullsized":"2024-01-31T05:04:21.580011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:44:28.652707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580645+0000","last_change":"2024-01-31T05:04:16.286442+0000","last_active":"2024-01-31T05:04:21.580645+0000","last_peered":"2024-01-31T05:04:21.580645+0000","last_clean":"2024-01-31T05:04:21.580645+0000","last_became_active":"2024-01-31T05:04:16.286105+0000","last_became_peered":"2024-01-31T05:04:16.286105+0000","last_unstale":"2024-01-31T05:04:21.580645+0000","last_undegraded":"2024-01-31T05:04:21.580645+0000","last_fullsized":"2024-01-31T05:04:21.580645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.582060+0000","last_change":"2024-01-31T05:04:16.285693+0000","last_active":"2024-01-31T05:04:21.582060+0000","last_peered":"2024-01-31T05:04:21.582060+0000","last_clean":"2024-01-31T05:04:21.582060+0000","last_became_active":"2024-01-31T05:04:16.285438+0000","last_became_peered":"2024-01-31T05:04:16.285438+0000","last_unstale":"2024-01-31T05:04:21.582060+0000","last_undegraded":"2024-01-31T05:04:21.582060+0000","last_fullsized":"2024-01-31T05:04:21.582060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:41.035623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267794+0000","last_change":"2024-01-31T05:04:16.288398+0000","last_active":"2024-01-31T05:04:21.267794+0000","last_peered":"2024-01-31T05:04:21.267794+0000","last_clean":"2024-01-31T05:04:21.267794+0000","last_became_active":"2024-01-31T05:04:16.288236+0000","last_became_peered":"2024-01-31T05:04:16.288236+0000","last_unstale":"2024-01-31T05:04:21.267794+0000","last_undegraded":"2024-01-31T05:04:21.267794+0000","last_fullsized":"2024-01-31T05:04:21.267794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:24:56.115180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581838+0000","last_change":"2024-01-31T05:04:16.289516+0000","last_active":"2024-01-31T05:04:21.581838+0000","last_peered":"2024-01-31T05:04:21.581838+0000","last_clean":"2024-01-31T05:04:21.581838+0000","last_became_active":"2024-01-31T05:04:16.289233+0000","last_became_peered":"2024-01-31T05:04:16.289233+0000","last_unstale":"2024-01-31T05:04:21.581838+0000","last_undegraded":"2024-01-31T05:04:21.581838+0000","last_fullsized":"2024-01-31T05:04:21.581838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:42.297440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579222+0000","last_change":"2024-01-31T05:04:16.296022+0000","last_active":"2024-01-31T05:04:21.579222+0000","last_peered":"2024-01-31T05:04:21.579222+0000","last_clean":"2024-01-31T05:04:21.579222+0000","last_became_active":"2024-01-31T05:04:16.295742+0000","last_became_peered":"2024-01-31T05:04:16.295742+0000","last_unstale":"2024-01-31T05:04:21.579222+0000","last_undegraded":"2024-01-31T05:04:21.579222+0000","last_fullsized":"2024-01-31T05:04:21.579222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579754+0000","last_change":"2024-01-31T05:04:16.287380+0000","last_active":"2024-01-31T05:04:21.579754+0000","last_peered":"2024-01-31T05:04:21.579754+0000","last_clean":"2024-01-31T05:04:21.579754+0000","last_became_active":"2024-01-31T05:04:16.287109+0000","last_became_peered":"2024-01-31T05:04:16.287109+0000","last_unstale":"2024-01-31T05:04:21.579754+0000","last_undegraded":"2024-01-31T05:04:21.579754+0000","last_fullsized":"2024-01-31T05:04:21.579754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:36.794548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580061+0000","last_change":"2024-01-31T05:04:16.279154+0000","last_active":"2024-01-31T05:04:21.580061+0000","last_peered":"2024-01-31T05:04:21.580061+0000","last_clean":"2024-01-31T05:04:21.580061+0000","last_became_active":"2024-01-31T05:04:16.278567+0000","last_became_peered":"2024-01-31T05:04:16.278567+0000","last_unstale":"2024-01-31T05:04:21.580061+0000","last_undegraded":"2024-01-31T05:04:21.580061+0000","last_fullsized":"2024-01-31T05:04:21.580061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:42:45.290684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266435+0000","last_change":"2024-01-31T05:04:16.297488+0000","last_active":"2024-01-31T05:04:21.266435+0000","last_peered":"2024-01-31T05:04:21.266435+0000","last_clean":"2024-01-31T05:04:21.266435+0000","last_became_active":"2024-01-31T05:04:16.297230+0000","last_became_peered":"2024-01-31T05:04:16.297230+0000","last_unstale":"2024-01-31T05:04:21.266435+0000","last_undegraded":"2024-01-31T05:04:21.266435+0000","last_fullsized":"2024-01-31T05:04:21.266435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267316+0000","last_change":"2024-01-31T05:04:16.288685+0000","last_active":"2024-01-31T05:04:21.267316+0000","last_peered":"2024-01-31T05:04:21.267316+0000","last_clean":"2024-01-31T05:04:21.267316+0000","last_became_active":"2024-01-31T05:04:16.288432+0000","last_became_peered":"2024-01-31T05:04:16.288432+0000","last_unstale":"2024-01-31T05:04:21.267316+0000","last_undegraded":"2024-01-31T05:04:21.267316+0000","last_fullsized":"2024-01-31T05:04:21.267316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:16:27.370806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581061+0000","last_change":"2024-01-31T05:04:16.299989+0000","last_active":"2024-01-31T05:04:21.581061+0000","last_peered":"2024-01-31T05:04:21.581061+0000","last_clean":"2024-01-31T05:04:21.581061+0000","last_became_active":"2024-01-31T05:04:16.299706+0000","last_became_peered":"2024-01-31T05:04:16.299706+0000","last_unstale":"2024-01-31T05:04:21.581061+0000","last_undegraded":"2024-01-31T05:04:21.581061+0000","last_fullsized":"2024-01-31T05:04:21.581061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:32:44.394537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581425+0000","last_change":"2024-01-31T05:04:16.300161+0000","last_active":"2024-01-31T05:04:21.581425+0000","last_peered":"2024-01-31T05:04:21.581425+0000","last_clean":"2024-01-31T05:04:21.581425+0000","last_became_active":"2024-01-31T05:04:16.299891+0000","last_became_peered":"2024-01-31T05:04:16.299891+0000","last_unstale":"2024-01-31T05:04:21.581425+0000","last_undegraded":"2024-01-31T05:04:21.581425+0000","last_fullsized":"2024-01-31T05:04:21.581425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:05:32.076479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581621+0000","last_change":"2024-01-31T05:04:16.296845+0000","last_active":"2024-01-31T05:04:21.581621+0000","last_peered":"2024-01-31T05:04:21.581621+0000","last_clean":"2024-01-31T05:04:21.581621+0000","last_became_active":"2024-01-31T05:04:16.296607+0000","last_became_peered":"2024-01-31T05:04:16.296607+0000","last_unstale":"2024-01-31T05:04:21.581621+0000","last_undegraded":"2024-01-31T05:04:21.581621+0000","last_fullsized":"2024-01-31T05:04:21.581621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:42:10.970514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266165+0000","last_change":"2024-01-31T05:04:16.297713+0000","last_active":"2024-01-31T05:04:21.266165+0000","last_peered":"2024-01-31T05:04:21.266165+0000","last_clean":"2024-01-31T05:04:21.266165+0000","last_became_active":"2024-01-31T05:04:16.297428+0000","last_became_peered":"2024-01-31T05:04:16.297428+0000","last_unstale":"2024-01-31T05:04:21.266165+0000","last_undegraded":"2024-01-31T05:04:21.266165+0000","last_fullsized":"2024-01-31T05:04:21.266165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:44:28.652707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581148+0000","last_change":"2024-01-31T05:04:16.282822+0000","last_active":"2024-01-31T05:04:21.581148+0000","last_peered":"2024-01-31T05:04:21.581148+0000","last_clean":"2024-01-31T05:04:21.581148+0000","last_became_active":"2024-01-31T05:04:16.282537+0000","last_became_peered":"2024-01-31T05:04:16.282537+0000","last_unstale":"2024-01-31T05:04:21.581148+0000","last_undegraded":"2024-01-31T05:04:21.581148+0000","last_fullsized":"2024-01-31T05:04:21.581148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:52:00.886932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579642+0000","last_change":"2024-01-31T05:04:16.298033+0000","last_active":"2024-01-31T05:04:21.579642+0000","last_peered":"2024-01-31T05:04:21.579642+0000","last_clean":"2024-01-31T05:04:21.579642+0000","last_became_active":"2024-01-31T05:04:16.297503+0000","last_became_peered":"2024-01-31T05:04:16.297503+0000","last_unstale":"2024-01-31T05:04:21.579642+0000","last_undegraded":"2024-01-31T05:04:21.579642+0000","last_fullsized":"2024-01-31T05:04:21.579642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581513+0000","last_change":"2024-01-31T05:04:16.284955+0000","last_active":"2024-01-31T05:04:21.581513+0000","last_peered":"2024-01-31T05:04:21.581513+0000","last_clean":"2024-01-31T05:04:21.581513+0000","last_became_active":"2024-01-31T05:04:16.284672+0000","last_became_peered":"2024-01-31T05:04:16.284672+0000","last_unstale":"2024-01-31T05:04:21.581513+0000","last_undegraded":"2024-01-31T05:04:21.581513+0000","last_fullsized":"2024-01-31T05:04:21.581513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:10:07.431961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580116+0000","last_change":"2024-01-31T05:04:16.295273+0000","last_active":"2024-01-31T05:04:21.580116+0000","last_peered":"2024-01-31T05:04:21.580116+0000","last_clean":"2024-01-31T05:04:21.580116+0000","last_became_active":"2024-01-31T05:04:16.294052+0000","last_became_peered":"2024-01-31T05:04:16.294052+0000","last_unstale":"2024-01-31T05:04:21.580116+0000","last_undegraded":"2024-01-31T05:04:21.580116+0000","last_fullsized":"2024-01-31T05:04:21.580116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:59:17.499417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580619+0000","last_change":"2024-01-31T05:04:16.274394+0000","last_active":"2024-01-31T05:04:21.580619+0000","last_peered":"2024-01-31T05:04:21.580619+0000","last_clean":"2024-01-31T05:04:21.580619+0000","last_became_active":"2024-01-31T05:04:16.274092+0000","last_became_peered":"2024-01-31T05:04:16.274092+0000","last_unstale":"2024-01-31T05:04:21.580619+0000","last_undegraded":"2024-01-31T05:04:21.580619+0000","last_fullsized":"2024-01-31T05:04:21.580619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:05:32.076479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580935+0000","last_change":"2024-01-31T05:04:16.276197+0000","last_active":"2024-01-31T05:04:21.580935+0000","last_peered":"2024-01-31T05:04:21.580935+0000","last_clean":"2024-01-31T05:04:21.580935+0000","last_became_active":"2024-01-31T05:04:16.275821+0000","last_became_peered":"2024-01-31T05:04:16.275821+0000","last_unstale":"2024-01-31T05:04:21.580935+0000","last_undegraded":"2024-01-31T05:04:21.580935+0000","last_fullsized":"2024-01-31T05:04:21.580935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581450+0000","last_change":"2024-01-31T05:04:16.289246+0000","last_active":"2024-01-31T05:04:21.581450+0000","last_peered":"2024-01-31T05:04:21.581450+0000","last_clean":"2024-01-31T05:04:21.581450+0000","last_became_active":"2024-01-31T05:04:16.288595+0000","last_became_peered":"2024-01-31T05:04:16.288595+0000","last_unstale":"2024-01-31T05:04:21.581450+0000","last_undegraded":"2024-01-31T05:04:21.581450+0000","last_fullsized":"2024-01-31T05:04:21.581450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:42.297440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":690798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-31T05:04:41.826 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-31T05:04:41.826 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-31T05:04:41.826 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-31T05:04:41.827 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-31T05:04:41.827 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-31T05:04:42.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.003+0000 7f280e200640 1 Processor -- start 2024-01-31T05:04:42.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.003+0000 7f280e200640 1 -- start start 2024-01-31T05:04:42.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.003+0000 7f280e200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28080cd680 0x7f28080cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:42.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.003+0000 7f280e200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f280815b3e0 0x7f28080cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:42.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.003+0000 7f280e200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f28080ce4e0 0x7f28080ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:42.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.003+0000 7f280e200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28080ccd50 con 0x7f280815b3e0 2024-01-31T05:04:42.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.003+0000 7f280e200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28080cc790 con 0x7f28080ce4e0 2024-01-31T05:04:42.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.003+0000 7f280e200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28080cca70 con 0x7f28080cd680 2024-01-31T05:04:42.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.003+0000 7f2806a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f280815b3e0 0x7f28080cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:42.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.003+0000 7f2806a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f280815b3e0 0x7f28080cdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38400/0 (socket says 172.21.15.49:38400) 2024-01-31T05:04:42.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.003+0000 7f2806a00640 1 -- 172.21.15.49:0/3344337307 learned_addr learned my addr 172.21.15.49:0/3344337307 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:42.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.003+0000 7f2807e00640 1 --2- 172.21.15.49:0/3344337307 >> v2:172.21.15.195:3300/0 conn(0x7f28080ce4e0 0x7f28080ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:42.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.003+0000 7f2807400640 1 --2- 172.21.15.49:0/3344337307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28080cd680 0x7f28080cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:42.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.003+0000 7f2806a00640 1 -- 172.21.15.49:0/3344337307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28080cd680 msgr2=0x7f28080cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:42.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.003+0000 7f2806a00640 1 --2- 172.21.15.49:0/3344337307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28080cd680 0x7f28080cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.003+0000 7f2806a00640 1 -- 172.21.15.49:0/3344337307 >> v2:172.21.15.195:3300/0 conn(0x7f28080ce4e0 msgr2=0x7f28080ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:42.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.003+0000 7f2806a00640 1 --2- 172.21.15.49:0/3344337307 >> v2:172.21.15.195:3300/0 conn(0x7f28080ce4e0 0x7f28080ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.003+0000 7f2806a00640 1 -- 172.21.15.49:0/3344337307 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28080adcd0 con 0x7f280815b3e0 2024-01-31T05:04:42.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.007+0000 7f2806a00640 1 --2- 172.21.15.49:0/3344337307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f280815b3e0 0x7f28080cdfa0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2808072400 tx=0x7f27f001c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8db9ed1d1dbc13 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:42.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.007+0000 7f2806000640 1 -- 172.21.15.49:0/3344337307 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f00ab600 con 0x7f280815b3e0 2024-01-31T05:04:42.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.007+0000 7f2806000640 1 -- 172.21.15.49:0/3344337307 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f00a7050 con 0x7f280815b3e0 2024-01-31T05:04:42.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.007+0000 7f2806000640 1 -- 172.21.15.49:0/3344337307 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f00ab980 con 0x7f280815b3e0 2024-01-31T05:04:42.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.007+0000 7f280e200640 1 -- 172.21.15.49:0/3344337307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f280815b3e0 msgr2=0x7f28080cdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:42.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.007+0000 7f280e200640 1 --2- 172.21.15.49:0/3344337307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f280815b3e0 0x7f28080cdfa0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2808072400 tx=0x7f27f001c180 comp rx=0 tx=0).stop 2024-01-31T05:04:42.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.007+0000 7f280e200640 1 -- 172.21.15.49:0/3344337307 shutdown_connections 2024-01-31T05:04:42.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.007+0000 7f280e200640 1 --2- 172.21.15.49:0/3344337307 >> v2:172.21.15.195:3300/0 conn(0x7f28080ce4e0 0x7f28080ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.007+0000 7f280e200640 1 --2- 172.21.15.49:0/3344337307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f280815b3e0 0x7f28080cdfa0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.007+0000 7f280e200640 1 --2- 172.21.15.49:0/3344337307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28080cd680 0x7f28080cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.007+0000 7f280e200640 1 -- 172.21.15.49:0/3344337307 >> 172.21.15.49:0/3344337307 conn(0x7f28080b28e0 msgr2=0x7f28080b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:42.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.007+0000 7f280e200640 1 -- 172.21.15.49:0/3344337307 shutdown_connections 2024-01-31T05:04:42.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.007+0000 7f280e200640 1 -- 172.21.15.49:0/3344337307 wait complete. 2024-01-31T05:04:42.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f280e200640 1 Processor -- start 2024-01-31T05:04:42.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f280e200640 1 -- start start 2024-01-31T05:04:42.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f280e200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28080cd680 0x7f2808164c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:42.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f280e200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28080ce4e0 0x7f2808153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:42.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f280e200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f280815b3e0 0x7f2808154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:42.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f280e200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2808163910 con 0x7f28080cd680 2024-01-31T05:04:42.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f280e200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2808163b90 con 0x7f28080ce4e0 2024-01-31T05:04:42.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f280e200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2808163e70 con 0x7f280815b3e0 2024-01-31T05:04:42.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f2807400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28080cd680 0x7f2808164c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:42.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f2807400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28080cd680 0x7f2808164c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38414/0 (socket says 172.21.15.49:38414) 2024-01-31T05:04:42.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f2807400640 1 -- 172.21.15.49:0/2058296979 learned_addr learned my addr 172.21.15.49:0/2058296979 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:42.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f2806a00640 1 --2- 172.21.15.49:0/2058296979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28080ce4e0 0x7f2808153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:42.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f2807e00640 1 --2- 172.21.15.49:0/2058296979 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f280815b3e0 0x7f2808154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:42.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f2807400640 1 -- 172.21.15.49:0/2058296979 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f280815b3e0 msgr2=0x7f2808154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:42.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f2807400640 1 --2- 172.21.15.49:0/2058296979 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f280815b3e0 0x7f2808154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f2807400640 1 -- 172.21.15.49:0/2058296979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28080ce4e0 msgr2=0x7f2808153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:42.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f2807400640 1 --2- 172.21.15.49:0/2058296979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28080ce4e0 0x7f2808153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f2807400640 1 -- 172.21.15.49:0/2058296979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00094d0 con 0x7f28080cd680 2024-01-31T05:04:42.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f2807400640 1 --2- 172.21.15.49:0/2058296979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28080cd680 0x7f2808164c30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f27f800e8d0 tx=0x7f27f800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:42.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f27ff400640 1 -- 172.21.15.49:0/2058296979 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f8009630 con 0x7f28080cd680 2024-01-31T05:04:42.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f27ff400640 1 -- 172.21.15.49:0/2058296979 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f800c940 con 0x7f28080cd680 2024-01-31T05:04:42.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f27ff400640 1 -- 172.21.15.49:0/2058296979 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f800ccd0 con 0x7f28080cd680 2024-01-31T05:04:42.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f280e200640 1 -- 172.21.15.49:0/2058296979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2808164150 con 0x7f28080cd680 2024-01-31T05:04:42.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.011+0000 7f280e200640 1 -- 172.21.15.49:0/2058296979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2808164710 con 0x7f28080cd680 2024-01-31T05:04:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.015+0000 7f280e200640 1 -- 172.21.15.49:0/2058296979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2808164900 con 0x7f28080cd680 2024-01-31T05:04:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.015+0000 7f27ff400640 1 -- 172.21.15.49:0/2058296979 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f27f8013470 con 0x7f28080cd680 2024-01-31T05:04:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.015+0000 7f27ff400640 1 --2- 172.21.15.49:0/2058296979 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f27e0066500 0x7f27e00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.015+0000 7f27ff400640 1 -- 172.21.15.49:0/2058296979 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f27f8084310 con 0x7f28080cd680 2024-01-31T05:04:42.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.015+0000 7f2806a00640 1 --2- 172.21.15.49:0/2058296979 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f27e0066500 0x7f27e00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:42.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.015+0000 7f2806a00640 1 --2- 172.21.15.49:0/2058296979 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f27e0066500 0x7f27e00689c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f27f00ad000 tx=0x7f27f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:42.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.019+0000 7f27ff400640 1 -- 172.21.15.49:0/2058296979 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f27f8051400 con 0x7f28080cd680 2024-01-31T05:04:42.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.215+0000 7f280e200640 1 -- 172.21.15.49:0/2058296979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2808074860 con 0x7f28080cd680 2024-01-31T05:04:42.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.219+0000 7f27ff400640 1 -- 172.21.15.49:0/2058296979 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164186 (secure 0 0 0) 0x7f27f8054a20 con 0x7f28080cd680 2024-01-31T05:04:42.221 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:42.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.219+0000 7f280e200640 1 -- 172.21.15.49:0/2058296979 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f27e0066500 msgr2=0x7f27e00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:42.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.219+0000 7f280e200640 1 --2- 172.21.15.49:0/2058296979 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f27e0066500 0x7f27e00689c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f27f00ad000 tx=0x7f27f0008040 comp rx=0 tx=0).stop 2024-01-31T05:04:42.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.219+0000 7f280e200640 1 -- 172.21.15.49:0/2058296979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28080cd680 msgr2=0x7f2808164c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:42.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.219+0000 7f280e200640 1 --2- 172.21.15.49:0/2058296979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28080cd680 0x7f2808164c30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f27f800e8d0 tx=0x7f27f800ed90 comp rx=0 tx=0).stop 2024-01-31T05:04:42.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.219+0000 7f280e200640 1 -- 172.21.15.49:0/2058296979 shutdown_connections 2024-01-31T05:04:42.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.219+0000 7f280e200640 1 --2- 172.21.15.49:0/2058296979 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f280815b3e0 0x7f2808154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.219+0000 7f280e200640 1 --2- 172.21.15.49:0/2058296979 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f27e0066500 0x7f27e00689c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.219+0000 7f280e200640 1 --2- 172.21.15.49:0/2058296979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28080ce4e0 0x7f2808153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.219+0000 7f280e200640 1 --2- 172.21.15.49:0/2058296979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28080cd680 0x7f2808164c30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.219+0000 7f280e200640 1 -- 172.21.15.49:0/2058296979 >> 172.21.15.49:0/2058296979 conn(0x7f28080b28e0 msgr2=0x7f28080b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:42.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.219+0000 7f280e200640 1 -- 172.21.15.49:0/2058296979 shutdown_connections 2024-01-31T05:04:42.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.219+0000 7f280e200640 1 -- 172.21.15.49:0/2058296979 wait complete. 2024-01-31T05:04:42.242 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3035808172},{"type":"v1","addr":"172.21.15.195:6833","nonce":3035808172}]},"active_addr":"172.21.15.195:6833/3035808172","active_change":"2024-01-31T05:03:56.406344+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.195:0","nonce":2325274670}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.195:0","nonce":1473045742}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.195:0","nonce":3615991068}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.195:0","nonce":1044123978}]}]} 2024-01-31T05:04:42.245 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-31T05:04:42.245 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-31T05:04:42.245 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:04:42.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.383+0000 7fe724000640 1 Processor -- start 2024-01-31T05:04:42.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.387+0000 7fe724000640 1 -- start start 2024-01-31T05:04:42.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.387+0000 7fe724000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe71c15a000 0x7fe71c0cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:42.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.387+0000 7fe724000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe71c0715e0 0x7fe71c0ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:42.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.387+0000 7fe724000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71c06c750 con 0x7fe71c06c2d0 2024-01-31T05:04:42.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.387+0000 7fe724000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71c0b3760 con 0x7fe71c15a000 2024-01-31T05:04:42.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.387+0000 7fe724000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c071e40 con 0x7fe71c0715e0 2024-01-31T05:04:42.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.387+0000 7fe722000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe71c0715e0 0x7fe71c0ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:42.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.387+0000 7fe722000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe71c0715e0 0x7fe71c0ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:52826/0 (socket says 172.21.15.49:52826) 2024-01-31T05:04:42.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.387+0000 7fe722000640 1 -- 172.21.15.49:0/2423144592 learned_addr learned my addr 172.21.15.49:0/2423144592 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:42.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.387+0000 7fe721600640 1 --2- 172.21.15.49:0/2423144592 >> v2:172.21.15.195:3300/0 conn(0x7fe71c15a000 0x7fe71c0cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:42.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.387+0000 7fe722000640 1 -- 172.21.15.49:0/2423144592 >> v2:172.21.15.195:3300/0 conn(0x7fe71c15a000 msgr2=0x7fe71c0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:42.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.387+0000 7fe722000640 1 --2- 172.21.15.49:0/2423144592 >> v2:172.21.15.195:3300/0 conn(0x7fe71c15a000 0x7fe71c0cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.387+0000 7fe722000640 1 -- 172.21.15.49:0/2423144592 >> v1:172.21.15.195:6789/0 conn(0x7fe71c06c2d0 legacy=0x7fe71c070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:42.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.387+0000 7fe722000640 1 -- 172.21.15.49:0/2423144592 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c06c990 con 0x7fe71c0715e0 2024-01-31T05:04:42.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.391+0000 7fe722000640 1 --2- 172.21.15.49:0/2423144592 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe71c0715e0 0x7fe71c0ac8d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe71c072cb0 tx=0x7fe71401c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c47ce7e0b6cdb24 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:42.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.391+0000 7fe71be00640 1 -- 172.21.15.49:0/2423144592 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7140a5810 con 0x7fe71c0715e0 2024-01-31T05:04:42.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.391+0000 7fe71be00640 1 -- 172.21.15.49:0/2423144592 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7140a5970 con 0x7fe71c0715e0 2024-01-31T05:04:42.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.391+0000 7fe71be00640 1 -- 172.21.15.49:0/2423144592 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7140a5d00 con 0x7fe71c0715e0 2024-01-31T05:04:42.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.391+0000 7fe724000640 1 -- 172.21.15.49:0/2423144592 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe71c0715e0 msgr2=0x7fe71c0ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:42.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.391+0000 7fe724000640 1 --2- 172.21.15.49:0/2423144592 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe71c0715e0 0x7fe71c0ac8d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe71c072cb0 tx=0x7fe71401c990 comp rx=0 tx=0).stop 2024-01-31T05:04:42.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.391+0000 7fe724000640 1 -- 172.21.15.49:0/2423144592 shutdown_connections 2024-01-31T05:04:42.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.391+0000 7fe724000640 1 --2- 172.21.15.49:0/2423144592 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe71c0715e0 0x7fe71c0ac8d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.391+0000 7fe724000640 1 --2- 172.21.15.49:0/2423144592 >> v2:172.21.15.195:3300/0 conn(0x7fe71c15a000 0x7fe71c0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.391+0000 7fe724000640 1 -- 172.21.15.49:0/2423144592 >> 172.21.15.49:0/2423144592 conn(0x7fe71c0b09a0 msgr2=0x7fe71c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:42.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.391+0000 7fe724000640 1 -- 172.21.15.49:0/2423144592 shutdown_connections 2024-01-31T05:04:42.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.391+0000 7fe724000640 1 -- 172.21.15.49:0/2423144592 wait complete. 2024-01-31T05:04:42.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe724000640 1 Processor -- start 2024-01-31T05:04:42.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe724000640 1 -- start start 2024-01-31T05:04:42.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe724000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe71c06c2d0 0x7fe71c15c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:42.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe724000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe71c0715e0 0x7fe71c163b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:42.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe724000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe71c15a000 0x7fe71c162180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:42.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe724000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c0cde10 con 0x7fe71c06c2d0 2024-01-31T05:04:42.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe724000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c1f63d0 con 0x7fe71c15a000 2024-01-31T05:04:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe724000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c164090 con 0x7fe71c0715e0 2024-01-31T05:04:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe721600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe71c06c2d0 0x7fe71c15c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe721600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe71c06c2d0 0x7fe71c15c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38422/0 (socket says 172.21.15.49:38422) 2024-01-31T05:04:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe721600640 1 -- 172.21.15.49:0/3928246885 learned_addr learned my addr 172.21.15.49:0/3928246885 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe722000640 1 --2- 172.21.15.49:0/3928246885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe71c15a000 0x7fe71c162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe720c00640 1 --2- 172.21.15.49:0/3928246885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe71c0715e0 0x7fe71c163b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe721600640 1 -- 172.21.15.49:0/3928246885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe71c0715e0 msgr2=0x7fe71c163b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe721600640 1 --2- 172.21.15.49:0/3928246885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe71c0715e0 0x7fe71c163b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe721600640 1 -- 172.21.15.49:0/3928246885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe71c15a000 msgr2=0x7fe71c162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe721600640 1 --2- 172.21.15.49:0/3928246885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe71c15a000 0x7fe71c162180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe721600640 1 -- 172.21.15.49:0/3928246885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe714009b30 con 0x7fe71c06c2d0 2024-01-31T05:04:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe722000640 1 --2- 172.21.15.49:0/3928246885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe71c15a000 0x7fe71c162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe721600640 1 --2- 172.21.15.49:0/3928246885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe71c06c2d0 0x7fe71c15c200 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00d5f0 tx=0x7fe70c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe719600640 1 -- 172.21.15.49:0/3928246885 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c0125f0 con 0x7fe71c06c2d0 2024-01-31T05:04:42.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe719600640 1 -- 172.21.15.49:0/3928246885 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c012750 con 0x7fe71c06c2d0 2024-01-31T05:04:42.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe719600640 1 -- 172.21.15.49:0/3928246885 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c012b00 con 0x7fe71c06c2d0 2024-01-31T05:04:42.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe724000640 1 -- 172.21.15.49:0/3928246885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71c1626c0 con 0x7fe71c06c2d0 2024-01-31T05:04:42.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.395+0000 7fe724000640 1 -- 172.21.15.49:0/3928246885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71c1645d0 con 0x7fe71c06c2d0 2024-01-31T05:04:42.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.399+0000 7fe724000640 1 -- 172.21.15.49:0/3928246885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71c074860 con 0x7fe71c06c2d0 2024-01-31T05:04:42.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.399+0000 7fe719600640 1 -- 172.21.15.49:0/3928246885 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fe70c012c60 con 0x7fe71c06c2d0 2024-01-31T05:04:42.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.399+0000 7fe719600640 1 --2- 172.21.15.49:0/3928246885 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe6f4066500 0x7fe6f40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:42.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.399+0000 7fe719600640 1 -- 172.21.15.49:0/3928246885 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe70c0847c0 con 0x7fe71c06c2d0 2024-01-31T05:04:42.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.399+0000 7fe720c00640 1 --2- 172.21.15.49:0/3928246885 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe6f4066500 0x7fe6f40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:42.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.399+0000 7fe720c00640 1 --2- 172.21.15.49:0/3928246885 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe6f4066500 0x7fe6f40689c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe71c15bcc0 tx=0x7fe704009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:42.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.403+0000 7fe719600640 1 -- 172.21.15.49:0/3928246885 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fe70c0516d0 con 0x7fe71c06c2d0 2024-01-31T05:04:42.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.567+0000 7fe724000640 1 -- 172.21.15.49:0/3928246885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe71c0adb80 con 0x7fe71c06c2d0 2024-01-31T05:04:42.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.567+0000 7fe719600640 1 -- 172.21.15.49:0/3928246885 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18323 (secure 0 0 0) 0x7fe70c054cf0 con 0x7fe71c06c2d0 2024-01-31T05:04:42.568 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:42.568 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:20.695841+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:04:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.567+0000 7fe724000640 1 -- 172.21.15.49:0/3928246885 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe6f4066500 msgr2=0x7fe6f40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.567+0000 7fe724000640 1 --2- 172.21.15.49:0/3928246885 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe6f4066500 0x7fe6f40689c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe71c15bcc0 tx=0x7fe704009040 comp rx=0 tx=0).stop 2024-01-31T05:04:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.567+0000 7fe724000640 1 -- 172.21.15.49:0/3928246885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe71c06c2d0 msgr2=0x7fe71c15c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.567+0000 7fe724000640 1 --2- 172.21.15.49:0/3928246885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe71c06c2d0 0x7fe71c15c200 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00d5f0 tx=0x7fe70c00dab0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.571+0000 7fe724000640 1 -- 172.21.15.49:0/3928246885 shutdown_connections 2024-01-31T05:04:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.571+0000 7fe724000640 1 --2- 172.21.15.49:0/3928246885 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe6f4066500 0x7fe6f40689c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.571+0000 7fe724000640 1 --2- 172.21.15.49:0/3928246885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe71c15a000 0x7fe71c162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.571+0000 7fe724000640 1 --2- 172.21.15.49:0/3928246885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe71c0715e0 0x7fe71c163b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.571+0000 7fe724000640 1 --2- 172.21.15.49:0/3928246885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe71c06c2d0 0x7fe71c15c200 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.571+0000 7fe724000640 1 -- 172.21.15.49:0/3928246885 >> 172.21.15.49:0/3928246885 conn(0x7fe71c0b09a0 msgr2=0x7fe71c157290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:42.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.571+0000 7fe724000640 1 -- 172.21.15.49:0/3928246885 shutdown_connections 2024-01-31T05:04:42.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.571+0000 7fe724000640 1 -- 172.21.15.49:0/3928246885 wait complete. 2024-01-31T05:04:42.591 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-31T05:04:42.591 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:04:42.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.731+0000 7f8b1aa00640 1 Processor -- start 2024-01-31T05:04:42.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.731+0000 7f8b1aa00640 1 -- start start 2024-01-31T05:04:42.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.731+0000 7f8b1aa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b140cde80 0x7f8b1415cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:42.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.731+0000 7f8b1aa00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8b140cf0f0 0x7f8b1415d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:42.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.731+0000 7f8b1aa00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b140cf660 con 0x7f8b140cd0c0 2024-01-31T05:04:42.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.731+0000 7f8b1aa00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b140d02e0 con 0x7f8b140cf0f0 2024-01-31T05:04:42.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.731+0000 7f8b1aa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b140cf940 con 0x7f8b140cde80 2024-01-31T05:04:42.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.731+0000 7f8b18a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8b140cf0f0 0x7f8b1415d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:42.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.731+0000 7f8b18a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8b140cf0f0 0x7f8b1415d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38426/0 (socket says 172.21.15.49:38426) 2024-01-31T05:04:42.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.731+0000 7f8b18a00640 1 -- 172.21.15.49:0/3538113237 learned_addr learned my addr 172.21.15.49:0/3538113237 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:42.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.731+0000 7f8b13400640 1 --2- 172.21.15.49:0/3538113237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b140cde80 0x7f8b1415cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:42.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.731+0000 7f8b18a00640 1 -- 172.21.15.49:0/3538113237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b140cde80 msgr2=0x7f8b1415cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:42.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.731+0000 7f8b18a00640 1 --2- 172.21.15.49:0/3538113237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b140cde80 0x7f8b1415cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.731+0000 7f8b18a00640 1 -- 172.21.15.49:0/3538113237 >> v1:172.21.15.195:6789/0 conn(0x7f8b140cd0c0 legacy=0x7f8b140cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:42.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.731+0000 7f8b18a00640 1 -- 172.21.15.49:0/3538113237 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b140cfc20 con 0x7f8b140cf0f0 2024-01-31T05:04:42.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.735+0000 7f8b18a00640 1 --2- 172.21.15.49:0/3538113237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b140cf0f0 0x7f8b1415d0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c009e50 tx=0x7f8b0c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f877292ccc9afab server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:42.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.735+0000 7f8b12a00640 1 -- 172.21.15.49:0/3538113237 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0a57b0 con 0x7f8b140cf0f0 2024-01-31T05:04:42.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.735+0000 7f8b12a00640 1 -- 172.21.15.49:0/3538113237 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0c0a5910 con 0x7f8b140cf0f0 2024-01-31T05:04:42.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.735+0000 7f8b12a00640 1 -- 172.21.15.49:0/3538113237 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0a5ca0 con 0x7f8b140cf0f0 2024-01-31T05:04:42.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.735+0000 7f8b1aa00640 1 -- 172.21.15.49:0/3538113237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b140cf0f0 msgr2=0x7f8b1415d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:42.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.735+0000 7f8b1aa00640 1 --2- 172.21.15.49:0/3538113237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b140cf0f0 0x7f8b1415d0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c009e50 tx=0x7f8b0c01c950 comp rx=0 tx=0).stop 2024-01-31T05:04:42.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.735+0000 7f8b1aa00640 1 -- 172.21.15.49:0/3538113237 shutdown_connections 2024-01-31T05:04:42.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.735+0000 7f8b1aa00640 1 --2- 172.21.15.49:0/3538113237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b140cf0f0 0x7f8b1415d0a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.735+0000 7f8b1aa00640 1 --2- 172.21.15.49:0/3538113237 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b140cde80 0x7f8b1415cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.735+0000 7f8b1aa00640 1 -- 172.21.15.49:0/3538113237 >> 172.21.15.49:0/3538113237 conn(0x7f8b140d0ef0 msgr2=0x7f8b140d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:42.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b1aa00640 1 -- 172.21.15.49:0/3538113237 shutdown_connections 2024-01-31T05:04:42.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b1aa00640 1 -- 172.21.15.49:0/3538113237 wait complete. 2024-01-31T05:04:42.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b1aa00640 1 Processor -- start 2024-01-31T05:04:42.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b1aa00640 1 -- start start 2024-01-31T05:04:42.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b1aa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b140cd0c0 0x7f8b1414fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:42.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b1aa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b140cde80 0x7f8b14151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:42.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b1aa00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b140cf0f0 0x7f8b141535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:42.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b1aa00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b14159390 con 0x7f8b140cd0c0 2024-01-31T05:04:42.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b1aa00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b140c5930 con 0x7f8b140cf0f0 2024-01-31T05:04:42.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b1aa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b14150580 con 0x7f8b140cde80 2024-01-31T05:04:42.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b13e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b140cd0c0 0x7f8b1414fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:42.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b13e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b140cd0c0 0x7f8b1414fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38428/0 (socket says 172.21.15.49:38428) 2024-01-31T05:04:42.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b13e00640 1 -- 172.21.15.49:0/3972509173 learned_addr learned my addr 172.21.15.49:0/3972509173 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:42.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b13400640 1 --2- 172.21.15.49:0/3972509173 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b140cde80 0x7f8b14151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:42.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b18a00640 1 --2- 172.21.15.49:0/3972509173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b140cf0f0 0x7f8b141535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:42.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b13e00640 1 -- 172.21.15.49:0/3972509173 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b140cde80 msgr2=0x7f8b14151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:42.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b13e00640 1 --2- 172.21.15.49:0/3972509173 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b140cde80 0x7f8b14151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b13e00640 1 -- 172.21.15.49:0/3972509173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b140cf0f0 msgr2=0x7f8b141535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:42.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b13e00640 1 --2- 172.21.15.49:0/3972509173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b140cf0f0 0x7f8b141535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b13e00640 1 -- 172.21.15.49:0/3972509173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c009b30 con 0x7f8b140cd0c0 2024-01-31T05:04:42.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.739+0000 7f8b13e00640 1 --2- 172.21.15.49:0/3972509173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b140cd0c0 0x7f8b1414fcd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400c420 tx=0x7f8b0400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:42.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.743+0000 7f8b0be00640 1 -- 172.21.15.49:0/3972509173 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b040052d0 con 0x7f8b140cd0c0 2024-01-31T05:04:42.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.743+0000 7f8b0be00640 1 -- 172.21.15.49:0/3972509173 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b04005430 con 0x7f8b140cd0c0 2024-01-31T05:04:42.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.743+0000 7f8b0be00640 1 -- 172.21.15.49:0/3972509173 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b04007260 con 0x7f8b140cd0c0 2024-01-31T05:04:42.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.743+0000 7f8b1aa00640 1 -- 172.21.15.49:0/3972509173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b14152040 con 0x7f8b140cd0c0 2024-01-31T05:04:42.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.743+0000 7f8b1aa00640 1 -- 172.21.15.49:0/3972509173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b14158cd0 con 0x7f8b140cd0c0 2024-01-31T05:04:42.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.743+0000 7f8b1aa00640 1 -- 172.21.15.49:0/3972509173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b14074860 con 0x7f8b140cd0c0 2024-01-31T05:04:42.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.743+0000 7f8b0be00640 1 -- 172.21.15.49:0/3972509173 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f8b040073c0 con 0x7f8b140cd0c0 2024-01-31T05:04:42.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.743+0000 7f8b0be00640 1 --2- 172.21.15.49:0/3972509173 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8aec066500 0x7f8aec0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:42.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.743+0000 7f8b0be00640 1 -- 172.21.15.49:0/3972509173 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8b04083590 con 0x7f8b140cd0c0 2024-01-31T05:04:42.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.743+0000 7f8b13400640 1 --2- 172.21.15.49:0/3972509173 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8aec066500 0x7f8aec0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:42.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.747+0000 7f8b13400640 1 --2- 172.21.15.49:0/3972509173 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8aec066500 0x7f8aec0689c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8b141563e0 tx=0x7f8afc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:42.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.747+0000 7f8b0be00640 1 -- 172.21.15.49:0/3972509173 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f8b04050550 con 0x7f8b140cd0c0 2024-01-31T05:04:42.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.911+0000 7f8b1aa00640 1 -- 172.21.15.49:0/3972509173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b1406b4e0 con 0x7f8b140cd0c0 2024-01-31T05:04:42.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.911+0000 7f8b0be00640 1 -- 172.21.15.49:0/3972509173 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18323 (secure 0 0 0) 0x7f8b04053b70 con 0x7f8b140cd0c0 2024-01-31T05:04:42.914 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:42.914 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:20.695841+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:04:42.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.915+0000 7f8b1aa00640 1 -- 172.21.15.49:0/3972509173 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8aec066500 msgr2=0x7f8aec0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:42.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.915+0000 7f8b1aa00640 1 --2- 172.21.15.49:0/3972509173 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8aec066500 0x7f8aec0689c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8b141563e0 tx=0x7f8afc008040 comp rx=0 tx=0).stop 2024-01-31T05:04:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.915+0000 7f8b1aa00640 1 -- 172.21.15.49:0/3972509173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b140cd0c0 msgr2=0x7f8b1414fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.915+0000 7f8b1aa00640 1 --2- 172.21.15.49:0/3972509173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b140cd0c0 0x7f8b1414fcd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400c420 tx=0x7f8b0400c8e0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.915+0000 7f8b1aa00640 1 -- 172.21.15.49:0/3972509173 shutdown_connections 2024-01-31T05:04:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.915+0000 7f8b1aa00640 1 --2- 172.21.15.49:0/3972509173 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8aec066500 0x7f8aec0689c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.915+0000 7f8b1aa00640 1 --2- 172.21.15.49:0/3972509173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b140cf0f0 0x7f8b141535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.915+0000 7f8b1aa00640 1 --2- 172.21.15.49:0/3972509173 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b140cde80 0x7f8b14151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.915+0000 7f8b1aa00640 1 --2- 172.21.15.49:0/3972509173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b140cd0c0 0x7f8b1414fcd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.915+0000 7f8b1aa00640 1 -- 172.21.15.49:0/3972509173 >> 172.21.15.49:0/3972509173 conn(0x7f8b140d0ef0 msgr2=0x7f8b1406f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.915+0000 7f8b1aa00640 1 -- 172.21.15.49:0/3972509173 shutdown_connections 2024-01-31T05:04:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:42.915+0000 7f8b1aa00640 1 -- 172.21.15.49:0/3972509173 wait complete. 2024-01-31T05:04:42.937 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-31T05:04:42.937 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-31T05:04:42.938 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-31T05:04:42.938 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-31T05:04:42.938 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-31T05:04:42.939 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-31T05:04:42.939 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-31T05:04:42.939 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-31T05:04:43.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.179+0000 7f60db800640 1 Processor -- start 2024-01-31T05:04:43.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.179+0000 7f60db800640 1 -- start start 2024-01-31T05:04:43.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.183+0000 7f60db800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60d415d910 0x7f60d406c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.183+0000 7f60db800640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d406dd50 con 0x7f60d40b1ca0 2024-01-31T05:04:43.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.183+0000 7f60db800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d40ae6e0 con 0x7f60d40705d0 2024-01-31T05:04:43.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.183+0000 7f60db800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d40b3e40 con 0x7f60d415d910 2024-01-31T05:04:43.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.183+0000 7f60d8e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f60d40705d0 0x7f60d415a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:50462/0 (socket says 172.21.15.49:50462) 2024-01-31T05:04:43.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.183+0000 7f60d8e00640 1 -- 172.21.15.49:0/2835224070 learned_addr learned my addr 172.21.15.49:0/2835224070 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:43.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.183+0000 7f60d9800640 1 --2- 172.21.15.49:0/2835224070 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60d415d910 0x7f60d406c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.183+0000 7f60d3400640 1 -- 172.21.15.49:0/2835224070 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842002051 0 0) 0x7f60d40ae6e0 con 0x7f60d40705d0 2024-01-31T05:04:43.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.183+0000 7f60d3400640 1 -- 172.21.15.49:0/2835224070 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60b4003530 con 0x7f60d40705d0 2024-01-31T05:04:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.183+0000 7f60d9800640 1 -- 172.21.15.49:0/2835224070 >> v1:172.21.15.195:6789/0 conn(0x7f60d40705d0 legacy=0x7f60d415a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.183+0000 7f60d9800640 1 -- 172.21.15.49:0/2835224070 >> v1:172.21.15.49:6789/0 conn(0x7f60d40b1ca0 legacy=0x7f60d40709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.183+0000 7f60d9800640 1 -- 172.21.15.49:0/2835224070 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d40b38a0 con 0x7f60d415d910 2024-01-31T05:04:43.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.187+0000 7fb75c400640 1 Processor -- start 2024-01-31T05:04:43.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.187+0000 7fa28fc00640 1 Processor -- start 2024-01-31T05:04:43.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.187+0000 7fb75c400640 1 -- start start 2024-01-31T05:04:43.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.187+0000 7fa28fc00640 1 -- start start 2024-01-31T05:04:43.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7f60d9800640 1 --2- 172.21.15.49:0/2835224070 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60d415d910 0x7f60d406c2d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f60d40b3a90 tx=0x7f60cc01da60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=342918a49b7e05da server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7fa28fc00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa2880ce110 0x7fa2880ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7fa28fc00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2880ceaa0 con 0x7fa2880b1680 2024-01-31T05:04:43.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7fa28fc00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa288071230 con 0x7fa288156f40 2024-01-31T05:04:43.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7fa28fc00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa28806dd20 con 0x7fa2880ce110 2024-01-31T05:04:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7f60d3400640 1 -- 172.21.15.49:0/2835224070 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc0a68c0 con 0x7f60d415d910 2024-01-31T05:04:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7f60d3400640 1 -- 172.21.15.49:0/2835224070 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60cc0a6a20 con 0x7f60d415d910 2024-01-31T05:04:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7f60d3400640 1 -- 172.21.15.49:0/2835224070 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc0a6db0 con 0x7f60d415d910 2024-01-31T05:04:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7fa287e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fa288156f40 0x7fa28806cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:50472/0 (socket says 172.21.15.49:50472) 2024-01-31T05:04:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7fa287e00640 1 -- 172.21.15.49:0/69731341 learned_addr learned my addr 172.21.15.49:0/69731341 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:43.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7fb75c400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb7540ce550 0x7fb754144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7f92c1e00640 1 Processor -- start 2024-01-31T05:04:43.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7f92c1e00640 1 -- start start 2024-01-31T05:04:43.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7fa287400640 1 -- 172.21.15.49:0/69731341 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883341069 0 0) 0x7fa270001050 con 0x7fa2880b1680 2024-01-31T05:04:43.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7fa287400640 1 -- 172.21.15.49:0/69731341 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa268003530 con 0x7fa2880b1680 2024-01-31T05:04:43.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7f60db800640 1 -- 172.21.15.49:0/2835224070 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60d415d910 msgr2=0x7f60d406c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7f60db800640 1 --2- 172.21.15.49:0/2835224070 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60d415d910 0x7f60d406c2d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f60d40b3a90 tx=0x7f60cc01da60 comp rx=0 tx=0).stop 2024-01-31T05:04:43.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7fa287400640 1 -- 172.21.15.49:0/69731341 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3022676105 0 0) 0x7fa268003530 con 0x7fa2880b1680 2024-01-31T05:04:43.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7fa287400640 1 -- 172.21.15.49:0/69731341 >> v2:172.21.15.195:3300/0 conn(0x7fa2880ce110 msgr2=0x7fa2880ce560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-31T05:04:43.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7fa287400640 1 --2- 172.21.15.49:0/69731341 >> v2:172.21.15.195:3300/0 conn(0x7fa2880ce110 0x7fa2880ce560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7fa287400640 1 -- 172.21.15.49:0/69731341 >> v1:172.21.15.195:6789/0 conn(0x7fa288156f40 legacy=0x7fa28806cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7fa287400640 1 -- 172.21.15.49:0/69731341 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28806da40 con 0x7fa2880b1680 2024-01-31T05:04:43.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7fa287400640 1 -- 172.21.15.49:0/69731341 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7fa270001740 con 0x7fa2880b1680 2024-01-31T05:04:43.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7fa287400640 1 -- 172.21.15.49:0/69731341 >> v1:172.21.15.49:6789/0 conn(0x7fa2880b1680 legacy=0x7fa2880b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7fa287400640 1 --2- 172.21.15.49:0/69731341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa268003980 0x7fa268003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fa287400640 1 --2- 172.21.15.49:0/69731341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2680047d0 0x7fa268004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fa287400640 1 --2- 172.21.15.49:0/69731341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2680052b0 0x7fa26800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fa287400640 1 -- 172.21.15.49:0/69731341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28806dd20 con 0x7fa2680052b0 2024-01-31T05:04:43.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fa287400640 1 -- 172.21.15.49:0/69731341 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26800c180 con 0x7fa268003980 2024-01-31T05:04:43.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fa287400640 1 -- 172.21.15.49:0/69731341 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26800c340 con 0x7fa2680047d0 2024-01-31T05:04:43.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.191+0000 7fb759000640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb7540ce930 0x7fb754070560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57750/0 (socket says 172.21.15.49:57750) 2024-01-31T05:04:43.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fb759a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb7540ce550 0x7fb754144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fb759a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb7540ce550 0x7fb754144dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41460/0 (socket says 172.21.15.49:41460) 2024-01-31T05:04:43.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fb759000640 1 -- 172.21.15.49:0/4147701564 learned_addr learned my addr 172.21.15.49:0/4147701564 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:43.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fb75c400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75406c740 con 0x7fb7540ce930 2024-01-31T05:04:43.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fb75c400640 1 -- 172.21.15.49:0/4147701564 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb754145310 con 0x7fb754070c70 2024-01-31T05:04:43.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fa28d200640 1 --2- 172.21.15.49:0/69731341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa268003980 0x7fa268003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fb75c400640 1 -- 172.21.15.49:0/4147701564 --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7541660f0 con 0x7fb7540ce550 2024-01-31T05:04:43.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fa287e00640 1 --2- 172.21.15.49:0/69731341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2680047d0 0x7fa268004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fa28dc00640 1 --2- 172.21.15.49:0/69731341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2680052b0 0x7fa26800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fc1d6c00640 1 Processor -- start 2024-01-31T05:04:43.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7f60db800640 1 -- 172.21.15.49:0/2835224070 shutdown_connections 2024-01-31T05:04:43.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7f60db800640 1 --2- 172.21.15.49:0/2835224070 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60d415d910 0x7f60d406c2d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7f60db800640 1 -- 172.21.15.49:0/2835224070 >> 172.21.15.49:0/2835224070 conn(0x7f60d40b09a0 msgr2=0x7f60d40b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fb753e00640 1 -- 172.21.15.49:0/4147701564 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205795287 0 0) 0x7fb75406c740 con 0x7fb7540ce930 2024-01-31T05:04:43.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fb753e00640 1 -- 172.21.15.49:0/4147701564 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb734003530 con 0x7fb7540ce930 2024-01-31T05:04:43.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fb753e00640 1 -- 172.21.15.49:0/4147701564 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937524395 0 0) 0x7fb754145310 con 0x7fb754070c70 2024-01-31T05:04:43.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fb753e00640 1 -- 172.21.15.49:0/4147701564 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb75406c740 con 0x7fb754070c70 2024-01-31T05:04:43.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fca89e00640 1 Processor -- start 2024-01-31T05:04:43.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fc1d6c00640 1 -- start start 2024-01-31T05:04:43.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7f92c1e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f92bc15f2d0 0x7f92bc072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7f92c1e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f92bc0b33a0 0x7f92bc0b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7f92c1e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92bc0b1ef0 con 0x7f92bc06c100 2024-01-31T05:04:43.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7f92c1e00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92bc0b3d70 con 0x7f92bc0b33a0 2024-01-31T05:04:43.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7f92c1e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92bc0b1bc0 con 0x7f92bc15f2d0 2024-01-31T05:04:43.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7f92c0a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f92bc15f2d0 0x7f92bc072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7f92bbe00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f92bc06c100 0x7f92bc161d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:50496/0 (socket says 172.21.15.49:50496) 2024-01-31T05:04:43.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7f92c0a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f92bc15f2d0 0x7f92bc072180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41478/0 (socket says 172.21.15.49:41478) 2024-01-31T05:04:43.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7f92bbe00640 1 -- 172.21.15.49:0/1694189904 learned_addr learned my addr 172.21.15.49:0/1694189904 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:43.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7f92c1400640 1 --2- 172.21.15.49:0/1694189904 >> v2:172.21.15.49:3300/0 conn(0x7f92bc0b33a0 0x7f92bc0b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7f92c0a00640 1 -- 172.21.15.49:0/1694189904 >> v2:172.21.15.49:3300/0 conn(0x7f92bc0b33a0 msgr2=0x7f92bc0b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7f92c0a00640 1 --2- 172.21.15.49:0/1694189904 >> v2:172.21.15.49:3300/0 conn(0x7f92bc0b33a0 0x7f92bc0b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7f92c0a00640 1 -- 172.21.15.49:0/1694189904 >> v1:172.21.15.195:6789/0 conn(0x7f92bc06c100 legacy=0x7f92bc161d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7f92c0a00640 1 -- 172.21.15.49:0/1694189904 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc1625a0 con 0x7f92bc15f2d0 2024-01-31T05:04:43.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fa287e00640 1 -- 172.21.15.49:0/69731341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa268003980 msgr2=0x7fa268003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fa287e00640 1 --2- 172.21.15.49:0/69731341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa268003980 0x7fa268003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fa287e00640 1 -- 172.21.15.49:0/69731341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2680052b0 msgr2=0x7fa26800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fa287e00640 1 --2- 172.21.15.49:0/69731341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2680052b0 0x7fa26800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fa287e00640 1 -- 172.21.15.49:0/69731341 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28806da40 con 0x7fa2680047d0 2024-01-31T05:04:43.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fa28dc00640 1 -- 172.21.15.49:0/69731341 reap_dead start 2024-01-31T05:04:43.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fc1d6c00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc1d015f4e0 0x7fc1d00ade10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fc1d6c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc1d00b3650 0x7fc1d015f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fc1d6c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d00b0430 con 0x7fc1d015fe00 2024-01-31T05:04:43.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fc1d6c00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d00d01f0 con 0x7fc1d015f4e0 2024-01-31T05:04:43.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fc1d6c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d00cfc30 con 0x7fc1d00b3650 2024-01-31T05:04:43.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fb759a00640 1 -- 172.21.15.49:0/4147701564 >> v1:172.21.15.195:6789/0 conn(0x7fb754070c70 legacy=0x7fb754165380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fb759a00640 1 -- 172.21.15.49:0/4147701564 >> v1:172.21.15.49:6789/0 conn(0x7fb7540ce930 legacy=0x7fb754070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.195+0000 7fb759a00640 1 -- 172.21.15.49:0/4147701564 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75406c990 con 0x7fb7540ce550 2024-01-31T05:04:43.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7f60db800640 1 -- 172.21.15.49:0/2835224070 shutdown_connections 2024-01-31T05:04:43.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fc1cfe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc1d015f4e0 0x7fc1d00ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fc1cfe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc1d015f4e0 0x7fc1d00ade10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38456/0 (socket says 172.21.15.49:38456) 2024-01-31T05:04:43.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fc1cfe00640 1 -- 172.21.15.49:0/197635891 learned_addr learned my addr 172.21.15.49:0/197635891 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fc1cf400640 1 --2- 172.21.15.49:0/197635891 >> v2:172.21.15.195:3300/0 conn(0x7fc1d00b3650 0x7fc1d015f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fc1cea00640 1 -- 172.21.15.49:0/197635891 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099095202 0 0) 0x7fc1d00b0430 con 0x7fc1d015fe00 2024-01-31T05:04:43.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fc1cea00640 1 -- 172.21.15.49:0/197635891 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1b0003530 con 0x7fc1d015fe00 2024-01-31T05:04:43.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fc1cfe00640 1 -- 172.21.15.49:0/197635891 >> v2:172.21.15.195:3300/0 conn(0x7fc1d00b3650 msgr2=0x7fc1d015f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fc1cfe00640 1 --2- 172.21.15.49:0/197635891 >> v2:172.21.15.195:3300/0 conn(0x7fc1d00b3650 0x7fc1d015f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fc1cfe00640 1 -- 172.21.15.49:0/197635891 >> v1:172.21.15.195:6789/0 conn(0x7fc1d015fe00 legacy=0x7fc1d015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fc1cfe00640 1 -- 172.21.15.49:0/197635891 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d00cbd10 con 0x7fc1d015f4e0 2024-01-31T05:04:43.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7f60db800640 1 -- 172.21.15.49:0/2835224070 wait complete. 2024-01-31T05:04:43.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fca89e00640 1 -- start start 2024-01-31T05:04:43.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fa287e00640 1 --2- 172.21.15.49:0/69731341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2680047d0 0x7fa268004c50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa278001930 tx=0x7fa27801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a6c75d423a73047 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fa287400640 1 -- 172.21.15.49:0/69731341 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa278005ae0 con 0x7fa2680047d0 2024-01-31T05:04:43.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fb759a00640 1 --2- 172.21.15.49:0/4147701564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7540ce550 0x7fb754144dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb7440097c0 tx=0x7fb74401c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85f342edb3933618 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fa287400640 1 -- 172.21.15.49:0/69731341 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2780a7070 con 0x7fa2680047d0 2024-01-31T05:04:43.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fa287400640 1 -- 172.21.15.49:0/69731341 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa278005e80 con 0x7fa2680047d0 2024-01-31T05:04:43.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7f60db800640 1 Processor -- start 2024-01-31T05:04:43.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fb753e00640 1 -- 172.21.15.49:0/4147701564 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440ab600 con 0x7fb7540ce550 2024-01-31T05:04:43.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fb753e00640 1 -- 172.21.15.49:0/4147701564 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7440a7050 con 0x7fb7540ce550 2024-01-31T05:04:43.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fb753e00640 1 -- 172.21.15.49:0/4147701564 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440ab980 con 0x7fb7540ce550 2024-01-31T05:04:43.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fca89e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fca8406cfc0 0x7fca8406d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fca89e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fca840ce110 0x7fca840ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fca89e00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca84071230 con 0x7fca84156f40 2024-01-31T05:04:43.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fca89e00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8406dd20 con 0x7fca8406cfc0 2024-01-31T05:04:43.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.199+0000 7fca89e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca840ceac0 con 0x7fca840ce110 2024-01-31T05:04:43.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fa28fc00640 1 -- 172.21.15.49:0/69731341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2680047d0 msgr2=0x7fa268004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fa28fc00640 1 --2- 172.21.15.49:0/69731341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2680047d0 0x7fa268004c50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa278001930 tx=0x7fa27801c560 comp rx=0 tx=0).stop 2024-01-31T05:04:43.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7f92c0a00640 1 --2- 172.21.15.49:0/1694189904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92bc15f2d0 0x7f92bc072180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f92bc067410 tx=0x7f92a401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=869d3665dc49ff76 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fca82a00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fca84156f40 0x7fca840b2250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57762/0 (socket says 172.21.15.49:57762) 2024-01-31T05:04:43.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fca83400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fca840ce110 0x7fca840ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fca82a00640 1 -- 172.21.15.49:0/2123213215 learned_addr learned my addr 172.21.15.49:0/2123213215 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:43.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fca83400640 1 --2- 172.21.15.49:0/2123213215 >> v2:172.21.15.195:3300/0 conn(0x7fca840ce110 0x7fca840ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41490/0 (socket says 172.21.15.49:41490) 2024-01-31T05:04:43.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fb75c400640 1 -- 172.21.15.49:0/4147701564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7540ce550 msgr2=0x7fb754144dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fb75c400640 1 --2- 172.21.15.49:0/4147701564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7540ce550 0x7fb754144dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb7440097c0 tx=0x7fb74401c380 comp rx=0 tx=0).stop 2024-01-31T05:04:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fca82000640 1 --2- 172.21.15.49:0/2123213215 >> v2:172.21.15.49:3300/0 conn(0x7fca8406cfc0 0x7fca8406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7f92bb400640 1 -- 172.21.15.49:0/1694189904 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a40ac600 con 0x7f92bc15f2d0 2024-01-31T05:04:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7f92bb400640 1 -- 172.21.15.49:0/1694189904 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a40a8050 con 0x7f92bc15f2d0 2024-01-31T05:04:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7f92bb400640 1 -- 172.21.15.49:0/1694189904 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a40ac980 con 0x7f92bc15f2d0 2024-01-31T05:04:43.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fc1cfe00640 1 --2- 172.21.15.49:0/197635891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d015f4e0 0x7fc1d00ade10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00b0070 tx=0x7fc1c001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759d7bcc95e12f80 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fca83400640 1 -- 172.21.15.49:0/2123213215 >> v2:172.21.15.49:3300/0 conn(0x7fca8406cfc0 msgr2=0x7fca8406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fca83400640 1 --2- 172.21.15.49:0/2123213215 >> v2:172.21.15.49:3300/0 conn(0x7fca8406cfc0 0x7fca8406d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fca83400640 1 -- 172.21.15.49:0/2123213215 >> v1:172.21.15.49:6789/0 conn(0x7fca84156f40 legacy=0x7fca840b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fca81600640 1 -- 172.21.15.49:0/2123213215 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418751307 0 0) 0x7fca84071230 con 0x7fca84156f40 2024-01-31T05:04:43.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fca83400640 1 -- 172.21.15.49:0/2123213215 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8406da40 con 0x7fca840ce110 2024-01-31T05:04:43.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fc1cea00640 1 -- 172.21.15.49:0/197635891 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0004230 con 0x7fc1d015f4e0 2024-01-31T05:04:43.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fc1cea00640 1 -- 172.21.15.49:0/197635891 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c00a7050 con 0x7fc1d015f4e0 2024-01-31T05:04:43.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fc1cea00640 1 -- 172.21.15.49:0/197635891 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0003620 con 0x7fc1d015f4e0 2024-01-31T05:04:43.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7f92c1e00640 1 -- 172.21.15.49:0/1694189904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92bc15f2d0 msgr2=0x7f92bc072180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7f92c1e00640 1 --2- 172.21.15.49:0/1694189904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92bc15f2d0 0x7f92bc072180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f92bc067410 tx=0x7f92a401c3a0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7ff615800640 1 Processor -- start 2024-01-31T05:04:43.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7ff615800640 1 -- start start 2024-01-31T05:04:43.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7f92c1e00640 1 -- 172.21.15.49:0/1694189904 shutdown_connections 2024-01-31T05:04:43.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7f92c1e00640 1 --2- 172.21.15.49:0/1694189904 >> v2:172.21.15.49:3300/0 conn(0x7f92bc0b33a0 0x7f92bc0b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7f92c1e00640 1 --2- 172.21.15.49:0/1694189904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92bc15f2d0 0x7f92bc072180 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7f92c1e00640 1 -- 172.21.15.49:0/1694189904 >> 172.21.15.49:0/1694189904 conn(0x7f92bc06a770 msgr2=0x7f92bc06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7ff615800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff61014b350 0x7ff6100b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7ff615800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff61006d440 0x7ff6100cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7ff615800640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6100709f0 con 0x7ff6100b2670 2024-01-31T05:04:43.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7ff615800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6100b3920 con 0x7ff61006d440 2024-01-31T05:04:43.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7ff615800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6100b2ca0 con 0x7ff61014b350 2024-01-31T05:04:43.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7f60db800640 1 -- start start 2024-01-31T05:04:43.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7f60db800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60d40705d0 0x7f60d41551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7f60db800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60d40b1ca0 0x7f60d40ad170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7f60db800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60d415d910 0x7f60d4155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7f60db800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d41556e0 con 0x7f60d40705d0 2024-01-31T05:04:43.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7f60db800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d4154100 con 0x7f60d415d910 2024-01-31T05:04:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7f60db800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d41543e0 con 0x7f60d40b1ca0 2024-01-31T05:04:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fc1d6c00640 1 -- 172.21.15.49:0/197635891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d015f4e0 msgr2=0x7fc1d00ade10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fc1d6c00640 1 --2- 172.21.15.49:0/197635891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d015f4e0 0x7fc1d00ade10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00b0070 tx=0x7fc1c001c440 comp rx=0 tx=0).stop 2024-01-31T05:04:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7f92c1e00640 1 -- 172.21.15.49:0/1694189904 shutdown_connections 2024-01-31T05:04:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7f92c1e00640 1 -- 172.21.15.49:0/1694189904 wait complete. 2024-01-31T05:04:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7ff60f400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff61006d440 0x7ff6100cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7ff60f400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff61006d440 0x7ff6100cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41500/0 (socket says 172.21.15.49:41500) 2024-01-31T05:04:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7ff60f400640 1 -- 172.21.15.49:0/1198750914 learned_addr learned my addr 172.21.15.49:0/1198750914 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7ff60ea00640 1 --2- 172.21.15.49:0/1198750914 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff61014b350 0x7ff6100b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7fb75c400640 1 -- 172.21.15.49:0/4147701564 shutdown_connections 2024-01-31T05:04:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7f60d3e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60d40b1ca0 0x7f60d40ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7f60d3e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60d40b1ca0 0x7f60d40ad170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:52884/0 (socket says 172.21.15.49:52884) 2024-01-31T05:04:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7f60d3e00640 1 -- 172.21.15.49:0/3426964932 learned_addr learned my addr 172.21.15.49:0/3426964932 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7fb75c400640 1 --2- 172.21.15.49:0/4147701564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7540ce550 0x7fb754144dd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7fb75c400640 1 -- 172.21.15.49:0/4147701564 >> 172.21.15.49:0/4147701564 conn(0x7fb75406ad70 msgr2=0x7fb7540b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7f60d9800640 1 --2- 172.21.15.49:0/3426964932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60d415d910 0x7f60d4155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7f60d8e00640 1 --2- 172.21.15.49:0/3426964932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60d40705d0 0x7f60d41551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7ff60f400640 1 -- 172.21.15.49:0/1198750914 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff61014b350 msgr2=0x7ff6100b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7ff60f400640 1 --2- 172.21.15.49:0/1198750914 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff61014b350 0x7ff6100b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7ff60f400640 1 -- 172.21.15.49:0/1198750914 >> v1:172.21.15.49:6789/0 conn(0x7ff6100b2670 legacy=0x7ff61006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7ff60f400640 1 -- 172.21.15.49:0/1198750914 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6100b2f80 con 0x7ff61006d440 2024-01-31T05:04:43.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fa28fc00640 1 -- 172.21.15.49:0/69731341 shutdown_connections 2024-01-31T05:04:43.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fa28fc00640 1 --2- 172.21.15.49:0/69731341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2680047d0 0x7fa268004c50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fa28fc00640 1 -- 172.21.15.49:0/69731341 >> 172.21.15.49:0/69731341 conn(0x7fa2880b0b60 msgr2=0x7fa2880b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fa28fc00640 1 -- 172.21.15.49:0/69731341 shutdown_connections 2024-01-31T05:04:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.203+0000 7fa28fc00640 1 -- 172.21.15.49:0/69731341 wait complete. 2024-01-31T05:04:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7fa28fc00640 1 Processor -- start 2024-01-31T05:04:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7f60d9800640 1 -- 172.21.15.49:0/3426964932 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60d40b1ca0 msgr2=0x7f60d40ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7f60d9800640 1 --2- 172.21.15.49:0/3426964932 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60d40b1ca0 0x7f60d40ad170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7f60d9800640 1 -- 172.21.15.49:0/3426964932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60d40705d0 msgr2=0x7f60d41551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7f60d9800640 1 --2- 172.21.15.49:0/3426964932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60d40705d0 0x7f60d41551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7f60d9800640 1 -- 172.21.15.49:0/3426964932 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc00d040 con 0x7f60d415d910 2024-01-31T05:04:43.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7fa28fc00640 1 -- start start 2024-01-31T05:04:43.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7f92c1e00640 1 Processor -- start 2024-01-31T05:04:43.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7f60d9800640 1 --2- 172.21.15.49:0/3426964932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60d415d910 0x7f60d4155cf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f60d406df00 tx=0x7f60cc01a800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7f60d0c00640 1 -- 172.21.15.49:0/3426964932 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc0ae850 con 0x7f60d415d910 2024-01-31T05:04:43.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7f60d0c00640 1 -- 172.21.15.49:0/3426964932 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60cc0ae9b0 con 0x7f60d415d910 2024-01-31T05:04:43.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7f60d0c00640 1 -- 172.21.15.49:0/3426964932 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc0aed60 con 0x7f60d415d910 2024-01-31T05:04:43.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7f60db800640 1 -- 172.21.15.49:0/3426964932 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d41546c0 con 0x7f60d415d910 2024-01-31T05:04:43.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7fb75c400640 1 -- 172.21.15.49:0/4147701564 shutdown_connections 2024-01-31T05:04:43.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7fb75c400640 1 -- 172.21.15.49:0/4147701564 wait complete. 2024-01-31T05:04:43.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7f60db800640 1 -- 172.21.15.49:0/3426964932 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d4154c80 con 0x7f60d415d910 2024-01-31T05:04:43.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7f92c1e00640 1 -- start start 2024-01-31T05:04:43.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7fa28fc00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2680047d0 0x7fa288159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7fa28fc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa288154540 0x7fa28815c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.207+0000 7f92c1e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92bc06c100 0x7f92bc145970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f92c1e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92bc0b33a0 0x7f92bc144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f92c1e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92bc15f2d0 0x7f92bc09bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa28d200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2680047d0 0x7fa288159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa28fc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa288155f50 0x7fa2881563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa28fc00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa288200130 con 0x7fa2680047d0 2024-01-31T05:04:43.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa28d200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2680047d0 0x7fa288159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38472/0 (socket says 172.21.15.49:38472) 2024-01-31T05:04:43.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa28d200640 1 -- 172.21.15.49:0/1348171785 learned_addr learned my addr 172.21.15.49:0/1348171785 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f92bbe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92bc0b33a0 0x7f92bc144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f92bbe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92bc0b33a0 0x7f92bc144df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:52898/0 (socket says 172.21.15.49:52898) 2024-01-31T05:04:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f92bbe00640 1 -- 172.21.15.49:0/1632692679 learned_addr learned my addr 172.21.15.49:0/1632692679 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa287e00640 1 --2- 172.21.15.49:0/1348171785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa288154540 0x7fa28815c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa28fc00640 1 -- 172.21.15.49:0/1348171785 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2882003f0 con 0x7fa288154540 2024-01-31T05:04:43.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa28fc00640 1 -- 172.21.15.49:0/1348171785 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2882006d0 con 0x7fa288155f50 2024-01-31T05:04:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f92c1400640 1 --2- 172.21.15.49:0/1632692679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92bc15f2d0 0x7f92bc09bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f92c1e00640 1 -- 172.21.15.49:0/1632692679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc09c640 con 0x7f92bc15f2d0 2024-01-31T05:04:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f92c1e00640 1 -- 172.21.15.49:0/1632692679 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc158c40 con 0x7f92bc06c100 2024-01-31T05:04:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f92c1e00640 1 -- 172.21.15.49:0/1632692679 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc158f20 con 0x7f92bc0b33a0 2024-01-31T05:04:43.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fc1d6c00640 1 -- 172.21.15.49:0/197635891 shutdown_connections 2024-01-31T05:04:43.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fc1d6c00640 1 --2- 172.21.15.49:0/197635891 >> v2:172.21.15.195:3300/0 conn(0x7fc1d00b3650 0x7fc1d015f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fc1d6c00640 1 --2- 172.21.15.49:0/197635891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d015f4e0 0x7fc1d00ade10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fc1d6c00640 1 -- 172.21.15.49:0/197635891 >> 172.21.15.49:0/197635891 conn(0x7fc1d00b2b30 msgr2=0x7fc1d00b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f92c0a00640 1 --2- 172.21.15.49:0/1632692679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92bc06c100 0x7f92bc145970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa28dc00640 1 --2- 172.21.15.49:0/1348171785 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa288155f50 0x7fa2881563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa28d200640 1 -- 172.21.15.49:0/1348171785 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa288155f50 msgr2=0x7fa2881563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa28d200640 1 --2- 172.21.15.49:0/1348171785 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa288155f50 0x7fa2881563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa28d200640 1 -- 172.21.15.49:0/1348171785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa288154540 msgr2=0x7fa28815c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa28d200640 1 --2- 172.21.15.49:0/1348171785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa288154540 0x7fa28815c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa28d200640 1 -- 172.21.15.49:0/1348171785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2882009b0 con 0x7fa2680047d0 2024-01-31T05:04:43.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f60db800640 1 -- 172.21.15.49:0/3426964932 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60d41670a0 con 0x7f60d415d910 2024-01-31T05:04:43.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fc1d6c00640 1 -- 172.21.15.49:0/197635891 shutdown_connections 2024-01-31T05:04:43.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fc1d6c00640 1 -- 172.21.15.49:0/197635891 wait complete. 2024-01-31T05:04:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f2773000640 1 Processor -- start 2024-01-31T05:04:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f60d0c00640 1 -- 172.21.15.49:0/3426964932 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f60cc0b8400 con 0x7f60d415d910 2024-01-31T05:04:43.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f92c1400640 1 -- 172.21.15.49:0/1632692679 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92bc0b33a0 msgr2=0x7f92bc144df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f92c1400640 1 --2- 172.21.15.49:0/1632692679 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92bc0b33a0 0x7f92bc144df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f92c1400640 1 -- 172.21.15.49:0/1632692679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92bc06c100 msgr2=0x7f92bc145970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f92c1400640 1 --2- 172.21.15.49:0/1632692679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92bc06c100 0x7f92bc145970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa28d200640 1 --2- 172.21.15.49:0/1348171785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2680047d0 0x7fa288159000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa270011840 tx=0x7fa270011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f2773000640 1 -- start start 2024-01-31T05:04:43.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f92c1400640 1 -- 172.21.15.49:0/1632692679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a4009420 con 0x7f92bc15f2d0 2024-01-31T05:04:43.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f92c0a00640 1 --2- 172.21.15.49:0/1632692679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92bc06c100 0x7f92bc145970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:04:43.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f92bbe00640 1 --2- 172.21.15.49:0/1632692679 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f92bc0b33a0 0x7f92bc144df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:43.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa284c00640 1 -- 172.21.15.49:0/1348171785 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2700052e0 con 0x7fa2680047d0 2024-01-31T05:04:43.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa284c00640 1 -- 172.21.15.49:0/1348171785 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa270005440 con 0x7fa2680047d0 2024-01-31T05:04:43.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f92c1400640 1 --2- 172.21.15.49:0/1632692679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92bc15f2d0 0x7f92bc09bb40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f92b400efc0 tx=0x7f92b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fb75c400640 1 Processor -- start 2024-01-31T05:04:43.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa284c00640 1 -- 172.21.15.49:0/1348171785 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27000f9b0 con 0x7fa2680047d0 2024-01-31T05:04:43.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa28fc00640 1 -- 172.21.15.49:0/1348171785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa288200c90 con 0x7fa2680047d0 2024-01-31T05:04:43.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fa28fc00640 1 -- 172.21.15.49:0/1348171785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28815c580 con 0x7fa2680047d0 2024-01-31T05:04:43.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f92b8c00640 1 -- 172.21.15.49:0/1632692679 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4009b10 con 0x7f92bc15f2d0 2024-01-31T05:04:43.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fca83400640 1 --2- 172.21.15.49:0/2123213215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca840ce110 0x7fca840ce580 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fca84073330 tx=0x7fca6c020840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb57c17f8f66014e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fca81600640 1 -- 172.21.15.49:0/2123213215 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c0a9800 con 0x7fca840ce110 2024-01-31T05:04:43.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fca81600640 1 -- 172.21.15.49:0/2123213215 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c0a9960 con 0x7fca840ce110 2024-01-31T05:04:43.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7fca81600640 1 -- 172.21.15.49:0/2123213215 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c0a9cf0 con 0x7fca840ce110 2024-01-31T05:04:43.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f60d0c00640 1 --2- 172.21.15.49:0/3426964932 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f60ac0665d0 0x7f60ac068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f60d0c00640 1 -- 172.21.15.49:0/3426964932 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f60cc11e4a0 con 0x7f60d415d910 2024-01-31T05:04:43.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7ff60f400640 1 --2- 172.21.15.49:0/1198750914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff61006d440 0x7ff6100cb7d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff608009e50 tx=0x7ff60801c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=577f15bdd2dde345 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f60d0c00640 1 --2- 172.21.15.49:0/3426964932 >> [v2:172.21.15.49:6800/3804147802,v1:172.21.15.49:6801/3804147802] conn(0x7f60ac06fc10 0x7f60ac072050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f60d0c00640 1 -- 172.21.15.49:0/3426964932 --> [v2:172.21.15.49:6800/3804147802,v1:172.21.15.49:6801/3804147802] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f60ac072720 con 0x7f60ac06fc10 2024-01-31T05:04:43.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.211+0000 7f60d0c00640 1 -- 172.21.15.49:0/3426964932 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60cc120ac0 con 0x7f60d415d910 2024-01-31T05:04:43.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7ff60d600640 1 -- 172.21.15.49:0/1198750914 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6080a5740 con 0x7ff61006d440 2024-01-31T05:04:43.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7ff60d600640 1 -- 172.21.15.49:0/1198750914 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6080a58a0 con 0x7ff61006d440 2024-01-31T05:04:43.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7ff60d600640 1 -- 172.21.15.49:0/1198750914 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6080a5c30 con 0x7ff61006d440 2024-01-31T05:04:43.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7f60d3e00640 1 --2- 172.21.15.49:0/3426964932 >> [v2:172.21.15.49:6800/3804147802,v1:172.21.15.49:6801/3804147802] conn(0x7f60ac06fc10 0x7f60ac072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7f60d8e00640 1 --2- 172.21.15.49:0/3426964932 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f60ac0665d0 0x7f60ac068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7fa28fc00640 1 -- 172.21.15.49:0/1348171785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa288071a40 con 0x7fa2680047d0 2024-01-31T05:04:43.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7f92c1e00640 1 -- 172.21.15.49:0/1632692679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92bc159200 con 0x7f92bc15f2d0 2024-01-31T05:04:43.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7f92c1e00640 1 -- 172.21.15.49:0/1632692679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92bc157d20 con 0x7f92bc15f2d0 2024-01-31T05:04:43.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7f92b8c00640 1 -- 172.21.15.49:0/1632692679 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b400f040 con 0x7f92bc15f2d0 2024-01-31T05:04:43.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7f92b8c00640 1 -- 172.21.15.49:0/1632692679 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4009b10 con 0x7f92bc15f2d0 2024-01-31T05:04:43.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7f60d8e00640 1 --2- 172.21.15.49:0/3426964932 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f60ac0665d0 0x7f60ac068a90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f60c40049e0 tx=0x7f60c400b240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7f60d3e00640 1 --2- 172.21.15.49:0/3426964932 >> [v2:172.21.15.49:6800/3804147802,v1:172.21.15.49:6801/3804147802] conn(0x7f60ac06fc10 0x7f60ac072050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7f92c1e00640 1 -- 172.21.15.49:0/1632692679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f928c001040 con 0x7f92bc15f2d0 2024-01-31T05:04:43.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7f2773000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f276c0ce290 0x7f276c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7fb75c400640 1 -- start start 2024-01-31T05:04:43.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7fb75c400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb754070c70 0x7fb7541420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7fb75c400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7540ce550 0x7fb7541603a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7fb75c400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7540ce930 0x7fb7541637f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7fb75c400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75415ff10 con 0x7fb754070c70 2024-01-31T05:04:43.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7fb75c400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb754142600 con 0x7fb7540ce550 2024-01-31T05:04:43.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7fb75c400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75415f300 con 0x7fb7540ce930 2024-01-31T05:04:43.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7fb75a400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7540ce930 0x7fb7541637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7fb75a400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7540ce930 0x7fb7541637f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:52920/0 (socket says 172.21.15.49:52920) 2024-01-31T05:04:43.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7fb75a400640 1 -- 172.21.15.49:0/742655634 learned_addr learned my addr 172.21.15.49:0/742655634 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7fc1d6c00640 1 Processor -- start 2024-01-31T05:04:43.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7f2773000640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276c06c8c0 con 0x7f276c06dbc0 2024-01-31T05:04:43.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7f2773000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276c06cba0 con 0x7f276c156e40 2024-01-31T05:04:43.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7f2773000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f276c0ce810 con 0x7f276c0ce290 2024-01-31T05:04:43.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7f276b400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f276c0ce290 0x7f276c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7f276b400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f276c0ce290 0x7f276c06d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41534/0 (socket says 172.21.15.49:41534) 2024-01-31T05:04:43.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7f276b400640 1 -- 172.21.15.49:0/423563949 learned_addr learned my addr 172.21.15.49:0/423563949 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7fca89e00640 1 -- 172.21.15.49:0/2123213215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca840ce110 msgr2=0x7fca840ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7fca89e00640 1 --2- 172.21.15.49:0/2123213215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca840ce110 0x7fca840ce580 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fca84073330 tx=0x7fca6c020840 comp rx=0 tx=0).stop 2024-01-31T05:04:43.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7f276b400640 1 -- 172.21.15.49:0/423563949 >> v1:172.21.15.195:6789/0 conn(0x7f276c156e40 legacy=0x7f276c0b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7f276b400640 1 -- 172.21.15.49:0/423563949 >> v1:172.21.15.49:6789/0 conn(0x7f276c06dbc0 legacy=0x7f276c1598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7f276b400640 1 -- 172.21.15.49:0/423563949 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c06ce80 con 0x7f276c0ce290 2024-01-31T05:04:43.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7fb75a400640 1 -- 172.21.15.49:0/742655634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7540ce550 msgr2=0x7fb7541603a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-31T05:04:43.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7fb75a400640 1 --2- 172.21.15.49:0/742655634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7540ce550 0x7fb7541603a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7fb75a400640 1 -- 172.21.15.49:0/742655634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb754070c70 msgr2=0x7fb7541420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7fb75a400640 1 --2- 172.21.15.49:0/742655634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb754070c70 0x7fb7541420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fb75a400640 1 -- 172.21.15.49:0/742655634 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb744009420 con 0x7fb7540ce930 2024-01-31T05:04:43.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fb75a400640 1 --2- 172.21.15.49:0/742655634 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7540ce930 0x7fb7541637f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00c7b0 tx=0x7fb74c00cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7ff615800640 1 -- 172.21.15.49:0/1198750914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff61006d440 msgr2=0x7ff6100cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7ff615800640 1 --2- 172.21.15.49:0/1198750914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff61006d440 0x7ff6100cb7d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff608009e50 tx=0x7ff60801c9d0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fb751600640 1 -- 172.21.15.49:0/742655634 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c003db0 con 0x7fb7540ce930 2024-01-31T05:04:43.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fb751600640 1 -- 172.21.15.49:0/742655634 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74c005070 con 0x7fb7540ce930 2024-01-31T05:04:43.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fb751600640 1 -- 172.21.15.49:0/742655634 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c005400 con 0x7fb7540ce930 2024-01-31T05:04:43.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.215+0000 7fc1d6c00640 1 -- start start 2024-01-31T05:04:43.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fc1d6c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1d00b3650 0x7fc1d00b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fc1d6c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d015f4e0 0x7fc1d01555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fa284c00640 1 -- 172.21.15.49:0/1348171785 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa27000fb10 con 0x7fa2680047d0 2024-01-31T05:04:43.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7ff615800640 1 -- 172.21.15.49:0/1198750914 shutdown_connections 2024-01-31T05:04:43.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7ff615800640 1 --2- 172.21.15.49:0/1198750914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff61006d440 0x7ff6100cb7d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7ff615800640 1 --2- 172.21.15.49:0/1198750914 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff61014b350 0x7ff6100b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7ff615800640 1 -- 172.21.15.49:0/1198750914 >> 172.21.15.49:0/1198750914 conn(0x7ff6100b0b60 msgr2=0x7ff6100b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fc1cfe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1d00b3650 0x7fc1d00b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fc1cfe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1d00b3650 0x7fc1d00b60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:52932/0 (socket says 172.21.15.49:52932) 2024-01-31T05:04:43.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7f60d0c00640 1 -- 172.21.15.49:0/3426964932 <== osd.0 v2:172.21.15.49:6800/3804147802 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f60ac072720 con 0x7f60ac06fc10 2024-01-31T05:04:43.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7ff615800640 1 -- 172.21.15.49:0/1198750914 shutdown_connections 2024-01-31T05:04:43.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7ff615800640 1 -- 172.21.15.49:0/1198750914 wait complete. 2024-01-31T05:04:43.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7f92b8c00640 1 -- 172.21.15.49:0/1632692679 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f92b4014480 con 0x7f92bc15f2d0 2024-01-31T05:04:43.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fb75c400640 1 -- 172.21.15.49:0/742655634 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75415f5e0 con 0x7fb7540ce930 2024-01-31T05:04:43.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fca89e00640 1 -- 172.21.15.49:0/2123213215 shutdown_connections 2024-01-31T05:04:43.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fca89e00640 1 --2- 172.21.15.49:0/2123213215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca840ce110 0x7fca840ce580 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fb75c400640 1 -- 172.21.15.49:0/742655634 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75415fba0 con 0x7fb7540ce930 2024-01-31T05:04:43.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fca89e00640 1 --2- 172.21.15.49:0/2123213215 >> v2:172.21.15.49:3300/0 conn(0x7fca8406cfc0 0x7fca8406d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fca89e00640 1 -- 172.21.15.49:0/2123213215 >> 172.21.15.49:0/2123213215 conn(0x7fca840b0b60 msgr2=0x7fca840b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fa284c00640 1 --2- 172.21.15.49:0/1348171785 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa260066580 0x7fa260068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fc1d6c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1d015fe00 0x7fc1d01fa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fc1d6c00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0157c90 con 0x7fc1d015f4e0 2024-01-31T05:04:43.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fc1d6c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d01fb650 con 0x7fc1d015fe00 2024-01-31T05:04:43.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fc1d6c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d01fb090 con 0x7fc1d00b3650 2024-01-31T05:04:43.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fc1cfe00640 1 -- 172.21.15.49:0/731759673 learned_addr learned my addr 172.21.15.49:0/731759673 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fca89e00640 1 -- 172.21.15.49:0/2123213215 shutdown_connections 2024-01-31T05:04:43.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fa284c00640 1 -- 172.21.15.49:0/1348171785 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa270087620 con 0x7fa2680047d0 2024-01-31T05:04:43.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fa287e00640 1 --2- 172.21.15.49:0/1348171785 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa260066580 0x7fa260068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fa284c00640 1 --2- 172.21.15.49:0/1348171785 >> [v2:172.21.15.49:6824/659898319,v1:172.21.15.49:6825/659898319] conn(0x7fa26006fbc0 0x7fa260072000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fa284c00640 1 -- 172.21.15.49:0/1348171785 --> [v2:172.21.15.49:6824/659898319,v1:172.21.15.49:6825/659898319] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa2600726d0 con 0x7fa26006fbc0 2024-01-31T05:04:43.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fa284c00640 1 -- 172.21.15.49:0/1348171785 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa270087990 con 0x7fa2680047d0 2024-01-31T05:04:43.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fb75c400640 1 -- 172.21.15.49:0/742655634 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb75416f6c0 con 0x7fb7540ce930 2024-01-31T05:04:43.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fc1cf400640 1 --2- 172.21.15.49:0/731759673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d015f4e0 0x7fc1d01555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.219+0000 7fc1d4c00640 1 --2- 172.21.15.49:0/731759673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1d015fe00 0x7fc1d01fa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fc1cfe00640 1 -- 172.21.15.49:0/731759673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1d015fe00 msgr2=0x7fc1d01fa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fc1cfe00640 1 --2- 172.21.15.49:0/731759673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1d015fe00 0x7fc1d01fa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fc1cfe00640 1 -- 172.21.15.49:0/731759673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d015f4e0 msgr2=0x7fc1d01555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7f92b8c00640 1 --2- 172.21.15.49:0/1632692679 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9294066590 0x7f9294068a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fca89e00640 1 -- 172.21.15.49:0/2123213215 wait complete. 2024-01-31T05:04:43.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7f276b400640 1 --2- 172.21.15.49:0/423563949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276c0ce290 0x7f276c06d680 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f275400dc90 tx=0x7f2754020810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94828140b5e003ab server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fa28dc00640 1 --2- 172.21.15.49:0/1348171785 >> [v2:172.21.15.49:6824/659898319,v1:172.21.15.49:6825/659898319] conn(0x7fa26006fbc0 0x7fa260072000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fc1cfe00640 1 --2- 172.21.15.49:0/731759673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d015f4e0 0x7fc1d01555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fc1cfe00640 1 -- 172.21.15.49:0/731759673 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c00094d0 con 0x7fc1d00b3650 2024-01-31T05:04:43.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fc1cf400640 1 --2- 172.21.15.49:0/731759673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1d015f4e0 0x7fc1d01555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7f92c0a00640 1 --2- 172.21.15.49:0/1632692679 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9294066590 0x7f9294068a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7f92b8c00640 1 -- 172.21.15.49:0/1632692679 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f92b4085440 con 0x7f92bc15f2d0 2024-01-31T05:04:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7f92c0a00640 1 --2- 172.21.15.49:0/1632692679 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9294066590 0x7f9294068a50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f92a40ae000 tx=0x7f92a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7f276aa00640 1 -- 172.21.15.49:0/423563949 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275400d2d0 con 0x7f276c0ce290 2024-01-31T05:04:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7f276aa00640 1 -- 172.21.15.49:0/423563949 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27540a95f0 con 0x7f276c0ce290 2024-01-31T05:04:43.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7f276aa00640 1 -- 172.21.15.49:0/423563949 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27540a9980 con 0x7f276c0ce290 2024-01-31T05:04:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7f92b8c00640 1 --2- 172.21.15.49:0/1632692679 >> [v2:172.21.15.195:6824/2275458030,v1:172.21.15.195:6825/2275458030] conn(0x7f929406fb50 0x7f9294071f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fc1cfe00640 1 --2- 172.21.15.49:0/731759673 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1d00b3650 0x7fc1d00b60c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc1c001a070 tx=0x7fc1c00191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7f92b8c00640 1 -- 172.21.15.49:0/1632692679 --> [v2:172.21.15.195:6824/2275458030,v1:172.21.15.195:6825/2275458030] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9294072660 con 0x7f929406fb50 2024-01-31T05:04:43.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7f92b8c00640 1 -- 172.21.15.49:0/1632692679 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92b40857b0 con 0x7f92bc15f2d0 2024-01-31T05:04:43.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7ff615800640 1 Processor -- start 2024-01-31T05:04:43.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7ff615800640 1 -- start start 2024-01-31T05:04:43.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7f92bbe00640 1 --2- 172.21.15.49:0/1632692679 >> [v2:172.21.15.195:6824/2275458030,v1:172.21.15.195:6825/2275458030] conn(0x7f929406fb50 0x7f9294071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fc1c7e00640 1 -- 172.21.15.49:0/731759673 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0003b70 con 0x7fc1d00b3650 2024-01-31T05:04:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fc1c7e00640 1 -- 172.21.15.49:0/731759673 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c0003cd0 con 0x7fc1d00b3650 2024-01-31T05:04:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fc1c7e00640 1 -- 172.21.15.49:0/731759673 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c00ab660 con 0x7fc1d00b3650 2024-01-31T05:04:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fc1d6c00640 1 -- 172.21.15.49:0/731759673 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d01fb370 con 0x7fc1d00b3650 2024-01-31T05:04:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fc1d6c00640 1 -- 172.21.15.49:0/731759673 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d01550d0 con 0x7fc1d00b3650 2024-01-31T05:04:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7f2773000640 1 -- 172.21.15.49:0/423563949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276c0ce290 msgr2=0x7f276c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7f2773000640 1 --2- 172.21.15.49:0/423563949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276c0ce290 0x7f276c06d680 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f275400dc90 tx=0x7f2754020810 comp rx=0 tx=0).stop 2024-01-31T05:04:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fca89e00640 1 Processor -- start 2024-01-31T05:04:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fc1d6c00640 1 -- 172.21.15.49:0/731759673 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc1a0001040 con 0x7fc1d00b3650 2024-01-31T05:04:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7ff615800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff61006d440 0x7ff61015bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fa287e00640 1 --2- 172.21.15.49:0/1348171785 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa260066580 0x7fa260068a40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa2780ab000 tx=0x7fa2780a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7fa28dc00640 1 --2- 172.21.15.49:0/1348171785 >> [v2:172.21.15.49:6824/659898319,v1:172.21.15.49:6825/659898319] conn(0x7fa26006fbc0 0x7fa260072000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fb751600640 1 -- 172.21.15.49:0/742655634 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb74c005560 con 0x7fb7540ce930 2024-01-31T05:04:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fb751600640 1 --2- 172.21.15.49:0/742655634 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb72c0665d0 0x7fb72c068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fb751600640 1 -- 172.21.15.49:0/742655634 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb74c083a90 con 0x7fb7540ce930 2024-01-31T05:04:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fb751600640 1 --2- 172.21.15.49:0/742655634 >> [v2:172.21.15.49:6816/1521900239,v1:172.21.15.49:6817/1521900239] conn(0x7fb72c06fc10 0x7fb72c072050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fb751600640 1 -- 172.21.15.49:0/742655634 --> [v2:172.21.15.49:6816/1521900239,v1:172.21.15.49:6817/1521900239] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb72c072720 con 0x7fb72c06fc10 2024-01-31T05:04:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fb751600640 1 -- 172.21.15.49:0/742655634 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb74c0882a0 con 0x7fb7540ce930 2024-01-31T05:04:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7fb759000640 1 --2- 172.21.15.49:0/742655634 >> [v2:172.21.15.49:6816/1521900239,v1:172.21.15.49:6817/1521900239] conn(0x7fb72c06fc10 0x7fb72c072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7fb759a00640 1 --2- 172.21.15.49:0/742655634 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb72c0665d0 0x7fb72c068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7fb759a00640 1 --2- 172.21.15.49:0/742655634 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb72c0665d0 0x7fb72c068a90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb7440ad000 tx=0x7fb744004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7f92bbe00640 1 --2- 172.21.15.49:0/1632692679 >> [v2:172.21.15.195:6824/2275458030,v1:172.21.15.195:6825/2275458030] conn(0x7f929406fb50 0x7f9294071f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7f2773000640 1 -- 172.21.15.49:0/423563949 shutdown_connections 2024-01-31T05:04:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7f2773000640 1 --2- 172.21.15.49:0/423563949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276c0ce290 0x7f276c06d680 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7f2773000640 1 -- 172.21.15.49:0/423563949 >> 172.21.15.49:0/423563949 conn(0x7f276c06ad70 msgr2=0x7f276c0b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7ff615800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6100b2670 0x7ff610162550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7ff615800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff61014b350 0x7ff61015a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7ff615800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61015c0d0 con 0x7ff6100b2670 2024-01-31T05:04:43.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7ff615800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61015aaf0 con 0x7ff61014b350 2024-01-31T05:04:43.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7ff615800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61015add0 con 0x7ff61006d440 2024-01-31T05:04:43.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7ff60f400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff61014b350 0x7ff61015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7ff60f400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff61014b350 0x7ff61015a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41552/0 (socket says 172.21.15.49:41552) 2024-01-31T05:04:43.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7ff60f400640 1 -- 172.21.15.49:0/2728336612 learned_addr learned my addr 172.21.15.49:0/2728336612 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7ff60f400640 1 -- 172.21.15.49:0/2728336612 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff61006d440 msgr2=0x7ff61015bb90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-31T05:04:43.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7ff60f400640 1 --2- 172.21.15.49:0/2728336612 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff61006d440 0x7ff61015bb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7ff60f400640 1 -- 172.21.15.49:0/2728336612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6100b2670 msgr2=0x7ff610162550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7ff60f400640 1 --2- 172.21.15.49:0/2728336612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6100b2670 0x7ff610162550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7ff60f400640 1 -- 172.21.15.49:0/2728336612 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff608009b30 con 0x7ff61014b350 2024-01-31T05:04:43.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7f92b8c00640 1 -- 172.21.15.49:0/1632692679 <== osd.4 v2:172.21.15.195:6824/2275458030 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9294072660 con 0x7f929406fb50 2024-01-31T05:04:43.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.223+0000 7fca89e00640 1 -- start start 2024-01-31T05:04:43.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7fca89e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca8406cfc0 0x7fca841496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7fca89e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca840ce110 0x7fca84146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7fca89e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca84156f40 0x7fca840cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7fca89e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca84148900 con 0x7fca84156f40 2024-01-31T05:04:43.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7f2773000640 1 -- 172.21.15.49:0/423563949 shutdown_connections 2024-01-31T05:04:43.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7fb759000640 1 --2- 172.21.15.49:0/742655634 >> [v2:172.21.15.49:6816/1521900239,v1:172.21.15.49:6817/1521900239] conn(0x7fb72c06fc10 0x7fb72c072050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7fca89e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca84148be0 con 0x7fca840ce110 2024-01-31T05:04:43.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7fca89e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca84148ec0 con 0x7fca8406cfc0 2024-01-31T05:04:43.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7ff60f400640 1 --2- 172.21.15.49:0/2728336612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff61014b350 0x7ff61015a050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff60801b080 tx=0x7ff608019770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7fca83400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca84156f40 0x7fca840cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7ff606a00640 1 -- 172.21.15.49:0/2728336612 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6080a5740 con 0x7ff61014b350 2024-01-31T05:04:43.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7fca82000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca840ce110 0x7fca84146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7fca83400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca84156f40 0x7fca840cc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38514/0 (socket says 172.21.15.49:38514) 2024-01-31T05:04:43.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7fca83400640 1 -- 172.21.15.49:0/4026951512 learned_addr learned my addr 172.21.15.49:0/4026951512 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7ff606a00640 1 -- 172.21.15.49:0/2728336612 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6080b8670 con 0x7ff61014b350 2024-01-31T05:04:43.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7ff615800640 1 -- 172.21.15.49:0/2728336612 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61015b0b0 con 0x7ff61014b350 2024-01-31T05:04:43.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7ff615800640 1 -- 172.21.15.49:0/2728336612 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61015b670 con 0x7ff61014b350 2024-01-31T05:04:43.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7fc1c7e00640 1 -- 172.21.15.49:0/731759673 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fc1c00b2050 con 0x7fc1d00b3650 2024-01-31T05:04:43.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7fca82a00640 1 --2- 172.21.15.49:0/4026951512 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca8406cfc0 0x7fca841496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7ff606a00640 1 -- 172.21.15.49:0/2728336612 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6080b8a00 con 0x7ff61014b350 2024-01-31T05:04:43.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.227+0000 7fa284c00640 1 -- 172.21.15.49:0/1348171785 <== osd.1 v2:172.21.15.49:6824/659898319 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa2600726d0 con 0x7fa26006fbc0 2024-01-31T05:04:43.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.231+0000 7ff615800640 1 -- 172.21.15.49:0/2728336612 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff5e0001040 con 0x7ff61014b350 2024-01-31T05:04:43.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.231+0000 7fb751600640 1 -- 172.21.15.49:0/742655634 <== osd.2 v2:172.21.15.49:6816/1521900239 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb72c072720 con 0x7fb72c06fc10 2024-01-31T05:04:43.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.231+0000 7fc1c7e00640 1 --2- 172.21.15.49:0/731759673 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc1a8066500 0x7fc1a80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.231+0000 7fca82a00640 1 -- 172.21.15.49:0/4026951512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca840ce110 msgr2=0x7fca84146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.231+0000 7fca82a00640 1 --2- 172.21.15.49:0/4026951512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca840ce110 0x7fca84146bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.231+0000 7fca82a00640 1 -- 172.21.15.49:0/4026951512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca84156f40 msgr2=0x7fca840cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.231+0000 7fca82a00640 1 --2- 172.21.15.49:0/4026951512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca84156f40 0x7fca840cc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.231+0000 7fca82a00640 1 -- 172.21.15.49:0/4026951512 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c009cb0 con 0x7fca8406cfc0 2024-01-31T05:04:43.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.231+0000 7fca82a00640 1 --2- 172.21.15.49:0/4026951512 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca8406cfc0 0x7fca841496c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00c6d0 tx=0x7fca7c00cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.231+0000 7f2773000640 1 -- 172.21.15.49:0/423563949 wait complete. 2024-01-31T05:04:43.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.231+0000 7fc1c7e00640 1 -- 172.21.15.49:0/731759673 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc1c011e340 con 0x7fc1d00b3650 2024-01-31T05:04:43.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.231+0000 7fc1cf400640 1 --2- 172.21.15.49:0/731759673 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc1a8066500 0x7fc1a80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7fc1c7e00640 1 --2- 172.21.15.49:0/731759673 >> [v2:172.21.15.49:6802/571126940,v1:172.21.15.49:6805/571126940] conn(0x7fc1a806fb40 0x7fc1a8071f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7fc1c7e00640 1 -- 172.21.15.49:0/731759673 --> [v2:172.21.15.49:6802/571126940,v1:172.21.15.49:6805/571126940] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc1a8072650 con 0x7fc1a806fb40 2024-01-31T05:04:43.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7fc1c7e00640 1 -- 172.21.15.49:0/731759673 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1c0120960 con 0x7fc1d00b3650 2024-01-31T05:04:43.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7fc1d4c00640 1 --2- 172.21.15.49:0/731759673 >> [v2:172.21.15.49:6802/571126940,v1:172.21.15.49:6805/571126940] conn(0x7fc1a806fb40 0x7fc1a8071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.231+0000 7fca7b400640 1 -- 172.21.15.49:0/4026951512 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c004d70 con 0x7fca8406cfc0 2024-01-31T05:04:43.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.231+0000 7fca7b400640 1 -- 172.21.15.49:0/4026951512 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c00a640 con 0x7fca8406cfc0 2024-01-31T05:04:43.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.231+0000 7fca7b400640 1 -- 172.21.15.49:0/4026951512 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c00a9f0 con 0x7fca8406cfc0 2024-01-31T05:04:43.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7fca89e00640 1 -- 172.21.15.49:0/4026951512 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca841491a0 con 0x7fca8406cfc0 2024-01-31T05:04:43.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7fca89e00640 1 -- 172.21.15.49:0/4026951512 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca840ccb20 con 0x7fca8406cfc0 2024-01-31T05:04:43.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7fca89e00640 1 -- 172.21.15.49:0/4026951512 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fca84148a70 con 0x7fca8406cfc0 2024-01-31T05:04:43.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7f2773000640 1 Processor -- start 2024-01-31T05:04:43.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.231+0000 7ff606a00640 1 -- 172.21.15.49:0/2728336612 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff6080b8b60 con 0x7ff61014b350 2024-01-31T05:04:43.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7ff606a00640 1 --2- 172.21.15.49:0/2728336612 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff5e8066500 0x7ff5e80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7ff606a00640 1 -- 172.21.15.49:0/2728336612 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff6080f0630 con 0x7ff61014b350 2024-01-31T05:04:43.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7ff60ea00640 1 --2- 172.21.15.49:0/2728336612 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff5e8066500 0x7ff5e80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7ff606a00640 1 --2- 172.21.15.49:0/2728336612 >> [v2:172.21.15.195:6809/1947167273,v1:172.21.15.195:6811/1947167273] conn(0x7ff5e80707e0 0x7ff5e8072c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7ff606a00640 1 -- 172.21.15.49:0/2728336612 --> [v2:172.21.15.195:6809/1947167273,v1:172.21.15.195:6811/1947167273] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5e8073350 con 0x7ff5e80707e0 2024-01-31T05:04:43.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7ff606a00640 1 -- 172.21.15.49:0/2728336612 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6080f0400 con 0x7ff61014b350 2024-01-31T05:04:43.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7f2773000640 1 -- start start 2024-01-31T05:04:43.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7ff60e000640 1 --2- 172.21.15.49:0/2728336612 >> [v2:172.21.15.195:6809/1947167273,v1:172.21.15.195:6811/1947167273] conn(0x7ff5e80707e0 0x7ff5e8072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7fc1d4c00640 1 --2- 172.21.15.49:0/731759673 >> [v2:172.21.15.49:6802/571126940,v1:172.21.15.49:6805/571126940] conn(0x7fc1a806fb40 0x7fc1a8071f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7fc1cf400640 1 --2- 172.21.15.49:0/731759673 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc1a8066500 0x7fc1a80689c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8007a70 tx=0x7fc1b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7ff60e000640 1 --2- 172.21.15.49:0/2728336612 >> [v2:172.21.15.195:6809/1947167273,v1:172.21.15.195:6811/1947167273] conn(0x7ff5e80707e0 0x7ff5e8072c80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7ff60ea00640 1 --2- 172.21.15.49:0/2728336612 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff5e8066500 0x7ff5e80689c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff6000099f0 tx=0x7ff600009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7f2773000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f276c06dbc0 0x7f276c15c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7f2773000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276c0ce290 0x7f276c13c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7f2773000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f276c156e40 0x7f276c14f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7f276b400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276c0ce290 0x7f276c13c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7f2773000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c150b60 con 0x7f276c156e40 2024-01-31T05:04:43.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7f2773000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c14ff50 con 0x7f276c0ce290 2024-01-31T05:04:43.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7f276b400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276c0ce290 0x7f276c13c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41562/0 (socket says 172.21.15.49:41562) 2024-01-31T05:04:43.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7f276b400640 1 -- 172.21.15.49:0/1236673800 learned_addr learned my addr 172.21.15.49:0/1236673800 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7f276be00640 1 --2- 172.21.15.49:0/1236673800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f276c06dbc0 0x7f276c15c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7f2773000640 1 -- 172.21.15.49:0/1236673800 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276c150230 con 0x7f276c06dbc0 2024-01-31T05:04:43.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7f2771000640 1 --2- 172.21.15.49:0/1236673800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f276c156e40 0x7f276c14f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7f276b400640 1 -- 172.21.15.49:0/1236673800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f276c06dbc0 msgr2=0x7f276c15c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7f276b400640 1 --2- 172.21.15.49:0/1236673800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f276c06dbc0 0x7f276c15c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7f276b400640 1 -- 172.21.15.49:0/1236673800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f276c156e40 msgr2=0x7f276c14f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7f276b400640 1 --2- 172.21.15.49:0/1236673800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f276c156e40 0x7f276c14f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7f276b400640 1 -- 172.21.15.49:0/1236673800 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275400d970 con 0x7f276c0ce290 2024-01-31T05:04:43.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.235+0000 7fc1c7e00640 1 -- 172.21.15.49:0/731759673 <== osd.3 v2:172.21.15.49:6802/571126940 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc1a8072650 con 0x7fc1a806fb40 2024-01-31T05:04:43.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7fca7b400640 1 -- 172.21.15.49:0/4026951512 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fca7c00ab50 con 0x7fca8406cfc0 2024-01-31T05:04:43.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7fca7b400640 1 --2- 172.21.15.49:0/4026951512 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fca5c066550 0x7fca5c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7fca7b400640 1 -- 172.21.15.49:0/4026951512 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fca7c0840d0 con 0x7fca8406cfc0 2024-01-31T05:04:43.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7fca82000640 1 --2- 172.21.15.49:0/4026951512 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fca5c066550 0x7fca5c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7fca7b400640 1 --2- 172.21.15.49:0/4026951512 >> [v2:172.21.15.195:6800/578985434,v1:172.21.15.195:6801/578985434] conn(0x7fca5c06fb90 0x7fca5c071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7fca7b400640 1 -- 172.21.15.49:0/4026951512 --> [v2:172.21.15.195:6800/578985434,v1:172.21.15.195:6801/578985434] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca5c0726a0 con 0x7fca5c06fb90 2024-01-31T05:04:43.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7fca7b400640 1 -- 172.21.15.49:0/4026951512 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca7c084440 con 0x7fca8406cfc0 2024-01-31T05:04:43.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.239+0000 7f276b400640 1 --2- 172.21.15.49:0/1236673800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276c0ce290 0x7f276c13c850 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f27540b3040 tx=0x7f275401d5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.243+0000 7f2763e00640 1 -- 172.21.15.49:0/1236673800 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27540bc670 con 0x7f276c0ce290 2024-01-31T05:04:43.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.243+0000 7f2763e00640 1 -- 172.21.15.49:0/1236673800 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27540bc810 con 0x7f276c0ce290 2024-01-31T05:04:43.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.243+0000 7f2763e00640 1 -- 172.21.15.49:0/1236673800 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27540bcbc0 con 0x7f276c0ce290 2024-01-31T05:04:43.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.243+0000 7ff606a00640 1 -- 172.21.15.49:0/2728336612 <== osd.7 v2:172.21.15.195:6809/1947167273 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff5e8073350 con 0x7ff5e80707e0 2024-01-31T05:04:43.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.243+0000 7fca83400640 1 --2- 172.21.15.49:0/4026951512 >> [v2:172.21.15.195:6800/578985434,v1:172.21.15.195:6801/578985434] conn(0x7fca5c06fb90 0x7fca5c071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.243+0000 7fca82000640 1 --2- 172.21.15.49:0/4026951512 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fca5c066550 0x7fca5c068a10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fca841477b0 tx=0x7fca74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.243+0000 7f2773000640 1 -- 172.21.15.49:0/1236673800 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276c1573a0 con 0x7f276c0ce290 2024-01-31T05:04:43.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.243+0000 7fca83400640 1 --2- 172.21.15.49:0/4026951512 >> [v2:172.21.15.195:6800/578985434,v1:172.21.15.195:6801/578985434] conn(0x7fca5c06fb90 0x7fca5c071fd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.243+0000 7f2773000640 1 -- 172.21.15.49:0/1236673800 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276c1507f0 con 0x7f276c0ce290 2024-01-31T05:04:43.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.243+0000 7fca7b400640 1 -- 172.21.15.49:0/4026951512 <== osd.5 v2:172.21.15.195:6800/578985434 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fca5c0726a0 con 0x7fca5c06fb90 2024-01-31T05:04:43.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.247+0000 7f2761600640 1 -- 172.21.15.49:0/1236673800 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f276c157220 con 0x7f276c0ce290 2024-01-31T05:04:43.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.247+0000 7f92c1e00640 1 -- 172.21.15.49:0/1632692679 --> [v2:172.21.15.195:6824/2275458030,v1:172.21.15.195:6825/2275458030] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f928c002d40 con 0x7f929406fb50 2024-01-31T05:04:43.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.247+0000 7f2763e00640 1 -- 172.21.15.49:0/1236673800 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f27540bcd20 con 0x7f276c0ce290 2024-01-31T05:04:43.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.247+0000 7f2763e00640 1 --2- 172.21.15.49:0/1236673800 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2744066550 0x7f2744068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.247+0000 7f2763e00640 1 -- 172.21.15.49:0/1236673800 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2754123630 con 0x7f276c0ce290 2024-01-31T05:04:43.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.247+0000 7f2763e00640 1 --2- 172.21.15.49:0/1236673800 >> [v2:172.21.15.195:6806/2294396668,v1:172.21.15.195:6808/2294396668] conn(0x7f274406fb90 0x7f2744071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.247+0000 7f2763e00640 1 -- 172.21.15.49:0/1236673800 --> [v2:172.21.15.195:6806/2294396668,v1:172.21.15.195:6808/2294396668] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27440726a0 con 0x7f274406fb90 2024-01-31T05:04:43.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.247+0000 7f2763e00640 1 -- 172.21.15.49:0/1236673800 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2754125c10 con 0x7f276c0ce290 2024-01-31T05:04:43.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.247+0000 7f2771000640 1 --2- 172.21.15.49:0/1236673800 >> [v2:172.21.15.195:6806/2294396668,v1:172.21.15.195:6808/2294396668] conn(0x7f274406fb90 0x7f2744071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.251+0000 7f92b8c00640 1 -- 172.21.15.49:0/1632692679 <== osd.4 v2:172.21.15.195:6824/2275458030 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f928c002d40 con 0x7f929406fb50 2024-01-31T05:04:43.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.251+0000 7f92c1e00640 1 -- 172.21.15.49:0/1632692679 >> [v2:172.21.15.195:6824/2275458030,v1:172.21.15.195:6825/2275458030] conn(0x7f929406fb50 msgr2=0x7f9294071f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.251+0000 7f92c1e00640 1 --2- 172.21.15.49:0/1632692679 >> [v2:172.21.15.195:6824/2275458030,v1:172.21.15.195:6825/2275458030] conn(0x7f929406fb50 0x7f9294071f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.251+0000 7f2771000640 1 --2- 172.21.15.49:0/1236673800 >> [v2:172.21.15.195:6806/2294396668,v1:172.21.15.195:6808/2294396668] conn(0x7f274406fb90 0x7f2744071fd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.251+0000 7f276be00640 1 --2- 172.21.15.49:0/1236673800 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2744066550 0x7f2744068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.251+0000 7f2763e00640 1 -- 172.21.15.49:0/1236673800 <== osd.6 v2:172.21.15.195:6806/2294396668 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f27440726a0 con 0x7f274406fb90 2024-01-31T05:04:43.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.251+0000 7f92c1e00640 1 -- 172.21.15.49:0/1632692679 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9294066590 msgr2=0x7f9294068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.251+0000 7f92c1e00640 1 --2- 172.21.15.49:0/1632692679 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9294066590 0x7f9294068a50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f92a40ae000 tx=0x7f92a4008040 comp rx=0 tx=0).stop 2024-01-31T05:04:43.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.251+0000 7f92c1e00640 1 -- 172.21.15.49:0/1632692679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92bc15f2d0 msgr2=0x7f92bc09bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.251+0000 7f92c1e00640 1 --2- 172.21.15.49:0/1632692679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92bc15f2d0 0x7f92bc09bb40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f92b400efc0 tx=0x7f92b400c490 comp rx=0 tx=0).stop 2024-01-31T05:04:43.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.251+0000 7f92c1400640 1 -- 172.21.15.49:0/1632692679 reap_dead start 2024-01-31T05:04:43.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.251+0000 7f92c1e00640 1 -- 172.21.15.49:0/1632692679 shutdown_connections 2024-01-31T05:04:43.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.251+0000 7f92c1e00640 1 -- 172.21.15.49:0/1632692679 >> 172.21.15.49:0/1632692679 conn(0x7f92bc06a770 msgr2=0x7f92bc15d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.251+0000 7f276be00640 1 --2- 172.21.15.49:0/1236673800 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2744066550 0x7f2744068a10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f275c00b810 tx=0x7f275c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.255+0000 7f92c1e00640 1 -- 172.21.15.49:0/1632692679 shutdown_connections 2024-01-31T05:04:43.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.255+0000 7f92c1e00640 1 -- 172.21.15.49:0/1632692679 wait complete. 2024-01-31T05:04:43.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.255+0000 7f60db800640 1 -- 172.21.15.49:0/3426964932 --> [v2:172.21.15.49:6800/3804147802,v1:172.21.15.49:6801/3804147802] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f60d406b660 con 0x7f60ac06fc10 2024-01-31T05:04:43.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.255+0000 7f60d0c00640 1 -- 172.21.15.49:0/3426964932 <== osd.0 v2:172.21.15.49:6800/3804147802 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f60d406b660 con 0x7f60ac06fc10 2024-01-31T05:04:43.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.255+0000 7f60db800640 1 -- 172.21.15.49:0/3426964932 >> [v2:172.21.15.49:6800/3804147802,v1:172.21.15.49:6801/3804147802] conn(0x7f60ac06fc10 msgr2=0x7f60ac072050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.255+0000 7f60db800640 1 --2- 172.21.15.49:0/3426964932 >> [v2:172.21.15.49:6800/3804147802,v1:172.21.15.49:6801/3804147802] conn(0x7f60ac06fc10 0x7f60ac072050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.259+0000 7f60db800640 1 -- 172.21.15.49:0/3426964932 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f60ac0665d0 msgr2=0x7f60ac068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.259+0000 7f60db800640 1 --2- 172.21.15.49:0/3426964932 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f60ac0665d0 0x7f60ac068a90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f60c40049e0 tx=0x7f60c400b240 comp rx=0 tx=0).stop 2024-01-31T05:04:43.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.259+0000 7f60db800640 1 -- 172.21.15.49:0/3426964932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60d415d910 msgr2=0x7f60d4155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.259+0000 7f60db800640 1 --2- 172.21.15.49:0/3426964932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60d415d910 0x7f60d4155cf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f60d406df00 tx=0x7f60cc01a800 comp rx=0 tx=0).stop 2024-01-31T05:04:43.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.259+0000 7f60d9800640 1 -- 172.21.15.49:0/3426964932 reap_dead start 2024-01-31T05:04:43.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.259+0000 7f60db800640 1 -- 172.21.15.49:0/3426964932 shutdown_connections 2024-01-31T05:04:43.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.259+0000 7f60db800640 1 -- 172.21.15.49:0/3426964932 >> 172.21.15.49:0/3426964932 conn(0x7f60d40b09a0 msgr2=0x7f60d4158aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.259+0000 7f60db800640 1 -- 172.21.15.49:0/3426964932 shutdown_connections 2024-01-31T05:04:43.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.259+0000 7f60db800640 1 -- 172.21.15.49:0/3426964932 wait complete. 2024-01-31T05:04:43.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.259+0000 7fa28fc00640 1 -- 172.21.15.49:0/1348171785 --> [v2:172.21.15.49:6824/659898319,v1:172.21.15.49:6825/659898319] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa288071760 con 0x7fa26006fbc0 2024-01-31T05:04:43.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fb75c400640 1 -- 172.21.15.49:0/742655634 --> [v2:172.21.15.49:6816/1521900239,v1:172.21.15.49:6817/1521900239] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb7541600c0 con 0x7fb72c06fc10 2024-01-31T05:04:43.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fa284c00640 1 -- 172.21.15.49:0/1348171785 <== osd.1 v2:172.21.15.49:6824/659898319 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa280009d40 con 0x7fa26006fbc0 2024-01-31T05:04:43.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fa28fc00640 1 -- 172.21.15.49:0/1348171785 >> [v2:172.21.15.49:6824/659898319,v1:172.21.15.49:6825/659898319] conn(0x7fa26006fbc0 msgr2=0x7fa260072000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fa28fc00640 1 --2- 172.21.15.49:0/1348171785 >> [v2:172.21.15.49:6824/659898319,v1:172.21.15.49:6825/659898319] conn(0x7fa26006fbc0 0x7fa260072000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fb751600640 1 -- 172.21.15.49:0/742655634 <== osd.2 v2:172.21.15.49:6816/1521900239 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb7541600c0 con 0x7fb72c06fc10 2024-01-31T05:04:43.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fa28fc00640 1 -- 172.21.15.49:0/1348171785 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa260066580 msgr2=0x7fa260068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fa28fc00640 1 --2- 172.21.15.49:0/1348171785 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa260066580 0x7fa260068a40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa2780ab000 tx=0x7fa2780a6000 comp rx=0 tx=0).stop 2024-01-31T05:04:43.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fa28fc00640 1 -- 172.21.15.49:0/1348171785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2680047d0 msgr2=0x7fa288159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fa28fc00640 1 --2- 172.21.15.49:0/1348171785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2680047d0 0x7fa288159000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa270011840 tx=0x7fa270011d00 comp rx=0 tx=0).stop 2024-01-31T05:04:43.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fa28dc00640 1 -- 172.21.15.49:0/1348171785 reap_dead start 2024-01-31T05:04:43.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fb75c400640 1 -- 172.21.15.49:0/742655634 >> [v2:172.21.15.49:6816/1521900239,v1:172.21.15.49:6817/1521900239] conn(0x7fb72c06fc10 msgr2=0x7fb72c072050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fb75c400640 1 --2- 172.21.15.49:0/742655634 >> [v2:172.21.15.49:6816/1521900239,v1:172.21.15.49:6817/1521900239] conn(0x7fb72c06fc10 0x7fb72c072050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fc1d6c00640 1 -- 172.21.15.49:0/731759673 --> [v2:172.21.15.49:6802/571126940,v1:172.21.15.49:6805/571126940] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc1a0002d40 con 0x7fc1a806fb40 2024-01-31T05:04:43.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fb75c400640 1 -- 172.21.15.49:0/742655634 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb72c0665d0 msgr2=0x7fb72c068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fb75c400640 1 --2- 172.21.15.49:0/742655634 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb72c0665d0 0x7fb72c068a90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb7440ad000 tx=0x7fb744004740 comp rx=0 tx=0).stop 2024-01-31T05:04:43.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fb75c400640 1 -- 172.21.15.49:0/742655634 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7540ce930 msgr2=0x7fb7541637f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fb75c400640 1 --2- 172.21.15.49:0/742655634 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7540ce930 0x7fb7541637f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00c7b0 tx=0x7fb74c00cc70 comp rx=0 tx=0).stop 2024-01-31T05:04:43.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fb75a400640 1 -- 172.21.15.49:0/742655634 reap_dead start 2024-01-31T05:04:43.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fa28fc00640 1 -- 172.21.15.49:0/1348171785 shutdown_connections 2024-01-31T05:04:43.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fa28fc00640 1 -- 172.21.15.49:0/1348171785 >> 172.21.15.49:0/1348171785 conn(0x7fa2880b0b60 msgr2=0x7fa28816cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fb75c400640 1 -- 172.21.15.49:0/742655634 shutdown_connections 2024-01-31T05:04:43.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.263+0000 7fb75c400640 1 -- 172.21.15.49:0/742655634 >> 172.21.15.49:0/742655634 conn(0x7fb75406ad70 msgr2=0x7fb7541454e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.267+0000 7fa28fc00640 1 -- 172.21.15.49:0/1348171785 shutdown_connections 2024-01-31T05:04:43.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.267+0000 7fa28fc00640 1 -- 172.21.15.49:0/1348171785 wait complete. 2024-01-31T05:04:43.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.267+0000 7fb75c400640 1 -- 172.21.15.49:0/742655634 shutdown_connections 2024-01-31T05:04:43.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.267+0000 7fb75c400640 1 -- 172.21.15.49:0/742655634 wait complete. 2024-01-31T05:04:43.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.267+0000 7fc1c7e00640 1 -- 172.21.15.49:0/731759673 <== osd.3 v2:172.21.15.49:6802/571126940 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc1a0002d40 con 0x7fc1a806fb40 2024-01-31T05:04:43.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.267+0000 7fc1c5600640 1 -- 172.21.15.49:0/731759673 >> [v2:172.21.15.49:6802/571126940,v1:172.21.15.49:6805/571126940] conn(0x7fc1a806fb40 msgr2=0x7fc1a8071f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.267+0000 7fc1c5600640 1 --2- 172.21.15.49:0/731759673 >> [v2:172.21.15.49:6802/571126940,v1:172.21.15.49:6805/571126940] conn(0x7fc1a806fb40 0x7fc1a8071f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.267+0000 7fc1c5600640 1 -- 172.21.15.49:0/731759673 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc1a8066500 msgr2=0x7fc1a80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.271+0000 7fc1c5600640 1 --2- 172.21.15.49:0/731759673 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc1a8066500 0x7fc1a80689c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8007a70 tx=0x7fc1b8008040 comp rx=0 tx=0).stop 2024-01-31T05:04:43.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.271+0000 7fc1c5600640 1 -- 172.21.15.49:0/731759673 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1d00b3650 msgr2=0x7fc1d00b60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.271+0000 7fc1c5600640 1 --2- 172.21.15.49:0/731759673 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1d00b3650 0x7fc1d00b60c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc1c001a070 tx=0x7fc1c00191e0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.271+0000 7fc1d4c00640 1 -- 172.21.15.49:0/731759673 reap_dead start 2024-01-31T05:04:43.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.271+0000 7fc1c5600640 1 -- 172.21.15.49:0/731759673 shutdown_connections 2024-01-31T05:04:43.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.271+0000 7fc1c5600640 1 -- 172.21.15.49:0/731759673 >> 172.21.15.49:0/731759673 conn(0x7fc1d00b2b30 msgr2=0x7fc1d006f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.275+0000 7fc1c5600640 1 -- 172.21.15.49:0/731759673 shutdown_connections 2024-01-31T05:04:43.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.275+0000 7fc1c5600640 1 -- 172.21.15.49:0/731759673 wait complete. 2024-01-31T05:04:43.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.275+0000 7fca89e00640 1 -- 172.21.15.49:0/4026951512 --> [v2:172.21.15.195:6800/578985434,v1:172.21.15.195:6801/578985434] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fca8415a6b0 con 0x7fca5c06fb90 2024-01-31T05:04:43.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.275+0000 7fca7b400640 1 -- 172.21.15.49:0/4026951512 <== osd.5 v2:172.21.15.195:6800/578985434 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fca5c0726a0 con 0x7fca5c06fb90 2024-01-31T05:04:43.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.275+0000 7f2761600640 1 -- 172.21.15.49:0/1236673800 --> [v2:172.21.15.195:6806/2294396668,v1:172.21.15.195:6808/2294396668] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f276c1672b0 con 0x7f274406fb90 2024-01-31T05:04:43.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.275+0000 7fca89e00640 1 -- 172.21.15.49:0/4026951512 >> [v2:172.21.15.195:6800/578985434,v1:172.21.15.195:6801/578985434] conn(0x7fca5c06fb90 msgr2=0x7fca5c071fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.275+0000 7fca89e00640 1 --2- 172.21.15.49:0/4026951512 >> [v2:172.21.15.195:6800/578985434,v1:172.21.15.195:6801/578985434] conn(0x7fca5c06fb90 0x7fca5c071fd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.275+0000 7ff615800640 1 -- 172.21.15.49:0/2728336612 --> [v2:172.21.15.195:6809/1947167273,v1:172.21.15.195:6811/1947167273] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff5e0002d40 con 0x7ff5e80707e0 2024-01-31T05:04:43.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.275+0000 7f2763e00640 1 -- 172.21.15.49:0/1236673800 <== osd.6 v2:172.21.15.195:6806/2294396668 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2764001b40 con 0x7f274406fb90 2024-01-31T05:04:43.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.279+0000 7ff606a00640 1 -- 172.21.15.49:0/2728336612 <== osd.7 v2:172.21.15.195:6809/1947167273 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff5e0002d40 con 0x7ff5e80707e0 2024-01-31T05:04:43.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.279+0000 7f2761600640 1 -- 172.21.15.49:0/1236673800 >> [v2:172.21.15.195:6806/2294396668,v1:172.21.15.195:6808/2294396668] conn(0x7f274406fb90 msgr2=0x7f2744071fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.279+0000 7f2761600640 1 --2- 172.21.15.49:0/1236673800 >> [v2:172.21.15.195:6806/2294396668,v1:172.21.15.195:6808/2294396668] conn(0x7f274406fb90 0x7f2744071fd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.279+0000 7ff615800640 1 -- 172.21.15.49:0/2728336612 >> [v2:172.21.15.195:6809/1947167273,v1:172.21.15.195:6811/1947167273] conn(0x7ff5e80707e0 msgr2=0x7ff5e8072c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.279+0000 7ff615800640 1 --2- 172.21.15.49:0/2728336612 >> [v2:172.21.15.195:6809/1947167273,v1:172.21.15.195:6811/1947167273] conn(0x7ff5e80707e0 0x7ff5e8072c80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.279+0000 7ff615800640 1 -- 172.21.15.49:0/2728336612 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff5e8066500 msgr2=0x7ff5e80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.279+0000 7ff615800640 1 --2- 172.21.15.49:0/2728336612 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff5e8066500 0x7ff5e80689c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff6000099f0 tx=0x7ff600009190 comp rx=0 tx=0).stop 2024-01-31T05:04:43.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.279+0000 7ff615800640 1 -- 172.21.15.49:0/2728336612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff61014b350 msgr2=0x7ff61015a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.279+0000 7ff615800640 1 --2- 172.21.15.49:0/2728336612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff61014b350 0x7ff61015a050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff60801b080 tx=0x7ff608019770 comp rx=0 tx=0).stop 2024-01-31T05:04:43.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.279+0000 7ff60f400640 1 -- 172.21.15.49:0/2728336612 reap_dead start 2024-01-31T05:04:43.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7ff615800640 1 -- 172.21.15.49:0/2728336612 shutdown_connections 2024-01-31T05:04:43.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7ff615800640 1 -- 172.21.15.49:0/2728336612 >> 172.21.15.49:0/2728336612 conn(0x7ff6100b0b60 msgr2=0x7ff6100aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7f2761600640 1 -- 172.21.15.49:0/1236673800 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2744066550 msgr2=0x7f2744068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7f2761600640 1 --2- 172.21.15.49:0/1236673800 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2744066550 0x7f2744068a10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f275c00b810 tx=0x7f275c008040 comp rx=0 tx=0).stop 2024-01-31T05:04:43.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7f2761600640 1 -- 172.21.15.49:0/1236673800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276c0ce290 msgr2=0x7f276c13c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7f2761600640 1 --2- 172.21.15.49:0/1236673800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276c0ce290 0x7f276c13c850 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f27540b3040 tx=0x7f275401d5b0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7fca89e00640 1 -- 172.21.15.49:0/4026951512 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fca5c066550 msgr2=0x7fca5c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7fca89e00640 1 --2- 172.21.15.49:0/4026951512 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fca5c066550 0x7fca5c068a10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fca841477b0 tx=0x7fca74009040 comp rx=0 tx=0).stop 2024-01-31T05:04:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7fca89e00640 1 -- 172.21.15.49:0/4026951512 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca8406cfc0 msgr2=0x7fca841496c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7fca89e00640 1 --2- 172.21.15.49:0/4026951512 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca8406cfc0 0x7fca841496c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00c6d0 tx=0x7fca7c00cb90 comp rx=0 tx=0).stop 2024-01-31T05:04:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7fca83400640 1 -- 172.21.15.49:0/4026951512 reap_dead start 2024-01-31T05:04:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7f2771000640 1 -- 172.21.15.49:0/1236673800 reap_dead start 2024-01-31T05:04:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7f2761600640 1 -- 172.21.15.49:0/1236673800 shutdown_connections 2024-01-31T05:04:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7f2761600640 1 -- 172.21.15.49:0/1236673800 >> 172.21.15.49:0/1236673800 conn(0x7f276c06ad70 msgr2=0x7f276c0af7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7fca89e00640 1 -- 172.21.15.49:0/4026951512 shutdown_connections 2024-01-31T05:04:43.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7fca89e00640 1 -- 172.21.15.49:0/4026951512 >> 172.21.15.49:0/4026951512 conn(0x7fca840b0b60 msgr2=0x7fca8406c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7f2761600640 1 -- 172.21.15.49:0/1236673800 shutdown_connections 2024-01-31T05:04:43.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7ff615800640 1 -- 172.21.15.49:0/2728336612 shutdown_connections 2024-01-31T05:04:43.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7fca89e00640 1 -- 172.21.15.49:0/4026951512 shutdown_connections 2024-01-31T05:04:43.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7fca89e00640 1 -- 172.21.15.49:0/4026951512 wait complete. 2024-01-31T05:04:43.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7f2761600640 1 -- 172.21.15.49:0/1236673800 wait complete. 2024-01-31T05:04:43.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.283+0000 7ff615800640 1 -- 172.21.15.49:0/2728336612 wait complete. 2024-01-31T05:04:43.306 INFO:teuthology.orchestra.run.smithi049.stdout:55834574857 2024-01-31T05:04:43.306 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-31T05:04:43.307 INFO:teuthology.orchestra.run.smithi049.stdout:55834574858 2024-01-31T05:04:43.307 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-31T05:04:43.309 INFO:teuthology.orchestra.run.smithi049.stdout:55834574858 2024-01-31T05:04:43.309 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-31T05:04:43.318 INFO:teuthology.orchestra.run.smithi049.stdout:55834574857 2024-01-31T05:04:43.318 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-31T05:04:43.319 INFO:teuthology.orchestra.run.smithi049.stdout:55834574857 2024-01-31T05:04:43.319 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-31T05:04:43.326 INFO:teuthology.orchestra.run.smithi049.stdout:55834574859 2024-01-31T05:04:43.326 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-31T05:04:43.328 INFO:teuthology.orchestra.run.smithi049.stdout:55834574857 2024-01-31T05:04:43.329 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-31T05:04:43.335 INFO:teuthology.orchestra.run.smithi049.stdout:55834574857 2024-01-31T05:04:43.336 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-31T05:04:43.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.507+0000 7fd93d200640 1 Processor -- start 2024-01-31T05:04:43.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.507+0000 7fd93d200640 1 -- start start 2024-01-31T05:04:43.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.511+0000 7fd93d200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd938070ad0 0x7fd9380b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.511+0000 7fd93d200640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93806c7e0 con 0x7fd9380b2040 2024-01-31T05:04:43.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.511+0000 7fd93d200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9380b2960 con 0x7fd93806cc70 2024-01-31T05:04:43.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.511+0000 7fd93d200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9380b3170 con 0x7fd938070ad0 2024-01-31T05:04:43.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.511+0000 7fd935e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd9380b2040 0x7fd9380703c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57792/0 (socket says 172.21.15.49:57792) 2024-01-31T05:04:43.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.511+0000 7fd935e00640 1 -- 172.21.15.49:0/2183457239 learned_addr learned my addr 172.21.15.49:0/2183457239 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:43.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.511+0000 7fd935400640 1 --2- 172.21.15.49:0/2183457239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd938070ad0 0x7fd9380b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.511+0000 7fd934a00640 1 -- 172.21.15.49:0/2183457239 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215903810 0 0) 0x7fd9380b2960 con 0x7fd93806cc70 2024-01-31T05:04:43.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.511+0000 7fa54e400640 1 Processor -- start 2024-01-31T05:04:43.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.511+0000 7fd934a00640 1 -- 172.21.15.49:0/2183457239 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd918003530 con 0x7fd93806cc70 2024-01-31T05:04:43.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd934a00640 1 -- 172.21.15.49:0/2183457239 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856741466 0 0) 0x7fd93806c7e0 con 0x7fd9380b2040 2024-01-31T05:04:43.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd934a00640 1 -- 172.21.15.49:0/2183457239 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9380b2960 con 0x7fd9380b2040 2024-01-31T05:04:43.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd934a00640 1 -- 172.21.15.49:0/2183457239 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 982901373 0 0) 0x7fd918003530 con 0x7fd93806cc70 2024-01-31T05:04:43.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd934a00640 1 -- 172.21.15.49:0/2183457239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd938070ad0 msgr2=0x7fd9380b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd934a00640 1 --2- 172.21.15.49:0/2183457239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd938070ad0 0x7fd9380b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd934a00640 1 -- 172.21.15.49:0/2183457239 >> v1:172.21.15.49:6789/0 conn(0x7fd9380b2040 legacy=0x7fd9380703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd934a00640 1 -- 172.21.15.49:0/2183457239 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9380b2bb0 con 0x7fd93806cc70 2024-01-31T05:04:43.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd934a00640 1 -- 172.21.15.49:0/2183457239 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7fd920001680 con 0x7fd93806cc70 2024-01-31T05:04:43.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd934a00640 1 -- 172.21.15.49:0/2183457239 >> v1:172.21.15.195:6789/0 conn(0x7fd93806cc70 legacy=0x7fd93806d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd934a00640 1 --2- 172.21.15.49:0/2183457239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd918003b10 0x7fd918003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd934a00640 1 --2- 172.21.15.49:0/2183457239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9180047d0 0x7fd918004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd934a00640 1 --2- 172.21.15.49:0/2183457239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd938070ad0 0x7fd918005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fa54e400640 1 -- start start 2024-01-31T05:04:43.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fa54e400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5480705d0 0x7fa54815d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fa54e400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54806dd50 con 0x7fa5480b1ca0 2024-01-31T05:04:43.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fa54e400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5480ae6e0 con 0x7fa5480709b0 2024-01-31T05:04:43.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fa54e400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5480b3e40 con 0x7fa5480705d0 2024-01-31T05:04:43.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd934a00640 1 -- 172.21.15.49:0/2183457239 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91800ba40 con 0x7fd918003b10 2024-01-31T05:04:43.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd934a00640 1 -- 172.21.15.49:0/2183457239 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91800bb80 con 0x7fd9180047d0 2024-01-31T05:04:43.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd934a00640 1 -- 172.21.15.49:0/2183457239 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91800bd40 con 0x7fd938070ad0 2024-01-31T05:04:43.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd935e00640 1 --2- 172.21.15.49:0/2183457239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd918003b10 0x7fd918003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd936800640 1 --2- 172.21.15.49:0/2183457239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd938070ad0 0x7fd918005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fa547e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fa5480709b0 0x7fa54806c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:50548/0 (socket says 172.21.15.49:50548) 2024-01-31T05:04:43.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fa547e00640 1 -- 172.21.15.49:0/598767131 learned_addr learned my addr 172.21.15.49:0/598767131 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:43.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fa547400640 1 --2- 172.21.15.49:0/598767131 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5480705d0 0x7fa54815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd936800640 1 -- 172.21.15.49:0/2183457239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9180047d0 msgr2=0x7fd918004c50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-31T05:04:43.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd936800640 1 --2- 172.21.15.49:0/2183457239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9180047d0 0x7fd918004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd936800640 1 -- 172.21.15.49:0/2183457239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd918003b10 msgr2=0x7fd918003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd936800640 1 --2- 172.21.15.49:0/2183457239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd918003b10 0x7fd918003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd936800640 1 -- 172.21.15.49:0/2183457239 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd918003530 con 0x7fd938070ad0 2024-01-31T05:04:43.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fd935e00640 1 --2- 172.21.15.49:0/2183457239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd918003b10 0x7fd918003f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:43.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.515+0000 7fa546000640 1 -- 172.21.15.49:0/598767131 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15844978 0 0) 0x7fa5480ae6e0 con 0x7fa5480709b0 2024-01-31T05:04:43.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.519+0000 7fa546000640 1 -- 172.21.15.49:0/598767131 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa528003530 con 0x7fa5480709b0 2024-01-31T05:04:43.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.519+0000 7fa546000640 1 -- 172.21.15.49:0/598767131 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230425787 0 0) 0x7fa54806dd50 con 0x7fa5480b1ca0 2024-01-31T05:04:43.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.519+0000 7fa546000640 1 -- 172.21.15.49:0/598767131 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5480ae6e0 con 0x7fa5480b1ca0 2024-01-31T05:04:43.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.519+0000 7fa547400640 1 -- 172.21.15.49:0/598767131 >> v1:172.21.15.195:6789/0 conn(0x7fa5480709b0 legacy=0x7fa54806c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.519+0000 7fa547400640 1 -- 172.21.15.49:0/598767131 >> v1:172.21.15.49:6789/0 conn(0x7fa5480b1ca0 legacy=0x7fa54815a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.519+0000 7fa547400640 1 -- 172.21.15.49:0/598767131 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5480b38a0 con 0x7fa5480705d0 2024-01-31T05:04:43.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.519+0000 7fd3d1800640 1 Processor -- start 2024-01-31T05:04:43.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.519+0000 7fd3d1800640 1 -- start start 2024-01-31T05:04:43.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fd936800640 1 --2- 172.21.15.49:0/2183457239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd938070ad0 0x7fd918005190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd920007eb0 tx=0x7fd92001ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b68c5d751868ab42 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fa547400640 1 --2- 172.21.15.49:0/598767131 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5480705d0 0x7fa54815d910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa5480b3a90 tx=0x7fa53801e6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6905be124c28116 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fd934a00640 1 -- 172.21.15.49:0/2183457239 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9200a66c0 con 0x7fd938070ad0 2024-01-31T05:04:43.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fd3d1800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3cc1593d0 0x7fd3cc0abd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fd3d1800640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3cc06c8f0 con 0x7fd3cc0b3580 2024-01-31T05:04:43.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fd3d1800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3cc0b22c0 con 0x7fd3cc0b3c60 2024-01-31T05:04:43.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fd3d1800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc06c2a0 con 0x7fd3cc1593d0 2024-01-31T05:04:43.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fd3d0e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd3cc0b3580 0x7fd3cc070a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57822/0 (socket says 172.21.15.49:57822) 2024-01-31T05:04:43.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fd3d0e00640 1 -- 172.21.15.49:0/3095411954 learned_addr learned my addr 172.21.15.49:0/3095411954 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:43.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fd3cbe00640 1 --2- 172.21.15.49:0/3095411954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3cc1593d0 0x7fd3cc0abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fd934a00640 1 -- 172.21.15.49:0/2183457239 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9200a6840 con 0x7fd938070ad0 2024-01-31T05:04:43.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fd934a00640 1 -- 172.21.15.49:0/2183457239 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9200a6bf0 con 0x7fd938070ad0 2024-01-31T05:04:43.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fd93d200640 1 -- 172.21.15.49:0/2183457239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd938070ad0 msgr2=0x7fd918005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fd93d200640 1 --2- 172.21.15.49:0/2183457239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd938070ad0 0x7fd918005190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd920007eb0 tx=0x7fd92001ca00 comp rx=0 tx=0).stop 2024-01-31T05:04:43.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fd936800640 1 -- 172.21.15.49:0/2183457239 reap_dead start 2024-01-31T05:04:43.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fa546000640 1 -- 172.21.15.49:0/598767131 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5380ab680 con 0x7fa5480705d0 2024-01-31T05:04:43.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fa546000640 1 -- 172.21.15.49:0/598767131 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5380ab7e0 con 0x7fa5480705d0 2024-01-31T05:04:43.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fa546000640 1 -- 172.21.15.49:0/598767131 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5380abb70 con 0x7fa5480705d0 2024-01-31T05:04:43.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fd93d200640 1 -- 172.21.15.49:0/2183457239 shutdown_connections 2024-01-31T05:04:43.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.523+0000 7fd93d200640 1 -- 172.21.15.49:0/2183457239 >> 172.21.15.49:0/2183457239 conn(0x7fd9380b09a0 msgr2=0x7fd9380b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.527+0000 7fd93d200640 1 -- 172.21.15.49:0/2183457239 shutdown_connections 2024-01-31T05:04:43.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.527+0000 7fd3caa00640 1 -- 172.21.15.49:0/3095411954 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927264240 0 0) 0x7fd3cc06c8f0 con 0x7fd3cc0b3580 2024-01-31T05:04:43.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.527+0000 7fd93d200640 1 -- 172.21.15.49:0/2183457239 wait complete. 2024-01-31T05:04:43.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.527+0000 7fa54e400640 1 -- 172.21.15.49:0/598767131 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5480705d0 msgr2=0x7fa54815d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.527+0000 7fa54e400640 1 --2- 172.21.15.49:0/598767131 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5480705d0 0x7fa54815d910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa5480b3a90 tx=0x7fa53801e6e0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.527+0000 7fd3caa00640 1 -- 172.21.15.49:0/3095411954 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3ac003530 con 0x7fd3cc0b3580 2024-01-31T05:04:43.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.527+0000 7fd3caa00640 1 -- 172.21.15.49:0/3095411954 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717396372 0 0) 0x7fd3cc0b22c0 con 0x7fd3cc0b3c60 2024-01-31T05:04:43.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.527+0000 7fd3caa00640 1 -- 172.21.15.49:0/3095411954 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3cc06c8f0 con 0x7fd3cc0b3c60 2024-01-31T05:04:43.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.527+0000 7fa54e400640 1 -- 172.21.15.49:0/598767131 shutdown_connections 2024-01-31T05:04:43.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.527+0000 7fa54e400640 1 --2- 172.21.15.49:0/598767131 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5480705d0 0x7fa54815d910 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.527+0000 7fa54e400640 1 -- 172.21.15.49:0/598767131 >> 172.21.15.49:0/598767131 conn(0x7fa5480b09a0 msgr2=0x7fa5480b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.527+0000 7fd3cbe00640 1 -- 172.21.15.49:0/3095411954 >> v1:172.21.15.195:6789/0 conn(0x7fd3cc0b3c60 legacy=0x7fd3cc070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.527+0000 7fd3cbe00640 1 -- 172.21.15.49:0/3095411954 >> v1:172.21.15.49:6789/0 conn(0x7fd3cc0b3580 legacy=0x7fd3cc070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.527+0000 7fd3cbe00640 1 -- 172.21.15.49:0/3095411954 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc06c580 con 0x7fd3cc1593d0 2024-01-31T05:04:43.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.527+0000 7fa54e400640 1 -- 172.21.15.49:0/598767131 shutdown_connections 2024-01-31T05:04:43.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.527+0000 7fa54e400640 1 -- 172.21.15.49:0/598767131 wait complete. 2024-01-31T05:04:43.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.527+0000 7fd93d200640 1 Processor -- start 2024-01-31T05:04:43.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.527+0000 7fd93d200640 1 -- start start 2024-01-31T05:04:43.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd93d200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd938070ad0 0x7fd93816c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd93d200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd938174f70 0x7fd93816fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd935e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd938070ad0 0x7fd93816c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd935e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd938070ad0 0x7fd93816c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38536/0 (socket says 172.21.15.49:38536) 2024-01-31T05:04:43.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd935e00640 1 -- 172.21.15.49:0/511367302 learned_addr learned my addr 172.21.15.49:0/511367302 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fa54e400640 1 Processor -- start 2024-01-31T05:04:43.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd93d200640 1 --2- 172.21.15.49:0/511367302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd938174160 0x7fd93816d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd935400640 1 --2- 172.21.15.49:0/511367302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd938174f70 0x7fd93816fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd3cbe00640 1 --2- 172.21.15.49:0/3095411954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3cc1593d0 0x7fd3cc0abd80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4007dd0 tx=0x7fd3c401cbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5c0fb70ca7814e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd93d200640 1 -- 172.21.15.49:0/511367302 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9381739d0 con 0x7fd938070ad0 2024-01-31T05:04:43.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd93d200640 1 -- 172.21.15.49:0/511367302 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93815f050 con 0x7fd938174f70 2024-01-31T05:04:43.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd93d200640 1 -- 172.21.15.49:0/511367302 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93815f330 con 0x7fd938174160 2024-01-31T05:04:43.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd936800640 1 --2- 172.21.15.49:0/511367302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd938174160 0x7fd93816d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd3caa00640 1 -- 172.21.15.49:0/3095411954 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c40a5bd0 con 0x7fd3cc1593d0 2024-01-31T05:04:43.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd3caa00640 1 -- 172.21.15.49:0/3095411954 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c40a5d30 con 0x7fd3cc1593d0 2024-01-31T05:04:43.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd3caa00640 1 -- 172.21.15.49:0/3095411954 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c40a5ea0 con 0x7fd3cc1593d0 2024-01-31T05:04:43.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd935400640 1 -- 172.21.15.49:0/511367302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd938174160 msgr2=0x7fd93816d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd935400640 1 --2- 172.21.15.49:0/511367302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd938174160 0x7fd93816d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd935400640 1 -- 172.21.15.49:0/511367302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd938070ad0 msgr2=0x7fd93816c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd935400640 1 --2- 172.21.15.49:0/511367302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd938070ad0 0x7fd93816c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd935400640 1 -- 172.21.15.49:0/511367302 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd938173c40 con 0x7fd938174f70 2024-01-31T05:04:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.531+0000 7fd935400640 1 --2- 172.21.15.49:0/511367302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd938174f70 0x7fd93816fa60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd92800e7f0 tx=0x7fd92800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.535+0000 7fd92e000640 1 -- 172.21.15.49:0/511367302 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92800eea0 con 0x7fd938174f70 2024-01-31T05:04:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.535+0000 7fd92e000640 1 -- 172.21.15.49:0/511367302 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92800c940 con 0x7fd938174f70 2024-01-31T05:04:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.535+0000 7fd92e000640 1 -- 172.21.15.49:0/511367302 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92800ccf0 con 0x7fd938174f70 2024-01-31T05:04:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.535+0000 7fd93d200640 1 -- 172.21.15.49:0/511367302 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9381753f0 con 0x7fd938174f70 2024-01-31T05:04:43.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.535+0000 7fd93d200640 1 -- 172.21.15.49:0/511367302 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93816ffa0 con 0x7fd938174f70 2024-01-31T05:04:43.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.535+0000 7fd3d1800640 1 -- 172.21.15.49:0/3095411954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3cc1593d0 msgr2=0x7fd3cc0abd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.535+0000 7fd3d1800640 1 --2- 172.21.15.49:0/3095411954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3cc1593d0 0x7fd3cc0abd80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4007dd0 tx=0x7fd3c401cbb0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.535+0000 7fa54e400640 1 -- start start 2024-01-31T05:04:43.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.535+0000 7fd93d200640 1 -- 172.21.15.49:0/511367302 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd93806b660 con 0x7fd938174f70 2024-01-31T05:04:43.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.535+0000 7fd3d1800640 1 -- 172.21.15.49:0/3095411954 shutdown_connections 2024-01-31T05:04:43.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.535+0000 7fd3d1800640 1 --2- 172.21.15.49:0/3095411954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3cc1593d0 0x7fd3cc0abd80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.535+0000 7fd3d1800640 1 -- 172.21.15.49:0/3095411954 >> 172.21.15.49:0/3095411954 conn(0x7fd3cc0b08c0 msgr2=0x7fd3cc0b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.535+0000 7fd3d1800640 1 -- 172.21.15.49:0/3095411954 shutdown_connections 2024-01-31T05:04:43.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.535+0000 7fd3d1800640 1 -- 172.21.15.49:0/3095411954 wait complete. 2024-01-31T05:04:43.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd3d1800640 1 Processor -- start 2024-01-31T05:04:43.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fa54e400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5480705d0 0x7fa54814f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd92e000640 1 -- 172.21.15.49:0/511367302 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd928013470 con 0x7fd938174f70 2024-01-31T05:04:43.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd92e000640 1 --2- 172.21.15.49:0/511367302 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd910066500 0x7fd9100689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd92e000640 1 -- 172.21.15.49:0/511367302 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd928084190 con 0x7fd938174f70 2024-01-31T05:04:43.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd3d1800640 1 -- start start 2024-01-31T05:04:43.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd3d1800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3cc0b3580 0x7fd3cc13fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd3d1800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3cc0b3c60 0x7fd3cc162ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd3d1800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3cc1593d0 0x7fd3cc1fa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd3d1800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc14c600 con 0x7fd3cc0b3c60 2024-01-31T05:04:43.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd3d1800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc13ea60 con 0x7fd3cc0b3580 2024-01-31T05:04:43.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd3d1800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc13ed40 con 0x7fd3cc1593d0 2024-01-31T05:04:43.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd3d0e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3cc1593d0 0x7fd3cc1fa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd3d0e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3cc1593d0 0x7fd3cc1fa2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:53032/0 (socket says 172.21.15.49:53032) 2024-01-31T05:04:43.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd3d0e00640 1 -- 172.21.15.49:0/3782284585 learned_addr learned my addr 172.21.15.49:0/3782284585 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fa54e400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5480709b0 0x7fa5481437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fa54e400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5480b1ca0 0x7fa548158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fa54e400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54814ed20 con 0x7fa5480709b0 2024-01-31T05:04:43.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fa54e400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54814f530 con 0x7fa5480705d0 2024-01-31T05:04:43.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fa54e400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54814fe40 con 0x7fa5480b1ca0 2024-01-31T05:04:43.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd935e00640 1 --2- 172.21.15.49:0/511367302 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd910066500 0x7fd9100689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fa547400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5480705d0 0x7fa54814f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd3d0e00640 1 -- 172.21.15.49:0/3782284585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3cc0b3580 msgr2=0x7fd3cc13fb00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-31T05:04:43.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd3d0e00640 1 --2- 172.21.15.49:0/3782284585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3cc0b3580 0x7fd3cc13fb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd3d0e00640 1 -- 172.21.15.49:0/3782284585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3cc0b3c60 msgr2=0x7fd3cc162ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd3d0e00640 1 --2- 172.21.15.49:0/3782284585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3cc0b3c60 0x7fd3cc162ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fd3d0e00640 1 -- 172.21.15.49:0/3782284585 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c4007a50 con 0x7fd3cc1593d0 2024-01-31T05:04:43.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.539+0000 7fa547e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5480b1ca0 0x7fa548158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fa547e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5480b1ca0 0x7fa548158a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:53044/0 (socket says 172.21.15.49:53044) 2024-01-31T05:04:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fa547e00640 1 -- 172.21.15.49:0/2232259879 learned_addr learned my addr 172.21.15.49:0/2232259879 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fd935e00640 1 --2- 172.21.15.49:0/511367302 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd910066500 0x7fd9100689c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd930005fd0 tx=0x7fd930005e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fd3d0e00640 1 --2- 172.21.15.49:0/3782284585 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3cc1593d0 0x7fd3cc1fa2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400c3c0 tx=0x7fd3b400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fa547400640 1 -- 172.21.15.49:0/2232259879 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5480b1ca0 msgr2=0x7fa548158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fa547400640 1 --2- 172.21.15.49:0/2232259879 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5480b1ca0 0x7fa548158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fa547400640 1 -- 172.21.15.49:0/2232259879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5480709b0 msgr2=0x7fa5481437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fa547400640 1 --2- 172.21.15.49:0/2232259879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5480709b0 0x7fa5481437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fa547400640 1 -- 172.21.15.49:0/2232259879 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa538009cb0 con 0x7fa5480705d0 2024-01-31T05:04:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fd3c3e00640 1 -- 172.21.15.49:0/3782284585 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4005cf0 con 0x7fd3cc1593d0 2024-01-31T05:04:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fd3c3e00640 1 -- 172.21.15.49:0/3782284585 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b4005e50 con 0x7fd3cc1593d0 2024-01-31T05:04:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fd3c3e00640 1 -- 172.21.15.49:0/3782284585 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4007310 con 0x7fd3cc1593d0 2024-01-31T05:04:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fa547400640 1 --2- 172.21.15.49:0/2232259879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5480705d0 0x7fa54814f900 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa5380ac000 tx=0x7fa53801b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fd3d1800640 1 -- 172.21.15.49:0/3782284585 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3cc13f020 con 0x7fd3cc1593d0 2024-01-31T05:04:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fa53f400640 1 -- 172.21.15.49:0/2232259879 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5380bb5f0 con 0x7fa5480705d0 2024-01-31T05:04:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fd3d1800640 1 -- 172.21.15.49:0/3782284585 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3cc13f5e0 con 0x7fd3cc1593d0 2024-01-31T05:04:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fa53f400640 1 -- 172.21.15.49:0/2232259879 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5380bb770 con 0x7fa5480705d0 2024-01-31T05:04:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fa53f400640 1 -- 172.21.15.49:0/2232259879 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5380bbb20 con 0x7fa5480705d0 2024-01-31T05:04:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fa54e400640 1 -- 172.21.15.49:0/2232259879 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54814ef70 con 0x7fa5480705d0 2024-01-31T05:04:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fa54e400640 1 -- 172.21.15.49:0/2232259879 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa548158210 con 0x7fa5480705d0 2024-01-31T05:04:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fd3d1800640 1 -- 172.21.15.49:0/3782284585 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39c0052a0 con 0x7fd3cc1593d0 2024-01-31T05:04:43.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fd92e000640 1 -- 172.21.15.49:0/511367302 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd9280511e0 con 0x7fd938174f70 2024-01-31T05:04:43.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.543+0000 7fa54e400640 1 -- 172.21.15.49:0/2232259879 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5180052a0 con 0x7fa5480705d0 2024-01-31T05:04:43.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.547+0000 7fd3c3e00640 1 -- 172.21.15.49:0/3782284585 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd3b4007470 con 0x7fd3cc1593d0 2024-01-31T05:04:43.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.547+0000 7fa53f400640 1 -- 172.21.15.49:0/2232259879 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa5380b33f0 con 0x7fa5480705d0 2024-01-31T05:04:43.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.547+0000 7fd3c3e00640 1 --2- 172.21.15.49:0/3782284585 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd3a40665d0 0x7fd3a4068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.551+0000 7fd3c3e00640 1 -- 172.21.15.49:0/3782284585 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd3b4083590 con 0x7fd3cc1593d0 2024-01-31T05:04:43.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.551+0000 7fa53f400640 1 --2- 172.21.15.49:0/2232259879 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa5200665d0 0x7fa520068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.551+0000 7fa53f400640 1 -- 172.21.15.49:0/2232259879 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa53811f460 con 0x7fa5480705d0 2024-01-31T05:04:43.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.551+0000 7fd3cbe00640 1 --2- 172.21.15.49:0/3782284585 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd3a40665d0 0x7fd3a4068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.551+0000 7fa546a00640 1 --2- 172.21.15.49:0/2232259879 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa5200665d0 0x7fa520068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.551+0000 7fa53f400640 1 -- 172.21.15.49:0/2232259879 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa5380ec4e0 con 0x7fa5480705d0 2024-01-31T05:04:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.551+0000 7fd3cbe00640 1 --2- 172.21.15.49:0/3782284585 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd3a40665d0 0x7fd3a4068a90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40ae000 tx=0x7fd3c40a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.555+0000 7fd3c3e00640 1 -- 172.21.15.49:0/3782284585 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd3b40505d0 con 0x7fd3cc1593d0 2024-01-31T05:04:43.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.559+0000 7fa546a00640 1 --2- 172.21.15.49:0/2232259879 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa5200665d0 0x7fa520068a90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa530007fd0 tx=0x7fa530007960 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.571+0000 7fceb3e00640 1 Processor -- start 2024-01-31T05:04:43.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.571+0000 7fceb3e00640 1 -- start start 2024-01-31T05:04:43.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.571+0000 7fceb3e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fceb41593d0 0x7fceb40abd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.571+0000 7fceb3e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fceb40b3c60 0x7fceb4070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.571+0000 7fceb3e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fceb40b13e0 0x7fceb40708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.571+0000 7fceb3e00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb406c8f0 con 0x7fceb40b13e0 2024-01-31T05:04:43.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.571+0000 7fceb3e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb40b22c0 con 0x7fceb40b3c60 2024-01-31T05:04:43.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.571+0000 7fceb3e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb406c2a0 con 0x7fceb41593d0 2024-01-31T05:04:43.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.571+0000 7fceb2000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fceb40b3c60 0x7fceb4070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.575+0000 7fceb2000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fceb40b3c60 0x7fceb4070380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41608/0 (socket says 172.21.15.49:41608) 2024-01-31T05:04:43.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.575+0000 7fceb2000640 1 -- 172.21.15.49:0/3805602602 learned_addr learned my addr 172.21.15.49:0/3805602602 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.575+0000 7fceb3400640 1 --2- 172.21.15.49:0/3805602602 >> v2:172.21.15.49:3300/0 conn(0x7fceb40b13e0 0x7fceb40708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.575+0000 7fceb2000640 1 -- 172.21.15.49:0/3805602602 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fceb41593d0 msgr2=0x7fceb40abd80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-31T05:04:43.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.575+0000 7fceb2000640 1 --2- 172.21.15.49:0/3805602602 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fceb41593d0 0x7fceb40abd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.575+0000 7fceb2000640 1 -- 172.21.15.49:0/3805602602 >> v2:172.21.15.49:3300/0 conn(0x7fceb40b13e0 msgr2=0x7fceb40708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.575+0000 7fceb2000640 1 --2- 172.21.15.49:0/3805602602 >> v2:172.21.15.49:3300/0 conn(0x7fceb40b13e0 0x7fceb40708c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.575+0000 7fceb2000640 1 -- 172.21.15.49:0/3805602602 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb406c580 con 0x7fceb40b3c60 2024-01-31T05:04:43.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.579+0000 7fceb2000640 1 --2- 172.21.15.49:0/3805602602 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fceb40b3c60 0x7fceb4070380 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fceb406b830 tx=0x7fce9c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa00b0d61eb4b415 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.579+0000 7fceb1600640 1 -- 172.21.15.49:0/3805602602 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c0ab600 con 0x7fceb40b3c60 2024-01-31T05:04:43.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.579+0000 7fceb1600640 1 -- 172.21.15.49:0/3805602602 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c0a7050 con 0x7fceb40b3c60 2024-01-31T05:04:43.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.579+0000 7fceb1600640 1 -- 172.21.15.49:0/3805602602 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c0ab980 con 0x7fceb40b3c60 2024-01-31T05:04:43.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.579+0000 7fceb3e00640 1 -- 172.21.15.49:0/3805602602 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fceb40b3c60 msgr2=0x7fceb4070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.579+0000 7fceb3e00640 1 --2- 172.21.15.49:0/3805602602 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fceb40b3c60 0x7fceb4070380 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fceb406b830 tx=0x7fce9c01c470 comp rx=0 tx=0).stop 2024-01-31T05:04:43.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.583+0000 7fceb3e00640 1 -- 172.21.15.49:0/3805602602 shutdown_connections 2024-01-31T05:04:43.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.583+0000 7fceb3e00640 1 --2- 172.21.15.49:0/3805602602 >> v2:172.21.15.49:3300/0 conn(0x7fceb40b13e0 0x7fceb40708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.583+0000 7fceb3e00640 1 --2- 172.21.15.49:0/3805602602 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fceb40b3c60 0x7fceb4070380 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.583+0000 7fceb3e00640 1 --2- 172.21.15.49:0/3805602602 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fceb41593d0 0x7fceb40abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.583+0000 7fceb3e00640 1 -- 172.21.15.49:0/3805602602 >> 172.21.15.49:0/3805602602 conn(0x7fceb40b08c0 msgr2=0x7fceb40b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.583+0000 7fceb3e00640 1 -- 172.21.15.49:0/3805602602 shutdown_connections 2024-01-31T05:04:43.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.583+0000 7fceb3e00640 1 -- 172.21.15.49:0/3805602602 wait complete. 2024-01-31T05:04:43.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.583+0000 7f68b9400640 1 Processor -- start 2024-01-31T05:04:43.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.583+0000 7f68b9400640 1 -- start start 2024-01-31T05:04:43.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.583+0000 7f68b9400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f68b4072270 0x7f68b406c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.583+0000 7f68b9400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b4161a10 con 0x7f68b406ce50 2024-01-31T05:04:43.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.583+0000 7f68b9400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b40abd80 con 0x7f68b406c530 2024-01-31T05:04:43.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.583+0000 7f68b9400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b4070ad0 con 0x7f68b4072270 2024-01-31T05:04:43.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.583+0000 7fceb3e00640 1 Processor -- start 2024-01-31T05:04:43.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.587+0000 7fceb3e00640 1 -- start start 2024-01-31T05:04:43.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.587+0000 7f68b1e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f68b4072270 0x7f68b406c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.587+0000 7f68b1e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f68b4072270 0x7f68b406c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38568/0 (socket says 172.21.15.49:38568) 2024-01-31T05:04:43.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.587+0000 7f68b1e00640 1 -- 172.21.15.49:0/3503498926 learned_addr learned my addr 172.21.15.49:0/3503498926 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.587+0000 7f68b1e00640 1 -- 172.21.15.49:0/3503498926 >> v1:172.21.15.195:6789/0 conn(0x7f68b406c530 legacy=0x7f68b40703c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-31T05:04:43.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.587+0000 7fceb3e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fceb40b13e0 0x7fceb4153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.587+0000 7f68b1e00640 1 -- 172.21.15.49:0/3503498926 >> v1:172.21.15.49:6789/0 conn(0x7f68b406ce50 legacy=0x7f68b40acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.587+0000 7fceb3e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fceb40b3c60 0x7fceb42022b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.587+0000 7fceb3e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fceb41593d0 0x7fceb42027f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.587+0000 7f68b1e00640 1 -- 172.21.15.49:0/3503498926 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b40abfd0 con 0x7f68b4072270 2024-01-31T05:04:43.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.587+0000 7fceb2000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fceb40b3c60 0x7fceb42022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.587+0000 7fceb2000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fceb40b3c60 0x7fceb42022b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41618/0 (socket says 172.21.15.49:41618) 2024-01-31T05:04:43.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.587+0000 7fceb3e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb4149bf0 con 0x7fceb40b13e0 2024-01-31T05:04:43.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.587+0000 7fceb3e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb4148f70 con 0x7fceb40b3c60 2024-01-31T05:04:43.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.587+0000 7fceb3e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb4149250 con 0x7fceb41593d0 2024-01-31T05:04:43.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.591+0000 7fceb3400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fceb41593d0 0x7fceb42027f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.591+0000 7fceb3400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fceb41593d0 0x7fceb42027f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:53052/0 (socket says 172.21.15.49:53052) 2024-01-31T05:04:43.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.591+0000 7fceb3400640 1 -- 172.21.15.49:0/350475647 learned_addr learned my addr 172.21.15.49:0/350475647 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.591+0000 7fceb2a00640 1 --2- 172.21.15.49:0/350475647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fceb40b13e0 0x7fceb4153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.591+0000 7fceb3400640 1 -- 172.21.15.49:0/350475647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fceb40b3c60 msgr2=0x7fceb42022b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.591+0000 7fceb3400640 1 --2- 172.21.15.49:0/350475647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fceb40b3c60 0x7fceb42022b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.591+0000 7fceb3400640 1 -- 172.21.15.49:0/350475647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fceb40b13e0 msgr2=0x7fceb4153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.591+0000 7fceb3400640 1 --2- 172.21.15.49:0/350475647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fceb40b13e0 0x7fceb4153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.591+0000 7fceb3400640 1 -- 172.21.15.49:0/350475647 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c0094d0 con 0x7fceb41593d0 2024-01-31T05:04:43.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.591+0000 7fceb3400640 1 --2- 172.21.15.49:0/350475647 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fceb41593d0 0x7fceb42027f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcea400cd70 tx=0x7fcea400a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.591+0000 7fceb2000640 1 --2- 172.21.15.49:0/350475647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fceb40b3c60 0x7fceb42022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-01-31T05:04:43.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.591+0000 7fceaaa00640 1 -- 172.21.15.49:0/350475647 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4003ba0 con 0x7fceb41593d0 2024-01-31T05:04:43.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.591+0000 7fceaaa00640 1 -- 172.21.15.49:0/350475647 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea4003d00 con 0x7fceb41593d0 2024-01-31T05:04:43.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.591+0000 7fceaaa00640 1 -- 172.21.15.49:0/350475647 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4004240 con 0x7fceb41593d0 2024-01-31T05:04:43.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.591+0000 7fceb3e00640 1 -- 172.21.15.49:0/350475647 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb4149530 con 0x7fceb41593d0 2024-01-31T05:04:43.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.595+0000 7f68b1e00640 1 --2- 172.21.15.49:0/3503498926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68b4072270 0x7f68b406c910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f68a4009870 tx=0x7f68a401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8288e225c773581 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.591+0000 7fceb3e00640 1 -- 172.21.15.49:0/350475647 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb4203930 con 0x7fceb41593d0 2024-01-31T05:04:43.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.595+0000 7fceb3e00640 1 -- 172.21.15.49:0/350475647 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb4149d30 con 0x7fceb41593d0 2024-01-31T05:04:43.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.595+0000 7fceaaa00640 1 -- 172.21.15.49:0/350475647 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fcea40043a0 con 0x7fceb41593d0 2024-01-31T05:04:43.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.595+0000 7f68b1400640 1 -- 172.21.15.49:0/3503498926 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a40ac410 con 0x7f68b4072270 2024-01-31T05:04:43.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.595+0000 7fceaaa00640 1 --2- 172.21.15.49:0/350475647 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fce8c066500 0x7fce8c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.595+0000 7fceaaa00640 1 -- 172.21.15.49:0/350475647 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcea4012070 con 0x7fceb41593d0 2024-01-31T05:04:43.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.595+0000 7f68b1400640 1 -- 172.21.15.49:0/3503498926 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a40ac570 con 0x7f68b4072270 2024-01-31T05:04:43.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.595+0000 7f68b1400640 1 -- 172.21.15.49:0/3503498926 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a40ac900 con 0x7f68b4072270 2024-01-31T05:04:43.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.599+0000 7f68b9400640 1 -- 172.21.15.49:0/3503498926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68b4072270 msgr2=0x7f68b406c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.599+0000 7f68b9400640 1 --2- 172.21.15.49:0/3503498926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68b4072270 0x7f68b406c910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f68a4009870 tx=0x7f68a401c4c0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.599+0000 7f68b9400640 1 -- 172.21.15.49:0/3503498926 shutdown_connections 2024-01-31T05:04:43.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.599+0000 7fceb2a00640 1 --2- 172.21.15.49:0/350475647 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fce8c066500 0x7fce8c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.599+0000 7f68b9400640 1 --2- 172.21.15.49:0/3503498926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68b4072270 0x7f68b406c910 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.599+0000 7f68b9400640 1 -- 172.21.15.49:0/3503498926 >> 172.21.15.49:0/3503498926 conn(0x7f68b40b09a0 msgr2=0x7f68b40b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.599+0000 7fceaaa00640 1 -- 172.21.15.49:0/350475647 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fceb4149d30 con 0x7fceb41593d0 2024-01-31T05:04:43.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.599+0000 7fceb2a00640 1 --2- 172.21.15.49:0/350475647 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fce8c066500 0x7fce8c0689c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fceb41530d0 tx=0x7fceac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.599+0000 7f68b9400640 1 -- 172.21.15.49:0/3503498926 shutdown_connections 2024-01-31T05:04:43.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.599+0000 7f68b9400640 1 -- 172.21.15.49:0/3503498926 wait complete. 2024-01-31T05:04:43.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.603+0000 7f68b9400640 1 Processor -- start 2024-01-31T05:04:43.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.603+0000 7f68b9400640 1 -- start start 2024-01-31T05:04:43.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.607+0000 7f68b9400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68b406c530 0x7f68b4206fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.607+0000 7f68b9400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68b406ce50 0x7f68b4160a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.607+0000 7f68b9400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68b4072270 0x7f68b4150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.607+0000 7f68b2800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68b406c530 0x7f68b4206fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.607+0000 7f68b2800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68b406c530 0x7f68b4206fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41632/0 (socket says 172.21.15.49:41632) 2024-01-31T05:04:43.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.607+0000 7f68b9400640 1 -- 172.21.15.49:0/3223256187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b4207510 con 0x7f68b406ce50 2024-01-31T05:04:43.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.607+0000 7f68b9400640 1 -- 172.21.15.49:0/3223256187 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b415f320 con 0x7f68b406c530 2024-01-31T05:04:43.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.607+0000 7f68b9400640 1 -- 172.21.15.49:0/3223256187 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b415aac0 con 0x7f68b4072270 2024-01-31T05:04:43.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.607+0000 7f68b2800640 1 -- 172.21.15.49:0/3223256187 learned_addr learned my addr 172.21.15.49:0/3223256187 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.607+0000 7f68b3200640 1 --2- 172.21.15.49:0/3223256187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68b4072270 0x7f68b4150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.607+0000 7f68b3200640 1 -- 172.21.15.49:0/3223256187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68b406c530 msgr2=0x7f68b4206fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.607+0000 7f68b3200640 1 --2- 172.21.15.49:0/3223256187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68b406c530 0x7f68b4206fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.607+0000 7f68b3200640 1 -- 172.21.15.49:0/3223256187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68b406ce50 msgr2=0x7f68b4160a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.607+0000 7f68b3200640 1 --2- 172.21.15.49:0/3223256187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68b406ce50 0x7f68b4160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.607+0000 7f68b3200640 1 -- 172.21.15.49:0/3223256187 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a40094d0 con 0x7f68b4072270 2024-01-31T05:04:43.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.611+0000 7f68b3200640 1 --2- 172.21.15.49:0/3223256187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68b4072270 0x7f68b4150a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f689c00c410 tx=0x7f689c00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.611+0000 7f68aaa00640 1 -- 172.21.15.49:0/3223256187 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c003600 con 0x7f68b4072270 2024-01-31T05:04:43.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.611+0000 7f68aaa00640 1 -- 172.21.15.49:0/3223256187 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689c003760 con 0x7f68b4072270 2024-01-31T05:04:43.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.611+0000 7f68aaa00640 1 -- 172.21.15.49:0/3223256187 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c003b50 con 0x7f68b4072270 2024-01-31T05:04:43.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.611+0000 7f68b9400640 1 -- 172.21.15.49:0/3223256187 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b415f040 con 0x7f68b4072270 2024-01-31T05:04:43.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.611+0000 7f68b9400640 1 -- 172.21.15.49:0/3223256187 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b415aff0 con 0x7f68b4072270 2024-01-31T05:04:43.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.615+0000 7f68aaa00640 1 -- 172.21.15.49:0/3223256187 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f689c003cb0 con 0x7f68b4072270 2024-01-31T05:04:43.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.615+0000 7f68aaa00640 1 --2- 172.21.15.49:0/3223256187 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f688c066550 0x7f688c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.615+0000 7f68b9400640 1 -- 172.21.15.49:0/3223256187 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b4067c80 con 0x7f68b4072270 2024-01-31T05:04:43.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.615+0000 7f68b2800640 1 --2- 172.21.15.49:0/3223256187 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f688c066550 0x7f688c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.615+0000 7f68aaa00640 1 -- 172.21.15.49:0/3223256187 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f689c054af0 con 0x7f68b4072270 2024-01-31T05:04:43.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.619+0000 7f68b2800640 1 --2- 172.21.15.49:0/3223256187 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f688c066550 0x7f688c068a10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009f90 tx=0x7f68ac0095b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.627+0000 7f68aaa00640 1 -- 172.21.15.49:0/3223256187 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f689c050ec0 con 0x7f68b4072270 2024-01-31T05:04:43.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.639+0000 7f4c7e000640 1 Processor -- start 2024-01-31T05:04:43.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.639+0000 7f2de9000640 1 Processor -- start 2024-01-31T05:04:43.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.639+0000 7f2de9000640 1 -- start start 2024-01-31T05:04:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.639+0000 7f4c7e000640 1 -- start start 2024-01-31T05:04:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.639+0000 7f2de9000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2de415e3e0 0x7f2de40b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de9000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40703c0 0x7f2de4070830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de9000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de415e860 con 0x7f2de406dab0 2024-01-31T05:04:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de9000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de4070d70 con 0x7f2de415e3e0 2024-01-31T05:04:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de9000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de40b3eb0 con 0x7f2de40703c0 2024-01-31T05:04:43.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c7e000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4c7815a4b0 0x7f4c7806ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de1e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f2de406dab0 0x7f2de40b36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:50586/0 (socket says 172.21.15.49:50586) 2024-01-31T05:04:43.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de1e00640 1 -- 172.21.15.49:0/2957584336 learned_addr learned my addr 172.21.15.49:0/2957584336 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:43.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de1400640 1 --2- 172.21.15.49:0/2957584336 >> v2:172.21.15.49:3300/0 conn(0x7f2de415e3e0 0x7f2de40b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c7cc00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f4c78070490 0x7f4c78070870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:50594/0 (socket says 172.21.15.49:50594) 2024-01-31T05:04:43.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c7cc00640 1 -- 172.21.15.49:0/975857782 learned_addr learned my addr 172.21.15.49:0/975857782 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:43.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de0a00640 1 -- 172.21.15.49:0/2957584336 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669806179 0 0) 0x7f2dd4001120 con 0x7f2de406dab0 2024-01-31T05:04:43.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de2800640 1 --2- 172.21.15.49:0/2957584336 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40703c0 0x7f2de4070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de0a00640 1 -- 172.21.15.49:0/2957584336 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dc4003530 con 0x7f2de406dab0 2024-01-31T05:04:43.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c7e000640 1 -- 172.21.15.49:0/975857782 --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c7813c8e0 con 0x7f4c780cddb0 2024-01-31T05:04:43.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c7e000640 1 -- 172.21.15.49:0/975857782 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c7806d260 con 0x7f4c78070490 2024-01-31T05:04:43.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c7e000640 1 -- 172.21.15.49:0/975857782 --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c7806d540 con 0x7f4c7815a4b0 2024-01-31T05:04:43.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de0a00640 1 -- 172.21.15.49:0/2957584336 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 733278436 0 0) 0x7f2dc4003530 con 0x7f2de406dab0 2024-01-31T05:04:43.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de0a00640 1 -- 172.21.15.49:0/2957584336 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40703c0 msgr2=0x7f2de4070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de0a00640 1 --2- 172.21.15.49:0/2957584336 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40703c0 0x7f2de4070830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c77400640 1 -- 172.21.15.49:0/975857782 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955146028 0 0) 0x7f4c7806d260 con 0x7f4c78070490 2024-01-31T05:04:43.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c77400640 1 -- 172.21.15.49:0/975857782 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c58003530 con 0x7f4c78070490 2024-01-31T05:04:43.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de0a00640 1 -- 172.21.15.49:0/2957584336 >> v2:172.21.15.49:3300/0 conn(0x7f2de415e3e0 msgr2=0x7f2de40b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de0a00640 1 --2- 172.21.15.49:0/2957584336 >> v2:172.21.15.49:3300/0 conn(0x7f2de415e3e0 0x7f2de40b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de0a00640 1 -- 172.21.15.49:0/2957584336 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de40b20e0 con 0x7f2de406dab0 2024-01-31T05:04:43.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de0a00640 1 -- 172.21.15.49:0/2957584336 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7f2dd4001810 con 0x7f2de406dab0 2024-01-31T05:04:43.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de0a00640 1 -- 172.21.15.49:0/2957584336 >> v1:172.21.15.195:6789/0 conn(0x7f2de406dab0 legacy=0x7f2de40b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de0a00640 1 --2- 172.21.15.49:0/2957584336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dc4003980 0x7f2dc4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de0a00640 1 --2- 172.21.15.49:0/2957584336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dc40047d0 0x7f2dc4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de0a00640 1 --2- 172.21.15.49:0/2957584336 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40703c0 0x7f2dc4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de0a00640 1 -- 172.21.15.49:0/2957584336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4070d70 con 0x7f2dc40047d0 2024-01-31T05:04:43.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de0a00640 1 -- 172.21.15.49:0/2957584336 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de40b3eb0 con 0x7f2dc4003980 2024-01-31T05:04:43.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de0a00640 1 -- 172.21.15.49:0/2957584336 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc400b990 con 0x7f2de40703c0 2024-01-31T05:04:43.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de1e00640 1 --2- 172.21.15.49:0/2957584336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dc4003980 0x7f2dc4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de2800640 1 --2- 172.21.15.49:0/2957584336 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40703c0 0x7f2dc4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c77400640 1 -- 172.21.15.49:0/975857782 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1870541852 0 0) 0x7f4c58003530 con 0x7f4c78070490 2024-01-31T05:04:43.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c77400640 1 -- 172.21.15.49:0/975857782 >> v2:172.21.15.49:3300/0 conn(0x7f4c7815a4b0 msgr2=0x7f4c7806ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c77400640 1 --2- 172.21.15.49:0/975857782 >> v2:172.21.15.49:3300/0 conn(0x7f4c7815a4b0 0x7f4c7806ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c77400640 1 -- 172.21.15.49:0/975857782 >> v1:172.21.15.49:6789/0 conn(0x7f4c780cddb0 legacy=0x7f4c780ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c77400640 1 -- 172.21.15.49:0/975857782 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7806d820 con 0x7f4c78070490 2024-01-31T05:04:43.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c77400640 1 -- 172.21.15.49:0/975857782 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7f4c68001680 con 0x7f4c78070490 2024-01-31T05:04:43.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c77400640 1 -- 172.21.15.49:0/975857782 >> v1:172.21.15.195:6789/0 conn(0x7f4c78070490 legacy=0x7f4c78070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c77400640 1 --2- 172.21.15.49:0/975857782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c58003980 0x7f4c58003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c77400640 1 --2- 172.21.15.49:0/975857782 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c580047d0 0x7f4c58004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c77400640 1 --2- 172.21.15.49:0/975857782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c58005190 0x7f4c58014590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de2800640 1 -- 172.21.15.49:0/2957584336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dc4003980 msgr2=0x7f2dc4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de2800640 1 --2- 172.21.15.49:0/2957584336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dc4003980 0x7f2dc4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de2800640 1 -- 172.21.15.49:0/2957584336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dc40047d0 msgr2=0x7f2dc4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de2800640 1 --2- 172.21.15.49:0/2957584336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dc40047d0 0x7f2dc4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f2de2800640 1 -- 172.21.15.49:0/2957584336 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de40b20e0 con 0x7f2de40703c0 2024-01-31T05:04:43.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c77400640 1 -- 172.21.15.49:0/975857782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7806d540 con 0x7f4c58003980 2024-01-31T05:04:43.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c7d600640 1 --2- 172.21.15.49:0/975857782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c58005190 0x7f4c58014590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c77400640 1 -- 172.21.15.49:0/975857782 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c58014ad0 con 0x7f4c58005190 2024-01-31T05:04:43.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.643+0000 7f4c77400640 1 -- 172.21.15.49:0/975857782 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c58014c10 con 0x7f4c580047d0 2024-01-31T05:04:43.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.647+0000 7f4c7d600640 1 -- 172.21.15.49:0/975857782 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c580047d0 msgr2=0x7f4c58004c50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-31T05:04:43.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.647+0000 7f4c77e00640 1 --2- 172.21.15.49:0/975857782 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c580047d0 0x7f4c58004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.647+0000 7f4c7d600640 1 --2- 172.21.15.49:0/975857782 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c580047d0 0x7f4c58004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.647+0000 7f4c7d600640 1 -- 172.21.15.49:0/975857782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c58003980 msgr2=0x7f4c58003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.647+0000 7f4c7cc00640 1 --2- 172.21.15.49:0/975857782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c58003980 0x7f4c58003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.647+0000 7f4c7d600640 1 --2- 172.21.15.49:0/975857782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c58003980 0x7f4c58003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.647+0000 7f4c7d600640 1 -- 172.21.15.49:0/975857782 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7806d820 con 0x7f4c58005190 2024-01-31T05:04:43.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.651+0000 7f4c77e00640 1 --2- 172.21.15.49:0/975857782 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c580047d0 0x7f4c58004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:43.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.651+0000 7f4c7cc00640 1 --2- 172.21.15.49:0/975857782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c58003980 0x7f4c58003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:43.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.651+0000 7f2de2800640 1 --2- 172.21.15.49:0/2957584336 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40703c0 0x7f2dc4005190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc009fc0 tx=0x7f2ddc01cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1707be339ebab67 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.651+0000 7f2de0a00640 1 -- 172.21.15.49:0/2957584336 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc0a5cb0 con 0x7f2de40703c0 2024-01-31T05:04:43.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.651+0000 7f2de0a00640 1 -- 172.21.15.49:0/2957584336 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ddc00f040 con 0x7f2de40703c0 2024-01-31T05:04:43.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.651+0000 7f2de9000640 1 -- 172.21.15.49:0/2957584336 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40703c0 msgr2=0x7f2dc4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.651+0000 7f2de0a00640 1 -- 172.21.15.49:0/2957584336 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc0a5cb0 con 0x7f2de40703c0 2024-01-31T05:04:43.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.651+0000 7f2de9000640 1 --2- 172.21.15.49:0/2957584336 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40703c0 0x7f2dc4005190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc009fc0 tx=0x7f2ddc01cca0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.651+0000 7f2de2800640 1 -- 172.21.15.49:0/2957584336 reap_dead start 2024-01-31T05:04:43.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.651+0000 7f2de9000640 1 -- 172.21.15.49:0/2957584336 shutdown_connections 2024-01-31T05:04:43.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.651+0000 7f2de9000640 1 -- 172.21.15.49:0/2957584336 >> 172.21.15.49:0/2957584336 conn(0x7f2de40b09a0 msgr2=0x7f2de40b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.651+0000 7f2de9000640 1 -- 172.21.15.49:0/2957584336 shutdown_connections 2024-01-31T05:04:43.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.651+0000 7f2de9000640 1 -- 172.21.15.49:0/2957584336 wait complete. 2024-01-31T05:04:43.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.655+0000 7f4c7d600640 1 -- 172.21.15.49:0/975857782 reap_dead start 2024-01-31T05:04:43.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.655+0000 7f4c7d600640 1 --2- 172.21.15.49:0/975857782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c58005190 0x7f4c58014590 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4c60001680 tx=0x7f4c6001c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=317abd191c3f2a47 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.655+0000 7f2de9000640 1 Processor -- start 2024-01-31T05:04:43.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.655+0000 7f2de9000640 1 -- start start 2024-01-31T05:04:43.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f4c77400640 1 -- 172.21.15.49:0/975857782 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60005270 con 0x7f4c58005190 2024-01-31T05:04:43.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f4c77400640 1 -- 172.21.15.49:0/975857782 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c600a7070 con 0x7f4c58005190 2024-01-31T05:04:43.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f4c77400640 1 -- 172.21.15.49:0/975857782 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60003600 con 0x7f4c58005190 2024-01-31T05:04:43.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f2de9000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2de40703c0 0x7f2de41f38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f2de9000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de40cb1b0 0x7f2de414b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f2de9000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40cb630 0x7f2de414ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f2de1e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2de40703c0 0x7f2de41f38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f2de1e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2de40703c0 0x7f2de41f38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38636/0 (socket says 172.21.15.49:38636) 2024-01-31T05:04:43.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f2de1400640 1 --2- 172.21.15.49:0/3840094993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de40cb1b0 0x7f2de414b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f2de1e00640 1 -- 172.21.15.49:0/3840094993 learned_addr learned my addr 172.21.15.49:0/3840094993 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f2de9000640 1 -- 172.21.15.49:0/3840094993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de414ef90 con 0x7f2de40703c0 2024-01-31T05:04:43.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f2de9000640 1 -- 172.21.15.49:0/3840094993 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de414e380 con 0x7f2de40cb1b0 2024-01-31T05:04:43.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f2de9000640 1 -- 172.21.15.49:0/3840094993 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de414e660 con 0x7f2de40cb630 2024-01-31T05:04:43.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f2de2800640 1 --2- 172.21.15.49:0/3840094993 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40cb630 0x7f2de414ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f2de2800640 1 -- 172.21.15.49:0/3840094993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de40cb1b0 msgr2=0x7f2de414b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f2de2800640 1 --2- 172.21.15.49:0/3840094993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de40cb1b0 0x7f2de414b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f4c7e000640 1 -- 172.21.15.49:0/975857782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c58005190 msgr2=0x7f4c58014590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f4c7e000640 1 --2- 172.21.15.49:0/975857782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c58005190 0x7f4c58014590 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4c60001680 tx=0x7f4c6001c300 comp rx=0 tx=0).stop 2024-01-31T05:04:43.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f2de2800640 1 -- 172.21.15.49:0/3840094993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2de40703c0 msgr2=0x7f2de41f38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f2de2800640 1 --2- 172.21.15.49:0/3840094993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2de40703c0 0x7f2de41f38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f2de2800640 1 -- 172.21.15.49:0/3840094993 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de414e940 con 0x7f2de40cb630 2024-01-31T05:04:43.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f4c7e000640 1 -- 172.21.15.49:0/975857782 shutdown_connections 2024-01-31T05:04:43.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f4c7e000640 1 --2- 172.21.15.49:0/975857782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c58005190 0x7f4c58014590 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f4c7e000640 1 -- 172.21.15.49:0/975857782 >> 172.21.15.49:0/975857782 conn(0x7f4c780b0890 msgr2=0x7f4c780b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f2de1e00640 1 --2- 172.21.15.49:0/3840094993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2de40703c0 0x7f2de41f38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:04:43.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f2de1400640 1 --2- 172.21.15.49:0/3840094993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de40cb1b0 0x7f2de414b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:43.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f4c7e000640 1 -- 172.21.15.49:0/975857782 shutdown_connections 2024-01-31T05:04:43.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f4c7e000640 1 -- 172.21.15.49:0/975857782 wait complete. 2024-01-31T05:04:43.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.659+0000 7f2de2800640 1 --2- 172.21.15.49:0/3840094993 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40cb630 0x7f2de414ba00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc0ac000 tx=0x7f2ddc009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.663+0000 7f2dda000640 1 -- 172.21.15.49:0/3840094993 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc0ada60 con 0x7f2de40cb630 2024-01-31T05:04:43.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.663+0000 7f2dda000640 1 -- 172.21.15.49:0/3840094993 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ddc0adbc0 con 0x7f2de40cb630 2024-01-31T05:04:43.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.663+0000 7f2dda000640 1 -- 172.21.15.49:0/3840094993 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc0b6460 con 0x7f2de40cb630 2024-01-31T05:04:43.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.663+0000 7f2de9000640 1 -- 172.21.15.49:0/3840094993 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de414ec20 con 0x7f2de40cb630 2024-01-31T05:04:43.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.663+0000 7f2de9000640 1 -- 172.21.15.49:0/3840094993 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de41f3130 con 0x7f2de40cb630 2024-01-31T05:04:43.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.663+0000 7f4c7e000640 1 Processor -- start 2024-01-31T05:04:43.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.663+0000 7f2de9000640 1 -- 172.21.15.49:0/3840094993 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db40052a0 con 0x7f2de40cb630 2024-01-31T05:04:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.667+0000 7f4c7e000640 1 -- start start 2024-01-31T05:04:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.667+0000 7f4c7e000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c58005190 0x7f4c78152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.667+0000 7f4c7e000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c780cd980 0x7f4c780cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.667+0000 7f4c7e000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c78137680 0x7f4c780cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.667+0000 7f2dda000640 1 -- 172.21.15.49:0/3840094993 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f2ddc0b4070 con 0x7f2de40cb630 2024-01-31T05:04:43.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.667+0000 7f4c7e000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7813bd60 con 0x7f4c58005190 2024-01-31T05:04:43.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.667+0000 7f4c7e000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c78138940 con 0x7f4c78137680 2024-01-31T05:04:43.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.667+0000 7f4c7e000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7813fae0 con 0x7f4c780cd980 2024-01-31T05:04:43.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.667+0000 7f4c7cc00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c58005190 0x7f4c78152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.667+0000 7f4c77e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c780cd980 0x7f4c780cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.667+0000 7f4c7cc00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c58005190 0x7f4c78152810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38644/0 (socket says 172.21.15.49:38644) 2024-01-31T05:04:43.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.667+0000 7f4c7cc00640 1 -- 172.21.15.49:0/3259503364 learned_addr learned my addr 172.21.15.49:0/3259503364 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.667+0000 7f4c7cc00640 1 -- 172.21.15.49:0/3259503364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c780cd980 msgr2=0x7f4c780cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.667+0000 7f2dda000640 1 --2- 172.21.15.49:0/3840094993 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2dbc066530 0x7f2dbc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.667+0000 7f4c7cc00640 1 --2- 172.21.15.49:0/3259503364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c780cd980 0x7f4c780cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.667+0000 7f4c7cc00640 1 -- 172.21.15.49:0/3259503364 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c78137680 msgr2=0x7f4c780cc310 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-31T05:04:43.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.667+0000 7f4c7cc00640 1 --2- 172.21.15.49:0/3259503364 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c78137680 0x7f4c780cc310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.667+0000 7f4c7cc00640 1 -- 172.21.15.49:0/3259503364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7813fdc0 con 0x7f4c58005190 2024-01-31T05:04:43.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.667+0000 7f4c77e00640 1 --2- 172.21.15.49:0/3259503364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c780cd980 0x7f4c780cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:43.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.671+0000 7f2dda000640 1 -- 172.21.15.49:0/3840094993 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2ddc11ccd0 con 0x7f2de40cb630 2024-01-31T05:04:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.671+0000 7f4c7cc00640 1 --2- 172.21.15.49:0/3259503364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c58005190 0x7f4c78152810 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800d8e0 tx=0x7f4c6800dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.671+0000 7f4c74c00640 1 -- 172.21.15.49:0/3259503364 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c680074e0 con 0x7f4c58005190 2024-01-31T05:04:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.671+0000 7f4c74c00640 1 -- 172.21.15.49:0/3259503364 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c68007640 con 0x7f4c58005190 2024-01-31T05:04:43.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.671+0000 7f4c74c00640 1 -- 172.21.15.49:0/3259503364 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c680049f0 con 0x7f4c58005190 2024-01-31T05:04:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.671+0000 7f2de1e00640 1 --2- 172.21.15.49:0/3840094993 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2dbc066530 0x7f2dbc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.671+0000 7f4c7e000640 1 -- 172.21.15.49:0/3259503364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c781400a0 con 0x7f4c58005190 2024-01-31T05:04:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.671+0000 7f4c7e000640 1 -- 172.21.15.49:0/3259503364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c78152d50 con 0x7f4c58005190 2024-01-31T05:04:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.671+0000 7f2dda000640 1 -- 172.21.15.49:0/3840094993 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f2ddc0e9e40 con 0x7f2de40cb630 2024-01-31T05:04:43.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.671+0000 7f4c7e000640 1 -- 172.21.15.49:0/3259503364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c78067c80 con 0x7f4c58005190 2024-01-31T05:04:43.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.675+0000 7f4c74c00640 1 -- 172.21.15.49:0/3259503364 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f4c6800b6b0 con 0x7f4c58005190 2024-01-31T05:04:43.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.675+0000 7f4c74c00640 1 --2- 172.21.15.49:0/3259503364 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4c50066550 0x7f4c50068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.675+0000 7f4c74c00640 1 -- 172.21.15.49:0/3259503364 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c68084160 con 0x7f4c58005190 2024-01-31T05:04:43.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.675+0000 7f2de1e00640 1 --2- 172.21.15.49:0/3840094993 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2dbc066530 0x7f2dbc0689f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2de415b7c0 tx=0x7f2dd4007a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.683+0000 7f4c77e00640 1 --2- 172.21.15.49:0/3259503364 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4c50066550 0x7f4c50068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.683+0000 7f4c77e00640 1 --2- 172.21.15.49:0/3259503364 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4c50066550 0x7f4c50068a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4c780cdd80 tx=0x7f4c70007540 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.687+0000 7f4c74c00640 1 -- 172.21.15.49:0/3259503364 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f4c680511a0 con 0x7f4c58005190 2024-01-31T05:04:43.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.691+0000 7ff6f5000640 1 Processor -- start 2024-01-31T05:04:43.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.691+0000 7ff6f5000640 1 -- start start 2024-01-31T05:04:43.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.695+0000 7ff6f5000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff6f00ce930 0x7ff6f0070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.695+0000 7ff6f5000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff6f0070aa0 0x7ff6f0165380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.695+0000 7ff6ede00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff6f00ce550 0x7ff6f0144dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57838/0 (socket says 172.21.15.49:57838) 2024-01-31T05:04:43.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.695+0000 7ff6ede00640 1 -- 172.21.15.49:0/4077487914 learned_addr learned my addr 172.21.15.49:0/4077487914 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:43.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.695+0000 7ff6ed400640 1 --2- 172.21.15.49:0/4077487914 >> v2:172.21.15.195:3300/0 conn(0x7ff6f00ce930 0x7ff6f0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.695+0000 7ff6f5000640 1 -- 172.21.15.49:0/4077487914 --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f006c740 con 0x7ff6f00ce550 2024-01-31T05:04:43.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.695+0000 7ff6ee800640 1 --2- 172.21.15.49:0/4077487914 >> v2:172.21.15.49:3300/0 conn(0x7ff6f0070aa0 0x7ff6f0165380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.695+0000 7ff6f5000640 1 -- 172.21.15.49:0/4077487914 --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f0070ed0 con 0x7ff6f0070aa0 2024-01-31T05:04:43.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.695+0000 7ff6f5000640 1 -- 172.21.15.49:0/4077487914 --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f01660f0 con 0x7ff6f00ce930 2024-01-31T05:04:43.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.695+0000 7ff6ed400640 1 -- 172.21.15.49:0/4077487914 >> v2:172.21.15.49:3300/0 conn(0x7ff6f0070aa0 msgr2=0x7ff6f0165380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.695+0000 7ff6ed400640 1 --2- 172.21.15.49:0/4077487914 >> v2:172.21.15.49:3300/0 conn(0x7ff6f0070aa0 0x7ff6f0165380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.695+0000 7ff6ed400640 1 -- 172.21.15.49:0/4077487914 >> v1:172.21.15.49:6789/0 conn(0x7ff6f00ce550 legacy=0x7ff6f0144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:43.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.695+0000 7ff6ed400640 1 -- 172.21.15.49:0/4077487914 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f006c990 con 0x7ff6f00ce930 2024-01-31T05:04:43.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.703+0000 7ff6ed400640 1 --2- 172.21.15.49:0/4077487914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f00ce930 0x7ff6f0070560 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff6f006b5f0 tx=0x7ff6e801c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14fa9f865014478d server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.703+0000 7ff6eca00640 1 -- 172.21.15.49:0/4077487914 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e80a58d0 con 0x7ff6f00ce930 2024-01-31T05:04:43.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.703+0000 7ff6eca00640 1 -- 172.21.15.49:0/4077487914 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e80a5a30 con 0x7ff6f00ce930 2024-01-31T05:04:43.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.703+0000 7ff6eca00640 1 -- 172.21.15.49:0/4077487914 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e80a5dc0 con 0x7ff6f00ce930 2024-01-31T05:04:43.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.703+0000 7ff6f5000640 1 -- 172.21.15.49:0/4077487914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f00ce930 msgr2=0x7ff6f0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.703+0000 7ff6f5000640 1 --2- 172.21.15.49:0/4077487914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f00ce930 0x7ff6f0070560 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff6f006b5f0 tx=0x7ff6e801c830 comp rx=0 tx=0).stop 2024-01-31T05:04:43.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.703+0000 7ff6f5000640 1 -- 172.21.15.49:0/4077487914 shutdown_connections 2024-01-31T05:04:43.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.703+0000 7ff6f5000640 1 --2- 172.21.15.49:0/4077487914 >> v2:172.21.15.49:3300/0 conn(0x7ff6f0070aa0 0x7ff6f0165380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.703+0000 7ff6f5000640 1 --2- 172.21.15.49:0/4077487914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f00ce930 0x7ff6f0070560 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.703+0000 7ff6f5000640 1 -- 172.21.15.49:0/4077487914 >> 172.21.15.49:0/4077487914 conn(0x7ff6f006ad70 msgr2=0x7ff6f00b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.707+0000 7ff6f5000640 1 -- 172.21.15.49:0/4077487914 shutdown_connections 2024-01-31T05:04:43.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.707+0000 7ff6f5000640 1 -- 172.21.15.49:0/4077487914 wait complete. 2024-01-31T05:04:43.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.707+0000 7ff6f5000640 1 Processor -- start 2024-01-31T05:04:43.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.711+0000 7ff6f5000640 1 -- start start 2024-01-31T05:04:43.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.711+0000 7ff6f5000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f0070aa0 0x7ff6f013d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.711+0000 7ff6f5000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f00ce550 0x7ff6f013c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.711+0000 7ff6ede00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f0070aa0 0x7ff6f013d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.711+0000 7ff6ede00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f0070aa0 0x7ff6f013d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41692/0 (socket says 172.21.15.49:41692) 2024-01-31T05:04:43.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.711+0000 7ff6ed400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f00ce550 0x7ff6f013c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.711+0000 7ff6ede00640 1 -- 172.21.15.49:0/4207954175 learned_addr learned my addr 172.21.15.49:0/4207954175 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:43.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.711+0000 7ff6f5000640 1 --2- 172.21.15.49:0/4207954175 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6f00ce930 0x7ff6f0157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.711+0000 7ff6f5000640 1 -- 172.21.15.49:0/4207954175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f013e5b0 con 0x7ff6f00ce550 2024-01-31T05:04:43.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.715+0000 7ff6ee800640 1 --2- 172.21.15.49:0/4207954175 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6f00ce930 0x7ff6f0157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.715+0000 7ff6f5000640 1 -- 172.21.15.49:0/4207954175 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f013d9a0 con 0x7ff6f0070aa0 2024-01-31T05:04:43.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.715+0000 7ff6f5000640 1 -- 172.21.15.49:0/4207954175 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f013dc80 con 0x7ff6f00ce930 2024-01-31T05:04:43.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.715+0000 7ff6ede00640 1 -- 172.21.15.49:0/4207954175 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6f00ce930 msgr2=0x7ff6f0157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.715+0000 7ff6ede00640 1 --2- 172.21.15.49:0/4207954175 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6f00ce930 0x7ff6f0157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.715+0000 7ff6ede00640 1 -- 172.21.15.49:0/4207954175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f00ce550 msgr2=0x7ff6f013c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.715+0000 7ff6ede00640 1 --2- 172.21.15.49:0/4207954175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f00ce550 0x7ff6f013c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.715+0000 7ff6ede00640 1 -- 172.21.15.49:0/4207954175 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e8009a70 con 0x7ff6f0070aa0 2024-01-31T05:04:43.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.715+0000 7ff6ed400640 1 --2- 172.21.15.49:0/4207954175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f00ce550 0x7ff6f013c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:43.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.715+0000 7ff6ede00640 1 --2- 172.21.15.49:0/4207954175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f0070aa0 0x7ff6f013d3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000b430 tx=0x7ff6e000b830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.719+0000 7ff6e6000640 1 -- 172.21.15.49:0/4207954175 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0011830 con 0x7ff6f0070aa0 2024-01-31T05:04:43.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.719+0000 7ff6e6000640 1 -- 172.21.15.49:0/4207954175 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e00119b0 con 0x7ff6f0070aa0 2024-01-31T05:04:43.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.719+0000 7ff6e6000640 1 -- 172.21.15.49:0/4207954175 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0011d60 con 0x7ff6f0070aa0 2024-01-31T05:04:43.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.719+0000 7ff6f5000640 1 -- 172.21.15.49:0/4207954175 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f013df60 con 0x7ff6f0070aa0 2024-01-31T05:04:43.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.719+0000 7ff6f5000640 1 -- 172.21.15.49:0/4207954175 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f013cd30 con 0x7ff6f0070aa0 2024-01-31T05:04:43.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.719+0000 7ff6e6000640 1 -- 172.21.15.49:0/4207954175 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff6e001a400 con 0x7ff6f0070aa0 2024-01-31T05:04:43.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.723+0000 7ff6e6000640 1 --2- 172.21.15.49:0/4207954175 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff6c8066500 0x7ff6c80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:43.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.723+0000 7ff6e6000640 1 -- 172.21.15.49:0/4207954175 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff6e0084330 con 0x7ff6f0070aa0 2024-01-31T05:04:43.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.723+0000 7ff6f5000640 1 -- 172.21.15.49:0/4207954175 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f0067c60 con 0x7ff6f0070aa0 2024-01-31T05:04:43.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.723+0000 7ff6ed400640 1 --2- 172.21.15.49:0/4207954175 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff6c8066500 0x7ff6c80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:43.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.727+0000 7ff6ed400640 1 --2- 172.21.15.49:0/4207954175 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff6c8066500 0x7ff6c80689c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff6e80af000 tx=0x7ff6e80a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:43.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.727+0000 7ff6e6000640 1 -- 172.21.15.49:0/4207954175 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff6e0051240 con 0x7ff6f0070aa0 2024-01-31T05:04:43.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.891+0000 7fd93d200640 1 -- 172.21.15.49:0/511367302 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd938074860 con 0x7fd938174f70 2024-01-31T05:04:43.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.891+0000 7fd92e000640 1 -- 172.21.15.49:0/511367302 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd928054800 con 0x7fd938174f70 2024-01-31T05:04:43.897 INFO:teuthology.orchestra.run.smithi049.stdout:55834574857 2024-01-31T05:04:43.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.895+0000 7fd93d200640 1 -- 172.21.15.49:0/511367302 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd910066500 msgr2=0x7fd9100689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.895+0000 7fd93d200640 1 --2- 172.21.15.49:0/511367302 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd910066500 0x7fd9100689c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd930005fd0 tx=0x7fd930005e00 comp rx=0 tx=0).stop 2024-01-31T05:04:43.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.895+0000 7fd93d200640 1 -- 172.21.15.49:0/511367302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd938174f70 msgr2=0x7fd93816fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.895+0000 7fd93d200640 1 --2- 172.21.15.49:0/511367302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd938174f70 0x7fd93816fa60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd92800e7f0 tx=0x7fd92800ecb0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.903+0000 7fd93d200640 1 -- 172.21.15.49:0/511367302 shutdown_connections 2024-01-31T05:04:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.903+0000 7fd93d200640 1 --2- 172.21.15.49:0/511367302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd938174160 0x7fd93816d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.903+0000 7fd93d200640 1 --2- 172.21.15.49:0/511367302 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd910066500 0x7fd9100689c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.903+0000 7fd93d200640 1 --2- 172.21.15.49:0/511367302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd938174f70 0x7fd93816fa60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.903+0000 7fd93d200640 1 --2- 172.21.15.49:0/511367302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd938070ad0 0x7fd93816c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.903+0000 7fd93d200640 1 -- 172.21.15.49:0/511367302 >> 172.21.15.49:0/511367302 conn(0x7fd9380b09a0 msgr2=0x7fd9380ad1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.903+0000 7fd93d200640 1 -- 172.21.15.49:0/511367302 shutdown_connections 2024-01-31T05:04:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.903+0000 7fd93d200640 1 -- 172.21.15.49:0/511367302 wait complete. 2024-01-31T05:04:43.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.903+0000 7fa54e400640 1 -- 172.21.15.49:0/2232259879 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa518005820 con 0x7fa5480705d0 2024-01-31T05:04:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.907+0000 7fa53f400640 1 -- 172.21.15.49:0/2232259879 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5380efb00 con 0x7fa5480705d0 2024-01-31T05:04:43.907 INFO:teuthology.orchestra.run.smithi049.stdout:55834574856 2024-01-31T05:04:43.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.911+0000 7fa53cc00640 1 -- 172.21.15.49:0/2232259879 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa5200665d0 msgr2=0x7fa520068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.911+0000 7fa53cc00640 1 --2- 172.21.15.49:0/2232259879 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa5200665d0 0x7fa520068a90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa530007fd0 tx=0x7fa530007960 comp rx=0 tx=0).stop 2024-01-31T05:04:43.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.911+0000 7fa53cc00640 1 -- 172.21.15.49:0/2232259879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5480705d0 msgr2=0x7fa54814f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.911+0000 7fa53cc00640 1 --2- 172.21.15.49:0/2232259879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5480705d0 0x7fa54814f900 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa5380ac000 tx=0x7fa53801b480 comp rx=0 tx=0).stop 2024-01-31T05:04:43.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.911+0000 7fd3d1800640 1 -- 172.21.15.49:0/3782284585 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd39c005550 con 0x7fd3cc1593d0 2024-01-31T05:04:43.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.911+0000 7fd3c3e00640 1 -- 172.21.15.49:0/3782284585 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd3b4017090 con 0x7fd3cc1593d0 2024-01-31T05:04:43.913 INFO:teuthology.orchestra.run.smithi049.stdout:55834574857 2024-01-31T05:04:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.911+0000 7fa53cc00640 1 -- 172.21.15.49:0/2232259879 shutdown_connections 2024-01-31T05:04:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.911+0000 7fa53cc00640 1 --2- 172.21.15.49:0/2232259879 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5480b1ca0 0x7fa548158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.911+0000 7fa53cc00640 1 --2- 172.21.15.49:0/2232259879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5480709b0 0x7fa5481437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.911+0000 7fa53cc00640 1 --2- 172.21.15.49:0/2232259879 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa5200665d0 0x7fa520068a90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.911+0000 7fa53cc00640 1 --2- 172.21.15.49:0/2232259879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5480705d0 0x7fa54814f900 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.911+0000 7fa53cc00640 1 -- 172.21.15.49:0/2232259879 >> 172.21.15.49:0/2232259879 conn(0x7fa5480b09a0 msgr2=0x7fa5480cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.911+0000 7fa53cc00640 1 -- 172.21.15.49:0/2232259879 shutdown_connections 2024-01-31T05:04:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.911+0000 7fa53cc00640 1 -- 172.21.15.49:0/2232259879 wait complete. 2024-01-31T05:04:43.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.915+0000 7fd3d1800640 1 -- 172.21.15.49:0/3782284585 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd3a40665d0 msgr2=0x7fd3a4068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.915+0000 7fd3d1800640 1 --2- 172.21.15.49:0/3782284585 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd3a40665d0 0x7fd3a4068a90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40ae000 tx=0x7fd3c40a7070 comp rx=0 tx=0).stop 2024-01-31T05:04:43.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.915+0000 7fd3d1800640 1 -- 172.21.15.49:0/3782284585 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3cc1593d0 msgr2=0x7fd3cc1fa2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.915+0000 7fd3d1800640 1 --2- 172.21.15.49:0/3782284585 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3cc1593d0 0x7fd3cc1fa2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400c3c0 tx=0x7fd3b400c880 comp rx=0 tx=0).stop 2024-01-31T05:04:43.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.915+0000 7fd3d1800640 1 -- 172.21.15.49:0/3782284585 shutdown_connections 2024-01-31T05:04:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.915+0000 7fd3d1800640 1 --2- 172.21.15.49:0/3782284585 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3cc1593d0 0x7fd3cc1fa2f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.915+0000 7fd3d1800640 1 --2- 172.21.15.49:0/3782284585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3cc0b3c60 0x7fd3cc162ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.915+0000 7fd3d1800640 1 --2- 172.21.15.49:0/3782284585 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd3a40665d0 0x7fd3a4068a90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.915+0000 7fd3d1800640 1 --2- 172.21.15.49:0/3782284585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3cc0b3580 0x7fd3cc13fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.915+0000 7fd3d1800640 1 -- 172.21.15.49:0/3782284585 >> 172.21.15.49:0/3782284585 conn(0x7fd3cc0b08c0 msgr2=0x7fd3cc14da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.915+0000 7fd3d1800640 1 -- 172.21.15.49:0/3782284585 shutdown_connections 2024-01-31T05:04:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.915+0000 7fd3d1800640 1 -- 172.21.15.49:0/3782284585 wait complete. 2024-01-31T05:04:43.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2024-01-31T05:04:43.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.943+0000 7fceb3e00640 1 -- 172.21.15.49:0/350475647 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fceb4149d30 con 0x7fceb41593d0 2024-01-31T05:04:43.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.947+0000 7fceaaa00640 1 -- 172.21.15.49:0/350475647 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fceb4149d30 con 0x7fceb41593d0 2024-01-31T05:04:43.947 INFO:teuthology.orchestra.run.smithi049.stdout:55834574856 2024-01-31T05:04:43.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.947+0000 7fceb3e00640 1 -- 172.21.15.49:0/350475647 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fce8c066500 msgr2=0x7fce8c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.947+0000 7fceb3e00640 1 --2- 172.21.15.49:0/350475647 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fce8c066500 0x7fce8c0689c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fceb41530d0 tx=0x7fceac008040 comp rx=0 tx=0).stop 2024-01-31T05:04:43.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.947+0000 7fceb3e00640 1 -- 172.21.15.49:0/350475647 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fceb41593d0 msgr2=0x7fceb42027f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.947+0000 7fceb3e00640 1 --2- 172.21.15.49:0/350475647 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fceb41593d0 0x7fceb42027f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcea400cd70 tx=0x7fcea400a660 comp rx=0 tx=0).stop 2024-01-31T05:04:43.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-01-31T05:04:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.951+0000 7fceb3e00640 1 -- 172.21.15.49:0/350475647 shutdown_connections 2024-01-31T05:04:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.951+0000 7fceb3e00640 1 --2- 172.21.15.49:0/350475647 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fceb41593d0 0x7fceb42027f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.951+0000 7fceb3e00640 1 --2- 172.21.15.49:0/350475647 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fce8c066500 0x7fce8c0689c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.951+0000 7fceb3e00640 1 --2- 172.21.15.49:0/350475647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fceb40b3c60 0x7fceb42022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.951+0000 7fceb3e00640 1 --2- 172.21.15.49:0/350475647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fceb40b13e0 0x7fceb4153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.951+0000 7fceb3e00640 1 -- 172.21.15.49:0/350475647 >> 172.21.15.49:0/350475647 conn(0x7fceb40b08c0 msgr2=0x7fceb40ae010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2024-01-31T05:04:43.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.951+0000 7fceb3e00640 1 -- 172.21.15.49:0/350475647 shutdown_connections 2024-01-31T05:04:43.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.951+0000 7fceb3e00640 1 -- 172.21.15.49:0/350475647 wait complete. 2024-01-31T05:04:43.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.971+0000 7f68b9400640 1 -- 172.21.15.49:0/3223256187 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f68b415b1e0 con 0x7f68b4072270 2024-01-31T05:04:43.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.971+0000 7f68aaa00640 1 -- 172.21.15.49:0/3223256187 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f689c017030 con 0x7f68b4072270 2024-01-31T05:04:43.973 INFO:teuthology.orchestra.run.smithi049.stdout:55834574856 2024-01-31T05:04:43.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.975+0000 7f68b9400640 1 -- 172.21.15.49:0/3223256187 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f688c066550 msgr2=0x7f688c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.975+0000 7f68b9400640 1 --2- 172.21.15.49:0/3223256187 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f688c066550 0x7f688c068a10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009f90 tx=0x7f68ac0095b0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.975+0000 7f68b9400640 1 -- 172.21.15.49:0/3223256187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68b4072270 msgr2=0x7f68b4150a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.975+0000 7f68b9400640 1 --2- 172.21.15.49:0/3223256187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68b4072270 0x7f68b4150a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f689c00c410 tx=0x7f689c00c8d0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.975+0000 7f68b9400640 1 -- 172.21.15.49:0/3223256187 shutdown_connections 2024-01-31T05:04:43.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.975+0000 7f68b9400640 1 --2- 172.21.15.49:0/3223256187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68b4072270 0x7f68b4150a00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.975+0000 7f68b9400640 1 --2- 172.21.15.49:0/3223256187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68b406ce50 0x7f68b4160a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.975+0000 7f68b9400640 1 --2- 172.21.15.49:0/3223256187 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f688c066550 0x7f688c068a10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.975+0000 7f68b9400640 1 --2- 172.21.15.49:0/3223256187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68b406c530 0x7f68b4206fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.975+0000 7f68b9400640 1 -- 172.21.15.49:0/3223256187 >> 172.21.15.49:0/3223256187 conn(0x7f68b40b09a0 msgr2=0x7f68b415d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.975+0000 7f68b9400640 1 -- 172.21.15.49:0/3223256187 shutdown_connections 2024-01-31T05:04:43.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.975+0000 7f68b9400640 1 -- 172.21.15.49:0/3223256187 wait complete. 2024-01-31T05:04:43.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2024-01-31T05:04:43.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.979+0000 7f2de9000640 1 -- 172.21.15.49:0/3840094993 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2db4005550 con 0x7f2de40cb630 2024-01-31T05:04:43.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.979+0000 7f2dda000640 1 -- 172.21.15.49:0/3840094993 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2ddc0ed460 con 0x7f2de40cb630 2024-01-31T05:04:43.981 INFO:teuthology.orchestra.run.smithi049.stdout:55834574856 2024-01-31T05:04:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.983+0000 7f2de9000640 1 -- 172.21.15.49:0/3840094993 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2dbc066530 msgr2=0x7f2dbc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.983+0000 7f2de9000640 1 --2- 172.21.15.49:0/3840094993 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2dbc066530 0x7f2dbc0689f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2de415b7c0 tx=0x7f2dd4007a80 comp rx=0 tx=0).stop 2024-01-31T05:04:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.983+0000 7f2de9000640 1 -- 172.21.15.49:0/3840094993 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40cb630 msgr2=0x7f2de414ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.983+0000 7f2de9000640 1 --2- 172.21.15.49:0/3840094993 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40cb630 0x7f2de414ba00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc0ac000 tx=0x7f2ddc009750 comp rx=0 tx=0).stop 2024-01-31T05:04:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.983+0000 7f2de9000640 1 -- 172.21.15.49:0/3840094993 shutdown_connections 2024-01-31T05:04:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.983+0000 7f2de9000640 1 --2- 172.21.15.49:0/3840094993 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2de40cb630 0x7f2de414ba00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.983+0000 7f2de9000640 1 --2- 172.21.15.49:0/3840094993 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2dbc066530 0x7f2dbc0689f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.983+0000 7f2de9000640 1 --2- 172.21.15.49:0/3840094993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de40cb1b0 0x7f2de414b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.983+0000 7f2de9000640 1 --2- 172.21.15.49:0/3840094993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2de40703c0 0x7f2de41f38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.983+0000 7f2de9000640 1 -- 172.21.15.49:0/3840094993 >> 172.21.15.49:0/3840094993 conn(0x7f2de40b09a0 msgr2=0x7f2de415d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.983+0000 7f2de9000640 1 -- 172.21.15.49:0/3840094993 shutdown_connections 2024-01-31T05:04:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:43.983+0000 7f2de9000640 1 -- 172.21.15.49:0/3840094993 wait complete. 2024-01-31T05:04:44.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-01-31T05:04:44.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2024-01-31T05:04:44.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.027+0000 7f4c7e000640 1 -- 172.21.15.49:0/3259503364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4c78074860 con 0x7f4c58005190 2024-01-31T05:04:44.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.027+0000 7f4c74c00640 1 -- 172.21.15.49:0/3259503364 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4c680547c0 con 0x7f4c58005190 2024-01-31T05:04:44.029 INFO:teuthology.orchestra.run.smithi049.stdout:55834574858 2024-01-31T05:04:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.031+0000 7f4c7e000640 1 -- 172.21.15.49:0/3259503364 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4c50066550 msgr2=0x7f4c50068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.031+0000 7f4c7e000640 1 --2- 172.21.15.49:0/3259503364 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4c50066550 0x7f4c50068a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4c780cdd80 tx=0x7f4c70007540 comp rx=0 tx=0).stop 2024-01-31T05:04:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.031+0000 7f4c7e000640 1 -- 172.21.15.49:0/3259503364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c58005190 msgr2=0x7f4c78152810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.031+0000 7f4c7e000640 1 --2- 172.21.15.49:0/3259503364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c58005190 0x7f4c78152810 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800d8e0 tx=0x7f4c6800dda0 comp rx=0 tx=0).stop 2024-01-31T05:04:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.031+0000 7f4c7e000640 1 -- 172.21.15.49:0/3259503364 shutdown_connections 2024-01-31T05:04:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.031+0000 7f4c7e000640 1 --2- 172.21.15.49:0/3259503364 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4c50066550 0x7f4c50068a10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.031+0000 7f4c7e000640 1 --2- 172.21.15.49:0/3259503364 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c78137680 0x7f4c780cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.031+0000 7f4c7e000640 1 --2- 172.21.15.49:0/3259503364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c780cd980 0x7f4c780cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:44.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.031+0000 7f4c7e000640 1 --2- 172.21.15.49:0/3259503364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c58005190 0x7f4c78152810 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:44.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.031+0000 7f4c7e000640 1 -- 172.21.15.49:0/3259503364 >> 172.21.15.49:0/3259503364 conn(0x7f4c780b0890 msgr2=0x7f4c7814fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:44.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.031+0000 7f4c7e000640 1 -- 172.21.15.49:0/3259503364 shutdown_connections 2024-01-31T05:04:44.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.031+0000 7f4c7e000640 1 -- 172.21.15.49:0/3259503364 wait complete. 2024-01-31T05:04:44.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.051+0000 7ff6f5000640 1 -- 172.21.15.49:0/4207954175 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff6f00749c0 con 0x7ff6f0070aa0 2024-01-31T05:04:44.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.051+0000 7ff6e6000640 1 -- 172.21.15.49:0/4207954175 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff6e0015020 con 0x7ff6f0070aa0 2024-01-31T05:04:44.052 INFO:teuthology.orchestra.run.smithi049.stdout:55834574856 2024-01-31T05:04:44.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2024-01-31T05:04:44.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.051+0000 7ff6f5000640 1 -- 172.21.15.49:0/4207954175 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff6c8066500 msgr2=0x7ff6c80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:44.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.051+0000 7ff6f5000640 1 --2- 172.21.15.49:0/4207954175 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff6c8066500 0x7ff6c80689c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff6e80af000 tx=0x7ff6e80a7070 comp rx=0 tx=0).stop 2024-01-31T05:04:44.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.051+0000 7ff6f5000640 1 -- 172.21.15.49:0/4207954175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f0070aa0 msgr2=0x7ff6f013d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:44.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.051+0000 7ff6f5000640 1 --2- 172.21.15.49:0/4207954175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f0070aa0 0x7ff6f013d3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000b430 tx=0x7ff6e000b830 comp rx=0 tx=0).stop 2024-01-31T05:04:44.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.051+0000 7ff6f5000640 1 -- 172.21.15.49:0/4207954175 shutdown_connections 2024-01-31T05:04:44.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.051+0000 7ff6f5000640 1 --2- 172.21.15.49:0/4207954175 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff6f00ce930 0x7ff6f0157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:44.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.051+0000 7ff6f5000640 1 --2- 172.21.15.49:0/4207954175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f00ce550 0x7ff6f013c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:44.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.051+0000 7ff6f5000640 1 --2- 172.21.15.49:0/4207954175 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff6c8066500 0x7ff6c80689c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:44.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.051+0000 7ff6f5000640 1 --2- 172.21.15.49:0/4207954175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f0070aa0 0x7ff6f013d3c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:44.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.051+0000 7ff6f5000640 1 -- 172.21.15.49:0/4207954175 >> 172.21.15.49:0/4207954175 conn(0x7ff6f006ad70 msgr2=0x7ff6f00b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:44.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.051+0000 7ff6f5000640 1 -- 172.21.15.49:0/4207954175 shutdown_connections 2024-01-31T05:04:44.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:44.051+0000 7ff6f5000640 1 -- 172.21.15.49:0/4207954175 wait complete. 2024-01-31T05:04:44.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2024-01-31T05:04:44.944 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-31T05:04:44.953 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-31T05:04:44.954 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-31T05:04:44.981 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-31T05:04:45.001 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-31T05:04:45.007 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-31T05:04:45.054 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-31T05:04:45.075 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-31T05:04:45.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.127+0000 7ff457200640 1 Processor -- start 2024-01-31T05:04:45.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.127+0000 7ff457200640 1 -- start start 2024-01-31T05:04:45.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.131+0000 7ff457200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff4500cdf10 0x7ff450070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.131+0000 7ff457200640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45015b4f0 con 0x7ff45015b110 2024-01-31T05:04:45.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.131+0000 7ff457200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4500abf20 con 0x7ff4500ce610 2024-01-31T05:04:45.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.131+0000 7ff457200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4500ce460 con 0x7ff4500cdf10 2024-01-31T05:04:45.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.131+0000 7ff44fe00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff45015b110 0x7ff45006c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57846/0 (socket says 172.21.15.49:57846) 2024-01-31T05:04:45.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.131+0000 7ff44fe00640 1 -- 172.21.15.49:0/2981431927 learned_addr learned my addr 172.21.15.49:0/2981431927 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:45.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.131+0000 7ff44f400640 1 --2- 172.21.15.49:0/2981431927 >> v2:172.21.15.49:3300/0 conn(0x7ff4500cdf10 0x7ff450070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.131+0000 7ff44f400640 1 -- 172.21.15.49:0/2981431927 >> v1:172.21.15.195:6789/0 conn(0x7ff4500ce610 legacy=0x7ff4500ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:45.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.131+0000 7ff44f400640 1 -- 172.21.15.49:0/2981431927 >> v1:172.21.15.49:6789/0 conn(0x7ff45015b110 legacy=0x7ff45006c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.131+0000 7ff44f400640 1 -- 172.21.15.49:0/2981431927 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4500ac200 con 0x7ff4500cdf10 2024-01-31T05:04:45.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.139+0000 7ff44f400640 1 --2- 172.21.15.49:0/2981431927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4500cdf10 0x7ff450070dd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff44000f9b0 tx=0x7ff440020740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8054d35c80d6b80 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.139+0000 7ff44ea00640 1 -- 172.21.15.49:0/2981431927 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44000f110 con 0x7ff4500cdf10 2024-01-31T05:04:45.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.139+0000 7ff44ea00640 1 -- 172.21.15.49:0/2981431927 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44000f270 con 0x7ff4500cdf10 2024-01-31T05:04:45.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.139+0000 7ff44ea00640 1 -- 172.21.15.49:0/2981431927 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44000f110 con 0x7ff4500cdf10 2024-01-31T05:04:45.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.139+0000 7ff457200640 1 -- 172.21.15.49:0/2981431927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4500cdf10 msgr2=0x7ff450070dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.139+0000 7ff457200640 1 --2- 172.21.15.49:0/2981431927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4500cdf10 0x7ff450070dd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff44000f9b0 tx=0x7ff440020740 comp rx=0 tx=0).stop 2024-01-31T05:04:45.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.139+0000 7ff457200640 1 -- 172.21.15.49:0/2981431927 shutdown_connections 2024-01-31T05:04:45.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.139+0000 7ff457200640 1 --2- 172.21.15.49:0/2981431927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff4500cdf10 0x7ff450070dd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.139+0000 7ff457200640 1 -- 172.21.15.49:0/2981431927 >> 172.21.15.49:0/2981431927 conn(0x7ff4500b09a0 msgr2=0x7ff4500b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:45.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.143+0000 7ff457200640 1 -- 172.21.15.49:0/2981431927 shutdown_connections 2024-01-31T05:04:45.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.143+0000 7ff457200640 1 -- 172.21.15.49:0/2981431927 wait complete. 2024-01-31T05:04:45.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.143+0000 7ff457200640 1 Processor -- start 2024-01-31T05:04:45.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.143+0000 7ff457200640 1 -- start start 2024-01-31T05:04:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.147+0000 7ff457200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4500cdf10 0x7ff45014d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.147+0000 7ff457200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4500ce610 0x7ff450150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.147+0000 7ff457200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff45015b110 0x7ff45009aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.147+0000 7ff457200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff450150870 con 0x7ff45015b110 2024-01-31T05:04:45.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.147+0000 7ff44fe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4500cdf10 0x7ff45014d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.147+0000 7ff44fe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4500cdf10 0x7ff45014d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:53128/0 (socket says 172.21.15.49:53128) 2024-01-31T05:04:45.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.147+0000 7ff44fe00640 1 -- 172.21.15.49:0/1055993400 learned_addr learned my addr 172.21.15.49:0/1055993400 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:45.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.147+0000 7ff44f400640 1 --2- 172.21.15.49:0/1055993400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4500ce610 0x7ff450150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.147+0000 7ff457200640 1 -- 172.21.15.49:0/1055993400 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff450150b50 con 0x7ff4500ce610 2024-01-31T05:04:45.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.147+0000 7ff457200640 1 -- 172.21.15.49:0/1055993400 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff450150e30 con 0x7ff4500cdf10 2024-01-31T05:04:45.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.147+0000 7ff44fe00640 1 -- 172.21.15.49:0/1055993400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4500ce610 msgr2=0x7ff450150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.147+0000 7ff44fe00640 1 --2- 172.21.15.49:0/1055993400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4500ce610 0x7ff450150020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.147+0000 7ff44fe00640 1 -- 172.21.15.49:0/1055993400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff45015b110 msgr2=0x7ff45009aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.147+0000 7ff44fe00640 1 --2- 172.21.15.49:0/1055993400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff45015b110 0x7ff45009aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.147+0000 7ff44fe00640 1 -- 172.21.15.49:0/1055993400 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44000f610 con 0x7ff4500cdf10 2024-01-31T05:04:45.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.147+0000 7ff44f400640 1 --2- 172.21.15.49:0/1055993400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4500ce610 0x7ff450150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:04:45.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.151+0000 7ff44fe00640 1 --2- 172.21.15.49:0/1055993400 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4500cdf10 0x7ff45014d140 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff44800cba0 tx=0x7ff44800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.151+0000 7ff447e00640 1 -- 172.21.15.49:0/1055993400 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44800ad40 con 0x7ff4500cdf10 2024-01-31T05:04:45.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.151+0000 7ff447e00640 1 -- 172.21.15.49:0/1055993400 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff448012400 con 0x7ff4500cdf10 2024-01-31T05:04:45.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.151+0000 7ff447e00640 1 -- 172.21.15.49:0/1055993400 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44800aea0 con 0x7ff4500cdf10 2024-01-31T05:04:45.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.151+0000 7ff457200640 1 -- 172.21.15.49:0/1055993400 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff450151110 con 0x7ff4500cdf10 2024-01-31T05:04:45.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.151+0000 7ff457200640 1 -- 172.21.15.49:0/1055993400 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff450151910 con 0x7ff4500cdf10 2024-01-31T05:04:45.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.155+0000 7ff457200640 1 -- 172.21.15.49:0/1055993400 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff450151630 con 0x7ff4500cdf10 2024-01-31T05:04:45.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.155+0000 7ff447e00640 1 -- 172.21.15.49:0/1055993400 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff448007070 con 0x7ff4500cdf10 2024-01-31T05:04:45.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.155+0000 7ff447e00640 1 --2- 172.21.15.49:0/1055993400 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff4280665d0 0x7ff428068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.155+0000 7ff447e00640 1 -- 172.21.15.49:0/1055993400 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff448083f70 con 0x7ff4500cdf10 2024-01-31T05:04:45.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.155+0000 7ff44f400640 1 --2- 172.21.15.49:0/1055993400 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff4280665d0 0x7ff428068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.159+0000 7ff44f400640 1 --2- 172.21.15.49:0/1055993400 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff4280665d0 0x7ff428068a90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff4400b2000 tx=0x7ff4400ab070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.159+0000 7ff447e00640 1 -- 172.21.15.49:0/1055993400 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff450151630 con 0x7ff4500cdf10 2024-01-31T05:04:45.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.187+0000 7f4d30000640 1 Processor -- start 2024-01-31T05:04:45.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.187+0000 7f4d30000640 1 -- start start 2024-01-31T05:04:45.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.187+0000 7f4d30000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d280705d0 0x7f4d2815d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.187+0000 7f4d30000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d280b1ca0 0x7f4d2815a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.187+0000 7f4d30000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4d280709b0 0x7f4d2806c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.187+0000 7f4d30000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d280b3e40 con 0x7f4d280705d0 2024-01-31T05:04:45.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.191+0000 7f4d30000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d28159910 con 0x7f4d280709b0 2024-01-31T05:04:45.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.191+0000 7f4d30000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2806dd50 con 0x7f4d280b1ca0 2024-01-31T05:04:45.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.191+0000 7f4d2e000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4d280709b0 0x7f4d2806c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.191+0000 7f4d2e000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4d280709b0 0x7f4d2806c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41710/0 (socket says 172.21.15.49:41710) 2024-01-31T05:04:45.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.191+0000 7f4d2e000640 1 -- 172.21.15.49:0/2992759102 learned_addr learned my addr 172.21.15.49:0/2992759102 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:45.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.191+0000 7f4d2d600640 1 --2- 172.21.15.49:0/2992759102 >> v2:172.21.15.49:3300/0 conn(0x7f4d280705d0 0x7f4d2815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.191+0000 7f4d2e000640 1 -- 172.21.15.49:0/2992759102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d280b1ca0 msgr2=0x7f4d2815a320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-31T05:04:45.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.191+0000 7f4d2e000640 1 --2- 172.21.15.49:0/2992759102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d280b1ca0 0x7f4d2815a320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.191+0000 7f4d2e000640 1 -- 172.21.15.49:0/2992759102 >> v2:172.21.15.49:3300/0 conn(0x7f4d280705d0 msgr2=0x7f4d2815d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:45.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.191+0000 7f4d2e000640 1 --2- 172.21.15.49:0/2992759102 >> v2:172.21.15.49:3300/0 conn(0x7f4d280705d0 0x7f4d2815d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.191+0000 7f4d2e000640 1 -- 172.21.15.49:0/2992759102 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2815a860 con 0x7f4d280709b0 2024-01-31T05:04:45.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.191+0000 7f4d2d600640 1 --2- 172.21.15.49:0/2992759102 >> v2:172.21.15.49:3300/0 conn(0x7f4d280705d0 0x7f4d2815d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:45.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.195+0000 7f4d2e000640 1 --2- 172.21.15.49:0/2992759102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d280709b0 0x7f4d2806c2d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4d28071cd0 tx=0x7f4d1001d6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b87595eb7dcd6f2 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.195+0000 7f4d27e00640 1 -- 172.21.15.49:0/2992759102 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d100a9610 con 0x7f4d280709b0 2024-01-31T05:04:45.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.195+0000 7f201fa00640 1 Processor -- start 2024-01-31T05:04:45.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.195+0000 7f201fa00640 1 -- start start 2024-01-31T05:04:45.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.195+0000 7f4d27e00640 1 -- 172.21.15.49:0/2992759102 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d100a9770 con 0x7f4d280709b0 2024-01-31T05:04:45.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.199+0000 7f4d27e00640 1 -- 172.21.15.49:0/2992759102 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d100a9610 con 0x7f4d280709b0 2024-01-31T05:04:45.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.199+0000 7f4d30000640 1 -- 172.21.15.49:0/2992759102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d280709b0 msgr2=0x7f4d2806c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.199+0000 7f4d30000640 1 --2- 172.21.15.49:0/2992759102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d280709b0 0x7f4d2806c2d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4d28071cd0 tx=0x7f4d1001d6c0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.199+0000 7f201fa00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f201815e3e0 0x7f20180b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.199+0000 7f201fa00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f20180703c0 0x7f20180707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.199+0000 7f201fa00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201815e860 con 0x7f201806dab0 2024-01-31T05:04:45.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.199+0000 7f201fa00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2018070d30 con 0x7f20180703c0 2024-01-31T05:04:45.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.199+0000 7f201fa00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20180b3eb0 con 0x7f201815e3e0 2024-01-31T05:04:45.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.199+0000 7f4d30000640 1 -- 172.21.15.49:0/2992759102 shutdown_connections 2024-01-31T05:04:45.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.199+0000 7f4d30000640 1 --2- 172.21.15.49:0/2992759102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d280709b0 0x7f4d2806c2d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.199+0000 7f4d30000640 1 --2- 172.21.15.49:0/2992759102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d280b1ca0 0x7f4d2815a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.199+0000 7f4d30000640 1 --2- 172.21.15.49:0/2992759102 >> v2:172.21.15.49:3300/0 conn(0x7f4d280705d0 0x7f4d2815d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.199+0000 7f4d30000640 1 -- 172.21.15.49:0/2992759102 >> 172.21.15.49:0/2992759102 conn(0x7f4d280b09a0 msgr2=0x7f4d280b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:45.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.199+0000 7f201da00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f20180703c0 0x7f20180707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.199+0000 7f2017e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f201815e3e0 0x7f20180b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.199+0000 7f201d000640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f201806dab0 0x7f20180b36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57850/0 (socket says 172.21.15.49:57850) 2024-01-31T05:04:45.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.199+0000 7f201d000640 1 -- 172.21.15.49:0/3464964532 learned_addr learned my addr 172.21.15.49:0/3464964532 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:45.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.199+0000 7f4d30000640 1 -- 172.21.15.49:0/2992759102 shutdown_connections 2024-01-31T05:04:45.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.199+0000 7f4d30000640 1 -- 172.21.15.49:0/2992759102 wait complete. 2024-01-31T05:04:45.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.203+0000 7f2017e00640 1 -- 172.21.15.49:0/3464964532 >> v2:172.21.15.49:3300/0 conn(0x7f20180703c0 msgr2=0x7f20180707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:45.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.203+0000 7f2017e00640 1 --2- 172.21.15.49:0/3464964532 >> v2:172.21.15.49:3300/0 conn(0x7f20180703c0 0x7f20180707f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.203+0000 7f2017e00640 1 -- 172.21.15.49:0/3464964532 >> v1:172.21.15.49:6789/0 conn(0x7f201806dab0 legacy=0x7f20180b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.203+0000 7f2017e00640 1 -- 172.21.15.49:0/3464964532 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20180b20e0 con 0x7f201815e3e0 2024-01-31T05:04:45.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.203+0000 7f4d30000640 1 Processor -- start 2024-01-31T05:04:45.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.203+0000 7f4d30000640 1 -- start start 2024-01-31T05:04:45.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f4d30000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d280705d0 0x7f4d28203410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f4d30000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d280709b0 0x7f4d28155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f4d30000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d280b1ca0 0x7f4d28155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f2017e00640 1 --2- 172.21.15.49:0/3464964532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f201815e3e0 0x7f20180b2ea0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2018072d10 tx=0x7f200801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b23514b52cf35f4e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f4d30000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2815bd80 con 0x7f4d280709b0 2024-01-31T05:04:45.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f4d30000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2815aa40 con 0x7f4d280b1ca0 2024-01-31T05:04:45.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f4d30000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d28203950 con 0x7f4d280705d0 2024-01-31T05:04:45.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f4d2cc00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d280709b0 0x7f4d28155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f4d2e000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d280b1ca0 0x7f4d28155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f4d2cc00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d280709b0 0x7f4d28155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38714/0 (socket says 172.21.15.49:38714) 2024-01-31T05:04:45.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f4d2cc00640 1 -- 172.21.15.49:0/16358814 learned_addr learned my addr 172.21.15.49:0/16358814 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:45.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f2017400640 1 -- 172.21.15.49:0/3464964532 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20080a7070 con 0x7f201815e3e0 2024-01-31T05:04:45.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f2017400640 1 -- 172.21.15.49:0/3464964532 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20080ab430 con 0x7f201815e3e0 2024-01-31T05:04:45.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f2017400640 1 -- 172.21.15.49:0/3464964532 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20080ab7c0 con 0x7f201815e3e0 2024-01-31T05:04:45.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f4d2e000640 1 -- 172.21.15.49:0/16358814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d280705d0 msgr2=0x7f4d28203410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f4d2e000640 1 --2- 172.21.15.49:0/16358814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d280705d0 0x7f4d28203410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f4d2e000640 1 -- 172.21.15.49:0/16358814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d280709b0 msgr2=0x7f4d28155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f4d2e000640 1 --2- 172.21.15.49:0/16358814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d280709b0 0x7f4d28155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f4d2e000640 1 -- 172.21.15.49:0/16358814 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d10009d60 con 0x7f4d280b1ca0 2024-01-31T05:04:45.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f7020200640 1 Processor -- start 2024-01-31T05:04:45.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.207+0000 7f7020200640 1 -- start start 2024-01-31T05:04:45.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f7020200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7018070620 0x7f70180b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f7020200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70180b3a10 0x7f7018162760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f7020200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70180b2040 con 0x7f7018070a00 2024-01-31T05:04:45.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f701d800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7018070620 0x7f70180b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f701ce00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f7018070a00 0x7f701806c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:50604/0 (socket says 172.21.15.49:50604) 2024-01-31T05:04:45.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f701ce00640 1 -- 172.21.15.49:0/4238574031 learned_addr learned my addr 172.21.15.49:0/4238574031 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:45.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f701e200640 1 --2- 172.21.15.49:0/4238574031 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70180b3a10 0x7f7018162760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f7020200640 1 -- 172.21.15.49:0/4238574031 --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7018071b80 con 0x7f7018070620 2024-01-31T05:04:45.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f7020200640 1 -- 172.21.15.49:0/4238574031 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70180b3ea0 con 0x7f70180b3a10 2024-01-31T05:04:45.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f4d2e000640 1 --2- 172.21.15.49:0/16358814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d280b1ca0 0x7f4d28155cc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4d100ad000 tx=0x7f4d1001a460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f201fa00640 1 -- 172.21.15.49:0/3464964532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f201815e3e0 msgr2=0x7f20180b2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f201fa00640 1 --2- 172.21.15.49:0/3464964532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f201815e3e0 0x7f20180b2ea0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2018072d10 tx=0x7f200801c470 comp rx=0 tx=0).stop 2024-01-31T05:04:45.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f7017e00640 1 -- 172.21.15.49:0/4238574031 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960433046 0 0) 0x7f70180b2040 con 0x7f7018070a00 2024-01-31T05:04:45.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f7017e00640 1 -- 172.21.15.49:0/4238574031 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff8003530 con 0x7f7018070a00 2024-01-31T05:04:45.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f4d25600640 1 -- 172.21.15.49:0/16358814 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d100a9610 con 0x7f4d280b1ca0 2024-01-31T05:04:45.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f4d30000640 1 -- 172.21.15.49:0/16358814 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2815ace0 con 0x7f4d280b1ca0 2024-01-31T05:04:45.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f4d30000640 1 -- 172.21.15.49:0/16358814 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2815b2a0 con 0x7f4d280b1ca0 2024-01-31T05:04:45.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f201fa00640 1 -- 172.21.15.49:0/3464964532 shutdown_connections 2024-01-31T05:04:45.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f201fa00640 1 --2- 172.21.15.49:0/3464964532 >> v2:172.21.15.49:3300/0 conn(0x7f20180703c0 0x7f20180707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f201fa00640 1 --2- 172.21.15.49:0/3464964532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f201815e3e0 0x7f20180b2ea0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f201fa00640 1 -- 172.21.15.49:0/3464964532 >> 172.21.15.49:0/3464964532 conn(0x7f20180b09a0 msgr2=0x7f20180b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:45.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f201fa00640 1 -- 172.21.15.49:0/3464964532 shutdown_connections 2024-01-31T05:04:45.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f201fa00640 1 -- 172.21.15.49:0/3464964532 wait complete. 2024-01-31T05:04:45.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f4d25600640 1 -- 172.21.15.49:0/16358814 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1000c050 con 0x7f4d280b1ca0 2024-01-31T05:04:45.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f4d25600640 1 -- 172.21.15.49:0/16358814 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d100a9610 con 0x7f4d280b1ca0 2024-01-31T05:04:45.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.215+0000 7f4d1ea00640 1 -- 172.21.15.49:0/16358814 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf00052a0 con 0x7f4d280b1ca0 2024-01-31T05:04:45.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.215+0000 7f201fa00640 1 Processor -- start 2024-01-31T05:04:45.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f701d800640 1 -- 172.21.15.49:0/4238574031 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70180b3a10 msgr2=0x7f7018162760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:45.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f701d800640 1 --2- 172.21.15.49:0/4238574031 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70180b3a10 0x7f7018162760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f701d800640 1 -- 172.21.15.49:0/4238574031 >> v1:172.21.15.195:6789/0 conn(0x7f7018070a00 legacy=0x7f701806c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.211+0000 7f701d800640 1 -- 172.21.15.49:0/4238574031 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7018166220 con 0x7f7018070620 2024-01-31T05:04:45.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.215+0000 7f201fa00640 1 -- start start 2024-01-31T05:04:45.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.215+0000 7f4d25600640 1 -- 172.21.15.49:0/16358814 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f4d100a7040 con 0x7f4d280b1ca0 2024-01-31T05:04:45.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.215+0000 7f201fa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f201806dab0 0x7f2018157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.215+0000 7f4d25600640 1 --2- 172.21.15.49:0/16358814 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4d00066560 0x7f4d00068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f4d25600640 1 -- 172.21.15.49:0/16358814 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4d1011e800 con 0x7f4d280b1ca0 2024-01-31T05:04:45.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f701d800640 1 --2- 172.21.15.49:0/4238574031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7018070620 0x7f70180b34d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f70080097c0 tx=0x7f700801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a2eca9a0334c19e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f4d2d600640 1 --2- 172.21.15.49:0/16358814 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4d00066560 0x7f4d00068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f201fa00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20180703c0 0x7f2018202300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f201fa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f201815e3e0 0x7f2018154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f201d000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f201806dab0 0x7f2018157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f201d000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f201806dab0 0x7f2018157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:53148/0 (socket says 172.21.15.49:53148) 2024-01-31T05:04:45.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f2017e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20180703c0 0x7f2018202300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f2017e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20180703c0 0x7f2018202300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41744/0 (socket says 172.21.15.49:41744) 2024-01-31T05:04:45.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f4d2d600640 1 --2- 172.21.15.49:0/16358814 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4d00066560 0x7f4d00068a20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4d2815c070 tx=0x7f4d18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f201d000640 1 -- 172.21.15.49:0/2758580131 learned_addr learned my addr 172.21.15.49:0/2758580131 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:45.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f201da00640 1 --2- 172.21.15.49:0/2758580131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f201815e3e0 0x7f2018154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f201fa00640 1 -- 172.21.15.49:0/2758580131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2018202840 con 0x7f201815e3e0 2024-01-31T05:04:45.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f201fa00640 1 -- 172.21.15.49:0/2758580131 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20181562c0 con 0x7f20180703c0 2024-01-31T05:04:45.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f201fa00640 1 -- 172.21.15.49:0/2758580131 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20181565a0 con 0x7f201806dab0 2024-01-31T05:04:45.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f2017e00640 1 -- 172.21.15.49:0/2758580131 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f201806dab0 msgr2=0x7f2018157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f2017e00640 1 --2- 172.21.15.49:0/2758580131 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f201806dab0 0x7f2018157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f2017e00640 1 -- 172.21.15.49:0/2758580131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f201815e3e0 msgr2=0x7f2018154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f2017e00640 1 --2- 172.21.15.49:0/2758580131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f201815e3e0 0x7f2018154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f2017e00640 1 -- 172.21.15.49:0/2758580131 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2008009420 con 0x7f20180703c0 2024-01-31T05:04:45.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f201da00640 1 --2- 172.21.15.49:0/2758580131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f201815e3e0 0x7f2018154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:45.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.219+0000 7f201d000640 1 --2- 172.21.15.49:0/2758580131 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f201806dab0 0x7f2018157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:04:45.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.223+0000 7f7017e00640 1 -- 172.21.15.49:0/4238574031 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080ab650 con 0x7f7018070620 2024-01-31T05:04:45.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.223+0000 7f7017e00640 1 -- 172.21.15.49:0/4238574031 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70080ab7b0 con 0x7f7018070620 2024-01-31T05:04:45.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.223+0000 7f2017e00640 1 --2- 172.21.15.49:0/2758580131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20180703c0 0x7f2018202300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f20080ac000 tx=0x7f200801acb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.223+0000 7f4d25600640 1 -- 172.21.15.49:0/16358814 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f4d100eb7b0 con 0x7f4d280b1ca0 2024-01-31T05:04:45.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.223+0000 7f7017e00640 1 -- 172.21.15.49:0/4238574031 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080abb40 con 0x7f7018070620 2024-01-31T05:04:45.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.223+0000 7f2014c00640 1 -- 172.21.15.49:0/2758580131 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20080b58d0 con 0x7f20180703c0 2024-01-31T05:04:45.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.223+0000 7f2014c00640 1 -- 172.21.15.49:0/2758580131 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20080b5a50 con 0x7f20180703c0 2024-01-31T05:04:45.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.223+0000 7f2014c00640 1 -- 172.21.15.49:0/2758580131 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20080b5e00 con 0x7f20180703c0 2024-01-31T05:04:45.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.223+0000 7f201fa00640 1 -- 172.21.15.49:0/2758580131 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2018156880 con 0x7f20180703c0 2024-01-31T05:04:45.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.223+0000 7f7020200640 1 -- 172.21.15.49:0/4238574031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7018070620 msgr2=0x7f70180b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.223+0000 7f7020200640 1 --2- 172.21.15.49:0/4238574031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7018070620 0x7f70180b34d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f70080097c0 tx=0x7f700801c450 comp rx=0 tx=0).stop 2024-01-31T05:04:45.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.223+0000 7f201fa00640 1 -- 172.21.15.49:0/2758580131 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2018156e40 con 0x7f20180703c0 2024-01-31T05:04:45.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.223+0000 7f7020200640 1 -- 172.21.15.49:0/4238574031 shutdown_connections 2024-01-31T05:04:45.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.223+0000 7f7020200640 1 --2- 172.21.15.49:0/4238574031 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70180b3a10 0x7f7018162760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.223+0000 7f7020200640 1 --2- 172.21.15.49:0/4238574031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7018070620 0x7f70180b34d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.223+0000 7f7020200640 1 -- 172.21.15.49:0/4238574031 >> 172.21.15.49:0/4238574031 conn(0x7f70180b09a0 msgr2=0x7f70180b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:45.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.223+0000 7f7020200640 1 -- 172.21.15.49:0/4238574031 shutdown_connections 2024-01-31T05:04:45.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.223+0000 7f7020200640 1 -- 172.21.15.49:0/4238574031 wait complete. 2024-01-31T05:04:45.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.227+0000 7f200e000640 1 -- 172.21.15.49:0/2758580131 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f201806b660 con 0x7f20180703c0 2024-01-31T05:04:45.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.227+0000 7f2014c00640 1 -- 172.21.15.49:0/2758580131 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f20080b4390 con 0x7f20180703c0 2024-01-31T05:04:45.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.227+0000 7f2014c00640 1 --2- 172.21.15.49:0/2758580131 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1ff0066500 0x7f1ff00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.227+0000 7f2014c00640 1 -- 172.21.15.49:0/2758580131 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f200811e570 con 0x7f20180703c0 2024-01-31T05:04:45.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.227+0000 7f201d000640 1 --2- 172.21.15.49:0/2758580131 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1ff0066500 0x7f1ff00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.231+0000 7f7020200640 1 Processor -- start 2024-01-31T05:04:45.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.231+0000 7f7020200640 1 -- start start 2024-01-31T05:04:45.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.231+0000 7f201d000640 1 --2- 172.21.15.49:0/2758580131 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1ff0066500 0x7f1ff00689c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2000005890 tx=0x7f2000009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.231+0000 7f2014c00640 1 -- 172.21.15.49:0/2758580131 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f20080eb6d0 con 0x7f20180703c0 2024-01-31T05:04:45.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.235+0000 7f7020200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7018070620 0x7f70180ce950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.235+0000 7f7020200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7018070a00 0x7f701809a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.235+0000 7f7020200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70180b3a10 0x7f701809bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.235+0000 7f7020200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701815e6e0 con 0x7f7018070620 2024-01-31T05:04:45.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.235+0000 7f7020200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701815d810 con 0x7f7018070a00 2024-01-31T05:04:45.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.235+0000 7f7020200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701815da60 con 0x7f70180b3a10 2024-01-31T05:04:45.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.235+0000 7f701d800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7018070620 0x7f70180ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.235+0000 7f701d800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7018070620 0x7f70180ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38726/0 (socket says 172.21.15.49:38726) 2024-01-31T05:04:45.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.235+0000 7f701d800640 1 -- 172.21.15.49:0/2162893834 learned_addr learned my addr 172.21.15.49:0/2162893834 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:45.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.235+0000 7f701ce00640 1 --2- 172.21.15.49:0/2162893834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7018070a00 0x7f701809a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.235+0000 7f701ce00640 1 -- 172.21.15.49:0/2162893834 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70180b3a10 msgr2=0x7f701809bec0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-31T05:04:45.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.235+0000 7f701ce00640 1 --2- 172.21.15.49:0/2162893834 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70180b3a10 0x7f701809bec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.235+0000 7f701ce00640 1 -- 172.21.15.49:0/2162893834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7018070620 msgr2=0x7f70180ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.235+0000 7f701ce00640 1 --2- 172.21.15.49:0/2162893834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7018070620 0x7f70180ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.235+0000 7f701ce00640 1 -- 172.21.15.49:0/2162893834 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7008009420 con 0x7f7018070a00 2024-01-31T05:04:45.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.239+0000 7f701ce00640 1 --2- 172.21.15.49:0/2162893834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7018070a00 0x7f701809a340 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f701000cae0 tx=0x7f701000a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.239+0000 7f7015600640 1 -- 172.21.15.49:0/2162893834 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701000ac40 con 0x7f7018070a00 2024-01-31T05:04:45.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.239+0000 7f7015600640 1 -- 172.21.15.49:0/2162893834 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701000ada0 con 0x7f7018070a00 2024-01-31T05:04:45.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.239+0000 7f7015600640 1 -- 172.21.15.49:0/2162893834 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701000ac40 con 0x7f7018070a00 2024-01-31T05:04:45.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.239+0000 7f7020200640 1 -- 172.21.15.49:0/2162893834 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701815dd40 con 0x7f7018070a00 2024-01-31T05:04:45.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.239+0000 7f7020200640 1 -- 172.21.15.49:0/2162893834 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701815e300 con 0x7f7018070a00 2024-01-31T05:04:45.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.243+0000 7f7015600640 1 -- 172.21.15.49:0/2162893834 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f7010012400 con 0x7f7018070a00 2024-01-31T05:04:45.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.243+0000 7f7015600640 1 --2- 172.21.15.49:0/2162893834 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6ff0066560 0x7f6ff0068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.243+0000 7f7015600640 1 -- 172.21.15.49:0/2162893834 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7010083cb0 con 0x7f7018070a00 2024-01-31T05:04:45.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.247+0000 7f701d800640 1 --2- 172.21.15.49:0/2162893834 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6ff0066560 0x7f6ff0068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.247+0000 7f7020200640 1 -- 172.21.15.49:0/2162893834 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701806b660 con 0x7f7018070a00 2024-01-31T05:04:45.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.247+0000 7f701d800640 1 --2- 172.21.15.49:0/2162893834 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6ff0066560 0x7f6ff0068a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f70080097c0 tx=0x7f70080a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.251+0000 7f7015600640 1 -- 172.21.15.49:0/2162893834 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f7010017080 con 0x7f7018070a00 2024-01-31T05:04:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.295+0000 7f9635400640 1 Processor -- start 2024-01-31T05:04:45.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.295+0000 7f9635400640 1 -- start start 2024-01-31T05:04:45.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.295+0000 7f4097400640 1 Processor -- start 2024-01-31T05:04:45.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.295+0000 7f4097400640 1 -- start start 2024-01-31T05:04:45.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.295+0000 7f9635400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f963006dab0 0x7f963015e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.295+0000 7f9635400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96300b2ea0 0x7f96300b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.295+0000 7f9635400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f96300703c0 0x7f9630070850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.295+0000 7f9635400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9630070d90 con 0x7f96300703c0 2024-01-31T05:04:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.295+0000 7f9635400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96300b3320 con 0x7f963006dab0 2024-01-31T05:04:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.295+0000 7f9635400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96300b3c30 con 0x7f96300b2ea0 2024-01-31T05:04:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.299+0000 7f962de00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96300b2ea0 0x7f96300b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.299+0000 7f4097400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f40900b3650 0x7f409006b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.299+0000 7f962de00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96300b2ea0 0x7f96300b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:53164/0 (socket says 172.21.15.49:53164) 2024-01-31T05:04:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.299+0000 7f962de00640 1 -- 172.21.15.49:0/583740837 learned_addr learned my addr 172.21.15.49:0/583740837 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.299+0000 7f962e800640 1 --2- 172.21.15.49:0/583740837 >> v2:172.21.15.195:3300/0 conn(0x7f963006dab0 0x7f963015e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.299+0000 7f4097400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f409006f5c0 0x7f40900b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.299+0000 7f4097400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40900b3f70 con 0x7f40900b5630 2024-01-31T05:04:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.299+0000 7f4097400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40900705c0 con 0x7f40900b3650 2024-01-31T05:04:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.299+0000 7f4097400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409006a770 con 0x7f409006f5c0 2024-01-31T05:04:45.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.299+0000 7f4094a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f40900b3650 0x7f409006b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.299+0000 7f408fe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f409006f5c0 0x7f40900b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.299+0000 7f408fe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f409006f5c0 0x7f40900b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:53168/0 (socket says 172.21.15.49:53168) 2024-01-31T05:04:45.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.299+0000 7f408fe00640 1 -- 172.21.15.49:0/93807433 learned_addr learned my addr 172.21.15.49:0/93807433 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:45.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.299+0000 7f4094a00640 1 -- 172.21.15.49:0/93807433 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f409006f5c0 msgr2=0x7f40900b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:45.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.299+0000 7f4094a00640 1 --2- 172.21.15.49:0/93807433 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f409006f5c0 0x7f40900b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.299+0000 7f4094a00640 1 -- 172.21.15.49:0/93807433 >> v1:172.21.15.49:6789/0 conn(0x7f40900b5630 legacy=0x7f4090071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.299+0000 7f4094a00640 1 -- 172.21.15.49:0/93807433 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409006aa50 con 0x7f40900b3650 2024-01-31T05:04:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.303+0000 7f962e800640 1 -- 172.21.15.49:0/583740837 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96300b2ea0 msgr2=0x7f96300b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.303+0000 7f962e800640 1 --2- 172.21.15.49:0/583740837 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96300b2ea0 0x7f96300b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.303+0000 7f962e800640 1 -- 172.21.15.49:0/583740837 >> v2:172.21.15.49:3300/0 conn(0x7f96300703c0 msgr2=0x7f9630070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.303+0000 7f962e800640 1 --2- 172.21.15.49:0/583740837 >> v2:172.21.15.49:3300/0 conn(0x7f96300703c0 0x7f9630070850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.303+0000 7f962e800640 1 -- 172.21.15.49:0/583740837 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96300b3eb0 con 0x7f963006dab0 2024-01-31T05:04:45.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.307+0000 7f4094a00640 1 --2- 172.21.15.49:0/93807433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40900b3650 0x7f409006b810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4078013db0 tx=0x7f4078024b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=285cad50977af778 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.307+0000 7f408f400640 1 -- 172.21.15.49:0/93807433 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40780ad9e0 con 0x7f40900b3650 2024-01-31T05:04:45.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.307+0000 7f408f400640 1 -- 172.21.15.49:0/93807433 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40780adb40 con 0x7f40900b3650 2024-01-31T05:04:45.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.307+0000 7f408f400640 1 -- 172.21.15.49:0/93807433 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40780b5440 con 0x7f40900b3650 2024-01-31T05:04:45.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.307+0000 7f962e800640 1 --2- 172.21.15.49:0/583740837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f963006dab0 0x7f963015e3e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f963006beb0 tx=0x7f962801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ceea88dfd3d9957c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.307+0000 7f4097400640 1 -- 172.21.15.49:0/93807433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40900b3650 msgr2=0x7f409006b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.307+0000 7f4097400640 1 --2- 172.21.15.49:0/93807433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40900b3650 0x7f409006b810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4078013db0 tx=0x7f4078024b40 comp rx=0 tx=0).stop 2024-01-31T05:04:45.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.307+0000 7f962d400640 1 -- 172.21.15.49:0/583740837 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96280a5960 con 0x7f963006dab0 2024-01-31T05:04:45.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.307+0000 7f962d400640 1 -- 172.21.15.49:0/583740837 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96280a5ac0 con 0x7f963006dab0 2024-01-31T05:04:45.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.307+0000 7f962d400640 1 -- 172.21.15.49:0/583740837 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96280a5e50 con 0x7f963006dab0 2024-01-31T05:04:45.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.307+0000 7f9635400640 1 -- 172.21.15.49:0/583740837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f963006dab0 msgr2=0x7f963015e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.307+0000 7f9635400640 1 --2- 172.21.15.49:0/583740837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f963006dab0 0x7f963015e3e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f963006beb0 tx=0x7f962801c8e0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.307+0000 7f4097400640 1 -- 172.21.15.49:0/93807433 shutdown_connections 2024-01-31T05:04:45.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.307+0000 7f4097400640 1 --2- 172.21.15.49:0/93807433 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f409006f5c0 0x7f40900b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.307+0000 7f4097400640 1 --2- 172.21.15.49:0/93807433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40900b3650 0x7f409006b810 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.307+0000 7f4097400640 1 -- 172.21.15.49:0/93807433 >> 172.21.15.49:0/93807433 conn(0x7f409006de40 msgr2=0x7f409006e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:45.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.311+0000 7f9635400640 1 -- 172.21.15.49:0/583740837 shutdown_connections 2024-01-31T05:04:45.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.311+0000 7f9635400640 1 --2- 172.21.15.49:0/583740837 >> v2:172.21.15.49:3300/0 conn(0x7f96300703c0 0x7f9630070850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.311+0000 7f9635400640 1 --2- 172.21.15.49:0/583740837 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96300b2ea0 0x7f96300b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.311+0000 7f9635400640 1 --2- 172.21.15.49:0/583740837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f963006dab0 0x7f963015e3e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.311+0000 7f9635400640 1 -- 172.21.15.49:0/583740837 >> 172.21.15.49:0/583740837 conn(0x7f96300b09a0 msgr2=0x7f96300b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:45.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.311+0000 7f9635400640 1 -- 172.21.15.49:0/583740837 shutdown_connections 2024-01-31T05:04:45.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.311+0000 7f9635400640 1 -- 172.21.15.49:0/583740837 wait complete. 2024-01-31T05:04:45.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.315+0000 7f4097400640 1 -- 172.21.15.49:0/93807433 shutdown_connections 2024-01-31T05:04:45.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.315+0000 7f4097400640 1 -- 172.21.15.49:0/93807433 wait complete. 2024-01-31T05:04:45.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.315+0000 7f9635400640 1 Processor -- start 2024-01-31T05:04:45.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.315+0000 7f9635400640 1 -- start start 2024-01-31T05:04:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.315+0000 7f9635400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f963006dab0 0x7f9630152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.315+0000 7f9635400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96300703c0 0x7f9630205e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.315+0000 7f9635400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96300b2ea0 0x7f96300adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.315+0000 7f9635400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96302063b0 con 0x7f963006dab0 2024-01-31T05:04:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.315+0000 7f9635400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96300ad7b0 con 0x7f96300703c0 2024-01-31T05:04:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.315+0000 7f9635400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9630153120 con 0x7f96300b2ea0 2024-01-31T05:04:45.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.315+0000 7f4097400640 1 Processor -- start 2024-01-31T05:04:45.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.315+0000 7f962de00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96300703c0 0x7f9630205e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.315+0000 7f962de00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96300703c0 0x7f9630205e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41780/0 (socket says 172.21.15.49:41780) 2024-01-31T05:04:45.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.315+0000 7f962de00640 1 -- 172.21.15.49:0/900516086 learned_addr learned my addr 172.21.15.49:0/900516086 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:45.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.315+0000 7f962e800640 1 --2- 172.21.15.49:0/900516086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f963006dab0 0x7f9630152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f962de00640 1 -- 172.21.15.49:0/900516086 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96300b2ea0 msgr2=0x7f96300adc40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-31T05:04:45.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f962de00640 1 --2- 172.21.15.49:0/900516086 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96300b2ea0 0x7f96300adc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f962de00640 1 -- 172.21.15.49:0/900516086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f963006dab0 msgr2=0x7f9630152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f962de00640 1 --2- 172.21.15.49:0/900516086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f963006dab0 0x7f9630152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f962de00640 1 -- 172.21.15.49:0/900516086 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9628009a70 con 0x7f96300703c0 2024-01-31T05:04:45.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f4097400640 1 -- start start 2024-01-31T05:04:45.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f962de00640 1 --2- 172.21.15.49:0/900516086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96300703c0 0x7f9630205e70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f961800e820 tx=0x7f961800ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f9626a00640 1 -- 172.21.15.49:0/900516086 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618009580 con 0x7f96300703c0 2024-01-31T05:04:45.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f9626a00640 1 -- 172.21.15.49:0/900516086 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961800c940 con 0x7f96300703c0 2024-01-31T05:04:45.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f4097400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f409006f5c0 0x7f4090156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f4097400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40900b3650 0x7f4090141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f4097400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40900b5630 0x7f4090143cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f408fe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40900b3650 0x7f4090141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f408fe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40900b3650 0x7f4090141680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38732/0 (socket says 172.21.15.49:38732) 2024-01-31T05:04:45.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f9626a00640 1 -- 172.21.15.49:0/900516086 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961800ccf0 con 0x7f96300703c0 2024-01-31T05:04:45.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f9635400640 1 -- 172.21.15.49:0/900516086 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96300acec0 con 0x7f96300703c0 2024-01-31T05:04:45.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f9635400640 1 -- 172.21.15.49:0/900516086 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96300ad440 con 0x7f96300703c0 2024-01-31T05:04:45.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.323+0000 7f9635400640 1 -- 172.21.15.49:0/900516086 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f963006b660 con 0x7f96300703c0 2024-01-31T05:04:45.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f408fe00640 1 -- 172.21.15.49:0/1746730567 learned_addr learned my addr 172.21.15.49:0/1746730567 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:45.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f4097400640 1 -- 172.21.15.49:0/1746730567 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40901438b0 con 0x7f40900b3650 2024-01-31T05:04:45.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f4097400640 1 -- 172.21.15.49:0/1746730567 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409015a000 con 0x7f409006f5c0 2024-01-31T05:04:45.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f4097400640 1 -- 172.21.15.49:0/1746730567 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4090159ae0 con 0x7f40900b5630 2024-01-31T05:04:45.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.319+0000 7f4094a00640 1 --2- 172.21.15.49:0/1746730567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f409006f5c0 0x7f4090156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.323+0000 7f4095e00640 1 --2- 172.21.15.49:0/1746730567 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40900b5630 0x7f4090143cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.323+0000 7f4095e00640 1 -- 172.21.15.49:0/1746730567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f409006f5c0 msgr2=0x7f4090156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.323+0000 7f4095e00640 1 --2- 172.21.15.49:0/1746730567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f409006f5c0 0x7f4090156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.323+0000 7f4095e00640 1 -- 172.21.15.49:0/1746730567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40900b3650 msgr2=0x7f4090141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.323+0000 7f4095e00640 1 --2- 172.21.15.49:0/1746730567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40900b3650 0x7f4090141680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.323+0000 7f4095e00640 1 -- 172.21.15.49:0/1746730567 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4078013a10 con 0x7f40900b5630 2024-01-31T05:04:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.323+0000 7f4095e00640 1 --2- 172.21.15.49:0/1746730567 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40900b5630 0x7f4090143cd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f408800c760 tx=0x7f408800cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.323+0000 7f408cc00640 1 -- 172.21.15.49:0/1746730567 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4088006d60 con 0x7f40900b5630 2024-01-31T05:04:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.323+0000 7f408cc00640 1 -- 172.21.15.49:0/1746730567 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408800ce10 con 0x7f40900b5630 2024-01-31T05:04:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.323+0000 7f4097400640 1 -- 172.21.15.49:0/1746730567 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40901565e0 con 0x7f40900b5630 2024-01-31T05:04:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.323+0000 7f4097400640 1 -- 172.21.15.49:0/1746730567 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4090156ba0 con 0x7f40900b5630 2024-01-31T05:04:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.323+0000 7f408cc00640 1 -- 172.21.15.49:0/1746730567 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4088003bc0 con 0x7f40900b5630 2024-01-31T05:04:45.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.327+0000 7f408cc00640 1 -- 172.21.15.49:0/1746730567 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f4088003d20 con 0x7f40900b5630 2024-01-31T05:04:45.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.327+0000 7f9626a00640 1 -- 172.21.15.49:0/900516086 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f9618013470 con 0x7f96300703c0 2024-01-31T05:04:45.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.331+0000 7f4097400640 1 -- 172.21.15.49:0/1746730567 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40600052a0 con 0x7f40900b5630 2024-01-31T05:04:45.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.331+0000 7f9626a00640 1 --2- 172.21.15.49:0/900516086 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f96080665d0 0x7f9608068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.331+0000 7f408cc00640 1 --2- 172.21.15.49:0/1746730567 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f40680665d0 0x7f4068068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.331+0000 7f9626a00640 1 -- 172.21.15.49:0/900516086 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f96180845d0 con 0x7f96300703c0 2024-01-31T05:04:45.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.331+0000 7f408cc00640 1 -- 172.21.15.49:0/1746730567 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4088083ba0 con 0x7f40900b5630 2024-01-31T05:04:45.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.331+0000 7f962e800640 1 --2- 172.21.15.49:0/900516086 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f96080665d0 0x7f9608068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.331+0000 7f4094a00640 1 --2- 172.21.15.49:0/1746730567 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f40680665d0 0x7f4068068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.331+0000 7f962e800640 1 --2- 172.21.15.49:0/900516086 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f96080665d0 0x7f9608068a90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f96280af000 tx=0x7f96280a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.331+0000 7f4094a00640 1 --2- 172.21.15.49:0/1746730567 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f40680665d0 0x7f4068068a90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f40780b7000 tx=0x7f4078008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.335+0000 7f9626a00640 1 -- 172.21.15.49:0/900516086 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9618051560 con 0x7f96300703c0 2024-01-31T05:04:45.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.339+0000 7f408cc00640 1 -- 172.21.15.49:0/1746730567 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f4088050bc0 con 0x7f40900b5630 2024-01-31T05:04:45.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.351+0000 7f886da00640 1 Processor -- start 2024-01-31T05:04:45.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.351+0000 7f886da00640 1 -- start start 2024-01-31T05:04:45.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.351+0000 7f886da00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f886815d330 0x7f8868070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.351+0000 7f886da00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886806cc00 con 0x7f88680b3430 2024-01-31T05:04:45.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.351+0000 7f886da00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886806ef10 con 0x7f886806e670 2024-01-31T05:04:45.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.351+0000 7f886da00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8868070840 con 0x7f886815d330 2024-01-31T05:04:45.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.351+0000 7f8867400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f88680b3430 0x7f88680b38c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57864/0 (socket says 172.21.15.49:57864) 2024-01-31T05:04:45.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.351+0000 7f8867400640 1 -- 172.21.15.49:0/495764852 learned_addr learned my addr 172.21.15.49:0/495764852 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:45.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.351+0000 7f8866a00640 1 --2- 172.21.15.49:0/495764852 >> v2:172.21.15.195:3300/0 conn(0x7f886815d330 0x7f8868070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.355+0000 7f8866a00640 1 -- 172.21.15.49:0/495764852 >> v1:172.21.15.195:6789/0 conn(0x7f886806e670 legacy=0x7f8868071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:45.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.355+0000 7f8865600640 1 -- 172.21.15.49:0/495764852 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074090200 0 0) 0x7f886806cc00 con 0x7f88680b3430 2024-01-31T05:04:45.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.355+0000 7f8866a00640 1 -- 172.21.15.49:0/495764852 >> v1:172.21.15.49:6789/0 conn(0x7f88680b3430 legacy=0x7f88680b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.355+0000 7f8866a00640 1 -- 172.21.15.49:0/495764852 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8868070560 con 0x7f886815d330 2024-01-31T05:04:45.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.359+0000 7f8866a00640 1 --2- 172.21.15.49:0/495764852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f886815d330 0x7f8868070ee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8860009d90 tx=0x7f886001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7ec3980ebba275 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.359+0000 7f8865600640 1 -- 172.21.15.49:0/495764852 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88600a58b0 con 0x7f886815d330 2024-01-31T05:04:45.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.359+0000 7f8865600640 1 -- 172.21.15.49:0/495764852 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88600a5a10 con 0x7f886815d330 2024-01-31T05:04:45.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.363+0000 7f886da00640 1 -- 172.21.15.49:0/495764852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f886815d330 msgr2=0x7f8868070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.363+0000 7f8865600640 1 -- 172.21.15.49:0/495764852 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88600a5da0 con 0x7f886815d330 2024-01-31T05:04:45.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.363+0000 7f886da00640 1 --2- 172.21.15.49:0/495764852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f886815d330 0x7f8868070ee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8860009d90 tx=0x7f886001c8e0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.363+0000 7f886da00640 1 -- 172.21.15.49:0/495764852 shutdown_connections 2024-01-31T05:04:45.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.363+0000 7f886da00640 1 --2- 172.21.15.49:0/495764852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f886815d330 0x7f8868070ee0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.363+0000 7f886da00640 1 -- 172.21.15.49:0/495764852 >> 172.21.15.49:0/495764852 conn(0x7f88680b0b60 msgr2=0x7f88680b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:45.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.363+0000 7f886da00640 1 -- 172.21.15.49:0/495764852 shutdown_connections 2024-01-31T05:04:45.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.363+0000 7f886da00640 1 -- 172.21.15.49:0/495764852 wait complete. 2024-01-31T05:04:45.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.367+0000 7f1e1b600640 1 Processor -- start 2024-01-31T05:04:45.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.367+0000 7f1e1b600640 1 -- start start 2024-01-31T05:04:45.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.367+0000 7f1e1b600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e140705d0 0x7f1e1415d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.367+0000 7f1e1b600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1e140b1ca0 0x7f1e1415a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.367+0000 7f1e1b600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1406dd50 con 0x7f1e140709b0 2024-01-31T05:04:45.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.367+0000 7f1e1b600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e140b3e40 con 0x7f1e140b1ca0 2024-01-31T05:04:45.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.367+0000 7f1e1b600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e14159910 con 0x7f1e140705d0 2024-01-31T05:04:45.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.367+0000 7f886da00640 1 Processor -- start 2024-01-31T05:04:45.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.367+0000 7f1e18c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e140705d0 0x7f1e1415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.367+0000 7f886da00640 1 -- start start 2024-01-31T05:04:45.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.367+0000 7f1e19600640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f1e140709b0 0x7f1e1406c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:50610/0 (socket says 172.21.15.49:50610) 2024-01-31T05:04:45.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.367+0000 7f1e19600640 1 -- 172.21.15.49:0/36703547 learned_addr learned my addr 172.21.15.49:0/36703547 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:45.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.367+0000 7f1e13e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1e140b1ca0 0x7f1e1415a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f1e13400640 1 -- 172.21.15.49:0/36703547 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338116412 0 0) 0x7f1e1406dd50 con 0x7f1e140709b0 2024-01-31T05:04:45.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f1e13400640 1 -- 172.21.15.49:0/36703547 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1df4003530 con 0x7f1e140709b0 2024-01-31T05:04:45.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f886da00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f886806e670 0x7f8868153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f1e13400640 1 -- 172.21.15.49:0/36703547 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 89254699 0 0) 0x7f1df4003530 con 0x7f1e140709b0 2024-01-31T05:04:45.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f1e13e00640 1 -- 172.21.15.49:0/36703547 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e140705d0 msgr2=0x7f1e1415d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:45.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f886da00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88680b3430 0x7f886815acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f8866a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f886806e670 0x7f8868153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f8866a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f886806e670 0x7f8868153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:53206/0 (socket says 172.21.15.49:53206) 2024-01-31T05:04:45.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f8866000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88680b3430 0x7f886815acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f8866000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88680b3430 0x7f886815acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41818/0 (socket says 172.21.15.49:41818) 2024-01-31T05:04:45.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f886da00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f886815d330 0x7f8868141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f8866a00640 1 -- 172.21.15.49:0/2089131464 learned_addr learned my addr 172.21.15.49:0/2089131464 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:45.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f886da00640 1 -- 172.21.15.49:0/2089131464 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88681428a0 con 0x7f886815d330 2024-01-31T05:04:45.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f886da00640 1 -- 172.21.15.49:0/2089131464 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8868142530 con 0x7f88680b3430 2024-01-31T05:04:45.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f886da00640 1 -- 172.21.15.49:0/2089131464 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8868153af0 con 0x7f886806e670 2024-01-31T05:04:45.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f8867400640 1 --2- 172.21.15.49:0/2089131464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f886815d330 0x7f8868141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f8866000640 1 -- 172.21.15.49:0/2089131464 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f886806e670 msgr2=0x7f8868153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f8866000640 1 --2- 172.21.15.49:0/2089131464 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f886806e670 0x7f8868153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f8866000640 1 -- 172.21.15.49:0/2089131464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f886815d330 msgr2=0x7f8868141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f8866000640 1 --2- 172.21.15.49:0/2089131464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f886815d330 0x7f8868141280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f8866000640 1 -- 172.21.15.49:0/2089131464 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8860009a70 con 0x7f88680b3430 2024-01-31T05:04:45.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.375+0000 7f8866000640 1 --2- 172.21.15.49:0/2089131464 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88680b3430 0x7f886815acb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f885000b410 tx=0x7f885000b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f1e13e00640 1 --2- 172.21.15.49:0/36703547 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e140705d0 0x7f1e1415d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f1e13e00640 1 -- 172.21.15.49:0/36703547 >> v1:172.21.15.195:6789/0 conn(0x7f1e140709b0 legacy=0x7f1e1406c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.371+0000 7f1e13e00640 1 -- 172.21.15.49:0/36703547 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1415a860 con 0x7f1e140b1ca0 2024-01-31T05:04:45.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.375+0000 7f1e18c00640 1 --2- 172.21.15.49:0/36703547 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e140705d0 0x7f1e1415d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:45.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.375+0000 7f885ea00640 1 -- 172.21.15.49:0/2089131464 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850004020 con 0x7f88680b3430 2024-01-31T05:04:45.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.375+0000 7f885ea00640 1 -- 172.21.15.49:0/2089131464 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8850004180 con 0x7f88680b3430 2024-01-31T05:04:45.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.375+0000 7f886da00640 1 -- 172.21.15.49:0/2089131464 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8868153dd0 con 0x7f88680b3430 2024-01-31T05:04:45.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.375+0000 7f886da00640 1 -- 172.21.15.49:0/2089131464 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88681537a0 con 0x7f88680b3430 2024-01-31T05:04:45.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.375+0000 7f885ea00640 1 -- 172.21.15.49:0/2089131464 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850011630 con 0x7f88680b3430 2024-01-31T05:04:45.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.375+0000 7f1e13e00640 1 --2- 172.21.15.49:0/36703547 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e140b1ca0 0x7f1e1415a320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0087c0 tx=0x7f1dfc01e8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27bda51f885185ab server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.375+0000 7f886da00640 1 -- 172.21.15.49:0/2089131464 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88380052a0 con 0x7f88680b3430 2024-01-31T05:04:45.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.379+0000 7f1e13400640 1 -- 172.21.15.49:0/36703547 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c001a00 con 0x7f1e140b1ca0 2024-01-31T05:04:45.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.379+0000 7f1e13400640 1 -- 172.21.15.49:0/36703547 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dfc0ab070 con 0x7f1e140b1ca0 2024-01-31T05:04:45.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.379+0000 7f1e13400640 1 -- 172.21.15.49:0/36703547 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc0a77d0 con 0x7f1e140b1ca0 2024-01-31T05:04:45.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.379+0000 7f1e1b600640 1 -- 172.21.15.49:0/36703547 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e140b1ca0 msgr2=0x7f1e1415a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.379+0000 7f1e1b600640 1 --2- 172.21.15.49:0/36703547 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e140b1ca0 0x7f1e1415a320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0087c0 tx=0x7f1dfc01e8d0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.379+0000 7f1e1b600640 1 -- 172.21.15.49:0/36703547 shutdown_connections 2024-01-31T05:04:45.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.379+0000 7f1e1b600640 1 --2- 172.21.15.49:0/36703547 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e140b1ca0 0x7f1e1415a320 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.379+0000 7f1e1b600640 1 --2- 172.21.15.49:0/36703547 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e140705d0 0x7f1e1415d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.379+0000 7f1e1b600640 1 -- 172.21.15.49:0/36703547 >> 172.21.15.49:0/36703547 conn(0x7f1e140b09a0 msgr2=0x7f1e140b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:45.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.379+0000 7f885ea00640 1 -- 172.21.15.49:0/2089131464 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f8850011790 con 0x7f88680b3430 2024-01-31T05:04:45.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.379+0000 7f1e1b600640 1 -- 172.21.15.49:0/36703547 shutdown_connections 2024-01-31T05:04:45.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.379+0000 7f1e1b600640 1 -- 172.21.15.49:0/36703547 wait complete. 2024-01-31T05:04:45.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.379+0000 7f885ea00640 1 --2- 172.21.15.49:0/2089131464 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f88400665d0 0x7f8840068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.379+0000 7f885ea00640 1 -- 172.21.15.49:0/2089131464 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8850083c10 con 0x7f88680b3430 2024-01-31T05:04:45.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.383+0000 7f1e1b600640 1 Processor -- start 2024-01-31T05:04:45.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.383+0000 7f885ea00640 1 -- 172.21.15.49:0/2089131464 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f8850050c30 con 0x7f88680b3430 2024-01-31T05:04:45.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.383+0000 7f1e1b600640 1 -- start start 2024-01-31T05:04:45.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.387+0000 7f8866a00640 1 --2- 172.21.15.49:0/2089131464 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f88400665d0 0x7f8840068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.387+0000 7f8866a00640 1 --2- 172.21.15.49:0/2089131464 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f88400665d0 0x7f8840068a90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f88600194f0 tx=0x7f88600a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.387+0000 7f1e1b600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e140705d0 0x7f1e1414a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.387+0000 7f1e1b600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e140709b0 0x7f1e140cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.387+0000 7f1e18c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e140705d0 0x7f1e1414a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.387+0000 7f1e18c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e140705d0 0x7f1e1414a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38752/0 (socket says 172.21.15.49:38752) 2024-01-31T05:04:45.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.387+0000 7f1e1b600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e140b1ca0 0x7f1e14158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.387+0000 7f1e1b600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1409c300 con 0x7f1e140705d0 2024-01-31T05:04:45.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.387+0000 7f1e1b600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1409b680 con 0x7f1e140b1ca0 2024-01-31T05:04:45.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.387+0000 7f1e1b600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1409b960 con 0x7f1e140709b0 2024-01-31T05:04:45.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.387+0000 7f1e13e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e140709b0 0x7f1e140cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.387+0000 7f1e13e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e140709b0 0x7f1e140cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:53210/0 (socket says 172.21.15.49:53210) 2024-01-31T05:04:45.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.387+0000 7f1e13e00640 1 -- 172.21.15.49:0/1361002890 learned_addr learned my addr 172.21.15.49:0/1361002890 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:45.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.387+0000 7f1e13e00640 1 -- 172.21.15.49:0/1361002890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e140b1ca0 msgr2=0x7f1e14158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.387+0000 7f1e13e00640 1 --2- 172.21.15.49:0/1361002890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e140b1ca0 0x7f1e14158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.387+0000 7f1e13e00640 1 -- 172.21.15.49:0/1361002890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e140705d0 msgr2=0x7f1e1414a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.387+0000 7f1e13e00640 1 --2- 172.21.15.49:0/1361002890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e140705d0 0x7f1e1414a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.387+0000 7f1e13e00640 1 -- 172.21.15.49:0/1361002890 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc0084a0 con 0x7f1e140709b0 2024-01-31T05:04:45.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.391+0000 7f1e13e00640 1 --2- 172.21.15.49:0/1361002890 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e140709b0 0x7f1e140cdd40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0b3040 tx=0x7f1dfc01b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.395+0000 7f1e10c00640 1 -- 172.21.15.49:0/1361002890 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc0bdde0 con 0x7f1e140709b0 2024-01-31T05:04:45.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.395+0000 7f1e10c00640 1 -- 172.21.15.49:0/1361002890 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dfc003620 con 0x7f1e140709b0 2024-01-31T05:04:45.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.395+0000 7f1e10c00640 1 -- 172.21.15.49:0/1361002890 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc0039b0 con 0x7f1e140709b0 2024-01-31T05:04:45.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.395+0000 7f1e1b600640 1 -- 172.21.15.49:0/1361002890 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1409bc40 con 0x7f1e140709b0 2024-01-31T05:04:45.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.395+0000 7f1e1b600640 1 -- 172.21.15.49:0/1361002890 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1414acf0 con 0x7f1e140709b0 2024-01-31T05:04:45.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.399+0000 7f1e1b600640 1 -- 172.21.15.49:0/1361002890 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e140b2220 con 0x7f1e140709b0 2024-01-31T05:04:45.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.399+0000 7f1e10c00640 1 -- 172.21.15.49:0/1361002890 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1dfc003b10 con 0x7f1e140709b0 2024-01-31T05:04:45.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.399+0000 7f1e10c00640 1 --2- 172.21.15.49:0/1361002890 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1dec0665d0 0x7f1dec068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.399+0000 7f1e10c00640 1 -- 172.21.15.49:0/1361002890 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1dfc126c90 con 0x7f1e140709b0 2024-01-31T05:04:45.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.403+0000 7f1e18c00640 1 --2- 172.21.15.49:0/1361002890 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1dec0665d0 0x7f1dec068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.403+0000 7f1e18c00640 1 --2- 172.21.15.49:0/1361002890 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1dec0665d0 0x7f1dec068a90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400ab60 tx=0x7f1e04008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.403+0000 7f1e10c00640 1 -- 172.21.15.49:0/1361002890 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1dfc0f3d60 con 0x7f1e140709b0 2024-01-31T05:04:45.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.495+0000 7ff457200640 1 -- 172.21.15.49:0/1055993400 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff45015b4f0 con 0x7ff4500cdf10 2024-01-31T05:04:45.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.495+0000 7ff447e00640 1 -- 172.21.15.49:0/1055993400 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff45015b4f0 con 0x7ff4500cdf10 2024-01-31T05:04:45.497 INFO:teuthology.orchestra.run.smithi049.stdout:55834574859 2024-01-31T05:04:45.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.499+0000 7ff457200640 1 -- 172.21.15.49:0/1055993400 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff4280665d0 msgr2=0x7ff428068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.499+0000 7ff457200640 1 --2- 172.21.15.49:0/1055993400 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff4280665d0 0x7ff428068a90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff4400b2000 tx=0x7ff4400ab070 comp rx=0 tx=0).stop 2024-01-31T05:04:45.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.499+0000 7ff457200640 1 -- 172.21.15.49:0/1055993400 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4500cdf10 msgr2=0x7ff45014d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.499+0000 7ff457200640 1 --2- 172.21.15.49:0/1055993400 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4500cdf10 0x7ff45014d140 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff44800cba0 tx=0x7ff44800a430 comp rx=0 tx=0).stop 2024-01-31T05:04:45.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.499+0000 7ff457200640 1 -- 172.21.15.49:0/1055993400 shutdown_connections 2024-01-31T05:04:45.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.499+0000 7ff457200640 1 --2- 172.21.15.49:0/1055993400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff45015b110 0x7ff45009aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.499+0000 7ff457200640 1 --2- 172.21.15.49:0/1055993400 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff4280665d0 0x7ff428068a90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.499+0000 7ff457200640 1 --2- 172.21.15.49:0/1055993400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4500ce610 0x7ff450150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.499+0000 7ff457200640 1 --2- 172.21.15.49:0/1055993400 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4500cdf10 0x7ff45014d140 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.499+0000 7ff457200640 1 -- 172.21.15.49:0/1055993400 >> 172.21.15.49:0/1055993400 conn(0x7ff4500b09a0 msgr2=0x7ff45015a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:45.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.499+0000 7ff457200640 1 -- 172.21.15.49:0/1055993400 shutdown_connections 2024-01-31T05:04:45.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.499+0000 7ff457200640 1 -- 172.21.15.49:0/1055993400 wait complete. 2024-01-31T05:04:45.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.1 2024-01-31T05:04:45.538 DEBUG:teuthology.parallel:result is None 2024-01-31T05:04:45.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.571+0000 7f4d1ea00640 1 -- 172.21.15.49:0/16358814 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4cf0005820 con 0x7f4d280b1ca0 2024-01-31T05:04:45.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.571+0000 7f4d25600640 1 -- 172.21.15.49:0/16358814 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4d100eedd0 con 0x7f4d280b1ca0 2024-01-31T05:04:45.574 INFO:teuthology.orchestra.run.smithi049.stdout:55834574858 2024-01-31T05:04:45.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.575+0000 7f4d1ea00640 1 -- 172.21.15.49:0/16358814 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4d00066560 msgr2=0x7f4d00068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.575+0000 7f4d1ea00640 1 --2- 172.21.15.49:0/16358814 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4d00066560 0x7f4d00068a20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4d2815c070 tx=0x7f4d18008040 comp rx=0 tx=0).stop 2024-01-31T05:04:45.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.575+0000 7f4d1ea00640 1 -- 172.21.15.49:0/16358814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d280b1ca0 msgr2=0x7f4d28155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.575+0000 7f4d1ea00640 1 --2- 172.21.15.49:0/16358814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d280b1ca0 0x7f4d28155cc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4d100ad000 tx=0x7f4d1001a460 comp rx=0 tx=0).stop 2024-01-31T05:04:45.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.575+0000 7f4d1ea00640 1 -- 172.21.15.49:0/16358814 shutdown_connections 2024-01-31T05:04:45.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.575+0000 7f4d1ea00640 1 --2- 172.21.15.49:0/16358814 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4d00066560 0x7f4d00068a20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.575+0000 7f4d1ea00640 1 --2- 172.21.15.49:0/16358814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d280b1ca0 0x7f4d28155cc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.575+0000 7f4d1ea00640 1 --2- 172.21.15.49:0/16358814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d280709b0 0x7f4d28155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.575+0000 7f4d1ea00640 1 --2- 172.21.15.49:0/16358814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d280705d0 0x7f4d28203410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.575+0000 7f4d1ea00640 1 -- 172.21.15.49:0/16358814 >> 172.21.15.49:0/16358814 conn(0x7f4d280b09a0 msgr2=0x7f4d280b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:45.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.575+0000 7f4d1ea00640 1 -- 172.21.15.49:0/16358814 shutdown_connections 2024-01-31T05:04:45.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.575+0000 7f4d1ea00640 1 -- 172.21.15.49:0/16358814 wait complete. 2024-01-31T05:04:45.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.579+0000 7f200e000640 1 -- 172.21.15.49:0/2758580131 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2018157030 con 0x7f20180703c0 2024-01-31T05:04:45.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.583+0000 7f2014c00640 1 -- 172.21.15.49:0/2758580131 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f20080f5020 con 0x7f20180703c0 2024-01-31T05:04:45.584 INFO:teuthology.orchestra.run.smithi049.stdout:55834574858 2024-01-31T05:04:45.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.583+0000 7f7020200640 1 -- 172.21.15.49:0/2162893834 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7018074860 con 0x7f7018070a00 2024-01-31T05:04:45.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.587+0000 7f200e000640 1 -- 172.21.15.49:0/2758580131 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1ff0066500 msgr2=0x7f1ff00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.587+0000 7f200e000640 1 --2- 172.21.15.49:0/2758580131 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1ff0066500 0x7f1ff00689c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2000005890 tx=0x7f2000009040 comp rx=0 tx=0).stop 2024-01-31T05:04:45.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.587+0000 7f200e000640 1 -- 172.21.15.49:0/2758580131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20180703c0 msgr2=0x7f2018202300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.587+0000 7f200e000640 1 --2- 172.21.15.49:0/2758580131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20180703c0 0x7f2018202300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f20080ac000 tx=0x7f200801acb0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.587+0000 7f200e000640 1 -- 172.21.15.49:0/2758580131 shutdown_connections 2024-01-31T05:04:45.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.587+0000 7f200e000640 1 --2- 172.21.15.49:0/2758580131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f201815e3e0 0x7f2018154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.587+0000 7f200e000640 1 --2- 172.21.15.49:0/2758580131 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1ff0066500 0x7f1ff00689c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.587+0000 7f200e000640 1 --2- 172.21.15.49:0/2758580131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20180703c0 0x7f2018202300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.587+0000 7f200e000640 1 --2- 172.21.15.49:0/2758580131 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f201806dab0 0x7f2018157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.587+0000 7f200e000640 1 -- 172.21.15.49:0/2758580131 >> 172.21.15.49:0/2758580131 conn(0x7f20180b09a0 msgr2=0x7f2018152880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:45.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.587+0000 7f7015600640 1 -- 172.21.15.49:0/2162893834 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7010054700 con 0x7f7018070a00 2024-01-31T05:04:45.588 INFO:teuthology.orchestra.run.smithi049.stdout:55834574859 2024-01-31T05:04:45.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.587+0000 7f200e000640 1 -- 172.21.15.49:0/2758580131 shutdown_connections 2024-01-31T05:04:45.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.587+0000 7f200e000640 1 -- 172.21.15.49:0/2758580131 wait complete. 2024-01-31T05:04:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.591+0000 7f7020200640 1 -- 172.21.15.49:0/2162893834 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6ff0066560 msgr2=0x7f6ff0068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.591+0000 7f7020200640 1 --2- 172.21.15.49:0/2162893834 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6ff0066560 0x7f6ff0068a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f70080097c0 tx=0x7f70080a7000 comp rx=0 tx=0).stop 2024-01-31T05:04:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.591+0000 7f7020200640 1 -- 172.21.15.49:0/2162893834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7018070a00 msgr2=0x7f701809a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.591+0000 7f7020200640 1 --2- 172.21.15.49:0/2162893834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7018070a00 0x7f701809a340 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f701000cae0 tx=0x7f701000a060 comp rx=0 tx=0).stop 2024-01-31T05:04:45.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.591+0000 7f7020200640 1 -- 172.21.15.49:0/2162893834 shutdown_connections 2024-01-31T05:04:45.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.591+0000 7f7020200640 1 --2- 172.21.15.49:0/2162893834 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f70180b3a10 0x7f701809bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.591+0000 7f7020200640 1 --2- 172.21.15.49:0/2162893834 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6ff0066560 0x7f6ff0068a20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.591+0000 7f7020200640 1 --2- 172.21.15.49:0/2162893834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7018070a00 0x7f701809a340 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.591+0000 7f7020200640 1 --2- 172.21.15.49:0/2162893834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7018070620 0x7f70180ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.591+0000 7f7020200640 1 -- 172.21.15.49:0/2162893834 >> 172.21.15.49:0/2162893834 conn(0x7f70180b09a0 msgr2=0x7f70180ac640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:45.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.591+0000 7f7020200640 1 -- 172.21.15.49:0/2162893834 shutdown_connections 2024-01-31T05:04:45.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.591+0000 7f7020200640 1 -- 172.21.15.49:0/2162893834 wait complete. 2024-01-31T05:04:45.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.4 2024-01-31T05:04:45.618 DEBUG:teuthology.parallel:result is None 2024-01-31T05:04:45.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.3 2024-01-31T05:04:45.625 DEBUG:teuthology.parallel:result is None 2024-01-31T05:04:45.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.0 2024-01-31T05:04:45.628 DEBUG:teuthology.parallel:result is None 2024-01-31T05:04:45.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.643+0000 7f9635400640 1 -- 172.21.15.49:0/900516086 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9630074860 con 0x7f96300703c0 2024-01-31T05:04:45.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.643+0000 7f9626a00640 1 -- 172.21.15.49:0/900516086 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9618054b80 con 0x7f96300703c0 2024-01-31T05:04:45.645 INFO:teuthology.orchestra.run.smithi049.stdout:55834574858 2024-01-31T05:04:45.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.647+0000 7f9635400640 1 -- 172.21.15.49:0/900516086 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f96080665d0 msgr2=0x7f9608068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.647+0000 7f9635400640 1 --2- 172.21.15.49:0/900516086 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f96080665d0 0x7f9608068a90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f96280af000 tx=0x7f96280a7070 comp rx=0 tx=0).stop 2024-01-31T05:04:45.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.647+0000 7f9635400640 1 -- 172.21.15.49:0/900516086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96300703c0 msgr2=0x7f9630205e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.647+0000 7f9635400640 1 --2- 172.21.15.49:0/900516086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96300703c0 0x7f9630205e70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f961800e820 tx=0x7f961800ece0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.647+0000 7f9635400640 1 -- 172.21.15.49:0/900516086 shutdown_connections 2024-01-31T05:04:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.647+0000 7f9635400640 1 --2- 172.21.15.49:0/900516086 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96300b2ea0 0x7f96300adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.647+0000 7f9635400640 1 --2- 172.21.15.49:0/900516086 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f96080665d0 0x7f9608068a90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.647+0000 7f9635400640 1 --2- 172.21.15.49:0/900516086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96300703c0 0x7f9630205e70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.647+0000 7f9635400640 1 --2- 172.21.15.49:0/900516086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f963006dab0 0x7f9630152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.647+0000 7f9635400640 1 -- 172.21.15.49:0/900516086 >> 172.21.15.49:0/900516086 conn(0x7f96300b09a0 msgr2=0x7f96300cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.647+0000 7f9635400640 1 -- 172.21.15.49:0/900516086 shutdown_connections 2024-01-31T05:04:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.647+0000 7f9635400640 1 -- 172.21.15.49:0/900516086 wait complete. 2024-01-31T05:04:45.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.647+0000 7f1e1b600640 1 -- 172.21.15.49:0/1361002890 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1e1406b660 con 0x7f1e140709b0 2024-01-31T05:04:45.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.647+0000 7f1e10c00640 1 -- 172.21.15.49:0/1361002890 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1dfc0f7380 con 0x7f1e140709b0 2024-01-31T05:04:45.651 INFO:teuthology.orchestra.run.smithi049.stdout:55834574858 2024-01-31T05:04:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.651+0000 7f1e1b600640 1 -- 172.21.15.49:0/1361002890 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1dec0665d0 msgr2=0x7f1dec068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.651+0000 7f1e1b600640 1 --2- 172.21.15.49:0/1361002890 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1dec0665d0 0x7f1dec068a90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400ab60 tx=0x7f1e04008040 comp rx=0 tx=0).stop 2024-01-31T05:04:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.651+0000 7f1e1b600640 1 -- 172.21.15.49:0/1361002890 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e140709b0 msgr2=0x7f1e140cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.651+0000 7f1e1b600640 1 --2- 172.21.15.49:0/1361002890 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e140709b0 0x7f1e140cdd40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0b3040 tx=0x7f1dfc01b670 comp rx=0 tx=0).stop 2024-01-31T05:04:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.651+0000 7f1e1b600640 1 -- 172.21.15.49:0/1361002890 shutdown_connections 2024-01-31T05:04:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.651+0000 7f1e1b600640 1 --2- 172.21.15.49:0/1361002890 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1dec0665d0 0x7f1dec068a90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.651+0000 7f1e1b600640 1 --2- 172.21.15.49:0/1361002890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e140b1ca0 0x7f1e14158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.651+0000 7f1e1b600640 1 --2- 172.21.15.49:0/1361002890 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e140709b0 0x7f1e140cdd40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.651+0000 7f1e1b600640 1 --2- 172.21.15.49:0/1361002890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e140705d0 0x7f1e1414a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.651+0000 7f1e1b600640 1 -- 172.21.15.49:0/1361002890 >> 172.21.15.49:0/1361002890 conn(0x7f1e140b09a0 msgr2=0x7f1e140b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:45.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.651+0000 7f1e1b600640 1 -- 172.21.15.49:0/1361002890 shutdown_connections 2024-01-31T05:04:45.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.651+0000 7f1e1b600640 1 -- 172.21.15.49:0/1361002890 wait complete. 2024-01-31T05:04:45.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.655+0000 7f4097400640 1 -- 172.21.15.49:0/1746730567 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f4060005550 con 0x7f40900b5630 2024-01-31T05:04:45.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.655+0000 7f408cc00640 1 -- 172.21.15.49:0/1746730567 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f40880541e0 con 0x7f40900b5630 2024-01-31T05:04:45.656 INFO:teuthology.orchestra.run.smithi049.stdout:55834574858 2024-01-31T05:04:45.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.655+0000 7f4097400640 1 -- 172.21.15.49:0/1746730567 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f40680665d0 msgr2=0x7f4068068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.655+0000 7f4097400640 1 --2- 172.21.15.49:0/1746730567 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f40680665d0 0x7f4068068a90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f40780b7000 tx=0x7f4078008040 comp rx=0 tx=0).stop 2024-01-31T05:04:45.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.655+0000 7f4097400640 1 -- 172.21.15.49:0/1746730567 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40900b5630 msgr2=0x7f4090143cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.655+0000 7f4097400640 1 --2- 172.21.15.49:0/1746730567 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40900b5630 0x7f4090143cd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f408800c760 tx=0x7f408800cc20 comp rx=0 tx=0).stop 2024-01-31T05:04:45.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.655+0000 7f4097400640 1 -- 172.21.15.49:0/1746730567 shutdown_connections 2024-01-31T05:04:45.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.655+0000 7f4097400640 1 --2- 172.21.15.49:0/1746730567 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f40900b5630 0x7f4090143cd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.655+0000 7f4097400640 1 --2- 172.21.15.49:0/1746730567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40900b3650 0x7f4090141680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.655+0000 7f4097400640 1 --2- 172.21.15.49:0/1746730567 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f40680665d0 0x7f4068068a90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.655+0000 7f4097400640 1 --2- 172.21.15.49:0/1746730567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f409006f5c0 0x7f4090156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.659+0000 7f4097400640 1 -- 172.21.15.49:0/1746730567 >> 172.21.15.49:0/1746730567 conn(0x7f409006de40 msgr2=0x7f40900d0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:45.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.659+0000 7f4097400640 1 -- 172.21.15.49:0/1746730567 shutdown_connections 2024-01-31T05:04:45.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.659+0000 7f4097400640 1 -- 172.21.15.49:0/1746730567 wait complete. 2024-01-31T05:04:45.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.671+0000 7f886da00640 1 -- 172.21.15.49:0/2089131464 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8838005550 con 0x7f88680b3430 2024-01-31T05:04:45.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.675+0000 7f885ea00640 1 -- 172.21.15.49:0/2089131464 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8850054250 con 0x7f88680b3430 2024-01-31T05:04:45.676 INFO:teuthology.orchestra.run.smithi049.stdout:55834574860 2024-01-31T05:04:45.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.675+0000 7f886da00640 1 -- 172.21.15.49:0/2089131464 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f88400665d0 msgr2=0x7f8840068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.675+0000 7f886da00640 1 --2- 172.21.15.49:0/2089131464 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f88400665d0 0x7f8840068a90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f88600194f0 tx=0x7f88600a7070 comp rx=0 tx=0).stop 2024-01-31T05:04:45.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.675+0000 7f886da00640 1 -- 172.21.15.49:0/2089131464 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88680b3430 msgr2=0x7f886815acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.675+0000 7f886da00640 1 --2- 172.21.15.49:0/2089131464 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88680b3430 0x7f886815acb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f885000b410 tx=0x7f885000b8d0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.675+0000 7f886da00640 1 -- 172.21.15.49:0/2089131464 shutdown_connections 2024-01-31T05:04:45.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.675+0000 7f886da00640 1 --2- 172.21.15.49:0/2089131464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f886815d330 0x7f8868141280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.675+0000 7f886da00640 1 --2- 172.21.15.49:0/2089131464 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f88400665d0 0x7f8840068a90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.675+0000 7f886da00640 1 --2- 172.21.15.49:0/2089131464 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88680b3430 0x7f886815acb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.675+0000 7f886da00640 1 --2- 172.21.15.49:0/2089131464 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f886806e670 0x7f8868153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.675+0000 7f886da00640 1 -- 172.21.15.49:0/2089131464 >> 172.21.15.49:0/2089131464 conn(0x7f88680b0b60 msgr2=0x7f8868151bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:45.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.675+0000 7f886da00640 1 -- 172.21.15.49:0/2089131464 shutdown_connections 2024-01-31T05:04:45.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.675+0000 7f886da00640 1 -- 172.21.15.49:0/2089131464 wait complete. 2024-01-31T05:04:45.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.2 2024-01-31T05:04:45.683 DEBUG:teuthology.parallel:result is None 2024-01-31T05:04:45.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.6 2024-01-31T05:04:45.687 DEBUG:teuthology.parallel:result is None 2024-01-31T05:04:45.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.7 2024-01-31T05:04:45.690 DEBUG:teuthology.parallel:result is None 2024-01-31T05:04:45.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.5 2024-01-31T05:04:45.701 DEBUG:teuthology.parallel:result is None 2024-01-31T05:04:45.701 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-31T05:04:45.701 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-31T05:04:45.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f889d000640 1 Processor -- start 2024-01-31T05:04:45.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f889d000640 1 -- start start 2024-01-31T05:04:45.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f889d000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f889806ba90 0x7f88980cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f889d000640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889815d7e0 con 0x7f889806c290 2024-01-31T05:04:45.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f889d000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88980d0470 con 0x7f88980cbf80 2024-01-31T05:04:45.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f889d000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88980d0190 con 0x7f889806ba90 2024-01-31T05:04:45.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8895e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f889806c290 0x7f889806c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57876/0 (socket says 172.21.15.49:57876) 2024-01-31T05:04:45.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8895e00640 1 -- 172.21.15.49:0/1929779672 learned_addr learned my addr 172.21.15.49:0/1929779672 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8895400640 1 --2- 172.21.15.49:0/1929779672 >> v2:172.21.15.195:3300/0 conn(0x7f889806ba90 0x7f88980cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8894a00640 1 -- 172.21.15.49:0/1929779672 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354174643 0 0) 0x7f889815d7e0 con 0x7f889806c290 2024-01-31T05:04:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8894a00640 1 -- 172.21.15.49:0/1929779672 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8878003530 con 0x7f889806c290 2024-01-31T05:04:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8894a00640 1 -- 172.21.15.49:0/1929779672 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574212235 0 0) 0x7f88980d0470 con 0x7f88980cbf80 2024-01-31T05:04:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8894a00640 1 -- 172.21.15.49:0/1929779672 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f889815d7e0 con 0x7f88980cbf80 2024-01-31T05:04:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8894a00640 1 -- 172.21.15.49:0/1929779672 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2304678156 0 0) 0x7f8878003530 con 0x7f889806c290 2024-01-31T05:04:45.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8894a00640 1 -- 172.21.15.49:0/1929779672 >> v2:172.21.15.195:3300/0 conn(0x7f889806ba90 msgr2=0x7f88980cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:45.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8894a00640 1 --2- 172.21.15.49:0/1929779672 >> v2:172.21.15.195:3300/0 conn(0x7f889806ba90 0x7f88980cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8894a00640 1 -- 172.21.15.49:0/1929779672 >> v1:172.21.15.195:6789/0 conn(0x7f88980cbf80 legacy=0x7f88980cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8894a00640 1 -- 172.21.15.49:0/1929779672 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88980cb4a0 con 0x7f889806c290 2024-01-31T05:04:45.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8894a00640 1 -- 172.21.15.49:0/1929779672 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7f8888001680 con 0x7f889806c290 2024-01-31T05:04:45.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8895400640 1 --2- 172.21.15.49:0/1929779672 >> v2:172.21.15.195:3300/0 conn(0x7f889806ba90 0x7f88980cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:04:45.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8894a00640 1 -- 172.21.15.49:0/1929779672 >> v1:172.21.15.49:6789/0 conn(0x7f889806c290 legacy=0x7f889806c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8894a00640 1 --2- 172.21.15.49:0/1929779672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8878003b10 0x7f8878003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8894a00640 1 --2- 172.21.15.49:0/1929779672 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88780047d0 0x7f8878004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8894a00640 1 --2- 172.21.15.49:0/1929779672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8878005190 0x7f887800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8894a00640 1 -- 172.21.15.49:0/1929779672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88980d0190 con 0x7f8878005190 2024-01-31T05:04:45.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8894a00640 1 -- 172.21.15.49:0/1929779672 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887800c0c0 con 0x7f8878003b10 2024-01-31T05:04:45.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8894a00640 1 -- 172.21.15.49:0/1929779672 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887800c280 con 0x7f88780047d0 2024-01-31T05:04:45.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8895e00640 1 --2- 172.21.15.49:0/1929779672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8878003b10 0x7f8878003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8896800640 1 --2- 172.21.15.49:0/1929779672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8878005190 0x7f887800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8895400640 1 --2- 172.21.15.49:0/1929779672 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88780047d0 0x7f8878004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8896800640 1 -- 172.21.15.49:0/1929779672 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88780047d0 msgr2=0x7f8878004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:45.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8896800640 1 --2- 172.21.15.49:0/1929779672 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88780047d0 0x7f8878004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8896800640 1 -- 172.21.15.49:0/1929779672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8878003b10 msgr2=0x7f8878003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:45.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8896800640 1 --2- 172.21.15.49:0/1929779672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8878003b10 0x7f8878003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8896800640 1 -- 172.21.15.49:0/1929779672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8878003530 con 0x7f8878005190 2024-01-31T05:04:45.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.887+0000 7f8895e00640 1 --2- 172.21.15.49:0/1929779672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8878003b10 0x7f8878003f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:04:45.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.891+0000 7f8896800640 1 -- 172.21.15.49:0/1929779672 reap_dead start 2024-01-31T05:04:45.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.891+0000 7f8896800640 1 --2- 172.21.15.49:0/1929779672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8878005190 0x7f887800b990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8890001fd0 tx=0x7f889001f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80a1158d9cd5f4a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.891+0000 7f8894a00640 1 -- 172.21.15.49:0/1929779672 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88900a8c70 con 0x7f8878005190 2024-01-31T05:04:45.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.891+0000 7f8894a00640 1 -- 172.21.15.49:0/1929779672 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88900a8dd0 con 0x7f8878005190 2024-01-31T05:04:45.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.891+0000 7f8894a00640 1 -- 172.21.15.49:0/1929779672 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890003bc0 con 0x7f8878005190 2024-01-31T05:04:45.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.891+0000 7f889d000640 1 -- 172.21.15.49:0/1929779672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8878005190 msgr2=0x7f887800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.891+0000 7f889d000640 1 --2- 172.21.15.49:0/1929779672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8878005190 0x7f887800b990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8890001fd0 tx=0x7f889001f050 comp rx=0 tx=0).stop 2024-01-31T05:04:45.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.891+0000 7f889d000640 1 -- 172.21.15.49:0/1929779672 shutdown_connections 2024-01-31T05:04:45.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.891+0000 7f889d000640 1 --2- 172.21.15.49:0/1929779672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8878005190 0x7f887800b990 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.891+0000 7f889d000640 1 -- 172.21.15.49:0/1929779672 >> 172.21.15.49:0/1929779672 conn(0x7f88980b28e0 msgr2=0x7f88980b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:45.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.891+0000 7f889d000640 1 -- 172.21.15.49:0/1929779672 shutdown_connections 2024-01-31T05:04:45.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.891+0000 7f889d000640 1 -- 172.21.15.49:0/1929779672 wait complete. 2024-01-31T05:04:45.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.895+0000 7f889d000640 1 Processor -- start 2024-01-31T05:04:45.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.895+0000 7f889d000640 1 -- start start 2024-01-31T05:04:45.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.895+0000 7f889d000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8878005190 0x7f88980c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.895+0000 7f889d000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88980c9060 0x7f88980cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.895+0000 7f889d000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88980ca590 0x7f889814ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.895+0000 7f889d000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88980ca170 con 0x7f88980c9060 2024-01-31T05:04:45.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.895+0000 7f889d000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88980c94f0 con 0x7f88980ca590 2024-01-31T05:04:45.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.895+0000 7f889d000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88980c97d0 con 0x7f8878005190 2024-01-31T05:04:45.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.895+0000 7f8895400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88980c9060 0x7f88980cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.895+0000 7f8895400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88980c9060 0x7f88980cd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38768/0 (socket says 172.21.15.49:38768) 2024-01-31T05:04:45.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.895+0000 7f8895400640 1 -- 172.21.15.49:0/2777455727 learned_addr learned my addr 172.21.15.49:0/2777455727 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:45.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.895+0000 7f8896800640 1 --2- 172.21.15.49:0/2777455727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88980ca590 0x7f889814ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.895+0000 7f8895e00640 1 --2- 172.21.15.49:0/2777455727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8878005190 0x7f88980c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.895+0000 7f8895400640 1 -- 172.21.15.49:0/2777455727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8878005190 msgr2=0x7f88980c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.895+0000 7f8895400640 1 --2- 172.21.15.49:0/2777455727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8878005190 0x7f88980c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.895+0000 7f8895400640 1 -- 172.21.15.49:0/2777455727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88980ca590 msgr2=0x7f889814ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:45.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.895+0000 7f8895400640 1 --2- 172.21.15.49:0/2777455727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88980ca590 0x7f889814ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:45.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.895+0000 7f8895400640 1 -- 172.21.15.49:0/2777455727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88980c9ab0 con 0x7f88980c9060 2024-01-31T05:04:45.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.895+0000 7f8895400640 1 --2- 172.21.15.49:0/2777455727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88980c9060 0x7f88980cd640 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8880011a00 tx=0x7f8880011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.899+0000 7f888e000640 1 -- 172.21.15.49:0/2777455727 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888000fc10 con 0x7f88980c9060 2024-01-31T05:04:45.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.899+0000 7f888e000640 1 -- 172.21.15.49:0/2777455727 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888000fd70 con 0x7f88980c9060 2024-01-31T05:04:45.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.899+0000 7f888e000640 1 -- 172.21.15.49:0/2777455727 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888000fee0 con 0x7f88980c9060 2024-01-31T05:04:45.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.899+0000 7f889d000640 1 -- 172.21.15.49:0/2777455727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88980c9d90 con 0x7f88980c9060 2024-01-31T05:04:45.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.899+0000 7f889d000640 1 -- 172.21.15.49:0/2777455727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88980c4f20 con 0x7f88980c9060 2024-01-31T05:04:45.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.899+0000 7f889d000640 1 -- 172.21.15.49:0/2777455727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8898067c80 con 0x7f88980c9060 2024-01-31T05:04:45.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.899+0000 7f888e000640 1 -- 172.21.15.49:0/2777455727 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f8880004260 con 0x7f88980c9060 2024-01-31T05:04:45.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.899+0000 7f888e000640 1 --2- 172.21.15.49:0/2777455727 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8870066500 0x7f88700689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:45.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.899+0000 7f888e000640 1 -- 172.21.15.49:0/2777455727 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8880084760 con 0x7f88980c9060 2024-01-31T05:04:45.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.899+0000 7f8895e00640 1 --2- 172.21.15.49:0/2777455727 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8870066500 0x7f88700689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:45.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.903+0000 7f8895e00640 1 --2- 172.21.15.49:0/2777455727 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8870066500 0x7f88700689c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8888001210 tx=0x7f8888001e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:45.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:45.903+0000 7f888e000640 1 -- 172.21.15.49:0/2777455727 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f88800517b0 con 0x7f88980c9060 2024-01-31T05:04:46.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.059+0000 7f889d000640 1 -- 172.21.15.49:0/2777455727 --> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8898067a70 con 0x7f8870066500 2024-01-31T05:04:46.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.067+0000 7f888e000640 1 -- 172.21.15.49:0/2777455727 <== mgr.4100 v2:172.21.15.195:6832/3035808172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345283 (secure 0 0 0) 0x7f8898067a70 con 0x7f8870066500 2024-01-31T05:04:46.074 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:46.076 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-31T05:04:46.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.071+0000 7f889d000640 1 -- 172.21.15.49:0/2777455727 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8870066500 msgr2=0x7f88700689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:46.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.071+0000 7f889d000640 1 --2- 172.21.15.49:0/2777455727 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8870066500 0x7f88700689c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8888001210 tx=0x7f8888001e30 comp rx=0 tx=0).stop 2024-01-31T05:04:46.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.071+0000 7f889d000640 1 -- 172.21.15.49:0/2777455727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88980c9060 msgr2=0x7f88980cd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:46.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.071+0000 7f889d000640 1 --2- 172.21.15.49:0/2777455727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88980c9060 0x7f88980cd640 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8880011a00 tx=0x7f8880011ec0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.071+0000 7f889d000640 1 -- 172.21.15.49:0/2777455727 shutdown_connections 2024-01-31T05:04:46.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.071+0000 7f889d000640 1 --2- 172.21.15.49:0/2777455727 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8870066500 0x7f88700689c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.071+0000 7f889d000640 1 --2- 172.21.15.49:0/2777455727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88980ca590 0x7f889814ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.071+0000 7f889d000640 1 --2- 172.21.15.49:0/2777455727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88980c9060 0x7f88980cd640 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.071+0000 7f889d000640 1 --2- 172.21.15.49:0/2777455727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8878005190 0x7f88980c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.071+0000 7f889d000640 1 -- 172.21.15.49:0/2777455727 >> 172.21.15.49:0/2777455727 conn(0x7f88980b28e0 msgr2=0x7f889806c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:46.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.075+0000 7f889d000640 1 -- 172.21.15.49:0/2777455727 shutdown_connections 2024-01-31T05:04:46.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.075+0000 7f889d000640 1 -- 172.21.15.49:0/2777455727 wait complete. 2024-01-31T05:04:46.095 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-01-31T05:04:44.426440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252676,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722044,"statfs":{"total":773094113280,"available":772835373056,"internally_reserved":0,"allocated":3284992,"data_stored":1988350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003354"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581219+0000","last_change":"2024-01-31T05:04:15.868245+0000","last_active":"2024-01-31T05:04:21.581219+0000","last_peered":"2024-01-31T05:04:21.581219+0000","last_clean":"2024-01-31T05:04:21.581219+0000","last_became_active":"2024-01-31T05:04:15.864318+0000","last_became_peered":"2024-01-31T05:04:15.864318+0000","last_unstale":"2024-01-31T05:04:21.581219+0000","last_undegraded":"2024-01-31T05:04:21.581219+0000","last_fullsized":"2024-01-31T05:04:21.581219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:27:44.760988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267122+0000","last_change":"2024-01-31T05:04:16.288950+0000","last_active":"2024-01-31T05:04:21.267122+0000","last_peered":"2024-01-31T05:04:21.267122+0000","last_clean":"2024-01-31T05:04:21.267122+0000","last_became_active":"2024-01-31T05:04:16.288679+0000","last_became_peered":"2024-01-31T05:04:16.288679+0000","last_unstale":"2024-01-31T05:04:21.267122+0000","last_undegraded":"2024-01-31T05:04:21.267122+0000","last_fullsized":"2024-01-31T05:04:21.267122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:10:07.431961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266325+0000","last_change":"2024-01-31T05:04:20.413702+0000","last_active":"2024-01-31T05:04:21.266325+0000","last_peered":"2024-01-31T05:04:21.266325+0000","last_clean":"2024-01-31T05:04:21.266325+0000","last_became_active":"2024-01-31T05:04:20.413348+0000","last_became_peered":"2024-01-31T05:04:20.413348+0000","last_unstale":"2024-01-31T05:04:21.266325+0000","last_undegraded":"2024-01-31T05:04:21.266325+0000","last_fullsized":"2024-01-31T05:04:21.266325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:58:24.669260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267427+0000","last_change":"2024-01-31T05:04:15.865431+0000","last_active":"2024-01-31T05:04:21.267427+0000","last_peered":"2024-01-31T05:04:21.267427+0000","last_clean":"2024-01-31T05:04:21.267427+0000","last_became_active":"2024-01-31T05:04:15.863143+0000","last_became_peered":"2024-01-31T05:04:15.863143+0000","last_unstale":"2024-01-31T05:04:21.267427+0000","last_undegraded":"2024-01-31T05:04:21.267427+0000","last_fullsized":"2024-01-31T05:04:21.267427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:27:44.760988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580949+0000","last_change":"2024-01-31T05:04:16.295890+0000","last_active":"2024-01-31T05:04:21.580949+0000","last_peered":"2024-01-31T05:04:21.580949+0000","last_clean":"2024-01-31T05:04:21.580949+0000","last_became_active":"2024-01-31T05:04:16.295666+0000","last_became_peered":"2024-01-31T05:04:16.295666+0000","last_unstale":"2024-01-31T05:04:21.580949+0000","last_undegraded":"2024-01-31T05:04:21.580949+0000","last_fullsized":"2024-01-31T05:04:21.580949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266605+0000","last_change":"2024-01-31T05:04:20.314420+0000","last_active":"2024-01-31T05:04:21.266605+0000","last_peered":"2024-01-31T05:04:21.266605+0000","last_clean":"2024-01-31T05:04:21.266605+0000","last_became_active":"2024-01-31T05:04:20.314026+0000","last_became_peered":"2024-01-31T05:04:20.314026+0000","last_unstale":"2024-01-31T05:04:21.266605+0000","last_undegraded":"2024-01-31T05:04:21.266605+0000","last_fullsized":"2024-01-31T05:04:21.266605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:25.928105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.582056+0000","last_change":"2024-01-31T05:04:15.872667+0000","last_active":"2024-01-31T05:04:21.582056+0000","last_peered":"2024-01-31T05:04:21.582056+0000","last_clean":"2024-01-31T05:04:21.582056+0000","last_became_active":"2024-01-31T05:04:15.872184+0000","last_became_peered":"2024-01-31T05:04:15.872184+0000","last_unstale":"2024-01-31T05:04:21.582056+0000","last_undegraded":"2024-01-31T05:04:21.582056+0000","last_fullsized":"2024-01-31T05:04:21.582056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:15.850243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579858+0000","last_change":"2024-01-31T05:04:16.291560+0000","last_active":"2024-01-31T05:04:21.579858+0000","last_peered":"2024-01-31T05:04:21.579858+0000","last_clean":"2024-01-31T05:04:21.579858+0000","last_became_active":"2024-01-31T05:04:16.291315+0000","last_became_peered":"2024-01-31T05:04:16.291315+0000","last_unstale":"2024-01-31T05:04:21.579858+0000","last_undegraded":"2024-01-31T05:04:21.579858+0000","last_fullsized":"2024-01-31T05:04:21.579858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:29:14.662909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266987+0000","last_change":"2024-01-31T05:04:20.302441+0000","last_active":"2024-01-31T05:04:21.266987+0000","last_peered":"2024-01-31T05:04:21.266987+0000","last_clean":"2024-01-31T05:04:21.266987+0000","last_became_active":"2024-01-31T05:04:20.302037+0000","last_became_peered":"2024-01-31T05:04:20.302037+0000","last_unstale":"2024-01-31T05:04:21.266987+0000","last_undegraded":"2024-01-31T05:04:21.266987+0000","last_fullsized":"2024-01-31T05:04:21.266987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:10:10.869523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581271+0000","last_change":"2024-01-31T05:04:15.866007+0000","last_active":"2024-01-31T05:04:21.581271+0000","last_peered":"2024-01-31T05:04:21.581271+0000","last_clean":"2024-01-31T05:04:21.581271+0000","last_became_active":"2024-01-31T05:04:15.865702+0000","last_became_peered":"2024-01-31T05:04:15.865702+0000","last_unstale":"2024-01-31T05:04:21.581271+0000","last_undegraded":"2024-01-31T05:04:21.581271+0000","last_fullsized":"2024-01-31T05:04:21.581271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:24:55.108827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580173+0000","last_change":"2024-01-31T05:04:16.295973+0000","last_active":"2024-01-31T05:04:21.580173+0000","last_peered":"2024-01-31T05:04:21.580173+0000","last_clean":"2024-01-31T05:04:21.580173+0000","last_became_active":"2024-01-31T05:04:16.294920+0000","last_became_peered":"2024-01-31T05:04:16.294920+0000","last_unstale":"2024-01-31T05:04:21.580173+0000","last_undegraded":"2024-01-31T05:04:21.580173+0000","last_fullsized":"2024-01-31T05:04:21.580173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:47.781626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266874+0000","last_change":"2024-01-31T05:04:20.306343+0000","last_active":"2024-01-31T05:04:21.266874+0000","last_peered":"2024-01-31T05:04:21.266874+0000","last_clean":"2024-01-31T05:04:21.266874+0000","last_became_active":"2024-01-31T05:04:20.305678+0000","last_became_peered":"2024-01-31T05:04:20.305678+0000","last_unstale":"2024-01-31T05:04:21.266874+0000","last_undegraded":"2024-01-31T05:04:21.266874+0000","last_fullsized":"2024-01-31T05:04:21.266874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:23.877718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580317+0000","last_change":"2024-01-31T05:04:16.292709+0000","last_active":"2024-01-31T05:04:21.580317+0000","last_peered":"2024-01-31T05:04:21.580317+0000","last_clean":"2024-01-31T05:04:21.580317+0000","last_became_active":"2024-01-31T05:04:16.292447+0000","last_became_peered":"2024-01-31T05:04:16.292447+0000","last_unstale":"2024-01-31T05:04:21.580317+0000","last_undegraded":"2024-01-31T05:04:21.580317+0000","last_fullsized":"2024-01-31T05:04:21.580317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:36.794548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581839+0000","last_change":"2024-01-31T05:04:15.864066+0000","last_active":"2024-01-31T05:04:21.581839+0000","last_peered":"2024-01-31T05:04:21.581839+0000","last_clean":"2024-01-31T05:04:21.581839+0000","last_became_active":"2024-01-31T05:04:15.863757+0000","last_became_peered":"2024-01-31T05:04:15.863757+0000","last_unstale":"2024-01-31T05:04:21.581839+0000","last_undegraded":"2024-01-31T05:04:21.581839+0000","last_fullsized":"2024-01-31T05:04:21.581839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:16:26.364453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267538+0000","last_change":"2024-01-31T05:04:20.306016+0000","last_active":"2024-01-31T05:04:21.267538+0000","last_peered":"2024-01-31T05:04:21.267538+0000","last_clean":"2024-01-31T05:04:21.267538+0000","last_became_active":"2024-01-31T05:04:20.305523+0000","last_became_peered":"2024-01-31T05:04:20.305523+0000","last_unstale":"2024-01-31T05:04:21.267538+0000","last_undegraded":"2024-01-31T05:04:21.267538+0000","last_fullsized":"2024-01-31T05:04:21.267538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:44.473185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266570+0000","last_change":"2024-01-31T05:04:16.284277+0000","last_active":"2024-01-31T05:04:21.266570+0000","last_peered":"2024-01-31T05:04:21.266570+0000","last_clean":"2024-01-31T05:04:21.266570+0000","last_became_active":"2024-01-31T05:04:16.283861+0000","last_became_peered":"2024-01-31T05:04:16.283861+0000","last_unstale":"2024-01-31T05:04:21.266570+0000","last_undegraded":"2024-01-31T05:04:21.266570+0000","last_fullsized":"2024-01-31T05:04:21.266570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:59:17.499417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580029+0000","last_change":"2024-01-31T05:04:15.866369+0000","last_active":"2024-01-31T05:04:21.580029+0000","last_peered":"2024-01-31T05:04:21.580029+0000","last_clean":"2024-01-31T05:04:21.580029+0000","last_became_active":"2024-01-31T05:04:15.865958+0000","last_became_peered":"2024-01-31T05:04:15.865958+0000","last_unstale":"2024-01-31T05:04:21.580029+0000","last_undegraded":"2024-01-31T05:04:21.580029+0000","last_fullsized":"2024-01-31T05:04:21.580029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:24:55.108827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267344+0000","last_change":"2024-01-31T05:04:20.306127+0000","last_active":"2024-01-31T05:04:21.267344+0000","last_peered":"2024-01-31T05:04:21.267344+0000","last_clean":"2024-01-31T05:04:21.267344+0000","last_became_active":"2024-01-31T05:04:20.305397+0000","last_became_peered":"2024-01-31T05:04:20.305397+0000","last_unstale":"2024-01-31T05:04:21.267344+0000","last_undegraded":"2024-01-31T05:04:21.267344+0000","last_fullsized":"2024-01-31T05:04:21.267344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:20:14.179731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266407+0000","last_change":"2024-01-31T05:04:16.278338+0000","last_active":"2024-01-31T05:04:21.266407+0000","last_peered":"2024-01-31T05:04:21.266407+0000","last_clean":"2024-01-31T05:04:21.266407+0000","last_became_active":"2024-01-31T05:04:16.277709+0000","last_became_peered":"2024-01-31T05:04:16.277709+0000","last_unstale":"2024-01-31T05:04:21.266407+0000","last_undegraded":"2024-01-31T05:04:21.266407+0000","last_fullsized":"2024-01-31T05:04:21.266407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:38.399003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579843+0000","last_change":"2024-01-31T05:04:15.866645+0000","last_active":"2024-01-31T05:04:21.579843+0000","last_peered":"2024-01-31T05:04:21.579843+0000","last_clean":"2024-01-31T05:04:21.579843+0000","last_became_active":"2024-01-31T05:04:15.866293+0000","last_became_peered":"2024-01-31T05:04:15.866293+0000","last_unstale":"2024-01-31T05:04:21.579843+0000","last_undegraded":"2024-01-31T05:04:21.579843+0000","last_fullsized":"2024-01-31T05:04:21.579843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:16:26.364453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581344+0000","last_change":"2024-01-31T05:04:20.411913+0000","last_active":"2024-01-31T05:04:21.581344+0000","last_peered":"2024-01-31T05:04:21.581344+0000","last_clean":"2024-01-31T05:04:21.581344+0000","last_became_active":"2024-01-31T05:04:20.411469+0000","last_became_peered":"2024-01-31T05:04:20.411469+0000","last_unstale":"2024-01-31T05:04:21.581344+0000","last_undegraded":"2024-01-31T05:04:21.581344+0000","last_fullsized":"2024-01-31T05:04:21.581344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:45.735003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267040+0000","last_change":"2024-01-31T05:04:16.274299+0000","last_active":"2024-01-31T05:04:21.267040+0000","last_peered":"2024-01-31T05:04:21.267040+0000","last_clean":"2024-01-31T05:04:21.267040+0000","last_became_active":"2024-01-31T05:04:16.273410+0000","last_became_peered":"2024-01-31T05:04:16.273410+0000","last_unstale":"2024-01-31T05:04:21.267040+0000","last_undegraded":"2024-01-31T05:04:21.267040+0000","last_fullsized":"2024-01-31T05:04:21.267040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:34.994793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581098+0000","last_change":"2024-01-31T05:04:15.862190+0000","last_active":"2024-01-31T05:04:21.581098+0000","last_peered":"2024-01-31T05:04:21.581098+0000","last_clean":"2024-01-31T05:04:21.581098+0000","last_became_active":"2024-01-31T05:04:15.861894+0000","last_became_peered":"2024-01-31T05:04:15.861894+0000","last_unstale":"2024-01-31T05:04:21.581098+0000","last_undegraded":"2024-01-31T05:04:21.581098+0000","last_fullsized":"2024-01-31T05:04:21.581098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:33.988440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267462+0000","last_change":"2024-01-31T05:04:20.302070+0000","last_active":"2024-01-31T05:04:21.267462+0000","last_peered":"2024-01-31T05:04:21.267462+0000","last_clean":"2024-01-31T05:04:21.267462+0000","last_became_active":"2024-01-31T05:04:20.301514+0000","last_became_peered":"2024-01-31T05:04:20.301514+0000","last_unstale":"2024-01-31T05:04:21.267462+0000","last_undegraded":"2024-01-31T05:04:21.267462+0000","last_fullsized":"2024-01-31T05:04:21.267462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:51.219189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581061+0000","last_change":"2024-01-31T05:04:16.277874+0000","last_active":"2024-01-31T05:04:21.581061+0000","last_peered":"2024-01-31T05:04:21.581061+0000","last_clean":"2024-01-31T05:04:21.581061+0000","last_became_active":"2024-01-31T05:04:16.277627+0000","last_became_peered":"2024-01-31T05:04:16.277627+0000","last_unstale":"2024-01-31T05:04:21.581061+0000","last_undegraded":"2024-01-31T05:04:21.581061+0000","last_fullsized":"2024-01-31T05:04:21.581061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:38.399003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581821+0000","last_change":"2024-01-31T05:04:15.867994+0000","last_active":"2024-01-31T05:04:21.581821+0000","last_peered":"2024-01-31T05:04:21.581821+0000","last_clean":"2024-01-31T05:04:21.581821+0000","last_became_active":"2024-01-31T05:04:15.866731+0000","last_became_peered":"2024-01-31T05:04:15.866731+0000","last_unstale":"2024-01-31T05:04:21.581821+0000","last_undegraded":"2024-01-31T05:04:21.581821+0000","last_fullsized":"2024-01-31T05:04:21.581821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:12:26.990588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266940+0000","last_change":"2024-01-31T05:04:20.410734+0000","last_active":"2024-01-31T05:04:21.266940+0000","last_peered":"2024-01-31T05:04:21.266940+0000","last_clean":"2024-01-31T05:04:21.266940+0000","last_became_active":"2024-01-31T05:04:20.410368+0000","last_became_peered":"2024-01-31T05:04:20.410368+0000","last_unstale":"2024-01-31T05:04:21.266940+0000","last_undegraded":"2024-01-31T05:04:21.266940+0000","last_fullsized":"2024-01-31T05:04:21.266940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:29:18.100472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.268005+0000","last_change":"2024-01-31T05:04:16.283103+0000","last_active":"2024-01-31T05:04:21.268005+0000","last_peered":"2024-01-31T05:04:21.268005+0000","last_clean":"2024-01-31T05:04:21.268005+0000","last_became_active":"2024-01-31T05:04:16.282869+0000","last_became_peered":"2024-01-31T05:04:16.282869+0000","last_unstale":"2024-01-31T05:04:21.268005+0000","last_undegraded":"2024-01-31T05:04:21.268005+0000","last_fullsized":"2024-01-31T05:04:21.268005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:20.440155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581016+0000","last_change":"2024-01-31T05:04:15.872874+0000","last_active":"2024-01-31T05:04:21.581016+0000","last_peered":"2024-01-31T05:04:21.581016+0000","last_clean":"2024-01-31T05:04:21.581016+0000","last_became_active":"2024-01-31T05:04:15.872478+0000","last_became_peered":"2024-01-31T05:04:15.872478+0000","last_unstale":"2024-01-31T05:04:21.581016+0000","last_undegraded":"2024-01-31T05:04:21.581016+0000","last_fullsized":"2024-01-31T05:04:21.581016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:12:26.990588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266215+0000","last_change":"2024-01-31T05:04:20.409515+0000","last_active":"2024-01-31T05:04:21.266215+0000","last_peered":"2024-01-31T05:04:21.266215+0000","last_clean":"2024-01-31T05:04:21.266215+0000","last_became_active":"2024-01-31T05:04:20.409104+0000","last_became_peered":"2024-01-31T05:04:20.409104+0000","last_unstale":"2024-01-31T05:04:21.266215+0000","last_undegraded":"2024-01-31T05:04:21.266215+0000","last_fullsized":"2024-01-31T05:04:21.266215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:26:03.624550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580349+0000","last_change":"2024-01-31T05:04:16.276727+0000","last_active":"2024-01-31T05:04:21.580349+0000","last_peered":"2024-01-31T05:04:21.580349+0000","last_clean":"2024-01-31T05:04:21.580349+0000","last_became_active":"2024-01-31T05:04:16.276429+0000","last_became_peered":"2024-01-31T05:04:16.276429+0000","last_unstale":"2024-01-31T05:04:21.580349+0000","last_undegraded":"2024-01-31T05:04:21.580349+0000","last_fullsized":"2024-01-31T05:04:21.580349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.582205+0000","last_change":"2024-01-31T05:04:15.872449+0000","last_active":"2024-01-31T05:04:21.582205+0000","last_peered":"2024-01-31T05:04:21.582205+0000","last_clean":"2024-01-31T05:04:21.582205+0000","last_became_active":"2024-01-31T05:04:15.871832+0000","last_became_peered":"2024-01-31T05:04:15.871832+0000","last_unstale":"2024-01-31T05:04:21.582205+0000","last_undegraded":"2024-01-31T05:04:21.582205+0000","last_fullsized":"2024-01-31T05:04:21.582205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:18:30.350723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579984+0000","last_change":"2024-01-31T05:04:20.410664+0000","last_active":"2024-01-31T05:04:21.579984+0000","last_peered":"2024-01-31T05:04:21.579984+0000","last_clean":"2024-01-31T05:04:21.579984+0000","last_became_active":"2024-01-31T05:04:20.409595+0000","last_became_peered":"2024-01-31T05:04:20.409595+0000","last_unstale":"2024-01-31T05:04:21.579984+0000","last_undegraded":"2024-01-31T05:04:21.579984+0000","last_fullsized":"2024-01-31T05:04:21.579984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:51.219189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580268+0000","last_change":"2024-01-31T05:04:16.299267+0000","last_active":"2024-01-31T05:04:21.580268+0000","last_peered":"2024-01-31T05:04:21.580268+0000","last_clean":"2024-01-31T05:04:21.580268+0000","last_became_active":"2024-01-31T05:04:16.298919+0000","last_became_peered":"2024-01-31T05:04:16.298919+0000","last_unstale":"2024-01-31T05:04:21.580268+0000","last_undegraded":"2024-01-31T05:04:21.580268+0000","last_fullsized":"2024-01-31T05:04:21.580268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:41.035623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580402+0000","last_change":"2024-01-31T05:04:15.863096+0000","last_active":"2024-01-31T05:04:21.580402+0000","last_peered":"2024-01-31T05:04:21.580402+0000","last_clean":"2024-01-31T05:04:21.580402+0000","last_became_active":"2024-01-31T05:04:15.862799+0000","last_became_peered":"2024-01-31T05:04:15.862799+0000","last_unstale":"2024-01-31T05:04:21.580402+0000","last_undegraded":"2024-01-31T05:04:21.580402+0000","last_fullsized":"2024-01-31T05:04:21.580402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:33.988440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579915+0000","last_change":"2024-01-31T05:04:20.318591+0000","last_active":"2024-01-31T05:04:21.579915+0000","last_peered":"2024-01-31T05:04:21.579915+0000","last_clean":"2024-01-31T05:04:21.579915+0000","last_became_active":"2024-01-31T05:04:20.314906+0000","last_became_peered":"2024-01-31T05:04:20.314906+0000","last_unstale":"2024-01-31T05:04:21.579915+0000","last_undegraded":"2024-01-31T05:04:21.579915+0000","last_fullsized":"2024-01-31T05:04:21.579915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:51.219189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267338+0000","last_change":"2024-01-31T05:04:16.284119+0000","last_active":"2024-01-31T05:04:21.267338+0000","last_peered":"2024-01-31T05:04:21.267338+0000","last_clean":"2024-01-31T05:04:21.267338+0000","last_became_active":"2024-01-31T05:04:16.277112+0000","last_became_peered":"2024-01-31T05:04:16.277112+0000","last_unstale":"2024-01-31T05:04:21.267338+0000","last_undegraded":"2024-01-31T05:04:21.267338+0000","last_fullsized":"2024-01-31T05:04:21.267338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:12.324478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579785+0000","last_change":"2024-01-31T05:04:15.862604+0000","last_active":"2024-01-31T05:04:21.579785+0000","last_peered":"2024-01-31T05:04:21.579785+0000","last_clean":"2024-01-31T05:04:21.579785+0000","last_became_active":"2024-01-31T05:04:15.862119+0000","last_became_peered":"2024-01-31T05:04:15.862119+0000","last_unstale":"2024-01-31T05:04:21.579785+0000","last_undegraded":"2024-01-31T05:04:21.579785+0000","last_fullsized":"2024-01-31T05:04:21.579785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:15.850243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580443+0000","last_change":"2024-01-31T05:04:20.319285+0000","last_active":"2024-01-31T05:04:21.580443+0000","last_peered":"2024-01-31T05:04:21.580443+0000","last_clean":"2024-01-31T05:04:21.580443+0000","last_became_active":"2024-01-31T05:04:20.318678+0000","last_became_peered":"2024-01-31T05:04:20.318678+0000","last_unstale":"2024-01-31T05:04:21.580443+0000","last_undegraded":"2024-01-31T05:04:21.580443+0000","last_fullsized":"2024-01-31T05:04:21.580443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:52:04.324494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579922+0000","last_change":"2024-01-31T05:04:16.277245+0000","last_active":"2024-01-31T05:04:21.579922+0000","last_peered":"2024-01-31T05:04:21.579922+0000","last_clean":"2024-01-31T05:04:21.579922+0000","last_became_active":"2024-01-31T05:04:16.276969+0000","last_became_peered":"2024-01-31T05:04:16.276969+0000","last_unstale":"2024-01-31T05:04:21.579922+0000","last_undegraded":"2024-01-31T05:04:21.579922+0000","last_fullsized":"2024-01-31T05:04:21.579922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:05:32.076479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267230+0000","last_change":"2024-01-31T05:04:15.868758+0000","last_active":"2024-01-31T05:04:21.267230+0000","last_peered":"2024-01-31T05:04:21.267230+0000","last_clean":"2024-01-31T05:04:21.267230+0000","last_became_active":"2024-01-31T05:04:15.868431+0000","last_became_peered":"2024-01-31T05:04:15.868431+0000","last_unstale":"2024-01-31T05:04:21.267230+0000","last_undegraded":"2024-01-31T05:04:21.267230+0000","last_fullsized":"2024-01-31T05:04:21.267230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:38:14.126192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581401+0000","last_change":"2024-01-31T05:04:20.314828+0000","last_active":"2024-01-31T05:04:21.581401+0000","last_peered":"2024-01-31T05:04:21.581401+0000","last_clean":"2024-01-31T05:04:21.581401+0000","last_became_active":"2024-01-31T05:04:20.314407+0000","last_became_peered":"2024-01-31T05:04:20.314407+0000","last_unstale":"2024-01-31T05:04:21.581401+0000","last_undegraded":"2024-01-31T05:04:21.581401+0000","last_fullsized":"2024-01-31T05:04:21.581401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:42:14.408077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579808+0000","last_change":"2024-01-31T05:04:16.274865+0000","last_active":"2024-01-31T05:04:21.579808+0000","last_peered":"2024-01-31T05:04:21.579808+0000","last_clean":"2024-01-31T05:04:21.579808+0000","last_became_active":"2024-01-31T05:04:16.273448+0000","last_became_peered":"2024-01-31T05:04:16.273448+0000","last_unstale":"2024-01-31T05:04:21.579808+0000","last_undegraded":"2024-01-31T05:04:21.579808+0000","last_fullsized":"2024-01-31T05:04:21.579808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:28:15.218916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581205+0000","last_change":"2024-01-31T05:04:15.865828+0000","last_active":"2024-01-31T05:04:21.581205+0000","last_peered":"2024-01-31T05:04:21.581205+0000","last_clean":"2024-01-31T05:04:21.581205+0000","last_became_active":"2024-01-31T05:04:15.865556+0000","last_became_peered":"2024-01-31T05:04:15.865556+0000","last_unstale":"2024-01-31T05:04:21.581205+0000","last_undegraded":"2024-01-31T05:04:21.581205+0000","last_fullsized":"2024-01-31T05:04:21.581205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:11.318125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580994+0000","last_change":"2024-01-31T05:04:20.410795+0000","last_active":"2024-01-31T05:04:21.580994+0000","last_peered":"2024-01-31T05:04:21.580994+0000","last_clean":"2024-01-31T05:04:21.580994+0000","last_became_active":"2024-01-31T05:04:20.409164+0000","last_became_peered":"2024-01-31T05:04:20.409164+0000","last_unstale":"2024-01-31T05:04:21.580994+0000","last_undegraded":"2024-01-31T05:04:21.580994+0000","last_fullsized":"2024-01-31T05:04:21.580994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:42:14.408077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266618+0000","last_change":"2024-01-31T05:04:16.302810+0000","last_active":"2024-01-31T05:04:21.266618+0000","last_peered":"2024-01-31T05:04:21.266618+0000","last_clean":"2024-01-31T05:04:21.266618+0000","last_became_active":"2024-01-31T05:04:16.302580+0000","last_became_peered":"2024-01-31T05:04:16.302580+0000","last_unstale":"2024-01-31T05:04:21.266618+0000","last_undegraded":"2024-01-31T05:04:21.266618+0000","last_fullsized":"2024-01-31T05:04:21.266618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:05:32.076479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579670+0000","last_change":"2024-01-31T05:04:15.859340+0000","last_active":"2024-01-31T05:04:21.579670+0000","last_peered":"2024-01-31T05:04:21.579670+0000","last_clean":"2024-01-31T05:04:21.579670+0000","last_became_active":"2024-01-31T05:04:15.858887+0000","last_became_peered":"2024-01-31T05:04:15.858887+0000","last_unstale":"2024-01-31T05:04:21.579670+0000","last_undegraded":"2024-01-31T05:04:21.579670+0000","last_fullsized":"2024-01-31T05:04:21.579670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:11.318125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581256+0000","last_change":"2024-01-31T05:04:05.699222+0000","last_active":"2024-01-31T05:04:21.581256+0000","last_peered":"2024-01-31T05:04:21.581256+0000","last_clean":"2024-01-31T05:04:21.581256+0000","last_became_active":"2024-01-31T05:04:05.698239+0000","last_became_peered":"2024-01-31T05:04:05.698239+0000","last_unstale":"2024-01-31T05:04:21.581256+0000","last_undegraded":"2024-01-31T05:04:21.581256+0000","last_fullsized":"2024-01-31T05:04:21.581256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_clean_scrub_stamp":"2024-01-31T05:04:04.484734+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:05:13.736598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580928+0000","last_change":"2024-01-31T05:04:20.409212+0000","last_active":"2024-01-31T05:04:21.580928+0000","last_peered":"2024-01-31T05:04:21.580928+0000","last_clean":"2024-01-31T05:04:21.580928+0000","last_became_active":"2024-01-31T05:04:20.408741+0000","last_became_peered":"2024-01-31T05:04:20.408741+0000","last_unstale":"2024-01-31T05:04:21.580928+0000","last_undegraded":"2024-01-31T05:04:21.580928+0000","last_fullsized":"2024-01-31T05:04:21.580928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:20:14.179731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581967+0000","last_change":"2024-01-31T05:04:16.301754+0000","last_active":"2024-01-31T05:04:21.581967+0000","last_peered":"2024-01-31T05:04:21.581967+0000","last_clean":"2024-01-31T05:04:21.581967+0000","last_became_active":"2024-01-31T05:04:16.301449+0000","last_became_peered":"2024-01-31T05:04:16.301449+0000","last_unstale":"2024-01-31T05:04:21.581967+0000","last_undegraded":"2024-01-31T05:04:21.581967+0000","last_fullsized":"2024-01-31T05:04:21.581967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:47.781626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267625+0000","last_change":"2024-01-31T05:04:15.866001+0000","last_active":"2024-01-31T05:04:21.267625+0000","last_peered":"2024-01-31T05:04:21.267625+0000","last_clean":"2024-01-31T05:04:21.267625+0000","last_became_active":"2024-01-31T05:04:15.865731+0000","last_became_peered":"2024-01-31T05:04:15.865731+0000","last_unstale":"2024-01-31T05:04:21.267625+0000","last_undegraded":"2024-01-31T05:04:21.267625+0000","last_fullsized":"2024-01-31T05:04:21.267625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:53.760373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580399+0000","last_change":"2024-01-31T05:04:20.409951+0000","last_active":"2024-01-31T05:04:21.580399+0000","last_peered":"2024-01-31T05:04:21.580399+0000","last_clean":"2024-01-31T05:04:21.580399+0000","last_became_active":"2024-01-31T05:04:20.408740+0000","last_became_peered":"2024-01-31T05:04:20.408740+0000","last_unstale":"2024-01-31T05:04:21.580399+0000","last_undegraded":"2024-01-31T05:04:21.580399+0000","last_fullsized":"2024-01-31T05:04:21.580399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:17:35.221341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579952+0000","last_change":"2024-01-31T05:04:16.290253+0000","last_active":"2024-01-31T05:04:21.579952+0000","last_peered":"2024-01-31T05:04:21.579952+0000","last_clean":"2024-01-31T05:04:21.579952+0000","last_became_active":"2024-01-31T05:04:16.289838+0000","last_became_peered":"2024-01-31T05:04:16.289838+0000","last_unstale":"2024-01-31T05:04:21.579952+0000","last_undegraded":"2024-01-31T05:04:21.579952+0000","last_fullsized":"2024-01-31T05:04:21.579952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:20:10.742169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580789+0000","last_change":"2024-01-31T05:04:15.866801+0000","last_active":"2024-01-31T05:04:21.580789+0000","last_peered":"2024-01-31T05:04:21.580789+0000","last_clean":"2024-01-31T05:04:21.580789+0000","last_became_active":"2024-01-31T05:04:15.866478+0000","last_became_peered":"2024-01-31T05:04:15.866478+0000","last_unstale":"2024-01-31T05:04:21.580789+0000","last_undegraded":"2024-01-31T05:04:21.580789+0000","last_fullsized":"2024-01-31T05:04:21.580789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:11.318125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580174+0000","last_change":"2024-01-31T05:04:20.307543+0000","last_active":"2024-01-31T05:04:21.580174+0000","last_peered":"2024-01-31T05:04:21.580174+0000","last_clean":"2024-01-31T05:04:21.580174+0000","last_became_active":"2024-01-31T05:04:20.307124+0000","last_became_peered":"2024-01-31T05:04:20.307124+0000","last_unstale":"2024-01-31T05:04:21.580174+0000","last_undegraded":"2024-01-31T05:04:21.580174+0000","last_fullsized":"2024-01-31T05:04:21.580174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:44.473185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581703+0000","last_change":"2024-01-31T05:04:16.289496+0000","last_active":"2024-01-31T05:04:21.581703+0000","last_peered":"2024-01-31T05:04:21.581703+0000","last_clean":"2024-01-31T05:04:21.581703+0000","last_became_active":"2024-01-31T05:04:16.288932+0000","last_became_peered":"2024-01-31T05:04:16.288932+0000","last_unstale":"2024-01-31T05:04:21.581703+0000","last_undegraded":"2024-01-31T05:04:21.581703+0000","last_fullsized":"2024-01-31T05:04:21.581703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:26:00.186988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267853+0000","last_change":"2024-01-31T05:04:15.868950+0000","last_active":"2024-01-31T05:04:21.267853+0000","last_peered":"2024-01-31T05:04:21.267853+0000","last_clean":"2024-01-31T05:04:21.267853+0000","last_became_active":"2024-01-31T05:04:15.868416+0000","last_became_peered":"2024-01-31T05:04:15.868416+0000","last_unstale":"2024-01-31T05:04:21.267853+0000","last_undegraded":"2024-01-31T05:04:21.267853+0000","last_fullsized":"2024-01-31T05:04:21.267853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:12:26.990588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579270+0000","last_change":"2024-01-31T05:04:20.412399+0000","last_active":"2024-01-31T05:04:21.579270+0000","last_peered":"2024-01-31T05:04:21.579270+0000","last_clean":"2024-01-31T05:04:21.579270+0000","last_became_active":"2024-01-31T05:04:20.412174+0000","last_became_peered":"2024-01-31T05:04:20.412174+0000","last_unstale":"2024-01-31T05:04:21.579270+0000","last_undegraded":"2024-01-31T05:04:21.579270+0000","last_fullsized":"2024-01-31T05:04:21.579270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:50:26.572528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.582346+0000","last_change":"2024-01-31T05:04:16.291917+0000","last_active":"2024-01-31T05:04:21.582346+0000","last_peered":"2024-01-31T05:04:21.582346+0000","last_clean":"2024-01-31T05:04:21.582346+0000","last_became_active":"2024-01-31T05:04:16.291631+0000","last_became_peered":"2024-01-31T05:04:16.291631+0000","last_unstale":"2024-01-31T05:04:21.582346+0000","last_undegraded":"2024-01-31T05:04:21.582346+0000","last_fullsized":"2024-01-31T05:04:21.582346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:29:14.662909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267621+0000","last_change":"2024-01-31T05:04:15.860520+0000","last_active":"2024-01-31T05:04:21.267621+0000","last_peered":"2024-01-31T05:04:21.267621+0000","last_clean":"2024-01-31T05:04:21.267621+0000","last_became_active":"2024-01-31T05:04:15.860310+0000","last_became_peered":"2024-01-31T05:04:15.860310+0000","last_unstale":"2024-01-31T05:04:21.267621+0000","last_undegraded":"2024-01-31T05:04:21.267621+0000","last_fullsized":"2024-01-31T05:04:21.267621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:05:24.077981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266628+0000","last_change":"2024-01-31T05:04:20.303904+0000","last_active":"2024-01-31T05:04:21.266628+0000","last_peered":"2024-01-31T05:04:21.266628+0000","last_clean":"2024-01-31T05:04:21.266628+0000","last_became_active":"2024-01-31T05:04:20.302675+0000","last_became_peered":"2024-01-31T05:04:20.302675+0000","last_unstale":"2024-01-31T05:04:21.266628+0000","last_undegraded":"2024-01-31T05:04:21.266628+0000","last_fullsized":"2024-01-31T05:04:21.266628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:59:20.936979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581255+0000","last_change":"2024-01-31T05:04:16.293580+0000","last_active":"2024-01-31T05:04:21.581255+0000","last_peered":"2024-01-31T05:04:21.581255+0000","last_clean":"2024-01-31T05:04:21.581255+0000","last_became_active":"2024-01-31T05:04:16.289043+0000","last_became_peered":"2024-01-31T05:04:16.289043+0000","last_unstale":"2024-01-31T05:04:21.581255+0000","last_undegraded":"2024-01-31T05:04:21.581255+0000","last_fullsized":"2024-01-31T05:04:21.581255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:20.440155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266904+0000","last_change":"2024-01-31T05:04:15.858583+0000","last_active":"2024-01-31T05:04:21.266904+0000","last_peered":"2024-01-31T05:04:21.266904+0000","last_clean":"2024-01-31T05:04:21.266904+0000","last_became_active":"2024-01-31T05:04:15.858214+0000","last_became_peered":"2024-01-31T05:04:15.858214+0000","last_unstale":"2024-01-31T05:04:21.266904+0000","last_undegraded":"2024-01-31T05:04:21.266904+0000","last_fullsized":"2024-01-31T05:04:21.266904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:27:44.760988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580996+0000","last_change":"2024-01-31T05:04:20.305474+0000","last_active":"2024-01-31T05:04:21.580996+0000","last_peered":"2024-01-31T05:04:21.580996+0000","last_clean":"2024-01-31T05:04:21.580996+0000","last_became_active":"2024-01-31T05:04:20.304812+0000","last_became_peered":"2024-01-31T05:04:20.304812+0000","last_unstale":"2024-01-31T05:04:21.580996+0000","last_undegraded":"2024-01-31T05:04:21.580996+0000","last_fullsized":"2024-01-31T05:04:21.580996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:45.735003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580086+0000","last_change":"2024-01-31T05:04:16.281029+0000","last_active":"2024-01-31T05:04:21.580086+0000","last_peered":"2024-01-31T05:04:21.580086+0000","last_clean":"2024-01-31T05:04:21.580086+0000","last_became_active":"2024-01-31T05:04:16.280773+0000","last_became_peered":"2024-01-31T05:04:16.280773+0000","last_unstale":"2024-01-31T05:04:21.580086+0000","last_undegraded":"2024-01-31T05:04:21.580086+0000","last_fullsized":"2024-01-31T05:04:21.580086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:44:28.652707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580546+0000","last_change":"2024-01-31T05:04:15.873157+0000","last_active":"2024-01-31T05:04:21.580546+0000","last_peered":"2024-01-31T05:04:21.580546+0000","last_clean":"2024-01-31T05:04:21.580546+0000","last_became_active":"2024-01-31T05:04:15.872851+0000","last_became_peered":"2024-01-31T05:04:15.872851+0000","last_unstale":"2024-01-31T05:04:21.580546+0000","last_undegraded":"2024-01-31T05:04:21.580546+0000","last_fullsized":"2024-01-31T05:04:21.580546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:53.760373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267875+0000","last_change":"2024-01-31T05:04:20.414571+0000","last_active":"2024-01-31T05:04:21.267875+0000","last_peered":"2024-01-31T05:04:21.267875+0000","last_clean":"2024-01-31T05:04:21.267875+0000","last_became_active":"2024-01-31T05:04:20.413308+0000","last_became_peered":"2024-01-31T05:04:20.413308+0000","last_unstale":"2024-01-31T05:04:21.267875+0000","last_undegraded":"2024-01-31T05:04:21.267875+0000","last_fullsized":"2024-01-31T05:04:21.267875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:41:46.079832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581697+0000","last_change":"2024-01-31T05:04:16.289635+0000","last_active":"2024-01-31T05:04:21.581697+0000","last_peered":"2024-01-31T05:04:21.581697+0000","last_clean":"2024-01-31T05:04:21.581697+0000","last_became_active":"2024-01-31T05:04:16.289367+0000","last_became_peered":"2024-01-31T05:04:16.289367+0000","last_unstale":"2024-01-31T05:04:21.581697+0000","last_undegraded":"2024-01-31T05:04:21.581697+0000","last_fullsized":"2024-01-31T05:04:21.581697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:20:10.742169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579673+0000","last_change":"2024-01-31T05:04:15.867802+0000","last_active":"2024-01-31T05:04:21.579673+0000","last_peered":"2024-01-31T05:04:21.579673+0000","last_clean":"2024-01-31T05:04:21.579673+0000","last_became_active":"2024-01-31T05:04:15.867509+0000","last_became_peered":"2024-01-31T05:04:15.867509+0000","last_unstale":"2024-01-31T05:04:21.579673+0000","last_undegraded":"2024-01-31T05:04:21.579673+0000","last_fullsized":"2024-01-31T05:04:21.579673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:12:26.990588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267002+0000","last_change":"2024-01-31T05:04:20.410363+0000","last_active":"2024-01-31T05:04:21.267002+0000","last_peered":"2024-01-31T05:04:21.267002+0000","last_clean":"2024-01-31T05:04:21.267002+0000","last_became_active":"2024-01-31T05:04:20.409349+0000","last_became_peered":"2024-01-31T05:04:20.409349+0000","last_unstale":"2024-01-31T05:04:21.267002+0000","last_undegraded":"2024-01-31T05:04:21.267002+0000","last_fullsized":"2024-01-31T05:04:21.267002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:12:43.831584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580116+0000","last_change":"2024-01-31T05:04:16.279383+0000","last_active":"2024-01-31T05:04:21.580116+0000","last_peered":"2024-01-31T05:04:21.580116+0000","last_clean":"2024-01-31T05:04:21.580116+0000","last_became_active":"2024-01-31T05:04:16.278871+0000","last_became_peered":"2024-01-31T05:04:16.278871+0000","last_unstale":"2024-01-31T05:04:21.580116+0000","last_undegraded":"2024-01-31T05:04:21.580116+0000","last_fullsized":"2024-01-31T05:04:21.580116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:14:16.417240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580394+0000","last_change":"2024-01-31T05:04:15.860246+0000","last_active":"2024-01-31T05:04:21.580394+0000","last_peered":"2024-01-31T05:04:21.580394+0000","last_clean":"2024-01-31T05:04:21.580394+0000","last_became_active":"2024-01-31T05:04:15.860027+0000","last_became_peered":"2024-01-31T05:04:15.860027+0000","last_unstale":"2024-01-31T05:04:21.580394+0000","last_undegraded":"2024-01-31T05:04:21.580394+0000","last_fullsized":"2024-01-31T05:04:21.580394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:00:09.341930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580269+0000","last_change":"2024-01-31T05:04:20.414791+0000","last_active":"2024-01-31T05:04:21.580269+0000","last_peered":"2024-01-31T05:04:21.580269+0000","last_clean":"2024-01-31T05:04:21.580269+0000","last_became_active":"2024-01-31T05:04:20.414082+0000","last_became_peered":"2024-01-31T05:04:20.414082+0000","last_unstale":"2024-01-31T05:04:21.580269+0000","last_undegraded":"2024-01-31T05:04:21.580269+0000","last_fullsized":"2024-01-31T05:04:21.580269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:29:34.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581901+0000","last_change":"2024-01-31T05:04:16.288217+0000","last_active":"2024-01-31T05:04:21.581901+0000","last_peered":"2024-01-31T05:04:21.581901+0000","last_clean":"2024-01-31T05:04:21.581901+0000","last_became_active":"2024-01-31T05:04:16.287855+0000","last_became_peered":"2024-01-31T05:04:16.287855+0000","last_unstale":"2024-01-31T05:04:21.581901+0000","last_undegraded":"2024-01-31T05:04:21.581901+0000","last_fullsized":"2024-01-31T05:04:21.581901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:17:31.783779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:26.937176+0000","last_change":"2024-01-31T05:04:15.871503+0000","last_active":"2024-01-31T05:04:26.937176+0000","last_peered":"2024-01-31T05:04:26.937176+0000","last_clean":"2024-01-31T05:04:26.937176+0000","last_became_active":"2024-01-31T05:04:15.871207+0000","last_became_peered":"2024-01-31T05:04:15.871207+0000","last_unstale":"2024-01-31T05:04:26.937176+0000","last_undegraded":"2024-01-31T05:04:26.937176+0000","last_fullsized":"2024-01-31T05:04:26.937176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:07:45.743062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580076+0000","last_change":"2024-01-31T05:04:20.318951+0000","last_active":"2024-01-31T05:04:21.580076+0000","last_peered":"2024-01-31T05:04:21.580076+0000","last_clean":"2024-01-31T05:04:21.580076+0000","last_became_active":"2024-01-31T05:04:20.315434+0000","last_became_peered":"2024-01-31T05:04:20.315434+0000","last_unstale":"2024-01-31T05:04:21.580076+0000","last_undegraded":"2024-01-31T05:04:21.580076+0000","last_fullsized":"2024-01-31T05:04:21.580076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:44.473185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267446+0000","last_change":"2024-01-31T05:04:16.284047+0000","last_active":"2024-01-31T05:04:21.267446+0000","last_peered":"2024-01-31T05:04:21.267446+0000","last_clean":"2024-01-31T05:04:21.267446+0000","last_became_active":"2024-01-31T05:04:16.283455+0000","last_became_peered":"2024-01-31T05:04:16.283455+0000","last_unstale":"2024-01-31T05:04:21.267446+0000","last_undegraded":"2024-01-31T05:04:21.267446+0000","last_fullsized":"2024-01-31T05:04:21.267446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:24:56.115180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580681+0000","last_change":"2024-01-31T05:04:15.868251+0000","last_active":"2024-01-31T05:04:21.580681+0000","last_peered":"2024-01-31T05:04:21.580681+0000","last_clean":"2024-01-31T05:04:21.580681+0000","last_became_active":"2024-01-31T05:04:15.867924+0000","last_became_peered":"2024-01-31T05:04:15.867924+0000","last_unstale":"2024-01-31T05:04:21.580681+0000","last_undegraded":"2024-01-31T05:04:21.580681+0000","last_fullsized":"2024-01-31T05:04:21.580681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:07:45.743062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267249+0000","last_change":"2024-01-31T05:04:20.302123+0000","last_active":"2024-01-31T05:04:21.267249+0000","last_peered":"2024-01-31T05:04:21.267249+0000","last_clean":"2024-01-31T05:04:21.267249+0000","last_became_active":"2024-01-31T05:04:20.301865+0000","last_became_peered":"2024-01-31T05:04:20.301865+0000","last_unstale":"2024-01-31T05:04:21.267249+0000","last_undegraded":"2024-01-31T05:04:21.267249+0000","last_fullsized":"2024-01-31T05:04:21.267249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:17:35.221341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581093+0000","last_change":"2024-01-31T05:04:16.295806+0000","last_active":"2024-01-31T05:04:21.581093+0000","last_peered":"2024-01-31T05:04:21.581093+0000","last_clean":"2024-01-31T05:04:21.581093+0000","last_became_active":"2024-01-31T05:04:16.295553+0000","last_became_peered":"2024-01-31T05:04:16.295553+0000","last_unstale":"2024-01-31T05:04:21.581093+0000","last_undegraded":"2024-01-31T05:04:21.581093+0000","last_fullsized":"2024-01-31T05:04:21.581093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580840+0000","last_change":"2024-01-31T05:04:15.875006+0000","last_active":"2024-01-31T05:04:21.580840+0000","last_peered":"2024-01-31T05:04:21.580840+0000","last_clean":"2024-01-31T05:04:21.580840+0000","last_became_active":"2024-01-31T05:04:15.874743+0000","last_became_peered":"2024-01-31T05:04:15.874743+0000","last_unstale":"2024-01-31T05:04:21.580840+0000","last_undegraded":"2024-01-31T05:04:21.580840+0000","last_fullsized":"2024-01-31T05:04:21.580840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:37.392650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266837+0000","last_change":"2024-01-31T05:04:20.316263+0000","last_active":"2024-01-31T05:04:21.266837+0000","last_peered":"2024-01-31T05:04:21.266837+0000","last_clean":"2024-01-31T05:04:21.266837+0000","last_became_active":"2024-01-31T05:04:20.315752+0000","last_became_peered":"2024-01-31T05:04:20.315752+0000","last_unstale":"2024-01-31T05:04:21.266837+0000","last_undegraded":"2024-01-31T05:04:21.266837+0000","last_fullsized":"2024-01-31T05:04:21.266837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:29:34.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580744+0000","last_change":"2024-01-31T05:04:16.292783+0000","last_active":"2024-01-31T05:04:21.580744+0000","last_peered":"2024-01-31T05:04:21.580744+0000","last_clean":"2024-01-31T05:04:21.580744+0000","last_became_active":"2024-01-31T05:04:16.292520+0000","last_became_peered":"2024-01-31T05:04:16.292520+0000","last_unstale":"2024-01-31T05:04:21.580744+0000","last_undegraded":"2024-01-31T05:04:21.580744+0000","last_fullsized":"2024-01-31T05:04:21.580744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:52:00.886932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581728+0000","last_change":"2024-01-31T05:04:15.877472+0000","last_active":"2024-01-31T05:04:21.581728+0000","last_peered":"2024-01-31T05:04:21.581728+0000","last_clean":"2024-01-31T05:04:21.581728+0000","last_became_active":"2024-01-31T05:04:15.877195+0000","last_became_peered":"2024-01-31T05:04:15.877195+0000","last_unstale":"2024-01-31T05:04:21.581728+0000","last_undegraded":"2024-01-31T05:04:21.581728+0000","last_fullsized":"2024-01-31T05:04:21.581728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:38:14.126192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266508+0000","last_change":"2024-01-31T05:04:20.410602+0000","last_active":"2024-01-31T05:04:21.266508+0000","last_peered":"2024-01-31T05:04:21.266508+0000","last_clean":"2024-01-31T05:04:21.266508+0000","last_became_active":"2024-01-31T05:04:20.410214+0000","last_became_peered":"2024-01-31T05:04:20.410214+0000","last_unstale":"2024-01-31T05:04:21.266508+0000","last_undegraded":"2024-01-31T05:04:21.266508+0000","last_fullsized":"2024-01-31T05:04:21.266508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:50:26.572528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580777+0000","last_change":"2024-01-31T05:04:20.413035+0000","last_active":"2024-01-31T05:04:21.580777+0000","last_peered":"2024-01-31T05:04:21.580777+0000","last_clean":"2024-01-31T05:04:21.580777+0000","last_became_active":"2024-01-31T05:04:20.409657+0000","last_became_peered":"2024-01-31T05:04:20.409657+0000","last_unstale":"2024-01-31T05:04:21.580777+0000","last_undegraded":"2024-01-31T05:04:21.580777+0000","last_fullsized":"2024-01-31T05:04:21.580777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:52:04.324494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579651+0000","last_change":"2024-01-31T05:04:16.280492+0000","last_active":"2024-01-31T05:04:21.579651+0000","last_peered":"2024-01-31T05:04:21.579651+0000","last_clean":"2024-01-31T05:04:21.579651+0000","last_became_active":"2024-01-31T05:04:16.280274+0000","last_became_peered":"2024-01-31T05:04:16.280274+0000","last_unstale":"2024-01-31T05:04:21.579651+0000","last_undegraded":"2024-01-31T05:04:21.579651+0000","last_fullsized":"2024-01-31T05:04:21.579651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:32:44.394537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579405+0000","last_change":"2024-01-31T05:04:15.861706+0000","last_active":"2024-01-31T05:04:21.579405+0000","last_peered":"2024-01-31T05:04:21.579405+0000","last_clean":"2024-01-31T05:04:21.579405+0000","last_became_active":"2024-01-31T05:04:15.861143+0000","last_became_peered":"2024-01-31T05:04:15.861143+0000","last_unstale":"2024-01-31T05:04:21.579405+0000","last_undegraded":"2024-01-31T05:04:21.579405+0000","last_fullsized":"2024-01-31T05:04:21.579405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:53.760373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581668+0000","last_change":"2024-01-31T05:04:20.314757+0000","last_active":"2024-01-31T05:04:21.581668+0000","last_peered":"2024-01-31T05:04:21.581668+0000","last_clean":"2024-01-31T05:04:21.581668+0000","last_became_active":"2024-01-31T05:04:20.314255+0000","last_became_peered":"2024-01-31T05:04:20.314255+0000","last_unstale":"2024-01-31T05:04:21.581668+0000","last_undegraded":"2024-01-31T05:04:21.581668+0000","last_fullsized":"2024-01-31T05:04:21.581668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:51.219189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266310+0000","last_change":"2024-01-31T05:04:16.283281+0000","last_active":"2024-01-31T05:04:21.266310+0000","last_peered":"2024-01-31T05:04:21.266310+0000","last_clean":"2024-01-31T05:04:21.266310+0000","last_became_active":"2024-01-31T05:04:16.283067+0000","last_became_peered":"2024-01-31T05:04:16.283067+0000","last_unstale":"2024-01-31T05:04:21.266310+0000","last_undegraded":"2024-01-31T05:04:21.266310+0000","last_fullsized":"2024-01-31T05:04:21.266310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:32:44.394537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266680+0000","last_change":"2024-01-31T05:04:15.870556+0000","last_active":"2024-01-31T05:04:21.266680+0000","last_peered":"2024-01-31T05:04:21.266680+0000","last_clean":"2024-01-31T05:04:21.266680+0000","last_became_active":"2024-01-31T05:04:15.870204+0000","last_became_peered":"2024-01-31T05:04:15.870204+0000","last_unstale":"2024-01-31T05:04:21.266680+0000","last_undegraded":"2024-01-31T05:04:21.266680+0000","last_fullsized":"2024-01-31T05:04:21.266680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:53.760373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580467+0000","last_change":"2024-01-31T05:04:15.874785+0000","last_active":"2024-01-31T05:04:21.580467+0000","last_peered":"2024-01-31T05:04:21.580467+0000","last_clean":"2024-01-31T05:04:21.580467+0000","last_became_active":"2024-01-31T05:04:15.874174+0000","last_became_peered":"2024-01-31T05:04:15.874174+0000","last_unstale":"2024-01-31T05:04:21.580467+0000","last_undegraded":"2024-01-31T05:04:21.580467+0000","last_fullsized":"2024-01-31T05:04:21.580467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:11.318125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580306+0000","last_change":"2024-01-31T05:04:16.273656+0000","last_active":"2024-01-31T05:04:21.580306+0000","last_peered":"2024-01-31T05:04:21.580306+0000","last_clean":"2024-01-31T05:04:21.580306+0000","last_became_active":"2024-01-31T05:04:16.273182+0000","last_became_peered":"2024-01-31T05:04:16.273182+0000","last_unstale":"2024-01-31T05:04:21.580306+0000","last_undegraded":"2024-01-31T05:04:21.580306+0000","last_fullsized":"2024-01-31T05:04:21.580306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:32:44.394537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267586+0000","last_change":"2024-01-31T05:04:20.304766+0000","last_active":"2024-01-31T05:04:21.267586+0000","last_peered":"2024-01-31T05:04:21.267586+0000","last_clean":"2024-01-31T05:04:21.267586+0000","last_became_active":"2024-01-31T05:04:20.302194+0000","last_became_peered":"2024-01-31T05:04:20.302194+0000","last_unstale":"2024-01-31T05:04:21.267586+0000","last_undegraded":"2024-01-31T05:04:21.267586+0000","last_fullsized":"2024-01-31T05:04:21.267586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:44:32.090269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266563+0000","last_change":"2024-01-31T05:04:15.863162+0000","last_active":"2024-01-31T05:04:21.266563+0000","last_peered":"2024-01-31T05:04:21.266563+0000","last_clean":"2024-01-31T05:04:21.266563+0000","last_became_active":"2024-01-31T05:04:15.862856+0000","last_became_peered":"2024-01-31T05:04:15.862856+0000","last_unstale":"2024-01-31T05:04:21.266563+0000","last_undegraded":"2024-01-31T05:04:21.266563+0000","last_fullsized":"2024-01-31T05:04:21.266563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:38:14.126192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266991+0000","last_change":"2024-01-31T05:04:16.278690+0000","last_active":"2024-01-31T05:04:21.266991+0000","last_peered":"2024-01-31T05:04:21.266991+0000","last_clean":"2024-01-31T05:04:21.266991+0000","last_became_active":"2024-01-31T05:04:16.277442+0000","last_became_peered":"2024-01-31T05:04:16.277442+0000","last_unstale":"2024-01-31T05:04:21.266991+0000","last_undegraded":"2024-01-31T05:04:21.266991+0000","last_fullsized":"2024-01-31T05:04:21.266991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:07:46.749416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267351+0000","last_change":"2024-01-31T05:04:20.302359+0000","last_active":"2024-01-31T05:04:21.267351+0000","last_peered":"2024-01-31T05:04:21.267351+0000","last_clean":"2024-01-31T05:04:21.267351+0000","last_became_active":"2024-01-31T05:04:20.301989+0000","last_became_peered":"2024-01-31T05:04:20.301989+0000","last_unstale":"2024-01-31T05:04:21.267351+0000","last_undegraded":"2024-01-31T05:04:21.267351+0000","last_fullsized":"2024-01-31T05:04:21.267351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:45:23.064537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579969+0000","last_change":"2024-01-31T05:04:16.281815+0000","last_active":"2024-01-31T05:04:21.579969+0000","last_peered":"2024-01-31T05:04:21.579969+0000","last_clean":"2024-01-31T05:04:21.579969+0000","last_became_active":"2024-01-31T05:04:16.281498+0000","last_became_peered":"2024-01-31T05:04:16.281498+0000","last_unstale":"2024-01-31T05:04:21.579969+0000","last_undegraded":"2024-01-31T05:04:21.579969+0000","last_fullsized":"2024-01-31T05:04:21.579969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267024+0000","last_change":"2024-01-31T05:04:16.295756+0000","last_active":"2024-01-31T05:04:21.267024+0000","last_peered":"2024-01-31T05:04:21.267024+0000","last_clean":"2024-01-31T05:04:21.267024+0000","last_became_active":"2024-01-31T05:04:16.295450+0000","last_became_peered":"2024-01-31T05:04:16.295450+0000","last_unstale":"2024-01-31T05:04:21.267024+0000","last_undegraded":"2024-01-31T05:04:21.267024+0000","last_fullsized":"2024-01-31T05:04:21.267024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:16:27.370806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579563+0000","last_change":"2024-01-31T05:04:16.298362+0000","last_active":"2024-01-31T05:04:21.579563+0000","last_peered":"2024-01-31T05:04:21.579563+0000","last_clean":"2024-01-31T05:04:21.579563+0000","last_became_active":"2024-01-31T05:04:16.297810+0000","last_became_peered":"2024-01-31T05:04:16.297810+0000","last_unstale":"2024-01-31T05:04:21.579563+0000","last_undegraded":"2024-01-31T05:04:21.579563+0000","last_fullsized":"2024-01-31T05:04:21.579563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:10:07.431961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580221+0000","last_change":"2024-01-31T05:04:16.282239+0000","last_active":"2024-01-31T05:04:21.580221+0000","last_peered":"2024-01-31T05:04:21.580221+0000","last_clean":"2024-01-31T05:04:21.580221+0000","last_became_active":"2024-01-31T05:04:16.281895+0000","last_became_peered":"2024-01-31T05:04:16.281895+0000","last_unstale":"2024-01-31T05:04:21.580221+0000","last_undegraded":"2024-01-31T05:04:21.580221+0000","last_fullsized":"2024-01-31T05:04:21.580221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:36.794548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267075+0000","last_change":"2024-01-31T05:04:16.282767+0000","last_active":"2024-01-31T05:04:21.267075+0000","last_peered":"2024-01-31T05:04:21.267075+0000","last_clean":"2024-01-31T05:04:21.267075+0000","last_became_active":"2024-01-31T05:04:16.282281+0000","last_became_peered":"2024-01-31T05:04:16.282281+0000","last_unstale":"2024-01-31T05:04:21.267075+0000","last_undegraded":"2024-01-31T05:04:21.267075+0000","last_fullsized":"2024-01-31T05:04:21.267075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:29:14.662909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580441+0000","last_change":"2024-01-31T05:04:16.281263+0000","last_active":"2024-01-31T05:04:21.580441+0000","last_peered":"2024-01-31T05:04:21.580441+0000","last_clean":"2024-01-31T05:04:21.580441+0000","last_became_active":"2024-01-31T05:04:16.280997+0000","last_became_peered":"2024-01-31T05:04:16.280997+0000","last_unstale":"2024-01-31T05:04:21.580441+0000","last_undegraded":"2024-01-31T05:04:21.580441+0000","last_fullsized":"2024-01-31T05:04:21.580441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:38.399003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581900+0000","last_change":"2024-01-31T05:04:16.287350+0000","last_active":"2024-01-31T05:04:21.581900+0000","last_peered":"2024-01-31T05:04:21.581900+0000","last_clean":"2024-01-31T05:04:21.581900+0000","last_became_active":"2024-01-31T05:04:16.286994+0000","last_became_peered":"2024-01-31T05:04:16.286994+0000","last_unstale":"2024-01-31T05:04:21.581900+0000","last_undegraded":"2024-01-31T05:04:21.581900+0000","last_fullsized":"2024-01-31T05:04:21.581900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:38.399003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267923+0000","last_change":"2024-01-31T05:04:16.281989+0000","last_active":"2024-01-31T05:04:21.267923+0000","last_peered":"2024-01-31T05:04:21.267923+0000","last_clean":"2024-01-31T05:04:21.267923+0000","last_became_active":"2024-01-31T05:04:16.281750+0000","last_became_peered":"2024-01-31T05:04:16.281750+0000","last_unstale":"2024-01-31T05:04:21.267923+0000","last_undegraded":"2024-01-31T05:04:21.267923+0000","last_fullsized":"2024-01-31T05:04:21.267923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579377+0000","last_change":"2024-01-31T05:04:16.294158+0000","last_active":"2024-01-31T05:04:21.579377+0000","last_peered":"2024-01-31T05:04:21.579377+0000","last_clean":"2024-01-31T05:04:21.579377+0000","last_became_active":"2024-01-31T05:04:16.293446+0000","last_became_peered":"2024-01-31T05:04:16.293446+0000","last_unstale":"2024-01-31T05:04:21.579377+0000","last_undegraded":"2024-01-31T05:04:21.579377+0000","last_fullsized":"2024-01-31T05:04:21.579377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:17:31.783779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266570+0000","last_change":"2024-01-31T05:04:16.285685+0000","last_active":"2024-01-31T05:04:21.266570+0000","last_peered":"2024-01-31T05:04:21.266570+0000","last_clean":"2024-01-31T05:04:21.266570+0000","last_became_active":"2024-01-31T05:04:16.285379+0000","last_became_peered":"2024-01-31T05:04:16.285379+0000","last_unstale":"2024-01-31T05:04:21.266570+0000","last_undegraded":"2024-01-31T05:04:21.266570+0000","last_fullsized":"2024-01-31T05:04:21.266570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:36.794548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579467+0000","last_change":"2024-01-31T05:04:16.295065+0000","last_active":"2024-01-31T05:04:21.579467+0000","last_peered":"2024-01-31T05:04:21.579467+0000","last_clean":"2024-01-31T05:04:21.579467+0000","last_became_active":"2024-01-31T05:04:16.294149+0000","last_became_peered":"2024-01-31T05:04:16.294149+0000","last_unstale":"2024-01-31T05:04:21.579467+0000","last_undegraded":"2024-01-31T05:04:21.579467+0000","last_fullsized":"2024-01-31T05:04:21.579467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:20.440155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580011+0000","last_change":"2024-01-31T05:04:16.282035+0000","last_active":"2024-01-31T05:04:21.580011+0000","last_peered":"2024-01-31T05:04:21.580011+0000","last_clean":"2024-01-31T05:04:21.580011+0000","last_became_active":"2024-01-31T05:04:16.281692+0000","last_became_peered":"2024-01-31T05:04:16.281692+0000","last_unstale":"2024-01-31T05:04:21.580011+0000","last_undegraded":"2024-01-31T05:04:21.580011+0000","last_fullsized":"2024-01-31T05:04:21.580011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:44:28.652707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580645+0000","last_change":"2024-01-31T05:04:16.286442+0000","last_active":"2024-01-31T05:04:21.580645+0000","last_peered":"2024-01-31T05:04:21.580645+0000","last_clean":"2024-01-31T05:04:21.580645+0000","last_became_active":"2024-01-31T05:04:16.286105+0000","last_became_peered":"2024-01-31T05:04:16.286105+0000","last_unstale":"2024-01-31T05:04:21.580645+0000","last_undegraded":"2024-01-31T05:04:21.580645+0000","last_fullsized":"2024-01-31T05:04:21.580645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.582060+0000","last_change":"2024-01-31T05:04:16.285693+0000","last_active":"2024-01-31T05:04:21.582060+0000","last_peered":"2024-01-31T05:04:21.582060+0000","last_clean":"2024-01-31T05:04:21.582060+0000","last_became_active":"2024-01-31T05:04:16.285438+0000","last_became_peered":"2024-01-31T05:04:16.285438+0000","last_unstale":"2024-01-31T05:04:21.582060+0000","last_undegraded":"2024-01-31T05:04:21.582060+0000","last_fullsized":"2024-01-31T05:04:21.582060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:41.035623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267794+0000","last_change":"2024-01-31T05:04:16.288398+0000","last_active":"2024-01-31T05:04:21.267794+0000","last_peered":"2024-01-31T05:04:21.267794+0000","last_clean":"2024-01-31T05:04:21.267794+0000","last_became_active":"2024-01-31T05:04:16.288236+0000","last_became_peered":"2024-01-31T05:04:16.288236+0000","last_unstale":"2024-01-31T05:04:21.267794+0000","last_undegraded":"2024-01-31T05:04:21.267794+0000","last_fullsized":"2024-01-31T05:04:21.267794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:24:56.115180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581838+0000","last_change":"2024-01-31T05:04:16.289516+0000","last_active":"2024-01-31T05:04:21.581838+0000","last_peered":"2024-01-31T05:04:21.581838+0000","last_clean":"2024-01-31T05:04:21.581838+0000","last_became_active":"2024-01-31T05:04:16.289233+0000","last_became_peered":"2024-01-31T05:04:16.289233+0000","last_unstale":"2024-01-31T05:04:21.581838+0000","last_undegraded":"2024-01-31T05:04:21.581838+0000","last_fullsized":"2024-01-31T05:04:21.581838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:42.297440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579222+0000","last_change":"2024-01-31T05:04:16.296022+0000","last_active":"2024-01-31T05:04:21.579222+0000","last_peered":"2024-01-31T05:04:21.579222+0000","last_clean":"2024-01-31T05:04:21.579222+0000","last_became_active":"2024-01-31T05:04:16.295742+0000","last_became_peered":"2024-01-31T05:04:16.295742+0000","last_unstale":"2024-01-31T05:04:21.579222+0000","last_undegraded":"2024-01-31T05:04:21.579222+0000","last_fullsized":"2024-01-31T05:04:21.579222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579754+0000","last_change":"2024-01-31T05:04:16.287380+0000","last_active":"2024-01-31T05:04:21.579754+0000","last_peered":"2024-01-31T05:04:21.579754+0000","last_clean":"2024-01-31T05:04:21.579754+0000","last_became_active":"2024-01-31T05:04:16.287109+0000","last_became_peered":"2024-01-31T05:04:16.287109+0000","last_unstale":"2024-01-31T05:04:21.579754+0000","last_undegraded":"2024-01-31T05:04:21.579754+0000","last_fullsized":"2024-01-31T05:04:21.579754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:36.794548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580061+0000","last_change":"2024-01-31T05:04:16.279154+0000","last_active":"2024-01-31T05:04:21.580061+0000","last_peered":"2024-01-31T05:04:21.580061+0000","last_clean":"2024-01-31T05:04:21.580061+0000","last_became_active":"2024-01-31T05:04:16.278567+0000","last_became_peered":"2024-01-31T05:04:16.278567+0000","last_unstale":"2024-01-31T05:04:21.580061+0000","last_undegraded":"2024-01-31T05:04:21.580061+0000","last_fullsized":"2024-01-31T05:04:21.580061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:42:45.290684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266435+0000","last_change":"2024-01-31T05:04:16.297488+0000","last_active":"2024-01-31T05:04:21.266435+0000","last_peered":"2024-01-31T05:04:21.266435+0000","last_clean":"2024-01-31T05:04:21.266435+0000","last_became_active":"2024-01-31T05:04:16.297230+0000","last_became_peered":"2024-01-31T05:04:16.297230+0000","last_unstale":"2024-01-31T05:04:21.266435+0000","last_undegraded":"2024-01-31T05:04:21.266435+0000","last_fullsized":"2024-01-31T05:04:21.266435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267316+0000","last_change":"2024-01-31T05:04:16.288685+0000","last_active":"2024-01-31T05:04:21.267316+0000","last_peered":"2024-01-31T05:04:21.267316+0000","last_clean":"2024-01-31T05:04:21.267316+0000","last_became_active":"2024-01-31T05:04:16.288432+0000","last_became_peered":"2024-01-31T05:04:16.288432+0000","last_unstale":"2024-01-31T05:04:21.267316+0000","last_undegraded":"2024-01-31T05:04:21.267316+0000","last_fullsized":"2024-01-31T05:04:21.267316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:16:27.370806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581061+0000","last_change":"2024-01-31T05:04:16.299989+0000","last_active":"2024-01-31T05:04:21.581061+0000","last_peered":"2024-01-31T05:04:21.581061+0000","last_clean":"2024-01-31T05:04:21.581061+0000","last_became_active":"2024-01-31T05:04:16.299706+0000","last_became_peered":"2024-01-31T05:04:16.299706+0000","last_unstale":"2024-01-31T05:04:21.581061+0000","last_undegraded":"2024-01-31T05:04:21.581061+0000","last_fullsized":"2024-01-31T05:04:21.581061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:32:44.394537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581425+0000","last_change":"2024-01-31T05:04:16.300161+0000","last_active":"2024-01-31T05:04:21.581425+0000","last_peered":"2024-01-31T05:04:21.581425+0000","last_clean":"2024-01-31T05:04:21.581425+0000","last_became_active":"2024-01-31T05:04:16.299891+0000","last_became_peered":"2024-01-31T05:04:16.299891+0000","last_unstale":"2024-01-31T05:04:21.581425+0000","last_undegraded":"2024-01-31T05:04:21.581425+0000","last_fullsized":"2024-01-31T05:04:21.581425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:05:32.076479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581621+0000","last_change":"2024-01-31T05:04:16.296845+0000","last_active":"2024-01-31T05:04:21.581621+0000","last_peered":"2024-01-31T05:04:21.581621+0000","last_clean":"2024-01-31T05:04:21.581621+0000","last_became_active":"2024-01-31T05:04:16.296607+0000","last_became_peered":"2024-01-31T05:04:16.296607+0000","last_unstale":"2024-01-31T05:04:21.581621+0000","last_undegraded":"2024-01-31T05:04:21.581621+0000","last_fullsized":"2024-01-31T05:04:21.581621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:42:10.970514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266165+0000","last_change":"2024-01-31T05:04:16.297713+0000","last_active":"2024-01-31T05:04:21.266165+0000","last_peered":"2024-01-31T05:04:21.266165+0000","last_clean":"2024-01-31T05:04:21.266165+0000","last_became_active":"2024-01-31T05:04:16.297428+0000","last_became_peered":"2024-01-31T05:04:16.297428+0000","last_unstale":"2024-01-31T05:04:21.266165+0000","last_undegraded":"2024-01-31T05:04:21.266165+0000","last_fullsized":"2024-01-31T05:04:21.266165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:44:28.652707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581148+0000","last_change":"2024-01-31T05:04:16.282822+0000","last_active":"2024-01-31T05:04:21.581148+0000","last_peered":"2024-01-31T05:04:21.581148+0000","last_clean":"2024-01-31T05:04:21.581148+0000","last_became_active":"2024-01-31T05:04:16.282537+0000","last_became_peered":"2024-01-31T05:04:16.282537+0000","last_unstale":"2024-01-31T05:04:21.581148+0000","last_undegraded":"2024-01-31T05:04:21.581148+0000","last_fullsized":"2024-01-31T05:04:21.581148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:52:00.886932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579642+0000","last_change":"2024-01-31T05:04:16.298033+0000","last_active":"2024-01-31T05:04:21.579642+0000","last_peered":"2024-01-31T05:04:21.579642+0000","last_clean":"2024-01-31T05:04:21.579642+0000","last_became_active":"2024-01-31T05:04:16.297503+0000","last_became_peered":"2024-01-31T05:04:16.297503+0000","last_unstale":"2024-01-31T05:04:21.579642+0000","last_undegraded":"2024-01-31T05:04:21.579642+0000","last_fullsized":"2024-01-31T05:04:21.579642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581513+0000","last_change":"2024-01-31T05:04:16.284955+0000","last_active":"2024-01-31T05:04:21.581513+0000","last_peered":"2024-01-31T05:04:21.581513+0000","last_clean":"2024-01-31T05:04:21.581513+0000","last_became_active":"2024-01-31T05:04:16.284672+0000","last_became_peered":"2024-01-31T05:04:16.284672+0000","last_unstale":"2024-01-31T05:04:21.581513+0000","last_undegraded":"2024-01-31T05:04:21.581513+0000","last_fullsized":"2024-01-31T05:04:21.581513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:10:07.431961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580116+0000","last_change":"2024-01-31T05:04:16.295273+0000","last_active":"2024-01-31T05:04:21.580116+0000","last_peered":"2024-01-31T05:04:21.580116+0000","last_clean":"2024-01-31T05:04:21.580116+0000","last_became_active":"2024-01-31T05:04:16.294052+0000","last_became_peered":"2024-01-31T05:04:16.294052+0000","last_unstale":"2024-01-31T05:04:21.580116+0000","last_undegraded":"2024-01-31T05:04:21.580116+0000","last_fullsized":"2024-01-31T05:04:21.580116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:59:17.499417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580619+0000","last_change":"2024-01-31T05:04:16.274394+0000","last_active":"2024-01-31T05:04:21.580619+0000","last_peered":"2024-01-31T05:04:21.580619+0000","last_clean":"2024-01-31T05:04:21.580619+0000","last_became_active":"2024-01-31T05:04:16.274092+0000","last_became_peered":"2024-01-31T05:04:16.274092+0000","last_unstale":"2024-01-31T05:04:21.580619+0000","last_undegraded":"2024-01-31T05:04:21.580619+0000","last_fullsized":"2024-01-31T05:04:21.580619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:05:32.076479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580935+0000","last_change":"2024-01-31T05:04:16.276197+0000","last_active":"2024-01-31T05:04:21.580935+0000","last_peered":"2024-01-31T05:04:21.580935+0000","last_clean":"2024-01-31T05:04:21.580935+0000","last_became_active":"2024-01-31T05:04:16.275821+0000","last_became_peered":"2024-01-31T05:04:16.275821+0000","last_unstale":"2024-01-31T05:04:21.580935+0000","last_undegraded":"2024-01-31T05:04:21.580935+0000","last_fullsized":"2024-01-31T05:04:21.580935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581450+0000","last_change":"2024-01-31T05:04:16.289246+0000","last_active":"2024-01-31T05:04:21.581450+0000","last_peered":"2024-01-31T05:04:21.581450+0000","last_clean":"2024-01-31T05:04:21.581450+0000","last_became_active":"2024-01-31T05:04:16.288595+0000","last_became_peered":"2024-01-31T05:04:16.288595+0000","last_unstale":"2024-01-31T05:04:21.581450+0000","last_undegraded":"2024-01-31T05:04:21.581450+0000","last_fullsized":"2024-01-31T05:04:21.581450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:42.297440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":690798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-31T05:04:46.100 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-31T05:04:46.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.279+0000 7f0562e00640 1 Processor -- start 2024-01-31T05:04:46.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.279+0000 7f0562e00640 1 -- start start 2024-01-31T05:04:46.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.279+0000 7f0562e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c15d540 0x7f055c0cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:46.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.279+0000 7f0562e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f055c0cbbc0 0x7f055c15d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:46.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.279+0000 7f0562e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055c0cef80 con 0x7f055c06c290 2024-01-31T05:04:46.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.279+0000 7f0562e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055c06cae0 con 0x7f055c0cbbc0 2024-01-31T05:04:46.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.279+0000 7f0562e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c0cf1b0 con 0x7f055c15d540 2024-01-31T05:04:46.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.279+0000 7f055be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c15d540 0x7f055c0cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:46.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.279+0000 7f0560e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f055c0cbbc0 0x7f055c15d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:46.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.279+0000 7f055b400640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f055c06c290 0x7f055c0cb4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:50632/0 (socket says 172.21.15.49:50632) 2024-01-31T05:04:46.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.279+0000 7f055b400640 1 -- 172.21.15.49:0/345734037 learned_addr learned my addr 172.21.15.49:0/345734037 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:46.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.279+0000 7f055be00640 1 -- 172.21.15.49:0/345734037 >> v2:172.21.15.195:3300/0 conn(0x7f055c0cbbc0 msgr2=0x7f055c15d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:46.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.279+0000 7f055aa00640 1 -- 172.21.15.49:0/345734037 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326608235 0 0) 0x7f055c0cef80 con 0x7f055c06c290 2024-01-31T05:04:46.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.279+0000 7f055be00640 1 --2- 172.21.15.49:0/345734037 >> v2:172.21.15.195:3300/0 conn(0x7f055c0cbbc0 0x7f055c15d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.279+0000 7f055be00640 1 -- 172.21.15.49:0/345734037 >> v1:172.21.15.195:6789/0 conn(0x7f055c06c290 legacy=0x7f055c0cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:46.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.279+0000 7f055be00640 1 -- 172.21.15.49:0/345734037 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c0cf490 con 0x7f055c15d540 2024-01-31T05:04:46.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.283+0000 7f055be00640 1 --2- 172.21.15.49:0/345734037 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c15d540 0x7f055c0cff70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f054c0097c0 tx=0x7f054c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1c16c013c306e66 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:46.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.283+0000 7f055aa00640 1 -- 172.21.15.49:0/345734037 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c0ab650 con 0x7f055c15d540 2024-01-31T05:04:46.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.283+0000 7f055aa00640 1 -- 172.21.15.49:0/345734037 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c0ab7b0 con 0x7f055c15d540 2024-01-31T05:04:46.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.283+0000 7f055aa00640 1 -- 172.21.15.49:0/345734037 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c0abb40 con 0x7f055c15d540 2024-01-31T05:04:46.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.283+0000 7f0562e00640 1 -- 172.21.15.49:0/345734037 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c15d540 msgr2=0x7f055c0cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:46.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.283+0000 7f0562e00640 1 --2- 172.21.15.49:0/345734037 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c15d540 0x7f055c0cff70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f054c0097c0 tx=0x7f054c01c450 comp rx=0 tx=0).stop 2024-01-31T05:04:46.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.283+0000 7f0562e00640 1 -- 172.21.15.49:0/345734037 shutdown_connections 2024-01-31T05:04:46.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.283+0000 7f0562e00640 1 --2- 172.21.15.49:0/345734037 >> v2:172.21.15.195:3300/0 conn(0x7f055c0cbbc0 0x7f055c15d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.283+0000 7f0562e00640 1 --2- 172.21.15.49:0/345734037 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c15d540 0x7f055c0cff70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.283+0000 7f0562e00640 1 -- 172.21.15.49:0/345734037 >> 172.21.15.49:0/345734037 conn(0x7f055c0d0e60 msgr2=0x7f055c0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:46.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.283+0000 7f0562e00640 1 -- 172.21.15.49:0/345734037 shutdown_connections 2024-01-31T05:04:46.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.283+0000 7f0562e00640 1 -- 172.21.15.49:0/345734037 wait complete. 2024-01-31T05:04:46.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f0562e00640 1 Processor -- start 2024-01-31T05:04:46.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f0562e00640 1 -- start start 2024-01-31T05:04:46.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f0562e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f055c06c290 0x7f055c159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:46.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f0562e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c0cbbc0 0x7f055c15b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:46.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f0562e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c15d540 0x7f055c0b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:46.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f0562e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1590f0 con 0x7f055c06c290 2024-01-31T05:04:46.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f0562e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c150330 con 0x7f055c0cbbc0 2024-01-31T05:04:46.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f0562e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c0b4580 con 0x7f055c15d540 2024-01-31T05:04:46.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f055be00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f055c06c290 0x7f055c159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:46.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f055be00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f055c06c290 0x7f055c159960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38782/0 (socket says 172.21.15.49:38782) 2024-01-31T05:04:46.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f055be00640 1 -- 172.21.15.49:0/4053466886 learned_addr learned my addr 172.21.15.49:0/4053466886 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:46.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f0560e00640 1 --2- 172.21.15.49:0/4053466886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c15d540 0x7f055c0b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:46.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f055b400640 1 --2- 172.21.15.49:0/4053466886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c0cbbc0 0x7f055c15b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:46.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f055be00640 1 -- 172.21.15.49:0/4053466886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c15d540 msgr2=0x7f055c0b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:46.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f055be00640 1 --2- 172.21.15.49:0/4053466886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c15d540 0x7f055c0b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f055be00640 1 -- 172.21.15.49:0/4053466886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c0cbbc0 msgr2=0x7f055c15b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:46.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f055be00640 1 --2- 172.21.15.49:0/4053466886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c0cbbc0 0x7f055c15b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f055be00640 1 -- 172.21.15.49:0/4053466886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c009420 con 0x7f055c06c290 2024-01-31T05:04:46.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f055be00640 1 --2- 172.21.15.49:0/4053466886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f055c06c290 0x7f055c159960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f054c0ad040 tx=0x7f054c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:46.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.287+0000 7f0553e00640 1 -- 172.21.15.49:0/4053466886 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c0bf610 con 0x7f055c06c290 2024-01-31T05:04:46.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.291+0000 7f0553e00640 1 -- 172.21.15.49:0/4053466886 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c0bf770 con 0x7f055c06c290 2024-01-31T05:04:46.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.291+0000 7f0553e00640 1 -- 172.21.15.49:0/4053466886 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c0bfb20 con 0x7f055c06c290 2024-01-31T05:04:46.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.291+0000 7f0562e00640 1 -- 172.21.15.49:0/4053466886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c158e10 con 0x7f055c06c290 2024-01-31T05:04:46.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.291+0000 7f0562e00640 1 -- 172.21.15.49:0/4053466886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055c0b4b00 con 0x7f055c06c290 2024-01-31T05:04:46.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.291+0000 7f0562e00640 1 -- 172.21.15.49:0/4053466886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055c0ce880 con 0x7f055c06c290 2024-01-31T05:04:46.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.291+0000 7f0553e00640 1 -- 172.21.15.49:0/4053466886 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f054c0b5400 con 0x7f055c06c290 2024-01-31T05:04:46.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.291+0000 7f0553e00640 1 --2- 172.21.15.49:0/4053466886 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0534066500 0x7f05340689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:46.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.291+0000 7f0553e00640 1 -- 172.21.15.49:0/4053466886 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f054c11edd0 con 0x7f055c06c290 2024-01-31T05:04:46.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.291+0000 7f055b400640 1 --2- 172.21.15.49:0/4053466886 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0534066500 0x7f05340689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:46.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.295+0000 7f055b400640 1 --2- 172.21.15.49:0/4053466886 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0534066500 0x7f05340689c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f055c070180 tx=0x7f0544007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:46.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.295+0000 7f0553e00640 1 -- 172.21.15.49:0/4053466886 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f054c0ebd90 con 0x7f055c06c290 2024-01-31T05:04:46.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.455+0000 7f0562e00640 1 -- 172.21.15.49:0/4053466886 --> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f055c15e670 con 0x7f0534066500 2024-01-31T05:04:46.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.463+0000 7f0553e00640 1 -- 172.21.15.49:0/4053466886 <== mgr.4100 v2:172.21.15.195:6832/3035808172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345281 (secure 0 0 0) 0x7f05440071f0 con 0x7f0534066500 2024-01-31T05:04:46.470 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:46.472 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-31T05:04:46.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.467+0000 7f0562e00640 1 -- 172.21.15.49:0/4053466886 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0534066500 msgr2=0x7f05340689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:46.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.467+0000 7f0562e00640 1 --2- 172.21.15.49:0/4053466886 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0534066500 0x7f05340689c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f055c070180 tx=0x7f0544007b60 comp rx=0 tx=0).stop 2024-01-31T05:04:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.467+0000 7f0562e00640 1 -- 172.21.15.49:0/4053466886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f055c06c290 msgr2=0x7f055c159960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.467+0000 7f0562e00640 1 --2- 172.21.15.49:0/4053466886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f055c06c290 0x7f055c159960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f054c0ad040 tx=0x7f054c01ac90 comp rx=0 tx=0).stop 2024-01-31T05:04:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.467+0000 7f0562e00640 1 -- 172.21.15.49:0/4053466886 shutdown_connections 2024-01-31T05:04:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.467+0000 7f0562e00640 1 --2- 172.21.15.49:0/4053466886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f055c15d540 0x7f055c0b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.467+0000 7f0562e00640 1 --2- 172.21.15.49:0/4053466886 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0534066500 0x7f05340689c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.467+0000 7f0562e00640 1 --2- 172.21.15.49:0/4053466886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c0cbbc0 0x7f055c15b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.467+0000 7f0562e00640 1 --2- 172.21.15.49:0/4053466886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f055c06c290 0x7f055c159960 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.467+0000 7f0562e00640 1 -- 172.21.15.49:0/4053466886 >> 172.21.15.49:0/4053466886 conn(0x7f055c0d0e60 msgr2=0x7f055c0cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:46.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.467+0000 7f0562e00640 1 -- 172.21.15.49:0/4053466886 shutdown_connections 2024-01-31T05:04:46.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.467+0000 7f0562e00640 1 -- 172.21.15.49:0/4053466886 wait complete. 2024-01-31T05:04:46.491 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-01-31T05:04:46.427070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252676,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722044,"statfs":{"total":773094113280,"available":772835373056,"internally_reserved":0,"allocated":3284992,"data_stored":1988350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003542"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581219+0000","last_change":"2024-01-31T05:04:15.868245+0000","last_active":"2024-01-31T05:04:21.581219+0000","last_peered":"2024-01-31T05:04:21.581219+0000","last_clean":"2024-01-31T05:04:21.581219+0000","last_became_active":"2024-01-31T05:04:15.864318+0000","last_became_peered":"2024-01-31T05:04:15.864318+0000","last_unstale":"2024-01-31T05:04:21.581219+0000","last_undegraded":"2024-01-31T05:04:21.581219+0000","last_fullsized":"2024-01-31T05:04:21.581219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:27:44.760988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267122+0000","last_change":"2024-01-31T05:04:16.288950+0000","last_active":"2024-01-31T05:04:21.267122+0000","last_peered":"2024-01-31T05:04:21.267122+0000","last_clean":"2024-01-31T05:04:21.267122+0000","last_became_active":"2024-01-31T05:04:16.288679+0000","last_became_peered":"2024-01-31T05:04:16.288679+0000","last_unstale":"2024-01-31T05:04:21.267122+0000","last_undegraded":"2024-01-31T05:04:21.267122+0000","last_fullsized":"2024-01-31T05:04:21.267122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:10:07.431961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266325+0000","last_change":"2024-01-31T05:04:20.413702+0000","last_active":"2024-01-31T05:04:21.266325+0000","last_peered":"2024-01-31T05:04:21.266325+0000","last_clean":"2024-01-31T05:04:21.266325+0000","last_became_active":"2024-01-31T05:04:20.413348+0000","last_became_peered":"2024-01-31T05:04:20.413348+0000","last_unstale":"2024-01-31T05:04:21.266325+0000","last_undegraded":"2024-01-31T05:04:21.266325+0000","last_fullsized":"2024-01-31T05:04:21.266325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:58:24.669260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267427+0000","last_change":"2024-01-31T05:04:15.865431+0000","last_active":"2024-01-31T05:04:21.267427+0000","last_peered":"2024-01-31T05:04:21.267427+0000","last_clean":"2024-01-31T05:04:21.267427+0000","last_became_active":"2024-01-31T05:04:15.863143+0000","last_became_peered":"2024-01-31T05:04:15.863143+0000","last_unstale":"2024-01-31T05:04:21.267427+0000","last_undegraded":"2024-01-31T05:04:21.267427+0000","last_fullsized":"2024-01-31T05:04:21.267427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:27:44.760988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580949+0000","last_change":"2024-01-31T05:04:16.295890+0000","last_active":"2024-01-31T05:04:21.580949+0000","last_peered":"2024-01-31T05:04:21.580949+0000","last_clean":"2024-01-31T05:04:21.580949+0000","last_became_active":"2024-01-31T05:04:16.295666+0000","last_became_peered":"2024-01-31T05:04:16.295666+0000","last_unstale":"2024-01-31T05:04:21.580949+0000","last_undegraded":"2024-01-31T05:04:21.580949+0000","last_fullsized":"2024-01-31T05:04:21.580949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266605+0000","last_change":"2024-01-31T05:04:20.314420+0000","last_active":"2024-01-31T05:04:21.266605+0000","last_peered":"2024-01-31T05:04:21.266605+0000","last_clean":"2024-01-31T05:04:21.266605+0000","last_became_active":"2024-01-31T05:04:20.314026+0000","last_became_peered":"2024-01-31T05:04:20.314026+0000","last_unstale":"2024-01-31T05:04:21.266605+0000","last_undegraded":"2024-01-31T05:04:21.266605+0000","last_fullsized":"2024-01-31T05:04:21.266605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:25.928105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.582056+0000","last_change":"2024-01-31T05:04:15.872667+0000","last_active":"2024-01-31T05:04:21.582056+0000","last_peered":"2024-01-31T05:04:21.582056+0000","last_clean":"2024-01-31T05:04:21.582056+0000","last_became_active":"2024-01-31T05:04:15.872184+0000","last_became_peered":"2024-01-31T05:04:15.872184+0000","last_unstale":"2024-01-31T05:04:21.582056+0000","last_undegraded":"2024-01-31T05:04:21.582056+0000","last_fullsized":"2024-01-31T05:04:21.582056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:15.850243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579858+0000","last_change":"2024-01-31T05:04:16.291560+0000","last_active":"2024-01-31T05:04:21.579858+0000","last_peered":"2024-01-31T05:04:21.579858+0000","last_clean":"2024-01-31T05:04:21.579858+0000","last_became_active":"2024-01-31T05:04:16.291315+0000","last_became_peered":"2024-01-31T05:04:16.291315+0000","last_unstale":"2024-01-31T05:04:21.579858+0000","last_undegraded":"2024-01-31T05:04:21.579858+0000","last_fullsized":"2024-01-31T05:04:21.579858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:29:14.662909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266987+0000","last_change":"2024-01-31T05:04:20.302441+0000","last_active":"2024-01-31T05:04:21.266987+0000","last_peered":"2024-01-31T05:04:21.266987+0000","last_clean":"2024-01-31T05:04:21.266987+0000","last_became_active":"2024-01-31T05:04:20.302037+0000","last_became_peered":"2024-01-31T05:04:20.302037+0000","last_unstale":"2024-01-31T05:04:21.266987+0000","last_undegraded":"2024-01-31T05:04:21.266987+0000","last_fullsized":"2024-01-31T05:04:21.266987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:10:10.869523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581271+0000","last_change":"2024-01-31T05:04:15.866007+0000","last_active":"2024-01-31T05:04:21.581271+0000","last_peered":"2024-01-31T05:04:21.581271+0000","last_clean":"2024-01-31T05:04:21.581271+0000","last_became_active":"2024-01-31T05:04:15.865702+0000","last_became_peered":"2024-01-31T05:04:15.865702+0000","last_unstale":"2024-01-31T05:04:21.581271+0000","last_undegraded":"2024-01-31T05:04:21.581271+0000","last_fullsized":"2024-01-31T05:04:21.581271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:24:55.108827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580173+0000","last_change":"2024-01-31T05:04:16.295973+0000","last_active":"2024-01-31T05:04:21.580173+0000","last_peered":"2024-01-31T05:04:21.580173+0000","last_clean":"2024-01-31T05:04:21.580173+0000","last_became_active":"2024-01-31T05:04:16.294920+0000","last_became_peered":"2024-01-31T05:04:16.294920+0000","last_unstale":"2024-01-31T05:04:21.580173+0000","last_undegraded":"2024-01-31T05:04:21.580173+0000","last_fullsized":"2024-01-31T05:04:21.580173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:47.781626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266874+0000","last_change":"2024-01-31T05:04:20.306343+0000","last_active":"2024-01-31T05:04:21.266874+0000","last_peered":"2024-01-31T05:04:21.266874+0000","last_clean":"2024-01-31T05:04:21.266874+0000","last_became_active":"2024-01-31T05:04:20.305678+0000","last_became_peered":"2024-01-31T05:04:20.305678+0000","last_unstale":"2024-01-31T05:04:21.266874+0000","last_undegraded":"2024-01-31T05:04:21.266874+0000","last_fullsized":"2024-01-31T05:04:21.266874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:23.877718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580317+0000","last_change":"2024-01-31T05:04:16.292709+0000","last_active":"2024-01-31T05:04:21.580317+0000","last_peered":"2024-01-31T05:04:21.580317+0000","last_clean":"2024-01-31T05:04:21.580317+0000","last_became_active":"2024-01-31T05:04:16.292447+0000","last_became_peered":"2024-01-31T05:04:16.292447+0000","last_unstale":"2024-01-31T05:04:21.580317+0000","last_undegraded":"2024-01-31T05:04:21.580317+0000","last_fullsized":"2024-01-31T05:04:21.580317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:36.794548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581839+0000","last_change":"2024-01-31T05:04:15.864066+0000","last_active":"2024-01-31T05:04:21.581839+0000","last_peered":"2024-01-31T05:04:21.581839+0000","last_clean":"2024-01-31T05:04:21.581839+0000","last_became_active":"2024-01-31T05:04:15.863757+0000","last_became_peered":"2024-01-31T05:04:15.863757+0000","last_unstale":"2024-01-31T05:04:21.581839+0000","last_undegraded":"2024-01-31T05:04:21.581839+0000","last_fullsized":"2024-01-31T05:04:21.581839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:16:26.364453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267538+0000","last_change":"2024-01-31T05:04:20.306016+0000","last_active":"2024-01-31T05:04:21.267538+0000","last_peered":"2024-01-31T05:04:21.267538+0000","last_clean":"2024-01-31T05:04:21.267538+0000","last_became_active":"2024-01-31T05:04:20.305523+0000","last_became_peered":"2024-01-31T05:04:20.305523+0000","last_unstale":"2024-01-31T05:04:21.267538+0000","last_undegraded":"2024-01-31T05:04:21.267538+0000","last_fullsized":"2024-01-31T05:04:21.267538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:44.473185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266570+0000","last_change":"2024-01-31T05:04:16.284277+0000","last_active":"2024-01-31T05:04:21.266570+0000","last_peered":"2024-01-31T05:04:21.266570+0000","last_clean":"2024-01-31T05:04:21.266570+0000","last_became_active":"2024-01-31T05:04:16.283861+0000","last_became_peered":"2024-01-31T05:04:16.283861+0000","last_unstale":"2024-01-31T05:04:21.266570+0000","last_undegraded":"2024-01-31T05:04:21.266570+0000","last_fullsized":"2024-01-31T05:04:21.266570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:59:17.499417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580029+0000","last_change":"2024-01-31T05:04:15.866369+0000","last_active":"2024-01-31T05:04:21.580029+0000","last_peered":"2024-01-31T05:04:21.580029+0000","last_clean":"2024-01-31T05:04:21.580029+0000","last_became_active":"2024-01-31T05:04:15.865958+0000","last_became_peered":"2024-01-31T05:04:15.865958+0000","last_unstale":"2024-01-31T05:04:21.580029+0000","last_undegraded":"2024-01-31T05:04:21.580029+0000","last_fullsized":"2024-01-31T05:04:21.580029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:24:55.108827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267344+0000","last_change":"2024-01-31T05:04:20.306127+0000","last_active":"2024-01-31T05:04:21.267344+0000","last_peered":"2024-01-31T05:04:21.267344+0000","last_clean":"2024-01-31T05:04:21.267344+0000","last_became_active":"2024-01-31T05:04:20.305397+0000","last_became_peered":"2024-01-31T05:04:20.305397+0000","last_unstale":"2024-01-31T05:04:21.267344+0000","last_undegraded":"2024-01-31T05:04:21.267344+0000","last_fullsized":"2024-01-31T05:04:21.267344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:20:14.179731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266407+0000","last_change":"2024-01-31T05:04:16.278338+0000","last_active":"2024-01-31T05:04:21.266407+0000","last_peered":"2024-01-31T05:04:21.266407+0000","last_clean":"2024-01-31T05:04:21.266407+0000","last_became_active":"2024-01-31T05:04:16.277709+0000","last_became_peered":"2024-01-31T05:04:16.277709+0000","last_unstale":"2024-01-31T05:04:21.266407+0000","last_undegraded":"2024-01-31T05:04:21.266407+0000","last_fullsized":"2024-01-31T05:04:21.266407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:38.399003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579843+0000","last_change":"2024-01-31T05:04:15.866645+0000","last_active":"2024-01-31T05:04:21.579843+0000","last_peered":"2024-01-31T05:04:21.579843+0000","last_clean":"2024-01-31T05:04:21.579843+0000","last_became_active":"2024-01-31T05:04:15.866293+0000","last_became_peered":"2024-01-31T05:04:15.866293+0000","last_unstale":"2024-01-31T05:04:21.579843+0000","last_undegraded":"2024-01-31T05:04:21.579843+0000","last_fullsized":"2024-01-31T05:04:21.579843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:16:26.364453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581344+0000","last_change":"2024-01-31T05:04:20.411913+0000","last_active":"2024-01-31T05:04:21.581344+0000","last_peered":"2024-01-31T05:04:21.581344+0000","last_clean":"2024-01-31T05:04:21.581344+0000","last_became_active":"2024-01-31T05:04:20.411469+0000","last_became_peered":"2024-01-31T05:04:20.411469+0000","last_unstale":"2024-01-31T05:04:21.581344+0000","last_undegraded":"2024-01-31T05:04:21.581344+0000","last_fullsized":"2024-01-31T05:04:21.581344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:45.735003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267040+0000","last_change":"2024-01-31T05:04:16.274299+0000","last_active":"2024-01-31T05:04:21.267040+0000","last_peered":"2024-01-31T05:04:21.267040+0000","last_clean":"2024-01-31T05:04:21.267040+0000","last_became_active":"2024-01-31T05:04:16.273410+0000","last_became_peered":"2024-01-31T05:04:16.273410+0000","last_unstale":"2024-01-31T05:04:21.267040+0000","last_undegraded":"2024-01-31T05:04:21.267040+0000","last_fullsized":"2024-01-31T05:04:21.267040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:34.994793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581098+0000","last_change":"2024-01-31T05:04:15.862190+0000","last_active":"2024-01-31T05:04:21.581098+0000","last_peered":"2024-01-31T05:04:21.581098+0000","last_clean":"2024-01-31T05:04:21.581098+0000","last_became_active":"2024-01-31T05:04:15.861894+0000","last_became_peered":"2024-01-31T05:04:15.861894+0000","last_unstale":"2024-01-31T05:04:21.581098+0000","last_undegraded":"2024-01-31T05:04:21.581098+0000","last_fullsized":"2024-01-31T05:04:21.581098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:33.988440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267462+0000","last_change":"2024-01-31T05:04:20.302070+0000","last_active":"2024-01-31T05:04:21.267462+0000","last_peered":"2024-01-31T05:04:21.267462+0000","last_clean":"2024-01-31T05:04:21.267462+0000","last_became_active":"2024-01-31T05:04:20.301514+0000","last_became_peered":"2024-01-31T05:04:20.301514+0000","last_unstale":"2024-01-31T05:04:21.267462+0000","last_undegraded":"2024-01-31T05:04:21.267462+0000","last_fullsized":"2024-01-31T05:04:21.267462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:51.219189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581061+0000","last_change":"2024-01-31T05:04:16.277874+0000","last_active":"2024-01-31T05:04:21.581061+0000","last_peered":"2024-01-31T05:04:21.581061+0000","last_clean":"2024-01-31T05:04:21.581061+0000","last_became_active":"2024-01-31T05:04:16.277627+0000","last_became_peered":"2024-01-31T05:04:16.277627+0000","last_unstale":"2024-01-31T05:04:21.581061+0000","last_undegraded":"2024-01-31T05:04:21.581061+0000","last_fullsized":"2024-01-31T05:04:21.581061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:38.399003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581821+0000","last_change":"2024-01-31T05:04:15.867994+0000","last_active":"2024-01-31T05:04:21.581821+0000","last_peered":"2024-01-31T05:04:21.581821+0000","last_clean":"2024-01-31T05:04:21.581821+0000","last_became_active":"2024-01-31T05:04:15.866731+0000","last_became_peered":"2024-01-31T05:04:15.866731+0000","last_unstale":"2024-01-31T05:04:21.581821+0000","last_undegraded":"2024-01-31T05:04:21.581821+0000","last_fullsized":"2024-01-31T05:04:21.581821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:12:26.990588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266940+0000","last_change":"2024-01-31T05:04:20.410734+0000","last_active":"2024-01-31T05:04:21.266940+0000","last_peered":"2024-01-31T05:04:21.266940+0000","last_clean":"2024-01-31T05:04:21.266940+0000","last_became_active":"2024-01-31T05:04:20.410368+0000","last_became_peered":"2024-01-31T05:04:20.410368+0000","last_unstale":"2024-01-31T05:04:21.266940+0000","last_undegraded":"2024-01-31T05:04:21.266940+0000","last_fullsized":"2024-01-31T05:04:21.266940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:29:18.100472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.268005+0000","last_change":"2024-01-31T05:04:16.283103+0000","last_active":"2024-01-31T05:04:21.268005+0000","last_peered":"2024-01-31T05:04:21.268005+0000","last_clean":"2024-01-31T05:04:21.268005+0000","last_became_active":"2024-01-31T05:04:16.282869+0000","last_became_peered":"2024-01-31T05:04:16.282869+0000","last_unstale":"2024-01-31T05:04:21.268005+0000","last_undegraded":"2024-01-31T05:04:21.268005+0000","last_fullsized":"2024-01-31T05:04:21.268005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:20.440155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581016+0000","last_change":"2024-01-31T05:04:15.872874+0000","last_active":"2024-01-31T05:04:21.581016+0000","last_peered":"2024-01-31T05:04:21.581016+0000","last_clean":"2024-01-31T05:04:21.581016+0000","last_became_active":"2024-01-31T05:04:15.872478+0000","last_became_peered":"2024-01-31T05:04:15.872478+0000","last_unstale":"2024-01-31T05:04:21.581016+0000","last_undegraded":"2024-01-31T05:04:21.581016+0000","last_fullsized":"2024-01-31T05:04:21.581016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:12:26.990588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266215+0000","last_change":"2024-01-31T05:04:20.409515+0000","last_active":"2024-01-31T05:04:21.266215+0000","last_peered":"2024-01-31T05:04:21.266215+0000","last_clean":"2024-01-31T05:04:21.266215+0000","last_became_active":"2024-01-31T05:04:20.409104+0000","last_became_peered":"2024-01-31T05:04:20.409104+0000","last_unstale":"2024-01-31T05:04:21.266215+0000","last_undegraded":"2024-01-31T05:04:21.266215+0000","last_fullsized":"2024-01-31T05:04:21.266215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:26:03.624550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580349+0000","last_change":"2024-01-31T05:04:16.276727+0000","last_active":"2024-01-31T05:04:21.580349+0000","last_peered":"2024-01-31T05:04:21.580349+0000","last_clean":"2024-01-31T05:04:21.580349+0000","last_became_active":"2024-01-31T05:04:16.276429+0000","last_became_peered":"2024-01-31T05:04:16.276429+0000","last_unstale":"2024-01-31T05:04:21.580349+0000","last_undegraded":"2024-01-31T05:04:21.580349+0000","last_fullsized":"2024-01-31T05:04:21.580349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.582205+0000","last_change":"2024-01-31T05:04:15.872449+0000","last_active":"2024-01-31T05:04:21.582205+0000","last_peered":"2024-01-31T05:04:21.582205+0000","last_clean":"2024-01-31T05:04:21.582205+0000","last_became_active":"2024-01-31T05:04:15.871832+0000","last_became_peered":"2024-01-31T05:04:15.871832+0000","last_unstale":"2024-01-31T05:04:21.582205+0000","last_undegraded":"2024-01-31T05:04:21.582205+0000","last_fullsized":"2024-01-31T05:04:21.582205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:18:30.350723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579984+0000","last_change":"2024-01-31T05:04:20.410664+0000","last_active":"2024-01-31T05:04:21.579984+0000","last_peered":"2024-01-31T05:04:21.579984+0000","last_clean":"2024-01-31T05:04:21.579984+0000","last_became_active":"2024-01-31T05:04:20.409595+0000","last_became_peered":"2024-01-31T05:04:20.409595+0000","last_unstale":"2024-01-31T05:04:21.579984+0000","last_undegraded":"2024-01-31T05:04:21.579984+0000","last_fullsized":"2024-01-31T05:04:21.579984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:51.219189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580268+0000","last_change":"2024-01-31T05:04:16.299267+0000","last_active":"2024-01-31T05:04:21.580268+0000","last_peered":"2024-01-31T05:04:21.580268+0000","last_clean":"2024-01-31T05:04:21.580268+0000","last_became_active":"2024-01-31T05:04:16.298919+0000","last_became_peered":"2024-01-31T05:04:16.298919+0000","last_unstale":"2024-01-31T05:04:21.580268+0000","last_undegraded":"2024-01-31T05:04:21.580268+0000","last_fullsized":"2024-01-31T05:04:21.580268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:41.035623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580402+0000","last_change":"2024-01-31T05:04:15.863096+0000","last_active":"2024-01-31T05:04:21.580402+0000","last_peered":"2024-01-31T05:04:21.580402+0000","last_clean":"2024-01-31T05:04:21.580402+0000","last_became_active":"2024-01-31T05:04:15.862799+0000","last_became_peered":"2024-01-31T05:04:15.862799+0000","last_unstale":"2024-01-31T05:04:21.580402+0000","last_undegraded":"2024-01-31T05:04:21.580402+0000","last_fullsized":"2024-01-31T05:04:21.580402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:33.988440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579915+0000","last_change":"2024-01-31T05:04:20.318591+0000","last_active":"2024-01-31T05:04:21.579915+0000","last_peered":"2024-01-31T05:04:21.579915+0000","last_clean":"2024-01-31T05:04:21.579915+0000","last_became_active":"2024-01-31T05:04:20.314906+0000","last_became_peered":"2024-01-31T05:04:20.314906+0000","last_unstale":"2024-01-31T05:04:21.579915+0000","last_undegraded":"2024-01-31T05:04:21.579915+0000","last_fullsized":"2024-01-31T05:04:21.579915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:51.219189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267338+0000","last_change":"2024-01-31T05:04:16.284119+0000","last_active":"2024-01-31T05:04:21.267338+0000","last_peered":"2024-01-31T05:04:21.267338+0000","last_clean":"2024-01-31T05:04:21.267338+0000","last_became_active":"2024-01-31T05:04:16.277112+0000","last_became_peered":"2024-01-31T05:04:16.277112+0000","last_unstale":"2024-01-31T05:04:21.267338+0000","last_undegraded":"2024-01-31T05:04:21.267338+0000","last_fullsized":"2024-01-31T05:04:21.267338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:12.324478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579785+0000","last_change":"2024-01-31T05:04:15.862604+0000","last_active":"2024-01-31T05:04:21.579785+0000","last_peered":"2024-01-31T05:04:21.579785+0000","last_clean":"2024-01-31T05:04:21.579785+0000","last_became_active":"2024-01-31T05:04:15.862119+0000","last_became_peered":"2024-01-31T05:04:15.862119+0000","last_unstale":"2024-01-31T05:04:21.579785+0000","last_undegraded":"2024-01-31T05:04:21.579785+0000","last_fullsized":"2024-01-31T05:04:21.579785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:15.850243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580443+0000","last_change":"2024-01-31T05:04:20.319285+0000","last_active":"2024-01-31T05:04:21.580443+0000","last_peered":"2024-01-31T05:04:21.580443+0000","last_clean":"2024-01-31T05:04:21.580443+0000","last_became_active":"2024-01-31T05:04:20.318678+0000","last_became_peered":"2024-01-31T05:04:20.318678+0000","last_unstale":"2024-01-31T05:04:21.580443+0000","last_undegraded":"2024-01-31T05:04:21.580443+0000","last_fullsized":"2024-01-31T05:04:21.580443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:52:04.324494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579922+0000","last_change":"2024-01-31T05:04:16.277245+0000","last_active":"2024-01-31T05:04:21.579922+0000","last_peered":"2024-01-31T05:04:21.579922+0000","last_clean":"2024-01-31T05:04:21.579922+0000","last_became_active":"2024-01-31T05:04:16.276969+0000","last_became_peered":"2024-01-31T05:04:16.276969+0000","last_unstale":"2024-01-31T05:04:21.579922+0000","last_undegraded":"2024-01-31T05:04:21.579922+0000","last_fullsized":"2024-01-31T05:04:21.579922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:05:32.076479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267230+0000","last_change":"2024-01-31T05:04:15.868758+0000","last_active":"2024-01-31T05:04:21.267230+0000","last_peered":"2024-01-31T05:04:21.267230+0000","last_clean":"2024-01-31T05:04:21.267230+0000","last_became_active":"2024-01-31T05:04:15.868431+0000","last_became_peered":"2024-01-31T05:04:15.868431+0000","last_unstale":"2024-01-31T05:04:21.267230+0000","last_undegraded":"2024-01-31T05:04:21.267230+0000","last_fullsized":"2024-01-31T05:04:21.267230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:38:14.126192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581401+0000","last_change":"2024-01-31T05:04:20.314828+0000","last_active":"2024-01-31T05:04:21.581401+0000","last_peered":"2024-01-31T05:04:21.581401+0000","last_clean":"2024-01-31T05:04:21.581401+0000","last_became_active":"2024-01-31T05:04:20.314407+0000","last_became_peered":"2024-01-31T05:04:20.314407+0000","last_unstale":"2024-01-31T05:04:21.581401+0000","last_undegraded":"2024-01-31T05:04:21.581401+0000","last_fullsized":"2024-01-31T05:04:21.581401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:42:14.408077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579808+0000","last_change":"2024-01-31T05:04:16.274865+0000","last_active":"2024-01-31T05:04:21.579808+0000","last_peered":"2024-01-31T05:04:21.579808+0000","last_clean":"2024-01-31T05:04:21.579808+0000","last_became_active":"2024-01-31T05:04:16.273448+0000","last_became_peered":"2024-01-31T05:04:16.273448+0000","last_unstale":"2024-01-31T05:04:21.579808+0000","last_undegraded":"2024-01-31T05:04:21.579808+0000","last_fullsized":"2024-01-31T05:04:21.579808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:28:15.218916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581205+0000","last_change":"2024-01-31T05:04:15.865828+0000","last_active":"2024-01-31T05:04:21.581205+0000","last_peered":"2024-01-31T05:04:21.581205+0000","last_clean":"2024-01-31T05:04:21.581205+0000","last_became_active":"2024-01-31T05:04:15.865556+0000","last_became_peered":"2024-01-31T05:04:15.865556+0000","last_unstale":"2024-01-31T05:04:21.581205+0000","last_undegraded":"2024-01-31T05:04:21.581205+0000","last_fullsized":"2024-01-31T05:04:21.581205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:11.318125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580994+0000","last_change":"2024-01-31T05:04:20.410795+0000","last_active":"2024-01-31T05:04:21.580994+0000","last_peered":"2024-01-31T05:04:21.580994+0000","last_clean":"2024-01-31T05:04:21.580994+0000","last_became_active":"2024-01-31T05:04:20.409164+0000","last_became_peered":"2024-01-31T05:04:20.409164+0000","last_unstale":"2024-01-31T05:04:21.580994+0000","last_undegraded":"2024-01-31T05:04:21.580994+0000","last_fullsized":"2024-01-31T05:04:21.580994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:42:14.408077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266618+0000","last_change":"2024-01-31T05:04:16.302810+0000","last_active":"2024-01-31T05:04:21.266618+0000","last_peered":"2024-01-31T05:04:21.266618+0000","last_clean":"2024-01-31T05:04:21.266618+0000","last_became_active":"2024-01-31T05:04:16.302580+0000","last_became_peered":"2024-01-31T05:04:16.302580+0000","last_unstale":"2024-01-31T05:04:21.266618+0000","last_undegraded":"2024-01-31T05:04:21.266618+0000","last_fullsized":"2024-01-31T05:04:21.266618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:05:32.076479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579670+0000","last_change":"2024-01-31T05:04:15.859340+0000","last_active":"2024-01-31T05:04:21.579670+0000","last_peered":"2024-01-31T05:04:21.579670+0000","last_clean":"2024-01-31T05:04:21.579670+0000","last_became_active":"2024-01-31T05:04:15.858887+0000","last_became_peered":"2024-01-31T05:04:15.858887+0000","last_unstale":"2024-01-31T05:04:21.579670+0000","last_undegraded":"2024-01-31T05:04:21.579670+0000","last_fullsized":"2024-01-31T05:04:21.579670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:11.318125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581256+0000","last_change":"2024-01-31T05:04:05.699222+0000","last_active":"2024-01-31T05:04:21.581256+0000","last_peered":"2024-01-31T05:04:21.581256+0000","last_clean":"2024-01-31T05:04:21.581256+0000","last_became_active":"2024-01-31T05:04:05.698239+0000","last_became_peered":"2024-01-31T05:04:05.698239+0000","last_unstale":"2024-01-31T05:04:21.581256+0000","last_undegraded":"2024-01-31T05:04:21.581256+0000","last_fullsized":"2024-01-31T05:04:21.581256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_clean_scrub_stamp":"2024-01-31T05:04:04.484734+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:05:13.736598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580928+0000","last_change":"2024-01-31T05:04:20.409212+0000","last_active":"2024-01-31T05:04:21.580928+0000","last_peered":"2024-01-31T05:04:21.580928+0000","last_clean":"2024-01-31T05:04:21.580928+0000","last_became_active":"2024-01-31T05:04:20.408741+0000","last_became_peered":"2024-01-31T05:04:20.408741+0000","last_unstale":"2024-01-31T05:04:21.580928+0000","last_undegraded":"2024-01-31T05:04:21.580928+0000","last_fullsized":"2024-01-31T05:04:21.580928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:20:14.179731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581967+0000","last_change":"2024-01-31T05:04:16.301754+0000","last_active":"2024-01-31T05:04:21.581967+0000","last_peered":"2024-01-31T05:04:21.581967+0000","last_clean":"2024-01-31T05:04:21.581967+0000","last_became_active":"2024-01-31T05:04:16.301449+0000","last_became_peered":"2024-01-31T05:04:16.301449+0000","last_unstale":"2024-01-31T05:04:21.581967+0000","last_undegraded":"2024-01-31T05:04:21.581967+0000","last_fullsized":"2024-01-31T05:04:21.581967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:47.781626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267625+0000","last_change":"2024-01-31T05:04:15.866001+0000","last_active":"2024-01-31T05:04:21.267625+0000","last_peered":"2024-01-31T05:04:21.267625+0000","last_clean":"2024-01-31T05:04:21.267625+0000","last_became_active":"2024-01-31T05:04:15.865731+0000","last_became_peered":"2024-01-31T05:04:15.865731+0000","last_unstale":"2024-01-31T05:04:21.267625+0000","last_undegraded":"2024-01-31T05:04:21.267625+0000","last_fullsized":"2024-01-31T05:04:21.267625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:53.760373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580399+0000","last_change":"2024-01-31T05:04:20.409951+0000","last_active":"2024-01-31T05:04:21.580399+0000","last_peered":"2024-01-31T05:04:21.580399+0000","last_clean":"2024-01-31T05:04:21.580399+0000","last_became_active":"2024-01-31T05:04:20.408740+0000","last_became_peered":"2024-01-31T05:04:20.408740+0000","last_unstale":"2024-01-31T05:04:21.580399+0000","last_undegraded":"2024-01-31T05:04:21.580399+0000","last_fullsized":"2024-01-31T05:04:21.580399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:17:35.221341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579952+0000","last_change":"2024-01-31T05:04:16.290253+0000","last_active":"2024-01-31T05:04:21.579952+0000","last_peered":"2024-01-31T05:04:21.579952+0000","last_clean":"2024-01-31T05:04:21.579952+0000","last_became_active":"2024-01-31T05:04:16.289838+0000","last_became_peered":"2024-01-31T05:04:16.289838+0000","last_unstale":"2024-01-31T05:04:21.579952+0000","last_undegraded":"2024-01-31T05:04:21.579952+0000","last_fullsized":"2024-01-31T05:04:21.579952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:20:10.742169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580789+0000","last_change":"2024-01-31T05:04:15.866801+0000","last_active":"2024-01-31T05:04:21.580789+0000","last_peered":"2024-01-31T05:04:21.580789+0000","last_clean":"2024-01-31T05:04:21.580789+0000","last_became_active":"2024-01-31T05:04:15.866478+0000","last_became_peered":"2024-01-31T05:04:15.866478+0000","last_unstale":"2024-01-31T05:04:21.580789+0000","last_undegraded":"2024-01-31T05:04:21.580789+0000","last_fullsized":"2024-01-31T05:04:21.580789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:11.318125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580174+0000","last_change":"2024-01-31T05:04:20.307543+0000","last_active":"2024-01-31T05:04:21.580174+0000","last_peered":"2024-01-31T05:04:21.580174+0000","last_clean":"2024-01-31T05:04:21.580174+0000","last_became_active":"2024-01-31T05:04:20.307124+0000","last_became_peered":"2024-01-31T05:04:20.307124+0000","last_unstale":"2024-01-31T05:04:21.580174+0000","last_undegraded":"2024-01-31T05:04:21.580174+0000","last_fullsized":"2024-01-31T05:04:21.580174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:44.473185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581703+0000","last_change":"2024-01-31T05:04:16.289496+0000","last_active":"2024-01-31T05:04:21.581703+0000","last_peered":"2024-01-31T05:04:21.581703+0000","last_clean":"2024-01-31T05:04:21.581703+0000","last_became_active":"2024-01-31T05:04:16.288932+0000","last_became_peered":"2024-01-31T05:04:16.288932+0000","last_unstale":"2024-01-31T05:04:21.581703+0000","last_undegraded":"2024-01-31T05:04:21.581703+0000","last_fullsized":"2024-01-31T05:04:21.581703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:26:00.186988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267853+0000","last_change":"2024-01-31T05:04:15.868950+0000","last_active":"2024-01-31T05:04:21.267853+0000","last_peered":"2024-01-31T05:04:21.267853+0000","last_clean":"2024-01-31T05:04:21.267853+0000","last_became_active":"2024-01-31T05:04:15.868416+0000","last_became_peered":"2024-01-31T05:04:15.868416+0000","last_unstale":"2024-01-31T05:04:21.267853+0000","last_undegraded":"2024-01-31T05:04:21.267853+0000","last_fullsized":"2024-01-31T05:04:21.267853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:12:26.990588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579270+0000","last_change":"2024-01-31T05:04:20.412399+0000","last_active":"2024-01-31T05:04:21.579270+0000","last_peered":"2024-01-31T05:04:21.579270+0000","last_clean":"2024-01-31T05:04:21.579270+0000","last_became_active":"2024-01-31T05:04:20.412174+0000","last_became_peered":"2024-01-31T05:04:20.412174+0000","last_unstale":"2024-01-31T05:04:21.579270+0000","last_undegraded":"2024-01-31T05:04:21.579270+0000","last_fullsized":"2024-01-31T05:04:21.579270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:50:26.572528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.582346+0000","last_change":"2024-01-31T05:04:16.291917+0000","last_active":"2024-01-31T05:04:21.582346+0000","last_peered":"2024-01-31T05:04:21.582346+0000","last_clean":"2024-01-31T05:04:21.582346+0000","last_became_active":"2024-01-31T05:04:16.291631+0000","last_became_peered":"2024-01-31T05:04:16.291631+0000","last_unstale":"2024-01-31T05:04:21.582346+0000","last_undegraded":"2024-01-31T05:04:21.582346+0000","last_fullsized":"2024-01-31T05:04:21.582346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:29:14.662909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267621+0000","last_change":"2024-01-31T05:04:15.860520+0000","last_active":"2024-01-31T05:04:21.267621+0000","last_peered":"2024-01-31T05:04:21.267621+0000","last_clean":"2024-01-31T05:04:21.267621+0000","last_became_active":"2024-01-31T05:04:15.860310+0000","last_became_peered":"2024-01-31T05:04:15.860310+0000","last_unstale":"2024-01-31T05:04:21.267621+0000","last_undegraded":"2024-01-31T05:04:21.267621+0000","last_fullsized":"2024-01-31T05:04:21.267621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:05:24.077981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266628+0000","last_change":"2024-01-31T05:04:20.303904+0000","last_active":"2024-01-31T05:04:21.266628+0000","last_peered":"2024-01-31T05:04:21.266628+0000","last_clean":"2024-01-31T05:04:21.266628+0000","last_became_active":"2024-01-31T05:04:20.302675+0000","last_became_peered":"2024-01-31T05:04:20.302675+0000","last_unstale":"2024-01-31T05:04:21.266628+0000","last_undegraded":"2024-01-31T05:04:21.266628+0000","last_fullsized":"2024-01-31T05:04:21.266628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:59:20.936979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581255+0000","last_change":"2024-01-31T05:04:16.293580+0000","last_active":"2024-01-31T05:04:21.581255+0000","last_peered":"2024-01-31T05:04:21.581255+0000","last_clean":"2024-01-31T05:04:21.581255+0000","last_became_active":"2024-01-31T05:04:16.289043+0000","last_became_peered":"2024-01-31T05:04:16.289043+0000","last_unstale":"2024-01-31T05:04:21.581255+0000","last_undegraded":"2024-01-31T05:04:21.581255+0000","last_fullsized":"2024-01-31T05:04:21.581255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:20.440155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266904+0000","last_change":"2024-01-31T05:04:15.858583+0000","last_active":"2024-01-31T05:04:21.266904+0000","last_peered":"2024-01-31T05:04:21.266904+0000","last_clean":"2024-01-31T05:04:21.266904+0000","last_became_active":"2024-01-31T05:04:15.858214+0000","last_became_peered":"2024-01-31T05:04:15.858214+0000","last_unstale":"2024-01-31T05:04:21.266904+0000","last_undegraded":"2024-01-31T05:04:21.266904+0000","last_fullsized":"2024-01-31T05:04:21.266904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:27:44.760988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580996+0000","last_change":"2024-01-31T05:04:20.305474+0000","last_active":"2024-01-31T05:04:21.580996+0000","last_peered":"2024-01-31T05:04:21.580996+0000","last_clean":"2024-01-31T05:04:21.580996+0000","last_became_active":"2024-01-31T05:04:20.304812+0000","last_became_peered":"2024-01-31T05:04:20.304812+0000","last_unstale":"2024-01-31T05:04:21.580996+0000","last_undegraded":"2024-01-31T05:04:21.580996+0000","last_fullsized":"2024-01-31T05:04:21.580996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:45.735003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580086+0000","last_change":"2024-01-31T05:04:16.281029+0000","last_active":"2024-01-31T05:04:21.580086+0000","last_peered":"2024-01-31T05:04:21.580086+0000","last_clean":"2024-01-31T05:04:21.580086+0000","last_became_active":"2024-01-31T05:04:16.280773+0000","last_became_peered":"2024-01-31T05:04:16.280773+0000","last_unstale":"2024-01-31T05:04:21.580086+0000","last_undegraded":"2024-01-31T05:04:21.580086+0000","last_fullsized":"2024-01-31T05:04:21.580086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:44:28.652707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580546+0000","last_change":"2024-01-31T05:04:15.873157+0000","last_active":"2024-01-31T05:04:21.580546+0000","last_peered":"2024-01-31T05:04:21.580546+0000","last_clean":"2024-01-31T05:04:21.580546+0000","last_became_active":"2024-01-31T05:04:15.872851+0000","last_became_peered":"2024-01-31T05:04:15.872851+0000","last_unstale":"2024-01-31T05:04:21.580546+0000","last_undegraded":"2024-01-31T05:04:21.580546+0000","last_fullsized":"2024-01-31T05:04:21.580546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:53.760373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267875+0000","last_change":"2024-01-31T05:04:20.414571+0000","last_active":"2024-01-31T05:04:21.267875+0000","last_peered":"2024-01-31T05:04:21.267875+0000","last_clean":"2024-01-31T05:04:21.267875+0000","last_became_active":"2024-01-31T05:04:20.413308+0000","last_became_peered":"2024-01-31T05:04:20.413308+0000","last_unstale":"2024-01-31T05:04:21.267875+0000","last_undegraded":"2024-01-31T05:04:21.267875+0000","last_fullsized":"2024-01-31T05:04:21.267875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:41:46.079832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581697+0000","last_change":"2024-01-31T05:04:16.289635+0000","last_active":"2024-01-31T05:04:21.581697+0000","last_peered":"2024-01-31T05:04:21.581697+0000","last_clean":"2024-01-31T05:04:21.581697+0000","last_became_active":"2024-01-31T05:04:16.289367+0000","last_became_peered":"2024-01-31T05:04:16.289367+0000","last_unstale":"2024-01-31T05:04:21.581697+0000","last_undegraded":"2024-01-31T05:04:21.581697+0000","last_fullsized":"2024-01-31T05:04:21.581697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:20:10.742169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579673+0000","last_change":"2024-01-31T05:04:15.867802+0000","last_active":"2024-01-31T05:04:21.579673+0000","last_peered":"2024-01-31T05:04:21.579673+0000","last_clean":"2024-01-31T05:04:21.579673+0000","last_became_active":"2024-01-31T05:04:15.867509+0000","last_became_peered":"2024-01-31T05:04:15.867509+0000","last_unstale":"2024-01-31T05:04:21.579673+0000","last_undegraded":"2024-01-31T05:04:21.579673+0000","last_fullsized":"2024-01-31T05:04:21.579673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:12:26.990588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267002+0000","last_change":"2024-01-31T05:04:20.410363+0000","last_active":"2024-01-31T05:04:21.267002+0000","last_peered":"2024-01-31T05:04:21.267002+0000","last_clean":"2024-01-31T05:04:21.267002+0000","last_became_active":"2024-01-31T05:04:20.409349+0000","last_became_peered":"2024-01-31T05:04:20.409349+0000","last_unstale":"2024-01-31T05:04:21.267002+0000","last_undegraded":"2024-01-31T05:04:21.267002+0000","last_fullsized":"2024-01-31T05:04:21.267002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:12:43.831584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580116+0000","last_change":"2024-01-31T05:04:16.279383+0000","last_active":"2024-01-31T05:04:21.580116+0000","last_peered":"2024-01-31T05:04:21.580116+0000","last_clean":"2024-01-31T05:04:21.580116+0000","last_became_active":"2024-01-31T05:04:16.278871+0000","last_became_peered":"2024-01-31T05:04:16.278871+0000","last_unstale":"2024-01-31T05:04:21.580116+0000","last_undegraded":"2024-01-31T05:04:21.580116+0000","last_fullsized":"2024-01-31T05:04:21.580116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:14:16.417240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580394+0000","last_change":"2024-01-31T05:04:15.860246+0000","last_active":"2024-01-31T05:04:21.580394+0000","last_peered":"2024-01-31T05:04:21.580394+0000","last_clean":"2024-01-31T05:04:21.580394+0000","last_became_active":"2024-01-31T05:04:15.860027+0000","last_became_peered":"2024-01-31T05:04:15.860027+0000","last_unstale":"2024-01-31T05:04:21.580394+0000","last_undegraded":"2024-01-31T05:04:21.580394+0000","last_fullsized":"2024-01-31T05:04:21.580394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:00:09.341930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580269+0000","last_change":"2024-01-31T05:04:20.414791+0000","last_active":"2024-01-31T05:04:21.580269+0000","last_peered":"2024-01-31T05:04:21.580269+0000","last_clean":"2024-01-31T05:04:21.580269+0000","last_became_active":"2024-01-31T05:04:20.414082+0000","last_became_peered":"2024-01-31T05:04:20.414082+0000","last_unstale":"2024-01-31T05:04:21.580269+0000","last_undegraded":"2024-01-31T05:04:21.580269+0000","last_fullsized":"2024-01-31T05:04:21.580269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:29:34.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581901+0000","last_change":"2024-01-31T05:04:16.288217+0000","last_active":"2024-01-31T05:04:21.581901+0000","last_peered":"2024-01-31T05:04:21.581901+0000","last_clean":"2024-01-31T05:04:21.581901+0000","last_became_active":"2024-01-31T05:04:16.287855+0000","last_became_peered":"2024-01-31T05:04:16.287855+0000","last_unstale":"2024-01-31T05:04:21.581901+0000","last_undegraded":"2024-01-31T05:04:21.581901+0000","last_fullsized":"2024-01-31T05:04:21.581901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:17:31.783779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:26.937176+0000","last_change":"2024-01-31T05:04:15.871503+0000","last_active":"2024-01-31T05:04:26.937176+0000","last_peered":"2024-01-31T05:04:26.937176+0000","last_clean":"2024-01-31T05:04:26.937176+0000","last_became_active":"2024-01-31T05:04:15.871207+0000","last_became_peered":"2024-01-31T05:04:15.871207+0000","last_unstale":"2024-01-31T05:04:26.937176+0000","last_undegraded":"2024-01-31T05:04:26.937176+0000","last_fullsized":"2024-01-31T05:04:26.937176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:07:45.743062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580076+0000","last_change":"2024-01-31T05:04:20.318951+0000","last_active":"2024-01-31T05:04:21.580076+0000","last_peered":"2024-01-31T05:04:21.580076+0000","last_clean":"2024-01-31T05:04:21.580076+0000","last_became_active":"2024-01-31T05:04:20.315434+0000","last_became_peered":"2024-01-31T05:04:20.315434+0000","last_unstale":"2024-01-31T05:04:21.580076+0000","last_undegraded":"2024-01-31T05:04:21.580076+0000","last_fullsized":"2024-01-31T05:04:21.580076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:44.473185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267446+0000","last_change":"2024-01-31T05:04:16.284047+0000","last_active":"2024-01-31T05:04:21.267446+0000","last_peered":"2024-01-31T05:04:21.267446+0000","last_clean":"2024-01-31T05:04:21.267446+0000","last_became_active":"2024-01-31T05:04:16.283455+0000","last_became_peered":"2024-01-31T05:04:16.283455+0000","last_unstale":"2024-01-31T05:04:21.267446+0000","last_undegraded":"2024-01-31T05:04:21.267446+0000","last_fullsized":"2024-01-31T05:04:21.267446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:24:56.115180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580681+0000","last_change":"2024-01-31T05:04:15.868251+0000","last_active":"2024-01-31T05:04:21.580681+0000","last_peered":"2024-01-31T05:04:21.580681+0000","last_clean":"2024-01-31T05:04:21.580681+0000","last_became_active":"2024-01-31T05:04:15.867924+0000","last_became_peered":"2024-01-31T05:04:15.867924+0000","last_unstale":"2024-01-31T05:04:21.580681+0000","last_undegraded":"2024-01-31T05:04:21.580681+0000","last_fullsized":"2024-01-31T05:04:21.580681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:07:45.743062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267249+0000","last_change":"2024-01-31T05:04:20.302123+0000","last_active":"2024-01-31T05:04:21.267249+0000","last_peered":"2024-01-31T05:04:21.267249+0000","last_clean":"2024-01-31T05:04:21.267249+0000","last_became_active":"2024-01-31T05:04:20.301865+0000","last_became_peered":"2024-01-31T05:04:20.301865+0000","last_unstale":"2024-01-31T05:04:21.267249+0000","last_undegraded":"2024-01-31T05:04:21.267249+0000","last_fullsized":"2024-01-31T05:04:21.267249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:17:35.221341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581093+0000","last_change":"2024-01-31T05:04:16.295806+0000","last_active":"2024-01-31T05:04:21.581093+0000","last_peered":"2024-01-31T05:04:21.581093+0000","last_clean":"2024-01-31T05:04:21.581093+0000","last_became_active":"2024-01-31T05:04:16.295553+0000","last_became_peered":"2024-01-31T05:04:16.295553+0000","last_unstale":"2024-01-31T05:04:21.581093+0000","last_undegraded":"2024-01-31T05:04:21.581093+0000","last_fullsized":"2024-01-31T05:04:21.581093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580840+0000","last_change":"2024-01-31T05:04:15.875006+0000","last_active":"2024-01-31T05:04:21.580840+0000","last_peered":"2024-01-31T05:04:21.580840+0000","last_clean":"2024-01-31T05:04:21.580840+0000","last_became_active":"2024-01-31T05:04:15.874743+0000","last_became_peered":"2024-01-31T05:04:15.874743+0000","last_unstale":"2024-01-31T05:04:21.580840+0000","last_undegraded":"2024-01-31T05:04:21.580840+0000","last_fullsized":"2024-01-31T05:04:21.580840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:37.392650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266837+0000","last_change":"2024-01-31T05:04:20.316263+0000","last_active":"2024-01-31T05:04:21.266837+0000","last_peered":"2024-01-31T05:04:21.266837+0000","last_clean":"2024-01-31T05:04:21.266837+0000","last_became_active":"2024-01-31T05:04:20.315752+0000","last_became_peered":"2024-01-31T05:04:20.315752+0000","last_unstale":"2024-01-31T05:04:21.266837+0000","last_undegraded":"2024-01-31T05:04:21.266837+0000","last_fullsized":"2024-01-31T05:04:21.266837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:29:34.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580744+0000","last_change":"2024-01-31T05:04:16.292783+0000","last_active":"2024-01-31T05:04:21.580744+0000","last_peered":"2024-01-31T05:04:21.580744+0000","last_clean":"2024-01-31T05:04:21.580744+0000","last_became_active":"2024-01-31T05:04:16.292520+0000","last_became_peered":"2024-01-31T05:04:16.292520+0000","last_unstale":"2024-01-31T05:04:21.580744+0000","last_undegraded":"2024-01-31T05:04:21.580744+0000","last_fullsized":"2024-01-31T05:04:21.580744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:52:00.886932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581728+0000","last_change":"2024-01-31T05:04:15.877472+0000","last_active":"2024-01-31T05:04:21.581728+0000","last_peered":"2024-01-31T05:04:21.581728+0000","last_clean":"2024-01-31T05:04:21.581728+0000","last_became_active":"2024-01-31T05:04:15.877195+0000","last_became_peered":"2024-01-31T05:04:15.877195+0000","last_unstale":"2024-01-31T05:04:21.581728+0000","last_undegraded":"2024-01-31T05:04:21.581728+0000","last_fullsized":"2024-01-31T05:04:21.581728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:38:14.126192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266508+0000","last_change":"2024-01-31T05:04:20.410602+0000","last_active":"2024-01-31T05:04:21.266508+0000","last_peered":"2024-01-31T05:04:21.266508+0000","last_clean":"2024-01-31T05:04:21.266508+0000","last_became_active":"2024-01-31T05:04:20.410214+0000","last_became_peered":"2024-01-31T05:04:20.410214+0000","last_unstale":"2024-01-31T05:04:21.266508+0000","last_undegraded":"2024-01-31T05:04:21.266508+0000","last_fullsized":"2024-01-31T05:04:21.266508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:50:26.572528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580777+0000","last_change":"2024-01-31T05:04:20.413035+0000","last_active":"2024-01-31T05:04:21.580777+0000","last_peered":"2024-01-31T05:04:21.580777+0000","last_clean":"2024-01-31T05:04:21.580777+0000","last_became_active":"2024-01-31T05:04:20.409657+0000","last_became_peered":"2024-01-31T05:04:20.409657+0000","last_unstale":"2024-01-31T05:04:21.580777+0000","last_undegraded":"2024-01-31T05:04:21.580777+0000","last_fullsized":"2024-01-31T05:04:21.580777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:52:04.324494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579651+0000","last_change":"2024-01-31T05:04:16.280492+0000","last_active":"2024-01-31T05:04:21.579651+0000","last_peered":"2024-01-31T05:04:21.579651+0000","last_clean":"2024-01-31T05:04:21.579651+0000","last_became_active":"2024-01-31T05:04:16.280274+0000","last_became_peered":"2024-01-31T05:04:16.280274+0000","last_unstale":"2024-01-31T05:04:21.579651+0000","last_undegraded":"2024-01-31T05:04:21.579651+0000","last_fullsized":"2024-01-31T05:04:21.579651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:32:44.394537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579405+0000","last_change":"2024-01-31T05:04:15.861706+0000","last_active":"2024-01-31T05:04:21.579405+0000","last_peered":"2024-01-31T05:04:21.579405+0000","last_clean":"2024-01-31T05:04:21.579405+0000","last_became_active":"2024-01-31T05:04:15.861143+0000","last_became_peered":"2024-01-31T05:04:15.861143+0000","last_unstale":"2024-01-31T05:04:21.579405+0000","last_undegraded":"2024-01-31T05:04:21.579405+0000","last_fullsized":"2024-01-31T05:04:21.579405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:53.760373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581668+0000","last_change":"2024-01-31T05:04:20.314757+0000","last_active":"2024-01-31T05:04:21.581668+0000","last_peered":"2024-01-31T05:04:21.581668+0000","last_clean":"2024-01-31T05:04:21.581668+0000","last_became_active":"2024-01-31T05:04:20.314255+0000","last_became_peered":"2024-01-31T05:04:20.314255+0000","last_unstale":"2024-01-31T05:04:21.581668+0000","last_undegraded":"2024-01-31T05:04:21.581668+0000","last_fullsized":"2024-01-31T05:04:21.581668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:52:51.219189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266310+0000","last_change":"2024-01-31T05:04:16.283281+0000","last_active":"2024-01-31T05:04:21.266310+0000","last_peered":"2024-01-31T05:04:21.266310+0000","last_clean":"2024-01-31T05:04:21.266310+0000","last_became_active":"2024-01-31T05:04:16.283067+0000","last_became_peered":"2024-01-31T05:04:16.283067+0000","last_unstale":"2024-01-31T05:04:21.266310+0000","last_undegraded":"2024-01-31T05:04:21.266310+0000","last_fullsized":"2024-01-31T05:04:21.266310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:32:44.394537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266680+0000","last_change":"2024-01-31T05:04:15.870556+0000","last_active":"2024-01-31T05:04:21.266680+0000","last_peered":"2024-01-31T05:04:21.266680+0000","last_clean":"2024-01-31T05:04:21.266680+0000","last_became_active":"2024-01-31T05:04:15.870204+0000","last_became_peered":"2024-01-31T05:04:15.870204+0000","last_unstale":"2024-01-31T05:04:21.266680+0000","last_undegraded":"2024-01-31T05:04:21.266680+0000","last_fullsized":"2024-01-31T05:04:21.266680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:53.760373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580467+0000","last_change":"2024-01-31T05:04:15.874785+0000","last_active":"2024-01-31T05:04:21.580467+0000","last_peered":"2024-01-31T05:04:21.580467+0000","last_clean":"2024-01-31T05:04:21.580467+0000","last_became_active":"2024-01-31T05:04:15.874174+0000","last_became_peered":"2024-01-31T05:04:15.874174+0000","last_unstale":"2024-01-31T05:04:21.580467+0000","last_undegraded":"2024-01-31T05:04:21.580467+0000","last_fullsized":"2024-01-31T05:04:21.580467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:11.318125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580306+0000","last_change":"2024-01-31T05:04:16.273656+0000","last_active":"2024-01-31T05:04:21.580306+0000","last_peered":"2024-01-31T05:04:21.580306+0000","last_clean":"2024-01-31T05:04:21.580306+0000","last_became_active":"2024-01-31T05:04:16.273182+0000","last_became_peered":"2024-01-31T05:04:16.273182+0000","last_unstale":"2024-01-31T05:04:21.580306+0000","last_undegraded":"2024-01-31T05:04:21.580306+0000","last_fullsized":"2024-01-31T05:04:21.580306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:32:44.394537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267586+0000","last_change":"2024-01-31T05:04:20.304766+0000","last_active":"2024-01-31T05:04:21.267586+0000","last_peered":"2024-01-31T05:04:21.267586+0000","last_clean":"2024-01-31T05:04:21.267586+0000","last_became_active":"2024-01-31T05:04:20.302194+0000","last_became_peered":"2024-01-31T05:04:20.302194+0000","last_unstale":"2024-01-31T05:04:21.267586+0000","last_undegraded":"2024-01-31T05:04:21.267586+0000","last_fullsized":"2024-01-31T05:04:21.267586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:44:32.090269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266563+0000","last_change":"2024-01-31T05:04:15.863162+0000","last_active":"2024-01-31T05:04:21.266563+0000","last_peered":"2024-01-31T05:04:21.266563+0000","last_clean":"2024-01-31T05:04:21.266563+0000","last_became_active":"2024-01-31T05:04:15.862856+0000","last_became_peered":"2024-01-31T05:04:15.862856+0000","last_unstale":"2024-01-31T05:04:21.266563+0000","last_undegraded":"2024-01-31T05:04:21.266563+0000","last_fullsized":"2024-01-31T05:04:21.266563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:14.826116+0000","last_clean_scrub_stamp":"2024-01-31T05:04:14.826116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:38:14.126192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266991+0000","last_change":"2024-01-31T05:04:16.278690+0000","last_active":"2024-01-31T05:04:21.266991+0000","last_peered":"2024-01-31T05:04:21.266991+0000","last_clean":"2024-01-31T05:04:21.266991+0000","last_became_active":"2024-01-31T05:04:16.277442+0000","last_became_peered":"2024-01-31T05:04:16.277442+0000","last_unstale":"2024-01-31T05:04:21.266991+0000","last_undegraded":"2024-01-31T05:04:21.266991+0000","last_fullsized":"2024-01-31T05:04:21.266991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:07:46.749416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267351+0000","last_change":"2024-01-31T05:04:20.302359+0000","last_active":"2024-01-31T05:04:21.267351+0000","last_peered":"2024-01-31T05:04:21.267351+0000","last_clean":"2024-01-31T05:04:21.267351+0000","last_became_active":"2024-01-31T05:04:20.301989+0000","last_became_peered":"2024-01-31T05:04:20.301989+0000","last_unstale":"2024-01-31T05:04:21.267351+0000","last_undegraded":"2024-01-31T05:04:21.267351+0000","last_fullsized":"2024-01-31T05:04:21.267351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:19.270032+0000","last_clean_scrub_stamp":"2024-01-31T05:04:19.270032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:45:23.064537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579969+0000","last_change":"2024-01-31T05:04:16.281815+0000","last_active":"2024-01-31T05:04:21.579969+0000","last_peered":"2024-01-31T05:04:21.579969+0000","last_clean":"2024-01-31T05:04:21.579969+0000","last_became_active":"2024-01-31T05:04:16.281498+0000","last_became_peered":"2024-01-31T05:04:16.281498+0000","last_unstale":"2024-01-31T05:04:21.579969+0000","last_undegraded":"2024-01-31T05:04:21.579969+0000","last_fullsized":"2024-01-31T05:04:21.579969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267024+0000","last_change":"2024-01-31T05:04:16.295756+0000","last_active":"2024-01-31T05:04:21.267024+0000","last_peered":"2024-01-31T05:04:21.267024+0000","last_clean":"2024-01-31T05:04:21.267024+0000","last_became_active":"2024-01-31T05:04:16.295450+0000","last_became_peered":"2024-01-31T05:04:16.295450+0000","last_unstale":"2024-01-31T05:04:21.267024+0000","last_undegraded":"2024-01-31T05:04:21.267024+0000","last_fullsized":"2024-01-31T05:04:21.267024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:16:27.370806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579563+0000","last_change":"2024-01-31T05:04:16.298362+0000","last_active":"2024-01-31T05:04:21.579563+0000","last_peered":"2024-01-31T05:04:21.579563+0000","last_clean":"2024-01-31T05:04:21.579563+0000","last_became_active":"2024-01-31T05:04:16.297810+0000","last_became_peered":"2024-01-31T05:04:16.297810+0000","last_unstale":"2024-01-31T05:04:21.579563+0000","last_undegraded":"2024-01-31T05:04:21.579563+0000","last_fullsized":"2024-01-31T05:04:21.579563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:10:07.431961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580221+0000","last_change":"2024-01-31T05:04:16.282239+0000","last_active":"2024-01-31T05:04:21.580221+0000","last_peered":"2024-01-31T05:04:21.580221+0000","last_clean":"2024-01-31T05:04:21.580221+0000","last_became_active":"2024-01-31T05:04:16.281895+0000","last_became_peered":"2024-01-31T05:04:16.281895+0000","last_unstale":"2024-01-31T05:04:21.580221+0000","last_undegraded":"2024-01-31T05:04:21.580221+0000","last_fullsized":"2024-01-31T05:04:21.580221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:36.794548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267075+0000","last_change":"2024-01-31T05:04:16.282767+0000","last_active":"2024-01-31T05:04:21.267075+0000","last_peered":"2024-01-31T05:04:21.267075+0000","last_clean":"2024-01-31T05:04:21.267075+0000","last_became_active":"2024-01-31T05:04:16.282281+0000","last_became_peered":"2024-01-31T05:04:16.282281+0000","last_unstale":"2024-01-31T05:04:21.267075+0000","last_undegraded":"2024-01-31T05:04:21.267075+0000","last_fullsized":"2024-01-31T05:04:21.267075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:29:14.662909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580441+0000","last_change":"2024-01-31T05:04:16.281263+0000","last_active":"2024-01-31T05:04:21.580441+0000","last_peered":"2024-01-31T05:04:21.580441+0000","last_clean":"2024-01-31T05:04:21.580441+0000","last_became_active":"2024-01-31T05:04:16.280997+0000","last_became_peered":"2024-01-31T05:04:16.280997+0000","last_unstale":"2024-01-31T05:04:21.580441+0000","last_undegraded":"2024-01-31T05:04:21.580441+0000","last_fullsized":"2024-01-31T05:04:21.580441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:38.399003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581900+0000","last_change":"2024-01-31T05:04:16.287350+0000","last_active":"2024-01-31T05:04:21.581900+0000","last_peered":"2024-01-31T05:04:21.581900+0000","last_clean":"2024-01-31T05:04:21.581900+0000","last_became_active":"2024-01-31T05:04:16.286994+0000","last_became_peered":"2024-01-31T05:04:16.286994+0000","last_unstale":"2024-01-31T05:04:21.581900+0000","last_undegraded":"2024-01-31T05:04:21.581900+0000","last_fullsized":"2024-01-31T05:04:21.581900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:16:38.399003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267923+0000","last_change":"2024-01-31T05:04:16.281989+0000","last_active":"2024-01-31T05:04:21.267923+0000","last_peered":"2024-01-31T05:04:21.267923+0000","last_clean":"2024-01-31T05:04:21.267923+0000","last_became_active":"2024-01-31T05:04:16.281750+0000","last_became_peered":"2024-01-31T05:04:16.281750+0000","last_unstale":"2024-01-31T05:04:21.267923+0000","last_undegraded":"2024-01-31T05:04:21.267923+0000","last_fullsized":"2024-01-31T05:04:21.267923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579377+0000","last_change":"2024-01-31T05:04:16.294158+0000","last_active":"2024-01-31T05:04:21.579377+0000","last_peered":"2024-01-31T05:04:21.579377+0000","last_clean":"2024-01-31T05:04:21.579377+0000","last_became_active":"2024-01-31T05:04:16.293446+0000","last_became_peered":"2024-01-31T05:04:16.293446+0000","last_unstale":"2024-01-31T05:04:21.579377+0000","last_undegraded":"2024-01-31T05:04:21.579377+0000","last_fullsized":"2024-01-31T05:04:21.579377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:17:31.783779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266570+0000","last_change":"2024-01-31T05:04:16.285685+0000","last_active":"2024-01-31T05:04:21.266570+0000","last_peered":"2024-01-31T05:04:21.266570+0000","last_clean":"2024-01-31T05:04:21.266570+0000","last_became_active":"2024-01-31T05:04:16.285379+0000","last_became_peered":"2024-01-31T05:04:16.285379+0000","last_unstale":"2024-01-31T05:04:21.266570+0000","last_undegraded":"2024-01-31T05:04:21.266570+0000","last_fullsized":"2024-01-31T05:04:21.266570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:36.794548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579467+0000","last_change":"2024-01-31T05:04:16.295065+0000","last_active":"2024-01-31T05:04:21.579467+0000","last_peered":"2024-01-31T05:04:21.579467+0000","last_clean":"2024-01-31T05:04:21.579467+0000","last_became_active":"2024-01-31T05:04:16.294149+0000","last_became_peered":"2024-01-31T05:04:16.294149+0000","last_unstale":"2024-01-31T05:04:21.579467+0000","last_undegraded":"2024-01-31T05:04:21.579467+0000","last_fullsized":"2024-01-31T05:04:21.579467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:18:20.440155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580011+0000","last_change":"2024-01-31T05:04:16.282035+0000","last_active":"2024-01-31T05:04:21.580011+0000","last_peered":"2024-01-31T05:04:21.580011+0000","last_clean":"2024-01-31T05:04:21.580011+0000","last_became_active":"2024-01-31T05:04:16.281692+0000","last_became_peered":"2024-01-31T05:04:16.281692+0000","last_unstale":"2024-01-31T05:04:21.580011+0000","last_undegraded":"2024-01-31T05:04:21.580011+0000","last_fullsized":"2024-01-31T05:04:21.580011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:44:28.652707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580645+0000","last_change":"2024-01-31T05:04:16.286442+0000","last_active":"2024-01-31T05:04:21.580645+0000","last_peered":"2024-01-31T05:04:21.580645+0000","last_clean":"2024-01-31T05:04:21.580645+0000","last_became_active":"2024-01-31T05:04:16.286105+0000","last_became_peered":"2024-01-31T05:04:16.286105+0000","last_unstale":"2024-01-31T05:04:21.580645+0000","last_undegraded":"2024-01-31T05:04:21.580645+0000","last_fullsized":"2024-01-31T05:04:21.580645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.582060+0000","last_change":"2024-01-31T05:04:16.285693+0000","last_active":"2024-01-31T05:04:21.582060+0000","last_peered":"2024-01-31T05:04:21.582060+0000","last_clean":"2024-01-31T05:04:21.582060+0000","last_became_active":"2024-01-31T05:04:16.285438+0000","last_became_peered":"2024-01-31T05:04:16.285438+0000","last_unstale":"2024-01-31T05:04:21.582060+0000","last_undegraded":"2024-01-31T05:04:21.582060+0000","last_fullsized":"2024-01-31T05:04:21.582060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:18:41.035623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267794+0000","last_change":"2024-01-31T05:04:16.288398+0000","last_active":"2024-01-31T05:04:21.267794+0000","last_peered":"2024-01-31T05:04:21.267794+0000","last_clean":"2024-01-31T05:04:21.267794+0000","last_became_active":"2024-01-31T05:04:16.288236+0000","last_became_peered":"2024-01-31T05:04:16.288236+0000","last_unstale":"2024-01-31T05:04:21.267794+0000","last_undegraded":"2024-01-31T05:04:21.267794+0000","last_fullsized":"2024-01-31T05:04:21.267794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:24:56.115180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581838+0000","last_change":"2024-01-31T05:04:16.289516+0000","last_active":"2024-01-31T05:04:21.581838+0000","last_peered":"2024-01-31T05:04:21.581838+0000","last_clean":"2024-01-31T05:04:21.581838+0000","last_became_active":"2024-01-31T05:04:16.289233+0000","last_became_peered":"2024-01-31T05:04:16.289233+0000","last_unstale":"2024-01-31T05:04:21.581838+0000","last_undegraded":"2024-01-31T05:04:21.581838+0000","last_fullsized":"2024-01-31T05:04:21.581838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:42.297440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579222+0000","last_change":"2024-01-31T05:04:16.296022+0000","last_active":"2024-01-31T05:04:21.579222+0000","last_peered":"2024-01-31T05:04:21.579222+0000","last_clean":"2024-01-31T05:04:21.579222+0000","last_became_active":"2024-01-31T05:04:16.295742+0000","last_became_peered":"2024-01-31T05:04:16.295742+0000","last_unstale":"2024-01-31T05:04:21.579222+0000","last_undegraded":"2024-01-31T05:04:21.579222+0000","last_fullsized":"2024-01-31T05:04:21.579222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579754+0000","last_change":"2024-01-31T05:04:16.287380+0000","last_active":"2024-01-31T05:04:21.579754+0000","last_peered":"2024-01-31T05:04:21.579754+0000","last_clean":"2024-01-31T05:04:21.579754+0000","last_became_active":"2024-01-31T05:04:16.287109+0000","last_became_peered":"2024-01-31T05:04:16.287109+0000","last_unstale":"2024-01-31T05:04:21.579754+0000","last_undegraded":"2024-01-31T05:04:21.579754+0000","last_fullsized":"2024-01-31T05:04:21.579754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:36.794548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580061+0000","last_change":"2024-01-31T05:04:16.279154+0000","last_active":"2024-01-31T05:04:21.580061+0000","last_peered":"2024-01-31T05:04:21.580061+0000","last_clean":"2024-01-31T05:04:21.580061+0000","last_became_active":"2024-01-31T05:04:16.278567+0000","last_became_peered":"2024-01-31T05:04:16.278567+0000","last_unstale":"2024-01-31T05:04:21.580061+0000","last_undegraded":"2024-01-31T05:04:21.580061+0000","last_fullsized":"2024-01-31T05:04:21.580061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:42:45.290684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266435+0000","last_change":"2024-01-31T05:04:16.297488+0000","last_active":"2024-01-31T05:04:21.266435+0000","last_peered":"2024-01-31T05:04:21.266435+0000","last_clean":"2024-01-31T05:04:21.266435+0000","last_became_active":"2024-01-31T05:04:16.297230+0000","last_became_peered":"2024-01-31T05:04:16.297230+0000","last_unstale":"2024-01-31T05:04:21.266435+0000","last_undegraded":"2024-01-31T05:04:21.266435+0000","last_fullsized":"2024-01-31T05:04:21.266435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:20.560663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.267316+0000","last_change":"2024-01-31T05:04:16.288685+0000","last_active":"2024-01-31T05:04:21.267316+0000","last_peered":"2024-01-31T05:04:21.267316+0000","last_clean":"2024-01-31T05:04:21.267316+0000","last_became_active":"2024-01-31T05:04:16.288432+0000","last_became_peered":"2024-01-31T05:04:16.288432+0000","last_unstale":"2024-01-31T05:04:21.267316+0000","last_undegraded":"2024-01-31T05:04:21.267316+0000","last_fullsized":"2024-01-31T05:04:21.267316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:16:27.370806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581061+0000","last_change":"2024-01-31T05:04:16.299989+0000","last_active":"2024-01-31T05:04:21.581061+0000","last_peered":"2024-01-31T05:04:21.581061+0000","last_clean":"2024-01-31T05:04:21.581061+0000","last_became_active":"2024-01-31T05:04:16.299706+0000","last_became_peered":"2024-01-31T05:04:16.299706+0000","last_unstale":"2024-01-31T05:04:21.581061+0000","last_undegraded":"2024-01-31T05:04:21.581061+0000","last_fullsized":"2024-01-31T05:04:21.581061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:32:44.394537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581425+0000","last_change":"2024-01-31T05:04:16.300161+0000","last_active":"2024-01-31T05:04:21.581425+0000","last_peered":"2024-01-31T05:04:21.581425+0000","last_clean":"2024-01-31T05:04:21.581425+0000","last_became_active":"2024-01-31T05:04:16.299891+0000","last_became_peered":"2024-01-31T05:04:16.299891+0000","last_unstale":"2024-01-31T05:04:21.581425+0000","last_undegraded":"2024-01-31T05:04:21.581425+0000","last_fullsized":"2024-01-31T05:04:21.581425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:05:32.076479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581621+0000","last_change":"2024-01-31T05:04:16.296845+0000","last_active":"2024-01-31T05:04:21.581621+0000","last_peered":"2024-01-31T05:04:21.581621+0000","last_clean":"2024-01-31T05:04:21.581621+0000","last_became_active":"2024-01-31T05:04:16.296607+0000","last_became_peered":"2024-01-31T05:04:16.296607+0000","last_unstale":"2024-01-31T05:04:21.581621+0000","last_undegraded":"2024-01-31T05:04:21.581621+0000","last_fullsized":"2024-01-31T05:04:21.581621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:42:10.970514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.266165+0000","last_change":"2024-01-31T05:04:16.297713+0000","last_active":"2024-01-31T05:04:21.266165+0000","last_peered":"2024-01-31T05:04:21.266165+0000","last_clean":"2024-01-31T05:04:21.266165+0000","last_became_active":"2024-01-31T05:04:16.297428+0000","last_became_peered":"2024-01-31T05:04:16.297428+0000","last_unstale":"2024-01-31T05:04:21.266165+0000","last_undegraded":"2024-01-31T05:04:21.266165+0000","last_fullsized":"2024-01-31T05:04:21.266165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:44:28.652707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581148+0000","last_change":"2024-01-31T05:04:16.282822+0000","last_active":"2024-01-31T05:04:21.581148+0000","last_peered":"2024-01-31T05:04:21.581148+0000","last_clean":"2024-01-31T05:04:21.581148+0000","last_became_active":"2024-01-31T05:04:16.282537+0000","last_became_peered":"2024-01-31T05:04:16.282537+0000","last_unstale":"2024-01-31T05:04:21.581148+0000","last_undegraded":"2024-01-31T05:04:21.581148+0000","last_fullsized":"2024-01-31T05:04:21.581148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:52:00.886932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.579642+0000","last_change":"2024-01-31T05:04:16.298033+0000","last_active":"2024-01-31T05:04:21.579642+0000","last_peered":"2024-01-31T05:04:21.579642+0000","last_clean":"2024-01-31T05:04:21.579642+0000","last_became_active":"2024-01-31T05:04:16.297503+0000","last_became_peered":"2024-01-31T05:04:16.297503+0000","last_unstale":"2024-01-31T05:04:21.579642+0000","last_undegraded":"2024-01-31T05:04:21.579642+0000","last_fullsized":"2024-01-31T05:04:21.579642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581513+0000","last_change":"2024-01-31T05:04:16.284955+0000","last_active":"2024-01-31T05:04:21.581513+0000","last_peered":"2024-01-31T05:04:21.581513+0000","last_clean":"2024-01-31T05:04:21.581513+0000","last_became_active":"2024-01-31T05:04:16.284672+0000","last_became_peered":"2024-01-31T05:04:16.284672+0000","last_unstale":"2024-01-31T05:04:21.581513+0000","last_undegraded":"2024-01-31T05:04:21.581513+0000","last_fullsized":"2024-01-31T05:04:21.581513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:10:07.431961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580116+0000","last_change":"2024-01-31T05:04:16.295273+0000","last_active":"2024-01-31T05:04:21.580116+0000","last_peered":"2024-01-31T05:04:21.580116+0000","last_clean":"2024-01-31T05:04:21.580116+0000","last_became_active":"2024-01-31T05:04:16.294052+0000","last_became_peered":"2024-01-31T05:04:16.294052+0000","last_unstale":"2024-01-31T05:04:21.580116+0000","last_undegraded":"2024-01-31T05:04:21.580116+0000","last_fullsized":"2024-01-31T05:04:21.580116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:59:17.499417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580619+0000","last_change":"2024-01-31T05:04:16.274394+0000","last_active":"2024-01-31T05:04:21.580619+0000","last_peered":"2024-01-31T05:04:21.580619+0000","last_clean":"2024-01-31T05:04:21.580619+0000","last_became_active":"2024-01-31T05:04:16.274092+0000","last_became_peered":"2024-01-31T05:04:16.274092+0000","last_unstale":"2024-01-31T05:04:21.580619+0000","last_undegraded":"2024-01-31T05:04:21.580619+0000","last_fullsized":"2024-01-31T05:04:21.580619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:05:32.076479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.580935+0000","last_change":"2024-01-31T05:04:16.276197+0000","last_active":"2024-01-31T05:04:21.580935+0000","last_peered":"2024-01-31T05:04:21.580935+0000","last_clean":"2024-01-31T05:04:21.580935+0000","last_became_active":"2024-01-31T05:04:16.275821+0000","last_became_peered":"2024-01-31T05:04:16.275821+0000","last_unstale":"2024-01-31T05:04:21.580935+0000","last_undegraded":"2024-01-31T05:04:21.580935+0000","last_fullsized":"2024-01-31T05:04:21.580935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:21:22.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-31T05:04:21.581450+0000","last_change":"2024-01-31T05:04:16.289246+0000","last_active":"2024-01-31T05:04:21.581450+0000","last_peered":"2024-01-31T05:04:21.581450+0000","last_clean":"2024-01-31T05:04:21.581450+0000","last_became_active":"2024-01-31T05:04:16.288595+0000","last_became_peered":"2024-01-31T05:04:16.288595+0000","last_unstale":"2024-01-31T05:04:21.581450+0000","last_undegraded":"2024-01-31T05:04:21.581450+0000","last_fullsized":"2024-01-31T05:04:21.581450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:15.832470+0000","last_clean_scrub_stamp":"2024-01-31T05:04:15.832470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:42.297440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":690798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-31T05:04:46.496 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-31T05:04:46.496 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-31T05:04:46.496 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-31T05:04:46.497 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-31T05:04:46.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.679+0000 7f4e6b800640 1 Processor -- start 2024-01-31T05:04:46.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.679+0000 7f4e6b800640 1 -- start start 2024-01-31T05:04:46.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.679+0000 7f4e6b800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4e64070660 0x7f4e64070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:46.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.679+0000 7f4e6b800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4e640ac050 0x7f4e640ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:46.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.679+0000 7f4e6b800640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e64071000 con 0x7f4e64159790 2024-01-31T05:04:46.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.679+0000 7f4e6b800640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e64159b70 con 0x7f4e64070660 2024-01-31T05:04:46.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.679+0000 7f4e6b800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e640b2750 con 0x7f4e640ac050 2024-01-31T05:04:46.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.679+0000 7f4e63e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4e64070660 0x7f4e64070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:46.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.679+0000 7f4e68e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4e64159790 0x7f4e640b37c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57880/0 (socket says 172.21.15.49:57880) 2024-01-31T05:04:46.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.679+0000 7f4e68e00640 1 -- 172.21.15.49:0/1534525091 learned_addr learned my addr 172.21.15.49:0/1534525091 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:46.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.679+0000 7f4e69800640 1 --2- 172.21.15.49:0/1534525091 >> v2:172.21.15.195:3300/0 conn(0x7f4e640ac050 0x7f4e640ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:46.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.679+0000 7f4e63e00640 1 -- 172.21.15.49:0/1534525091 >> v2:172.21.15.195:3300/0 conn(0x7f4e640ac050 msgr2=0x7f4e640ac4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:46.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.679+0000 7f4e63e00640 1 --2- 172.21.15.49:0/1534525091 >> v2:172.21.15.195:3300/0 conn(0x7f4e640ac050 0x7f4e640ac4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.679+0000 7f4e63e00640 1 -- 172.21.15.49:0/1534525091 >> v1:172.21.15.49:6789/0 conn(0x7f4e64159790 legacy=0x7f4e640b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:46.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.679+0000 7f4e63e00640 1 -- 172.21.15.49:0/1534525091 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e640b2a30 con 0x7f4e64070660 2024-01-31T05:04:46.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.679+0000 7f4e63400640 1 -- 172.21.15.49:0/1534525091 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474905144 0 0) 0x7f4e64071000 con 0x7f4e64159790 2024-01-31T05:04:46.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.679+0000 7f4e69800640 1 --2- 172.21.15.49:0/1534525091 >> v2:172.21.15.195:3300/0 conn(0x7f4e640ac050 0x7f4e640ac4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:46.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.683+0000 7f4e63e00640 1 --2- 172.21.15.49:0/1534525091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e64070660 0x7f4e64070ac0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4e640b1690 tx=0x7f4e4c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d808ae2c63a68c73 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:46.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.683+0000 7f4e63400640 1 -- 172.21.15.49:0/1534525091 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c0ab600 con 0x7f4e64070660 2024-01-31T05:04:46.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.683+0000 7f4e63400640 1 -- 172.21.15.49:0/1534525091 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c0a7050 con 0x7f4e64070660 2024-01-31T05:04:46.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.683+0000 7f4e63400640 1 -- 172.21.15.49:0/1534525091 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c0ab980 con 0x7f4e64070660 2024-01-31T05:04:46.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.683+0000 7f4e6b800640 1 -- 172.21.15.49:0/1534525091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e64070660 msgr2=0x7f4e64070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:46.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.683+0000 7f4e6b800640 1 --2- 172.21.15.49:0/1534525091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e64070660 0x7f4e64070ac0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4e640b1690 tx=0x7f4e4c01c430 comp rx=0 tx=0).stop 2024-01-31T05:04:46.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.683+0000 7f4e6b800640 1 -- 172.21.15.49:0/1534525091 shutdown_connections 2024-01-31T05:04:46.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.683+0000 7f4e6b800640 1 --2- 172.21.15.49:0/1534525091 >> v2:172.21.15.195:3300/0 conn(0x7f4e640ac050 0x7f4e640ac4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.683+0000 7f4e6b800640 1 --2- 172.21.15.49:0/1534525091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e64070660 0x7f4e64070ac0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.683+0000 7f4e6b800640 1 -- 172.21.15.49:0/1534525091 >> 172.21.15.49:0/1534525091 conn(0x7f4e640b09a0 msgr2=0x7f4e640b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:46.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.683+0000 7f4e6b800640 1 -- 172.21.15.49:0/1534525091 shutdown_connections 2024-01-31T05:04:46.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.683+0000 7f4e6b800640 1 -- 172.21.15.49:0/1534525091 wait complete. 2024-01-31T05:04:46.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e6b800640 1 Processor -- start 2024-01-31T05:04:46.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e6b800640 1 -- start start 2024-01-31T05:04:46.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e6b800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e64070660 0x7f4e640af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:46.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e6b800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e640ac050 0x7f4e6406cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:46.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e6b800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e64159790 0x7f4e6406d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:46.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e6b800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e641f7860 con 0x7f4e64070660 2024-01-31T05:04:46.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e6b800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e641f69d0 con 0x7f4e64159790 2024-01-31T05:04:46.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e6b800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e641f6be0 con 0x7f4e640ac050 2024-01-31T05:04:46.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e68e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e64070660 0x7f4e640af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:46.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e68e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e64070660 0x7f4e640af910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38792/0 (socket says 172.21.15.49:38792) 2024-01-31T05:04:46.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e68e00640 1 -- 172.21.15.49:0/872293051 learned_addr learned my addr 172.21.15.49:0/872293051 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:46.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e69800640 1 --2- 172.21.15.49:0/872293051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e64159790 0x7f4e6406d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:46.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e63e00640 1 --2- 172.21.15.49:0/872293051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e640ac050 0x7f4e6406cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:46.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e68e00640 1 -- 172.21.15.49:0/872293051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e640ac050 msgr2=0x7f4e6406cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:46.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e68e00640 1 --2- 172.21.15.49:0/872293051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e640ac050 0x7f4e6406cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e68e00640 1 -- 172.21.15.49:0/872293051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e64159790 msgr2=0x7f4e6406d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:46.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e68e00640 1 --2- 172.21.15.49:0/872293051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e64159790 0x7f4e6406d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e68e00640 1 -- 172.21.15.49:0/872293051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c009420 con 0x7f4e64070660 2024-01-31T05:04:46.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e63e00640 1 --2- 172.21.15.49:0/872293051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e640ac050 0x7f4e6406cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:46.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e68e00640 1 --2- 172.21.15.49:0/872293051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e64070660 0x7f4e640af910 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4e5400c480 tx=0x7f4e5400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:46.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e60c00640 1 -- 172.21.15.49:0/872293051 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e540074e0 con 0x7f4e64070660 2024-01-31T05:04:46.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e60c00640 1 -- 172.21.15.49:0/872293051 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e54007660 con 0x7f4e64070660 2024-01-31T05:04:46.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e6b800640 1 -- 172.21.15.49:0/872293051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e641f6ec0 con 0x7f4e64070660 2024-01-31T05:04:46.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e60c00640 1 -- 172.21.15.49:0/872293051 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54004a30 con 0x7f4e64070660 2024-01-31T05:04:46.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.687+0000 7f4e6b800640 1 -- 172.21.15.49:0/872293051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e641f7480 con 0x7f4e64070660 2024-01-31T05:04:46.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.691+0000 7f4e6b800640 1 -- 172.21.15.49:0/872293051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e64074860 con 0x7f4e64070660 2024-01-31T05:04:46.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.691+0000 7f4e60c00640 1 -- 172.21.15.49:0/872293051 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f4e54004b90 con 0x7f4e64070660 2024-01-31T05:04:46.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.691+0000 7f4e60c00640 1 --2- 172.21.15.49:0/872293051 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4e3c066530 0x7f4e3c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:46.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.691+0000 7f4e60c00640 1 -- 172.21.15.49:0/872293051 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4e54083610 con 0x7f4e64070660 2024-01-31T05:04:46.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.691+0000 7f4e63e00640 1 --2- 172.21.15.49:0/872293051 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4e3c066530 0x7f4e3c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:46.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.695+0000 7f4e63e00640 1 --2- 172.21.15.49:0/872293051 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4e3c066530 0x7f4e3c0689f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0ad000 tx=0x7f4e4c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:46.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.695+0000 7f4e60c00640 1 -- 172.21.15.49:0/872293051 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f4e540540f0 con 0x7f4e64070660 2024-01-31T05:04:46.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.887+0000 7f4e6b800640 1 -- 172.21.15.49:0/872293051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4e64154880 con 0x7f4e64070660 2024-01-31T05:04:46.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.891+0000 7f4e60c00640 1 -- 172.21.15.49:0/872293051 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4e54053c80 con 0x7f4e64070660 2024-01-31T05:04:46.891 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:46.891 INFO:teuthology.orchestra.run.smithi049.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-31T05:04:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.891+0000 7f4e6b800640 1 -- 172.21.15.49:0/872293051 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4e3c066530 msgr2=0x7f4e3c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.891+0000 7f4e6b800640 1 --2- 172.21.15.49:0/872293051 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4e3c066530 0x7f4e3c0689f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0ad000 tx=0x7f4e4c0a6000 comp rx=0 tx=0).stop 2024-01-31T05:04:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.891+0000 7f4e6b800640 1 -- 172.21.15.49:0/872293051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e64070660 msgr2=0x7f4e640af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.891+0000 7f4e6b800640 1 --2- 172.21.15.49:0/872293051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e64070660 0x7f4e640af910 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4e5400c480 tx=0x7f4e5400c940 comp rx=0 tx=0).stop 2024-01-31T05:04:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.891+0000 7f4e6b800640 1 -- 172.21.15.49:0/872293051 shutdown_connections 2024-01-31T05:04:46.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.891+0000 7f4e6b800640 1 --2- 172.21.15.49:0/872293051 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4e3c066530 0x7f4e3c0689f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.891+0000 7f4e6b800640 1 --2- 172.21.15.49:0/872293051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e64159790 0x7f4e6406d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.891+0000 7f4e6b800640 1 --2- 172.21.15.49:0/872293051 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e640ac050 0x7f4e6406cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.891+0000 7f4e6b800640 1 --2- 172.21.15.49:0/872293051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e64070660 0x7f4e640af910 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:46.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.891+0000 7f4e6b800640 1 -- 172.21.15.49:0/872293051 >> 172.21.15.49:0/872293051 conn(0x7f4e640b09a0 msgr2=0x7f4e64073bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:46.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.891+0000 7f4e6b800640 1 -- 172.21.15.49:0/872293051 shutdown_connections 2024-01-31T05:04:46.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:46.891+0000 7f4e6b800640 1 -- 172.21.15.49:0/872293051 wait complete. 2024-01-31T05:04:46.913 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-31T05:04:46.914 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:04:47.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.051+0000 7f3e43800640 1 Processor -- start 2024-01-31T05:04:47.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.051+0000 7f3e43800640 1 -- start start 2024-01-31T05:04:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.055+0000 7f3e43800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3e3c070ac0 0x7f3e3c0ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.055+0000 7f3e43800640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c159b70 con 0x7f3e3c159790 2024-01-31T05:04:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.055+0000 7f3e43800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c0b2750 con 0x7f3e3c070660 2024-01-31T05:04:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.055+0000 7f3e43800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c0b2a30 con 0x7f3e3c070ac0 2024-01-31T05:04:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.055+0000 7f3e40e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3e3c159790 0x7f3e3c0b37c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57882/0 (socket says 172.21.15.49:57882) 2024-01-31T05:04:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.055+0000 7f3e40e00640 1 -- 172.21.15.49:0/503724451 learned_addr learned my addr 172.21.15.49:0/503724451 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.055+0000 7f3e41800640 1 --2- 172.21.15.49:0/503724451 >> v2:172.21.15.195:3300/0 conn(0x7f3e3c070ac0 0x7f3e3c0ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.055+0000 7f3e3b400640 1 -- 172.21.15.49:0/503724451 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115395109 0 0) 0x7f3e3c159b70 con 0x7f3e3c159790 2024-01-31T05:04:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.055+0000 7f3e3b400640 1 -- 172.21.15.49:0/503724451 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e1c003530 con 0x7f3e3c159790 2024-01-31T05:04:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.055+0000 7f3e3b400640 1 -- 172.21.15.49:0/503724451 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364195142 0 0) 0x7f3e3c0b2750 con 0x7f3e3c070660 2024-01-31T05:04:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.055+0000 7f3e3b400640 1 -- 172.21.15.49:0/503724451 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e3c159b70 con 0x7f3e3c070660 2024-01-31T05:04:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.055+0000 7f3e3b400640 1 -- 172.21.15.49:0/503724451 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1202734556 0 0) 0x7f3e1c003530 con 0x7f3e3c159790 2024-01-31T05:04:47.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.055+0000 7f3e41800640 1 -- 172.21.15.49:0/503724451 >> v1:172.21.15.195:6789/0 conn(0x7f3e3c070660 legacy=0x7f3e3c0ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.055+0000 7f3e41800640 1 -- 172.21.15.49:0/503724451 >> v1:172.21.15.49:6789/0 conn(0x7f3e3c159790 legacy=0x7f3e3c0b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.055+0000 7f3e41800640 1 -- 172.21.15.49:0/503724451 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c0b2d10 con 0x7f3e3c070ac0 2024-01-31T05:04:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.059+0000 7f3e41800640 1 --2- 172.21.15.49:0/503724451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e3c070ac0 0x7f3e3c0ac760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009d90 tx=0x7f3e3401c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfe9cffd5f084df2 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.059+0000 7f3e3b400640 1 -- 172.21.15.49:0/503724451 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c001680 con 0x7f3e3c070ac0 2024-01-31T05:04:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.059+0000 7f3e3b400640 1 -- 172.21.15.49:0/503724451 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e340a55c0 con 0x7f3e3c070ac0 2024-01-31T05:04:47.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.059+0000 7f3e3b400640 1 -- 172.21.15.49:0/503724451 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e340a5950 con 0x7f3e3c070ac0 2024-01-31T05:04:47.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.059+0000 7f3e43800640 1 -- 172.21.15.49:0/503724451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e3c070ac0 msgr2=0x7f3e3c0ac760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.059+0000 7f3e43800640 1 --2- 172.21.15.49:0/503724451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e3c070ac0 0x7f3e3c0ac760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009d90 tx=0x7f3e3401c810 comp rx=0 tx=0).stop 2024-01-31T05:04:47.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.059+0000 7f3e43800640 1 -- 172.21.15.49:0/503724451 shutdown_connections 2024-01-31T05:04:47.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.059+0000 7f3e43800640 1 --2- 172.21.15.49:0/503724451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e3c070ac0 0x7f3e3c0ac760 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.059+0000 7f3e43800640 1 -- 172.21.15.49:0/503724451 >> 172.21.15.49:0/503724451 conn(0x7f3e3c0b09a0 msgr2=0x7f3e3c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:47.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.059+0000 7f3e43800640 1 -- 172.21.15.49:0/503724451 shutdown_connections 2024-01-31T05:04:47.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.059+0000 7f3e43800640 1 -- 172.21.15.49:0/503724451 wait complete. 2024-01-31T05:04:47.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e43800640 1 Processor -- start 2024-01-31T05:04:47.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e43800640 1 -- start start 2024-01-31T05:04:47.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e43800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e3c070660 0x7f3e3c14f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e43800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e3c070ac0 0x7f3e3c13a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e43800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e3c159790 0x7f3e3c158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e43800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c14fd60 con 0x7f3e3c070660 2024-01-31T05:04:47.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e43800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c13b1b0 con 0x7f3e3c159790 2024-01-31T05:04:47.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e43800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c14eb40 con 0x7f3e3c070ac0 2024-01-31T05:04:47.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e40e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e3c070660 0x7f3e3c14f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e40e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e3c070660 0x7f3e3c14f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38794/0 (socket says 172.21.15.49:38794) 2024-01-31T05:04:47.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e40e00640 1 -- 172.21.15.49:0/1158176610 learned_addr learned my addr 172.21.15.49:0/1158176610 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:47.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e41800640 1 --2- 172.21.15.49:0/1158176610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e3c159790 0x7f3e3c158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e3be00640 1 --2- 172.21.15.49:0/1158176610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e3c070ac0 0x7f3e3c13a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e40e00640 1 -- 172.21.15.49:0/1158176610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e3c070ac0 msgr2=0x7f3e3c13a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e40e00640 1 --2- 172.21.15.49:0/1158176610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e3c070ac0 0x7f3e3c13a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e40e00640 1 -- 172.21.15.49:0/1158176610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e3c159790 msgr2=0x7f3e3c158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e40e00640 1 --2- 172.21.15.49:0/1158176610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e3c159790 0x7f3e3c158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e40e00640 1 -- 172.21.15.49:0/1158176610 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e34009a70 con 0x7f3e3c070660 2024-01-31T05:04:47.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e40e00640 1 --2- 172.21.15.49:0/1158176610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e3c070660 0x7f3e3c14f820 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c00c780 tx=0x7f3e2c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:47.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e38c00640 1 -- 172.21.15.49:0/1158176610 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c005ae0 con 0x7f3e3c070660 2024-01-31T05:04:47.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e38c00640 1 -- 172.21.15.49:0/1158176610 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c005c40 con 0x7f3e3c070660 2024-01-31T05:04:47.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e43800640 1 -- 172.21.15.49:0/1158176610 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3c13d790 con 0x7f3e3c070660 2024-01-31T05:04:47.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e38c00640 1 -- 172.21.15.49:0/1158176610 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c007070 con 0x7f3e3c070660 2024-01-31T05:04:47.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.063+0000 7f3e43800640 1 -- 172.21.15.49:0/1158176610 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c13dd50 con 0x7f3e3c070660 2024-01-31T05:04:47.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.067+0000 7f3e43800640 1 -- 172.21.15.49:0/1158176610 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3c154430 con 0x7f3e3c070660 2024-01-31T05:04:47.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.067+0000 7f3e38c00640 1 -- 172.21.15.49:0/1158176610 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f3e2c0071f0 con 0x7f3e3c070660 2024-01-31T05:04:47.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.067+0000 7f3e38c00640 1 --2- 172.21.15.49:0/1158176610 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3e14066500 0x7f3e140689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.067+0000 7f3e38c00640 1 -- 172.21.15.49:0/1158176610 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3e2c083df0 con 0x7f3e3c070660 2024-01-31T05:04:47.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.067+0000 7f3e3be00640 1 --2- 172.21.15.49:0/1158176610 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3e14066500 0x7f3e140689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.067+0000 7f3e3be00640 1 --2- 172.21.15.49:0/1158176610 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3e14066500 0x7f3e140689c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0ac420 tx=0x7f3e24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:47.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.071+0000 7f3e38c00640 1 -- 172.21.15.49:0/1158176610 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f3e2c050db0 con 0x7f3e3c070660 2024-01-31T05:04:47.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.231+0000 7f3e43800640 1 -- 172.21.15.49:0/1158176610 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e3c13b320 con 0x7f3e3c070660 2024-01-31T05:04:47.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.231+0000 7f3e38c00640 1 -- 172.21.15.49:0/1158176610 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18323 (secure 0 0 0) 0x7f3e2c0543d0 con 0x7f3e3c070660 2024-01-31T05:04:47.233 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:47.233 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:20.695841+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:04:47.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.235+0000 7f3e43800640 1 -- 172.21.15.49:0/1158176610 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3e14066500 msgr2=0x7f3e140689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.235+0000 7f3e43800640 1 --2- 172.21.15.49:0/1158176610 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3e14066500 0x7f3e140689c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0ac420 tx=0x7f3e24009040 comp rx=0 tx=0).stop 2024-01-31T05:04:47.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.235+0000 7f3e43800640 1 -- 172.21.15.49:0/1158176610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e3c070660 msgr2=0x7f3e3c14f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.235+0000 7f3e43800640 1 --2- 172.21.15.49:0/1158176610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e3c070660 0x7f3e3c14f820 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c00c780 tx=0x7f3e2c00cc40 comp rx=0 tx=0).stop 2024-01-31T05:04:47.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.235+0000 7f3e43800640 1 -- 172.21.15.49:0/1158176610 shutdown_connections 2024-01-31T05:04:47.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.235+0000 7f3e43800640 1 --2- 172.21.15.49:0/1158176610 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3e14066500 0x7f3e140689c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.235+0000 7f3e43800640 1 --2- 172.21.15.49:0/1158176610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e3c159790 0x7f3e3c158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.235+0000 7f3e43800640 1 --2- 172.21.15.49:0/1158176610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e3c070ac0 0x7f3e3c13a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.235+0000 7f3e43800640 1 --2- 172.21.15.49:0/1158176610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e3c070660 0x7f3e3c14f820 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.235+0000 7f3e43800640 1 -- 172.21.15.49:0/1158176610 >> 172.21.15.49:0/1158176610 conn(0x7f3e3c0b09a0 msgr2=0x7f3e3c06d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:47.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.235+0000 7f3e43800640 1 -- 172.21.15.49:0/1158176610 shutdown_connections 2024-01-31T05:04:47.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.235+0000 7f3e43800640 1 -- 172.21.15.49:0/1158176610 wait complete. 2024-01-31T05:04:47.255 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:04:14.566345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:04:15.231265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-31T05:04:18.316756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-31T05:04:47.256 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:04:47.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.399+0000 7f8cce000640 1 Processor -- start 2024-01-31T05:04:47.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.399+0000 7f8cce000640 1 -- start start 2024-01-31T05:04:47.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.399+0000 7f8cce000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cc806a770 0x7f8cc806ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.399+0000 7f8cce000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8cc806f0b0 0x7f8cc80714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.399+0000 7f8cce000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc80cf690 con 0x7f8cc80cf140 2024-01-31T05:04:47.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.399+0000 7f8cce000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc806ef30 con 0x7f8cc806f0b0 2024-01-31T05:04:47.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.399+0000 7f8cce000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc806b090 con 0x7f8cc806a770 2024-01-31T05:04:47.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.399+0000 7f8cc7400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cc806a770 0x7f8cc806ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.399+0000 7f8cc6a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8cc806f0b0 0x7f8cc80714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.399+0000 7f8cc7400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cc806a770 0x7f8cc806ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:53276/0 (socket says 172.21.15.49:53276) 2024-01-31T05:04:47.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.399+0000 7f8cc7400640 1 -- 172.21.15.49:0/2577661562 learned_addr learned my addr 172.21.15.49:0/2577661562 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:47.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.399+0000 7f8cc6a00640 1 -- 172.21.15.49:0/2577661562 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cc806a770 msgr2=0x7f8cc806ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:47.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.399+0000 7f8cc6a00640 1 --2- 172.21.15.49:0/2577661562 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cc806a770 0x7f8cc806ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.399+0000 7f8cc6a00640 1 -- 172.21.15.49:0/2577661562 >> v1:172.21.15.195:6789/0 conn(0x7f8cc80cf140 legacy=0x7f8cc815baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.399+0000 7f8cc6a00640 1 -- 172.21.15.49:0/2577661562 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc8071a10 con 0x7f8cc806f0b0 2024-01-31T05:04:47.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.403+0000 7f8cc6a00640 1 --2- 172.21.15.49:0/2577661562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cc806f0b0 0x7f8cc80714d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00097c0 tx=0x7f8cb001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ee0935cf853e344 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:47.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.403+0000 7f8cc6000640 1 -- 172.21.15.49:0/2577661562 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb00ab600 con 0x7f8cc806f0b0 2024-01-31T05:04:47.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.403+0000 7f8cc6000640 1 -- 172.21.15.49:0/2577661562 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb00a7050 con 0x7f8cc806f0b0 2024-01-31T05:04:47.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.403+0000 7f8cc6000640 1 -- 172.21.15.49:0/2577661562 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb00ab980 con 0x7f8cc806f0b0 2024-01-31T05:04:47.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.403+0000 7f8cce000640 1 -- 172.21.15.49:0/2577661562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cc806f0b0 msgr2=0x7f8cc80714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.403+0000 7f8cce000640 1 --2- 172.21.15.49:0/2577661562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cc806f0b0 0x7f8cc80714d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00097c0 tx=0x7f8cb001c480 comp rx=0 tx=0).stop 2024-01-31T05:04:47.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.403+0000 7f8cce000640 1 -- 172.21.15.49:0/2577661562 shutdown_connections 2024-01-31T05:04:47.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.403+0000 7f8cce000640 1 --2- 172.21.15.49:0/2577661562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cc806f0b0 0x7f8cc80714d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.403+0000 7f8cce000640 1 --2- 172.21.15.49:0/2577661562 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cc806a770 0x7f8cc806ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.403+0000 7f8cce000640 1 -- 172.21.15.49:0/2577661562 >> 172.21.15.49:0/2577661562 conn(0x7f8cc80b1ab0 msgr2=0x7f8cc80b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:47.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.403+0000 7f8cce000640 1 -- 172.21.15.49:0/2577661562 shutdown_connections 2024-01-31T05:04:47.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.403+0000 7f8cce000640 1 -- 172.21.15.49:0/2577661562 wait complete. 2024-01-31T05:04:47.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cce000640 1 Processor -- start 2024-01-31T05:04:47.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cce000640 1 -- start start 2024-01-31T05:04:47.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cce000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cc806a770 0x7f8cc8145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cce000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cc806f0b0 0x7f8cc814e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cce000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cc80cf140 0x7f8cc80b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cce000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc814ed30 con 0x7f8cc806a770 2024-01-31T05:04:47.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cce000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc80b2eb0 con 0x7f8cc806f0b0 2024-01-31T05:04:47.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cce000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc80b30c0 con 0x7f8cc80cf140 2024-01-31T05:04:47.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cc7400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cc806a770 0x7f8cc8145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cc7400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cc806a770 0x7f8cc8145120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38806/0 (socket says 172.21.15.49:38806) 2024-01-31T05:04:47.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cc7400640 1 -- 172.21.15.49:0/1665428034 learned_addr learned my addr 172.21.15.49:0/1665428034 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:47.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cc6a00640 1 --2- 172.21.15.49:0/1665428034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cc806f0b0 0x7f8cc814e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cc7e00640 1 --2- 172.21.15.49:0/1665428034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cc80cf140 0x7f8cc80b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cc7400640 1 -- 172.21.15.49:0/1665428034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cc80cf140 msgr2=0x7f8cc80b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cc7400640 1 --2- 172.21.15.49:0/1665428034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cc80cf140 0x7f8cc80b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cc7400640 1 -- 172.21.15.49:0/1665428034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cc806f0b0 msgr2=0x7f8cc814e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cc7400640 1 --2- 172.21.15.49:0/1665428034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cc806f0b0 0x7f8cc814e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cc7400640 1 -- 172.21.15.49:0/1665428034 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb0009420 con 0x7f8cc806a770 2024-01-31T05:04:47.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cc7400640 1 --2- 172.21.15.49:0/1665428034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cc806a770 0x7f8cc8145120 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8cb800e890 tx=0x7f8cb800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:47.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cbf400640 1 -- 172.21.15.49:0/1665428034 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8009620 con 0x7f8cc806a770 2024-01-31T05:04:47.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cbf400640 1 -- 172.21.15.49:0/1665428034 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb800c940 con 0x7f8cc806a770 2024-01-31T05:04:47.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cbf400640 1 -- 172.21.15.49:0/1665428034 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb800ccf0 con 0x7f8cc806a770 2024-01-31T05:04:47.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cce000640 1 -- 172.21.15.49:0/1665428034 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc80b33a0 con 0x7f8cc806a770 2024-01-31T05:04:47.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.407+0000 7f8cce000640 1 -- 172.21.15.49:0/1665428034 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc80b3960 con 0x7f8cc806a770 2024-01-31T05:04:47.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.411+0000 7f8cce000640 1 -- 172.21.15.49:0/1665428034 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc806c770 con 0x7f8cc806a770 2024-01-31T05:04:47.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.411+0000 7f8cbf400640 1 -- 172.21.15.49:0/1665428034 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f8cb8013470 con 0x7f8cc806a770 2024-01-31T05:04:47.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.411+0000 7f8cbf400640 1 --2- 172.21.15.49:0/1665428034 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8ca0066500 0x7f8ca00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.411+0000 7f8cbf400640 1 -- 172.21.15.49:0/1665428034 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8cb8084290 con 0x7f8cc806a770 2024-01-31T05:04:47.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.411+0000 7f8cc6a00640 1 --2- 172.21.15.49:0/1665428034 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8ca0066500 0x7f8ca00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.411+0000 7f8cc6a00640 1 --2- 172.21.15.49:0/1665428034 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8ca0066500 0x7f8ca00689c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00ad000 tx=0x7f8cb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:47.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.415+0000 7f8cbf400640 1 -- 172.21.15.49:0/1665428034 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f8cb80512f0 con 0x7f8cc806a770 2024-01-31T05:04:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.575+0000 7f8cce000640 1 -- 172.21.15.49:0/1665428034 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8cc8074860 con 0x7f8cc806a770 2024-01-31T05:04:47.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.575+0000 7f8cbf400640 1 -- 172.21.15.49:0/1665428034 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8cb8054910 con 0x7f8cc806a770 2024-01-31T05:04:47.576 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:04:47.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.575+0000 7f8cce000640 1 -- 172.21.15.49:0/1665428034 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8ca0066500 msgr2=0x7f8ca00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.575+0000 7f8cce000640 1 --2- 172.21.15.49:0/1665428034 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8ca0066500 0x7f8ca00689c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00ad000 tx=0x7f8cb0008040 comp rx=0 tx=0).stop 2024-01-31T05:04:47.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.575+0000 7f8cce000640 1 -- 172.21.15.49:0/1665428034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cc806a770 msgr2=0x7f8cc8145120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.575+0000 7f8cce000640 1 --2- 172.21.15.49:0/1665428034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cc806a770 0x7f8cc8145120 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8cb800e890 tx=0x7f8cb800ed50 comp rx=0 tx=0).stop 2024-01-31T05:04:47.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.575+0000 7f8cce000640 1 -- 172.21.15.49:0/1665428034 shutdown_connections 2024-01-31T05:04:47.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.575+0000 7f8cce000640 1 --2- 172.21.15.49:0/1665428034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cc80cf140 0x7f8cc80b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.575+0000 7f8cce000640 1 --2- 172.21.15.49:0/1665428034 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8ca0066500 0x7f8ca00689c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.575+0000 7f8cce000640 1 --2- 172.21.15.49:0/1665428034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cc806f0b0 0x7f8cc814e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.575+0000 7f8cce000640 1 --2- 172.21.15.49:0/1665428034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cc806a770 0x7f8cc8145120 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.575+0000 7f8cce000640 1 -- 172.21.15.49:0/1665428034 >> 172.21.15.49:0/1665428034 conn(0x7f8cc80b1ab0 msgr2=0x7f8cc80b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:47.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.575+0000 7f8cce000640 1 -- 172.21.15.49:0/1665428034 shutdown_connections 2024-01-31T05:04:47.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.575+0000 7f8cce000640 1 -- 172.21.15.49:0/1665428034 wait complete. 2024-01-31T05:04:47.598 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:04:47.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.739+0000 7f3178c00640 1 Processor -- start 2024-01-31T05:04:47.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.739+0000 7f3178c00640 1 -- start start 2024-01-31T05:04:47.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.739+0000 7f3178c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3174070660 0x7f3174070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.739+0000 7f3178c00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f31740ac050 0x7f31740ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.739+0000 7f3178c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3174071000 con 0x7f3174159790 2024-01-31T05:04:47.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.739+0000 7f3178c00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3174159b70 con 0x7f31740ac050 2024-01-31T05:04:47.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.739+0000 7f3178c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31740b2750 con 0x7f3174070660 2024-01-31T05:04:47.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.739+0000 7f3172800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f31740ac050 0x7f31740ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.743+0000 7f3172800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f31740ac050 0x7f31740ac4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38808/0 (socket says 172.21.15.49:38808) 2024-01-31T05:04:47.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.743+0000 7f3172800640 1 -- 172.21.15.49:0/716212818 learned_addr learned my addr 172.21.15.49:0/716212818 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:47.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.743+0000 7f3171400640 1 --2- 172.21.15.49:0/716212818 >> v2:172.21.15.195:3300/0 conn(0x7f3174070660 0x7f3174070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.743+0000 7f3172800640 1 -- 172.21.15.49:0/716212818 >> v2:172.21.15.195:3300/0 conn(0x7f3174070660 msgr2=0x7f3174070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:47.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.743+0000 7f3172800640 1 --2- 172.21.15.49:0/716212818 >> v2:172.21.15.195:3300/0 conn(0x7f3174070660 0x7f3174070ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.743+0000 7f3172800640 1 -- 172.21.15.49:0/716212818 >> v1:172.21.15.195:6789/0 conn(0x7f3174159790 legacy=0x7f31740b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.743+0000 7f3172800640 1 -- 172.21.15.49:0/716212818 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31740b2a30 con 0x7f31740ac050 2024-01-31T05:04:47.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.743+0000 7f3172800640 1 --2- 172.21.15.49:0/716212818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31740ac050 0x7f31740ac4c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3174072cb0 tx=0x7f316c01dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3e624b9655ac98 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:47.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.743+0000 7f3170a00640 1 -- 172.21.15.49:0/716212818 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c0a68f0 con 0x7f31740ac050 2024-01-31T05:04:47.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.743+0000 7f3170a00640 1 -- 172.21.15.49:0/716212818 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316c0a6a50 con 0x7f31740ac050 2024-01-31T05:04:47.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.743+0000 7f3170a00640 1 -- 172.21.15.49:0/716212818 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c0a6de0 con 0x7f31740ac050 2024-01-31T05:04:47.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3178c00640 1 -- 172.21.15.49:0/716212818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31740ac050 msgr2=0x7f31740ac4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3178c00640 1 --2- 172.21.15.49:0/716212818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31740ac050 0x7f31740ac4c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3174072cb0 tx=0x7f316c01dab0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3178c00640 1 -- 172.21.15.49:0/716212818 shutdown_connections 2024-01-31T05:04:47.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3178c00640 1 --2- 172.21.15.49:0/716212818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31740ac050 0x7f31740ac4c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3178c00640 1 --2- 172.21.15.49:0/716212818 >> v2:172.21.15.195:3300/0 conn(0x7f3174070660 0x7f3174070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3178c00640 1 -- 172.21.15.49:0/716212818 >> 172.21.15.49:0/716212818 conn(0x7f31740b09a0 msgr2=0x7f31740b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:47.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3178c00640 1 -- 172.21.15.49:0/716212818 shutdown_connections 2024-01-31T05:04:47.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3178c00640 1 -- 172.21.15.49:0/716212818 wait complete. 2024-01-31T05:04:47.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3178c00640 1 Processor -- start 2024-01-31T05:04:47.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3178c00640 1 -- start start 2024-01-31T05:04:47.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3178c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3174070660 0x7f317414c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3178c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31740ac050 0x7f31740cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3178c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3174159790 0x7f31740cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3178c00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3174152e50 con 0x7f3174070660 2024-01-31T05:04:47.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3178c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31741521d0 con 0x7f31740ac050 2024-01-31T05:04:47.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3178c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31741524b0 con 0x7f3174159790 2024-01-31T05:04:47.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3171e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3174070660 0x7f317414c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3171e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3174070660 0x7f317414c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38820/0 (socket says 172.21.15.49:38820) 2024-01-31T05:04:47.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3171e00640 1 -- 172.21.15.49:0/606091843 learned_addr learned my addr 172.21.15.49:0/606091843 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:47.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3171400640 1 --2- 172.21.15.49:0/606091843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31740ac050 0x7f31740cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.747+0000 7f3172800640 1 --2- 172.21.15.49:0/606091843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3174159790 0x7f31740cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.751+0000 7f3171e00640 1 -- 172.21.15.49:0/606091843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3174159790 msgr2=0x7f31740cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.751+0000 7f3171e00640 1 --2- 172.21.15.49:0/606091843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3174159790 0x7f31740cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.751+0000 7f3171e00640 1 -- 172.21.15.49:0/606091843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31740ac050 msgr2=0x7f31740cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.751+0000 7f3171e00640 1 --2- 172.21.15.49:0/606091843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31740ac050 0x7f31740cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.751+0000 7f3171e00640 1 -- 172.21.15.49:0/606091843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c009b30 con 0x7f3174070660 2024-01-31T05:04:47.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.751+0000 7f3171e00640 1 --2- 172.21.15.49:0/606091843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3174070660 0x7f317414c590 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f316400c370 tx=0x7f316400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:47.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.751+0000 7f316a000640 1 -- 172.21.15.49:0/606091843 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31640052d0 con 0x7f3174070660 2024-01-31T05:04:47.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.751+0000 7f316a000640 1 -- 172.21.15.49:0/606091843 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3164005430 con 0x7f3174070660 2024-01-31T05:04:47.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.751+0000 7f316a000640 1 -- 172.21.15.49:0/606091843 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3164007260 con 0x7f3174070660 2024-01-31T05:04:47.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.751+0000 7f3178c00640 1 -- 172.21.15.49:0/606091843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3174152790 con 0x7f3174070660 2024-01-31T05:04:47.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.751+0000 7f3178c00640 1 -- 172.21.15.49:0/606091843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317414cad0 con 0x7f3174070660 2024-01-31T05:04:47.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.751+0000 7f3178c00640 1 -- 172.21.15.49:0/606091843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3174074860 con 0x7f3174070660 2024-01-31T05:04:47.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.751+0000 7f316a000640 1 -- 172.21.15.49:0/606091843 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f31640073c0 con 0x7f3174070660 2024-01-31T05:04:47.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.751+0000 7f316a000640 1 --2- 172.21.15.49:0/606091843 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f314c066500 0x7f314c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.751+0000 7f316a000640 1 -- 172.21.15.49:0/606091843 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f31640834a0 con 0x7f3174070660 2024-01-31T05:04:47.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.755+0000 7f3171400640 1 --2- 172.21.15.49:0/606091843 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f314c066500 0x7f314c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.755+0000 7f3171400640 1 --2- 172.21.15.49:0/606091843 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f314c066500 0x7f314c0689c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3174067350 tx=0x7f315c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:47.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.755+0000 7f316a000640 1 -- 172.21.15.49:0/606091843 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f3164050500 con 0x7f3174070660 2024-01-31T05:04:47.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.915+0000 7f3178c00640 1 -- 172.21.15.49:0/606091843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3174157a10 con 0x7f3174070660 2024-01-31T05:04:47.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.919+0000 7f316a000640 1 -- 172.21.15.49:0/606091843 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3164053b20 con 0x7f3174070660 2024-01-31T05:04:47.919 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:04:47.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.919+0000 7f3178c00640 1 -- 172.21.15.49:0/606091843 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f314c066500 msgr2=0x7f314c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.919+0000 7f3178c00640 1 --2- 172.21.15.49:0/606091843 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f314c066500 0x7f314c0689c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3174067350 tx=0x7f315c009190 comp rx=0 tx=0).stop 2024-01-31T05:04:47.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.919+0000 7f3178c00640 1 -- 172.21.15.49:0/606091843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3174070660 msgr2=0x7f317414c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.919+0000 7f3178c00640 1 --2- 172.21.15.49:0/606091843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3174070660 0x7f317414c590 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f316400c370 tx=0x7f316400c830 comp rx=0 tx=0).stop 2024-01-31T05:04:47.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.919+0000 7f3178c00640 1 -- 172.21.15.49:0/606091843 shutdown_connections 2024-01-31T05:04:47.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.919+0000 7f3178c00640 1 --2- 172.21.15.49:0/606091843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3174159790 0x7f31740cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.919+0000 7f3178c00640 1 --2- 172.21.15.49:0/606091843 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f314c066500 0x7f314c0689c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.919+0000 7f3178c00640 1 --2- 172.21.15.49:0/606091843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31740ac050 0x7f31740cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.919+0000 7f3178c00640 1 --2- 172.21.15.49:0/606091843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3174070660 0x7f317414c590 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.919+0000 7f3178c00640 1 -- 172.21.15.49:0/606091843 >> 172.21.15.49:0/606091843 conn(0x7f31740b09a0 msgr2=0x7f3174157300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:47.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.919+0000 7f3178c00640 1 -- 172.21.15.49:0/606091843 shutdown_connections 2024-01-31T05:04:47.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:47.919+0000 7f3178c00640 1 -- 172.21.15.49:0/606091843 wait complete. 2024-01-31T05:04:47.941 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:04:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.083+0000 7f9cb1800640 1 Processor -- start 2024-01-31T05:04:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.083+0000 7f9cb1800640 1 -- start start 2024-01-31T05:04:48.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.087+0000 7f9cb1800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9cac070ac0 0x7f9cac0ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:48.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.087+0000 7f9cb1800640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cac159b70 con 0x7f9cac159790 2024-01-31T05:04:48.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.087+0000 7f9cb1800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cac0b2750 con 0x7f9cac070660 2024-01-31T05:04:48.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.087+0000 7f9cb1800640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cac0b2a30 con 0x7f9cac070ac0 2024-01-31T05:04:48.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.087+0000 7f9caaa00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9cac159790 0x7f9cac0b37c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57892/0 (socket says 172.21.15.49:57892) 2024-01-31T05:04:48.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.087+0000 7f9caaa00640 1 -- 172.21.15.49:0/1802071769 learned_addr learned my addr 172.21.15.49:0/1802071769 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:48.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.087+0000 7f9cab400640 1 --2- 172.21.15.49:0/1802071769 >> v2:172.21.15.49:3300/0 conn(0x7f9cac070ac0 0x7f9cac0ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:48.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.087+0000 7f9cab400640 1 -- 172.21.15.49:0/1802071769 >> v1:172.21.15.195:6789/0 conn(0x7f9cac070660 legacy=0x7f9cac0ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:48.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.087+0000 7f9cab400640 1 -- 172.21.15.49:0/1802071769 >> v1:172.21.15.49:6789/0 conn(0x7f9cac159790 legacy=0x7f9cac0b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:48.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.087+0000 7f9cab400640 1 -- 172.21.15.49:0/1802071769 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac0b2d10 con 0x7f9cac070ac0 2024-01-31T05:04:48.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.087+0000 7f9cab400640 1 --2- 172.21.15.49:0/1802071769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cac070ac0 0x7f9cac0ac760 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009d90 tx=0x7f9ca401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74672689ee8b8189 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:48.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.091+0000 7f9ca9600640 1 -- 172.21.15.49:0/1802071769 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca40a5920 con 0x7f9cac070ac0 2024-01-31T05:04:48.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.091+0000 7f9ca9600640 1 -- 172.21.15.49:0/1802071769 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca40a5a80 con 0x7f9cac070ac0 2024-01-31T05:04:48.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.091+0000 7f9ca9600640 1 -- 172.21.15.49:0/1802071769 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca40a5e10 con 0x7f9cac070ac0 2024-01-31T05:04:48.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.091+0000 7f9cb1800640 1 -- 172.21.15.49:0/1802071769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cac070ac0 msgr2=0x7f9cac0ac760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:48.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.091+0000 7f9cb1800640 1 --2- 172.21.15.49:0/1802071769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cac070ac0 0x7f9cac0ac760 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009d90 tx=0x7f9ca401c8f0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.091+0000 7f9cb1800640 1 -- 172.21.15.49:0/1802071769 shutdown_connections 2024-01-31T05:04:48.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.091+0000 7f9cb1800640 1 --2- 172.21.15.49:0/1802071769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cac070ac0 0x7f9cac0ac760 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.091+0000 7f9cb1800640 1 -- 172.21.15.49:0/1802071769 >> 172.21.15.49:0/1802071769 conn(0x7f9cac0b09a0 msgr2=0x7f9cac0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:48.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.091+0000 7f9cb1800640 1 -- 172.21.15.49:0/1802071769 shutdown_connections 2024-01-31T05:04:48.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.091+0000 7f9cb1800640 1 -- 172.21.15.49:0/1802071769 wait complete. 2024-01-31T05:04:48.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.091+0000 7f9cb1800640 1 Processor -- start 2024-01-31T05:04:48.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.091+0000 7f9cb1800640 1 -- start start 2024-01-31T05:04:48.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.091+0000 7f9cb1800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cac070660 0x7f9cac141dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:48.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.091+0000 7f9cb1800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9cac070ac0 0x7f9cac0ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:48.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.091+0000 7f9cb1800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cac159790 0x7f9cac0ae610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:48.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.091+0000 7f9cb1800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac1521e0 con 0x7f9cac070660 2024-01-31T05:04:48.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.091+0000 7f9cb1800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac1515d0 con 0x7f9cac159790 2024-01-31T05:04:48.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.091+0000 7f9cb1800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac1518b0 con 0x7f9cac070ac0 2024-01-31T05:04:48.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.095+0000 7f9caaa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cac070660 0x7f9cac141dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:48.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.095+0000 7f9caaa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cac070660 0x7f9cac141dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38830/0 (socket says 172.21.15.49:38830) 2024-01-31T05:04:48.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.095+0000 7f9caaa00640 1 -- 172.21.15.49:0/2362632655 learned_addr learned my addr 172.21.15.49:0/2362632655 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:48.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.095+0000 7f9cab400640 1 --2- 172.21.15.49:0/2362632655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cac159790 0x7f9cac0ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:48.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.095+0000 7f9caa000640 1 --2- 172.21.15.49:0/2362632655 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9cac070ac0 0x7f9cac0ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:48.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.095+0000 7f9caaa00640 1 -- 172.21.15.49:0/2362632655 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9cac070ac0 msgr2=0x7f9cac0ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:48.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.095+0000 7f9caaa00640 1 --2- 172.21.15.49:0/2362632655 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9cac070ac0 0x7f9cac0ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.095+0000 7f9caaa00640 1 -- 172.21.15.49:0/2362632655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cac159790 msgr2=0x7f9cac0ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:48.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.095+0000 7f9caaa00640 1 --2- 172.21.15.49:0/2362632655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cac159790 0x7f9cac0ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.095+0000 7f9caaa00640 1 -- 172.21.15.49:0/2362632655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca4009a70 con 0x7f9cac070660 2024-01-31T05:04:48.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.095+0000 7f9caaa00640 1 --2- 172.21.15.49:0/2362632655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cac070660 0x7f9cac141dd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00c400 tx=0x7f9c9c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:48.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.095+0000 7f9ca2a00640 1 -- 172.21.15.49:0/2362632655 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c005cf0 con 0x7f9cac070660 2024-01-31T05:04:48.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.095+0000 7f9ca2a00640 1 -- 172.21.15.49:0/2362632655 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9c005e50 con 0x7f9cac070660 2024-01-31T05:04:48.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.095+0000 7f9ca2a00640 1 -- 172.21.15.49:0/2362632655 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c0072d0 con 0x7f9cac070660 2024-01-31T05:04:48.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.095+0000 7f9cb1800640 1 -- 172.21.15.49:0/2362632655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cac151b90 con 0x7f9cac070660 2024-01-31T05:04:48.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.095+0000 7f9cb1800640 1 -- 172.21.15.49:0/2362632655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cac1512a0 con 0x7f9cac070660 2024-01-31T05:04:48.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.095+0000 7f9cb1800640 1 -- 172.21.15.49:0/2362632655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cac074860 con 0x7f9cac070660 2024-01-31T05:04:48.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.095+0000 7f9ca2a00640 1 -- 172.21.15.49:0/2362632655 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f9c9c007430 con 0x7f9cac070660 2024-01-31T05:04:48.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.099+0000 7f9ca2a00640 1 --2- 172.21.15.49:0/2362632655 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9c84066530 0x7f9c840689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:48.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.099+0000 7f9ca2a00640 1 -- 172.21.15.49:0/2362632655 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9c9c0835f0 con 0x7f9cac070660 2024-01-31T05:04:48.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.099+0000 7f9caa000640 1 --2- 172.21.15.49:0/2362632655 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9c84066530 0x7f9c840689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:48.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.099+0000 7f9caa000640 1 --2- 172.21.15.49:0/2362632655 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9c84066530 0x7f9c840689f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0b04e0 tx=0x7f9c94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:48.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.103+0000 7f9ca2a00640 1 -- 172.21.15.49:0/2362632655 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9c9c050650 con 0x7f9cac070660 2024-01-31T05:04:48.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.263+0000 7f9cb1800640 1 -- 172.21.15.49:0/2362632655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9cac06d1f0 con 0x7f9cac070660 2024-01-31T05:04:48.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.263+0000 7f9ca2a00640 1 -- 172.21.15.49:0/2362632655 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c9c053c70 con 0x7f9cac070660 2024-01-31T05:04:48.264 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-31T05:04:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.263+0000 7f9cb1800640 1 -- 172.21.15.49:0/2362632655 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9c84066530 msgr2=0x7f9c840689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.263+0000 7f9cb1800640 1 --2- 172.21.15.49:0/2362632655 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9c84066530 0x7f9c840689f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0b04e0 tx=0x7f9c94009040 comp rx=0 tx=0).stop 2024-01-31T05:04:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.263+0000 7f9cb1800640 1 -- 172.21.15.49:0/2362632655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cac070660 msgr2=0x7f9cac141dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.263+0000 7f9cb1800640 1 --2- 172.21.15.49:0/2362632655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cac070660 0x7f9cac141dd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00c400 tx=0x7f9c9c00c8c0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.263+0000 7f9cb1800640 1 -- 172.21.15.49:0/2362632655 shutdown_connections 2024-01-31T05:04:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.263+0000 7f9cb1800640 1 --2- 172.21.15.49:0/2362632655 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9c84066530 0x7f9c840689f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.263+0000 7f9cb1800640 1 --2- 172.21.15.49:0/2362632655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cac159790 0x7f9cac0ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.263+0000 7f9cb1800640 1 --2- 172.21.15.49:0/2362632655 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9cac070ac0 0x7f9cac0ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.263+0000 7f9cb1800640 1 --2- 172.21.15.49:0/2362632655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cac070660 0x7f9cac141dd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.263+0000 7f9cb1800640 1 -- 172.21.15.49:0/2362632655 >> 172.21.15.49:0/2362632655 conn(0x7f9cac0b09a0 msgr2=0x7f9cac06cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.263+0000 7f9cb1800640 1 -- 172.21.15.49:0/2362632655 shutdown_connections 2024-01-31T05:04:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.263+0000 7f9cb1800640 1 -- 172.21.15.49:0/2362632655 wait complete. 2024-01-31T05:04:48.286 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-31T05:04:48.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.431+0000 7faad7800640 1 Processor -- start 2024-01-31T05:04:48.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.431+0000 7faad7800640 1 -- start start 2024-01-31T05:04:48.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.431+0000 7faad7800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faad015b110 0x7faad006c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:48.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.431+0000 7faad7800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faad00714e0 0x7faad00ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:48.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.431+0000 7faad7800640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad015b4f0 con 0x7faad00cdf10 2024-01-31T05:04:48.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.431+0000 7faad7800640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad00ce460 con 0x7faad015b110 2024-01-31T05:04:48.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.431+0000 7faad7800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad00abf20 con 0x7faad00714e0 2024-01-31T05:04:48.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.431+0000 7faad4e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faad015b110 0x7faad006c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:48.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.431+0000 7faad4e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faad015b110 0x7faad006c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56500/0 (socket says 172.21.15.49:56500) 2024-01-31T05:04:48.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.431+0000 7faad4e00640 1 -- 172.21.15.49:0/1389104106 learned_addr learned my addr 172.21.15.49:0/1389104106 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:48.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.431+0000 7faad5800640 1 --2- 172.21.15.49:0/1389104106 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faad00714e0 0x7faad00ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:48.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.431+0000 7faad4e00640 1 -- 172.21.15.49:0/1389104106 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faad00714e0 msgr2=0x7faad00ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:48.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.431+0000 7faad4e00640 1 --2- 172.21.15.49:0/1389104106 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faad00714e0 0x7faad00ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.431+0000 7faad4e00640 1 -- 172.21.15.49:0/1389104106 >> v1:172.21.15.49:6789/0 conn(0x7faad00cdf10 legacy=0x7faad0070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:48.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.431+0000 7faad4e00640 1 -- 172.21.15.49:0/1389104106 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad00ac200 con 0x7faad015b110 2024-01-31T05:04:48.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.431+0000 7faacf400640 1 -- 172.21.15.49:0/1389104106 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623228827 0 0) 0x7faab8001120 con 0x7faad00cdf10 2024-01-31T05:04:48.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.431+0000 7faad5800640 1 --2- 172.21.15.49:0/1389104106 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faad00714e0 0x7faad00ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:48.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.435+0000 7faad4e00640 1 --2- 172.21.15.49:0/1389104106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad015b110 0x7faad006c2d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faac0009870 tx=0x7faac001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a02d725f8eaff51 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:48.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.435+0000 7faacf400640 1 -- 172.21.15.49:0/1389104106 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac00a95f0 con 0x7faad015b110 2024-01-31T05:04:48.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.435+0000 7faacf400640 1 -- 172.21.15.49:0/1389104106 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac00a9750 con 0x7faad015b110 2024-01-31T05:04:48.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.435+0000 7faacf400640 1 -- 172.21.15.49:0/1389104106 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac00a9ae0 con 0x7faad015b110 2024-01-31T05:04:48.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.435+0000 7faad7800640 1 -- 172.21.15.49:0/1389104106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad015b110 msgr2=0x7faad006c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:48.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.435+0000 7faad7800640 1 --2- 172.21.15.49:0/1389104106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad015b110 0x7faad006c2d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faac0009870 tx=0x7faac001c510 comp rx=0 tx=0).stop 2024-01-31T05:04:48.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.435+0000 7faad7800640 1 -- 172.21.15.49:0/1389104106 shutdown_connections 2024-01-31T05:04:48.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.435+0000 7faad7800640 1 --2- 172.21.15.49:0/1389104106 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faad00714e0 0x7faad00ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.435+0000 7faad7800640 1 --2- 172.21.15.49:0/1389104106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad015b110 0x7faad006c2d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.435+0000 7faad7800640 1 -- 172.21.15.49:0/1389104106 >> 172.21.15.49:0/1389104106 conn(0x7faad00b09a0 msgr2=0x7faad00b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:48.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.435+0000 7faad7800640 1 -- 172.21.15.49:0/1389104106 shutdown_connections 2024-01-31T05:04:48.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.435+0000 7faad7800640 1 -- 172.21.15.49:0/1389104106 wait complete. 2024-01-31T05:04:48.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faad7800640 1 Processor -- start 2024-01-31T05:04:48.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faad7800640 1 -- start start 2024-01-31T05:04:48.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faad7800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faad00714e0 0x7faad0151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:48.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faad7800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad00cdf10 0x7faad015d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:48.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faad7800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faad015b110 0x7faad015d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:48.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faad7800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad015e290 con 0x7faad00cdf10 2024-01-31T05:04:48.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faad7800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad014b020 con 0x7faad015b110 2024-01-31T05:04:48.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faad7800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad015dcd0 con 0x7faad00714e0 2024-01-31T05:04:48.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faacfe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad00cdf10 0x7faad015d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:48.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faacfe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad00cdf10 0x7faad015d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56510/0 (socket says 172.21.15.49:56510) 2024-01-31T05:04:48.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faacfe00640 1 -- 172.21.15.49:0/4290885110 learned_addr learned my addr 172.21.15.49:0/4290885110 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:48.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faad4e00640 1 --2- 172.21.15.49:0/4290885110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faad00714e0 0x7faad0151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:48.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faad5800640 1 --2- 172.21.15.49:0/4290885110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faad015b110 0x7faad015d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:48.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faacfe00640 1 -- 172.21.15.49:0/4290885110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faad00714e0 msgr2=0x7faad0151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:48.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faacfe00640 1 --2- 172.21.15.49:0/4290885110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faad00714e0 0x7faad0151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faacfe00640 1 -- 172.21.15.49:0/4290885110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faad015b110 msgr2=0x7faad015d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:48.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faacfe00640 1 --2- 172.21.15.49:0/4290885110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faad015b110 0x7faad015d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faacfe00640 1 -- 172.21.15.49:0/4290885110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac00094d0 con 0x7faad00cdf10 2024-01-31T05:04:48.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faacfe00640 1 --2- 172.21.15.49:0/4290885110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad00cdf10 0x7faad015d1b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faab8001ec0 tx=0x7faab800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:48.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faaccc00640 1 -- 172.21.15.49:0/4290885110 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab80054e0 con 0x7faad00cdf10 2024-01-31T05:04:48.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faaccc00640 1 -- 172.21.15.49:0/4290885110 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab8003600 con 0x7faad00cdf10 2024-01-31T05:04:48.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faaccc00640 1 -- 172.21.15.49:0/4290885110 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab80039b0 con 0x7faad00cdf10 2024-01-31T05:04:48.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faad7800640 1 -- 172.21.15.49:0/4290885110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad015dfb0 con 0x7faad00cdf10 2024-01-31T05:04:48.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faad7800640 1 -- 172.21.15.49:0/4290885110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad015c520 con 0x7faad00cdf10 2024-01-31T05:04:48.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.439+0000 7faad7800640 1 -- 172.21.15.49:0/4290885110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad015c740 con 0x7faad00cdf10 2024-01-31T05:04:48.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.443+0000 7faaccc00640 1 -- 172.21.15.49:0/4290885110 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7faab8003b10 con 0x7faad00cdf10 2024-01-31T05:04:48.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.443+0000 7faaccc00640 1 --2- 172.21.15.49:0/4290885110 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7faaa8066500 0x7faaa80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:48.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.443+0000 7faaccc00640 1 -- 172.21.15.49:0/4290885110 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faab80835d0 con 0x7faad00cdf10 2024-01-31T05:04:48.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.443+0000 7faad4e00640 1 --2- 172.21.15.49:0/4290885110 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7faaa8066500 0x7faaa80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:48.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.443+0000 7faad4e00640 1 --2- 172.21.15.49:0/4290885110 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7faaa8066500 0x7faaa80689c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faac00ae000 tx=0x7faac00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:48.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.447+0000 7faaccc00640 1 -- 172.21.15.49:0/4290885110 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7faab8050590 con 0x7faad00cdf10 2024-01-31T05:04:48.538 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:04:48.542 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:04:48.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.611+0000 7faad7800640 1 -- 172.21.15.49:0/4290885110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faad015b4f0 con 0x7faad00cdf10 2024-01-31T05:04:48.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.611+0000 7faaccc00640 1 -- 172.21.15.49:0/4290885110 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7faad015b4f0 con 0x7faad00cdf10 2024-01-31T05:04:48.611 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:04:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.611+0000 7faad7800640 1 -- 172.21.15.49:0/4290885110 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7faaa8066500 msgr2=0x7faaa80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.611+0000 7faad7800640 1 --2- 172.21.15.49:0/4290885110 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7faaa8066500 0x7faaa80689c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faac00ae000 tx=0x7faac00a7000 comp rx=0 tx=0).stop 2024-01-31T05:04:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.611+0000 7faad7800640 1 -- 172.21.15.49:0/4290885110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad00cdf10 msgr2=0x7faad015d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.611+0000 7faad7800640 1 --2- 172.21.15.49:0/4290885110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad00cdf10 0x7faad015d1b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faab8001ec0 tx=0x7faab800c8e0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.611+0000 7faad7800640 1 -- 172.21.15.49:0/4290885110 shutdown_connections 2024-01-31T05:04:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.611+0000 7faad7800640 1 --2- 172.21.15.49:0/4290885110 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7faaa8066500 0x7faaa80689c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.611+0000 7faad7800640 1 --2- 172.21.15.49:0/4290885110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faad015b110 0x7faad015d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.611+0000 7faad7800640 1 --2- 172.21.15.49:0/4290885110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faad00cdf10 0x7faad015d1b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.611+0000 7faad7800640 1 --2- 172.21.15.49:0/4290885110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faad00714e0 0x7faad0151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.611+0000 7faad7800640 1 -- 172.21.15.49:0/4290885110 >> 172.21.15.49:0/4290885110 conn(0x7faad00b09a0 msgr2=0x7faad014e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:48.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.611+0000 7faad7800640 1 -- 172.21.15.49:0/4290885110 shutdown_connections 2024-01-31T05:04:48.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.611+0000 7faad7800640 1 -- 172.21.15.49:0/4290885110 wait complete. 2024-01-31T05:04:48.634 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:04:48.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.811+0000 7f595a400640 1 Processor -- start 2024-01-31T05:04:48.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.811+0000 7f595a400640 1 -- start start 2024-01-31T05:04:48.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.815+0000 7f595a400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f59540703c0 0x7f59540af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:48.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.815+0000 7f595a400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59540d1e00 con 0x7f595415e770 2024-01-31T05:04:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.815+0000 7f595a400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59540cf220 con 0x7f595406fe70 2024-01-31T05:04:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.815+0000 7f595a400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595406fcc0 con 0x7f59540703c0 2024-01-31T05:04:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.815+0000 7f5953400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f595415e770 0x7f59540cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53172/0 (socket says 172.21.15.49:53172) 2024-01-31T05:04:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.815+0000 7f5953400640 1 -- 172.21.15.49:0/3023363584 learned_addr learned my addr 172.21.15.49:0/3023363584 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.815+0000 7f5953e00640 1 --2- 172.21.15.49:0/3023363584 >> v2:172.21.15.49:3300/0 conn(0x7f59540703c0 0x7f59540af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.815+0000 7f5953e00640 1 -- 172.21.15.49:0/3023363584 >> v1:172.21.15.195:6789/0 conn(0x7f595406fe70 legacy=0x7f595406e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.815+0000 7f5953e00640 1 -- 172.21.15.49:0/3023363584 >> v1:172.21.15.49:6789/0 conn(0x7f595415e770 legacy=0x7f59540cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:48.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.815+0000 7f5953e00640 1 -- 172.21.15.49:0/3023363584 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59540cfd00 con 0x7f59540703c0 2024-01-31T05:04:48.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.819+0000 7f5953e00640 1 --2- 172.21.15.49:0/3023363584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59540703c0 0x7f59540af5d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f594c009d90 tx=0x7f594c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd44e8b2f9388ce server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:48.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.819+0000 7f5952000640 1 -- 172.21.15.49:0/3023363584 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c0a58b0 con 0x7f59540703c0 2024-01-31T05:04:48.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.819+0000 7f5952000640 1 -- 172.21.15.49:0/3023363584 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594c0a5a10 con 0x7f59540703c0 2024-01-31T05:04:48.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.819+0000 7f5952000640 1 -- 172.21.15.49:0/3023363584 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c0a5da0 con 0x7f59540703c0 2024-01-31T05:04:48.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.819+0000 7f595a400640 1 -- 172.21.15.49:0/3023363584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59540703c0 msgr2=0x7f59540af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:48.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.819+0000 7f595a400640 1 --2- 172.21.15.49:0/3023363584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59540703c0 0x7f59540af5d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f594c009d90 tx=0x7f594c01c8e0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.819+0000 7f595a400640 1 -- 172.21.15.49:0/3023363584 shutdown_connections 2024-01-31T05:04:48.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.819+0000 7f595a400640 1 --2- 172.21.15.49:0/3023363584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59540703c0 0x7f59540af5d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.819+0000 7f595a400640 1 -- 172.21.15.49:0/3023363584 >> 172.21.15.49:0/3023363584 conn(0x7f59540d0e60 msgr2=0x7f59540d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:48.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.819+0000 7f595a400640 1 -- 172.21.15.49:0/3023363584 shutdown_connections 2024-01-31T05:04:48.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.819+0000 7f595a400640 1 -- 172.21.15.49:0/3023363584 wait complete. 2024-01-31T05:04:48.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.819+0000 7f595a400640 1 Processor -- start 2024-01-31T05:04:48.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.819+0000 7f595a400640 1 -- start start 2024-01-31T05:04:48.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f595a400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f595406fe70 0x7f59540c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:48.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f595a400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59540703c0 0x7f59540c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:48.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f595a400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f595415e770 0x7f59540ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:48.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f595a400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595406f6a0 con 0x7f59540703c0 2024-01-31T05:04:48.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f595a400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59540c4d30 con 0x7f595406fe70 2024-01-31T05:04:48.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f595a400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59540cc210 con 0x7f595415e770 2024-01-31T05:04:48.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f5952a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59540703c0 0x7f59540c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:48.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f5952a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59540703c0 0x7f59540c9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56528/0 (socket says 172.21.15.49:56528) 2024-01-31T05:04:48.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f5952a00640 1 -- 172.21.15.49:0/3054958473 learned_addr learned my addr 172.21.15.49:0/3054958473 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:48.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f5953400640 1 --2- 172.21.15.49:0/3054958473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f595406fe70 0x7f59540c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:48.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f5953e00640 1 --2- 172.21.15.49:0/3054958473 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f595415e770 0x7f59540ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:48.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f5952a00640 1 -- 172.21.15.49:0/3054958473 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f595415e770 msgr2=0x7f59540ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:48.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f5952a00640 1 --2- 172.21.15.49:0/3054958473 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f595415e770 0x7f59540ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f5952a00640 1 -- 172.21.15.49:0/3054958473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f595406fe70 msgr2=0x7f59540c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:48.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f5952a00640 1 --2- 172.21.15.49:0/3054958473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f595406fe70 0x7f59540c47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:48.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f5952a00640 1 -- 172.21.15.49:0/3054958473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594c009a70 con 0x7f59540703c0 2024-01-31T05:04:48.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f5953400640 1 --2- 172.21.15.49:0/3054958473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f595406fe70 0x7f59540c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:48.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f5952a00640 1 --2- 172.21.15.49:0/3054958473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59540703c0 0x7f59540c9f50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f593c00b410 tx=0x7f593c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:48.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f594b400640 1 -- 172.21.15.49:0/3054958473 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c004020 con 0x7f59540703c0 2024-01-31T05:04:48.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f594b400640 1 -- 172.21.15.49:0/3054958473 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c004180 con 0x7f59540703c0 2024-01-31T05:04:48.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f595a400640 1 -- 172.21.15.49:0/3054958473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59540ccd90 con 0x7f59540703c0 2024-01-31T05:04:48.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f594b400640 1 -- 172.21.15.49:0/3054958473 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c011630 con 0x7f59540703c0 2024-01-31T05:04:48.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f595a400640 1 -- 172.21.15.49:0/3054958473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59540cc740 con 0x7f59540703c0 2024-01-31T05:04:48.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.823+0000 7f595a400640 1 -- 172.21.15.49:0/3054958473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5954068070 con 0x7f59540703c0 2024-01-31T05:04:48.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.827+0000 7f594b400640 1 -- 172.21.15.49:0/3054958473 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f593c011790 con 0x7f59540703c0 2024-01-31T05:04:48.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.827+0000 7f594b400640 1 --2- 172.21.15.49:0/3054958473 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f592c066500 0x7f592c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:48.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.827+0000 7f594b400640 1 -- 172.21.15.49:0/3054958473 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f593c083f70 con 0x7f59540703c0 2024-01-31T05:04:48.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.827+0000 7f5953400640 1 --2- 172.21.15.49:0/3054958473 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f592c066500 0x7f592c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:48.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.827+0000 7f5953400640 1 --2- 172.21.15.49:0/3054958473 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f592c066500 0x7f592c0689c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5944000f70 tx=0x7f5944009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:48.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:48.831+0000 7f594b400640 1 -- 172.21.15.49:0/3054958473 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f593c050df0 con 0x7f59540703c0 2024-01-31T05:04:49.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.023+0000 7f595a400640 1 -- 172.21.15.49:0/3054958473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5954074860 con 0x7f59540703c0 2024-01-31T05:04:49.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.023+0000 7f594b400640 1 -- 172.21.15.49:0/3054958473 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7f593c015070 con 0x7f59540703c0 2024-01-31T05:04:49.025 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:49.025 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2308601440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2308601440},{"type":"v1","addr":"172.21.15.49:6835","nonce":2308601440}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2920530340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":2920530340},{"type":"v1","addr":"172.21.15.195:6836","nonce":2920530340}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3114317228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3114317228},{"type":"v1","addr":"172.21.15.195:6837","nonce":3114317228}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-31T05:04:16.248649+0000","modified":"2024-01-31T05:04:39.667986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/4254852793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4254852793},{"type":"v1","addr":"172.21.15.49:6834","nonce":4254852793}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:04:49.025 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2024-01-31T05:04:49.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.023+0000 7f595a400640 1 -- 172.21.15.49:0/3054958473 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f592c066500 msgr2=0x7f592c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:49.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.023+0000 7f595a400640 1 --2- 172.21.15.49:0/3054958473 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f592c066500 0x7f592c0689c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5944000f70 tx=0x7f5944009040 comp rx=0 tx=0).stop 2024-01-31T05:04:49.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.023+0000 7f595a400640 1 -- 172.21.15.49:0/3054958473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59540703c0 msgr2=0x7f59540c9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:49.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.023+0000 7f595a400640 1 --2- 172.21.15.49:0/3054958473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59540703c0 0x7f59540c9f50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f593c00b410 tx=0x7f593c00b8d0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.023+0000 7f595a400640 1 -- 172.21.15.49:0/3054958473 shutdown_connections 2024-01-31T05:04:49.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.023+0000 7f595a400640 1 --2- 172.21.15.49:0/3054958473 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f595415e770 0x7f59540ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.023+0000 7f595a400640 1 --2- 172.21.15.49:0/3054958473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59540703c0 0x7f59540c9f50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.023+0000 7f595a400640 1 --2- 172.21.15.49:0/3054958473 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f592c066500 0x7f592c0689c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.023+0000 7f595a400640 1 --2- 172.21.15.49:0/3054958473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f595406fe70 0x7f59540c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.023+0000 7f595a400640 1 -- 172.21.15.49:0/3054958473 >> 172.21.15.49:0/3054958473 conn(0x7f59540d0e60 msgr2=0x7f595406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:49.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.023+0000 7f595a400640 1 -- 172.21.15.49:0/3054958473 shutdown_connections 2024-01-31T05:04:49.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.027+0000 7f595a400640 1 -- 172.21.15.49:0/3054958473 wait complete. 2024-01-31T05:04:49.047 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:04:49.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.187+0000 7f0e65c00640 1 Processor -- start 2024-01-31T05:04:49.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.187+0000 7f0e65c00640 1 -- start start 2024-01-31T05:04:49.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.187+0000 7f0e65c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e6015b110 0x7f0e6006c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:49.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.187+0000 7f0e65c00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e6015b4f0 con 0x7f0e600714e0 2024-01-31T05:04:49.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.187+0000 7f0e65c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e600abf20 con 0x7f0e600cdf10 2024-01-31T05:04:49.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.187+0000 7f0e65c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600ce460 con 0x7f0e6015b110 2024-01-31T05:04:49.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.187+0000 7f0e5f400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0e600714e0 0x7f0e600ad800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53186/0 (socket says 172.21.15.49:53186) 2024-01-31T05:04:49.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.187+0000 7f0e5f400640 1 -- 172.21.15.49:0/4275367412 learned_addr learned my addr 172.21.15.49:0/4275367412 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:49.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.187+0000 7f0e5ea00640 1 --2- 172.21.15.49:0/4275367412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e6015b110 0x7f0e6006c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:49.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.187+0000 7f0e5d600640 1 -- 172.21.15.49:0/4275367412 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2064466134 0 0) 0x7f0e580014a0 con 0x7f0e600714e0 2024-01-31T05:04:49.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.187+0000 7f0e5d600640 1 -- 172.21.15.49:0/4275367412 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e40003530 con 0x7f0e600714e0 2024-01-31T05:04:49.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.187+0000 7f0e5d600640 1 -- 172.21.15.49:0/4275367412 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918488776 0 0) 0x7f0e600abf20 con 0x7f0e600cdf10 2024-01-31T05:04:49.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.187+0000 7f0e5d600640 1 -- 172.21.15.49:0/4275367412 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e580014a0 con 0x7f0e600cdf10 2024-01-31T05:04:49.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.187+0000 7f0e5ea00640 1 -- 172.21.15.49:0/4275367412 >> v1:172.21.15.195:6789/0 conn(0x7f0e600cdf10 legacy=0x7f0e60070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:49.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.187+0000 7f0e5ea00640 1 -- 172.21.15.49:0/4275367412 >> v1:172.21.15.49:6789/0 conn(0x7f0e600714e0 legacy=0x7f0e600ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:49.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.187+0000 7f0e5ea00640 1 -- 172.21.15.49:0/4275367412 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e600ac200 con 0x7f0e6015b110 2024-01-31T05:04:49.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.191+0000 7f0e5ea00640 1 --2- 172.21.15.49:0/4275367412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e6015b110 0x7f0e6006c2d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0e500097f0 tx=0x7f0e5001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=603dd84ef7925d27 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:49.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.191+0000 7f0e5d600640 1 -- 172.21.15.49:0/4275367412 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500ac600 con 0x7f0e6015b110 2024-01-31T05:04:49.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.191+0000 7f0e5d600640 1 -- 172.21.15.49:0/4275367412 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e500a8050 con 0x7f0e6015b110 2024-01-31T05:04:49.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.191+0000 7f0e5d600640 1 -- 172.21.15.49:0/4275367412 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500ac960 con 0x7f0e6015b110 2024-01-31T05:04:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.191+0000 7f0e65c00640 1 -- 172.21.15.49:0/4275367412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e6015b110 msgr2=0x7f0e6006c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.191+0000 7f0e65c00640 1 --2- 172.21.15.49:0/4275367412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e6015b110 0x7f0e6006c2d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0e500097f0 tx=0x7f0e5001c490 comp rx=0 tx=0).stop 2024-01-31T05:04:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.191+0000 7f0e65c00640 1 -- 172.21.15.49:0/4275367412 shutdown_connections 2024-01-31T05:04:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.191+0000 7f0e65c00640 1 --2- 172.21.15.49:0/4275367412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e6015b110 0x7f0e6006c2d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.191+0000 7f0e65c00640 1 -- 172.21.15.49:0/4275367412 >> 172.21.15.49:0/4275367412 conn(0x7f0e600b09a0 msgr2=0x7f0e600b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.191+0000 7f0e65c00640 1 -- 172.21.15.49:0/4275367412 shutdown_connections 2024-01-31T05:04:49.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.191+0000 7f0e65c00640 1 -- 172.21.15.49:0/4275367412 wait complete. 2024-01-31T05:04:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e65c00640 1 Processor -- start 2024-01-31T05:04:49.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e65c00640 1 -- start start 2024-01-31T05:04:49.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e65c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e600714e0 0x7f0e6014e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:49.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e65c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e600cdf10 0x7f0e6014cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:49.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e65c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e6015b110 0x7f0e60140650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:49.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e65c00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6013ec30 con 0x7f0e600cdf10 2024-01-31T05:04:49.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e65c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6014e040 con 0x7f0e6015b110 2024-01-31T05:04:49.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e65c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6014d190 con 0x7f0e600714e0 2024-01-31T05:04:49.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e5e000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e600cdf10 0x7f0e6014cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:49.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e5e000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e600cdf10 0x7f0e6014cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56530/0 (socket says 172.21.15.49:56530) 2024-01-31T05:04:49.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e5e000640 1 -- 172.21.15.49:0/1050075910 learned_addr learned my addr 172.21.15.49:0/1050075910 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:49.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e5f400640 1 --2- 172.21.15.49:0/1050075910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e6015b110 0x7f0e60140650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:49.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e5ea00640 1 --2- 172.21.15.49:0/1050075910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e600714e0 0x7f0e6014e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:49.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e5e000640 1 -- 172.21.15.49:0/1050075910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e600714e0 msgr2=0x7f0e6014e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:49.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e5e000640 1 --2- 172.21.15.49:0/1050075910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e600714e0 0x7f0e6014e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e5e000640 1 -- 172.21.15.49:0/1050075910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e6015b110 msgr2=0x7f0e60140650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:49.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e5e000640 1 --2- 172.21.15.49:0/1050075910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e6015b110 0x7f0e60140650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e5e000640 1 -- 172.21.15.49:0/1050075910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e50009420 con 0x7f0e600cdf10 2024-01-31T05:04:49.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e5e000640 1 --2- 172.21.15.49:0/1050075910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e600cdf10 0x7f0e6014cc50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800c500 tx=0x7f0e4800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:49.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e56a00640 1 -- 172.21.15.49:0/1050075910 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e480052d0 con 0x7f0e600cdf10 2024-01-31T05:04:49.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e56a00640 1 -- 172.21.15.49:0/1050075910 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e48005450 con 0x7f0e600cdf10 2024-01-31T05:04:49.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e65c00640 1 -- 172.21.15.49:0/1050075910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6014d430 con 0x7f0e600cdf10 2024-01-31T05:04:49.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e56a00640 1 -- 172.21.15.49:0/1050075910 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48012870 con 0x7f0e600cdf10 2024-01-31T05:04:49.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.195+0000 7f0e65c00640 1 -- 172.21.15.49:0/1050075910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6014d9f0 con 0x7f0e600cdf10 2024-01-31T05:04:49.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.199+0000 7f0e65c00640 1 -- 172.21.15.49:0/1050075910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e60074860 con 0x7f0e600cdf10 2024-01-31T05:04:49.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.199+0000 7f0e56a00640 1 -- 172.21.15.49:0/1050075910 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f0e480129d0 con 0x7f0e600cdf10 2024-01-31T05:04:49.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.199+0000 7f0e56a00640 1 --2- 172.21.15.49:0/1050075910 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0e38066530 0x7f0e380689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:49.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.199+0000 7f0e56a00640 1 -- 172.21.15.49:0/1050075910 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0e48083cd0 con 0x7f0e600cdf10 2024-01-31T05:04:49.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.199+0000 7f0e5ea00640 1 --2- 172.21.15.49:0/1050075910 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0e38066530 0x7f0e380689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:49.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.199+0000 7f0e5ea00640 1 --2- 172.21.15.49:0/1050075910 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0e38066530 0x7f0e380689f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0e500ae000 tx=0x7f0e500a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:49.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.203+0000 7f0e56a00640 1 -- 172.21.15.49:0/1050075910 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f0e48050ca0 con 0x7f0e600cdf10 2024-01-31T05:04:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.363+0000 7f0e65c00640 1 -- 172.21.15.49:0/1050075910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e6014e180 con 0x7f0e600cdf10 2024-01-31T05:04:49.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.367+0000 7f0e56a00640 1 -- 172.21.15.49:0/1050075910 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18323 (secure 0 0 0) 0x7f0e480542c0 con 0x7f0e600cdf10 2024-01-31T05:04:49.367 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:49.367 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:20.695841+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:04:49.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.367+0000 7f0e65c00640 1 -- 172.21.15.49:0/1050075910 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0e38066530 msgr2=0x7f0e380689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:49.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.367+0000 7f0e65c00640 1 --2- 172.21.15.49:0/1050075910 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0e38066530 0x7f0e380689f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0e500ae000 tx=0x7f0e500a7000 comp rx=0 tx=0).stop 2024-01-31T05:04:49.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.367+0000 7f0e65c00640 1 -- 172.21.15.49:0/1050075910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e600cdf10 msgr2=0x7f0e6014cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:49.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.367+0000 7f0e65c00640 1 --2- 172.21.15.49:0/1050075910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e600cdf10 0x7f0e6014cc50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800c500 tx=0x7f0e4800c9c0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.367+0000 7f0e65c00640 1 -- 172.21.15.49:0/1050075910 shutdown_connections 2024-01-31T05:04:49.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.367+0000 7f0e65c00640 1 --2- 172.21.15.49:0/1050075910 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0e38066530 0x7f0e380689f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.367+0000 7f0e65c00640 1 --2- 172.21.15.49:0/1050075910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e6015b110 0x7f0e60140650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.367+0000 7f0e65c00640 1 --2- 172.21.15.49:0/1050075910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e600cdf10 0x7f0e6014cc50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.367+0000 7f0e65c00640 1 --2- 172.21.15.49:0/1050075910 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e600714e0 0x7f0e6014e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.367+0000 7f0e65c00640 1 -- 172.21.15.49:0/1050075910 >> 172.21.15.49:0/1050075910 conn(0x7f0e600b09a0 msgr2=0x7f0e60099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:49.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.367+0000 7f0e65c00640 1 -- 172.21.15.49:0/1050075910 shutdown_connections 2024-01-31T05:04:49.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.367+0000 7f0e65c00640 1 -- 172.21.15.49:0/1050075910 wait complete. 2024-01-31T05:04:49.390 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:04:14.566345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:04:15.231265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-31T05:04:18.316756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-31T05:04:49.391 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:04:49.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.535+0000 7f683a400640 1 Processor -- start 2024-01-31T05:04:49.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.535+0000 7f683a400640 1 -- start start 2024-01-31T05:04:49.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.535+0000 7f683a400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f683415b110 0x7f683406c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:49.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.535+0000 7f683a400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68340714e0 0x7f68340ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:49.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.535+0000 7f683a400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f683415b4f0 con 0x7f68340cdf10 2024-01-31T05:04:49.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.535+0000 7f683a400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68340ce460 con 0x7f683415b110 2024-01-31T05:04:49.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.535+0000 7f683a400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68340abf20 con 0x7f68340714e0 2024-01-31T05:04:49.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.535+0000 7f6833400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f683415b110 0x7f683406c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:49.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.535+0000 7f6833400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f683415b110 0x7f683406c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56538/0 (socket says 172.21.15.49:56538) 2024-01-31T05:04:49.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.535+0000 7f6833400640 1 -- 172.21.15.49:0/323153597 learned_addr learned my addr 172.21.15.49:0/323153597 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:49.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.535+0000 7f6833e00640 1 --2- 172.21.15.49:0/323153597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68340714e0 0x7f68340ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:49.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.535+0000 7f6833400640 1 -- 172.21.15.49:0/323153597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68340714e0 msgr2=0x7f68340ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:49.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.535+0000 7f6833400640 1 --2- 172.21.15.49:0/323153597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68340714e0 0x7f68340ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.535+0000 7f6833400640 1 -- 172.21.15.49:0/323153597 >> v1:172.21.15.195:6789/0 conn(0x7f68340cdf10 legacy=0x7f6834070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:49.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.535+0000 7f6833400640 1 -- 172.21.15.49:0/323153597 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68340ac200 con 0x7f683415b110 2024-01-31T05:04:49.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.535+0000 7f6833e00640 1 --2- 172.21.15.49:0/323153597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68340714e0 0x7f68340ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:49.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.539+0000 7f6833400640 1 --2- 172.21.15.49:0/323153597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f683415b110 0x7f683406c2d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6824009870 tx=0x7f682401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d76184c9292dd8b server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:49.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.539+0000 7f6832000640 1 -- 172.21.15.49:0/323153597 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68240aa610 con 0x7f683415b110 2024-01-31T05:04:49.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.539+0000 7f6832000640 1 -- 172.21.15.49:0/323153597 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68240a6040 con 0x7f683415b110 2024-01-31T05:04:49.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.539+0000 7f6832000640 1 -- 172.21.15.49:0/323153597 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68240aa990 con 0x7f683415b110 2024-01-31T05:04:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.539+0000 7f683a400640 1 -- 172.21.15.49:0/323153597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f683415b110 msgr2=0x7f683406c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.539+0000 7f683a400640 1 --2- 172.21.15.49:0/323153597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f683415b110 0x7f683406c2d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6824009870 tx=0x7f682401c4d0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.539+0000 7f683a400640 1 -- 172.21.15.49:0/323153597 shutdown_connections 2024-01-31T05:04:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.539+0000 7f683a400640 1 --2- 172.21.15.49:0/323153597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68340714e0 0x7f68340ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.539+0000 7f683a400640 1 --2- 172.21.15.49:0/323153597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f683415b110 0x7f683406c2d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.539+0000 7f683a400640 1 -- 172.21.15.49:0/323153597 >> 172.21.15.49:0/323153597 conn(0x7f68340b09a0 msgr2=0x7f68340b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.539+0000 7f683a400640 1 -- 172.21.15.49:0/323153597 shutdown_connections 2024-01-31T05:04:49.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.539+0000 7f683a400640 1 -- 172.21.15.49:0/323153597 wait complete. 2024-01-31T05:04:49.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f683a400640 1 Processor -- start 2024-01-31T05:04:49.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f683a400640 1 -- start start 2024-01-31T05:04:49.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f683a400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68340714e0 0x7f683414e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:49.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f683a400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68340cdf10 0x7f68341f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:49.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f683a400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f683415b110 0x7f683415cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:49.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f683a400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68341f6be0 con 0x7f683415b110 2024-01-31T05:04:49.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f683a400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68340b3c10 con 0x7f68340cdf10 2024-01-31T05:04:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f683a400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68340b3930 con 0x7f68340714e0 2024-01-31T05:04:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f6833e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f683415b110 0x7f683415cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f6833e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f683415b110 0x7f683415cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56542/0 (socket says 172.21.15.49:56542) 2024-01-31T05:04:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f6833e00640 1 -- 172.21.15.49:0/3526843 learned_addr learned my addr 172.21.15.49:0/3526843 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f6833400640 1 --2- 172.21.15.49:0/3526843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68340714e0 0x7f683414e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f6832a00640 1 --2- 172.21.15.49:0/3526843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68340cdf10 0x7f68341f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f6833e00640 1 -- 172.21.15.49:0/3526843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68340714e0 msgr2=0x7f683414e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f6833e00640 1 --2- 172.21.15.49:0/3526843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68340714e0 0x7f683414e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f6833e00640 1 -- 172.21.15.49:0/3526843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68340cdf10 msgr2=0x7f68341f66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f6833e00640 1 --2- 172.21.15.49:0/3526843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68340cdf10 0x7f68341f66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f6833e00640 1 -- 172.21.15.49:0/3526843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68240094d0 con 0x7f683415b110 2024-01-31T05:04:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f6833e00640 1 --2- 172.21.15.49:0/3526843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f683415b110 0x7f683415cb70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f682c00cd50 tx=0x7f682c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:49.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f682b400640 1 -- 172.21.15.49:0/3526843 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c00f680 con 0x7f683415b110 2024-01-31T05:04:49.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f682b400640 1 -- 172.21.15.49:0/3526843 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c00f800 con 0x7f683415b110 2024-01-31T05:04:49.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f683a400640 1 -- 172.21.15.49:0/3526843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68341642a0 con 0x7f683415b110 2024-01-31T05:04:49.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f682b400640 1 -- 172.21.15.49:0/3526843 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c00fbb0 con 0x7f683415b110 2024-01-31T05:04:49.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.543+0000 7f683a400640 1 -- 172.21.15.49:0/3526843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6834164860 con 0x7f683415b110 2024-01-31T05:04:49.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.547+0000 7f683a400640 1 -- 172.21.15.49:0/3526843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6834164a50 con 0x7f683415b110 2024-01-31T05:04:49.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.547+0000 7f682b400640 1 -- 172.21.15.49:0/3526843 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f682c00b040 con 0x7f683415b110 2024-01-31T05:04:49.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.547+0000 7f682b400640 1 --2- 172.21.15.49:0/3526843 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f680c066500 0x7f680c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:49.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.547+0000 7f682b400640 1 -- 172.21.15.49:0/3526843 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f682c084b80 con 0x7f683415b110 2024-01-31T05:04:49.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.547+0000 7f6833400640 1 --2- 172.21.15.49:0/3526843 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f680c066500 0x7f680c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:49.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.547+0000 7f6833400640 1 --2- 172.21.15.49:0/3526843 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f680c066500 0x7f680c0689c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f68240ae000 tx=0x7f68240a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:49.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.551+0000 7f682b400640 1 -- 172.21.15.49:0/3526843 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f682c051b20 con 0x7f683415b110 2024-01-31T05:04:49.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.711+0000 7f683a400640 1 -- 172.21.15.49:0/3526843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6834074860 con 0x7f683415b110 2024-01-31T05:04:49.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.711+0000 7f682b400640 1 -- 172.21.15.49:0/3526843 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f682c084e60 con 0x7f683415b110 2024-01-31T05:04:49.714 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:04:49.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.715+0000 7f683a400640 1 -- 172.21.15.49:0/3526843 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f680c066500 msgr2=0x7f680c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:49.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.715+0000 7f683a400640 1 --2- 172.21.15.49:0/3526843 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f680c066500 0x7f680c0689c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f68240ae000 tx=0x7f68240a7000 comp rx=0 tx=0).stop 2024-01-31T05:04:49.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.715+0000 7f683a400640 1 -- 172.21.15.49:0/3526843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f683415b110 msgr2=0x7f683415cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:49.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.715+0000 7f683a400640 1 --2- 172.21.15.49:0/3526843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f683415b110 0x7f683415cb70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f682c00cd50 tx=0x7f682c00a650 comp rx=0 tx=0).stop 2024-01-31T05:04:49.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.715+0000 7f683a400640 1 -- 172.21.15.49:0/3526843 shutdown_connections 2024-01-31T05:04:49.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.715+0000 7f683a400640 1 --2- 172.21.15.49:0/3526843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f683415b110 0x7f683415cb70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.715+0000 7f683a400640 1 --2- 172.21.15.49:0/3526843 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f680c066500 0x7f680c0689c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.715+0000 7f683a400640 1 --2- 172.21.15.49:0/3526843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68340cdf10 0x7f68341f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.715+0000 7f683a400640 1 --2- 172.21.15.49:0/3526843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68340714e0 0x7f683414e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.715+0000 7f683a400640 1 -- 172.21.15.49:0/3526843 >> 172.21.15.49:0/3526843 conn(0x7f68340b09a0 msgr2=0x7f683406d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:49.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.715+0000 7f683a400640 1 -- 172.21.15.49:0/3526843 shutdown_connections 2024-01-31T05:04:49.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.715+0000 7f683a400640 1 -- 172.21.15.49:0/3526843 wait complete. 2024-01-31T05:04:49.739 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:04:49.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.879+0000 7fc6c6e00640 1 Processor -- start 2024-01-31T05:04:49.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.883+0000 7fc6c6e00640 1 -- start start 2024-01-31T05:04:49.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.883+0000 7fc6c6e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6c006c290 0x7fc6c00cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:49.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.883+0000 7fc6c6e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc6c006ba90 0x7fc6c006c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:49.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.883+0000 7fc6c6e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c006cbb0 con 0x7fc6c00cd630 2024-01-31T05:04:49.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.883+0000 7fc6c6e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c015d7e0 con 0x7fc6c006ba90 2024-01-31T05:04:49.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.883+0000 7fc6c6e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c00d0470 con 0x7fc6c006c290 2024-01-31T05:04:49.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.883+0000 7fc6bfe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6c006c290 0x7fc6c00cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:49.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.883+0000 7fc6bfe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6c006c290 0x7fc6c00cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:38086/0 (socket says 172.21.15.49:38086) 2024-01-31T05:04:49.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.883+0000 7fc6bfe00640 1 -- 172.21.15.49:0/3428116464 learned_addr learned my addr 172.21.15.49:0/3428116464 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:49.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.883+0000 7fc6bf400640 1 --2- 172.21.15.49:0/3428116464 >> v2:172.21.15.195:3300/0 conn(0x7fc6c006ba90 0x7fc6c006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:49.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.883+0000 7fc6bfe00640 1 -- 172.21.15.49:0/3428116464 >> v2:172.21.15.195:3300/0 conn(0x7fc6c006ba90 msgr2=0x7fc6c006c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:49.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.883+0000 7fc6bfe00640 1 --2- 172.21.15.49:0/3428116464 >> v2:172.21.15.195:3300/0 conn(0x7fc6c006ba90 0x7fc6c006c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.883+0000 7fc6bfe00640 1 -- 172.21.15.49:0/3428116464 >> v1:172.21.15.195:6789/0 conn(0x7fc6c00cd630 legacy=0x7fc6c00cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:49.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.883+0000 7fc6bfe00640 1 -- 172.21.15.49:0/3428116464 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c00d0190 con 0x7fc6c006c290 2024-01-31T05:04:49.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.887+0000 7fc6bfe00640 1 --2- 172.21.15.49:0/3428116464 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6c006c290 0x7fc6c00cfad0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009870 tx=0x7fc6b001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4263ac0a320431f server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:49.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.887+0000 7fc6bea00640 1 -- 172.21.15.49:0/3428116464 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b00ad640 con 0x7fc6c006c290 2024-01-31T05:04:49.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.887+0000 7fc6bea00640 1 -- 172.21.15.49:0/3428116464 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b00ad7a0 con 0x7fc6c006c290 2024-01-31T05:04:49.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.887+0000 7fc6bea00640 1 -- 172.21.15.49:0/3428116464 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b00adb30 con 0x7fc6c006c290 2024-01-31T05:04:49.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.887+0000 7fc6c6e00640 1 -- 172.21.15.49:0/3428116464 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6c006c290 msgr2=0x7fc6c00cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:49.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.887+0000 7fc6c6e00640 1 --2- 172.21.15.49:0/3428116464 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6c006c290 0x7fc6c00cfad0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009870 tx=0x7fc6b001c480 comp rx=0 tx=0).stop 2024-01-31T05:04:49.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.887+0000 7fc6c6e00640 1 -- 172.21.15.49:0/3428116464 shutdown_connections 2024-01-31T05:04:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.887+0000 7fc6c6e00640 1 --2- 172.21.15.49:0/3428116464 >> v2:172.21.15.195:3300/0 conn(0x7fc6c006ba90 0x7fc6c006c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.887+0000 7fc6c6e00640 1 --2- 172.21.15.49:0/3428116464 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6c006c290 0x7fc6c00cfad0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.887+0000 7fc6c6e00640 1 -- 172.21.15.49:0/3428116464 >> 172.21.15.49:0/3428116464 conn(0x7fc6c00b28e0 msgr2=0x7fc6c00b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.887+0000 7fc6c6e00640 1 -- 172.21.15.49:0/3428116464 shutdown_connections 2024-01-31T05:04:49.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.887+0000 7fc6c6e00640 1 -- 172.21.15.49:0/3428116464 wait complete. 2024-01-31T05:04:49.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6c6e00640 1 Processor -- start 2024-01-31T05:04:49.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6c6e00640 1 -- start start 2024-01-31T05:04:49.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6c6e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6c006ba90 0x7fc6c01513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6c6e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6c006c290 0x7fc6c00c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6c6e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6c00cd630 0x7fc6c0151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6c6e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c01533b0 con 0x7fc6c006ba90 2024-01-31T05:04:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6c6e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c0151900 con 0x7fc6c006c290 2024-01-31T05:04:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6c6e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c00b65b0 con 0x7fc6c00cd630 2024-01-31T05:04:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6bfe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6c006ba90 0x7fc6c01513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6bfe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6c006ba90 0x7fc6c01513c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56546/0 (socket says 172.21.15.49:56546) 2024-01-31T05:04:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6bfe00640 1 -- 172.21.15.49:0/1555515866 learned_addr learned my addr 172.21.15.49:0/1555515866 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6bf400640 1 --2- 172.21.15.49:0/1555515866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6c006c290 0x7fc6c00c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6c4e00640 1 --2- 172.21.15.49:0/1555515866 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6c00cd630 0x7fc6c0151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6bfe00640 1 -- 172.21.15.49:0/1555515866 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6c00cd630 msgr2=0x7fc6c0151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6bfe00640 1 --2- 172.21.15.49:0/1555515866 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6c00cd630 0x7fc6c0151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6bfe00640 1 -- 172.21.15.49:0/1555515866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6c006c290 msgr2=0x7fc6c00c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6bfe00640 1 --2- 172.21.15.49:0/1555515866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6c006c290 0x7fc6c00c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6bfe00640 1 -- 172.21.15.49:0/1555515866 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b00094d0 con 0x7fc6c006ba90 2024-01-31T05:04:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6c4e00640 1 --2- 172.21.15.49:0/1555515866 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6c00cd630 0x7fc6c0151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6bfe00640 1 --2- 172.21.15.49:0/1555515866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6c006ba90 0x7fc6c01513c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00b0040 tx=0x7fc6b0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6b7e00640 1 -- 172.21.15.49:0/1555515866 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b00b6830 con 0x7fc6c006ba90 2024-01-31T05:04:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6b7e00640 1 -- 172.21.15.49:0/1555515866 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b00a6040 con 0x7fc6c006ba90 2024-01-31T05:04:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6b7e00640 1 -- 172.21.15.49:0/1555515866 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b00b6bd0 con 0x7fc6c006ba90 2024-01-31T05:04:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6c6e00640 1 -- 172.21.15.49:0/1555515866 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c00b6890 con 0x7fc6c006ba90 2024-01-31T05:04:49.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.891+0000 7fc6c6e00640 1 -- 172.21.15.49:0/1555515866 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c00adf40 con 0x7fc6c006ba90 2024-01-31T05:04:49.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.895+0000 7fc6c6e00640 1 -- 172.21.15.49:0/1555515866 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c0074860 con 0x7fc6c006ba90 2024-01-31T05:04:49.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.895+0000 7fc6b7e00640 1 -- 172.21.15.49:0/1555515866 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fc6b00b4070 con 0x7fc6c006ba90 2024-01-31T05:04:49.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.895+0000 7fc6b7e00640 1 --2- 172.21.15.49:0/1555515866 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc698066530 0x7fc6980689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:49.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.895+0000 7fc6b7e00640 1 -- 172.21.15.49:0/1555515866 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc6b011e9f0 con 0x7fc6c006ba90 2024-01-31T05:04:49.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.895+0000 7fc6bf400640 1 --2- 172.21.15.49:0/1555515866 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc698066530 0x7fc6980689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:49.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.895+0000 7fc6bf400640 1 --2- 172.21.15.49:0/1555515866 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc698066530 0x7fc6980689f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00cffd0 tx=0x7fc6a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:49.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:49.899+0000 7fc6b7e00640 1 -- 172.21.15.49:0/1555515866 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fc6b00eb900 con 0x7fc6c006ba90 2024-01-31T05:04:50.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.059+0000 7fc6c6e00640 1 -- 172.21.15.49:0/1555515866 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6c00cafb0 con 0x7fc6c006ba90 2024-01-31T05:04:50.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.059+0000 7fc6b7e00640 1 -- 172.21.15.49:0/1555515866 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc6b00ad600 con 0x7fc6c006ba90 2024-01-31T05:04:50.060 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:04:50.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.059+0000 7fc6c6e00640 1 -- 172.21.15.49:0/1555515866 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc698066530 msgr2=0x7fc6980689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.059+0000 7fc6c6e00640 1 --2- 172.21.15.49:0/1555515866 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc698066530 0x7fc6980689f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00cffd0 tx=0x7fc6a8008040 comp rx=0 tx=0).stop 2024-01-31T05:04:50.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.059+0000 7fc6c6e00640 1 -- 172.21.15.49:0/1555515866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6c006ba90 msgr2=0x7fc6c01513c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.059+0000 7fc6c6e00640 1 --2- 172.21.15.49:0/1555515866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6c006ba90 0x7fc6c01513c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00b0040 tx=0x7fc6b0019220 comp rx=0 tx=0).stop 2024-01-31T05:04:50.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.059+0000 7fc6c6e00640 1 -- 172.21.15.49:0/1555515866 shutdown_connections 2024-01-31T05:04:50.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.059+0000 7fc6c6e00640 1 --2- 172.21.15.49:0/1555515866 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc6c00cd630 0x7fc6c0151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.059+0000 7fc6c6e00640 1 --2- 172.21.15.49:0/1555515866 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc698066530 0x7fc6980689f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.059+0000 7fc6c6e00640 1 --2- 172.21.15.49:0/1555515866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6c006c290 0x7fc6c00c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.059+0000 7fc6c6e00640 1 --2- 172.21.15.49:0/1555515866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6c006ba90 0x7fc6c01513c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.059+0000 7fc6c6e00640 1 -- 172.21.15.49:0/1555515866 >> 172.21.15.49:0/1555515866 conn(0x7fc6c00b28e0 msgr2=0x7fc6c00cdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:50.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.059+0000 7fc6c6e00640 1 -- 172.21.15.49:0/1555515866 shutdown_connections 2024-01-31T05:04:50.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.059+0000 7fc6c6e00640 1 -- 172.21.15.49:0/1555515866 wait complete. 2024-01-31T05:04:50.082 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:04:50.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.223+0000 7f2102e00640 1 Processor -- start 2024-01-31T05:04:50.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.223+0000 7f2102e00640 1 -- start start 2024-01-31T05:04:50.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.227+0000 7f2102e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f20fc0cff70 0x7f20fc0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:50.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.227+0000 7f2102e00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20fc0cef80 con 0x7f20fc15d540 2024-01-31T05:04:50.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.227+0000 7f2102e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20fc06cae0 con 0x7f20fc0cb9f0 2024-01-31T05:04:50.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.227+0000 7f2102e00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20fc0d03d0 con 0x7f20fc0cff70 2024-01-31T05:04:50.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.227+0000 7f20fb400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f20fc0cff70 0x7f20fc0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:50.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.227+0000 7f20fb400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f20fc0cff70 0x7f20fc0cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56560/0 (socket says 172.21.15.49:56560) 2024-01-31T05:04:50.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.227+0000 7f20fbe00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f20fc15d540 0x7f20fc06c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53194/0 (socket says 172.21.15.49:53194) 2024-01-31T05:04:50.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.227+0000 7f20fb400640 1 -- 172.21.15.49:0/1064646974 learned_addr learned my addr 172.21.15.49:0/1064646974 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:50.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.227+0000 7f20fb400640 1 -- 172.21.15.49:0/1064646974 >> v1:172.21.15.195:6789/0 conn(0x7f20fc0cb9f0 legacy=0x7f20fc15d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:50.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.227+0000 7f20fb400640 1 -- 172.21.15.49:0/1064646974 >> v1:172.21.15.49:6789/0 conn(0x7f20fc15d540 legacy=0x7f20fc06c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.227+0000 7f20faa00640 1 -- 172.21.15.49:0/1064646974 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951972567 0 0) 0x7f20fc0cef80 con 0x7f20fc15d540 2024-01-31T05:04:50.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.227+0000 7f20fb400640 1 -- 172.21.15.49:0/1064646974 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20fc0cf1b0 con 0x7f20fc0cff70 2024-01-31T05:04:50.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.227+0000 7f20fb400640 1 --2- 172.21.15.49:0/1064646974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20fc0cff70 0x7f20fc0cb4b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009870 tx=0x7f20e401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1108e1bc7815091d server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:50.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.227+0000 7f20faa00640 1 -- 172.21.15.49:0/1064646974 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e40ac640 con 0x7f20fc0cff70 2024-01-31T05:04:50.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.227+0000 7f20faa00640 1 -- 172.21.15.49:0/1064646974 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e40ac7a0 con 0x7f20fc0cff70 2024-01-31T05:04:50.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.227+0000 7f20faa00640 1 -- 172.21.15.49:0/1064646974 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e40acb30 con 0x7f20fc0cff70 2024-01-31T05:04:50.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.231+0000 7f2102e00640 1 -- 172.21.15.49:0/1064646974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20fc0cff70 msgr2=0x7f20fc0cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.231+0000 7f2102e00640 1 --2- 172.21.15.49:0/1064646974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20fc0cff70 0x7f20fc0cb4b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009870 tx=0x7f20e401c4d0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.231+0000 7f2102e00640 1 -- 172.21.15.49:0/1064646974 shutdown_connections 2024-01-31T05:04:50.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.231+0000 7f2102e00640 1 --2- 172.21.15.49:0/1064646974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20fc0cff70 0x7f20fc0cb4b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.231+0000 7f2102e00640 1 -- 172.21.15.49:0/1064646974 >> 172.21.15.49:0/1064646974 conn(0x7f20fc0d0e60 msgr2=0x7f20fc0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:50.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.231+0000 7f2102e00640 1 -- 172.21.15.49:0/1064646974 shutdown_connections 2024-01-31T05:04:50.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.231+0000 7f2102e00640 1 -- 172.21.15.49:0/1064646974 wait complete. 2024-01-31T05:04:50.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.231+0000 7f2102e00640 1 Processor -- start 2024-01-31T05:04:50.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.231+0000 7f2102e00640 1 -- start start 2024-01-31T05:04:50.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.231+0000 7f2102e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20fc0cb9f0 0x7f20fc0c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:50.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.231+0000 7f2102e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20fc0cff70 0x7f20fc0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:50.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.231+0000 7f2102e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20fc15d540 0x7f20fc0c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:50.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.231+0000 7f2102e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc156100 con 0x7f20fc0cb9f0 2024-01-31T05:04:50.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.231+0000 7f2102e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc0ca720 con 0x7f20fc15d540 2024-01-31T05:04:50.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.231+0000 7f2102e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc0caa00 con 0x7f20fc0cff70 2024-01-31T05:04:50.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.235+0000 7f20fbe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20fc0cb9f0 0x7f20fc0c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:50.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.235+0000 7f20fbe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20fc0cb9f0 0x7f20fc0c97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56564/0 (socket says 172.21.15.49:56564) 2024-01-31T05:04:50.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.235+0000 7f20fbe00640 1 -- 172.21.15.49:0/1125281235 learned_addr learned my addr 172.21.15.49:0/1125281235 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.235+0000 7f20fb400640 1 --2- 172.21.15.49:0/1125281235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20fc0cff70 0x7f20fc0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.235+0000 7f2100e00640 1 --2- 172.21.15.49:0/1125281235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20fc15d540 0x7f20fc0c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.235+0000 7f20fbe00640 1 -- 172.21.15.49:0/1125281235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20fc0cff70 msgr2=0x7f20fc0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.235+0000 7f20fbe00640 1 --2- 172.21.15.49:0/1125281235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20fc0cff70 0x7f20fc0c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.235+0000 7f20fbe00640 1 -- 172.21.15.49:0/1125281235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20fc15d540 msgr2=0x7f20fc0c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.235+0000 7f20fbe00640 1 --2- 172.21.15.49:0/1125281235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20fc15d540 0x7f20fc0c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.235+0000 7f20fbe00640 1 -- 172.21.15.49:0/1125281235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e40094d0 con 0x7f20fc0cb9f0 2024-01-31T05:04:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.235+0000 7f2100e00640 1 --2- 172.21.15.49:0/1125281235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20fc15d540 0x7f20fc0c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.235+0000 7f20fbe00640 1 --2- 172.21.15.49:0/1125281235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20fc0cb9f0 0x7f20fc0c97c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00c480 tx=0x7f20ec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.235+0000 7f20f3e00640 1 -- 172.21.15.49:0/1125281235 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0074e0 con 0x7f20fc0cb9f0 2024-01-31T05:04:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.235+0000 7f20f3e00640 1 -- 172.21.15.49:0/1125281235 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ec007660 con 0x7f20fc0cb9f0 2024-01-31T05:04:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.235+0000 7f20f3e00640 1 -- 172.21.15.49:0/1125281235 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec004a30 con 0x7f20fc0cb9f0 2024-01-31T05:04:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.235+0000 7f2102e00640 1 -- 172.21.15.49:0/1125281235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20fc0cace0 con 0x7f20fc0cb9f0 2024-01-31T05:04:50.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.235+0000 7f2102e00640 1 -- 172.21.15.49:0/1125281235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20fc153310 con 0x7f20fc0cb9f0 2024-01-31T05:04:50.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.235+0000 7f2102e00640 1 -- 172.21.15.49:0/1125281235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20fc0ce880 con 0x7f20fc0cb9f0 2024-01-31T05:04:50.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.235+0000 7f20f3e00640 1 -- 172.21.15.49:0/1125281235 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f20ec004b90 con 0x7f20fc0cb9f0 2024-01-31T05:04:50.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.239+0000 7f20f3e00640 1 --2- 172.21.15.49:0/1125281235 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f20d4066500 0x7f20d40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:50.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.239+0000 7f20f3e00640 1 -- 172.21.15.49:0/1125281235 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f20ec0833b0 con 0x7f20fc0cb9f0 2024-01-31T05:04:50.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.239+0000 7f20fb400640 1 --2- 172.21.15.49:0/1125281235 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f20d4066500 0x7f20d40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:50.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.239+0000 7f20fb400640 1 --2- 172.21.15.49:0/1125281235 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f20d4066500 0x7f20d40689c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f20e40ae000 tx=0x7f20e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:50.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.243+0000 7f20f3e00640 1 -- 172.21.15.49:0/1125281235 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f20ec053de0 con 0x7f20fc0cb9f0 2024-01-31T05:04:50.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.403+0000 7f2102e00640 1 -- 172.21.15.49:0/1125281235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20fc155ed0 con 0x7f20fc0cb9f0 2024-01-31T05:04:50.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.407+0000 7f20f3e00640 1 -- 172.21.15.49:0/1125281235 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f20fc155ed0 con 0x7f20fc0cb9f0 2024-01-31T05:04:50.407 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-31T05:04:50.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.407+0000 7f2102e00640 1 -- 172.21.15.49:0/1125281235 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f20d4066500 msgr2=0x7f20d40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.407+0000 7f2102e00640 1 --2- 172.21.15.49:0/1125281235 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f20d4066500 0x7f20d40689c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f20e40ae000 tx=0x7f20e4008040 comp rx=0 tx=0).stop 2024-01-31T05:04:50.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.407+0000 7f2102e00640 1 -- 172.21.15.49:0/1125281235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20fc0cb9f0 msgr2=0x7f20fc0c97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.407+0000 7f2102e00640 1 --2- 172.21.15.49:0/1125281235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20fc0cb9f0 0x7f20fc0c97c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00c480 tx=0x7f20ec00c940 comp rx=0 tx=0).stop 2024-01-31T05:04:50.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.407+0000 7f2102e00640 1 -- 172.21.15.49:0/1125281235 shutdown_connections 2024-01-31T05:04:50.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.407+0000 7f2102e00640 1 --2- 172.21.15.49:0/1125281235 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f20d4066500 0x7f20d40689c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.407+0000 7f2102e00640 1 --2- 172.21.15.49:0/1125281235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20fc15d540 0x7f20fc0c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.407+0000 7f2102e00640 1 --2- 172.21.15.49:0/1125281235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20fc0cff70 0x7f20fc0c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.407+0000 7f2102e00640 1 --2- 172.21.15.49:0/1125281235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20fc0cb9f0 0x7f20fc0c97c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.407+0000 7f2102e00640 1 -- 172.21.15.49:0/1125281235 >> 172.21.15.49:0/1125281235 conn(0x7f20fc0d0e60 msgr2=0x7f20fc15bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:50.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.407+0000 7f2102e00640 1 -- 172.21.15.49:0/1125281235 shutdown_connections 2024-01-31T05:04:50.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.407+0000 7f2102e00640 1 -- 172.21.15.49:0/1125281235 wait complete. 2024-01-31T05:04:50.430 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-31T05:04:50.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.571+0000 7f168e600640 1 Processor -- start 2024-01-31T05:04:50.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.571+0000 7f168e600640 1 -- start start 2024-01-31T05:04:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f168e600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16880cb040 0x7f168806c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f168e600640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1688071e40 con 0x7f168815a000 2024-01-31T05:04:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f168e600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168806c990 con 0x7f16880715e0 2024-01-31T05:04:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f168e600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16880b3760 con 0x7f16880cb040 2024-01-31T05:04:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1687400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f168815a000 0x7f1688070ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53208/0 (socket says 172.21.15.49:53208) 2024-01-31T05:04:50.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1687400640 1 -- 172.21.15.49:0/3922369888 learned_addr learned my addr 172.21.15.49:0/3922369888 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:50.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1687e00640 1 --2- 172.21.15.49:0/3922369888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16880cb040 0x7f168806c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:50.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1686000640 1 -- 172.21.15.49:0/3922369888 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000145557 0 0) 0x7f1688071e40 con 0x7f168815a000 2024-01-31T05:04:50.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1686000640 1 -- 172.21.15.49:0/3922369888 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1668003530 con 0x7f168815a000 2024-01-31T05:04:50.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1686000640 1 -- 172.21.15.49:0/3922369888 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3110651136 0 0) 0x7f1668003530 con 0x7f168815a000 2024-01-31T05:04:50.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1686000640 1 -- 172.21.15.49:0/3922369888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16880cb040 msgr2=0x7f168806c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:50.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1686000640 1 --2- 172.21.15.49:0/3922369888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16880cb040 0x7f168806c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1686000640 1 -- 172.21.15.49:0/3922369888 >> v1:172.21.15.195:6789/0 conn(0x7f16880715e0 legacy=0x7f16880ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1686000640 1 -- 172.21.15.49:0/3922369888 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168815a3e0 con 0x7f168815a000 2024-01-31T05:04:50.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1686000640 1 -- 172.21.15.49:0/3922369888 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7f16780016a0 con 0x7f168815a000 2024-01-31T05:04:50.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1686000640 1 -- 172.21.15.49:0/3922369888 >> v1:172.21.15.49:6789/0 conn(0x7f168815a000 legacy=0x7f1688070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1686000640 1 --2- 172.21.15.49:0/3922369888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16680039b0 0x7f1668003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:50.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1686000640 1 --2- 172.21.15.49:0/3922369888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1668004310 0x7f16680047f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:50.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1686000640 1 --2- 172.21.15.49:0/3922369888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1668004ff0 0x7f166800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:50.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1686000640 1 -- 172.21.15.49:0/3922369888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16880b3760 con 0x7f1668004ff0 2024-01-31T05:04:50.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1686000640 1 -- 172.21.15.49:0/3922369888 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166800bf00 con 0x7f1668004310 2024-01-31T05:04:50.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1686000640 1 -- 172.21.15.49:0/3922369888 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166800c0c0 con 0x7f16680039b0 2024-01-31T05:04:50.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1687400640 1 --2- 172.21.15.49:0/3922369888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16680039b0 0x7f1668003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:50.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1686a00640 1 --2- 172.21.15.49:0/3922369888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1668004310 0x7f16680047f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:50.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1687e00640 1 --2- 172.21.15.49:0/3922369888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1668004ff0 0x7f166800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:50.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1687400640 1 -- 172.21.15.49:0/3922369888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1668004310 msgr2=0x7f16680047f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:50.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1687400640 1 --2- 172.21.15.49:0/3922369888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1668004310 0x7f16680047f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1687400640 1 -- 172.21.15.49:0/3922369888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1668004ff0 msgr2=0x7f166800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:50.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1687400640 1 --2- 172.21.15.49:0/3922369888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1668004ff0 0x7f166800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.575+0000 7f1687400640 1 -- 172.21.15.49:0/3922369888 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1668003530 con 0x7f16680039b0 2024-01-31T05:04:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.579+0000 7f1687400640 1 --2- 172.21.15.49:0/3922369888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16680039b0 0x7f1668003d90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f167800c210 tx=0x7f167801f370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40abfc1b33b9f9bd server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.579+0000 7f1686000640 1 -- 172.21.15.49:0/3922369888 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1678005ae0 con 0x7f16680039b0 2024-01-31T05:04:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.579+0000 7f1686000640 1 -- 172.21.15.49:0/3922369888 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16780ab070 con 0x7f16680039b0 2024-01-31T05:04:50.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.579+0000 7f1686000640 1 -- 172.21.15.49:0/3922369888 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1678005e80 con 0x7f16680039b0 2024-01-31T05:04:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.579+0000 7f168e600640 1 -- 172.21.15.49:0/3922369888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16680039b0 msgr2=0x7f1668003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.579+0000 7f168e600640 1 --2- 172.21.15.49:0/3922369888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16680039b0 0x7f1668003d90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f167800c210 tx=0x7f167801f370 comp rx=0 tx=0).stop 2024-01-31T05:04:50.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.579+0000 7f1687e00640 1 -- 172.21.15.49:0/3922369888 reap_dead start 2024-01-31T05:04:50.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.579+0000 7f168e600640 1 -- 172.21.15.49:0/3922369888 shutdown_connections 2024-01-31T05:04:50.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.579+0000 7f168e600640 1 -- 172.21.15.49:0/3922369888 >> 172.21.15.49:0/3922369888 conn(0x7f16880b09a0 msgr2=0x7f16880b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:50.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.579+0000 7f168e600640 1 -- 172.21.15.49:0/3922369888 shutdown_connections 2024-01-31T05:04:50.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.579+0000 7f168e600640 1 -- 172.21.15.49:0/3922369888 wait complete. 2024-01-31T05:04:50.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f168e600640 1 Processor -- start 2024-01-31T05:04:50.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f168e600640 1 -- start start 2024-01-31T05:04:50.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f168e600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16680039b0 0x7f168814e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:50.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f168e600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1688099a50 0x7f16880afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:50.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f168e600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1688099ed0 0x7f16880aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:50.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f168e600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168814ed00 con 0x7f1688099ed0 2024-01-31T05:04:50.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f168e600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168809cb40 con 0x7f1688099a50 2024-01-31T05:04:50.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f168e600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168809ce20 con 0x7f16680039b0 2024-01-31T05:04:50.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f1687e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1688099ed0 0x7f16880aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:50.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f1687e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1688099ed0 0x7f16880aff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56578/0 (socket says 172.21.15.49:56578) 2024-01-31T05:04:50.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f1687e00640 1 -- 172.21.15.49:0/1505598944 learned_addr learned my addr 172.21.15.49:0/1505598944 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:50.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f1687400640 1 --2- 172.21.15.49:0/1505598944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16680039b0 0x7f168814e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:50.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f1686a00640 1 --2- 172.21.15.49:0/1505598944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1688099a50 0x7f16880afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:50.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f1687e00640 1 -- 172.21.15.49:0/1505598944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16680039b0 msgr2=0x7f168814e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f1687e00640 1 --2- 172.21.15.49:0/1505598944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16680039b0 0x7f168814e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f1687e00640 1 -- 172.21.15.49:0/1505598944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1688099a50 msgr2=0x7f16880afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f1687e00640 1 --2- 172.21.15.49:0/1505598944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1688099a50 0x7f16880afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f1687e00640 1 -- 172.21.15.49:0/1505598944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16880cc130 con 0x7f1688099ed0 2024-01-31T05:04:50.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f1687e00640 1 --2- 172.21.15.49:0/1505598944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1688099ed0 0x7f16880aff40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1688068220 tx=0x7f1680011580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:50.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f167f400640 1 -- 172.21.15.49:0/1505598944 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1680010040 con 0x7f1688099ed0 2024-01-31T05:04:50.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f167f400640 1 -- 172.21.15.49:0/1505598944 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1680011040 con 0x7f1688099ed0 2024-01-31T05:04:50.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f168e600640 1 -- 172.21.15.49:0/1505598944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16880cc410 con 0x7f1688099ed0 2024-01-31T05:04:50.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f167f400640 1 -- 172.21.15.49:0/1505598944 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168000b2b0 con 0x7f1688099ed0 2024-01-31T05:04:50.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f168e600640 1 -- 172.21.15.49:0/1505598944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168809b650 con 0x7f1688099ed0 2024-01-31T05:04:50.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.583+0000 7f168e600640 1 -- 172.21.15.49:0/1505598944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168806c2b0 con 0x7f1688099ed0 2024-01-31T05:04:50.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.587+0000 7f167f400640 1 -- 172.21.15.49:0/1505598944 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f16800039a0 con 0x7f1688099ed0 2024-01-31T05:04:50.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.587+0000 7f167f400640 1 --2- 172.21.15.49:0/1505598944 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1660066530 0x7f16600689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:50.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.587+0000 7f167f400640 1 -- 172.21.15.49:0/1505598944 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f16800847e0 con 0x7f1688099ed0 2024-01-31T05:04:50.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.587+0000 7f1687400640 1 --2- 172.21.15.49:0/1505598944 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1660066530 0x7f16600689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:50.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.587+0000 7f1687400640 1 --2- 172.21.15.49:0/1505598944 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1660066530 0x7f16600689f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f16780af000 tx=0x7f16780aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:50.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.591+0000 7f167f400640 1 -- 172.21.15.49:0/1505598944 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f168806c2b0 con 0x7f1688099ed0 2024-01-31T05:04:50.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.747+0000 7f168e600640 1 -- 172.21.15.49:0/1505598944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f168806c2b0 con 0x7f1688099ed0 2024-01-31T05:04:50.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.747+0000 7f167f400640 1 -- 172.21.15.49:0/1505598944 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f168806c2b0 con 0x7f1688099ed0 2024-01-31T05:04:50.750 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:04:50.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.751+0000 7f168e600640 1 -- 172.21.15.49:0/1505598944 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1660066530 msgr2=0x7f16600689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.751+0000 7f168e600640 1 --2- 172.21.15.49:0/1505598944 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1660066530 0x7f16600689f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f16780af000 tx=0x7f16780aa000 comp rx=0 tx=0).stop 2024-01-31T05:04:50.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.751+0000 7f168e600640 1 -- 172.21.15.49:0/1505598944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1688099ed0 msgr2=0x7f16880aff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.751+0000 7f168e600640 1 --2- 172.21.15.49:0/1505598944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1688099ed0 0x7f16880aff40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1688068220 tx=0x7f1680011580 comp rx=0 tx=0).stop 2024-01-31T05:04:50.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.751+0000 7f168e600640 1 -- 172.21.15.49:0/1505598944 shutdown_connections 2024-01-31T05:04:50.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.751+0000 7f168e600640 1 --2- 172.21.15.49:0/1505598944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1688099ed0 0x7f16880aff40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.751+0000 7f168e600640 1 --2- 172.21.15.49:0/1505598944 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1660066530 0x7f16600689f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.751+0000 7f168e600640 1 --2- 172.21.15.49:0/1505598944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1688099a50 0x7f16880afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.751+0000 7f168e600640 1 --2- 172.21.15.49:0/1505598944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16680039b0 0x7f168814e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.751+0000 7f168e600640 1 -- 172.21.15.49:0/1505598944 >> 172.21.15.49:0/1505598944 conn(0x7f16880b09a0 msgr2=0x7f16880b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:50.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.751+0000 7f168e600640 1 -- 172.21.15.49:0/1505598944 shutdown_connections 2024-01-31T05:04:50.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.751+0000 7f168e600640 1 -- 172.21.15.49:0/1505598944 wait complete. 2024-01-31T05:04:50.772 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:04:50.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.911+0000 7f6140400640 1 Processor -- start 2024-01-31T05:04:50.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.911+0000 7f6140400640 1 -- start start 2024-01-31T05:04:50.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.911+0000 7f6140400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6138160c10 0x7f61380ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:50.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.911+0000 7f6140400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61380d3f50 con 0x7f6138160830 2024-01-31T05:04:50.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.911+0000 7f6140400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61380b2610 con 0x7f61380d1d10 2024-01-31T05:04:50.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.911+0000 7f6140400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61380d03c0 con 0x7f6138160c10 2024-01-31T05:04:50.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.911+0000 7f613da00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6138160830 0x7f61380d1600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53220/0 (socket says 172.21.15.49:53220) 2024-01-31T05:04:50.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.911+0000 7f613da00640 1 -- 172.21.15.49:0/4146242722 learned_addr learned my addr 172.21.15.49:0/4146242722 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:50.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.911+0000 7f613e400640 1 --2- 172.21.15.49:0/4146242722 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6138160c10 0x7f61380ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:50.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.911+0000 7f6137e00640 1 -- 172.21.15.49:0/4146242722 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454930348 0 0) 0x7f61380d3f50 con 0x7f6138160830 2024-01-31T05:04:50.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.911+0000 7f6137e00640 1 -- 172.21.15.49:0/4146242722 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6118003530 con 0x7f6138160830 2024-01-31T05:04:50.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.911+0000 7f6137e00640 1 -- 172.21.15.49:0/4146242722 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910308922 0 0) 0x7f61380b2610 con 0x7f61380d1d10 2024-01-31T05:04:50.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.911+0000 7f6137e00640 1 -- 172.21.15.49:0/4146242722 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61380d3f50 con 0x7f61380d1d10 2024-01-31T05:04:50.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.911+0000 7f613e400640 1 -- 172.21.15.49:0/4146242722 >> v1:172.21.15.195:6789/0 conn(0x7f61380d1d10 legacy=0x7f61380cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.911+0000 7f613e400640 1 -- 172.21.15.49:0/4146242722 >> v1:172.21.15.49:6789/0 conn(0x7f6138160830 legacy=0x7f61380d1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.911+0000 7f6137e00640 1 -- 172.21.15.49:0/4146242722 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2525747529 0 0) 0x7f6118003530 con 0x7f6138160830 2024-01-31T05:04:50.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.911+0000 7f613e400640 1 -- 172.21.15.49:0/4146242722 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61380d0100 con 0x7f6138160c10 2024-01-31T05:04:50.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.915+0000 7f613e400640 1 --2- 172.21.15.49:0/4146242722 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6138160c10 0x7f61380ce2d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6130009dc0 tx=0x7f613001c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ebae80ba6c6afa6 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:50.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.915+0000 7f6137e00640 1 -- 172.21.15.49:0/4146242722 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128001680 con 0x7f6138160c10 2024-01-31T05:04:50.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.915+0000 7f6137e00640 1 -- 172.21.15.49:0/4146242722 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61300a5540 con 0x7f6138160c10 2024-01-31T05:04:50.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.915+0000 7f6137e00640 1 -- 172.21.15.49:0/4146242722 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61300a58d0 con 0x7f6138160c10 2024-01-31T05:04:50.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.915+0000 7f6140400640 1 -- 172.21.15.49:0/4146242722 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6138160c10 msgr2=0x7f61380ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.915+0000 7f6140400640 1 --2- 172.21.15.49:0/4146242722 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6138160c10 0x7f61380ce2d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6130009dc0 tx=0x7f613001c740 comp rx=0 tx=0).stop 2024-01-31T05:04:50.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.915+0000 7f6140400640 1 -- 172.21.15.49:0/4146242722 shutdown_connections 2024-01-31T05:04:50.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.915+0000 7f6140400640 1 --2- 172.21.15.49:0/4146242722 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6138160c10 0x7f61380ce2d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.915+0000 7f6140400640 1 -- 172.21.15.49:0/4146242722 >> 172.21.15.49:0/4146242722 conn(0x7f61380d3020 msgr2=0x7f61380d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:50.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f6140400640 1 -- 172.21.15.49:0/4146242722 shutdown_connections 2024-01-31T05:04:50.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f6140400640 1 -- 172.21.15.49:0/4146242722 wait complete. 2024-01-31T05:04:50.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f6140400640 1 Processor -- start 2024-01-31T05:04:50.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f6140400640 1 -- start start 2024-01-31T05:04:50.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f6140400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61380d1d10 0x7f61380b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:50.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f6140400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6138160830 0x7f61380b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:50.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f6140400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6138160c10 0x7f6138153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:50.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f6140400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61381555b0 con 0x7f61380d1d10 2024-01-31T05:04:50.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f6140400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6138154c00 con 0x7f6138160c10 2024-01-31T05:04:50.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f6140400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61381f7340 con 0x7f6138160830 2024-01-31T05:04:50.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f613da00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61380d1d10 0x7f61380b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:50.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f613da00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61380d1d10 0x7f61380b0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56592/0 (socket says 172.21.15.49:56592) 2024-01-31T05:04:50.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f613da00640 1 -- 172.21.15.49:0/3315635392 learned_addr learned my addr 172.21.15.49:0/3315635392 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:50.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f613e400640 1 --2- 172.21.15.49:0/3315635392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6138160c10 0x7f6138153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:50.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f613d000640 1 --2- 172.21.15.49:0/3315635392 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6138160830 0x7f61380b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:50.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f613da00640 1 -- 172.21.15.49:0/3315635392 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6138160830 msgr2=0x7f61380b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f613da00640 1 --2- 172.21.15.49:0/3315635392 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6138160830 0x7f61380b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f613da00640 1 -- 172.21.15.49:0/3315635392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6138160c10 msgr2=0x7f6138153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:50.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f613da00640 1 --2- 172.21.15.49:0/3315635392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6138160c10 0x7f6138153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:50.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f613da00640 1 -- 172.21.15.49:0/3315635392 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6130009a70 con 0x7f61380d1d10 2024-01-31T05:04:50.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f613da00640 1 --2- 172.21.15.49:0/3315635392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61380d1d10 0x7f61380b0db0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f612800c750 tx=0x7f612800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:50.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f6135600640 1 -- 172.21.15.49:0/3315635392 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128005af0 con 0x7f61380d1d10 2024-01-31T05:04:50.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f6135600640 1 -- 172.21.15.49:0/3315635392 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6128005c50 con 0x7f61380d1d10 2024-01-31T05:04:50.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f6140400640 1 -- 172.21.15.49:0/3315635392 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61381f7620 con 0x7f61380d1d10 2024-01-31T05:04:50.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.919+0000 7f6135600640 1 -- 172.21.15.49:0/3315635392 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128007070 con 0x7f61380d1d10 2024-01-31T05:04:50.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.923+0000 7f6140400640 1 -- 172.21.15.49:0/3315635392 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61381f7be0 con 0x7f61380d1d10 2024-01-31T05:04:50.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.923+0000 7f6140400640 1 -- 172.21.15.49:0/3315635392 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61380cfed0 con 0x7f61380d1d10 2024-01-31T05:04:50.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.923+0000 7f6135600640 1 -- 172.21.15.49:0/3315635392 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f61280071d0 con 0x7f61380d1d10 2024-01-31T05:04:50.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.923+0000 7f6135600640 1 --2- 172.21.15.49:0/3315635392 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6110066530 0x7f61100689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:50.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.923+0000 7f6135600640 1 -- 172.21.15.49:0/3315635392 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f61280838f0 con 0x7f61380d1d10 2024-01-31T05:04:50.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.923+0000 7f613d000640 1 --2- 172.21.15.49:0/3315635392 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6110066530 0x7f61100689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:50.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.923+0000 7f613d000640 1 --2- 172.21.15.49:0/3315635392 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6110066530 0x7f61100689f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f61380b1eb0 tx=0x7f6120009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:50.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:50.927+0000 7f6135600640 1 -- 172.21.15.49:0/3315635392 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f6128054340 con 0x7f61380d1d10 2024-01-31T05:04:51.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.119+0000 7f6140400640 1 -- 172.21.15.49:0/3315635392 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6138074860 con 0x7f61380d1d10 2024-01-31T05:04:51.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.123+0000 7f6135600640 1 -- 172.21.15.49:0/3315635392 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7f6128017090 con 0x7f61380d1d10 2024-01-31T05:04:51.123 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:51.123 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2308601440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2308601440},{"type":"v1","addr":"172.21.15.49:6835","nonce":2308601440}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2920530340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":2920530340},{"type":"v1","addr":"172.21.15.195:6836","nonce":2920530340}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3114317228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3114317228},{"type":"v1","addr":"172.21.15.195:6837","nonce":3114317228}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-31T05:04:16.248649+0000","modified":"2024-01-31T05:04:39.667986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/4254852793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4254852793},{"type":"v1","addr":"172.21.15.49:6834","nonce":4254852793}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:04:51.123 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2024-01-31T05:04:51.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.123+0000 7f6140400640 1 -- 172.21.15.49:0/3315635392 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6110066530 msgr2=0x7f61100689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:51.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.123+0000 7f6140400640 1 --2- 172.21.15.49:0/3315635392 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6110066530 0x7f61100689f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f61380b1eb0 tx=0x7f6120009040 comp rx=0 tx=0).stop 2024-01-31T05:04:51.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.123+0000 7f6140400640 1 -- 172.21.15.49:0/3315635392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61380d1d10 msgr2=0x7f61380b0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:51.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.123+0000 7f6140400640 1 --2- 172.21.15.49:0/3315635392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61380d1d10 0x7f61380b0db0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f612800c750 tx=0x7f612800cc10 comp rx=0 tx=0).stop 2024-01-31T05:04:51.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.123+0000 7f6140400640 1 -- 172.21.15.49:0/3315635392 shutdown_connections 2024-01-31T05:04:51.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.123+0000 7f6140400640 1 --2- 172.21.15.49:0/3315635392 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6110066530 0x7f61100689f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.123+0000 7f6140400640 1 --2- 172.21.15.49:0/3315635392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6138160c10 0x7f6138153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.123+0000 7f6140400640 1 --2- 172.21.15.49:0/3315635392 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6138160830 0x7f61380b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.123+0000 7f6140400640 1 --2- 172.21.15.49:0/3315635392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61380d1d10 0x7f61380b0db0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.123+0000 7f6140400640 1 -- 172.21.15.49:0/3315635392 >> 172.21.15.49:0/3315635392 conn(0x7f61380d3020 msgr2=0x7f613806bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:51.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.123+0000 7f6140400640 1 -- 172.21.15.49:0/3315635392 shutdown_connections 2024-01-31T05:04:51.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.123+0000 7f6140400640 1 -- 172.21.15.49:0/3315635392 wait complete. 2024-01-31T05:04:51.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:04:51.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.287+0000 7f03c0e00640 1 Processor -- start 2024-01-31T05:04:51.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.287+0000 7f03c0e00640 1 -- start start 2024-01-31T05:04:51.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.287+0000 7f03c0e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f03bc0b2db0 0x7f03bc06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:51.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.287+0000 7f03c0e00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03bc0ad4a0 con 0x7f03bc15af10 2024-01-31T05:04:51.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.287+0000 7f03c0e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03bc0b3240 con 0x7f03bc06acb0 2024-01-31T05:04:51.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.287+0000 7f03c0e00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03bc0b4ff0 con 0x7f03bc0b2db0 2024-01-31T05:04:51.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.287+0000 7f03b9400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f03bc0b2db0 0x7f03bc06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:51.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.287+0000 7f03b9e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f03bc15af10 0x7f03bc0acd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53226/0 (socket says 172.21.15.49:53226) 2024-01-31T05:04:51.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.287+0000 7f03b9e00640 1 -- 172.21.15.49:0/1156785703 learned_addr learned my addr 172.21.15.49:0/1156785703 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:51.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.287+0000 7f03b9400640 1 -- 172.21.15.49:0/1156785703 >> v1:172.21.15.195:6789/0 conn(0x7f03bc06acb0 legacy=0x7f03bc071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:51.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.287+0000 7f03b9400640 1 -- 172.21.15.49:0/1156785703 >> v1:172.21.15.49:6789/0 conn(0x7f03bc15af10 legacy=0x7f03bc0acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:51.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.287+0000 7f03b8a00640 1 -- 172.21.15.49:0/1156785703 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695117532 0 0) 0x7f03bc0ad4a0 con 0x7f03bc15af10 2024-01-31T05:04:51.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.287+0000 7f03b9400640 1 -- 172.21.15.49:0/1156785703 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03bc06b0d0 con 0x7f03bc0b2db0 2024-01-31T05:04:51.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.291+0000 7f03b9400640 1 --2- 172.21.15.49:0/1156785703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03bc0b2db0 0x7f03bc06a770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f03a40097c0 tx=0x7f03a401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6e7d41f80b660e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:51.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.291+0000 7f03b8a00640 1 -- 172.21.15.49:0/1156785703 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a40ab600 con 0x7f03bc0b2db0 2024-01-31T05:04:51.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.291+0000 7f03b8a00640 1 -- 172.21.15.49:0/1156785703 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a40a7050 con 0x7f03bc0b2db0 2024-01-31T05:04:51.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.291+0000 7f03b8a00640 1 -- 172.21.15.49:0/1156785703 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a40ab980 con 0x7f03bc0b2db0 2024-01-31T05:04:51.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.291+0000 7f03c0e00640 1 -- 172.21.15.49:0/1156785703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03bc0b2db0 msgr2=0x7f03bc06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:51.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.291+0000 7f03c0e00640 1 --2- 172.21.15.49:0/1156785703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03bc0b2db0 0x7f03bc06a770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f03a40097c0 tx=0x7f03a401c3f0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.291+0000 7f03c0e00640 1 -- 172.21.15.49:0/1156785703 shutdown_connections 2024-01-31T05:04:51.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.291+0000 7f03c0e00640 1 --2- 172.21.15.49:0/1156785703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03bc0b2db0 0x7f03bc06a770 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.291+0000 7f03c0e00640 1 -- 172.21.15.49:0/1156785703 >> 172.21.15.49:0/1156785703 conn(0x7f03bc0b1ab0 msgr2=0x7f03bc0b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:51.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.291+0000 7f03c0e00640 1 -- 172.21.15.49:0/1156785703 shutdown_connections 2024-01-31T05:04:51.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.291+0000 7f03c0e00640 1 -- 172.21.15.49:0/1156785703 wait complete. 2024-01-31T05:04:51.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03c0e00640 1 Processor -- start 2024-01-31T05:04:51.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03c0e00640 1 -- start start 2024-01-31T05:04:51.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03c0e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03bc06acb0 0x7f03bc14f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:51.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03c0e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03bc0b2db0 0x7f03bc153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:51.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03c0e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03bc15af10 0x7f03bc156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:51.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03c0e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc15d8d0 con 0x7f03bc15af10 2024-01-31T05:04:51.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03c0e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc150040 con 0x7f03bc06acb0 2024-01-31T05:04:51.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03c0e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc14fd60 con 0x7f03bc0b2db0 2024-01-31T05:04:51.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03ba800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03bc15af10 0x7f03bc156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:51.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03ba800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03bc15af10 0x7f03bc156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56604/0 (socket says 172.21.15.49:56604) 2024-01-31T05:04:51.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03ba800640 1 -- 172.21.15.49:0/1152523905 learned_addr learned my addr 172.21.15.49:0/1152523905 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:51.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03b9e00640 1 --2- 172.21.15.49:0/1152523905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03bc06acb0 0x7f03bc14f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:51.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03b9400640 1 --2- 172.21.15.49:0/1152523905 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03bc0b2db0 0x7f03bc153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:51.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03ba800640 1 -- 172.21.15.49:0/1152523905 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03bc0b2db0 msgr2=0x7f03bc153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:51.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03ba800640 1 --2- 172.21.15.49:0/1152523905 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03bc0b2db0 0x7f03bc153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03ba800640 1 -- 172.21.15.49:0/1152523905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03bc06acb0 msgr2=0x7f03bc14f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:51.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03ba800640 1 --2- 172.21.15.49:0/1152523905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03bc06acb0 0x7f03bc14f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03ba800640 1 -- 172.21.15.49:0/1152523905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a4009420 con 0x7f03bc15af10 2024-01-31T05:04:51.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03ba800640 1 --2- 172.21.15.49:0/1152523905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03bc15af10 0x7f03bc156c60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f03b400c770 tx=0x7f03b400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:51.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03b2000640 1 -- 172.21.15.49:0/1152523905 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b4003b80 con 0x7f03bc15af10 2024-01-31T05:04:51.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03b2000640 1 -- 172.21.15.49:0/1152523905 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b4003ce0 con 0x7f03bc15af10 2024-01-31T05:04:51.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03c0e00640 1 -- 172.21.15.49:0/1152523905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03bc15d280 con 0x7f03bc15af10 2024-01-31T05:04:51.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03b2000640 1 -- 172.21.15.49:0/1152523905 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b400aa90 con 0x7f03bc15af10 2024-01-31T05:04:51.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.295+0000 7f03c0e00640 1 -- 172.21.15.49:0/1152523905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03bc153bc0 con 0x7f03bc15af10 2024-01-31T05:04:51.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.299+0000 7f03c0e00640 1 -- 172.21.15.49:0/1152523905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03bc074860 con 0x7f03bc15af10 2024-01-31T05:04:51.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.299+0000 7f03b2000640 1 -- 172.21.15.49:0/1152523905 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f03b400abf0 con 0x7f03bc15af10 2024-01-31T05:04:51.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.299+0000 7f03b2000640 1 --2- 172.21.15.49:0/1152523905 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0394066500 0x7f03940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:51.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.299+0000 7f03b2000640 1 -- 172.21.15.49:0/1152523905 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f03b4083ec0 con 0x7f03bc15af10 2024-01-31T05:04:51.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.299+0000 7f03b9e00640 1 --2- 172.21.15.49:0/1152523905 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0394066500 0x7f03940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:51.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.299+0000 7f03b9e00640 1 --2- 172.21.15.49:0/1152523905 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0394066500 0x7f03940689c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f03ac007bc0 tx=0x7f03ac007b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:51.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.303+0000 7f03b2000640 1 -- 172.21.15.49:0/1152523905 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f03b4050f00 con 0x7f03bc15af10 2024-01-31T05:04:51.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.467+0000 7f03c0e00640 1 -- 172.21.15.49:0/1152523905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03bc0b2980 con 0x7f03bc15af10 2024-01-31T05:04:51.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.467+0000 7f03b2000640 1 -- 172.21.15.49:0/1152523905 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18323 (secure 0 0 0) 0x7f03b4054520 con 0x7f03bc15af10 2024-01-31T05:04:51.470 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:51.470 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:20.695841+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:04:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.471+0000 7f03c0e00640 1 -- 172.21.15.49:0/1152523905 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0394066500 msgr2=0x7f03940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.471+0000 7f03c0e00640 1 --2- 172.21.15.49:0/1152523905 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0394066500 0x7f03940689c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f03ac007bc0 tx=0x7f03ac007b10 comp rx=0 tx=0).stop 2024-01-31T05:04:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.471+0000 7f03c0e00640 1 -- 172.21.15.49:0/1152523905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03bc15af10 msgr2=0x7f03bc156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.471+0000 7f03c0e00640 1 --2- 172.21.15.49:0/1152523905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03bc15af10 0x7f03bc156c60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f03b400c770 tx=0x7f03b400cc30 comp rx=0 tx=0).stop 2024-01-31T05:04:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.471+0000 7f03c0e00640 1 -- 172.21.15.49:0/1152523905 shutdown_connections 2024-01-31T05:04:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.471+0000 7f03c0e00640 1 --2- 172.21.15.49:0/1152523905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03bc15af10 0x7f03bc156c60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.471+0000 7f03c0e00640 1 --2- 172.21.15.49:0/1152523905 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03bc0b2db0 0x7f03bc153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.471+0000 7f03c0e00640 1 --2- 172.21.15.49:0/1152523905 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0394066500 0x7f03940689c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.471+0000 7f03c0e00640 1 --2- 172.21.15.49:0/1152523905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03bc06acb0 0x7f03bc14f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.471+0000 7f03c0e00640 1 -- 172.21.15.49:0/1152523905 >> 172.21.15.49:0/1152523905 conn(0x7f03bc0b1ab0 msgr2=0x7f03bc0b1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.471+0000 7f03c0e00640 1 -- 172.21.15.49:0/1152523905 shutdown_connections 2024-01-31T05:04:51.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.471+0000 7f03c0e00640 1 -- 172.21.15.49:0/1152523905 wait complete. 2024-01-31T05:04:51.493 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:04:51.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.631+0000 7fdfa7e00640 1 Processor -- start 2024-01-31T05:04:51.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.631+0000 7fdfa7e00640 1 -- start start 2024-01-31T05:04:51.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.635+0000 7fdfa7e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfa00b30e0 0x7fdfa015e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:51.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.635+0000 7fdfa7e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdfa00b34c0 0x7fdfa00720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:51.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.635+0000 7fdfa7e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfa00703c0 con 0x7fdfa006c2d0 2024-01-31T05:04:51.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.635+0000 7fdfa7e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa00b1dd0 con 0x7fdfa00b34c0 2024-01-31T05:04:51.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.635+0000 7fdfa7e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa0070610 con 0x7fdfa00b30e0 2024-01-31T05:04:51.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.635+0000 7fdfa4a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdfa00b34c0 0x7fdfa00720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:51.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.635+0000 7fdfa5400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfa00b30e0 0x7fdfa015e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:51.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.635+0000 7fdfa5e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fdfa006c2d0 0x7fdfa00b22b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:42100/0 (socket says 172.21.15.49:42100) 2024-01-31T05:04:51.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.635+0000 7fdfa5e00640 1 -- 172.21.15.49:0/2246967820 learned_addr learned my addr 172.21.15.49:0/2246967820 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:51.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.635+0000 7fdfa5400640 1 -- 172.21.15.49:0/2246967820 >> v2:172.21.15.195:3300/0 conn(0x7fdfa00b34c0 msgr2=0x7fdfa00720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:51.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.635+0000 7fdfa5400640 1 --2- 172.21.15.49:0/2246967820 >> v2:172.21.15.195:3300/0 conn(0x7fdfa00b34c0 0x7fdfa00720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.635+0000 7fdfa5400640 1 -- 172.21.15.49:0/2246967820 >> v1:172.21.15.195:6789/0 conn(0x7fdfa006c2d0 legacy=0x7fdfa00b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:51.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.635+0000 7fdfa5400640 1 -- 172.21.15.49:0/2246967820 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa00708f0 con 0x7fdfa00b30e0 2024-01-31T05:04:51.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.635+0000 7fdf9fe00640 1 -- 172.21.15.49:0/2246967820 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665145248 0 0) 0x7fdfa00703c0 con 0x7fdfa006c2d0 2024-01-31T05:04:51.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.635+0000 7fdfa4a00640 1 --2- 172.21.15.49:0/2246967820 >> v2:172.21.15.195:3300/0 conn(0x7fdfa00b34c0 0x7fdfa00720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:04:51.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.639+0000 7fdfa5400640 1 --2- 172.21.15.49:0/2246967820 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfa00b30e0 0x7fdfa015e1c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdf900097c0 tx=0x7fdf9001c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a422791d1603753 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:51.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.639+0000 7fdf9fe00640 1 -- 172.21.15.49:0/2246967820 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf900ab600 con 0x7fdfa00b30e0 2024-01-31T05:04:51.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.639+0000 7fdf9fe00640 1 -- 172.21.15.49:0/2246967820 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf900a7050 con 0x7fdfa00b30e0 2024-01-31T05:04:51.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.639+0000 7fdf9fe00640 1 -- 172.21.15.49:0/2246967820 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf900ab980 con 0x7fdfa00b30e0 2024-01-31T05:04:51.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.639+0000 7fdfa7e00640 1 -- 172.21.15.49:0/2246967820 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfa00b30e0 msgr2=0x7fdfa015e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:51.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.639+0000 7fdfa7e00640 1 --2- 172.21.15.49:0/2246967820 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfa00b30e0 0x7fdfa015e1c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdf900097c0 tx=0x7fdf9001c360 comp rx=0 tx=0).stop 2024-01-31T05:04:51.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.639+0000 7fdfa7e00640 1 -- 172.21.15.49:0/2246967820 shutdown_connections 2024-01-31T05:04:51.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.639+0000 7fdfa7e00640 1 --2- 172.21.15.49:0/2246967820 >> v2:172.21.15.195:3300/0 conn(0x7fdfa00b34c0 0x7fdfa00720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.639+0000 7fdfa7e00640 1 --2- 172.21.15.49:0/2246967820 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfa00b30e0 0x7fdfa015e1c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.639+0000 7fdfa7e00640 1 -- 172.21.15.49:0/2246967820 >> 172.21.15.49:0/2246967820 conn(0x7fdfa00b09a0 msgr2=0x7fdfa00b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:51.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.639+0000 7fdfa7e00640 1 -- 172.21.15.49:0/2246967820 shutdown_connections 2024-01-31T05:04:51.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.639+0000 7fdfa7e00640 1 -- 172.21.15.49:0/2246967820 wait complete. 2024-01-31T05:04:51.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.639+0000 7fdfa7e00640 1 Processor -- start 2024-01-31T05:04:51.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa7e00640 1 -- start start 2024-01-31T05:04:51.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa7e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfa006c2d0 0x7fdfa014f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:51.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa7e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfa00b30e0 0x7fdfa014fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa7e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfa00b34c0 0x7fdfa00ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa7e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa01503a0 con 0x7fdfa006c2d0 2024-01-31T05:04:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa7e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa0143480 con 0x7fdfa00b30e0 2024-01-31T05:04:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa7e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa01431a0 con 0x7fdfa00b34c0 2024-01-31T05:04:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa5400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfa006c2d0 0x7fdfa014f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa5400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfa006c2d0 0x7fdfa014f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56614/0 (socket says 172.21.15.49:56614) 2024-01-31T05:04:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa5400640 1 -- 172.21.15.49:0/175579945 learned_addr learned my addr 172.21.15.49:0/175579945 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa4a00640 1 --2- 172.21.15.49:0/175579945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfa00b30e0 0x7fdfa014fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa5e00640 1 --2- 172.21.15.49:0/175579945 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfa00b34c0 0x7fdfa00ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa5400640 1 -- 172.21.15.49:0/175579945 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfa00b34c0 msgr2=0x7fdfa00ad030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa5400640 1 --2- 172.21.15.49:0/175579945 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfa00b34c0 0x7fdfa00ad030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa5400640 1 -- 172.21.15.49:0/175579945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfa00b30e0 msgr2=0x7fdfa014fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa5400640 1 --2- 172.21.15.49:0/175579945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfa00b30e0 0x7fdfa014fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa5400640 1 -- 172.21.15.49:0/175579945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf88009420 con 0x7fdfa006c2d0 2024-01-31T05:04:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa4a00640 1 --2- 172.21.15.49:0/175579945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfa00b30e0 0x7fdfa014fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa5400640 1 --2- 172.21.15.49:0/175579945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfa006c2d0 0x7fdfa014f920 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdf900ae040 tx=0x7fdf90019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdf9d600640 1 -- 172.21.15.49:0/175579945 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf900b7450 con 0x7fdfa006c2d0 2024-01-31T05:04:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdf9d600640 1 -- 172.21.15.49:0/175579945 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf900b75b0 con 0x7fdfa006c2d0 2024-01-31T05:04:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdf9d600640 1 -- 172.21.15.49:0/175579945 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf900b7960 con 0x7fdfa006c2d0 2024-01-31T05:04:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa7e00640 1 -- 172.21.15.49:0/175579945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf90009420 con 0x7fdfa006c2d0 2024-01-31T05:04:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa7e00640 1 -- 172.21.15.49:0/175579945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa0152760 con 0x7fdfa006c2d0 2024-01-31T05:04:51.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.643+0000 7fdfa7e00640 1 -- 172.21.15.49:0/175579945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa0074860 con 0x7fdfa006c2d0 2024-01-31T05:04:51.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.647+0000 7fdf9d600640 1 -- 172.21.15.49:0/175579945 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fdf900b7ac0 con 0x7fdfa006c2d0 2024-01-31T05:04:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.647+0000 7fdf9d600640 1 --2- 172.21.15.49:0/175579945 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdf78066500 0x7fdf780689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.647+0000 7fdf9d600640 1 -- 172.21.15.49:0/175579945 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdf9011ea20 con 0x7fdfa006c2d0 2024-01-31T05:04:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.647+0000 7fdfa4a00640 1 --2- 172.21.15.49:0/175579945 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdf78066500 0x7fdf780689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:51.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.647+0000 7fdfa4a00640 1 --2- 172.21.15.49:0/175579945 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdf78066500 0x7fdf780689c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0151240 tx=0x7fdf88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:51.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.651+0000 7fdf9d600640 1 -- 172.21.15.49:0/175579945 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fdf900eb930 con 0x7fdfa006c2d0 2024-01-31T05:04:51.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.843+0000 7fdfa7e00640 1 -- 172.21.15.49:0/175579945 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfa00b3d00 con 0x7fdfa006c2d0 2024-01-31T05:04:51.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.843+0000 7fdf9d600640 1 -- 172.21.15.49:0/175579945 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7fdf900bb090 con 0x7fdfa006c2d0 2024-01-31T05:04:51.848 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:04:51.848 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2308601440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2308601440},{"type":"v1","addr":"172.21.15.49:6835","nonce":2308601440}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2920530340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":2920530340},{"type":"v1","addr":"172.21.15.195:6836","nonce":2920530340}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3114317228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3114317228},{"type":"v1","addr":"172.21.15.195:6837","nonce":3114317228}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-31T05:04:16.248649+0000","modified":"2024-01-31T05:04:39.667986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/4254852793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4254852793},{"type":"v1","addr":"172.21.15.49:6834","nonce":4254852793}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:04:51.849 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2024-01-31T05:04:51.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.843+0000 7fdfa7e00640 1 -- 172.21.15.49:0/175579945 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdf78066500 msgr2=0x7fdf780689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:51.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.843+0000 7fdfa7e00640 1 --2- 172.21.15.49:0/175579945 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdf78066500 0x7fdf780689c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0151240 tx=0x7fdf88008040 comp rx=0 tx=0).stop 2024-01-31T05:04:51.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.843+0000 7fdfa7e00640 1 -- 172.21.15.49:0/175579945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfa006c2d0 msgr2=0x7fdfa014f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:51.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.843+0000 7fdfa7e00640 1 --2- 172.21.15.49:0/175579945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfa006c2d0 0x7fdfa014f920 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdf900ae040 tx=0x7fdf90019100 comp rx=0 tx=0).stop 2024-01-31T05:04:51.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.843+0000 7fdfa7e00640 1 -- 172.21.15.49:0/175579945 shutdown_connections 2024-01-31T05:04:51.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.843+0000 7fdfa7e00640 1 --2- 172.21.15.49:0/175579945 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfa00b34c0 0x7fdfa00ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.843+0000 7fdfa7e00640 1 --2- 172.21.15.49:0/175579945 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdf78066500 0x7fdf780689c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.843+0000 7fdfa7e00640 1 --2- 172.21.15.49:0/175579945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfa00b30e0 0x7fdfa014fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.843+0000 7fdfa7e00640 1 --2- 172.21.15.49:0/175579945 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfa006c2d0 0x7fdfa014f920 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:51.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.843+0000 7fdfa7e00640 1 -- 172.21.15.49:0/175579945 >> 172.21.15.49:0/175579945 conn(0x7fdfa00b09a0 msgr2=0x7fdfa014cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:51.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.843+0000 7fdfa7e00640 1 -- 172.21.15.49:0/175579945 shutdown_connections 2024-01-31T05:04:51.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:51.843+0000 7fdfa7e00640 1 -- 172.21.15.49:0/175579945 wait complete. 2024-01-31T05:04:52.270 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-31T05:04:16.248649+0000', 'modified': '2024-01-31T05:04:39.667986+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4269': {'gid': 4269, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6834/4254852793', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6832', 'nonce': 4254852793}, {'type': 'v1', 'addr': '172.21.15.49:6834', 'nonce': 4254852793}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-31T05:04:52.270 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-31T05:04:52.270 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-31T05:04:52.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.415+0000 7f9481a00640 1 Processor -- start 2024-01-31T05:04:52.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.415+0000 7f9481a00640 1 -- start start 2024-01-31T05:04:52.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.419+0000 7f9481a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f947c0cd6e0 0x7f947c0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:52.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.419+0000 7f9481a00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947c06c1b0 con 0x7f947c0cef80 2024-01-31T05:04:52.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.419+0000 7f9481a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947c06f4e0 con 0x7f947c06e5f0 2024-01-31T05:04:52.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.419+0000 7f9481a00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f947c06d890 con 0x7f947c0cd6e0 2024-01-31T05:04:52.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.419+0000 7f947aa00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f947c0cd6e0 0x7f947c0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:52.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.419+0000 7f947b400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f947c0cef80 0x7f947c0cf410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53228/0 (socket says 172.21.15.49:53228) 2024-01-31T05:04:52.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.419+0000 7f947b400640 1 -- 172.21.15.49:0/3725197687 learned_addr learned my addr 172.21.15.49:0/3725197687 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:52.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.419+0000 7f947aa00640 1 -- 172.21.15.49:0/3725197687 >> v1:172.21.15.195:6789/0 conn(0x7f947c06e5f0 legacy=0x7f947c0cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:52.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.419+0000 7f947aa00640 1 -- 172.21.15.49:0/3725197687 >> v1:172.21.15.49:6789/0 conn(0x7f947c0cef80 legacy=0x7f947c0cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:52.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.419+0000 7f947aa00640 1 -- 172.21.15.49:0/3725197687 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c06f760 con 0x7f947c0cd6e0 2024-01-31T05:04:52.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.419+0000 7f9479600640 1 -- 172.21.15.49:0/3725197687 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861033361 0 0) 0x7f947c06c1b0 con 0x7f947c0cef80 2024-01-31T05:04:52.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.423+0000 7f947aa00640 1 --2- 172.21.15.49:0/3725197687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f947c0cd6e0 0x7f947c0cb4b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f946c0097f0 tx=0x7f946c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee9e3af1f221460 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:52.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.423+0000 7f9479600640 1 -- 172.21.15.49:0/3725197687 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c0a8970 con 0x7f947c0cd6e0 2024-01-31T05:04:52.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.423+0000 7f9479600640 1 -- 172.21.15.49:0/3725197687 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946c0a8ad0 con 0x7f947c0cd6e0 2024-01-31T05:04:52.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.423+0000 7f9479600640 1 -- 172.21.15.49:0/3725197687 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c0a8e60 con 0x7f947c0cd6e0 2024-01-31T05:04:52.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.423+0000 7f9481a00640 1 -- 172.21.15.49:0/3725197687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f947c0cd6e0 msgr2=0x7f947c0cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:52.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.423+0000 7f9481a00640 1 --2- 172.21.15.49:0/3725197687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f947c0cd6e0 0x7f947c0cb4b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f946c0097f0 tx=0x7f946c01ec70 comp rx=0 tx=0).stop 2024-01-31T05:04:52.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.423+0000 7f9481a00640 1 -- 172.21.15.49:0/3725197687 shutdown_connections 2024-01-31T05:04:52.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.423+0000 7f9481a00640 1 --2- 172.21.15.49:0/3725197687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f947c0cd6e0 0x7f947c0cb4b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.423+0000 7f9481a00640 1 -- 172.21.15.49:0/3725197687 >> 172.21.15.49:0/3725197687 conn(0x7f947c0d0e60 msgr2=0x7f947c0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:52.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.423+0000 7f9481a00640 1 -- 172.21.15.49:0/3725197687 shutdown_connections 2024-01-31T05:04:52.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.423+0000 7f9481a00640 1 -- 172.21.15.49:0/3725197687 wait complete. 2024-01-31T05:04:52.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.423+0000 7f9481a00640 1 Processor -- start 2024-01-31T05:04:52.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.423+0000 7f9481a00640 1 -- start start 2024-01-31T05:04:52.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f9481a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f947c06e5f0 0x7f947c157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:52.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f9481a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f947c0cd6e0 0x7f947c159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:52.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f9481a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f947c0cef80 0x7f947c0c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:52.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f9481a00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c157920 con 0x7f947c06e5f0 2024-01-31T05:04:52.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f9481a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c156fc0 con 0x7f947c0cd6e0 2024-01-31T05:04:52.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f9481a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c15a310 con 0x7f947c0cef80 2024-01-31T05:04:52.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f947aa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f947c06e5f0 0x7f947c157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:52.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f947aa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f947c06e5f0 0x7f947c157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56624/0 (socket says 172.21.15.49:56624) 2024-01-31T05:04:52.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f947aa00640 1 -- 172.21.15.49:0/1973303264 learned_addr learned my addr 172.21.15.49:0/1973303264 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:52.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f947b400640 1 --2- 172.21.15.49:0/1973303264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f947c0cef80 0x7f947c0c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:52.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f947a000640 1 --2- 172.21.15.49:0/1973303264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f947c0cd6e0 0x7f947c159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:52.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f947aa00640 1 -- 172.21.15.49:0/1973303264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f947c0cef80 msgr2=0x7f947c0c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:52.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f947aa00640 1 --2- 172.21.15.49:0/1973303264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f947c0cef80 0x7f947c0c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f947aa00640 1 -- 172.21.15.49:0/1973303264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f947c0cd6e0 msgr2=0x7f947c159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:52.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f947aa00640 1 --2- 172.21.15.49:0/1973303264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f947c0cd6e0 0x7f947c159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f947aa00640 1 -- 172.21.15.49:0/1973303264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c009420 con 0x7f947c06e5f0 2024-01-31T05:04:52.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f947b400640 1 --2- 172.21.15.49:0/1973303264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f947c0cef80 0x7f947c0c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:52.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f947a000640 1 --2- 172.21.15.49:0/1973303264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f947c0cd6e0 0x7f947c159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:52.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f947aa00640 1 --2- 172.21.15.49:0/1973303264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f947c06e5f0 0x7f947c157d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f946c01b880 tx=0x7f946c01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:52.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f9472a00640 1 -- 172.21.15.49:0/1973303264 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c0a8970 con 0x7f947c06e5f0 2024-01-31T05:04:52.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f9472a00640 1 -- 172.21.15.49:0/1973303264 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946c0b9410 con 0x7f947c06e5f0 2024-01-31T05:04:52.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f9481a00640 1 -- 172.21.15.49:0/1973303264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947c1f3af0 con 0x7f947c06e5f0 2024-01-31T05:04:52.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f9472a00640 1 -- 172.21.15.49:0/1973303264 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c0b97a0 con 0x7f947c06e5f0 2024-01-31T05:04:52.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.427+0000 7f9481a00640 1 -- 172.21.15.49:0/1973303264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947c157540 con 0x7f947c06e5f0 2024-01-31T05:04:52.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f9472a00640 1 -- 172.21.15.49:0/1973303264 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f946c0b7040 con 0x7f947c06e5f0 2024-01-31T05:04:52.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f9472a00640 1 --2- 172.21.15.49:0/1973303264 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9454066500 0x7f94540689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:52.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f9472a00640 1 -- 172.21.15.49:0/1973303264 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f946c121ff0 con 0x7f947c06e5f0 2024-01-31T05:04:52.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f9484e4a000 1 Processor -- start 2024-01-31T05:04:52.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f9484e4a000 1 -- start start 2024-01-31T05:04:52.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f947a000640 1 --2- 172.21.15.49:0/1973303264 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9454066500 0x7f94540689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:52.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f9484e4a000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aeec770 0x55f72aeecb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:52.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f9484e4a000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeed090 0x55f72aea26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:52.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f9484e4a000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aea2c10 0x55f72aea2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:52.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f9484e4a000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72ad0c720 con 0x55f72aeed090 2024-01-31T05:04:52.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f9484e4a000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72acfad70 con 0x55f72aeec770 2024-01-31T05:04:52.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f9484e4a000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f72acf82a0 con 0x55f72aea2c10 2024-01-31T05:04:52.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f947a000640 1 --2- 172.21.15.49:0/1973303264 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9454066500 0x7f94540689c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f947c158280 tx=0x7f9464009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:52.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f947a000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeed090 0x55f72aea26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:52.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f947a000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeed090 0x55f72aea26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56634/0 (socket says 172.21.15.49:56634) 2024-01-31T05:04:52.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f947a000640 1 -- 172.21.15.49:0/2617604742 learned_addr learned my addr 172.21.15.49:0/2617604742 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:52.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f947b400640 1 --2- 172.21.15.49:0/2617604742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aea2c10 0x55f72aea2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:52.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f947aa00640 1 --2- 172.21.15.49:0/2617604742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aeec770 0x55f72aeecb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:52.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f947a000640 1 -- 172.21.15.49:0/2617604742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aea2c10 msgr2=0x55f72aea2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:52.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f947a000640 1 --2- 172.21.15.49:0/2617604742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aea2c10 0x55f72aea2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f947a000640 1 -- 172.21.15.49:0/2617604742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aeec770 msgr2=0x55f72aeecb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:52.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f947a000640 1 --2- 172.21.15.49:0/2617604742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aeec770 0x55f72aeecb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f947a000640 1 -- 172.21.15.49:0/2617604742 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f72a9ea890 con 0x55f72aeed090 2024-01-31T05:04:52.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f947a000640 1 --2- 172.21.15.49:0/2617604742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeed090 0x55f72aea26d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9464001e50 tx=0x7f9464010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0ddc0e539db82e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f946b400640 1 -- 172.21.15.49:0/2617604742 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464014a70 con 0x55f72aeed090 2024-01-31T05:04:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f946b400640 1 -- 172.21.15.49:0/2617604742 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9464014bd0 con 0x55f72aeed090 2024-01-31T05:04:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.431+0000 7f946b400640 1 -- 172.21.15.49:0/2617604742 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464007030 con 0x55f72aeed090 2024-01-31T05:04:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f9484e4a000 1 -- 172.21.15.49:0/2617604742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeed090 msgr2=0x55f72aea26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f9484e4a000 1 --2- 172.21.15.49:0/2617604742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeed090 0x55f72aea26d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9464001e50 tx=0x7f9464010000 comp rx=0 tx=0).stop 2024-01-31T05:04:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f9484e4a000 1 -- 172.21.15.49:0/2617604742 shutdown_connections 2024-01-31T05:04:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f9484e4a000 1 --2- 172.21.15.49:0/2617604742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aea2c10 0x55f72aea2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f9484e4a000 1 --2- 172.21.15.49:0/2617604742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeed090 0x55f72aea26d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f9484e4a000 1 --2- 172.21.15.49:0/2617604742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aeec770 0x55f72aeecb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f9484e4a000 1 -- 172.21.15.49:0/2617604742 >> 172.21.15.49:0/2617604742 conn(0x55f72aea8f80 msgr2=0x55f72aea0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f9484e4a000 1 -- 172.21.15.49:0/2617604742 shutdown_connections 2024-01-31T05:04:52.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f9484e4a000 1 -- 172.21.15.49:0/2617604742 wait complete. 2024-01-31T05:04:52.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f9484e4a000 1 -- start start 2024-01-31T05:04:52.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f9484e4a000 1 Processor -- start 2024-01-31T05:04:52.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f9484e4a000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aea2c10 0x55f72aead730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:52.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f9484e4a000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aeec770 0x55f72aeadc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:52.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f9484e4a000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aeed090 0x55f72aeae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:52.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f9484e4a000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72acf3b90 con 0x55f72aea2c10 2024-01-31T05:04:52.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f9484e4a000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72acb04c0 con 0x55f72aeec770 2024-01-31T05:04:52.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f9484e4a000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f72acaee10 con 0x55f72aeed090 2024-01-31T05:04:52.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f9484e4a000 10 client.0 _ll_register_callbacks cb 0x55f72aca9be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:04:52.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f947aa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aea2c10 0x55f72aead730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:52.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f947aa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aea2c10 0x55f72aead730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56642/0 (socket says 172.21.15.49:56642) 2024-01-31T05:04:52.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f947aa00640 1 -- 172.21.15.49:0/4181035098 learned_addr learned my addr 172.21.15.49:0/4181035098 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:52.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f947b400640 1 --2- 172.21.15.49:0/4181035098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aeed090 0x55f72aeae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:52.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f947a000640 1 --2- 172.21.15.49:0/4181035098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aeec770 0x55f72aeadc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:52.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f947aa00640 1 -- 172.21.15.49:0/4181035098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aeed090 msgr2=0x55f72aeae1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:52.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f947aa00640 1 --2- 172.21.15.49:0/4181035098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aeed090 0x55f72aeae1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f947aa00640 1 -- 172.21.15.49:0/4181035098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aeec770 msgr2=0x55f72aeadc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:52.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f947aa00640 1 --2- 172.21.15.49:0/4181035098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aeec770 0x55f72aeadc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f947aa00640 1 -- 172.21.15.49:0/4181035098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947c06f4e0 con 0x55f72aea2c10 2024-01-31T05:04:52.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f947b400640 1 --2- 172.21.15.49:0/4181035098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aeed090 0x55f72aeae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:52.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.435+0000 7f947a000640 1 --2- 172.21.15.49:0/4181035098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aeec770 0x55f72aeadc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:52.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f947aa00640 1 --2- 172.21.15.49:0/4181035098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aea2c10 0x55f72aead730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f946c0fa970 tx=0x7f946c0f3360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3dddf79c7b851e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:52.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9463e00640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-31T05:04:52.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9463e00640 1 -- 172.21.15.49:0/4181035098 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c0faea0 con 0x55f72aea2c10 2024-01-31T05:04:52.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9463e00640 1 -- 172.21.15.49:0/4181035098 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f946c0f2090 con 0x55f72aea2c10 2024-01-31T05:04:52.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 1 -- 172.21.15.49:0/4181035098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f72ac79e30 con 0x55f72aea2c10 2024-01-31T05:04:52.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9463e00640 1 -- 172.21.15.49:0/4181035098 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f946c0f2250 con 0x55f72aea2c10 2024-01-31T05:04:52.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 10 client.4809 fetch_fsmap learned FSMap version 9 2024-01-31T05:04:52.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 1 -- 172.21.15.49:0/4181035098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55f72acb3b80 con 0x55f72aea2c10 2024-01-31T05:04:52.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9463e00640 1 -- 172.21.15.49:0/4181035098 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f72ac79e30 con 0x55f72aea2c10 2024-01-31T05:04:52.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9463e00640 1 -- 172.21.15.49:0/4181035098 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f946c0faa10 con 0x55f72aea2c10 2024-01-31T05:04:52.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 10 client.4809 fetch_fsmap finished waiting for FSMap version 9 2024-01-31T05:04:52.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 10 client.4809 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-31T05:04:52.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 20 client.4809 populate_metadata read hostname 'smithi049' 2024-01-31T05:04:52.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 1 --2- 172.21.15.49:0/4181035098 >> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] conn(0x55f72aefba10 0x55f72aefde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:52.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 4 client.4809 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:04:52.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 1 -- 172.21.15.49:0/4181035098 --> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f72ad20bd0 con 0x55f72aefba10 2024-01-31T05:04:52.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f947a000640 1 --2- 172.21.15.49:0/4181035098 >> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] conn(0x55f72aefba10 0x55f72aefde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:52.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f947a000640 1 --2- 172.21.15.49:0/4181035098 >> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] conn(0x55f72aefba10 0x55f72aefde00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67f80f79fda19a28 server_cookie=2f1f0f5183d1d5b1 in_seq=0 out_seq=0 2024-01-31T05:04:52.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9463e00640 10 client.4809 ms_handle_connect on v2:172.21.15.49:6832/4254852793 2024-01-31T05:04:52.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9463e00640 1 -- 172.21.15.49:0/4181035098 <== mds.0 v2:172.21.15.49:6832/4254852793 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f72ad20bd0 con 0x55f72aefba10 2024-01-31T05:04:52.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9463e00640 10 client.4809 handle_command_reply: tid=0 2024-01-31T05:04:52.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 1 client.4809 shutdown 2024-01-31T05:04:52.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 1 -- 172.21.15.49:0/4181035098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aea2c10 msgr2=0x55f72aead730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:52.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 1 --2- 172.21.15.49:0/4181035098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aea2c10 0x55f72aead730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f946c0fa970 tx=0x7f946c0f3360 comp rx=0 tx=0).stop 2024-01-31T05:04:52.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 1 -- 172.21.15.49:0/4181035098 shutdown_connections 2024-01-31T05:04:52.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 1 --2- 172.21.15.49:0/4181035098 >> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] conn(0x55f72aefba10 0x55f72aefde00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 1 --2- 172.21.15.49:0/4181035098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aeed090 0x55f72aeae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 1 --2- 172.21.15.49:0/4181035098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aeec770 0x55f72aeadc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 1 --2- 172.21.15.49:0/4181035098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aea2c10 0x55f72aead730 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9463e00640 0 client.4809 ms_handle_reset on v2:172.21.15.49:6832/4254852793 2024-01-31T05:04:52.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 1 -- 172.21.15.49:0/4181035098 >> 172.21.15.49:0/4181035098 conn(0x55f72aea8f80 msgr2=0x55f72aea16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:52.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 1 -- 172.21.15.49:0/4181035098 shutdown_connections 2024-01-31T05:04:52.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 1 -- 172.21.15.49:0/4181035098 wait complete. 2024-01-31T05:04:52.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.439+0000 7f9484e4a000 20 client.4809 trim_cache size 0 max 16384 2024-01-31T05:04:52.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.455+0000 7f9484e4a000 1 Processor -- start 2024-01-31T05:04:52.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.455+0000 7f9484e4a000 1 -- start start 2024-01-31T05:04:52.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f9484e4a000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aea2c10 0x55f72aeeb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:52.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f9484e4a000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeec770 0x55f72aeebd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:52.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f9484e4a000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aeed090 0x55f72aefce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:52.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f9484e4a000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72a9ab940 con 0x55f72aeec770 2024-01-31T05:04:52.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f9484e4a000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72acede90 con 0x55f72aea2c10 2024-01-31T05:04:52.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f9484e4a000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f72acab9d0 con 0x55f72aeed090 2024-01-31T05:04:52.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f947a000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeec770 0x55f72aeebd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:52.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f947a000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeec770 0x55f72aeebd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56652/0 (socket says 172.21.15.49:56652) 2024-01-31T05:04:52.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f947a000640 1 -- 172.21.15.49:0/4292717798 learned_addr learned my addr 172.21.15.49:0/4292717798 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:52.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f947aa00640 1 --2- 172.21.15.49:0/4292717798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aea2c10 0x55f72aeeb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:52.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f947b400640 1 --2- 172.21.15.49:0/4292717798 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aeed090 0x55f72aefce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:52.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f947a000640 1 -- 172.21.15.49:0/4292717798 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aeed090 msgr2=0x55f72aefce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:52.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f947a000640 1 --2- 172.21.15.49:0/4292717798 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aeed090 0x55f72aefce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f947a000640 1 -- 172.21.15.49:0/4292717798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aea2c10 msgr2=0x55f72aeeb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:52.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f947a000640 1 --2- 172.21.15.49:0/4292717798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aea2c10 0x55f72aeeb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f947a000640 1 -- 172.21.15.49:0/4292717798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f72ac99bd0 con 0x55f72aeec770 2024-01-31T05:04:52.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f947aa00640 1 --2- 172.21.15.49:0/4292717798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aea2c10 0x55f72aeeb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:52.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f947b400640 1 --2- 172.21.15.49:0/4292717798 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aeed090 0x55f72aefce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:04:52.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f947a000640 1 --2- 172.21.15.49:0/4292717798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeec770 0x55f72aeebd80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9464022040 tx=0x7f946401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88aaf2f87bc1bd10 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:52.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f946aa00640 1 -- 172.21.15.49:0/4292717798 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464014db0 con 0x55f72aeec770 2024-01-31T05:04:52.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f946aa00640 1 -- 172.21.15.49:0/4292717798 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9464031b00 con 0x55f72aeec770 2024-01-31T05:04:52.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f946aa00640 1 -- 172.21.15.49:0/4292717798 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464031e70 con 0x55f72aeec770 2024-01-31T05:04:52.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f9484e4a000 1 -- 172.21.15.49:0/4292717798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeec770 msgr2=0x55f72aeebd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:52.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f9484e4a000 1 --2- 172.21.15.49:0/4292717798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeec770 0x55f72aeebd80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9464022040 tx=0x7f946401c000 comp rx=0 tx=0).stop 2024-01-31T05:04:52.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f9484e4a000 1 -- 172.21.15.49:0/4292717798 shutdown_connections 2024-01-31T05:04:52.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f9484e4a000 1 --2- 172.21.15.49:0/4292717798 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aeed090 0x55f72aefce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f9484e4a000 1 --2- 172.21.15.49:0/4292717798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeec770 0x55f72aeebd80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f9484e4a000 1 --2- 172.21.15.49:0/4292717798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aea2c10 0x55f72aeeb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f9484e4a000 1 -- 172.21.15.49:0/4292717798 >> 172.21.15.49:0/4292717798 conn(0x55f72aea8f80 msgr2=0x55f72aeeb130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:52.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f9484e4a000 1 -- 172.21.15.49:0/4292717798 shutdown_connections 2024-01-31T05:04:52.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f9484e4a000 1 -- 172.21.15.49:0/4292717798 wait complete. 2024-01-31T05:04:52.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f9484e4a000 1 -- start start 2024-01-31T05:04:52.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.459+0000 7f9484e4a000 1 Processor -- start 2024-01-31T05:04:52.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aea2c10 0x55f72af4c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:52.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aeec770 0x55f72af4c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:52.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeed090 0x55f72af07880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:52.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72acef500 con 0x55f72aeed090 2024-01-31T05:04:52.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72acacf90 con 0x55f72aeec770 2024-01-31T05:04:52.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f72ad799a0 con 0x55f72aea2c10 2024-01-31T05:04:52.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 10 client.0 _ll_register_callbacks cb 0x55f72aced300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:04:52.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f947b400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeed090 0x55f72af07880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:52.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f947b400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeed090 0x55f72af07880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56658/0 (socket says 172.21.15.49:56658) 2024-01-31T05:04:52.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f947b400640 1 -- 172.21.15.49:0/3828704997 learned_addr learned my addr 172.21.15.49:0/3828704997 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:52.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f947a000640 1 --2- 172.21.15.49:0/3828704997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aeec770 0x55f72af4c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:52.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f947aa00640 1 --2- 172.21.15.49:0/3828704997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aea2c10 0x55f72af4c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:52.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f947b400640 1 -- 172.21.15.49:0/3828704997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aea2c10 msgr2=0x55f72af4c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:52.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f947b400640 1 --2- 172.21.15.49:0/3828704997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aea2c10 0x55f72af4c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f947b400640 1 -- 172.21.15.49:0/3828704997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aeec770 msgr2=0x55f72af4c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:52.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f947b400640 1 --2- 172.21.15.49:0/3828704997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aeec770 0x55f72af4c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f947b400640 1 -- 172.21.15.49:0/3828704997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f72a9ea890 con 0x55f72aeed090 2024-01-31T05:04:52.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f947b400640 1 --2- 172.21.15.49:0/3828704997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeed090 0x55f72af07880 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9474007330 tx=0x7f9474007730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341738f1f0db04af server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:52.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9463e00640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-31T05:04:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9463e00640 1 -- 172.21.15.49:0/3828704997 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9474007a70 con 0x55f72aeed090 2024-01-31T05:04:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9463e00640 1 -- 172.21.15.49:0/3828704997 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f94740117b0 con 0x55f72aeed090 2024-01-31T05:04:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 -- 172.21.15.49:0/3828704997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f72aca7640 con 0x55f72aeed090 2024-01-31T05:04:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9463e00640 1 -- 172.21.15.49:0/3828704997 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9474011970 con 0x55f72aeed090 2024-01-31T05:04:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 10 client.4815 fetch_fsmap learned FSMap version 9 2024-01-31T05:04:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 -- 172.21.15.49:0/3828704997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55f72a9eacc0 con 0x55f72aeed090 2024-01-31T05:04:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9463e00640 1 -- 172.21.15.49:0/3828704997 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f72aca7640 con 0x55f72aeed090 2024-01-31T05:04:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9463e00640 1 -- 172.21.15.49:0/3828704997 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f9474011ad0 con 0x55f72aeed090 2024-01-31T05:04:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 10 client.4815 fetch_fsmap finished waiting for FSMap version 9 2024-01-31T05:04:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 10 client.4815 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-31T05:04:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 20 client.4815 populate_metadata read hostname 'smithi049' 2024-01-31T05:04:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 --2- 172.21.15.49:0/3828704997 >> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] conn(0x55f72af53060 0x55f72af083c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 4 client.4815 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-31T05:04:52.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 -- 172.21.15.49:0/3828704997 --> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f72aceca20 con 0x55f72af53060 2024-01-31T05:04:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f947aa00640 1 --2- 172.21.15.49:0/3828704997 >> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] conn(0x55f72af53060 0x55f72af083c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9463e00640 10 client.4815 ms_handle_connect on v2:172.21.15.49:6832/4254852793 2024-01-31T05:04:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f947aa00640 1 --2- 172.21.15.49:0/3828704997 >> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] conn(0x55f72af53060 0x55f72af083c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17b29920bdfc8080 server_cookie=9733d4713ab3e3f3 in_seq=0 out_seq=0 2024-01-31T05:04:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9463e00640 1 -- 172.21.15.49:0/3828704997 <== mds.0 v2:172.21.15.49:6832/4254852793 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55f72aceca20 con 0x55f72af53060 2024-01-31T05:04:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9463e00640 10 client.4815 handle_command_reply: tid=0 2024-01-31T05:04:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 client.4815 shutdown 2024-01-31T05:04:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 -- 172.21.15.49:0/3828704997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeed090 msgr2=0x55f72af07880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 --2- 172.21.15.49:0/3828704997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeed090 0x55f72af07880 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9474007330 tx=0x7f9474007730 comp rx=0 tx=0).stop 2024-01-31T05:04:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 -- 172.21.15.49:0/3828704997 shutdown_connections 2024-01-31T05:04:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 --2- 172.21.15.49:0/3828704997 >> [v2:172.21.15.49:6832/4254852793,v1:172.21.15.49:6834/4254852793] conn(0x55f72af53060 0x55f72af083c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 --2- 172.21.15.49:0/3828704997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f72aeed090 0x55f72af07880 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 --2- 172.21.15.49:0/3828704997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f72aeec770 0x55f72af4c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 --2- 172.21.15.49:0/3828704997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55f72aea2c10 0x55f72af4c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9463e00640 0 client.4815 ms_handle_reset on v2:172.21.15.49:6832/4254852793 2024-01-31T05:04:52.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 -- 172.21.15.49:0/3828704997 >> 172.21.15.49:0/3828704997 conn(0x55f72aea8f80 msgr2=0x55f72aeeb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:52.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.463+0000 7f9484e4a000 1 -- 172.21.15.49:0/3828704997 shutdown_connections 2024-01-31T05:04:52.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.467+0000 7f9484e4a000 1 -- 172.21.15.49:0/3828704997 wait complete. 2024-01-31T05:04:52.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.467+0000 7f9484e4a000 20 client.4815 trim_cache size 0 max 16384 2024-01-31T05:04:52.472 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-31T05:04:52.472 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "3d27a9c0-c28e-4304-958f-ef21a88f4ab5", 2024-01-31T05:04:52.472 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-31T05:04:52.472 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4269, 2024-01-31T05:04:52.472 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-31T05:04:52.472 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-31T05:04:52.473 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-31T05:04:52.473 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 35.627689332000003, 2024-01-31T05:04:52.473 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 9, 2024-01-31T05:04:52.473 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 24, 2024-01-31T05:04:52.473 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 24, 2024-01-31T05:04:52.473 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 42.663975241999999 2024-01-31T05:04:52.473 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-31T05:04:52.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.467+0000 7f9481a00640 1 -- 172.21.15.49:0/1973303264 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9454066500 msgr2=0x7f94540689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:52.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.467+0000 7f9481a00640 1 --2- 172.21.15.49:0/1973303264 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9454066500 0x7f94540689c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f947c158280 tx=0x7f9464009040 comp rx=0 tx=0).stop 2024-01-31T05:04:52.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.467+0000 7f9481a00640 1 -- 172.21.15.49:0/1973303264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f947c06e5f0 msgr2=0x7f947c157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:52.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.467+0000 7f9481a00640 1 --2- 172.21.15.49:0/1973303264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f947c06e5f0 0x7f947c157d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f946c01b880 tx=0x7f946c01ba10 comp rx=0 tx=0).stop 2024-01-31T05:04:52.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.467+0000 7f9481a00640 1 -- 172.21.15.49:0/1973303264 shutdown_connections 2024-01-31T05:04:52.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.467+0000 7f9481a00640 1 --2- 172.21.15.49:0/1973303264 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f947c0cef80 0x7f947c0c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.467+0000 7f9481a00640 1 --2- 172.21.15.49:0/1973303264 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9454066500 0x7f94540689c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.467+0000 7f9481a00640 1 --2- 172.21.15.49:0/1973303264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f947c0cd6e0 0x7f947c159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.467+0000 7f9481a00640 1 --2- 172.21.15.49:0/1973303264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f947c06e5f0 0x7f947c157d40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:52.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.467+0000 7f9481a00640 1 -- 172.21.15.49:0/1973303264 >> 172.21.15.49:0/1973303264 conn(0x7f947c0d0e60 msgr2=0x7f947c0ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:52.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.467+0000 7f9481a00640 1 -- 172.21.15.49:0/1973303264 shutdown_connections 2024-01-31T05:04:52.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:52.467+0000 7f9481a00640 1 -- 172.21.15.49:0/1973303264 wait complete. 2024-01-31T05:04:52.488 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-01-31T05:04:52.501 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-01-31T05:04:52.501 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-01-31T05:04:52.501 INFO:tasks.ceph_fuse:client.0 config is {} 2024-01-31T05:04:52.501 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-31T05:04:52.501 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-31T05:04:52.501 INFO:tasks.ceph_fuse:client.2 config is {} 2024-01-31T05:04:52.501 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-31T05:04:52.501 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-01-31T05:04:52.502 INFO:tasks.ceph_fuse:client.1 config is {} 2024-01-31T05:04:52.502 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-31T05:04:52.502 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-31T05:04:52.502 INFO:tasks.ceph_fuse:client.3 config is {} 2024-01-31T05:04:52.502 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-31T05:04:52.502 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-01-31T05:04:52.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:52.502 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-31T05:04:52.511 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-01-31T05:04:52.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:52.512 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-31T05:04:52.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:52.575 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-01-31T05:04:52.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:52.802 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-01-31T05:04:52.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:52.812 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-01-31T05:04:52.879 INFO:teuthology.orchestra.run.smithi195.stderr:Cannot find device "ceph-brx" 2024-01-31T05:04:52.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T05:04:52.882 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-01-31T05:04:52.882 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-31T05:04:53.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd32b200640 1 Processor -- start 2024-01-31T05:04:53.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd32b200640 1 -- start start 2024-01-31T05:04:53.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd32b200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd32415a480 0x7fd32415da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:53.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd32b200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3240b3300 0x7fd3240b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:53.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd32b200640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32415e9a0 con 0x7fd32406e140 2024-01-31T05:04:53.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd32b200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3240ad6e0 con 0x7fd32415a480 2024-01-31T05:04:53.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd32b200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3240b2e70 con 0x7fd3240b3300 2024-01-31T05:04:53.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd323e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd32406e140 0x7fd32406e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53242/0 (socket says 172.21.15.49:53242) 2024-01-31T05:04:53.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd323e00640 1 -- 172.21.15.49:0/2511887092 learned_addr learned my addr 172.21.15.49:0/2511887092 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:53.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd323400640 1 --2- 172.21.15.49:0/2511887092 >> v2:172.21.15.195:3300/0 conn(0x7fd32415a480 0x7fd32415da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:53.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd329200640 1 --2- 172.21.15.49:0/2511887092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3240b3300 0x7fd3240b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:53.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd322a00640 1 -- 172.21.15.49:0/2511887092 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619143772 0 0) 0x7fd32415e9a0 con 0x7fd32406e140 2024-01-31T05:04:53.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd322a00640 1 -- 172.21.15.49:0/2511887092 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd304003530 con 0x7fd32406e140 2024-01-31T05:04:53.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd322a00640 1 -- 172.21.15.49:0/2511887092 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4129436301 0 0) 0x7fd304003530 con 0x7fd32406e140 2024-01-31T05:04:53.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd322a00640 1 -- 172.21.15.49:0/2511887092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3240b3300 msgr2=0x7fd3240b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:53.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd322a00640 1 --2- 172.21.15.49:0/2511887092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3240b3300 0x7fd3240b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:53.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd322a00640 1 -- 172.21.15.49:0/2511887092 >> v2:172.21.15.195:3300/0 conn(0x7fd32415a480 msgr2=0x7fd32415da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:53.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd322a00640 1 --2- 172.21.15.49:0/2511887092 >> v2:172.21.15.195:3300/0 conn(0x7fd32415a480 0x7fd32415da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:53.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd322a00640 1 -- 172.21.15.49:0/2511887092 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32415e100 con 0x7fd32406e140 2024-01-31T05:04:53.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd322a00640 1 -- 172.21.15.49:0/2511887092 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7fd314001680 con 0x7fd32406e140 2024-01-31T05:04:53.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd322a00640 1 -- 172.21.15.49:0/2511887092 >> v1:172.21.15.49:6789/0 conn(0x7fd32406e140 legacy=0x7fd32406e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:53.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd322a00640 1 --2- 172.21.15.49:0/2511887092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3240b3300 0x7fd304003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:53.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd322a00640 1 --2- 172.21.15.49:0/2511887092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd304003f50 0x7fd3040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:53.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd322a00640 1 --2- 172.21.15.49:0/2511887092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd304004d10 0x7fd304005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:53.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd322a00640 1 -- 172.21.15.49:0/2511887092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3240b2e70 con 0x7fd304003f50 2024-01-31T05:04:53.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd322a00640 1 -- 172.21.15.49:0/2511887092 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30400dba0 con 0x7fd304004d10 2024-01-31T05:04:53.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd322a00640 1 -- 172.21.15.49:0/2511887092 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30400dce0 con 0x7fd3240b3300 2024-01-31T05:04:53.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.023+0000 7fd323400640 1 --2- 172.21.15.49:0/2511887092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd304003f50 0x7fd3040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:53.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.027+0000 7fd323e00640 1 --2- 172.21.15.49:0/2511887092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3240b3300 0x7fd304003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:53.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.027+0000 7fd329200640 1 --2- 172.21.15.49:0/2511887092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd304004d10 0x7fd304005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:53.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.027+0000 7fd323400640 1 -- 172.21.15.49:0/2511887092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3240b3300 msgr2=0x7fd304003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:53.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.027+0000 7fd323400640 1 --2- 172.21.15.49:0/2511887092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3240b3300 0x7fd304003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:53.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.027+0000 7fd323400640 1 -- 172.21.15.49:0/2511887092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd304004d10 msgr2=0x7fd304005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:53.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.027+0000 7fd323400640 1 --2- 172.21.15.49:0/2511887092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd304004d10 0x7fd304005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:53.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.027+0000 7fd323400640 1 -- 172.21.15.49:0/2511887092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd304003530 con 0x7fd304003f50 2024-01-31T05:04:53.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.027+0000 7fd323400640 1 --2- 172.21.15.49:0/2511887092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd304003f50 0x7fd3040047d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009b10 tx=0x7fd30c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf86bc2b4f5544e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:53.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.027+0000 7fd322a00640 1 -- 172.21.15.49:0/2511887092 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c0a5680 con 0x7fd304003f50 2024-01-31T05:04:53.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.027+0000 7fd322a00640 1 -- 172.21.15.49:0/2511887092 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30c0a57e0 con 0x7fd304003f50 2024-01-31T05:04:53.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.027+0000 7fd322a00640 1 -- 172.21.15.49:0/2511887092 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c0a5b90 con 0x7fd304003f50 2024-01-31T05:04:53.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.031+0000 7fd32b200640 1 -- 172.21.15.49:0/2511887092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd304003f50 msgr2=0x7fd3040047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:53.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.031+0000 7fd32b200640 1 --2- 172.21.15.49:0/2511887092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd304003f50 0x7fd3040047d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009b10 tx=0x7fd30c01ca90 comp rx=0 tx=0).stop 2024-01-31T05:04:53.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.031+0000 7fd329200640 1 -- 172.21.15.49:0/2511887092 reap_dead start 2024-01-31T05:04:53.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.031+0000 7fd32b200640 1 -- 172.21.15.49:0/2511887092 shutdown_connections 2024-01-31T05:04:53.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.031+0000 7fd32b200640 1 -- 172.21.15.49:0/2511887092 >> 172.21.15.49:0/2511887092 conn(0x7fd3240b1940 msgr2=0x7fd3240b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:53.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.031+0000 7fd32b200640 1 -- 172.21.15.49:0/2511887092 shutdown_connections 2024-01-31T05:04:53.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.031+0000 7fd32b200640 1 -- 172.21.15.49:0/2511887092 wait complete. 2024-01-31T05:04:53.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.031+0000 7fd32b200640 1 Processor -- start 2024-01-31T05:04:53.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.031+0000 7fd32b200640 1 -- start start 2024-01-31T05:04:53.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.031+0000 7fd32b200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd304003f50 0x7fd324148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:53.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.031+0000 7fd32b200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3241f43c0 0x7fd32415d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:53.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.031+0000 7fd32b200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd324154b00 0x7fd3241f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:53.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.031+0000 7fd32b200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd324148f40 con 0x7fd304003f50 2024-01-31T05:04:53.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.031+0000 7fd32b200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3241f48c0 con 0x7fd324154b00 2024-01-31T05:04:53.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.031+0000 7fd32b200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3241f4ba0 con 0x7fd3241f43c0 2024-01-31T05:04:53.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.031+0000 7fd323e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd304003f50 0x7fd324148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:53.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.031+0000 7fd323e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd304003f50 0x7fd324148a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56676/0 (socket says 172.21.15.49:56676) 2024-01-31T05:04:53.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.031+0000 7fd323e00640 1 -- 172.21.15.49:0/2006980538 learned_addr learned my addr 172.21.15.49:0/2006980538 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:53.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.035+0000 7fd323400640 1 --2- 172.21.15.49:0/2006980538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3241f43c0 0x7fd32415d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:53.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.035+0000 7fd329200640 1 --2- 172.21.15.49:0/2006980538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd324154b00 0x7fd3241f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:53.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.035+0000 7fd323e00640 1 -- 172.21.15.49:0/2006980538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3241f43c0 msgr2=0x7fd32415d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:53.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.035+0000 7fd323e00640 1 --2- 172.21.15.49:0/2006980538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3241f43c0 0x7fd32415d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:53.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.035+0000 7fd323e00640 1 -- 172.21.15.49:0/2006980538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd324154b00 msgr2=0x7fd3241f5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:53.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.035+0000 7fd323e00640 1 --2- 172.21.15.49:0/2006980538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd324154b00 0x7fd3241f5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:53.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.035+0000 7fd323e00640 1 -- 172.21.15.49:0/2006980538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3241f4e80 con 0x7fd304003f50 2024-01-31T05:04:53.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.035+0000 7fd323400640 1 --2- 172.21.15.49:0/2006980538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3241f43c0 0x7fd32415d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:53.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.035+0000 7fd323e00640 1 --2- 172.21.15.49:0/2006980538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd304003f50 0x7fd324148a00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd314004880 tx=0x7fd314012980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:53.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.035+0000 7fd31be00640 1 -- 172.21.15.49:0/2006980538 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314014810 con 0x7fd304003f50 2024-01-31T05:04:53.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.035+0000 7fd31be00640 1 -- 172.21.15.49:0/2006980538 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd314014990 con 0x7fd304003f50 2024-01-31T05:04:53.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.035+0000 7fd32b200640 1 -- 172.21.15.49:0/2006980538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3241f5160 con 0x7fd304003f50 2024-01-31T05:04:53.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.035+0000 7fd31be00640 1 -- 172.21.15.49:0/2006980538 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314014d40 con 0x7fd304003f50 2024-01-31T05:04:53.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.035+0000 7fd32b200640 1 -- 172.21.15.49:0/2006980538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32415d750 con 0x7fd304003f50 2024-01-31T05:04:53.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.035+0000 7fd32b200640 1 -- 172.21.15.49:0/2006980538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd324074860 con 0x7fd304003f50 2024-01-31T05:04:53.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.035+0000 7fd31be00640 1 -- 172.21.15.49:0/2006980538 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd3140153e0 con 0x7fd304003f50 2024-01-31T05:04:53.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.039+0000 7fd31be00640 1 --2- 172.21.15.49:0/2006980538 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd2fc066530 0x7fd2fc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:53.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.039+0000 7fd31be00640 1 -- 172.21.15.49:0/2006980538 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd314086f10 con 0x7fd304003f50 2024-01-31T05:04:53.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.039+0000 7fd323400640 1 --2- 172.21.15.49:0/2006980538 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd2fc066530 0x7fd2fc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:53.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.039+0000 7fd323400640 1 --2- 172.21.15.49:0/2006980538 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd2fc066530 0x7fd2fc0689f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0af000 tx=0x7fd30c0046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:53.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.039+0000 7fd31be00640 1 -- 172.21.15.49:0/2006980538 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd314053ec0 con 0x7fd304003f50 2024-01-31T05:04:53.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.235+0000 7fd32b200640 1 -- 172.21.15.49:0/2006980538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd3241f5610 con 0x7fd304003f50 2024-01-31T05:04:53.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.235+0000 7fd31be00640 1 -- 172.21.15.49:0/2006980538 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd31401c020 con 0x7fd304003f50 2024-01-31T05:04:53.236 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-31T05:04:53.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.235+0000 7fd32b200640 1 -- 172.21.15.49:0/2006980538 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd2fc066530 msgr2=0x7fd2fc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:53.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.235+0000 7fd32b200640 1 --2- 172.21.15.49:0/2006980538 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd2fc066530 0x7fd2fc0689f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0af000 tx=0x7fd30c0046d0 comp rx=0 tx=0).stop 2024-01-31T05:04:53.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.235+0000 7fd32b200640 1 -- 172.21.15.49:0/2006980538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd304003f50 msgr2=0x7fd324148a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:53.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.235+0000 7fd32b200640 1 --2- 172.21.15.49:0/2006980538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd304003f50 0x7fd324148a00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd314004880 tx=0x7fd314012980 comp rx=0 tx=0).stop 2024-01-31T05:04:53.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.235+0000 7fd32b200640 1 -- 172.21.15.49:0/2006980538 shutdown_connections 2024-01-31T05:04:53.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.235+0000 7fd32b200640 1 --2- 172.21.15.49:0/2006980538 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd2fc066530 0x7fd2fc0689f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:53.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.235+0000 7fd32b200640 1 --2- 172.21.15.49:0/2006980538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd324154b00 0x7fd3241f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:53.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.235+0000 7fd32b200640 1 --2- 172.21.15.49:0/2006980538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3241f43c0 0x7fd32415d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:53.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.235+0000 7fd32b200640 1 --2- 172.21.15.49:0/2006980538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd304003f50 0x7fd324148a00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:53.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.235+0000 7fd32b200640 1 -- 172.21.15.49:0/2006980538 >> 172.21.15.49:0/2006980538 conn(0x7fd3240b1940 msgr2=0x7fd32406bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:53.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.235+0000 7fd32b200640 1 -- 172.21.15.49:0/2006980538 shutdown_connections 2024-01-31T05:04:53.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:53.235+0000 7fd32b200640 1 -- 172.21.15.49:0/2006980538 wait complete. 2024-01-31T05:04:53.259 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-31T05:04:53.259 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-31T05:04:53.259 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-31T05:04:53.259 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-31T05:04:53.259 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-31T05:04:53.259 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-31T05:04:53.259 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-31T05:04:53.259 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-31T05:04:53.259 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-31T05:04:53.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:53.260 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-31T05:04:53.269 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-31T05:04:53.269 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-31T05:04:53.270 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-31T05:04:53.270 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:53.270 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-31T05:04:53.270 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:53.270 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-31T05:04:53.270 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:53.270 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-31T05:04:53.270 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-31T05:04:53.270 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:53.270 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-31T05:04:53.270 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-31T05:04:53.270 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:53.270 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-31T05:04:53.270 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-31T05:04:53.270 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42467sec preferred_lft 42467sec 2024-01-31T05:04:53.271 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-31T05:04:53.271 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:53.271 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-31T05:04:53.271 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:53.271 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-31T05:04:53.271 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-31T05:04:53.271 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:b9:ff:e5:3e brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:53.271 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-31T05:04:53.271 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:53.271 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-31T05:04:53.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:53.271 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-31T05:04:53.271 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-31T05:04:53.272 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2024-01-31T05:04:53.272 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2024-01-31T05:04:53.272 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2024-01-31T05:04:53.272 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-31T05:04:53.272 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-31T05:04:53.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:53.380 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-31T05:04:53.398 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-31T05:04:53.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:53.400 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-31T05:04:53.452 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-31T05:04:53.452 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-31T05:04:53.452 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-31T05:04:53.452 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-31T05:04:53.452 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-31T05:04:53.452 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-31T05:04:53.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:53.453 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-31T05:04:53.453 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-31T05:04:53.453 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-31T05:04:53.453 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-31T05:04:53.453 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-31T05:04:53.453 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-31T05:04:53.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:53.544 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-31T05:04:53.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:53.556 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2024-01-31T05:04:53.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:53.611 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-31T05:04:53.611 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-31T05:04:53.611 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-31T05:04:53.611 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-31T05:04:53.611 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-31T05:04:53.692 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-31T05:04:53.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:53.693 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-31T05:04:53.693 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-31T05:04:53.693 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-31T05:04:53.693 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-31T05:04:53.693 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-31T05:04:53.693 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-31T05:04:53.693 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-31T05:04:53.693 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-31T05:04:53.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:53.832 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-31T05:04:53.832 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-31T05:04:53.832 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-01-31T05:04:53.832 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2024-01-31T05:04:53.833 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-31T05:04:53.871 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-01-31T05:04:53.871 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-31T05:04:53.871 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-31T05:04:53.922 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-31T05:04:53.923 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-31T05:04:53.923 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-31T05:04:53.974 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-01-31T05:04:54.035 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-01-31T05:04:54.088 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-01-31T05:04:54.088 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-01-31T05:04:54.088 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-01-31T05:04:54.088 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-01-31T05:04:54.088 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-01-31T05:04:54.089 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-01-31T05:04:54.089 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-01-31T05:04:54.089 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-01-31T05:04:54.089 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2024-01-31T05:04:54.089 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-01-31T05:04:54.089 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-01-31T05:04:54.089 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-01-31T05:04:54.089 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-01-31T05:04:54.089 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-01-31T05:04:54.089 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-01-31T05:04:54.089 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-01-31T05:04:54.089 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-01-31T05:04:54.089 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2024-01-31T05:04:54.089 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-01-31T05:04:54.089 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-01-31T05:04:54.090 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2024-01-31T05:04:54.090 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2024-01-31T05:04:54.090 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-01-31T05:04:54.090 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-01-31T05:04:54.090 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-01-31T05:04:54.090 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-01-31T05:04:54.090 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-01-31T05:04:54.090 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2024-01-31T05:04:54.090 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-01-31T05:04:54.090 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-31T05:04:54.090 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-31T05:04:54.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:54.091 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-01-31T05:04:54.147 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-31T05:04:54.147 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-01-31T05:04:54.193 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-01-31T05:04:54.214 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-01-31T05:04:54.264 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-01-31T05:04:54.264 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-01-31T05:04:54.264 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-01-31T05:04:54.264 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-01-31T05:04:54.265 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-01-31T05:04:54.265 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-01-31T05:04:54.265 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-01-31T05:04:54.265 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-01-31T05:04:54.265 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2024-01-31T05:04:54.265 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-01-31T05:04:54.265 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-01-31T05:04:54.265 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-01-31T05:04:54.265 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-01-31T05:04:54.265 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-01-31T05:04:54.265 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-01-31T05:04:54.265 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-01-31T05:04:54.265 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-01-31T05:04:54.266 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2024-01-31T05:04:54.266 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-01-31T05:04:54.266 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-01-31T05:04:54.266 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2024-01-31T05:04:54.266 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2024-01-31T05:04:54.266 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-01-31T05:04:54.266 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-01-31T05:04:54.266 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-01-31T05:04:54.266 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-01-31T05:04:54.266 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-01-31T05:04:54.266 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2024-01-31T05:04:54.266 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-01-31T05:04:54.266 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-31T05:04:54.266 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-31T05:04:54.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:54.267 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-01-31T05:04:54.289 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2024-01-31T05:04:54.287+0000 7f31a7ff6580 -1 init, newargv = 0x5605ac463070 newargc=15 2024-01-31T05:04:54.290 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[33877]: starting ceph client 2024-01-31T05:04:54.297 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[33877]: starting fuse 2024-01-31T05:04:54.299 INFO:teuthology.orchestra.run.smithi049.stdout:43 2024-01-31T05:04:54.299 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-31T05:04:54.299 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-01-31T05:04:54.300 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-01-31T05:04:54.300 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-01-31T05:04:54.300 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-01-31T05:04:54.300 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-01-31T05:04:54.300 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-31T05:04:54.300 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-01-31T05:04:54.300 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-31T05:04:54.300 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-01-31T05:04:54.300 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-31T05:04:54.300 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-31T05:04:54.300 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-01-31T05:04:54.300 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-01-31T05:04:54.300 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-01-31T05:04:54.300 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-01-31T05:04:54.301 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-31T05:04:54.301 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-01-31T05:04:54.301 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-31T05:04:54.301 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-31T05:04:54.301 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-31T05:04:54.301 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-01-31T05:04:54.301 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-01-31T05:04:54.301 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-01-31T05:04:54.301 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-31T05:04:54.301 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-31T05:04:54.301 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2024-01-31T05:04:54.301 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-01-31T05:04:54.426 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.33877.asok 2024-01-31T05:04:54.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-31T05:04:54.438 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33877.asok 2024-01-31T05:04:54.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:54.438 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33877.asok status 2024-01-31T05:04:54.613 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-31T05:04:54.613 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-01-31T05:04:54.613 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "661946e7044723130c03627323f6a879a9848cb5", 2024-01-31T05:04:54.613 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev)", 2024-01-31T05:04:54.613 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2024-01-31T05:04:54.613 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-01-31T05:04:54.614 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-31T05:04:54.614 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "33877", 2024-01-31T05:04:54.614 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-01-31T05:04:54.614 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:04:54.614 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-01-31T05:04:54.614 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-01-31T05:04:54.614 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4827, 2024-01-31T05:04:54.614 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-01-31T05:04:54.614 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-01-31T05:04:54.614 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-01-31T05:04:54.614 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 4827 2024-01-31T05:04:54.614 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:04:54.614 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-01-31T05:04:54.614 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-01-31T05:04:54.615 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-01-31T05:04:54.615 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 1238084599 2024-01-31T05:04:54.615 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:04:54.615 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:04:54.615 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-01-31T05:04:54.615 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-01-31T05:04:54.615 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-01-31T05:04:54.615 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 1238084599 2024-01-31T05:04:54.615 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:04:54.615 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.4827 192.168.0.1:0/1238084599", 2024-01-31T05:04:54.615 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/1238084599", 2024-01-31T05:04:54.615 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-01-31T05:04:54.615 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 9, 2024-01-31T05:04:54.616 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 24, 2024-01-31T05:04:54.616 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-01-31T05:04:54.616 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-01-31T05:04:54.616 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-01-31T05:04:54.616 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-31T05:04:54.628 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-31T05:04:54.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.766+0000 7faacdc00640 1 Processor -- start 2024-01-31T05:04:54.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.766+0000 7faacdc00640 1 -- start start 2024-01-31T05:04:54.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.770+0000 7faacdc00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faac815d3a0 0x7faac806e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:54.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.770+0000 7faacdc00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7faac80cce30 0x7faac806f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:54.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.770+0000 7faacdc00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac80cb990 con 0x7faac806ee50 2024-01-31T05:04:54.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.770+0000 7faacdc00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac80d1c20 con 0x7faac815d3a0 2024-01-31T05:04:54.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.770+0000 7faacdc00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac80cfed0 con 0x7faac80cce30 2024-01-31T05:04:54.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.770+0000 7faac6a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faac815d3a0 0x7faac806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:54.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.770+0000 7faac6a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7faac815d3a0 0x7faac806e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56686/0 (socket says 172.21.15.49:56686) 2024-01-31T05:04:54.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.770+0000 7faac6a00640 1 -- 172.21.15.49:0/2572240552 learned_addr learned my addr 172.21.15.49:0/2572240552 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:54.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.770+0000 7faac7400640 1 --2- 172.21.15.49:0/2572240552 >> v2:172.21.15.195:3300/0 conn(0x7faac80cce30 0x7faac806f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:54.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.770+0000 7faac6a00640 1 -- 172.21.15.49:0/2572240552 >> v2:172.21.15.195:3300/0 conn(0x7faac80cce30 msgr2=0x7faac806f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:54.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.770+0000 7faac6a00640 1 --2- 172.21.15.49:0/2572240552 >> v2:172.21.15.195:3300/0 conn(0x7faac80cce30 0x7faac806f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:54.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.770+0000 7faac6a00640 1 -- 172.21.15.49:0/2572240552 >> v1:172.21.15.49:6789/0 conn(0x7faac806ee50 legacy=0x7faac80cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:54.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.770+0000 7faac6a00640 1 -- 172.21.15.49:0/2572240552 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac80d01b0 con 0x7faac815d3a0 2024-01-31T05:04:54.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.774+0000 7faac6a00640 1 --2- 172.21.15.49:0/2572240552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac815d3a0 0x7faac806e910 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faac80c4920 tx=0x7faab801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305cb16b6996007b server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:54.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.774+0000 7faac5600640 1 -- 172.21.15.49:0/2572240552 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab80aa680 con 0x7faac815d3a0 2024-01-31T05:04:54.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.774+0000 7faac5600640 1 -- 172.21.15.49:0/2572240552 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab80aa7e0 con 0x7faac815d3a0 2024-01-31T05:04:54.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.774+0000 7faac5600640 1 -- 172.21.15.49:0/2572240552 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab80aab70 con 0x7faac815d3a0 2024-01-31T05:04:54.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.774+0000 7faacdc00640 1 -- 172.21.15.49:0/2572240552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac815d3a0 msgr2=0x7faac806e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:54.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.774+0000 7faacdc00640 1 --2- 172.21.15.49:0/2572240552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac815d3a0 0x7faac806e910 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faac80c4920 tx=0x7faab801c500 comp rx=0 tx=0).stop 2024-01-31T05:04:54.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.774+0000 7faacdc00640 1 -- 172.21.15.49:0/2572240552 shutdown_connections 2024-01-31T05:04:54.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.774+0000 7faacdc00640 1 --2- 172.21.15.49:0/2572240552 >> v2:172.21.15.195:3300/0 conn(0x7faac80cce30 0x7faac806f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:54.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.774+0000 7faacdc00640 1 --2- 172.21.15.49:0/2572240552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac815d3a0 0x7faac806e910 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:54.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.774+0000 7faacdc00640 1 -- 172.21.15.49:0/2572240552 >> 172.21.15.49:0/2572240552 conn(0x7faac80d0e50 msgr2=0x7faac80d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:54.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.774+0000 7faacdc00640 1 -- 172.21.15.49:0/2572240552 shutdown_connections 2024-01-31T05:04:54.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.774+0000 7faacdc00640 1 -- 172.21.15.49:0/2572240552 wait complete. 2024-01-31T05:04:54.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.774+0000 7faacdc00640 1 Processor -- start 2024-01-31T05:04:54.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.774+0000 7faacdc00640 1 -- start start 2024-01-31T05:04:54.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faacdc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faac806ee50 0x7faac81532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:54.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faacdc00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac80cce30 0x7faac80c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:54.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faacdc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faac815d3a0 0x7faac80b6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:54.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faacdc00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac80b6c80 con 0x7faac80cce30 2024-01-31T05:04:54.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faacdc00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac815a7f0 con 0x7faac806ee50 2024-01-31T05:04:54.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faacdc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac815aad0 con 0x7faac815d3a0 2024-01-31T05:04:54.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faac6000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac80cce30 0x7faac80c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faac6a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faac806ee50 0x7faac81532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faac6000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac80cce30 0x7faac80c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56696/0 (socket says 172.21.15.49:56696) 2024-01-31T05:04:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faac6000640 1 -- 172.21.15.49:0/4269527351 learned_addr learned my addr 172.21.15.49:0/4269527351 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faac7400640 1 --2- 172.21.15.49:0/4269527351 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faac815d3a0 0x7faac80b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faac6000640 1 -- 172.21.15.49:0/4269527351 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faac815d3a0 msgr2=0x7faac80b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faac6000640 1 --2- 172.21.15.49:0/4269527351 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faac815d3a0 0x7faac80b6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faac6000640 1 -- 172.21.15.49:0/4269527351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faac806ee50 msgr2=0x7faac81532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faac6000640 1 --2- 172.21.15.49:0/4269527351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faac806ee50 0x7faac81532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faac6000640 1 -- 172.21.15.49:0/4269527351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab80094d0 con 0x7faac80cce30 2024-01-31T05:04:54.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faac6000640 1 --2- 172.21.15.49:0/4269527351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac80cce30 0x7faac80c8110 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faab000c420 tx=0x7faab000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:54.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faabea00640 1 -- 172.21.15.49:0/4269527351 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab00052d0 con 0x7faac80cce30 2024-01-31T05:04:54.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faabea00640 1 -- 172.21.15.49:0/4269527351 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab0005430 con 0x7faac80cce30 2024-01-31T05:04:54.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faabea00640 1 -- 172.21.15.49:0/4269527351 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0007260 con 0x7faac80cce30 2024-01-31T05:04:54.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faacdc00640 1 -- 172.21.15.49:0/4269527351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac815adb0 con 0x7faac80cce30 2024-01-31T05:04:54.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faacdc00640 1 -- 172.21.15.49:0/4269527351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac8153820 con 0x7faac80cce30 2024-01-31T05:04:54.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.778+0000 7faacdc00640 1 -- 172.21.15.49:0/4269527351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac806fdb0 con 0x7faac80cce30 2024-01-31T05:04:54.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.782+0000 7faabea00640 1 -- 172.21.15.49:0/4269527351 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7faab00073c0 con 0x7faac80cce30 2024-01-31T05:04:54.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.782+0000 7faabea00640 1 --2- 172.21.15.49:0/4269527351 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7faaa0066500 0x7faaa00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:54.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.782+0000 7faabea00640 1 -- 172.21.15.49:0/4269527351 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faab0083500 con 0x7faac80cce30 2024-01-31T05:04:54.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.782+0000 7faac6a00640 1 --2- 172.21.15.49:0/4269527351 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7faaa0066500 0x7faaa00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:54.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.782+0000 7faac6a00640 1 --2- 172.21.15.49:0/4269527351 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7faaa0066500 0x7faaa00689c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faab80ae000 tx=0x7faab80b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:54.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.786+0000 7faabea00640 1 -- 172.21.15.49:0/4269527351 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7faab0050550 con 0x7faac80cce30 2024-01-31T05:04:54.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.986+0000 7faacdc00640 1 -- 172.21.15.49:0/4269527351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faac8074860 con 0x7faac80cce30 2024-01-31T05:04:54.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.986+0000 7faabea00640 1 -- 172.21.15.49:0/4269527351 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7faab0053b70 con 0x7faac80cce30 2024-01-31T05:04:54.988 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-31T05:04:54.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.986+0000 7faacdc00640 1 -- 172.21.15.49:0/4269527351 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7faaa0066500 msgr2=0x7faaa00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:54.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.986+0000 7faacdc00640 1 --2- 172.21.15.49:0/4269527351 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7faaa0066500 0x7faaa00689c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faab80ae000 tx=0x7faab80b5040 comp rx=0 tx=0).stop 2024-01-31T05:04:54.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.986+0000 7faacdc00640 1 -- 172.21.15.49:0/4269527351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac80cce30 msgr2=0x7faac80c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:54.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.986+0000 7faacdc00640 1 --2- 172.21.15.49:0/4269527351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac80cce30 0x7faac80c8110 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faab000c420 tx=0x7faab000c8e0 comp rx=0 tx=0).stop 2024-01-31T05:04:54.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.986+0000 7faacdc00640 1 -- 172.21.15.49:0/4269527351 shutdown_connections 2024-01-31T05:04:54.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.986+0000 7faacdc00640 1 --2- 172.21.15.49:0/4269527351 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faac815d3a0 0x7faac80b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:54.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.986+0000 7faacdc00640 1 --2- 172.21.15.49:0/4269527351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac80cce30 0x7faac80c8110 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:54.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.986+0000 7faacdc00640 1 --2- 172.21.15.49:0/4269527351 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7faaa0066500 0x7faaa00689c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:54.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.986+0000 7faacdc00640 1 --2- 172.21.15.49:0/4269527351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faac806ee50 0x7faac81532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:54.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.986+0000 7faacdc00640 1 -- 172.21.15.49:0/4269527351 >> 172.21.15.49:0/4269527351 conn(0x7faac80d0e50 msgr2=0x7faac806cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:54.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.986+0000 7faacdc00640 1 -- 172.21.15.49:0/4269527351 shutdown_connections 2024-01-31T05:04:54.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:54.986+0000 7faacdc00640 1 -- 172.21.15.49:0/4269527351 wait complete. 2024-01-31T05:04:55.009 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-31T05:04:55.010 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-31T05:04:55.010 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-31T05:04:55.010 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-01-31T05:04:55.010 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-01-31T05:04:55.010 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-31T05:04:55.010 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-31T05:04:55.010 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-31T05:04:55.010 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-01-31T05:04:55.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:55.010 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-31T05:04:55.020 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-31T05:04:55.021 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-31T05:04:55.021 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-31T05:04:55.021 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:55.021 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-31T05:04:55.021 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:55.021 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-31T05:04:55.021 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:55.021 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-31T05:04:55.021 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-31T05:04:55.021 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:55.021 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-31T05:04:55.021 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-31T05:04:55.021 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:55.022 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-31T05:04:55.022 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-31T05:04:55.022 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42465sec preferred_lft 42465sec 2024-01-31T05:04:55.022 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-31T05:04:55.022 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:55.022 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-31T05:04:55.022 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:55.022 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-31T05:04:55.022 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-31T05:04:55.022 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:b9:ff:e5:3e brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:55.022 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-31T05:04:55.022 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:55.022 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-31T05:04:55.022 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:55.023 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-31T05:04:55.023 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:55.023 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-01-31T05:04:55.023 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:55.023 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-31T05:04:55.023 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-31T05:04:55.023 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-01-31T05:04:55.023 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:55.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:55.023 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-31T05:04:55.080 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-31T05:04:55.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:55.082 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-31T05:04:55.132 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-31T05:04:55.132 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-31T05:04:55.132 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-31T05:04:55.132 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-31T05:04:55.132 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-31T05:04:55.132 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-31T05:04:55.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:55.133 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-31T05:04:55.133 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-31T05:04:55.133 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-31T05:04:55.133 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-31T05:04:55.133 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-31T05:04:55.133 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-31T05:04:55.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:55.224 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-31T05:04:55.233 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-31T05:04:55.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:55.234 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2024-01-31T05:04:55.282 INFO:teuthology.orchestra.run.smithi049.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-01-31T05:04:55.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:55.283 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-31T05:04:55.283 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-31T05:04:55.283 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-31T05:04:55.283 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-01-31T05:04:55.284 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-31T05:04:55.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:55.369 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-01-31T05:04:55.434 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-31T05:04:55.435 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-31T05:04:55.435 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-31T05:04:55.435 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:55.435 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-31T05:04:55.435 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:55.435 INFO:teuthology.orchestra.run.smithi049.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-31T05:04:55.435 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 72:f6:f9:e6:84:57 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-31T05:04:55.435 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-31T05:04:55.435 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:55.435 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::70f6:f9ff:fee6:8457/64 scope link 2024-01-31T05:04:55.435 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:55.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:55.437 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-01-31T05:04:55.499 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-31T05:04:55.499 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-31T05:04:55.499 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-31T05:04:55.499 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:55.499 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-31T05:04:55.499 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:55.499 INFO:teuthology.orchestra.run.smithi049.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-31T05:04:55.499 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 72:f6:f9:e6:84:57 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-31T05:04:55.499 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-31T05:04:55.500 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:55.500 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::70f6:f9ff:fee6:8457/64 scope link 2024-01-31T05:04:55.500 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:55.501 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-01-31T05:04:55.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:55.501 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-31T05:04:55.501 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-31T05:04:55.501 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-01-31T05:04:55.502 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-01-31T05:04:55.502 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-01-31T05:04:55.502 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-01-31T05:04:55.502 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-01-31T05:04:55.502 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-31T05:04:55.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:55.641 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-31T05:04:55.641 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-31T05:04:55.641 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.1 up 2024-01-31T05:04:55.641 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.1 master ceph-brx 2024-01-31T05:04:55.641 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-31T05:04:55.680 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-01-31T05:04:55.681 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-31T05:04:55.681 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-01-31T05:04:55.734 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-01-31T05:04:55.735 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-31T05:04:55.735 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-01-31T05:04:55.790 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-01-31T05:04:55.855 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-01-31T05:04:55.908 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-01-31T05:04:55.908 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-01-31T05:04:55.908 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-01-31T05:04:55.908 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-01-31T05:04:55.908 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-01-31T05:04:55.908 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-01-31T05:04:55.908 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-01-31T05:04:55.908 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-01-31T05:04:55.908 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2024-01-31T05:04:55.908 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-01-31T05:04:55.909 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-01-31T05:04:55.909 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-01-31T05:04:55.909 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-01-31T05:04:55.909 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-01-31T05:04:55.909 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-01-31T05:04:55.909 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-01-31T05:04:55.909 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-01-31T05:04:55.909 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2024-01-31T05:04:55.909 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-01-31T05:04:55.909 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-01-31T05:04:55.909 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2024-01-31T05:04:55.909 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2024-01-31T05:04:55.909 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-01-31T05:04:55.909 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-01-31T05:04:55.909 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-01-31T05:04:55.909 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-01-31T05:04:55.910 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-01-31T05:04:55.910 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2024-01-31T05:04:55.910 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-01-31T05:04:55.910 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-31T05:04:55.910 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-31T05:04:55.910 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-01-31T05:04:55.910 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-31T05:04:55.910 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-31T05:04:55.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:55.911 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-01-31T05:04:55.966 INFO:teuthology.orchestra.run.smithi049.stdout:43 2024-01-31T05:04:55.966 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2024-01-31T05:04:55.967 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-01-31T05:04:56.014 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-01-31T05:04:56.034 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-01-31T05:04:56.088 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-01-31T05:04:56.088 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-01-31T05:04:56.089 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-01-31T05:04:56.089 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-01-31T05:04:56.089 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-01-31T05:04:56.089 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-01-31T05:04:56.089 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-01-31T05:04:56.089 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-01-31T05:04:56.089 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2024-01-31T05:04:56.089 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-01-31T05:04:56.089 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-01-31T05:04:56.089 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-01-31T05:04:56.089 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-01-31T05:04:56.089 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-01-31T05:04:56.089 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-01-31T05:04:56.089 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-01-31T05:04:56.090 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-01-31T05:04:56.090 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2024-01-31T05:04:56.090 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-01-31T05:04:56.090 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-01-31T05:04:56.090 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2024-01-31T05:04:56.090 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2024-01-31T05:04:56.090 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-01-31T05:04:56.090 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-01-31T05:04:56.090 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-01-31T05:04:56.090 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-01-31T05:04:56.090 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-01-31T05:04:56.090 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2024-01-31T05:04:56.090 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-01-31T05:04:56.090 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-31T05:04:56.090 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-31T05:04:56.091 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-01-31T05:04:56.091 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-31T05:04:56.091 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-31T05:04:56.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:56.092 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-01-31T05:04:56.109 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi049.stderr:2024-01-31T05:04:56.106+0000 7fbd54d9a580 -1 init, newargv = 0x55acbb85b170 newargc=15 2024-01-31T05:04:56.109 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi049.stderr:ceph-fuse[34012]: starting ceph client 2024-01-31T05:04:56.116 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi049.stderr:ceph-fuse[34012]: starting fuse 2024-01-31T05:04:56.118 INFO:teuthology.orchestra.run.smithi049.stdout:43 2024-01-31T05:04:56.119 INFO:teuthology.orchestra.run.smithi049.stdout:44 2024-01-31T05:04:56.119 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2024-01-31T05:04:56.119 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-01-31T05:04:56.119 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-01-31T05:04:56.119 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-01-31T05:04:56.119 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-01-31T05:04:56.119 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-01-31T05:04:56.119 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-31T05:04:56.119 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-01-31T05:04:56.119 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-01-31T05:04:56.120 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-01-31T05:04:56.120 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-01-31T05:04:56.120 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-31T05:04:56.120 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-01-31T05:04:56.120 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-01-31T05:04:56.120 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-01-31T05:04:56.120 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-01-31T05:04:56.120 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-31T05:04:56.120 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-01-31T05:04:56.120 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-31T05:04:56.120 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-31T05:04:56.120 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-31T05:04:56.120 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-01-31T05:04:56.120 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-01-31T05:04:56.120 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-01-31T05:04:56.120 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-31T05:04:56.120 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-31T05:04:56.120 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.2")) 2024-01-31T05:04:56.121 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-01-31T05:04:56.249 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.2.34012.asok 2024-01-31T05:04:56.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-31T05:04:56.261 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.34012.asok 2024-01-31T05:04:56.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:56.261 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.34012.asok status 2024-01-31T05:04:56.434 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-31T05:04:56.435 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-01-31T05:04:56.435 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "661946e7044723130c03627323f6a879a9848cb5", 2024-01-31T05:04:56.435 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev)", 2024-01-31T05:04:56.435 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "2", 2024-01-31T05:04:56.435 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-01-31T05:04:56.435 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-01-31T05:04:56.435 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "34012", 2024-01-31T05:04:56.435 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-01-31T05:04:56.435 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:04:56.435 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-01-31T05:04:56.435 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-01-31T05:04:56.435 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4845, 2024-01-31T05:04:56.435 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-01-31T05:04:56.436 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-01-31T05:04:56.436 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-01-31T05:04:56.436 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 4845 2024-01-31T05:04:56.436 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:04:56.436 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-01-31T05:04:56.436 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-01-31T05:04:56.436 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-01-31T05:04:56.436 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 4083999669 2024-01-31T05:04:56.436 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:04:56.436 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:04:56.436 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-01-31T05:04:56.436 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-01-31T05:04:56.436 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-01-31T05:04:56.436 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 4083999669 2024-01-31T05:04:56.436 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:04:56.437 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.4845 192.168.0.2:0/4083999669", 2024-01-31T05:04:56.437 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.2:0/4083999669", 2024-01-31T05:04:56.437 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-01-31T05:04:56.437 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 9, 2024-01-31T05:04:56.437 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 24, 2024-01-31T05:04:56.437 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-01-31T05:04:56.437 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-01-31T05:04:56.437 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-01-31T05:04:56.437 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-31T05:04:56.449 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-31T05:04:56.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.586+0000 7f01f2600640 1 Processor -- start 2024-01-31T05:04:56.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.586+0000 7f01f2600640 1 -- start start 2024-01-31T05:04:56.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.590+0000 7f01f2600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06ba90 0x7f01ec0cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:56.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.590+0000 7f01f2600640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ec15d7e0 con 0x7f01ec06c290 2024-01-31T05:04:56.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.590+0000 7f01f2600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ec0d0470 con 0x7f01ec0cbf80 2024-01-31T05:04:56.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.590+0000 7f01f2600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec0d0190 con 0x7f01ec06ba90 2024-01-31T05:04:56.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.590+0000 7f01eb400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f01ec06c290 0x7f01ec06c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53256/0 (socket says 172.21.15.49:53256) 2024-01-31T05:04:56.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.590+0000 7f01eb400640 1 -- 172.21.15.49:0/3605960229 learned_addr learned my addr 172.21.15.49:0/3605960229 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:04:56.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.590+0000 7f01eaa00640 1 --2- 172.21.15.49:0/3605960229 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06ba90 0x7f01ec0cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:56.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.590+0000 7f01ea000640 1 -- 172.21.15.49:0/3605960229 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569080549 0 0) 0x7f01ec15d7e0 con 0x7f01ec06c290 2024-01-31T05:04:56.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.590+0000 7f01ea000640 1 -- 172.21.15.49:0/3605960229 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01cc003530 con 0x7f01ec06c290 2024-01-31T05:04:56.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.590+0000 7f01ea000640 1 -- 172.21.15.49:0/3605960229 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481716351 0 0) 0x7f01ec0d0470 con 0x7f01ec0cbf80 2024-01-31T05:04:56.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.590+0000 7f01ea000640 1 -- 172.21.15.49:0/3605960229 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01ec15d7e0 con 0x7f01ec0cbf80 2024-01-31T05:04:56.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.590+0000 7f01eaa00640 1 -- 172.21.15.49:0/3605960229 >> v1:172.21.15.195:6789/0 conn(0x7f01ec0cbf80 legacy=0x7f01ec0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:56.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.590+0000 7f01eaa00640 1 -- 172.21.15.49:0/3605960229 >> v1:172.21.15.49:6789/0 conn(0x7f01ec06c290 legacy=0x7f01ec06c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:56.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.590+0000 7f01ea000640 1 -- 172.21.15.49:0/3605960229 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4192531128 0 0) 0x7f01cc003530 con 0x7f01ec06c290 2024-01-31T05:04:56.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.590+0000 7f01eaa00640 1 -- 172.21.15.49:0/3605960229 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec0cb4a0 con 0x7f01ec06ba90 2024-01-31T05:04:56.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.594+0000 7f01eaa00640 1 --2- 172.21.15.49:0/3605960229 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06ba90 0x7f01ec0cfad0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f01d40097f0 tx=0x7f01d401c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aea177f71b15634 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:56.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.594+0000 7f01ea000640 1 -- 172.21.15.49:0/3605960229 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc001680 con 0x7f01ec06ba90 2024-01-31T05:04:56.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.594+0000 7f01ea000640 1 -- 172.21.15.49:0/3605960229 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d40a7050 con 0x7f01ec06ba90 2024-01-31T05:04:56.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.594+0000 7f01ea000640 1 -- 172.21.15.49:0/3605960229 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d40ab600 con 0x7f01ec06ba90 2024-01-31T05:04:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.594+0000 7f01f2600640 1 -- 172.21.15.49:0/3605960229 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06ba90 msgr2=0x7f01ec0cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.594+0000 7f01f2600640 1 --2- 172.21.15.49:0/3605960229 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06ba90 0x7f01ec0cfad0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f01d40097f0 tx=0x7f01d401c320 comp rx=0 tx=0).stop 2024-01-31T05:04:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.594+0000 7f01f2600640 1 -- 172.21.15.49:0/3605960229 shutdown_connections 2024-01-31T05:04:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.594+0000 7f01f2600640 1 --2- 172.21.15.49:0/3605960229 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06ba90 0x7f01ec0cfad0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.594+0000 7f01f2600640 1 -- 172.21.15.49:0/3605960229 >> 172.21.15.49:0/3605960229 conn(0x7f01ec0b28e0 msgr2=0x7f01ec0b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.594+0000 7f01f2600640 1 -- 172.21.15.49:0/3605960229 shutdown_connections 2024-01-31T05:04:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.594+0000 7f01f2600640 1 -- 172.21.15.49:0/3605960229 wait complete. 2024-01-31T05:04:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01f2600640 1 Processor -- start 2024-01-31T05:04:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01f2600640 1 -- start start 2024-01-31T05:04:56.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01f2600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01ec06ba90 0x7f01ec0ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:56.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01f2600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06c290 0x7f01ec0c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:56.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01f2600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01ec0cbf80 0x7f01ec14db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:56.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01f2600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec0ca160 con 0x7f01ec0cbf80 2024-01-31T05:04:56.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01f2600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec15ab30 con 0x7f01ec06ba90 2024-01-31T05:04:56.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01f2600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec0c94e0 con 0x7f01ec06c290 2024-01-31T05:04:56.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01ebe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01ec0cbf80 0x7f01ec14db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:56.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01ebe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01ec0cbf80 0x7f01ec14db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56706/0 (socket says 172.21.15.49:56706) 2024-01-31T05:04:56.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01ebe00640 1 -- 172.21.15.49:0/2838846620 learned_addr learned my addr 172.21.15.49:0/2838846620 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:56.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01ebe00640 1 -- 172.21.15.49:0/2838846620 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06c290 msgr2=0x7f01ec0c8c00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-31T05:04:56.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01ebe00640 1 --2- 172.21.15.49:0/2838846620 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06c290 0x7f01ec0c8c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:56.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01ebe00640 1 -- 172.21.15.49:0/2838846620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01ec06ba90 msgr2=0x7f01ec0ca580 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-31T05:04:56.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01ebe00640 1 --2- 172.21.15.49:0/2838846620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01ec06ba90 0x7f01ec0ca580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:56.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01ebe00640 1 -- 172.21.15.49:0/2838846620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d4009420 con 0x7f01ec0cbf80 2024-01-31T05:04:56.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01ebe00640 1 --2- 172.21.15.49:0/2838846620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01ec0cbf80 0x7f01ec14db90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f01e400c790 tx=0x7f01e400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:56.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01e3400640 1 -- 172.21.15.49:0/2838846620 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e400cea0 con 0x7f01ec0cbf80 2024-01-31T05:04:56.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01e3400640 1 -- 172.21.15.49:0/2838846620 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e4003b80 con 0x7f01ec0cbf80 2024-01-31T05:04:56.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01e3400640 1 -- 172.21.15.49:0/2838846620 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e400a850 con 0x7f01ec0cbf80 2024-01-31T05:04:56.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01f2600640 1 -- 172.21.15.49:0/2838846620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ec0c97c0 con 0x7f01ec0cbf80 2024-01-31T05:04:56.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01f2600640 1 -- 172.21.15.49:0/2838846620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec0c9d80 con 0x7f01ec0cbf80 2024-01-31T05:04:56.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.598+0000 7f01f2600640 1 -- 172.21.15.49:0/2838846620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ec074860 con 0x7f01ec0cbf80 2024-01-31T05:04:56.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.602+0000 7f01e3400640 1 -- 172.21.15.49:0/2838846620 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f01e400a9b0 con 0x7f01ec0cbf80 2024-01-31T05:04:56.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.602+0000 7f01e3400640 1 --2- 172.21.15.49:0/2838846620 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f01c4066500 0x7f01c40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:56.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.602+0000 7f01e3400640 1 -- 172.21.15.49:0/2838846620 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f01e4084130 con 0x7f01ec0cbf80 2024-01-31T05:04:56.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.602+0000 7f01eb400640 1 --2- 172.21.15.49:0/2838846620 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f01c4066500 0x7f01c40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:56.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.602+0000 7f01eb400640 1 --2- 172.21.15.49:0/2838846620 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f01c4066500 0x7f01c40689c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f01dc001390 tx=0x7f01dc001050 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:56.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.606+0000 7f01e3400640 1 -- 172.21.15.49:0/2838846620 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f01e4051040 con 0x7f01ec0cbf80 2024-01-31T05:04:56.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.798+0000 7f01f2600640 1 -- 172.21.15.49:0/2838846620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f01ec0ce540 con 0x7f01ec0cbf80 2024-01-31T05:04:56.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.802+0000 7f01e3400640 1 -- 172.21.15.49:0/2838846620 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f01e4054660 con 0x7f01ec0cbf80 2024-01-31T05:04:56.803 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-31T05:04:56.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.802+0000 7f01f2600640 1 -- 172.21.15.49:0/2838846620 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f01c4066500 msgr2=0x7f01c40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:56.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.802+0000 7f01f2600640 1 --2- 172.21.15.49:0/2838846620 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f01c4066500 0x7f01c40689c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f01dc001390 tx=0x7f01dc001050 comp rx=0 tx=0).stop 2024-01-31T05:04:56.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.802+0000 7f01f2600640 1 -- 172.21.15.49:0/2838846620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01ec0cbf80 msgr2=0x7f01ec14db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:56.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.802+0000 7f01f2600640 1 --2- 172.21.15.49:0/2838846620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01ec0cbf80 0x7f01ec14db90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f01e400c790 tx=0x7f01e400cc50 comp rx=0 tx=0).stop 2024-01-31T05:04:56.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.802+0000 7f01f2600640 1 -- 172.21.15.49:0/2838846620 shutdown_connections 2024-01-31T05:04:56.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.802+0000 7f01f2600640 1 --2- 172.21.15.49:0/2838846620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01ec0cbf80 0x7f01ec14db90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:56.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.802+0000 7f01f2600640 1 --2- 172.21.15.49:0/2838846620 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06c290 0x7f01ec0c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:56.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.802+0000 7f01f2600640 1 --2- 172.21.15.49:0/2838846620 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f01c4066500 0x7f01c40689c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:56.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.802+0000 7f01f2600640 1 --2- 172.21.15.49:0/2838846620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01ec06ba90 0x7f01ec0ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:56.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.802+0000 7f01f2600640 1 -- 172.21.15.49:0/2838846620 >> 172.21.15.49:0/2838846620 conn(0x7f01ec0b28e0 msgr2=0x7f01ec06c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:56.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.802+0000 7f01f2600640 1 -- 172.21.15.49:0/2838846620 shutdown_connections 2024-01-31T05:04:56.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:56.802+0000 7f01f2600640 1 -- 172.21.15.49:0/2838846620 wait complete. 2024-01-31T05:04:56.826 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-31T05:04:56.826 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-31T05:04:56.826 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-01-31T05:04:56.826 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-31T05:04:56.826 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-31T05:04:56.826 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-31T05:04:56.826 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-31T05:04:56.826 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-31T05:04:56.826 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-31T05:04:56.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:56.826 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-01-31T05:04:56.836 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-31T05:04:56.836 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-31T05:04:56.837 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-01-31T05:04:56.837 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:56.837 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-01-31T05:04:56.837 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:56.837 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-31T05:04:56.837 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:56.837 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-01-31T05:04:56.837 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-31T05:04:56.837 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:56.837 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-01-31T05:04:56.837 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-31T05:04:56.837 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:56.837 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-31T05:04:56.837 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:56.838 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-31T05:04:56.838 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42421sec preferred_lft 42421sec 2024-01-31T05:04:56.838 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::ec4:7aff:fe88:8081/64 scope link 2024-01-31T05:04:56.838 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:56.838 INFO:teuthology.orchestra.run.smithi195.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-31T05:04:56.838 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 02:42:0a:d5:9c:3e brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:56.838 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-31T05:04:56.838 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:56.839 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-31T05:04:56.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:56.839 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-01-31T05:04:56.839 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-01-31T05:04:56.839 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add name ceph-brx type bridge 2024-01-31T05:04:56.839 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr flush dev ceph-brx 2024-01-31T05:04:56.839 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set ceph-brx up 2024-01-31T05:04:56.840 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-31T05:04:56.840 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-01-31T05:04:56.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:56.956 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-31T05:04:56.975 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-01-31T05:04:56.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:56.977 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-01-31T05:04:57.052 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-01-31T05:04:57.053 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-31T05:04:57.053 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-31T05:04:57.053 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-31T05:04:57.053 INFO:teuthology.orchestra.run.smithi195.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-31T05:04:57.053 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-31T05:04:57.053 INFO:teuthology.orchestra.run.smithi195.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-31T05:04:57.053 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-31T05:04:57.053 INFO:teuthology.orchestra.run.smithi195.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-31T05:04:57.053 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-31T05:04:57.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:57.054 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-01-31T05:04:57.054 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-01-31T05:04:57.054 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-31T05:04:57.054 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-31T05:04:57.054 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-31T05:04:57.054 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-01-31T05:04:57.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:57.144 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-01-31T05:04:57.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:57.153 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list-id 2024-01-31T05:04:57.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:57.203 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-01-31T05:04:57.203 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-01-31T05:04:57.203 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-31T05:04:57.203 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-01-31T05:04:57.203 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-01-31T05:04:57.292 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-01-31T05:04:57.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:57.292 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-01-31T05:04:57.292 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-01-31T05:04:57.292 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-01-31T05:04:57.292 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-31T05:04:57.292 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-01-31T05:04:57.292 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-01-31T05:04:57.292 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-01-31T05:04:57.292 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-01-31T05:04:57.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:57.408 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-01-31T05:04:57.408 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-01-31T05:04:57.408 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2024-01-31T05:04:57.408 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set dev brx.0 master ceph-brx 2024-01-31T05:04:57.408 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-01-31T05:04:57.447 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-01-31T05:04:57.447 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-31T05:04:57.447 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-31T05:04:57.499 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-31T05:04:57.499 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-31T05:04:57.499 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-31T05:04:57.550 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2024-01-31T05:04:57.611 DEBUG:teuthology.orchestra.run.smithi195:> cat /proc/self/mounts | awk '{print $2}' 2024-01-31T05:04:57.668 INFO:teuthology.orchestra.run.smithi195.stdout:/sys 2024-01-31T05:04:57.668 INFO:teuthology.orchestra.run.smithi195.stdout:/proc 2024-01-31T05:04:57.668 INFO:teuthology.orchestra.run.smithi195.stdout:/dev 2024-01-31T05:04:57.668 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/pts 2024-01-31T05:04:57.668 INFO:teuthology.orchestra.run.smithi195.stdout:/run 2024-01-31T05:04:57.668 INFO:teuthology.orchestra.run.smithi195.stdout:/ 2024-01-31T05:04:57.668 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/security 2024-01-31T05:04:57.668 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/shm 2024-01-31T05:04:57.669 INFO:teuthology.orchestra.run.smithi195.stdout:/run/lock 2024-01-31T05:04:57.669 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup 2024-01-31T05:04:57.669 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/pstore 2024-01-31T05:04:57.669 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/bpf 2024-01-31T05:04:57.669 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/sys/fs/binfmt_misc 2024-01-31T05:04:57.669 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/hugepages 2024-01-31T05:04:57.669 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/mqueue 2024-01-31T05:04:57.669 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/debug 2024-01-31T05:04:57.669 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/tracing 2024-01-31T05:04:57.669 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/fs/nfsd 2024-01-31T05:04:57.669 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/fuse/connections 2024-01-31T05:04:57.669 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/config 2024-01-31T05:04:57.669 INFO:teuthology.orchestra.run.smithi195.stdout:/run/credentials/systemd-sysusers.service 2024-01-31T05:04:57.669 INFO:teuthology.orchestra.run.smithi195.stdout:/run/rpc_pipefs 2024-01-31T05:04:57.670 INFO:teuthology.orchestra.run.smithi195.stdout:/run/user/1000 2024-01-31T05:04:57.670 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph 2024-01-31T05:04:57.670 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-4 2024-01-31T05:04:57.670 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-5 2024-01-31T05:04:57.670 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-6 2024-01-31T05:04:57.670 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-7 2024-01-31T05:04:57.670 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns 2024-01-31T05:04:57.670 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-31T05:04:57.670 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-31T05:04:57.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:57.671 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2024-01-31T05:04:57.722 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-31T05:04:57.722 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-01-31T05:04:57.769 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2024-01-31T05:04:57.790 DEBUG:teuthology.orchestra.run.smithi195:> cat /proc/self/mounts | awk '{print $2}' 2024-01-31T05:04:57.844 INFO:teuthology.orchestra.run.smithi195.stdout:/sys 2024-01-31T05:04:57.844 INFO:teuthology.orchestra.run.smithi195.stdout:/proc 2024-01-31T05:04:57.844 INFO:teuthology.orchestra.run.smithi195.stdout:/dev 2024-01-31T05:04:57.844 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/pts 2024-01-31T05:04:57.845 INFO:teuthology.orchestra.run.smithi195.stdout:/run 2024-01-31T05:04:57.845 INFO:teuthology.orchestra.run.smithi195.stdout:/ 2024-01-31T05:04:57.845 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/security 2024-01-31T05:04:57.845 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/shm 2024-01-31T05:04:57.845 INFO:teuthology.orchestra.run.smithi195.stdout:/run/lock 2024-01-31T05:04:57.845 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup 2024-01-31T05:04:57.845 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/pstore 2024-01-31T05:04:57.845 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/bpf 2024-01-31T05:04:57.845 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/sys/fs/binfmt_misc 2024-01-31T05:04:57.845 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/hugepages 2024-01-31T05:04:57.845 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/mqueue 2024-01-31T05:04:57.845 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/debug 2024-01-31T05:04:57.845 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/tracing 2024-01-31T05:04:57.845 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/fs/nfsd 2024-01-31T05:04:57.845 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/fuse/connections 2024-01-31T05:04:57.846 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/config 2024-01-31T05:04:57.846 INFO:teuthology.orchestra.run.smithi195.stdout:/run/credentials/systemd-sysusers.service 2024-01-31T05:04:57.846 INFO:teuthology.orchestra.run.smithi195.stdout:/run/rpc_pipefs 2024-01-31T05:04:57.846 INFO:teuthology.orchestra.run.smithi195.stdout:/run/user/1000 2024-01-31T05:04:57.846 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph 2024-01-31T05:04:57.846 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-4 2024-01-31T05:04:57.846 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-5 2024-01-31T05:04:57.846 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-6 2024-01-31T05:04:57.846 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-7 2024-01-31T05:04:57.846 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns 2024-01-31T05:04:57.846 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-31T05:04:57.846 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-31T05:04:57.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:57.847 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2024-01-31T05:04:57.873 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi195.stderr:2024-01-31T05:04:57.871+0000 7f3e190dc580 -1 init, newargv = 0x55d0907b00c0 newargc=15 2024-01-31T05:04:57.874 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi195.stderr:ceph-fuse[31761]: starting ceph client 2024-01-31T05:04:57.883 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi195.stderr:ceph-fuse[31761]: starting fuse 2024-01-31T05:04:58.984 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2024-01-31T05:04:59.006 DEBUG:teuthology.orchestra.run.smithi195:> cat /proc/self/mounts | awk '{print $2}' 2024-01-31T05:04:59.056 INFO:teuthology.orchestra.run.smithi195.stdout:/sys 2024-01-31T05:04:59.056 INFO:teuthology.orchestra.run.smithi195.stdout:/proc 2024-01-31T05:04:59.056 INFO:teuthology.orchestra.run.smithi195.stdout:/dev 2024-01-31T05:04:59.056 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/pts 2024-01-31T05:04:59.056 INFO:teuthology.orchestra.run.smithi195.stdout:/run 2024-01-31T05:04:59.056 INFO:teuthology.orchestra.run.smithi195.stdout:/ 2024-01-31T05:04:59.056 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/security 2024-01-31T05:04:59.056 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/shm 2024-01-31T05:04:59.056 INFO:teuthology.orchestra.run.smithi195.stdout:/run/lock 2024-01-31T05:04:59.057 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup 2024-01-31T05:04:59.057 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/pstore 2024-01-31T05:04:59.057 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/bpf 2024-01-31T05:04:59.057 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/sys/fs/binfmt_misc 2024-01-31T05:04:59.057 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/hugepages 2024-01-31T05:04:59.057 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/mqueue 2024-01-31T05:04:59.057 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/debug 2024-01-31T05:04:59.057 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/tracing 2024-01-31T05:04:59.057 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/fs/nfsd 2024-01-31T05:04:59.057 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/fuse/connections 2024-01-31T05:04:59.057 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/config 2024-01-31T05:04:59.057 INFO:teuthology.orchestra.run.smithi195.stdout:/run/credentials/systemd-sysusers.service 2024-01-31T05:04:59.057 INFO:teuthology.orchestra.run.smithi195.stdout:/run/rpc_pipefs 2024-01-31T05:04:59.057 INFO:teuthology.orchestra.run.smithi195.stdout:/run/user/1000 2024-01-31T05:04:59.057 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph 2024-01-31T05:04:59.057 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-4 2024-01-31T05:04:59.058 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-5 2024-01-31T05:04:59.058 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-6 2024-01-31T05:04:59.058 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-7 2024-01-31T05:04:59.058 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns 2024-01-31T05:04:59.058 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-31T05:04:59.058 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-31T05:04:59.058 INFO:teuthology.orchestra.run.smithi195.stdout:/home/ubuntu/cephtest/mnt.1 2024-01-31T05:04:59.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:59.059 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2024-01-31T05:04:59.115 INFO:teuthology.orchestra.run.smithi195.stdout:43 2024-01-31T05:04:59.115 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-31T05:04:59.115 DEBUG:teuthology.orchestra.run.smithi195:> sudo stdin-killer -- python3 -c ' 2024-01-31T05:04:59.115 DEBUG:teuthology.orchestra.run.smithi195:> import glob 2024-01-31T05:04:59.115 DEBUG:teuthology.orchestra.run.smithi195:> import re 2024-01-31T05:04:59.115 DEBUG:teuthology.orchestra.run.smithi195:> import os 2024-01-31T05:04:59.115 DEBUG:teuthology.orchestra.run.smithi195:> import subprocess 2024-01-31T05:04:59.115 DEBUG:teuthology.orchestra.run.smithi195:> 2024-01-31T05:04:59.116 DEBUG:teuthology.orchestra.run.smithi195:> def _find_admin_socket(client_name): 2024-01-31T05:04:59.116 DEBUG:teuthology.orchestra.run.smithi195:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-01-31T05:04:59.116 DEBUG:teuthology.orchestra.run.smithi195:> files = glob.glob(asok_path) 2024-01-31T05:04:59.116 DEBUG:teuthology.orchestra.run.smithi195:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-01-31T05:04:59.116 DEBUG:teuthology.orchestra.run.smithi195:> 2024-01-31T05:04:59.116 DEBUG:teuthology.orchestra.run.smithi195:> # Given a non-glob path, it better be there 2024-01-31T05:04:59.116 DEBUG:teuthology.orchestra.run.smithi195:> if "*" not in asok_path: 2024-01-31T05:04:59.116 DEBUG:teuthology.orchestra.run.smithi195:> assert(len(files) == 1) 2024-01-31T05:04:59.116 DEBUG:teuthology.orchestra.run.smithi195:> return files[0] 2024-01-31T05:04:59.116 DEBUG:teuthology.orchestra.run.smithi195:> 2024-01-31T05:04:59.116 DEBUG:teuthology.orchestra.run.smithi195:> for f in files: 2024-01-31T05:04:59.116 DEBUG:teuthology.orchestra.run.smithi195:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-31T05:04:59.116 DEBUG:teuthology.orchestra.run.smithi195:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-31T05:04:59.116 DEBUG:teuthology.orchestra.run.smithi195:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-31T05:04:59.116 DEBUG:teuthology.orchestra.run.smithi195:> contents = proc_f.read() 2024-01-31T05:04:59.116 DEBUG:teuthology.orchestra.run.smithi195:> if mountpoint in contents: 2024-01-31T05:04:59.117 DEBUG:teuthology.orchestra.run.smithi195:> return f 2024-01-31T05:04:59.117 DEBUG:teuthology.orchestra.run.smithi195:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-31T05:04:59.117 DEBUG:teuthology.orchestra.run.smithi195:> 2024-01-31T05:04:59.117 DEBUG:teuthology.orchestra.run.smithi195:> print(_find_admin_socket("client.1")) 2024-01-31T05:04:59.117 DEBUG:teuthology.orchestra.run.smithi195:> ' 2024-01-31T05:04:59.240 INFO:teuthology.orchestra.run.smithi195.stdout:/var/run/ceph/ceph-client.1.31761.asok 2024-01-31T05:04:59.243 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:04:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-31T05:04:59.251 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.31761.asok 2024-01-31T05:04:59.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:59.251 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.31761.asok status 2024-01-31T05:04:59.421 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-01-31T05:04:59.421 INFO:teuthology.orchestra.run.smithi195.stdout: "metadata": { 2024-01-31T05:04:59.421 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_sha1": "661946e7044723130c03627323f6a879a9848cb5", 2024-01-31T05:04:59.421 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_version": "ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev)", 2024-01-31T05:04:59.422 INFO:teuthology.orchestra.run.smithi195.stdout: "entity_id": "1", 2024-01-31T05:04:59.422 INFO:teuthology.orchestra.run.smithi195.stdout: "hostname": "smithi195", 2024-01-31T05:04:59.422 INFO:teuthology.orchestra.run.smithi195.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-01-31T05:04:59.422 INFO:teuthology.orchestra.run.smithi195.stdout: "pid": "31761", 2024-01-31T05:04:59.422 INFO:teuthology.orchestra.run.smithi195.stdout: "root": "/" 2024-01-31T05:04:59.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-01-31T05:04:59.422 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_count": 0, 2024-01-31T05:04:59.422 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_pinned_count": 0, 2024-01-31T05:04:59.422 INFO:teuthology.orchestra.run.smithi195.stdout: "id": 4649, 2024-01-31T05:04:59.422 INFO:teuthology.orchestra.run.smithi195.stdout: "inst": { 2024-01-31T05:04:59.422 INFO:teuthology.orchestra.run.smithi195.stdout: "name": { 2024-01-31T05:04:59.422 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "client", 2024-01-31T05:04:59.422 INFO:teuthology.orchestra.run.smithi195.stdout: "num": 4649 2024-01-31T05:04:59.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-01-31T05:04:59.422 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2024-01-31T05:04:59.423 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2024-01-31T05:04:59.423 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "192.168.0.1:0", 2024-01-31T05:04:59.423 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 2686562459 2024-01-31T05:04:59.423 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-01-31T05:04:59.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-01-31T05:04:59.423 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2024-01-31T05:04:59.423 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2024-01-31T05:04:59.423 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "192.168.0.1:0", 2024-01-31T05:04:59.423 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 2686562459 2024-01-31T05:04:59.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-01-31T05:04:59.423 INFO:teuthology.orchestra.run.smithi195.stdout: "inst_str": "client.4649 192.168.0.1:0/2686562459", 2024-01-31T05:04:59.423 INFO:teuthology.orchestra.run.smithi195.stdout: "addr_str": "192.168.0.1:0/2686562459", 2024-01-31T05:04:59.423 INFO:teuthology.orchestra.run.smithi195.stdout: "inode_count": 1, 2024-01-31T05:04:59.423 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_epoch": 9, 2024-01-31T05:04:59.424 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch": 25, 2024-01-31T05:04:59.424 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch_barrier": 0, 2024-01-31T05:04:59.424 INFO:teuthology.orchestra.run.smithi195.stdout: "blocklisted": false, 2024-01-31T05:04:59.424 INFO:teuthology.orchestra.run.smithi195.stdout: "fs_name": "cephfs" 2024-01-31T05:04:59.424 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-01-31T05:04:59.436 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-31T05:04:59.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.586+0000 7fbc9a200640 1 Processor -- start 2024-01-31T05:04:59.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.586+0000 7fbc9a200640 1 -- start start 2024-01-31T05:04:59.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.586+0000 7fbc9a200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc9415e760 0x7fbc940cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:59.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.586+0000 7fbc9a200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbc940704d0 0x7fbc9406e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:59.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.586+0000 7fbc9a200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9406f460 con 0x7fbc940d1970 2024-01-31T05:04:59.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.586+0000 7fbc9a200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc940c7da0 con 0x7fbc940704d0 2024-01-31T05:04:59.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.586+0000 7fbc9a200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9406fad0 con 0x7fbc9415e760 2024-01-31T05:04:59.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.586+0000 7fbc92a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbc940704d0 0x7fbc9406e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:59.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.586+0000 7fbc92a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbc940704d0 0x7fbc9406e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45602/0 (socket says 172.21.15.49:45602) 2024-01-31T05:04:59.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.586+0000 7fbc92a00640 1 -- 172.21.15.49:0/967684994 learned_addr learned my addr 172.21.15.49:0/967684994 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:59.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.590+0000 7fbc93400640 1 --2- 172.21.15.49:0/967684994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc9415e760 0x7fbc940cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:59.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.590+0000 7fbc92a00640 1 -- 172.21.15.49:0/967684994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc9415e760 msgr2=0x7fbc940cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:04:59.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.590+0000 7fbc92a00640 1 --2- 172.21.15.49:0/967684994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc9415e760 0x7fbc940cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:59.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.590+0000 7fbc92a00640 1 -- 172.21.15.49:0/967684994 >> v1:172.21.15.195:6789/0 conn(0x7fbc940d1970 legacy=0x7fbc9406ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:59.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.590+0000 7fbc92a00640 1 -- 172.21.15.49:0/967684994 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9406fdb0 con 0x7fbc940704d0 2024-01-31T05:04:59.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.590+0000 7fbc92a00640 1 --2- 172.21.15.49:0/967684994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc940704d0 0x7fbc9406e700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c009870 tx=0x7fbc7c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0961f093d72d09 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:59.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.590+0000 7fbc92000640 1 -- 172.21.15.49:0/967684994 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0a95f0 con 0x7fbc940704d0 2024-01-31T05:04:59.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.590+0000 7fbc92000640 1 -- 172.21.15.49:0/967684994 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c0a9750 con 0x7fbc940704d0 2024-01-31T05:04:59.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.590+0000 7fbc92000640 1 -- 172.21.15.49:0/967684994 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0a9ae0 con 0x7fbc940704d0 2024-01-31T05:04:59.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.594+0000 7fbc9a200640 1 -- 172.21.15.49:0/967684994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc940704d0 msgr2=0x7fbc9406e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:59.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.594+0000 7fbc9a200640 1 --2- 172.21.15.49:0/967684994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc940704d0 0x7fbc9406e700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c009870 tx=0x7fbc7c01c510 comp rx=0 tx=0).stop 2024-01-31T05:04:59.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.594+0000 7fbc9a200640 1 -- 172.21.15.49:0/967684994 shutdown_connections 2024-01-31T05:04:59.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.594+0000 7fbc9a200640 1 --2- 172.21.15.49:0/967684994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc940704d0 0x7fbc9406e700 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:59.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.594+0000 7fbc9a200640 1 --2- 172.21.15.49:0/967684994 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc9415e760 0x7fbc940cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:59.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.594+0000 7fbc9a200640 1 -- 172.21.15.49:0/967684994 >> 172.21.15.49:0/967684994 conn(0x7fbc940d0e50 msgr2=0x7fbc940d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:59.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.594+0000 7fbc9a200640 1 -- 172.21.15.49:0/967684994 shutdown_connections 2024-01-31T05:04:59.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.594+0000 7fbc9a200640 1 -- 172.21.15.49:0/967684994 wait complete. 2024-01-31T05:04:59.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.594+0000 7fbc9a200640 1 Processor -- start 2024-01-31T05:04:59.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.594+0000 7fbc9a200640 1 -- start start 2024-01-31T05:04:59.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.594+0000 7fbc9a200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc940704d0 0x7fbc94165790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:59.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.594+0000 7fbc9a200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc940d1970 0x7fbc94154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:59.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.594+0000 7fbc9a200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc9415e760 0x7fbc941552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:59.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.594+0000 7fbc9a200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9406bb90 con 0x7fbc940d1970 2024-01-31T05:04:59.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.594+0000 7fbc9a200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9406be70 con 0x7fbc940704d0 2024-01-31T05:04:59.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.594+0000 7fbc9a200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9406c150 con 0x7fbc9415e760 2024-01-31T05:04:59.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.598+0000 7fbc92a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc940d1970 0x7fbc94154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:59.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.598+0000 7fbc92a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc940d1970 0x7fbc94154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45606/0 (socket says 172.21.15.49:45606) 2024-01-31T05:04:59.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.598+0000 7fbc92a00640 1 -- 172.21.15.49:0/449298445 learned_addr learned my addr 172.21.15.49:0/449298445 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:04:59.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.598+0000 7fbc93400640 1 --2- 172.21.15.49:0/449298445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc940704d0 0x7fbc94165790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:59.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.598+0000 7fbc93e00640 1 --2- 172.21.15.49:0/449298445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc9415e760 0x7fbc941552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:59.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.598+0000 7fbc92a00640 1 -- 172.21.15.49:0/449298445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc9415e760 msgr2=0x7fbc941552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:59.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.598+0000 7fbc92a00640 1 --2- 172.21.15.49:0/449298445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc9415e760 0x7fbc941552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:59.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.598+0000 7fbc92a00640 1 -- 172.21.15.49:0/449298445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc940704d0 msgr2=0x7fbc94165790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:59.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.598+0000 7fbc92a00640 1 --2- 172.21.15.49:0/449298445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc940704d0 0x7fbc94165790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:59.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.598+0000 7fbc92a00640 1 -- 172.21.15.49:0/449298445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c0094d0 con 0x7fbc940d1970 2024-01-31T05:04:59.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.598+0000 7fbc93400640 1 --2- 172.21.15.49:0/449298445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc940704d0 0x7fbc94165790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:04:59.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.598+0000 7fbc92a00640 1 --2- 172.21.15.49:0/449298445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc940d1970 0x7fbc94154db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c0ab040 tx=0x7fbc7c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:59.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.598+0000 7fbc8b400640 1 -- 172.21.15.49:0/449298445 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0bc650 con 0x7fbc940d1970 2024-01-31T05:04:59.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.598+0000 7fbc8b400640 1 -- 172.21.15.49:0/449298445 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c0bc7b0 con 0x7fbc940d1970 2024-01-31T05:04:59.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.598+0000 7fbc8b400640 1 -- 172.21.15.49:0/449298445 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0bcb60 con 0x7fbc940d1970 2024-01-31T05:04:59.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.598+0000 7fbc9a200640 1 -- 172.21.15.49:0/449298445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9406c430 con 0x7fbc940d1970 2024-01-31T05:04:59.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.598+0000 7fbc9a200640 1 -- 172.21.15.49:0/449298445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9406b880 con 0x7fbc940d1970 2024-01-31T05:04:59.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.598+0000 7fbc9a200640 1 -- 172.21.15.49:0/449298445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc940d0ac0 con 0x7fbc940d1970 2024-01-31T05:04:59.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.598+0000 7fbc8b400640 1 -- 172.21.15.49:0/449298445 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fbc7c0bccc0 con 0x7fbc940d1970 2024-01-31T05:04:59.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.602+0000 7fbc8b400640 1 --2- 172.21.15.49:0/449298445 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbc6c066500 0x7fbc6c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:59.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.602+0000 7fbc8b400640 1 -- 172.21.15.49:0/449298445 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbc7c11e9c0 con 0x7fbc940d1970 2024-01-31T05:04:59.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.602+0000 7fbc93400640 1 --2- 172.21.15.49:0/449298445 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbc6c066500 0x7fbc6c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:59.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.602+0000 7fbc93400640 1 --2- 172.21.15.49:0/449298445 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbc6c066500 0x7fbc6c0689c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbc9415b450 tx=0x7fbc84009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:59.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.606+0000 7fbc8b400640 1 -- 172.21.15.49:0/449298445 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fbc7c0eb980 con 0x7fbc940d1970 2024-01-31T05:04:59.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.802+0000 7fbc9a200640 1 -- 172.21.15.49:0/449298445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbc9406c290 con 0x7fbc940d1970 2024-01-31T05:04:59.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.802+0000 7fbc8b400640 1 -- 172.21.15.49:0/449298445 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fbc9406c290 con 0x7fbc940d1970 2024-01-31T05:04:59.804 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-31T05:04:59.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.802+0000 7fbc9a200640 1 -- 172.21.15.49:0/449298445 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbc6c066500 msgr2=0x7fbc6c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:59.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.802+0000 7fbc9a200640 1 --2- 172.21.15.49:0/449298445 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbc6c066500 0x7fbc6c0689c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbc9415b450 tx=0x7fbc84009190 comp rx=0 tx=0).stop 2024-01-31T05:04:59.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.802+0000 7fbc9a200640 1 -- 172.21.15.49:0/449298445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc940d1970 msgr2=0x7fbc94154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:59.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.802+0000 7fbc9a200640 1 --2- 172.21.15.49:0/449298445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc940d1970 0x7fbc94154db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c0ab040 tx=0x7fbc7c01ad50 comp rx=0 tx=0).stop 2024-01-31T05:04:59.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.802+0000 7fbc9a200640 1 -- 172.21.15.49:0/449298445 shutdown_connections 2024-01-31T05:04:59.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.802+0000 7fbc9a200640 1 --2- 172.21.15.49:0/449298445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc9415e760 0x7fbc941552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:59.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.802+0000 7fbc9a200640 1 --2- 172.21.15.49:0/449298445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc940d1970 0x7fbc94154db0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:59.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.802+0000 7fbc9a200640 1 --2- 172.21.15.49:0/449298445 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbc6c066500 0x7fbc6c0689c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:59.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.802+0000 7fbc9a200640 1 --2- 172.21.15.49:0/449298445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc940704d0 0x7fbc94165790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:59.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.802+0000 7fbc9a200640 1 -- 172.21.15.49:0/449298445 >> 172.21.15.49:0/449298445 conn(0x7fbc940d0e50 msgr2=0x7fbc940ae4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:59.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.802+0000 7fbc9a200640 1 -- 172.21.15.49:0/449298445 shutdown_connections 2024-01-31T05:04:59.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:04:59.802+0000 7fbc9a200640 1 -- 172.21.15.49:0/449298445 wait complete. 2024-01-31T05:04:59.826 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-31T05:04:59.826 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-31T05:04:59.826 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-01-31T05:04:59.826 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-01-31T05:04:59.826 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-01-31T05:04:59.826 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-31T05:04:59.827 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-31T05:04:59.827 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-31T05:04:59.827 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-01-31T05:04:59.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:59.827 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-01-31T05:04:59.836 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-31T05:04:59.836 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-31T05:04:59.836 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-01-31T05:04:59.836 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:59.836 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-01-31T05:04:59.836 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:59.836 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-31T05:04:59.836 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:59.837 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-01-31T05:04:59.837 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-31T05:04:59.837 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:59.837 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-01-31T05:04:59.837 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-31T05:04:59.837 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:59.837 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-31T05:04:59.837 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:59.837 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-31T05:04:59.837 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42418sec preferred_lft 42418sec 2024-01-31T05:04:59.837 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::ec4:7aff:fe88:8081/64 scope link 2024-01-31T05:04:59.837 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:59.837 INFO:teuthology.orchestra.run.smithi195.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-31T05:04:59.837 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 02:42:0a:d5:9c:3e brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:59.837 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-31T05:04:59.838 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:59.838 INFO:teuthology.orchestra.run.smithi195.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-31T05:04:59.838 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-31T05:04:59.838 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-31T05:04:59.838 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:59.838 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-31T05:04:59.838 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:59.838 INFO:teuthology.orchestra.run.smithi195.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-31T05:04:59.838 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-31T05:04:59.838 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-31T05:04:59.838 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:04:59.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:59.839 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-31T05:04:59.901 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-01-31T05:04:59.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:59.904 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-01-31T05:04:59.957 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-01-31T05:04:59.957 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-31T05:04:59.957 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-31T05:04:59.957 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-31T05:04:59.957 INFO:teuthology.orchestra.run.smithi195.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-31T05:04:59.957 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-31T05:04:59.957 INFO:teuthology.orchestra.run.smithi195.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-31T05:04:59.957 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-31T05:04:59.958 INFO:teuthology.orchestra.run.smithi195.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-31T05:04:59.958 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-31T05:04:59.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:04:59.958 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-01-31T05:04:59.958 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-01-31T05:04:59.958 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-31T05:04:59.958 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-31T05:04:59.958 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-31T05:04:59.958 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-01-31T05:05:00.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:00.049 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-01-31T05:05:00.058 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-31T05:05:00.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:00.059 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list-id 2024-01-31T05:05:00.107 INFO:teuthology.orchestra.run.smithi195.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-01-31T05:05:00.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:00.107 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-01-31T05:05:00.107 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-01-31T05:05:00.107 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-31T05:05:00.107 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-01-31T05:05:00.108 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-01-31T05:05:00.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:00.189 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-01-31T05:05:00.255 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-31T05:05:00.255 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-31T05:05:00.255 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-01-31T05:05:00.255 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:05:00.255 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-01-31T05:05:00.255 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:05:00.255 INFO:teuthology.orchestra.run.smithi195.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-31T05:05:00.255 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 4a:bc:17:40:b3:f8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-31T05:05:00.255 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-31T05:05:00.255 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:05:00.255 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::48bc:17ff:fe40:b3f8/64 scope link 2024-01-31T05:05:00.255 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:05:00.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:00.257 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-01-31T05:05:00.323 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-31T05:05:00.324 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-31T05:05:00.324 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-01-31T05:05:00.324 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:05:00.324 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-01-31T05:05:00.324 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:05:00.324 INFO:teuthology.orchestra.run.smithi195.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-31T05:05:00.324 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 4a:bc:17:40:b3:f8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-31T05:05:00.324 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-31T05:05:00.324 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:05:00.324 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::48bc:17ff:fe40:b3f8/64 scope link 2024-01-31T05:05:00.324 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:05:00.325 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-01-31T05:05:00.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:00.326 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-01-31T05:05:00.326 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-01-31T05:05:00.326 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-01-31T05:05:00.326 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-01-31T05:05:00.326 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-01-31T05:05:00.326 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-01-31T05:05:00.326 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-01-31T05:05:00.326 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-01-31T05:05:00.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:00.459 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-01-31T05:05:00.459 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-01-31T05:05:00.460 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.1 up 2024-01-31T05:05:00.460 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set dev brx.1 master ceph-brx 2024-01-31T05:05:00.460 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-01-31T05:05:00.498 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-01-31T05:05:00.498 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-31T05:05:00.498 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-01-31T05:05:00.551 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-01-31T05:05:00.551 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-31T05:05:00.551 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-01-31T05:05:00.602 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2024-01-31T05:05:00.662 DEBUG:teuthology.orchestra.run.smithi195:> cat /proc/self/mounts | awk '{print $2}' 2024-01-31T05:05:00.715 INFO:teuthology.orchestra.run.smithi195.stdout:/sys 2024-01-31T05:05:00.716 INFO:teuthology.orchestra.run.smithi195.stdout:/proc 2024-01-31T05:05:00.716 INFO:teuthology.orchestra.run.smithi195.stdout:/dev 2024-01-31T05:05:00.716 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/pts 2024-01-31T05:05:00.716 INFO:teuthology.orchestra.run.smithi195.stdout:/run 2024-01-31T05:05:00.716 INFO:teuthology.orchestra.run.smithi195.stdout:/ 2024-01-31T05:05:00.716 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/security 2024-01-31T05:05:00.716 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/shm 2024-01-31T05:05:00.716 INFO:teuthology.orchestra.run.smithi195.stdout:/run/lock 2024-01-31T05:05:00.716 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup 2024-01-31T05:05:00.716 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/pstore 2024-01-31T05:05:00.716 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/bpf 2024-01-31T05:05:00.716 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/sys/fs/binfmt_misc 2024-01-31T05:05:00.716 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/hugepages 2024-01-31T05:05:00.716 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/mqueue 2024-01-31T05:05:00.716 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/debug 2024-01-31T05:05:00.717 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/tracing 2024-01-31T05:05:00.717 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/fs/nfsd 2024-01-31T05:05:00.717 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/fuse/connections 2024-01-31T05:05:00.717 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/config 2024-01-31T05:05:00.717 INFO:teuthology.orchestra.run.smithi195.stdout:/run/credentials/systemd-sysusers.service 2024-01-31T05:05:00.717 INFO:teuthology.orchestra.run.smithi195.stdout:/run/rpc_pipefs 2024-01-31T05:05:00.717 INFO:teuthology.orchestra.run.smithi195.stdout:/run/user/1000 2024-01-31T05:05:00.717 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph 2024-01-31T05:05:00.717 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-4 2024-01-31T05:05:00.717 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-5 2024-01-31T05:05:00.717 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-6 2024-01-31T05:05:00.717 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-7 2024-01-31T05:05:00.717 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns 2024-01-31T05:05:00.717 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-31T05:05:00.717 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-31T05:05:00.717 INFO:teuthology.orchestra.run.smithi195.stdout:/home/ubuntu/cephtest/mnt.1 2024-01-31T05:05:00.718 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-31T05:05:00.718 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-31T05:05:00.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:00.719 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2024-01-31T05:05:00.771 INFO:teuthology.orchestra.run.smithi195.stdout:43 2024-01-31T05:05:00.771 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2024-01-31T05:05:00.772 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-01-31T05:05:00.817 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2024-01-31T05:05:00.837 DEBUG:teuthology.orchestra.run.smithi195:> cat /proc/self/mounts | awk '{print $2}' 2024-01-31T05:05:00.889 INFO:teuthology.orchestra.run.smithi195.stdout:/sys 2024-01-31T05:05:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:/proc 2024-01-31T05:05:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:/dev 2024-01-31T05:05:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/pts 2024-01-31T05:05:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:/run 2024-01-31T05:05:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:/ 2024-01-31T05:05:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/security 2024-01-31T05:05:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/shm 2024-01-31T05:05:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:/run/lock 2024-01-31T05:05:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup 2024-01-31T05:05:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/pstore 2024-01-31T05:05:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/bpf 2024-01-31T05:05:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/sys/fs/binfmt_misc 2024-01-31T05:05:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/hugepages 2024-01-31T05:05:00.890 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/mqueue 2024-01-31T05:05:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/debug 2024-01-31T05:05:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/tracing 2024-01-31T05:05:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/fs/nfsd 2024-01-31T05:05:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/fuse/connections 2024-01-31T05:05:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/config 2024-01-31T05:05:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:/run/credentials/systemd-sysusers.service 2024-01-31T05:05:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:/run/rpc_pipefs 2024-01-31T05:05:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:/run/user/1000 2024-01-31T05:05:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph 2024-01-31T05:05:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-4 2024-01-31T05:05:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-5 2024-01-31T05:05:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-6 2024-01-31T05:05:00.891 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph/osd/ceph-7 2024-01-31T05:05:00.892 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns 2024-01-31T05:05:00.892 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-31T05:05:00.892 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-31T05:05:00.892 INFO:teuthology.orchestra.run.smithi195.stdout:/home/ubuntu/cephtest/mnt.1 2024-01-31T05:05:00.892 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-31T05:05:00.892 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-31T05:05:00.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:00.893 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2024-01-31T05:05:00.912 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi195.stderr:2024-01-31T05:05:00.911+0000 7fc067c45580 -1 init, newargv = 0x56078bc46de0 newargc=15 2024-01-31T05:05:00.912 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi195.stderr:ceph-fuse[31873]: starting ceph client 2024-01-31T05:05:00.920 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi195.stderr:ceph-fuse[31873]: starting fuse 2024-01-31T05:05:00.921 INFO:teuthology.orchestra.run.smithi195.stdout:43 2024-01-31T05:05:00.921 INFO:teuthology.orchestra.run.smithi195.stdout:44 2024-01-31T05:05:00.921 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2024-01-31T05:05:00.921 DEBUG:teuthology.orchestra.run.smithi195:> sudo stdin-killer -- python3 -c ' 2024-01-31T05:05:00.921 DEBUG:teuthology.orchestra.run.smithi195:> import glob 2024-01-31T05:05:00.921 DEBUG:teuthology.orchestra.run.smithi195:> import re 2024-01-31T05:05:00.921 DEBUG:teuthology.orchestra.run.smithi195:> import os 2024-01-31T05:05:00.921 DEBUG:teuthology.orchestra.run.smithi195:> import subprocess 2024-01-31T05:05:00.921 DEBUG:teuthology.orchestra.run.smithi195:> 2024-01-31T05:05:00.922 DEBUG:teuthology.orchestra.run.smithi195:> def _find_admin_socket(client_name): 2024-01-31T05:05:00.922 DEBUG:teuthology.orchestra.run.smithi195:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-01-31T05:05:00.922 DEBUG:teuthology.orchestra.run.smithi195:> files = glob.glob(asok_path) 2024-01-31T05:05:00.922 DEBUG:teuthology.orchestra.run.smithi195:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-01-31T05:05:00.922 DEBUG:teuthology.orchestra.run.smithi195:> 2024-01-31T05:05:00.922 DEBUG:teuthology.orchestra.run.smithi195:> # Given a non-glob path, it better be there 2024-01-31T05:05:00.922 DEBUG:teuthology.orchestra.run.smithi195:> if "*" not in asok_path: 2024-01-31T05:05:00.922 DEBUG:teuthology.orchestra.run.smithi195:> assert(len(files) == 1) 2024-01-31T05:05:00.922 DEBUG:teuthology.orchestra.run.smithi195:> return files[0] 2024-01-31T05:05:00.922 DEBUG:teuthology.orchestra.run.smithi195:> 2024-01-31T05:05:00.922 DEBUG:teuthology.orchestra.run.smithi195:> for f in files: 2024-01-31T05:05:00.922 DEBUG:teuthology.orchestra.run.smithi195:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-31T05:05:00.922 DEBUG:teuthology.orchestra.run.smithi195:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-31T05:05:00.922 DEBUG:teuthology.orchestra.run.smithi195:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-31T05:05:00.922 DEBUG:teuthology.orchestra.run.smithi195:> contents = proc_f.read() 2024-01-31T05:05:00.922 DEBUG:teuthology.orchestra.run.smithi195:> if mountpoint in contents: 2024-01-31T05:05:00.923 DEBUG:teuthology.orchestra.run.smithi195:> return f 2024-01-31T05:05:00.923 DEBUG:teuthology.orchestra.run.smithi195:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-31T05:05:00.923 DEBUG:teuthology.orchestra.run.smithi195:> 2024-01-31T05:05:00.923 DEBUG:teuthology.orchestra.run.smithi195:> print(_find_admin_socket("client.3")) 2024-01-31T05:05:00.923 DEBUG:teuthology.orchestra.run.smithi195:> ' 2024-01-31T05:05:01.042 INFO:teuthology.orchestra.run.smithi195.stdout:/var/run/ceph/ceph-client.3.31873.asok 2024-01-31T05:05:01.045 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-31T05:05:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-31T05:05:01.053 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.31873.asok 2024-01-31T05:05:01.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:01.053 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.31873.asok status 2024-01-31T05:05:01.220 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-01-31T05:05:01.221 INFO:teuthology.orchestra.run.smithi195.stdout: "metadata": { 2024-01-31T05:05:01.221 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_sha1": "661946e7044723130c03627323f6a879a9848cb5", 2024-01-31T05:05:01.221 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_version": "ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev)", 2024-01-31T05:05:01.221 INFO:teuthology.orchestra.run.smithi195.stdout: "entity_id": "3", 2024-01-31T05:05:01.221 INFO:teuthology.orchestra.run.smithi195.stdout: "hostname": "smithi195", 2024-01-31T05:05:01.221 INFO:teuthology.orchestra.run.smithi195.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-01-31T05:05:01.221 INFO:teuthology.orchestra.run.smithi195.stdout: "pid": "31873", 2024-01-31T05:05:01.221 INFO:teuthology.orchestra.run.smithi195.stdout: "root": "/" 2024-01-31T05:05:01.221 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-01-31T05:05:01.221 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_count": 0, 2024-01-31T05:05:01.221 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_pinned_count": 0, 2024-01-31T05:05:01.221 INFO:teuthology.orchestra.run.smithi195.stdout: "id": 4861, 2024-01-31T05:05:01.221 INFO:teuthology.orchestra.run.smithi195.stdout: "inst": { 2024-01-31T05:05:01.221 INFO:teuthology.orchestra.run.smithi195.stdout: "name": { 2024-01-31T05:05:01.222 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "client", 2024-01-31T05:05:01.222 INFO:teuthology.orchestra.run.smithi195.stdout: "num": 4861 2024-01-31T05:05:01.222 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-01-31T05:05:01.222 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2024-01-31T05:05:01.222 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2024-01-31T05:05:01.222 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "192.168.0.2:0", 2024-01-31T05:05:01.222 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 3089888233 2024-01-31T05:05:01.222 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-01-31T05:05:01.222 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-01-31T05:05:01.222 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2024-01-31T05:05:01.222 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2024-01-31T05:05:01.222 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "192.168.0.2:0", 2024-01-31T05:05:01.222 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 3089888233 2024-01-31T05:05:01.222 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-01-31T05:05:01.222 INFO:teuthology.orchestra.run.smithi195.stdout: "inst_str": "client.4861 192.168.0.2:0/3089888233", 2024-01-31T05:05:01.223 INFO:teuthology.orchestra.run.smithi195.stdout: "addr_str": "192.168.0.2:0/3089888233", 2024-01-31T05:05:01.223 INFO:teuthology.orchestra.run.smithi195.stdout: "inode_count": 1, 2024-01-31T05:05:01.223 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_epoch": 9, 2024-01-31T05:05:01.223 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch": 26, 2024-01-31T05:05:01.223 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch_barrier": 0, 2024-01-31T05:05:01.223 INFO:teuthology.orchestra.run.smithi195.stdout: "blocklisted": false, 2024-01-31T05:05:01.223 INFO:teuthology.orchestra.run.smithi195.stdout: "fs_name": "cephfs" 2024-01-31T05:05:01.223 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-01-31T05:05:01.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:01.235 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-01-31T05:05:01.235 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-31T05:05:01.245 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-01-31T05:05:01.245 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-31T05:05:01.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:01.246 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-31T05:05:01.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:01.312 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-01-31T05:05:01.312 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.2 2024-01-31T05:05:01.368 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-01-31T05:05:01.368 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-01-31T05:05:01.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:01.369 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-01-31T05:05:01.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:01.431 DEBUG:teuthology.orchestra.run.smithi195:> stat --file-system '--printf=%T 2024-01-31T05:05:01.432 DEBUG:teuthology.orchestra.run.smithi195:> ' -- /home/ubuntu/cephtest/mnt.1 2024-01-31T05:05:01.441 INFO:teuthology.orchestra.run.smithi195.stdout:fuseblk 2024-01-31T05:05:01.441 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-01-31T05:05:01.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:01.441 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-31T05:05:01.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:01.503 DEBUG:teuthology.orchestra.run.smithi195:> stat --file-system '--printf=%T 2024-01-31T05:05:01.503 DEBUG:teuthology.orchestra.run.smithi195:> ' -- /home/ubuntu/cephtest/mnt.3 2024-01-31T05:05:01.555 INFO:teuthology.orchestra.run.smithi195.stdout:fuseblk 2024-01-31T05:05:01.555 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-01-31T05:05:01.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:01.555 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-01-31T05:05:01.617 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-01-31T05:05:01.634 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:01.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.782+0000 7fbfb3400640 1 Processor -- start 2024-01-31T05:05:01.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.782+0000 7fbfb3400640 1 -- start start 2024-01-31T05:05:01.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.786+0000 7fbfb3400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbfac15a000 0x7fbfac0cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:01.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.786+0000 7fbfb3400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfac06c2d0 0x7fbfac070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:01.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.786+0000 7fbfb3400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbfac071410 0x7fbfac0b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:01.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.786+0000 7fbfb3400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac0b3760 con 0x7fbfac071410 2024-01-31T05:05:01.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.786+0000 7fbfb3400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac0718a0 con 0x7fbfac15a000 2024-01-31T05:05:01.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.786+0000 7fbfb3400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac06c750 con 0x7fbfac06c2d0 2024-01-31T05:05:01.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.786+0000 7fbfb1400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbfac071410 0x7fbfac0b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:01.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.786+0000 7fbfb1400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbfac071410 0x7fbfac0b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45614/0 (socket says 172.21.15.49:45614) 2024-01-31T05:05:01.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.786+0000 7fbfb1400640 1 -- 172.21.15.49:0/2999814378 learned_addr learned my addr 172.21.15.49:0/2999814378 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:01.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.786+0000 7fbfb0a00640 1 --2- 172.21.15.49:0/2999814378 >> v2:172.21.15.195:3300/0 conn(0x7fbfac15a000 0x7fbfac0cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:01.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.786+0000 7fbfabe00640 1 --2- 172.21.15.49:0/2999814378 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfac06c2d0 0x7fbfac070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:01.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.786+0000 7fbfb1400640 1 -- 172.21.15.49:0/2999814378 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfac06c2d0 msgr2=0x7fbfac070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:01.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.786+0000 7fbfb1400640 1 --2- 172.21.15.49:0/2999814378 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfac06c2d0 0x7fbfac070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:01.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.786+0000 7fbfb1400640 1 -- 172.21.15.49:0/2999814378 >> v2:172.21.15.195:3300/0 conn(0x7fbfac15a000 msgr2=0x7fbfac0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:01.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.786+0000 7fbfb1400640 1 --2- 172.21.15.49:0/2999814378 >> v2:172.21.15.195:3300/0 conn(0x7fbfac15a000 0x7fbfac0cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:01.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.786+0000 7fbfb1400640 1 -- 172.21.15.49:0/2999814378 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac071e40 con 0x7fbfac071410 2024-01-31T05:05:01.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.786+0000 7fbfabe00640 1 --2- 172.21.15.49:0/2999814378 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfac06c2d0 0x7fbfac070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:01.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.790+0000 7fbfb1400640 1 --2- 172.21.15.49:0/2999814378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfac071410 0x7fbfac0b1ca0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbfac072cb0 tx=0x7fbfa401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42d32e4b61fb1cc server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:01.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.790+0000 7fbfab400640 1 -- 172.21.15.49:0/2999814378 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40a5740 con 0x7fbfac071410 2024-01-31T05:05:01.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.790+0000 7fbfab400640 1 -- 172.21.15.49:0/2999814378 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa40a58a0 con 0x7fbfac071410 2024-01-31T05:05:01.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.790+0000 7fbfab400640 1 -- 172.21.15.49:0/2999814378 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40a5c30 con 0x7fbfac071410 2024-01-31T05:05:01.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.790+0000 7fbfb3400640 1 -- 172.21.15.49:0/2999814378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfac071410 msgr2=0x7fbfac0b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:01.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.790+0000 7fbfb3400640 1 --2- 172.21.15.49:0/2999814378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfac071410 0x7fbfac0b1ca0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbfac072cb0 tx=0x7fbfa401c9d0 comp rx=0 tx=0).stop 2024-01-31T05:05:01.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.790+0000 7fbfb3400640 1 -- 172.21.15.49:0/2999814378 shutdown_connections 2024-01-31T05:05:01.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.790+0000 7fbfb3400640 1 --2- 172.21.15.49:0/2999814378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfac071410 0x7fbfac0b1ca0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:01.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.790+0000 7fbfb3400640 1 --2- 172.21.15.49:0/2999814378 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfac06c2d0 0x7fbfac070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:01.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.790+0000 7fbfb3400640 1 --2- 172.21.15.49:0/2999814378 >> v2:172.21.15.195:3300/0 conn(0x7fbfac15a000 0x7fbfac0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:01.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.790+0000 7fbfb3400640 1 -- 172.21.15.49:0/2999814378 >> 172.21.15.49:0/2999814378 conn(0x7fbfac0b09a0 msgr2=0x7fbfac0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:01.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.790+0000 7fbfb3400640 1 -- 172.21.15.49:0/2999814378 shutdown_connections 2024-01-31T05:05:01.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.790+0000 7fbfb3400640 1 -- 172.21.15.49:0/2999814378 wait complete. 2024-01-31T05:05:01.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.790+0000 7fbfb3400640 1 Processor -- start 2024-01-31T05:05:01.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.790+0000 7fbfb3400640 1 -- start start 2024-01-31T05:05:01.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfb3400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfac06c2d0 0x7fbfac14db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:01.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfb3400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfac071410 0x7fbfac154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:01.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfb3400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfac15a000 0x7fbfac154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:01.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfb3400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac15ae30 con 0x7fbfac06c2d0 2024-01-31T05:05:01.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfb3400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac163b30 con 0x7fbfac15a000 2024-01-31T05:05:01.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfb3400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac15b080 con 0x7fbfac071410 2024-01-31T05:05:01.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfb0a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfac06c2d0 0x7fbfac14db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:01.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfb0a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfac06c2d0 0x7fbfac14db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45624/0 (socket says 172.21.15.49:45624) 2024-01-31T05:05:01.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfb0a00640 1 -- 172.21.15.49:0/1270369523 learned_addr learned my addr 172.21.15.49:0/1270369523 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:01.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfb1400640 1 --2- 172.21.15.49:0/1270369523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfac15a000 0x7fbfac154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:01.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfabe00640 1 --2- 172.21.15.49:0/1270369523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfac071410 0x7fbfac154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:01.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfb0a00640 1 -- 172.21.15.49:0/1270369523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfac071410 msgr2=0x7fbfac154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:01.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfb0a00640 1 --2- 172.21.15.49:0/1270369523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfac071410 0x7fbfac154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:01.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfb0a00640 1 -- 172.21.15.49:0/1270369523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfac15a000 msgr2=0x7fbfac154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:01.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfb0a00640 1 --2- 172.21.15.49:0/1270369523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfac15a000 0x7fbfac154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:01.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfb0a00640 1 -- 172.21.15.49:0/1270369523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa4009b30 con 0x7fbfac06c2d0 2024-01-31T05:05:01.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfb0a00640 1 --2- 172.21.15.49:0/1270369523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfac06c2d0 0x7fbfac14db60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00e8a0 tx=0x7fbf9c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:01.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfa8c00640 1 -- 172.21.15.49:0/1270369523 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c009510 con 0x7fbfac06c2d0 2024-01-31T05:05:01.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfa8c00640 1 -- 172.21.15.49:0/1270369523 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c00c940 con 0x7fbfac06c2d0 2024-01-31T05:05:01.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfa8c00640 1 -- 172.21.15.49:0/1270369523 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c00ccb0 con 0x7fbfac06c2d0 2024-01-31T05:05:01.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfb3400640 1 -- 172.21.15.49:0/1270369523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfac15b360 con 0x7fbfac06c2d0 2024-01-31T05:05:01.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfb3400640 1 -- 172.21.15.49:0/1270369523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfac15b920 con 0x7fbfac06c2d0 2024-01-31T05:05:01.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.794+0000 7fbfb3400640 1 -- 172.21.15.49:0/1270369523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfac074860 con 0x7fbfac06c2d0 2024-01-31T05:05:01.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.798+0000 7fbfa8c00640 1 -- 172.21.15.49:0/1270369523 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fbf9c013470 con 0x7fbfac06c2d0 2024-01-31T05:05:01.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.798+0000 7fbfa8c00640 1 --2- 172.21.15.49:0/1270369523 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbf84066500 0x7fbf840689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:01.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.798+0000 7fbfa8c00640 1 -- 172.21.15.49:0/1270369523 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbf9c084250 con 0x7fbfac06c2d0 2024-01-31T05:05:01.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.798+0000 7fbfabe00640 1 --2- 172.21.15.49:0/1270369523 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbf84066500 0x7fbf840689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:01.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.798+0000 7fbfabe00640 1 --2- 172.21.15.49:0/1270369523 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbf84066500 0x7fbf840689c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbfac155670 tx=0x7fbf94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:01.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.802+0000 7fbfa8c00640 1 -- 172.21.15.49:0/1270369523 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fbf9c051270 con 0x7fbfac06c2d0 2024-01-31T05:05:01.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.962+0000 7fbfb3400640 1 -- 172.21.15.49:0/1270369523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfac15a910 con 0x7fbfac06c2d0 2024-01-31T05:05:01.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.966+0000 7fbfa8c00640 1 -- 172.21.15.49:0/1270369523 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7fbf9c054890 con 0x7fbfac06c2d0 2024-01-31T05:05:01.968 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:01.968 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:58.277568+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.966+0000 7fbfb3400640 1 -- 172.21.15.49:0/1270369523 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbf84066500 msgr2=0x7fbf840689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.966+0000 7fbfb3400640 1 --2- 172.21.15.49:0/1270369523 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbf84066500 0x7fbf840689c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbfac155670 tx=0x7fbf94008040 comp rx=0 tx=0).stop 2024-01-31T05:05:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.966+0000 7fbfb3400640 1 -- 172.21.15.49:0/1270369523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfac06c2d0 msgr2=0x7fbfac14db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:01.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.966+0000 7fbfb3400640 1 --2- 172.21.15.49:0/1270369523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfac06c2d0 0x7fbfac14db60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00e8a0 tx=0x7fbf9c00eca0 comp rx=0 tx=0).stop 2024-01-31T05:05:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.966+0000 7fbfb3400640 1 -- 172.21.15.49:0/1270369523 shutdown_connections 2024-01-31T05:05:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.966+0000 7fbfb3400640 1 --2- 172.21.15.49:0/1270369523 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbf84066500 0x7fbf840689c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.966+0000 7fbfb3400640 1 --2- 172.21.15.49:0/1270369523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfac15a000 0x7fbfac154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.966+0000 7fbfb3400640 1 --2- 172.21.15.49:0/1270369523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbfac071410 0x7fbfac154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.966+0000 7fbfb3400640 1 --2- 172.21.15.49:0/1270369523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfac06c2d0 0x7fbfac14db60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.966+0000 7fbfb3400640 1 -- 172.21.15.49:0/1270369523 >> 172.21.15.49:0/1270369523 conn(0x7fbfac0b09a0 msgr2=0x7fbfac0703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.966+0000 7fbfb3400640 1 -- 172.21.15.49:0/1270369523 shutdown_connections 2024-01-31T05:05:01.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:01.966+0000 7fbfb3400640 1 -- 172.21.15.49:0/1270369523 wait complete. 2024-01-31T05:05:01.990 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:04:14.566345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:04:15.231265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-31T05:04:18.316756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-31T05:05:01.990 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:05:02.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.130+0000 7f80ce200640 1 Processor -- start 2024-01-31T05:05:02.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.130+0000 7f80ce200640 1 -- start start 2024-01-31T05:05:02.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.134+0000 7f80ce200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f80c806c290 0x7f80c80cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.134+0000 7f80ce200640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c815d7e0 con 0x7f80c806ba90 2024-01-31T05:05:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.134+0000 7f80ce200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c80d0470 con 0x7f80c80cbf80 2024-01-31T05:05:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.134+0000 7f80ce200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c80d0190 con 0x7f80c806c290 2024-01-31T05:05:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.134+0000 7f80c6a00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f80c806ba90 0x7f80c806c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33546/0 (socket says 172.21.15.49:33546) 2024-01-31T05:05:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.134+0000 7f80c6a00640 1 -- 172.21.15.49:0/4068855072 learned_addr learned my addr 172.21.15.49:0/4068855072 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:02.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.134+0000 7f80c7400640 1 --2- 172.21.15.49:0/4068855072 >> v2:172.21.15.49:3300/0 conn(0x7f80c806c290 0x7f80c80cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:02.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.134+0000 7f80c6000640 1 -- 172.21.15.49:0/4068855072 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950851631 0 0) 0x7f80c815d7e0 con 0x7f80c806ba90 2024-01-31T05:05:02.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.134+0000 7f80c6000640 1 -- 172.21.15.49:0/4068855072 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80a8003530 con 0x7f80c806ba90 2024-01-31T05:05:02.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.134+0000 7f80c7400640 1 -- 172.21.15.49:0/4068855072 >> v1:172.21.15.195:6789/0 conn(0x7f80c80cbf80 legacy=0x7f80c80cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:02.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.134+0000 7f80c7400640 1 -- 172.21.15.49:0/4068855072 >> v1:172.21.15.49:6789/0 conn(0x7f80c806ba90 legacy=0x7f80c806c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:02.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.134+0000 7f80c6000640 1 -- 172.21.15.49:0/4068855072 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1355178357 0 0) 0x7f80a8003530 con 0x7f80c806ba90 2024-01-31T05:05:02.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.134+0000 7f80c7400640 1 -- 172.21.15.49:0/4068855072 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c80cb4a0 con 0x7f80c806c290 2024-01-31T05:05:02.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.138+0000 7f80c7400640 1 --2- 172.21.15.49:0/4068855072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80c806c290 0x7f80c80cfad0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f80b80097c0 tx=0x7f80b801c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be1b8a570be6b5e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:02.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.138+0000 7f80c6000640 1 -- 172.21.15.49:0/4068855072 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0001680 con 0x7f80c806c290 2024-01-31T05:05:02.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.138+0000 7f80c6000640 1 -- 172.21.15.49:0/4068855072 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b80a7050 con 0x7f80c806c290 2024-01-31T05:05:02.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.138+0000 7f80c6000640 1 -- 172.21.15.49:0/4068855072 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b80ab620 con 0x7f80c806c290 2024-01-31T05:05:02.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.138+0000 7f80ce200640 1 -- 172.21.15.49:0/4068855072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80c806c290 msgr2=0x7f80c80cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:02.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.138+0000 7f80ce200640 1 --2- 172.21.15.49:0/4068855072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80c806c290 0x7f80c80cfad0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f80b80097c0 tx=0x7f80b801c2a0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.138+0000 7f80ce200640 1 -- 172.21.15.49:0/4068855072 shutdown_connections 2024-01-31T05:05:02.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.138+0000 7f80ce200640 1 --2- 172.21.15.49:0/4068855072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80c806c290 0x7f80c80cfad0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.138+0000 7f80ce200640 1 -- 172.21.15.49:0/4068855072 >> 172.21.15.49:0/4068855072 conn(0x7f80c80b28e0 msgr2=0x7f80c80b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:02.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.138+0000 7f80ce200640 1 -- 172.21.15.49:0/4068855072 shutdown_connections 2024-01-31T05:05:02.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.138+0000 7f80ce200640 1 -- 172.21.15.49:0/4068855072 wait complete. 2024-01-31T05:05:02.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.138+0000 7f80ce200640 1 Processor -- start 2024-01-31T05:05:02.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.138+0000 7f80ce200640 1 -- start start 2024-01-31T05:05:02.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80ce200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80c806ba90 0x7f80c814c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:02.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80ce200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80c806c290 0x7f80c814dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:02.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80ce200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80c80cbf80 0x7f80c80c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:02.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80ce200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c814ce00 con 0x7f80c806ba90 2024-01-31T05:05:02.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80ce200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c814d0e0 con 0x7f80c80cbf80 2024-01-31T05:05:02.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80ce200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c814d3c0 con 0x7f80c806c290 2024-01-31T05:05:02.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80c7400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80c806ba90 0x7f80c814c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:02.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80c7400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80c806ba90 0x7f80c814c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45640/0 (socket says 172.21.15.49:45640) 2024-01-31T05:05:02.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80c7400640 1 -- 172.21.15.49:0/664378379 learned_addr learned my addr 172.21.15.49:0/664378379 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:02.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80c6a00640 1 --2- 172.21.15.49:0/664378379 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80c806c290 0x7f80c814dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:02.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80c7e00640 1 --2- 172.21.15.49:0/664378379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80c80cbf80 0x7f80c80c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:02.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80c7400640 1 -- 172.21.15.49:0/664378379 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80c806c290 msgr2=0x7f80c814dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:02.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80c7400640 1 --2- 172.21.15.49:0/664378379 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80c806c290 0x7f80c814dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80c7400640 1 -- 172.21.15.49:0/664378379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80c80cbf80 msgr2=0x7f80c80c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:02.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80c7400640 1 --2- 172.21.15.49:0/664378379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80c80cbf80 0x7f80c80c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80c7400640 1 -- 172.21.15.49:0/664378379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b8009420 con 0x7f80c806ba90 2024-01-31T05:05:02.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80c7400640 1 --2- 172.21.15.49:0/664378379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80c806ba90 0x7f80c814c0a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f80b80ae040 tx=0x7f80b801aae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:02.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80bf400640 1 -- 172.21.15.49:0/664378379 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b80b7450 con 0x7f80c806ba90 2024-01-31T05:05:02.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80bf400640 1 -- 172.21.15.49:0/664378379 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b80b75d0 con 0x7f80c806ba90 2024-01-31T05:05:02.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80bf400640 1 -- 172.21.15.49:0/664378379 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b80b7980 con 0x7f80c806ba90 2024-01-31T05:05:02.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80ce200640 1 -- 172.21.15.49:0/664378379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c814d6a0 con 0x7f80c806ba90 2024-01-31T05:05:02.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80ce200640 1 -- 172.21.15.49:0/664378379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c814e3e0 con 0x7f80c806ba90 2024-01-31T05:05:02.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.142+0000 7f80ce200640 1 -- 172.21.15.49:0/664378379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c8074860 con 0x7f80c806ba90 2024-01-31T05:05:02.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.146+0000 7f80bf400640 1 -- 172.21.15.49:0/664378379 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f80b80b7ae0 con 0x7f80c806ba90 2024-01-31T05:05:02.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.146+0000 7f80bf400640 1 --2- 172.21.15.49:0/664378379 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f80a0066500 0x7f80a00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:02.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.146+0000 7f80bf400640 1 -- 172.21.15.49:0/664378379 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f80b811ea20 con 0x7f80c806ba90 2024-01-31T05:05:02.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.146+0000 7f80c6a00640 1 --2- 172.21.15.49:0/664378379 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f80a0066500 0x7f80a00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:02.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.146+0000 7f80c6a00640 1 --2- 172.21.15.49:0/664378379 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f80a0066500 0x7f80a00689c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f80c81f95b0 tx=0x7f80b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:02.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.150+0000 7f80bf400640 1 -- 172.21.15.49:0/664378379 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f80b80eb980 con 0x7f80c806ba90 2024-01-31T05:05:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.310+0000 7f80ce200640 1 -- 172.21.15.49:0/664378379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80c806c070 con 0x7f80c806ba90 2024-01-31T05:05:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.310+0000 7f80bf400640 1 -- 172.21.15.49:0/664378379 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f80b80bb0a0 con 0x7f80c806ba90 2024-01-31T05:05:02.313 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:05:02.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.314+0000 7f80ce200640 1 -- 172.21.15.49:0/664378379 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f80a0066500 msgr2=0x7f80a00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:02.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.314+0000 7f80ce200640 1 --2- 172.21.15.49:0/664378379 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f80a0066500 0x7f80a00689c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f80c81f95b0 tx=0x7f80b0009040 comp rx=0 tx=0).stop 2024-01-31T05:05:02.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.314+0000 7f80ce200640 1 -- 172.21.15.49:0/664378379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80c806ba90 msgr2=0x7f80c814c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:02.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.314+0000 7f80ce200640 1 --2- 172.21.15.49:0/664378379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80c806ba90 0x7f80c814c0a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f80b80ae040 tx=0x7f80b801aae0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.314+0000 7f80ce200640 1 -- 172.21.15.49:0/664378379 shutdown_connections 2024-01-31T05:05:02.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.314+0000 7f80ce200640 1 --2- 172.21.15.49:0/664378379 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f80a0066500 0x7f80a00689c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.314+0000 7f80ce200640 1 --2- 172.21.15.49:0/664378379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80c80cbf80 0x7f80c80c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.314+0000 7f80ce200640 1 --2- 172.21.15.49:0/664378379 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80c806c290 0x7f80c814dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.314+0000 7f80ce200640 1 --2- 172.21.15.49:0/664378379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80c806ba90 0x7f80c814c0a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.314+0000 7f80ce200640 1 -- 172.21.15.49:0/664378379 >> 172.21.15.49:0/664378379 conn(0x7f80c80b28e0 msgr2=0x7f80c80cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:02.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.314+0000 7f80ce200640 1 -- 172.21.15.49:0/664378379 shutdown_connections 2024-01-31T05:05:02.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.314+0000 7f80ce200640 1 -- 172.21.15.49:0/664378379 wait complete. 2024-01-31T05:05:02.335 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:05:02.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.474+0000 7f383e000640 1 Processor -- start 2024-01-31T05:05:02.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.474+0000 7f383e000640 1 -- start start 2024-01-31T05:05:02.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.478+0000 7f383e000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f38380cde80 0x7f383815cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:02.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.478+0000 7f383e000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f38380cf0f0 0x7f383815d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:02.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.478+0000 7f383e000640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38380cf660 con 0x7f38380cd0c0 2024-01-31T05:05:02.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.478+0000 7f383e000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38380d02e0 con 0x7f38380cde80 2024-01-31T05:05:02.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.478+0000 7f383e000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38380cf940 con 0x7f38380cf0f0 2024-01-31T05:05:02.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.478+0000 7f3836a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f38380cde80 0x7f383815cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:02.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.478+0000 7f3836a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f38380cde80 0x7f383815cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45648/0 (socket says 172.21.15.49:45648) 2024-01-31T05:05:02.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.478+0000 7f3837400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f38380cd0c0 0x7f38380cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33550/0 (socket says 172.21.15.49:33550) 2024-01-31T05:05:02.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.478+0000 7f3836a00640 1 -- 172.21.15.49:0/3738611066 learned_addr learned my addr 172.21.15.49:0/3738611066 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:02.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.478+0000 7f3837e00640 1 --2- 172.21.15.49:0/3738611066 >> v2:172.21.15.195:3300/0 conn(0x7f38380cf0f0 0x7f383815d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:02.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.478+0000 7f3836a00640 1 -- 172.21.15.49:0/3738611066 >> v2:172.21.15.195:3300/0 conn(0x7f38380cf0f0 msgr2=0x7f383815d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:02.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.478+0000 7f3836a00640 1 --2- 172.21.15.49:0/3738611066 >> v2:172.21.15.195:3300/0 conn(0x7f38380cf0f0 0x7f383815d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.478+0000 7f3836a00640 1 -- 172.21.15.49:0/3738611066 >> v1:172.21.15.49:6789/0 conn(0x7f38380cd0c0 legacy=0x7f38380cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:02.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.478+0000 7f3836a00640 1 -- 172.21.15.49:0/3738611066 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38380cfc20 con 0x7f38380cde80 2024-01-31T05:05:02.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.478+0000 7f3837e00640 1 --2- 172.21.15.49:0/3738611066 >> v2:172.21.15.195:3300/0 conn(0x7f38380cf0f0 0x7f383815d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:02.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.478+0000 7f3836000640 1 -- 172.21.15.49:0/3738611066 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174012278 0 0) 0x7f38380cf660 con 0x7f38380cd0c0 2024-01-31T05:05:02.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.482+0000 7f3836a00640 1 --2- 172.21.15.49:0/3738611066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38380cde80 0x7f383815cb60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38380c49d0 tx=0x7f382001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0904ff762c8e9e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:02.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.482+0000 7f3836000640 1 -- 172.21.15.49:0/3738611066 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38200ac640 con 0x7f38380cde80 2024-01-31T05:05:02.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.482+0000 7f3836000640 1 -- 172.21.15.49:0/3738611066 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38200ac7a0 con 0x7f38380cde80 2024-01-31T05:05:02.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.482+0000 7f3836000640 1 -- 172.21.15.49:0/3738611066 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38200acb30 con 0x7f38380cde80 2024-01-31T05:05:02.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.482+0000 7f383e000640 1 -- 172.21.15.49:0/3738611066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38380cde80 msgr2=0x7f383815cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:02.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.482+0000 7f383e000640 1 --2- 172.21.15.49:0/3738611066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38380cde80 0x7f383815cb60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38380c49d0 tx=0x7f382001c440 comp rx=0 tx=0).stop 2024-01-31T05:05:02.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.482+0000 7f383e000640 1 -- 172.21.15.49:0/3738611066 shutdown_connections 2024-01-31T05:05:02.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.482+0000 7f383e000640 1 --2- 172.21.15.49:0/3738611066 >> v2:172.21.15.195:3300/0 conn(0x7f38380cf0f0 0x7f383815d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.482+0000 7f383e000640 1 --2- 172.21.15.49:0/3738611066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38380cde80 0x7f383815cb60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.482+0000 7f383e000640 1 -- 172.21.15.49:0/3738611066 >> 172.21.15.49:0/3738611066 conn(0x7f38380d0ef0 msgr2=0x7f38380d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:02.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.482+0000 7f383e000640 1 -- 172.21.15.49:0/3738611066 shutdown_connections 2024-01-31T05:05:02.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.482+0000 7f383e000640 1 -- 172.21.15.49:0/3738611066 wait complete. 2024-01-31T05:05:02.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f383e000640 1 Processor -- start 2024-01-31T05:05:02.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f383e000640 1 -- start start 2024-01-31T05:05:02.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f383e000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f38380cd0c0 0x7f3838160310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f383e000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f38380cde80 0x7f38380b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f383e000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38380cf0f0 0x7f38380b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f383e000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3838160850 con 0x7f38380cf0f0 2024-01-31T05:05:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f383e000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383815fe80 con 0x7f38380cd0c0 2024-01-31T05:05:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f383e000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38380b2cf0 con 0x7f38380cde80 2024-01-31T05:05:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f3837e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38380cf0f0 0x7f38380b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f3837e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38380cf0f0 0x7f38380b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45650/0 (socket says 172.21.15.49:45650) 2024-01-31T05:05:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f3837e00640 1 -- 172.21.15.49:0/2189537333 learned_addr learned my addr 172.21.15.49:0/2189537333 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f3837400640 1 --2- 172.21.15.49:0/2189537333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f38380cd0c0 0x7f3838160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f3836a00640 1 --2- 172.21.15.49:0/2189537333 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f38380cde80 0x7f38380b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f3837e00640 1 -- 172.21.15.49:0/2189537333 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f38380cde80 msgr2=0x7f38380b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f3837e00640 1 --2- 172.21.15.49:0/2189537333 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f38380cde80 0x7f38380b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f3837e00640 1 -- 172.21.15.49:0/2189537333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f38380cd0c0 msgr2=0x7f3838160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:02.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f3837e00640 1 --2- 172.21.15.49:0/2189537333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f38380cd0c0 0x7f3838160310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f3837e00640 1 -- 172.21.15.49:0/2189537333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38200094d0 con 0x7f38380cf0f0 2024-01-31T05:05:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f3836a00640 1 --2- 172.21.15.49:0/2189537333 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f38380cde80 0x7f38380b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f3837400640 1 --2- 172.21.15.49:0/2189537333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f38380cd0c0 0x7f3838160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f3837e00640 1 --2- 172.21.15.49:0/2189537333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38380cf0f0 0x7f38380b4e90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3830007df0 tx=0x7f383000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f382f400640 1 -- 172.21.15.49:0/2189537333 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38300039a0 con 0x7f38380cf0f0 2024-01-31T05:05:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f382f400640 1 -- 172.21.15.49:0/2189537333 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383000f040 con 0x7f38380cf0f0 2024-01-31T05:05:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f382f400640 1 -- 172.21.15.49:0/2189537333 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3830003d40 con 0x7f38380cf0f0 2024-01-31T05:05:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f383e000640 1 -- 172.21.15.49:0/2189537333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383815f590 con 0x7f38380cf0f0 2024-01-31T05:05:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f383e000640 1 -- 172.21.15.49:0/2189537333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383815f830 con 0x7f38380cf0f0 2024-01-31T05:05:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.486+0000 7f383e000640 1 -- 172.21.15.49:0/2189537333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3838074860 con 0x7f38380cf0f0 2024-01-31T05:05:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.490+0000 7f382f400640 1 -- 172.21.15.49:0/2189537333 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f3830004030 con 0x7f38380cf0f0 2024-01-31T05:05:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.490+0000 7f382f400640 1 --2- 172.21.15.49:0/2189537333 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3810066500 0x7f38100689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.490+0000 7f382f400640 1 -- 172.21.15.49:0/2189537333 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3830084560 con 0x7f38380cf0f0 2024-01-31T05:05:02.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.490+0000 7f3837400640 1 --2- 172.21.15.49:0/2189537333 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3810066500 0x7f38100689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:02.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.490+0000 7f3837400640 1 --2- 172.21.15.49:0/2189537333 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3810066500 0x7f38100689c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3828000f70 tx=0x7f3828007c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:02.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.494+0000 7f382f400640 1 -- 172.21.15.49:0/2189537333 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f3830051430 con 0x7f38380cf0f0 2024-01-31T05:05:02.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.650+0000 7f383e000640 1 -- 172.21.15.49:0/2189537333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f383806b4e0 con 0x7f38380cf0f0 2024-01-31T05:05:02.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.654+0000 7f382f400640 1 -- 172.21.15.49:0/2189537333 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3830054a50 con 0x7f38380cf0f0 2024-01-31T05:05:02.656 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:02.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.654+0000 7f383e000640 1 -- 172.21.15.49:0/2189537333 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3810066500 msgr2=0x7f38100689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:02.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.654+0000 7f383e000640 1 --2- 172.21.15.49:0/2189537333 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3810066500 0x7f38100689c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3828000f70 tx=0x7f3828007c40 comp rx=0 tx=0).stop 2024-01-31T05:05:02.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.654+0000 7f383e000640 1 -- 172.21.15.49:0/2189537333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38380cf0f0 msgr2=0x7f38380b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:02.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.654+0000 7f383e000640 1 --2- 172.21.15.49:0/2189537333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38380cf0f0 0x7f38380b4e90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3830007df0 tx=0x7f383000d4a0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.654+0000 7f383e000640 1 -- 172.21.15.49:0/2189537333 shutdown_connections 2024-01-31T05:05:02.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.654+0000 7f383e000640 1 --2- 172.21.15.49:0/2189537333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38380cf0f0 0x7f38380b4e90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.654+0000 7f383e000640 1 --2- 172.21.15.49:0/2189537333 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f38380cde80 0x7f38380b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.654+0000 7f383e000640 1 --2- 172.21.15.49:0/2189537333 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3810066500 0x7f38100689c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.654+0000 7f383e000640 1 --2- 172.21.15.49:0/2189537333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f38380cd0c0 0x7f3838160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.654+0000 7f383e000640 1 -- 172.21.15.49:0/2189537333 >> 172.21.15.49:0/2189537333 conn(0x7f38380d0ef0 msgr2=0x7f3838159420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:02.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.654+0000 7f383e000640 1 -- 172.21.15.49:0/2189537333 shutdown_connections 2024-01-31T05:05:02.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.654+0000 7f383e000640 1 -- 172.21.15.49:0/2189537333 wait complete. 2024-01-31T05:05:02.677 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:05:02.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.818+0000 7fdf3e800640 1 Processor -- start 2024-01-31T05:05:02.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.818+0000 7fdf3e800640 1 -- start start 2024-01-31T05:05:02.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.818+0000 7fdf3e800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdf380cd6e0 0x7fdf380cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:02.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.818+0000 7fdf3e800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdf3806e5f0 0x7fdf380cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:02.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.818+0000 7fdf3e800640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf3806c1b0 con 0x7fdf3806c640 2024-01-31T05:05:02.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.818+0000 7fdf3e800640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3806d890 con 0x7fdf3806e5f0 2024-01-31T05:05:02.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.818+0000 7fdf3e800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3806f4e0 con 0x7fdf380cd6e0 2024-01-31T05:05:02.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.818+0000 7fdf36a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fdf3806e5f0 0x7fdf380cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:02.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.818+0000 7fdf37e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fdf3806c640 0x7fdf3806cad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33554/0 (socket says 172.21.15.49:33554) 2024-01-31T05:05:02.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.818+0000 7fdf37e00640 1 -- 172.21.15.49:0/2208695057 learned_addr learned my addr 172.21.15.49:0/2208695057 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:02.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.818+0000 7fdf37400640 1 --2- 172.21.15.49:0/2208695057 >> v2:172.21.15.195:3300/0 conn(0x7fdf380cd6e0 0x7fdf380cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:02.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.818+0000 7fdf36a00640 1 -- 172.21.15.49:0/2208695057 >> v2:172.21.15.195:3300/0 conn(0x7fdf380cd6e0 msgr2=0x7fdf380cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:02.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.818+0000 7fdf36a00640 1 --2- 172.21.15.49:0/2208695057 >> v2:172.21.15.195:3300/0 conn(0x7fdf380cd6e0 0x7fdf380cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.818+0000 7fdf36a00640 1 -- 172.21.15.49:0/2208695057 >> v1:172.21.15.49:6789/0 conn(0x7fdf3806c640 legacy=0x7fdf3806cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:02.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.818+0000 7fdf36a00640 1 -- 172.21.15.49:0/2208695057 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf380ce000 con 0x7fdf3806e5f0 2024-01-31T05:05:02.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.818+0000 7fdf36000640 1 -- 172.21.15.49:0/2208695057 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4179092110 0 0) 0x7fdf3806c1b0 con 0x7fdf3806c640 2024-01-31T05:05:02.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.818+0000 7fdf37400640 1 --2- 172.21.15.49:0/2208695057 >> v2:172.21.15.195:3300/0 conn(0x7fdf380cd6e0 0x7fdf380cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:02.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.822+0000 7fdf36a00640 1 --2- 172.21.15.49:0/2208695057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3806e5f0 0x7fdf380cdac0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdf200097c0 tx=0x7fdf2001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921efbda17d7bc71 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:02.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.822+0000 7fdf36000640 1 -- 172.21.15.49:0/2208695057 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf200a8930 con 0x7fdf3806e5f0 2024-01-31T05:05:02.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.822+0000 7fdf36000640 1 -- 172.21.15.49:0/2208695057 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf200a8a90 con 0x7fdf3806e5f0 2024-01-31T05:05:02.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.822+0000 7fdf36000640 1 -- 172.21.15.49:0/2208695057 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf200a8e20 con 0x7fdf3806e5f0 2024-01-31T05:05:02.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.822+0000 7fdf3e800640 1 -- 172.21.15.49:0/2208695057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3806e5f0 msgr2=0x7fdf380cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:02.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.822+0000 7fdf3e800640 1 --2- 172.21.15.49:0/2208695057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3806e5f0 0x7fdf380cdac0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdf200097c0 tx=0x7fdf2001ec30 comp rx=0 tx=0).stop 2024-01-31T05:05:02.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.822+0000 7fdf3e800640 1 -- 172.21.15.49:0/2208695057 shutdown_connections 2024-01-31T05:05:02.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.822+0000 7fdf3e800640 1 --2- 172.21.15.49:0/2208695057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3806e5f0 0x7fdf380cdac0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.822+0000 7fdf3e800640 1 --2- 172.21.15.49:0/2208695057 >> v2:172.21.15.195:3300/0 conn(0x7fdf380cd6e0 0x7fdf380cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.822+0000 7fdf3e800640 1 -- 172.21.15.49:0/2208695057 >> 172.21.15.49:0/2208695057 conn(0x7fdf380d0e60 msgr2=0x7fdf380d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:02.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.822+0000 7fdf3e800640 1 -- 172.21.15.49:0/2208695057 shutdown_connections 2024-01-31T05:05:02.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf3e800640 1 -- 172.21.15.49:0/2208695057 wait complete. 2024-01-31T05:05:02.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf3e800640 1 Processor -- start 2024-01-31T05:05:02.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf3e800640 1 -- start start 2024-01-31T05:05:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf3e800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf3806c640 0x7fdf380ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf3e800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3806e5f0 0x7fdf380ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf3e800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf380cd6e0 0x7fdf381f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf3e800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3814f100 con 0x7fdf3806e5f0 2024-01-31T05:05:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf3e800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf38150a00 con 0x7fdf3806c640 2024-01-31T05:05:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf3e800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3809ea10 con 0x7fdf380cd6e0 2024-01-31T05:05:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf36a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3806e5f0 0x7fdf380ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf36a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3806e5f0 0x7fdf380ca640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45674/0 (socket says 172.21.15.49:45674) 2024-01-31T05:05:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf36a00640 1 -- 172.21.15.49:0/967652815 learned_addr learned my addr 172.21.15.49:0/967652815 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf37400640 1 --2- 172.21.15.49:0/967652815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf3806c640 0x7fdf380ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf37e00640 1 --2- 172.21.15.49:0/967652815 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf380cd6e0 0x7fdf381f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf36a00640 1 -- 172.21.15.49:0/967652815 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf380cd6e0 msgr2=0x7fdf381f1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf36a00640 1 --2- 172.21.15.49:0/967652815 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf380cd6e0 0x7fdf381f1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf36a00640 1 -- 172.21.15.49:0/967652815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf3806c640 msgr2=0x7fdf380ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:02.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf36a00640 1 --2- 172.21.15.49:0/967652815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf3806c640 0x7fdf380ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:02.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf36a00640 1 -- 172.21.15.49:0/967652815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf20009420 con 0x7fdf3806e5f0 2024-01-31T05:05:02.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf36a00640 1 --2- 172.21.15.49:0/967652815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3806e5f0 0x7fdf380ca640 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdf2001b840 tx=0x7fdf2001b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.826+0000 7fdf2f400640 1 -- 172.21.15.49:0/967652815 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf200b9630 con 0x7fdf3806e5f0 2024-01-31T05:05:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.830+0000 7fdf2f400640 1 -- 172.21.15.49:0/967652815 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf200b97b0 con 0x7fdf3806e5f0 2024-01-31T05:05:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.830+0000 7fdf3e800640 1 -- 172.21.15.49:0/967652815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf3814e860 con 0x7fdf3806e5f0 2024-01-31T05:05:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.830+0000 7fdf2f400640 1 -- 172.21.15.49:0/967652815 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf200b9b60 con 0x7fdf3806e5f0 2024-01-31T05:05:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.830+0000 7fdf3e800640 1 -- 172.21.15.49:0/967652815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3814ee20 con 0x7fdf3806e5f0 2024-01-31T05:05:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.830+0000 7fdf3e800640 1 -- 172.21.15.49:0/967652815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf38074860 con 0x7fdf3806e5f0 2024-01-31T05:05:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.830+0000 7fdf2f400640 1 -- 172.21.15.49:0/967652815 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fdf200b7040 con 0x7fdf3806e5f0 2024-01-31T05:05:02.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.830+0000 7fdf2f400640 1 --2- 172.21.15.49:0/967652815 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdf10066500 0x7fdf100689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:02.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.830+0000 7fdf2f400640 1 -- 172.21.15.49:0/967652815 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdf20122280 con 0x7fdf3806e5f0 2024-01-31T05:05:02.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.830+0000 7fdf37400640 1 --2- 172.21.15.49:0/967652815 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdf10066500 0x7fdf100689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:02.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.834+0000 7fdf37400640 1 --2- 172.21.15.49:0/967652815 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdf10066500 0x7fdf100689c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdf28006fd0 tx=0x7fdf28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:02.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.834+0000 7fdf2f400640 1 -- 172.21.15.49:0/967652815 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fdf200ef290 con 0x7fdf3806e5f0 2024-01-31T05:05:02.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.994+0000 7fdf3e800640 1 -- 172.21.15.49:0/967652815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdf38150760 con 0x7fdf3806e5f0 2024-01-31T05:05:02.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.994+0000 7fdf2f400640 1 -- 172.21.15.49:0/967652815 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdf200f28b0 con 0x7fdf3806e5f0 2024-01-31T05:05:02.998 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-31T05:05:03.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.998+0000 7fdf3e800640 1 -- 172.21.15.49:0/967652815 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdf10066500 msgr2=0x7fdf100689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.998+0000 7fdf3e800640 1 --2- 172.21.15.49:0/967652815 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdf10066500 0x7fdf100689c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdf28006fd0 tx=0x7fdf28008040 comp rx=0 tx=0).stop 2024-01-31T05:05:03.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.998+0000 7fdf3e800640 1 -- 172.21.15.49:0/967652815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3806e5f0 msgr2=0x7fdf380ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.998+0000 7fdf3e800640 1 --2- 172.21.15.49:0/967652815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3806e5f0 0x7fdf380ca640 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdf2001b840 tx=0x7fdf2001b9d0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.998+0000 7fdf3e800640 1 -- 172.21.15.49:0/967652815 shutdown_connections 2024-01-31T05:05:03.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.998+0000 7fdf3e800640 1 --2- 172.21.15.49:0/967652815 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdf380cd6e0 0x7fdf381f1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.998+0000 7fdf3e800640 1 --2- 172.21.15.49:0/967652815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf3806e5f0 0x7fdf380ca640 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.998+0000 7fdf3e800640 1 --2- 172.21.15.49:0/967652815 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdf10066500 0x7fdf100689c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.998+0000 7fdf3e800640 1 --2- 172.21.15.49:0/967652815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf3806c640 0x7fdf380ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.998+0000 7fdf3e800640 1 -- 172.21.15.49:0/967652815 >> 172.21.15.49:0/967652815 conn(0x7fdf380d0e60 msgr2=0x7fdf380ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:03.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.998+0000 7fdf3e800640 1 -- 172.21.15.49:0/967652815 shutdown_connections 2024-01-31T05:05:03.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:02.998+0000 7fdf3e800640 1 -- 172.21.15.49:0/967652815 wait complete. 2024-01-31T05:05:03.020 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-31T05:05:03.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.162+0000 7f35a8600640 1 Processor -- start 2024-01-31T05:05:03.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.162+0000 7f35a8600640 1 -- start start 2024-01-31T05:05:03.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.162+0000 7f35a8600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35a00cf800 0x7f35a00ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:03.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.162+0000 7f35a8600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f35a00d1a10 0x7f35a00ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:03.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.162+0000 7f35a8600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a00d1e60 con 0x7f35a015b4b0 2024-01-31T05:05:03.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.162+0000 7f35a8600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a015c560 con 0x7f35a00d1a10 2024-01-31T05:05:03.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.162+0000 7f35a8600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00cd8f0 con 0x7f35a00cf800 2024-01-31T05:05:03.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.162+0000 7f35a6600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f35a00d1a10 0x7f35a00ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:03.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.162+0000 7f35a5200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35a00cf800 0x7f35a00ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:03.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.162+0000 7f35a5c00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f35a015b4b0 0x7f35a00cf0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:46328/0 (socket says 172.21.15.49:46328) 2024-01-31T05:05:03.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.162+0000 7f35a5c00640 1 -- 172.21.15.49:0/3717164596 learned_addr learned my addr 172.21.15.49:0/3717164596 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:03.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.162+0000 7f35a6600640 1 -- 172.21.15.49:0/3717164596 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35a00cf800 msgr2=0x7f35a00ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:03.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.162+0000 7f35a6600640 1 --2- 172.21.15.49:0/3717164596 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35a00cf800 0x7f35a00ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.162+0000 7f35a6600640 1 -- 172.21.15.49:0/3717164596 >> v1:172.21.15.195:6789/0 conn(0x7f35a015b4b0 legacy=0x7f35a00cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.162+0000 7f35a6600640 1 -- 172.21.15.49:0/3717164596 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a00cdbd0 con 0x7f35a00d1a10 2024-01-31T05:05:03.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.166+0000 7f35a6600640 1 --2- 172.21.15.49:0/3717164596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35a00d1a10 0x7f35a00ce3d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3598009d90 tx=0x7f359801f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1efc4bf90fcf040f server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:03.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.166+0000 7f359fe00640 1 -- 172.21.15.49:0/3717164596 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35980af600 con 0x7f35a00d1a10 2024-01-31T05:05:03.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.166+0000 7f359fe00640 1 -- 172.21.15.49:0/3717164596 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35980ab050 con 0x7f35a00d1a10 2024-01-31T05:05:03.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.166+0000 7f359fe00640 1 -- 172.21.15.49:0/3717164596 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35980af980 con 0x7f35a00d1a10 2024-01-31T05:05:03.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.166+0000 7f35a8600640 1 -- 172.21.15.49:0/3717164596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35a00d1a10 msgr2=0x7f35a00ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.166+0000 7f35a8600640 1 --2- 172.21.15.49:0/3717164596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35a00d1a10 0x7f35a00ce3d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3598009d90 tx=0x7f359801f130 comp rx=0 tx=0).stop 2024-01-31T05:05:03.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.166+0000 7f35a8600640 1 -- 172.21.15.49:0/3717164596 shutdown_connections 2024-01-31T05:05:03.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.166+0000 7f35a8600640 1 --2- 172.21.15.49:0/3717164596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35a00d1a10 0x7f35a00ce3d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.166+0000 7f35a8600640 1 --2- 172.21.15.49:0/3717164596 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35a00cf800 0x7f35a00ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.166+0000 7f35a8600640 1 -- 172.21.15.49:0/3717164596 >> 172.21.15.49:0/3717164596 conn(0x7f35a00d0ef0 msgr2=0x7f35a00d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:03.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.166+0000 7f35a8600640 1 -- 172.21.15.49:0/3717164596 shutdown_connections 2024-01-31T05:05:03.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.166+0000 7f35a8600640 1 -- 172.21.15.49:0/3717164596 wait complete. 2024-01-31T05:05:03.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a8600640 1 Processor -- start 2024-01-31T05:05:03.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a8600640 1 -- start start 2024-01-31T05:05:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a8600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35a00cf800 0x7f35a014b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a8600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a00d1a10 0x7f35a015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a8600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35a015b4b0 0x7f35a015f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a8600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00b4e70 con 0x7f35a00d1a10 2024-01-31T05:05:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a8600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00b47d0 con 0x7f35a00cf800 2024-01-31T05:05:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a8600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a015f8b0 con 0x7f35a015b4b0 2024-01-31T05:05:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a5200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a00d1a10 0x7f35a015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a5200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a00d1a10 0x7f35a015ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45676/0 (socket says 172.21.15.49:45676) 2024-01-31T05:05:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a5200640 1 -- 172.21.15.49:0/1886501448 learned_addr learned my addr 172.21.15.49:0/1886501448 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a5c00640 1 --2- 172.21.15.49:0/1886501448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35a00cf800 0x7f35a014b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a6600640 1 --2- 172.21.15.49:0/1886501448 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35a015b4b0 0x7f35a015f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a5200640 1 -- 172.21.15.49:0/1886501448 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35a015b4b0 msgr2=0x7f35a015f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a5200640 1 --2- 172.21.15.49:0/1886501448 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35a015b4b0 0x7f35a015f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a5200640 1 -- 172.21.15.49:0/1886501448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35a00cf800 msgr2=0x7f35a014b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a5200640 1 --2- 172.21.15.49:0/1886501448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35a00cf800 0x7f35a014b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a5200640 1 -- 172.21.15.49:0/1886501448 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3598009a70 con 0x7f35a00d1a10 2024-01-31T05:05:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a5c00640 1 --2- 172.21.15.49:0/1886501448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35a00cf800 0x7f35a014b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a5200640 1 --2- 172.21.15.49:0/1886501448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a00d1a10 0x7f35a015ecf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f358800e900 tx=0x7f358800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:03.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f359d600640 1 -- 172.21.15.49:0/1886501448 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3588009690 con 0x7f35a00d1a10 2024-01-31T05:05:03.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f359d600640 1 -- 172.21.15.49:0/1886501448 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358800ca00 con 0x7f35a00d1a10 2024-01-31T05:05:03.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f359d600640 1 -- 172.21.15.49:0/1886501448 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358800cdb0 con 0x7f35a00d1a10 2024-01-31T05:05:03.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a8600640 1 -- 172.21.15.49:0/1886501448 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a015fb90 con 0x7f35a00d1a10 2024-01-31T05:05:03.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.170+0000 7f35a8600640 1 -- 172.21.15.49:0/1886501448 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a0156940 con 0x7f35a00d1a10 2024-01-31T05:05:03.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.174+0000 7f35a8600640 1 -- 172.21.15.49:0/1886501448 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a00b50e0 con 0x7f35a00d1a10 2024-01-31T05:05:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.174+0000 7f359d600640 1 -- 172.21.15.49:0/1886501448 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f3588013470 con 0x7f35a00d1a10 2024-01-31T05:05:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.174+0000 7f359d600640 1 --2- 172.21.15.49:0/1886501448 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3578066500 0x7f35780689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.174+0000 7f359d600640 1 -- 172.21.15.49:0/1886501448 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3588084330 con 0x7f35a00d1a10 2024-01-31T05:05:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.174+0000 7f35a5c00640 1 --2- 172.21.15.49:0/1886501448 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3578066500 0x7f35780689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.174+0000 7f35a5c00640 1 --2- 172.21.15.49:0/1886501448 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3578066500 0x7f35780689c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3590000f70 tx=0x7f3590007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:03.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.178+0000 7f359d600640 1 -- 172.21.15.49:0/1886501448 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f3588051350 con 0x7f35a00d1a10 2024-01-31T05:05:03.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.338+0000 7f35a8600640 1 -- 172.21.15.49:0/1886501448 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f35a0067c80 con 0x7f35a00d1a10 2024-01-31T05:05:03.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.338+0000 7f359d600640 1 -- 172.21.15.49:0/1886501448 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3588054970 con 0x7f35a00d1a10 2024-01-31T05:05:03.340 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:03.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.338+0000 7f35a8600640 1 -- 172.21.15.49:0/1886501448 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3578066500 msgr2=0x7f35780689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.338+0000 7f35a8600640 1 --2- 172.21.15.49:0/1886501448 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3578066500 0x7f35780689c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3590000f70 tx=0x7f3590007e90 comp rx=0 tx=0).stop 2024-01-31T05:05:03.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.338+0000 7f35a8600640 1 -- 172.21.15.49:0/1886501448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a00d1a10 msgr2=0x7f35a015ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.338+0000 7f35a8600640 1 --2- 172.21.15.49:0/1886501448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a00d1a10 0x7f35a015ecf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f358800e900 tx=0x7f358800edc0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.338+0000 7f35a8600640 1 -- 172.21.15.49:0/1886501448 shutdown_connections 2024-01-31T05:05:03.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.338+0000 7f35a8600640 1 --2- 172.21.15.49:0/1886501448 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f35a015b4b0 0x7f35a015f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.338+0000 7f35a8600640 1 --2- 172.21.15.49:0/1886501448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35a00d1a10 0x7f35a015ecf0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.338+0000 7f35a8600640 1 --2- 172.21.15.49:0/1886501448 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3578066500 0x7f35780689c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.338+0000 7f35a8600640 1 --2- 172.21.15.49:0/1886501448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35a00cf800 0x7f35a014b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.338+0000 7f35a8600640 1 -- 172.21.15.49:0/1886501448 >> 172.21.15.49:0/1886501448 conn(0x7f35a00d0ef0 msgr2=0x7f35a00b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:03.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.338+0000 7f35a8600640 1 -- 172.21.15.49:0/1886501448 shutdown_connections 2024-01-31T05:05:03.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.338+0000 7f35a8600640 1 -- 172.21.15.49:0/1886501448 wait complete. 2024-01-31T05:05:03.363 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:03.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.502+0000 7f41b2e00640 1 Processor -- start 2024-01-31T05:05:03.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.502+0000 7f41b2e00640 1 -- start start 2024-01-31T05:05:03.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.502+0000 7f41b2e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f41ac0cd680 0x7f41ac0cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:03.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.502+0000 7f41b2e00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ac0ccd50 con 0x7f41ac0ae4d0 2024-01-31T05:05:03.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.502+0000 7f41b2e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ac0cc790 con 0x7f41ac15b3e0 2024-01-31T05:05:03.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.502+0000 7f41b2e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ac0cca70 con 0x7f41ac0cd680 2024-01-31T05:05:03.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.502+0000 7f41b0e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f41ac0ae4d0 0x7f41ac0ae8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33560/0 (socket says 172.21.15.49:33560) 2024-01-31T05:05:03.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.502+0000 7f41b0e00640 1 -- 172.21.15.49:0/2840898609 learned_addr learned my addr 172.21.15.49:0/2840898609 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:03.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.502+0000 7f41abe00640 1 --2- 172.21.15.49:0/2840898609 >> v2:172.21.15.195:3300/0 conn(0x7f41ac0cd680 0x7f41ac0cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:03.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.502+0000 7f41aaa00640 1 -- 172.21.15.49:0/2840898609 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264883603 0 0) 0x7f41ac0ccd50 con 0x7f41ac0ae4d0 2024-01-31T05:05:03.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.502+0000 7f41aaa00640 1 -- 172.21.15.49:0/2840898609 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f418c003530 con 0x7f41ac0ae4d0 2024-01-31T05:05:03.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.502+0000 7f41aaa00640 1 -- 172.21.15.49:0/2840898609 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3861773277 0 0) 0x7f41ac0cc790 con 0x7f41ac15b3e0 2024-01-31T05:05:03.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.502+0000 7f41aaa00640 1 -- 172.21.15.49:0/2840898609 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41ac0ccd50 con 0x7f41ac15b3e0 2024-01-31T05:05:03.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.502+0000 7f41abe00640 1 -- 172.21.15.49:0/2840898609 >> v1:172.21.15.195:6789/0 conn(0x7f41ac15b3e0 legacy=0x7f41ac0cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.502+0000 7f41aaa00640 1 -- 172.21.15.49:0/2840898609 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1834837475 0 0) 0x7f418c003530 con 0x7f41ac0ae4d0 2024-01-31T05:05:03.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.502+0000 7f41abe00640 1 -- 172.21.15.49:0/2840898609 >> v1:172.21.15.49:6789/0 conn(0x7f41ac0ae4d0 legacy=0x7f41ac0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.502+0000 7f41abe00640 1 -- 172.21.15.49:0/2840898609 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac0adcd0 con 0x7f41ac0cd680 2024-01-31T05:05:03.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.506+0000 7f41abe00640 1 --2- 172.21.15.49:0/2840898609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41ac0cd680 0x7f41ac0cda60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f419c0097c0 tx=0x7f419c01c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae4e7e9d0d7db05e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:03.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.506+0000 7f41aaa00640 1 -- 172.21.15.49:0/2840898609 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a4001a00 con 0x7f41ac0cd680 2024-01-31T05:05:03.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.506+0000 7f41aaa00640 1 -- 172.21.15.49:0/2840898609 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c0a7050 con 0x7f41ac0cd680 2024-01-31T05:05:03.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.506+0000 7f41aaa00640 1 -- 172.21.15.49:0/2840898609 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c0ab620 con 0x7f41ac0cd680 2024-01-31T05:05:03.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.506+0000 7f41b2e00640 1 -- 172.21.15.49:0/2840898609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41ac0cd680 msgr2=0x7f41ac0cda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.506+0000 7f41b2e00640 1 --2- 172.21.15.49:0/2840898609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41ac0cd680 0x7f41ac0cda60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f419c0097c0 tx=0x7f419c01c2e0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b2e00640 1 -- 172.21.15.49:0/2840898609 shutdown_connections 2024-01-31T05:05:03.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b2e00640 1 --2- 172.21.15.49:0/2840898609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41ac0cd680 0x7f41ac0cda60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b2e00640 1 -- 172.21.15.49:0/2840898609 >> 172.21.15.49:0/2840898609 conn(0x7f41ac0b28e0 msgr2=0x7f41ac0b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:03.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b2e00640 1 -- 172.21.15.49:0/2840898609 shutdown_connections 2024-01-31T05:05:03.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b2e00640 1 -- 172.21.15.49:0/2840898609 wait complete. 2024-01-31T05:05:03.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b2e00640 1 Processor -- start 2024-01-31T05:05:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b2e00640 1 -- start start 2024-01-31T05:05:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b2e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41ac0ae4d0 0x7f41ac0b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b2e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41ac0cd680 0x7f41ac0c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b2e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41ac15b3e0 0x7f41ac0c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b2e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac0c67f0 con 0x7f41ac15b3e0 2024-01-31T05:05:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b2e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac0c6a90 con 0x7f41ac0ae4d0 2024-01-31T05:05:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b2e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac0c6d30 con 0x7f41ac0cd680 2024-01-31T05:05:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b0e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41ac15b3e0 0x7f41ac0c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b0e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41ac15b3e0 0x7f41ac0c48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45688/0 (socket says 172.21.15.49:45688) 2024-01-31T05:05:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b0e00640 1 -- 172.21.15.49:0/999026963 learned_addr learned my addr 172.21.15.49:0/999026963 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b0e00640 1 -- 172.21.15.49:0/999026963 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41ac0cd680 msgr2=0x7f41ac0c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b0e00640 1 --2- 172.21.15.49:0/999026963 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41ac0cd680 0x7f41ac0c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b0e00640 1 -- 172.21.15.49:0/999026963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41ac0ae4d0 msgr2=0x7f41ac0b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b0e00640 1 --2- 172.21.15.49:0/999026963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41ac0ae4d0 0x7f41ac0b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b0e00640 1 -- 172.21.15.49:0/999026963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c009420 con 0x7f41ac15b3e0 2024-01-31T05:05:03.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.510+0000 7f41b0e00640 1 --2- 172.21.15.49:0/999026963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41ac15b3e0 0x7f41ac0c48e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f41a400cc40 tx=0x7f41a400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:03.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.514+0000 7f41a3e00640 1 -- 172.21.15.49:0/999026963 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a400ce50 con 0x7f41ac15b3e0 2024-01-31T05:05:03.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.514+0000 7f41a3e00640 1 -- 172.21.15.49:0/999026963 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a4012400 con 0x7f41ac15b3e0 2024-01-31T05:05:03.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.514+0000 7f41b2e00640 1 -- 172.21.15.49:0/999026963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ac0c7010 con 0x7f41ac15b3e0 2024-01-31T05:05:03.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.514+0000 7f41a3e00640 1 -- 172.21.15.49:0/999026963 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a40127f0 con 0x7f41ac15b3e0 2024-01-31T05:05:03.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.514+0000 7f41b2e00640 1 -- 172.21.15.49:0/999026963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ac0c75d0 con 0x7f41ac15b3e0 2024-01-31T05:05:03.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.514+0000 7f41b2e00640 1 -- 172.21.15.49:0/999026963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ac074860 con 0x7f41ac15b3e0 2024-01-31T05:05:03.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.514+0000 7f41a3e00640 1 -- 172.21.15.49:0/999026963 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f41a4012950 con 0x7f41ac15b3e0 2024-01-31T05:05:03.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.514+0000 7f41a3e00640 1 --2- 172.21.15.49:0/999026963 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4184066530 0x7f41840689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:03.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.514+0000 7f41a3e00640 1 -- 172.21.15.49:0/999026963 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f41a4084a40 con 0x7f41ac15b3e0 2024-01-31T05:05:03.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.518+0000 7f41abe00640 1 --2- 172.21.15.49:0/999026963 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4184066530 0x7f41840689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:03.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.518+0000 7f41abe00640 1 --2- 172.21.15.49:0/999026963 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4184066530 0x7f41840689f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f419c0ad000 tx=0x7f419c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:03.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.522+0000 7f41a3e00640 1 -- 172.21.15.49:0/999026963 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f41a4051880 con 0x7f41ac15b3e0 2024-01-31T05:05:03.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.678+0000 7f41b2e00640 1 -- 172.21.15.49:0/999026963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41ac06fb40 con 0x7f41ac15b3e0 2024-01-31T05:05:03.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.682+0000 7f41a3e00640 1 -- 172.21.15.49:0/999026963 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7f41a4054ea0 con 0x7f41ac15b3e0 2024-01-31T05:05:03.684 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:03.684 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:58.277568+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:03.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.682+0000 7f41b2e00640 1 -- 172.21.15.49:0/999026963 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4184066530 msgr2=0x7f41840689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.682+0000 7f41b2e00640 1 --2- 172.21.15.49:0/999026963 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4184066530 0x7f41840689f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f419c0ad000 tx=0x7f419c008040 comp rx=0 tx=0).stop 2024-01-31T05:05:03.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.682+0000 7f41b2e00640 1 -- 172.21.15.49:0/999026963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41ac15b3e0 msgr2=0x7f41ac0c48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.682+0000 7f41b2e00640 1 --2- 172.21.15.49:0/999026963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41ac15b3e0 0x7f41ac0c48e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f41a400cc40 tx=0x7f41a400a430 comp rx=0 tx=0).stop 2024-01-31T05:05:03.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.682+0000 7f41b2e00640 1 -- 172.21.15.49:0/999026963 shutdown_connections 2024-01-31T05:05:03.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.682+0000 7f41b2e00640 1 --2- 172.21.15.49:0/999026963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41ac15b3e0 0x7f41ac0c48e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.682+0000 7f41b2e00640 1 --2- 172.21.15.49:0/999026963 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41ac0cd680 0x7f41ac0c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.682+0000 7f41b2e00640 1 --2- 172.21.15.49:0/999026963 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4184066530 0x7f41840689f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.682+0000 7f41b2e00640 1 --2- 172.21.15.49:0/999026963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41ac0ae4d0 0x7f41ac0b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.682+0000 7f41b2e00640 1 -- 172.21.15.49:0/999026963 >> 172.21.15.49:0/999026963 conn(0x7f41ac0b28e0 msgr2=0x7f41ac06fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:03.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.682+0000 7f41b2e00640 1 -- 172.21.15.49:0/999026963 shutdown_connections 2024-01-31T05:05:03.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.682+0000 7f41b2e00640 1 -- 172.21.15.49:0/999026963 wait complete. 2024-01-31T05:05:03.706 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:04:14.566345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:04:15.231265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-31T05:04:18.316756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-31T05:05:03.707 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:05:03.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff36600640 1 Processor -- start 2024-01-31T05:05:03.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff36600640 1 -- start start 2024-01-31T05:05:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff36600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7eff300715e0 0x7eff300cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff36600640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff30071e40 con 0x7eff3015a000 2024-01-31T05:05:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff36600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3006c990 con 0x7eff3006c2d0 2024-01-31T05:05:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff36600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff300b3760 con 0x7eff300715e0 2024-01-31T05:05:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2f400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7eff3015a000 0x7eff30070ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33568/0 (socket says 172.21.15.49:33568) 2024-01-31T05:05:03.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2f400640 1 -- 172.21.15.49:0/16451391 learned_addr learned my addr 172.21.15.49:0/16451391 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:03.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2ea00640 1 --2- 172.21.15.49:0/16451391 >> v2:172.21.15.195:3300/0 conn(0x7eff300715e0 0x7eff300cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:03.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2e000640 1 -- 172.21.15.49:0/16451391 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365598190 0 0) 0x7eff30071e40 con 0x7eff3015a000 2024-01-31T05:05:03.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2e000640 1 -- 172.21.15.49:0/16451391 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff10003530 con 0x7eff3015a000 2024-01-31T05:05:03.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2e000640 1 -- 172.21.15.49:0/16451391 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1103007825 0 0) 0x7eff10003530 con 0x7eff3015a000 2024-01-31T05:05:03.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2e000640 1 -- 172.21.15.49:0/16451391 >> v2:172.21.15.195:3300/0 conn(0x7eff300715e0 msgr2=0x7eff300cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:03.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2e000640 1 --2- 172.21.15.49:0/16451391 >> v2:172.21.15.195:3300/0 conn(0x7eff300715e0 0x7eff300cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2e000640 1 -- 172.21.15.49:0/16451391 >> v1:172.21.15.195:6789/0 conn(0x7eff3006c2d0 legacy=0x7eff300ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2e000640 1 -- 172.21.15.49:0/16451391 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3015a3e0 con 0x7eff3015a000 2024-01-31T05:05:03.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2e000640 1 -- 172.21.15.49:0/16451391 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7eff20001680 con 0x7eff3015a000 2024-01-31T05:05:03.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2e000640 1 -- 172.21.15.49:0/16451391 >> v1:172.21.15.49:6789/0 conn(0x7eff3015a000 legacy=0x7eff30070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2e000640 1 --2- 172.21.15.49:0/16451391 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff100039d0 0x7eff10003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2e000640 1 --2- 172.21.15.49:0/16451391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff100047d0 0x7eff10004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2e000640 1 --2- 172.21.15.49:0/16451391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff10005190 0x7eff1000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2e000640 1 -- 172.21.15.49:0/16451391 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff300b3760 con 0x7eff10005190 2024-01-31T05:05:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2e000640 1 -- 172.21.15.49:0/16451391 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1000c090 con 0x7eff100047d0 2024-01-31T05:05:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2e000640 1 -- 172.21.15.49:0/16451391 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1000c250 con 0x7eff100039d0 2024-01-31T05:05:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2fe00640 1 --2- 172.21.15.49:0/16451391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff10005190 0x7eff1000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2f400640 1 --2- 172.21.15.49:0/16451391 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff100039d0 0x7eff10003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2ea00640 1 --2- 172.21.15.49:0/16451391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff100047d0 0x7eff10004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2fe00640 1 -- 172.21.15.49:0/16451391 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff100039d0 msgr2=0x7eff10003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2fe00640 1 --2- 172.21.15.49:0/16451391 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff100039d0 0x7eff10003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2fe00640 1 -- 172.21.15.49:0/16451391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff100047d0 msgr2=0x7eff10004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2fe00640 1 --2- 172.21.15.49:0/16451391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff100047d0 0x7eff10004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.850+0000 7eff2fe00640 1 -- 172.21.15.49:0/16451391 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff10003530 con 0x7eff10005190 2024-01-31T05:05:03.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.854+0000 7eff2fe00640 1 -- 172.21.15.49:0/16451391 reap_dead start 2024-01-31T05:05:03.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.854+0000 7eff2fe00640 1 --2- 172.21.15.49:0/16451391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff10005190 0x7eff1000b990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7eff28001e70 tx=0x7eff2801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a2c83ae185d504 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:03.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.854+0000 7eff2e000640 1 -- 172.21.15.49:0/16451391 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff28003b80 con 0x7eff10005190 2024-01-31T05:05:03.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.854+0000 7eff2e000640 1 -- 172.21.15.49:0/16451391 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff28003d20 con 0x7eff10005190 2024-01-31T05:05:03.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.854+0000 7eff2e000640 1 -- 172.21.15.49:0/16451391 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff28005260 con 0x7eff10005190 2024-01-31T05:05:03.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.854+0000 7eff36600640 1 -- 172.21.15.49:0/16451391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff10005190 msgr2=0x7eff1000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.854+0000 7eff36600640 1 --2- 172.21.15.49:0/16451391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff10005190 0x7eff1000b990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7eff28001e70 tx=0x7eff2801c760 comp rx=0 tx=0).stop 2024-01-31T05:05:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.854+0000 7eff36600640 1 -- 172.21.15.49:0/16451391 shutdown_connections 2024-01-31T05:05:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.854+0000 7eff36600640 1 --2- 172.21.15.49:0/16451391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff10005190 0x7eff1000b990 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.854+0000 7eff36600640 1 -- 172.21.15.49:0/16451391 >> 172.21.15.49:0/16451391 conn(0x7eff300b09a0 msgr2=0x7eff300b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:03.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff36600640 1 -- 172.21.15.49:0/16451391 shutdown_connections 2024-01-31T05:05:03.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff36600640 1 -- 172.21.15.49:0/16451391 wait complete. 2024-01-31T05:05:03.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff36600640 1 Processor -- start 2024-01-31T05:05:03.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff36600640 1 -- start start 2024-01-31T05:05:03.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff36600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff10005190 0x7eff301e48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:03.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff36600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff301e6130 0x7eff301e2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:03.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff36600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff301e2e70 0x7eff3015c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:03.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff36600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff301f2ea0 con 0x7eff301e6130 2024-01-31T05:05:03.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff36600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff301f3180 con 0x7eff301e2e70 2024-01-31T05:05:03.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff36600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff301f3460 con 0x7eff10005190 2024-01-31T05:05:03.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff2ea00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff301e6130 0x7eff301e2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:03.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff2ea00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff301e6130 0x7eff301e2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45698/0 (socket says 172.21.15.49:45698) 2024-01-31T05:05:03.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff2ea00640 1 -- 172.21.15.49:0/136321280 learned_addr learned my addr 172.21.15.49:0/136321280 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:03.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff2f400640 1 --2- 172.21.15.49:0/136321280 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff10005190 0x7eff301e48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:03.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff2fe00640 1 --2- 172.21.15.49:0/136321280 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff301e2e70 0x7eff3015c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:03.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff2ea00640 1 -- 172.21.15.49:0/136321280 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff10005190 msgr2=0x7eff301e48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff2ea00640 1 --2- 172.21.15.49:0/136321280 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff10005190 0x7eff301e48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff2ea00640 1 -- 172.21.15.49:0/136321280 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff301e2e70 msgr2=0x7eff3015c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:03.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff2ea00640 1 --2- 172.21.15.49:0/136321280 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff301e2e70 0x7eff3015c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:03.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.858+0000 7eff2ea00640 1 -- 172.21.15.49:0/136321280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff301f3740 con 0x7eff301e6130 2024-01-31T05:05:03.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.862+0000 7eff2ea00640 1 --2- 172.21.15.49:0/136321280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff301e6130 0x7eff301e2930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7eff18011960 tx=0x7eff18011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:03.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.862+0000 7eff27400640 1 -- 172.21.15.49:0/136321280 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1800faf0 con 0x7eff301e6130 2024-01-31T05:05:03.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.862+0000 7eff27400640 1 -- 172.21.15.49:0/136321280 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1800fc50 con 0x7eff301e6130 2024-01-31T05:05:03.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.862+0000 7eff27400640 1 -- 172.21.15.49:0/136321280 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff18014440 con 0x7eff301e6130 2024-01-31T05:05:03.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.862+0000 7eff36600640 1 -- 172.21.15.49:0/136321280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff301f3a20 con 0x7eff301e6130 2024-01-31T05:05:03.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.862+0000 7eff36600640 1 -- 172.21.15.49:0/136321280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff301e65b0 con 0x7eff301e6130 2024-01-31T05:05:03.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.862+0000 7eff36600640 1 -- 172.21.15.49:0/136321280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff30074860 con 0x7eff301e6130 2024-01-31T05:05:03.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.862+0000 7eff27400640 1 -- 172.21.15.49:0/136321280 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7eff180145a0 con 0x7eff301e6130 2024-01-31T05:05:03.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.862+0000 7eff27400640 1 --2- 172.21.15.49:0/136321280 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7eff08066500 0x7eff080689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:03.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.866+0000 7eff27400640 1 -- 172.21.15.49:0/136321280 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7eff180849a0 con 0x7eff301e6130 2024-01-31T05:05:03.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.866+0000 7eff2f400640 1 --2- 172.21.15.49:0/136321280 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7eff08066500 0x7eff080689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:03.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.866+0000 7eff2f400640 1 --2- 172.21.15.49:0/136321280 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7eff08066500 0x7eff080689c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7eff200017b0 tx=0x7eff200015c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:03.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:03.870+0000 7eff27400640 1 -- 172.21.15.49:0/136321280 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7eff18051930 con 0x7eff301e6130 2024-01-31T05:05:04.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.026+0000 7eff36600640 1 -- 172.21.15.49:0/136321280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7eff30158fd0 con 0x7eff301e6130 2024-01-31T05:05:04.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.026+0000 7eff27400640 1 -- 172.21.15.49:0/136321280 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7eff180220a0 con 0x7eff301e6130 2024-01-31T05:05:04.030 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:05:04.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.030+0000 7eff36600640 1 -- 172.21.15.49:0/136321280 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7eff08066500 msgr2=0x7eff080689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:04.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.030+0000 7eff36600640 1 --2- 172.21.15.49:0/136321280 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7eff08066500 0x7eff080689c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7eff200017b0 tx=0x7eff200015c0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.030+0000 7eff36600640 1 -- 172.21.15.49:0/136321280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff301e6130 msgr2=0x7eff301e2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:04.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.030+0000 7eff36600640 1 --2- 172.21.15.49:0/136321280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff301e6130 0x7eff301e2930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7eff18011960 tx=0x7eff18011e20 comp rx=0 tx=0).stop 2024-01-31T05:05:04.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.030+0000 7eff36600640 1 -- 172.21.15.49:0/136321280 shutdown_connections 2024-01-31T05:05:04.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.030+0000 7eff36600640 1 --2- 172.21.15.49:0/136321280 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7eff08066500 0x7eff080689c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.030+0000 7eff36600640 1 --2- 172.21.15.49:0/136321280 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff301e2e70 0x7eff3015c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.030+0000 7eff36600640 1 --2- 172.21.15.49:0/136321280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff301e6130 0x7eff301e2930 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.030+0000 7eff36600640 1 --2- 172.21.15.49:0/136321280 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff10005190 0x7eff301e48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.030+0000 7eff36600640 1 -- 172.21.15.49:0/136321280 >> 172.21.15.49:0/136321280 conn(0x7eff300b09a0 msgr2=0x7eff300ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:04.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.030+0000 7eff36600640 1 -- 172.21.15.49:0/136321280 shutdown_connections 2024-01-31T05:05:04.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.030+0000 7eff36600640 1 -- 172.21.15.49:0/136321280 wait complete. 2024-01-31T05:05:04.052 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:05:04.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7c2800640 1 Processor -- start 2024-01-31T05:05:04.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7c2800640 1 -- start start 2024-01-31T05:05:04.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7c2800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb7bc15d510 0x7fb7bc072050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:04.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7c2800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb7bc0b4b20 0x7fb7bc06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7c2800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc06d920 0x7fb7bc06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7c2800640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7bc072590 con 0x7fb7bc15d510 2024-01-31T05:05:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7c2800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7bc06f010 con 0x7fb7bc0b4b20 2024-01-31T05:05:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7c2800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc071570 con 0x7fb7bc06d920 2024-01-31T05:05:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7bb400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb7bc15d510 0x7fb7bc072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7bb400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb7bc15d510 0x7fb7bc072050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45706/0 (socket says 172.21.15.49:45706) 2024-01-31T05:05:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7bb400640 1 -- 172.21.15.49:0/435961867 learned_addr learned my addr 172.21.15.49:0/435961867 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7bbe00640 1 --2- 172.21.15.49:0/435961867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc06d920 0x7fb7bc06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7baa00640 1 --2- 172.21.15.49:0/435961867 >> v2:172.21.15.195:3300/0 conn(0x7fb7bc0b4b20 0x7fb7bc06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7bb400640 1 -- 172.21.15.49:0/435961867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc06d920 msgr2=0x7fb7bc06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7bb400640 1 --2- 172.21.15.49:0/435961867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc06d920 0x7fb7bc06a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7bb400640 1 -- 172.21.15.49:0/435961867 >> v2:172.21.15.195:3300/0 conn(0x7fb7bc0b4b20 msgr2=0x7fb7bc06d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:04.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7bb400640 1 --2- 172.21.15.49:0/435961867 >> v2:172.21.15.195:3300/0 conn(0x7fb7bc0b4b20 0x7fb7bc06d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7bb400640 1 -- 172.21.15.49:0/435961867 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc071850 con 0x7fb7bc15d510 2024-01-31T05:05:04.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7bbe00640 1 --2- 172.21.15.49:0/435961867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc06d920 0x7fb7bc06a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:04.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.194+0000 7fb7baa00640 1 --2- 172.21.15.49:0/435961867 >> v2:172.21.15.195:3300/0 conn(0x7fb7bc0b4b20 0x7fb7bc06d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:04.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.198+0000 7fb7bb400640 1 --2- 172.21.15.49:0/435961867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7bc15d510 0x7fb7bc072050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc06d390 tx=0x7fb7ac01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ae61540036762c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:04.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.198+0000 7fb7ba000640 1 -- 172.21.15.49:0/435961867 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac0ab620 con 0x7fb7bc15d510 2024-01-31T05:05:04.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.198+0000 7fb7ba000640 1 -- 172.21.15.49:0/435961867 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ac0ab780 con 0x7fb7bc15d510 2024-01-31T05:05:04.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.198+0000 7fb7ba000640 1 -- 172.21.15.49:0/435961867 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac0abb10 con 0x7fb7bc15d510 2024-01-31T05:05:04.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.198+0000 7fb7c2800640 1 -- 172.21.15.49:0/435961867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7bc15d510 msgr2=0x7fb7bc072050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:04.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.198+0000 7fb7c2800640 1 --2- 172.21.15.49:0/435961867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7bc15d510 0x7fb7bc072050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc06d390 tx=0x7fb7ac01c440 comp rx=0 tx=0).stop 2024-01-31T05:05:04.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.198+0000 7fb7c2800640 1 -- 172.21.15.49:0/435961867 shutdown_connections 2024-01-31T05:05:04.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.198+0000 7fb7c2800640 1 --2- 172.21.15.49:0/435961867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc06d920 0x7fb7bc06a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.198+0000 7fb7c2800640 1 --2- 172.21.15.49:0/435961867 >> v2:172.21.15.195:3300/0 conn(0x7fb7bc0b4b20 0x7fb7bc06d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.198+0000 7fb7c2800640 1 --2- 172.21.15.49:0/435961867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7bc15d510 0x7fb7bc072050 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.198+0000 7fb7c2800640 1 -- 172.21.15.49:0/435961867 >> 172.21.15.49:0/435961867 conn(0x7fb7bc0b1ab0 msgr2=0x7fb7bc0b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:04.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.198+0000 7fb7c2800640 1 -- 172.21.15.49:0/435961867 shutdown_connections 2024-01-31T05:05:04.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.198+0000 7fb7c2800640 1 -- 172.21.15.49:0/435961867 wait complete. 2024-01-31T05:05:04.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7c2800640 1 Processor -- start 2024-01-31T05:05:04.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7c2800640 1 -- start start 2024-01-31T05:05:04.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7c2800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc06d920 0x7fb7bc14e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:04.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7c2800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7bc0b4b20 0x7fb7bc0cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:04.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7c2800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7bc15d510 0x7fb7bc0cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:04.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7c2800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc157520 con 0x7fb7bc0b4b20 2024-01-31T05:05:04.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7c2800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc14eff0 con 0x7fb7bc15d510 2024-01-31T05:05:04.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7c2800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc14eaa0 con 0x7fb7bc06d920 2024-01-31T05:05:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7baa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7bc0b4b20 0x7fb7bc0cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7baa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7bc0b4b20 0x7fb7bc0cc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45716/0 (socket says 172.21.15.49:45716) 2024-01-31T05:05:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7baa00640 1 -- 172.21.15.49:0/384045936 learned_addr learned my addr 172.21.15.49:0/384045936 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7bbe00640 1 --2- 172.21.15.49:0/384045936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7bc15d510 0x7fb7bc0cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7bb400640 1 --2- 172.21.15.49:0/384045936 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc06d920 0x7fb7bc14e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7baa00640 1 -- 172.21.15.49:0/384045936 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc06d920 msgr2=0x7fb7bc14e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7baa00640 1 --2- 172.21.15.49:0/384045936 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc06d920 0x7fb7bc14e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7baa00640 1 -- 172.21.15.49:0/384045936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7bc15d510 msgr2=0x7fb7bc0cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7baa00640 1 --2- 172.21.15.49:0/384045936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7bc15d510 0x7fb7bc0cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7baa00640 1 -- 172.21.15.49:0/384045936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ac0094d0 con 0x7fb7bc0b4b20 2024-01-31T05:05:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7bbe00640 1 --2- 172.21.15.49:0/384045936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7bc15d510 0x7fb7bc0cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7bb400640 1 --2- 172.21.15.49:0/384045936 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc06d920 0x7fb7bc14e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:04.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7baa00640 1 --2- 172.21.15.49:0/384045936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7bc0b4b20 0x7fb7bc0cc790 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400e810 tx=0x7fb7a400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:04.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7b3400640 1 -- 172.21.15.49:0/384045936 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a400c8d0 con 0x7fb7bc0b4b20 2024-01-31T05:05:04.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7b3400640 1 -- 172.21.15.49:0/384045936 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a400ca30 con 0x7fb7bc0b4b20 2024-01-31T05:05:04.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7b3400640 1 -- 172.21.15.49:0/384045936 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a400cdc0 con 0x7fb7bc0b4b20 2024-01-31T05:05:04.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7c2800640 1 -- 172.21.15.49:0/384045936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7bc156910 con 0x7fb7bc0b4b20 2024-01-31T05:05:04.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.202+0000 7fb7c2800640 1 -- 172.21.15.49:0/384045936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7bc156ed0 con 0x7fb7bc0b4b20 2024-01-31T05:05:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.206+0000 7fb7c2800640 1 -- 172.21.15.49:0/384045936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7bc06c770 con 0x7fb7bc0b4b20 2024-01-31T05:05:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.206+0000 7fb7b3400640 1 -- 172.21.15.49:0/384045936 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb7a4013410 con 0x7fb7bc0b4b20 2024-01-31T05:05:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.206+0000 7fb7b3400640 1 --2- 172.21.15.49:0/384045936 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb794066500 0x7fb7940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.206+0000 7fb7b3400640 1 -- 172.21.15.49:0/384045936 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb7a40840c0 con 0x7fb7bc0b4b20 2024-01-31T05:05:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.206+0000 7fb7bb400640 1 --2- 172.21.15.49:0/384045936 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb794066500 0x7fb7940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:04.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.206+0000 7fb7bb400640 1 --2- 172.21.15.49:0/384045936 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb794066500 0x7fb7940689c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0af000 tx=0x7fb7ac0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:04.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.210+0000 7fb7b3400640 1 -- 172.21.15.49:0/384045936 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fb7a4050fa0 con 0x7fb7bc0b4b20 2024-01-31T05:05:04.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.374+0000 7fb7c2800640 1 -- 172.21.15.49:0/384045936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb7bc074860 con 0x7fb7bc0b4b20 2024-01-31T05:05:04.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.374+0000 7fb7b3400640 1 -- 172.21.15.49:0/384045936 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb7a40545c0 con 0x7fb7bc0b4b20 2024-01-31T05:05:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:04.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.378+0000 7fb7c2800640 1 -- 172.21.15.49:0/384045936 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb794066500 msgr2=0x7fb7940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:04.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.378+0000 7fb7c2800640 1 --2- 172.21.15.49:0/384045936 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb794066500 0x7fb7940689c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0af000 tx=0x7fb7ac0a7000 comp rx=0 tx=0).stop 2024-01-31T05:05:04.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.378+0000 7fb7c2800640 1 -- 172.21.15.49:0/384045936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7bc0b4b20 msgr2=0x7fb7bc0cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:04.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.378+0000 7fb7c2800640 1 --2- 172.21.15.49:0/384045936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7bc0b4b20 0x7fb7bc0cc790 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400e810 tx=0x7fb7a400ecd0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.378+0000 7fb7c2800640 1 -- 172.21.15.49:0/384045936 shutdown_connections 2024-01-31T05:05:04.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.378+0000 7fb7c2800640 1 --2- 172.21.15.49:0/384045936 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb794066500 0x7fb7940689c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.378+0000 7fb7c2800640 1 --2- 172.21.15.49:0/384045936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7bc15d510 0x7fb7bc0cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.378+0000 7fb7c2800640 1 --2- 172.21.15.49:0/384045936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7bc0b4b20 0x7fb7bc0cc790 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.378+0000 7fb7c2800640 1 --2- 172.21.15.49:0/384045936 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7bc06d920 0x7fb7bc14e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.378+0000 7fb7c2800640 1 -- 172.21.15.49:0/384045936 >> 172.21.15.49:0/384045936 conn(0x7fb7bc0b1ab0 msgr2=0x7fb7bc0b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:04.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.378+0000 7fb7c2800640 1 -- 172.21.15.49:0/384045936 shutdown_connections 2024-01-31T05:05:04.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.378+0000 7fb7c2800640 1 -- 172.21.15.49:0/384045936 wait complete. 2024-01-31T05:05:04.401 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:05:04.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.542+0000 7f9452a00640 1 Processor -- start 2024-01-31T05:05:04.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.542+0000 7f9452a00640 1 -- start start 2024-01-31T05:05:04.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.542+0000 7f9452a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f944c15e770 0x7f944c0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:04.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.542+0000 7f9452a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f944c0703c0 0x7f944c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:04.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.542+0000 7f9452a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f944c0d1e00 con 0x7f944c06fe70 2024-01-31T05:05:04.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.542+0000 7f9452a00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f944c06fcc0 con 0x7f944c0703c0 2024-01-31T05:05:04.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.542+0000 7f9452a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944c06f6a0 con 0x7f944c15e770 2024-01-31T05:05:04.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.542+0000 7f9450a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f944c0703c0 0x7f944c0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:04.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.542+0000 7f9450a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f944c0703c0 0x7f944c0af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45730/0 (socket says 172.21.15.49:45730) 2024-01-31T05:05:04.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.542+0000 7f9450a00640 1 -- 172.21.15.49:0/3270408060 learned_addr learned my addr 172.21.15.49:0/3270408060 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:04.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.542+0000 7f944be00640 1 --2- 172.21.15.49:0/3270408060 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f944c15e770 0x7f944c0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:04.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.542+0000 7f9450a00640 1 -- 172.21.15.49:0/3270408060 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f944c15e770 msgr2=0x7f944c0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:04.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.542+0000 7f9450a00640 1 --2- 172.21.15.49:0/3270408060 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f944c15e770 0x7f944c0cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.542+0000 7f9450a00640 1 -- 172.21.15.49:0/3270408060 >> v1:172.21.15.195:6789/0 conn(0x7f944c06fe70 legacy=0x7f944c06e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:04.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.542+0000 7f9450a00640 1 -- 172.21.15.49:0/3270408060 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c0cf220 con 0x7f944c0703c0 2024-01-31T05:05:04.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9450a00640 1 --2- 172.21.15.49:0/3270408060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f944c0703c0 0x7f944c0af5d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9444009e50 tx=0x7f944401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d009be772205e4 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:04.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f944aa00640 1 -- 172.21.15.49:0/3270408060 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94440a57c0 con 0x7f944c0703c0 2024-01-31T05:05:04.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f944aa00640 1 -- 172.21.15.49:0/3270408060 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94440a5920 con 0x7f944c0703c0 2024-01-31T05:05:04.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f944aa00640 1 -- 172.21.15.49:0/3270408060 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94440a5cb0 con 0x7f944c0703c0 2024-01-31T05:05:04.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9452a00640 1 -- 172.21.15.49:0/3270408060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f944c0703c0 msgr2=0x7f944c0af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:04.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9452a00640 1 --2- 172.21.15.49:0/3270408060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f944c0703c0 0x7f944c0af5d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9444009e50 tx=0x7f944401c9e0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9452a00640 1 -- 172.21.15.49:0/3270408060 shutdown_connections 2024-01-31T05:05:04.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9452a00640 1 --2- 172.21.15.49:0/3270408060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f944c0703c0 0x7f944c0af5d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9452a00640 1 --2- 172.21.15.49:0/3270408060 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f944c15e770 0x7f944c0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9452a00640 1 -- 172.21.15.49:0/3270408060 >> 172.21.15.49:0/3270408060 conn(0x7f944c0d0e60 msgr2=0x7f944c0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:04.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9452a00640 1 -- 172.21.15.49:0/3270408060 shutdown_connections 2024-01-31T05:05:04.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9452a00640 1 -- 172.21.15.49:0/3270408060 wait complete. 2024-01-31T05:05:04.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9452a00640 1 Processor -- start 2024-01-31T05:05:04.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9452a00640 1 -- start start 2024-01-31T05:05:04.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9452a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f944c06fe70 0x7f944c151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:04.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9452a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f944c0703c0 0x7f944c14aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:04.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9452a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f944c15e770 0x7f944c1f77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:04.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9452a00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c1f7350 con 0x7f944c06fe70 2024-01-31T05:05:04.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9452a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c1f7020 con 0x7f944c15e770 2024-01-31T05:05:04.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9452a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944c152290 con 0x7f944c0703c0 2024-01-31T05:05:04.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f944be00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f944c06fe70 0x7f944c151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:04.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f944be00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f944c06fe70 0x7f944c151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45734/0 (socket says 172.21.15.49:45734) 2024-01-31T05:05:04.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f944be00640 1 -- 172.21.15.49:0/441571627 learned_addr learned my addr 172.21.15.49:0/441571627 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:04.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f944b400640 1 --2- 172.21.15.49:0/441571627 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f944c0703c0 0x7f944c14aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:04.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9450a00640 1 --2- 172.21.15.49:0/441571627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f944c15e770 0x7f944c1f77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:04.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f944be00640 1 -- 172.21.15.49:0/441571627 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f944c0703c0 msgr2=0x7f944c14aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:04.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f944be00640 1 --2- 172.21.15.49:0/441571627 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f944c0703c0 0x7f944c14aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f944be00640 1 -- 172.21.15.49:0/441571627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f944c15e770 msgr2=0x7f944c1f77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:04.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f944be00640 1 --2- 172.21.15.49:0/441571627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f944c15e770 0x7f944c1f77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f944be00640 1 -- 172.21.15.49:0/441571627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9444009b30 con 0x7f944c06fe70 2024-01-31T05:05:04.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9450a00640 1 --2- 172.21.15.49:0/441571627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f944c15e770 0x7f944c1f77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:04.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f944be00640 1 --2- 172.21.15.49:0/441571627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f944c06fe70 0x7f944c151d50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f943c00d800 tx=0x7f943c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:04.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9443e00640 1 -- 172.21.15.49:0/441571627 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c00b6c0 con 0x7f944c06fe70 2024-01-31T05:05:04.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9443e00640 1 -- 172.21.15.49:0/441571627 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943c00b820 con 0x7f944c06fe70 2024-01-31T05:05:04.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9443e00640 1 -- 172.21.15.49:0/441571627 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c00bb90 con 0x7f944c06fe70 2024-01-31T05:05:04.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9452a00640 1 -- 172.21.15.49:0/441571627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944c14c770 con 0x7f944c06fe70 2024-01-31T05:05:04.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.550+0000 7f9452a00640 1 -- 172.21.15.49:0/441571627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944c14b410 con 0x7f944c06fe70 2024-01-31T05:05:04.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.558+0000 7f9452a00640 1 -- 172.21.15.49:0/441571627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f944c1f6e80 con 0x7f944c06fe70 2024-01-31T05:05:04.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.558+0000 7f9443e00640 1 -- 172.21.15.49:0/441571627 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f943c00bcf0 con 0x7f944c06fe70 2024-01-31T05:05:04.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.558+0000 7f9443e00640 1 --2- 172.21.15.49:0/441571627 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9424066500 0x7f94240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:04.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.558+0000 7f9443e00640 1 -- 172.21.15.49:0/441571627 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f943c0846c0 con 0x7f944c06fe70 2024-01-31T05:05:04.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.558+0000 7f944b400640 1 --2- 172.21.15.49:0/441571627 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9424066500 0x7f94240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:04.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.558+0000 7f944b400640 1 --2- 172.21.15.49:0/441571627 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9424066500 0x7f94240689c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f944c15e0d0 tx=0x7f9434009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:04.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.562+0000 7f9443e00640 1 -- 172.21.15.49:0/441571627 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f944c1f6e80 con 0x7f944c06fe70 2024-01-31T05:05:04.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.722+0000 7f9452a00640 1 -- 172.21.15.49:0/441571627 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f944c1f6e80 con 0x7f944c06fe70 2024-01-31T05:05:04.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.722+0000 7f9443e00640 1 -- 172.21.15.49:0/441571627 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f944c1f6e80 con 0x7f944c06fe70 2024-01-31T05:05:04.721 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-31T05:05:04.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.722+0000 7f9452a00640 1 -- 172.21.15.49:0/441571627 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9424066500 msgr2=0x7f94240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:04.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.722+0000 7f9452a00640 1 --2- 172.21.15.49:0/441571627 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9424066500 0x7f94240689c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f944c15e0d0 tx=0x7f9434009040 comp rx=0 tx=0).stop 2024-01-31T05:05:04.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.722+0000 7f9452a00640 1 -- 172.21.15.49:0/441571627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f944c06fe70 msgr2=0x7f944c151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:04.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.722+0000 7f9452a00640 1 --2- 172.21.15.49:0/441571627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f944c06fe70 0x7f944c151d50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f943c00d800 tx=0x7f943c00dcc0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.726+0000 7f9452a00640 1 -- 172.21.15.49:0/441571627 shutdown_connections 2024-01-31T05:05:04.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.726+0000 7f9452a00640 1 --2- 172.21.15.49:0/441571627 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9424066500 0x7f94240689c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.726+0000 7f9452a00640 1 --2- 172.21.15.49:0/441571627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f944c15e770 0x7f944c1f77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.726+0000 7f9452a00640 1 --2- 172.21.15.49:0/441571627 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f944c0703c0 0x7f944c14aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.726+0000 7f9452a00640 1 --2- 172.21.15.49:0/441571627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f944c06fe70 0x7f944c151d50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.726+0000 7f9452a00640 1 -- 172.21.15.49:0/441571627 >> 172.21.15.49:0/441571627 conn(0x7f944c0d0e60 msgr2=0x7f944c0cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:04.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.726+0000 7f9452a00640 1 -- 172.21.15.49:0/441571627 shutdown_connections 2024-01-31T05:05:04.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.726+0000 7f9452a00640 1 -- 172.21.15.49:0/441571627 wait complete. 2024-01-31T05:05:04.745 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-31T05:05:04.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.890+0000 7f9378a00640 1 Processor -- start 2024-01-31T05:05:04.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.890+0000 7f9378a00640 1 -- start start 2024-01-31T05:05:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.890+0000 7f9378a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93700714e0 0x7f93700ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.890+0000 7f9378a00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f937015b4f0 con 0x7f937015b110 2024-01-31T05:05:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.890+0000 7f9378a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93700abf20 con 0x7f93700cdf10 2024-01-31T05:05:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.890+0000 7f9378a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93700ce460 con 0x7f93700714e0 2024-01-31T05:05:04.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.890+0000 7f9376000640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f937015b110 0x7f937006c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33574/0 (socket says 172.21.15.49:33574) 2024-01-31T05:05:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.890+0000 7f9376000640 1 -- 172.21.15.49:0/884696257 learned_addr learned my addr 172.21.15.49:0/884696257 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.890+0000 7f9376a00640 1 --2- 172.21.15.49:0/884696257 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93700714e0 0x7f93700ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.894+0000 7f9374c00640 1 -- 172.21.15.49:0/884696257 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47643962 0 0) 0x7f9360001120 con 0x7f937015b110 2024-01-31T05:05:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.894+0000 7f9374c00640 1 -- 172.21.15.49:0/884696257 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9350003530 con 0x7f937015b110 2024-01-31T05:05:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.894+0000 7f9374c00640 1 -- 172.21.15.49:0/884696257 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120550337 0 0) 0x7f93700abf20 con 0x7f93700cdf10 2024-01-31T05:05:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.894+0000 7f9374c00640 1 -- 172.21.15.49:0/884696257 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9360001120 con 0x7f93700cdf10 2024-01-31T05:05:04.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.894+0000 7f9374c00640 1 -- 172.21.15.49:0/884696257 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3001346699 0 0) 0x7f9350003530 con 0x7f937015b110 2024-01-31T05:05:04.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.894+0000 7f9376a00640 1 -- 172.21.15.49:0/884696257 >> v1:172.21.15.195:6789/0 conn(0x7f93700cdf10 legacy=0x7f9370070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:04.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.894+0000 7f9376a00640 1 -- 172.21.15.49:0/884696257 >> v1:172.21.15.49:6789/0 conn(0x7f937015b110 legacy=0x7f937006c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:04.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.894+0000 7f9376a00640 1 -- 172.21.15.49:0/884696257 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93700ac200 con 0x7f93700714e0 2024-01-31T05:05:04.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.894+0000 7f9376a00640 1 --2- 172.21.15.49:0/884696257 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93700714e0 0x7f93700ad800 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9368009dc0 tx=0x7f936801c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cabbc05aadb74a1a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:04.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.898+0000 7f9374c00640 1 -- 172.21.15.49:0/884696257 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360001810 con 0x7f93700714e0 2024-01-31T05:05:04.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.898+0000 7f9374c00640 1 -- 172.21.15.49:0/884696257 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93680a56c0 con 0x7f93700714e0 2024-01-31T05:05:04.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.898+0000 7f9374c00640 1 -- 172.21.15.49:0/884696257 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93680a5a50 con 0x7f93700714e0 2024-01-31T05:05:04.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.898+0000 7f9378a00640 1 -- 172.21.15.49:0/884696257 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93700714e0 msgr2=0x7f93700ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:04.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.898+0000 7f9378a00640 1 --2- 172.21.15.49:0/884696257 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93700714e0 0x7f93700ad800 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9368009dc0 tx=0x7f936801c860 comp rx=0 tx=0).stop 2024-01-31T05:05:04.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.898+0000 7f9378a00640 1 -- 172.21.15.49:0/884696257 shutdown_connections 2024-01-31T05:05:04.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.898+0000 7f9378a00640 1 --2- 172.21.15.49:0/884696257 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93700714e0 0x7f93700ad800 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.898+0000 7f9378a00640 1 -- 172.21.15.49:0/884696257 >> 172.21.15.49:0/884696257 conn(0x7f93700b09a0 msgr2=0x7f93700b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:04.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.898+0000 7f9378a00640 1 -- 172.21.15.49:0/884696257 shutdown_connections 2024-01-31T05:05:04.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.898+0000 7f9378a00640 1 -- 172.21.15.49:0/884696257 wait complete. 2024-01-31T05:05:04.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.898+0000 7f9378a00640 1 Processor -- start 2024-01-31T05:05:04.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.898+0000 7f9378a00640 1 -- start start 2024-01-31T05:05:04.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.898+0000 7f9378a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93700714e0 0x7f937014bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:04.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.898+0000 7f9378a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93700cdf10 0x7f937014b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:04.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.898+0000 7f9378a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f937015b110 0x7f9370165a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:04.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f9378a00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937014bac0 con 0x7f937015b110 2024-01-31T05:05:04.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f9378a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937014c4c0 con 0x7f93700cdf10 2024-01-31T05:05:04.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f9378a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9370165fb0 con 0x7f93700714e0 2024-01-31T05:05:04.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f9376a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f937015b110 0x7f9370165a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:04.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f9376a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f937015b110 0x7f9370165a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45742/0 (socket says 172.21.15.49:45742) 2024-01-31T05:05:04.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f9376a00640 1 -- 172.21.15.49:0/1153624599 learned_addr learned my addr 172.21.15.49:0/1153624599 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:04.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f9376000640 1 --2- 172.21.15.49:0/1153624599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93700714e0 0x7f937014bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:04.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f9375600640 1 --2- 172.21.15.49:0/1153624599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93700cdf10 0x7f937014b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:04.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f9376a00640 1 -- 172.21.15.49:0/1153624599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93700714e0 msgr2=0x7f937014bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:04.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f9376a00640 1 --2- 172.21.15.49:0/1153624599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93700714e0 0x7f937014bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f9376a00640 1 -- 172.21.15.49:0/1153624599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93700cdf10 msgr2=0x7f937014b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:04.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f9376a00640 1 --2- 172.21.15.49:0/1153624599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93700cdf10 0x7f937014b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:04.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f9376a00640 1 -- 172.21.15.49:0/1153624599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9368009a70 con 0x7f937015b110 2024-01-31T05:05:04.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f9375600640 1 --2- 172.21.15.49:0/1153624599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93700cdf10 0x7f937014b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:04.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f9376a00640 1 --2- 172.21.15.49:0/1153624599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f937015b110 0x7f9370165a70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f936801cd40 tx=0x7f9368019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:04.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f936e000640 1 -- 172.21.15.49:0/1153624599 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9368003ba0 con 0x7f937015b110 2024-01-31T05:05:04.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f936e000640 1 -- 172.21.15.49:0/1153624599 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9368003d20 con 0x7f937015b110 2024-01-31T05:05:04.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f9378a00640 1 -- 172.21.15.49:0/1153624599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9370164b70 con 0x7f937015b110 2024-01-31T05:05:04.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f936e000640 1 -- 172.21.15.49:0/1153624599 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93680ad890 con 0x7f937015b110 2024-01-31T05:05:04.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f9378a00640 1 -- 172.21.15.49:0/1153624599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9370165130 con 0x7f937015b110 2024-01-31T05:05:04.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f9378a00640 1 -- 172.21.15.49:0/1153624599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9370074860 con 0x7f937015b110 2024-01-31T05:05:04.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.902+0000 7f936e000640 1 -- 172.21.15.49:0/1153624599 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f93680b4050 con 0x7f937015b110 2024-01-31T05:05:04.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.906+0000 7f936e000640 1 --2- 172.21.15.49:0/1153624599 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9348066500 0x7f93480689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:04.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.906+0000 7f936e000640 1 -- 172.21.15.49:0/1153624599 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f936811ec10 con 0x7f937015b110 2024-01-31T05:05:04.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.906+0000 7f9376000640 1 --2- 172.21.15.49:0/1153624599 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9348066500 0x7f93480689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:04.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.906+0000 7f9376000640 1 --2- 172.21.15.49:0/1153624599 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9348066500 0x7f93480689c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9360000fe0 tx=0x7f9360001bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:04.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:04.910+0000 7f936e000640 1 -- 172.21.15.49:0/1153624599 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f93680ebb90 con 0x7f937015b110 2024-01-31T05:05:05.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.066+0000 7f9378a00640 1 -- 172.21.15.49:0/1153624599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f93700b17d0 con 0x7f937015b110 2024-01-31T05:05:05.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.066+0000 7f936e000640 1 -- 172.21.15.49:0/1153624599 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f93680c6020 con 0x7f937015b110 2024-01-31T05:05:05.067 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:05.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.070+0000 7f9378a00640 1 -- 172.21.15.49:0/1153624599 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9348066500 msgr2=0x7f93480689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:05.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.070+0000 7f9378a00640 1 --2- 172.21.15.49:0/1153624599 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9348066500 0x7f93480689c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9360000fe0 tx=0x7f9360001bd0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.070+0000 7f9378a00640 1 -- 172.21.15.49:0/1153624599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f937015b110 msgr2=0x7f9370165a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:05.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.070+0000 7f9378a00640 1 --2- 172.21.15.49:0/1153624599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f937015b110 0x7f9370165a70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f936801cd40 tx=0x7f9368019600 comp rx=0 tx=0).stop 2024-01-31T05:05:05.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.070+0000 7f9378a00640 1 -- 172.21.15.49:0/1153624599 shutdown_connections 2024-01-31T05:05:05.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.070+0000 7f9378a00640 1 --2- 172.21.15.49:0/1153624599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f937015b110 0x7f9370165a70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.070+0000 7f9378a00640 1 --2- 172.21.15.49:0/1153624599 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9348066500 0x7f93480689c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.070+0000 7f9378a00640 1 --2- 172.21.15.49:0/1153624599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f93700cdf10 0x7f937014b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.070+0000 7f9378a00640 1 --2- 172.21.15.49:0/1153624599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93700714e0 0x7f937014bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.070+0000 7f9378a00640 1 -- 172.21.15.49:0/1153624599 >> 172.21.15.49:0/1153624599 conn(0x7f93700b09a0 msgr2=0x7f93700aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:05.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.070+0000 7f9378a00640 1 -- 172.21.15.49:0/1153624599 shutdown_connections 2024-01-31T05:05:05.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.070+0000 7f9378a00640 1 -- 172.21.15.49:0/1153624599 wait complete. 2024-01-31T05:05:05.089 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:05.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.230+0000 7f7e6f800640 1 Processor -- start 2024-01-31T05:05:05.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.230+0000 7f7e6f800640 1 -- start start 2024-01-31T05:05:05.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.230+0000 7f7e6f800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e6806fe70 0x7f7e6806e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:05.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.230+0000 7f7e6f800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7e680703c0 0x7f7e6806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:05.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.230+0000 7f7e6f800640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e680d1e00 con 0x7f7e6815e770 2024-01-31T05:05:05.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.230+0000 7f7e6f800640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6806fcc0 con 0x7f7e680703c0 2024-01-31T05:05:05.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.230+0000 7f7e6f800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6806f6a0 con 0x7f7e6806fe70 2024-01-31T05:05:05.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.234+0000 7f7e6ce00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7e6815e770 0x7f7e680cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33578/0 (socket says 172.21.15.49:33578) 2024-01-31T05:05:05.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.234+0000 7f7e6ce00640 1 -- 172.21.15.49:0/2223981888 learned_addr learned my addr 172.21.15.49:0/2223981888 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:05.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.234+0000 7f7e6d800640 1 --2- 172.21.15.49:0/2223981888 >> v2:172.21.15.49:3300/0 conn(0x7f7e680703c0 0x7f7e6806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:05.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.234+0000 7f7e67e00640 1 --2- 172.21.15.49:0/2223981888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e6806fe70 0x7f7e6806e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:05.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.234+0000 7f7e6d800640 1 -- 172.21.15.49:0/2223981888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e6806fe70 msgr2=0x7f7e6806e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:05.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.234+0000 7f7e6d800640 1 --2- 172.21.15.49:0/2223981888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e6806fe70 0x7f7e6806e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.234+0000 7f7e6d800640 1 -- 172.21.15.49:0/2223981888 >> v1:172.21.15.49:6789/0 conn(0x7f7e6815e770 legacy=0x7f7e680cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:05.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.234+0000 7f7e67400640 1 -- 172.21.15.49:0/2223981888 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797155961 0 0) 0x7f7e680d1e00 con 0x7f7e6815e770 2024-01-31T05:05:05.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.234+0000 7f7e6d800640 1 -- 172.21.15.49:0/2223981888 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e680cf220 con 0x7f7e680703c0 2024-01-31T05:05:05.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.234+0000 7f7e67e00640 1 --2- 172.21.15.49:0/2223981888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e6806fe70 0x7f7e6806e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:05.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.234+0000 7f7e6d800640 1 --2- 172.21.15.49:0/2223981888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e680703c0 0x7f7e6806eb30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009d90 tx=0x7f7e6001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71496d06d205d579 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:05.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.234+0000 7f7e67400640 1 -- 172.21.15.49:0/2223981888 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e600a5810 con 0x7f7e680703c0 2024-01-31T05:05:05.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.234+0000 7f7e67400640 1 -- 172.21.15.49:0/2223981888 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e600a5970 con 0x7f7e680703c0 2024-01-31T05:05:05.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.234+0000 7f7e67400640 1 -- 172.21.15.49:0/2223981888 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e600a5d00 con 0x7f7e680703c0 2024-01-31T05:05:05.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6f800640 1 -- 172.21.15.49:0/2223981888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e680703c0 msgr2=0x7f7e6806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:05.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6f800640 1 --2- 172.21.15.49:0/2223981888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e680703c0 0x7f7e6806eb30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009d90 tx=0x7f7e6001c950 comp rx=0 tx=0).stop 2024-01-31T05:05:05.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6f800640 1 -- 172.21.15.49:0/2223981888 shutdown_connections 2024-01-31T05:05:05.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6f800640 1 --2- 172.21.15.49:0/2223981888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e680703c0 0x7f7e6806eb30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6f800640 1 --2- 172.21.15.49:0/2223981888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e6806fe70 0x7f7e6806e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6f800640 1 -- 172.21.15.49:0/2223981888 >> 172.21.15.49:0/2223981888 conn(0x7f7e680d0e60 msgr2=0x7f7e680d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:05.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6f800640 1 -- 172.21.15.49:0/2223981888 shutdown_connections 2024-01-31T05:05:05.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6f800640 1 -- 172.21.15.49:0/2223981888 wait complete. 2024-01-31T05:05:05.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6f800640 1 Processor -- start 2024-01-31T05:05:05.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6f800640 1 -- start start 2024-01-31T05:05:05.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6f800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e6806fe70 0x7f7e681472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:05.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6f800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e680703c0 0x7f7e680c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:05.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6f800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e6815e770 0x7f7e680c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:05.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6f800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e680cb4d0 con 0x7f7e6815e770 2024-01-31T05:05:05.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6f800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e681f69b0 con 0x7f7e680703c0 2024-01-31T05:05:05.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6f800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e68147800 con 0x7f7e6806fe70 2024-01-31T05:05:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6d800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e6815e770 0x7f7e680c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6d800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e6815e770 0x7f7e680c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45760/0 (socket says 172.21.15.49:45760) 2024-01-31T05:05:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6d800640 1 -- 172.21.15.49:0/1656445063 learned_addr learned my addr 172.21.15.49:0/1656445063 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.238+0000 7f7e6ce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e6806fe70 0x7f7e681472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.242+0000 7f7e67e00640 1 --2- 172.21.15.49:0/1656445063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e680703c0 0x7f7e680c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.242+0000 7f7e6d800640 1 -- 172.21.15.49:0/1656445063 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e6806fe70 msgr2=0x7f7e681472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.242+0000 7f7e6d800640 1 --2- 172.21.15.49:0/1656445063 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e6806fe70 0x7f7e681472c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.242+0000 7f7e6d800640 1 -- 172.21.15.49:0/1656445063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e680703c0 msgr2=0x7f7e680c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.242+0000 7f7e6d800640 1 --2- 172.21.15.49:0/1656445063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e680703c0 0x7f7e680c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.242+0000 7f7e6d800640 1 -- 172.21.15.49:0/1656445063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e60009a70 con 0x7f7e6815e770 2024-01-31T05:05:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.242+0000 7f7e67e00640 1 --2- 172.21.15.49:0/1656445063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e680703c0 0x7f7e680c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.242+0000 7f7e6d800640 1 --2- 172.21.15.49:0/1656445063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e6815e770 0x7f7e680c8470 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7e600b0040 tx=0x7f7e600196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.242+0000 7f7e64c00640 1 -- 172.21.15.49:0/1656445063 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e600ad850 con 0x7f7e6815e770 2024-01-31T05:05:05.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.242+0000 7f7e64c00640 1 -- 172.21.15.49:0/1656445063 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e600a5800 con 0x7f7e6815e770 2024-01-31T05:05:05.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.242+0000 7f7e64c00640 1 -- 172.21.15.49:0/1656445063 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e600adc30 con 0x7f7e6815e770 2024-01-31T05:05:05.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.242+0000 7f7e6f800640 1 -- 172.21.15.49:0/1656445063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e680caf10 con 0x7f7e6815e770 2024-01-31T05:05:05.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.242+0000 7f7e6f800640 1 -- 172.21.15.49:0/1656445063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e68159180 con 0x7f7e6815e770 2024-01-31T05:05:05.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.242+0000 7f7e6f800640 1 -- 172.21.15.49:0/1656445063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e68158fe0 con 0x7f7e6815e770 2024-01-31T05:05:05.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.242+0000 7f7e64c00640 1 -- 172.21.15.49:0/1656445063 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f7e600b4050 con 0x7f7e6815e770 2024-01-31T05:05:05.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.246+0000 7f7e64c00640 1 --2- 172.21.15.49:0/1656445063 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7e40066500 0x7f7e400689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:05.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.246+0000 7f7e64c00640 1 -- 172.21.15.49:0/1656445063 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7e6011f060 con 0x7f7e6815e770 2024-01-31T05:05:05.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.246+0000 7f7e6ce00640 1 --2- 172.21.15.49:0/1656445063 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7e40066500 0x7f7e400689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:05.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.246+0000 7f7e6ce00640 1 --2- 172.21.15.49:0/1656445063 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7e40066500 0x7f7e400689c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7e58000f70 tx=0x7f7e58007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.250+0000 7f7e64c00640 1 -- 172.21.15.49:0/1656445063 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f7e68158fe0 con 0x7f7e6815e770 2024-01-31T05:05:05.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.410+0000 7f7e6f800640 1 -- 172.21.15.49:0/1656445063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e68158fe0 con 0x7f7e6815e770 2024-01-31T05:05:05.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.410+0000 7f7e64c00640 1 -- 172.21.15.49:0/1656445063 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7f7e68158fe0 con 0x7f7e6815e770 2024-01-31T05:05:05.410 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:05.410 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:58.277568+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:05.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.414+0000 7f7e6f800640 1 -- 172.21.15.49:0/1656445063 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7e40066500 msgr2=0x7f7e400689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:05.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.414+0000 7f7e6f800640 1 --2- 172.21.15.49:0/1656445063 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7e40066500 0x7f7e400689c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7e58000f70 tx=0x7f7e58007df0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.414+0000 7f7e6f800640 1 -- 172.21.15.49:0/1656445063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e6815e770 msgr2=0x7f7e680c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:05.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.414+0000 7f7e6f800640 1 --2- 172.21.15.49:0/1656445063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e6815e770 0x7f7e680c8470 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7e600b0040 tx=0x7f7e600196f0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.414+0000 7f7e6f800640 1 -- 172.21.15.49:0/1656445063 shutdown_connections 2024-01-31T05:05:05.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.414+0000 7f7e6f800640 1 --2- 172.21.15.49:0/1656445063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e6815e770 0x7f7e680c8470 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.414+0000 7f7e6f800640 1 --2- 172.21.15.49:0/1656445063 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7e40066500 0x7f7e400689c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.414+0000 7f7e6f800640 1 --2- 172.21.15.49:0/1656445063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e680703c0 0x7f7e680c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.414+0000 7f7e6f800640 1 --2- 172.21.15.49:0/1656445063 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e6806fe70 0x7f7e681472c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.414+0000 7f7e6f800640 1 -- 172.21.15.49:0/1656445063 >> 172.21.15.49:0/1656445063 conn(0x7f7e680d0e60 msgr2=0x7f7e680cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:05.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.414+0000 7f7e6f800640 1 -- 172.21.15.49:0/1656445063 shutdown_connections 2024-01-31T05:05:05.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.414+0000 7f7e6f800640 1 -- 172.21.15.49:0/1656445063 wait complete. 2024-01-31T05:05:05.433 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:04:14.566345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:04:15.231265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-31T05:04:18.316756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-31T05:05:05.433 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:05:05.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.578+0000 7fcc22800640 1 Processor -- start 2024-01-31T05:05:05.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.578+0000 7fcc22800640 1 -- start start 2024-01-31T05:05:05.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.578+0000 7fcc22800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcc1c15e7e0 0x7fcc1c0b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:05.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.578+0000 7fcc22800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcc1c0cf670 0x7fcc1c0cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:05.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.578+0000 7fcc22800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1c0c67f0 con 0x7fcc1c0c63d0 2024-01-31T05:05:05.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.578+0000 7fcc22800640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1c0d1d40 con 0x7fcc1c15e7e0 2024-01-31T05:05:05.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.578+0000 7fcc22800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1c0c6ab0 con 0x7fcc1c0cf670 2024-01-31T05:05:05.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.578+0000 7fcc1b400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcc1c15e7e0 0x7fcc1c0b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:05.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.578+0000 7fcc1b400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcc1c15e7e0 0x7fcc1c0b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45766/0 (socket says 172.21.15.49:45766) 2024-01-31T05:05:05.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.578+0000 7fcc1b400640 1 -- 172.21.15.49:0/3930367143 learned_addr learned my addr 172.21.15.49:0/3930367143 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:05.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.578+0000 7fcc1be00640 1 --2- 172.21.15.49:0/3930367143 >> v2:172.21.15.195:3300/0 conn(0x7fcc1c0cf670 0x7fcc1c0cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:05.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.578+0000 7fcc1b400640 1 -- 172.21.15.49:0/3930367143 >> v2:172.21.15.195:3300/0 conn(0x7fcc1c0cf670 msgr2=0x7fcc1c0cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:05.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.578+0000 7fcc1b400640 1 --2- 172.21.15.49:0/3930367143 >> v2:172.21.15.195:3300/0 conn(0x7fcc1c0cf670 0x7fcc1c0cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.578+0000 7fcc1b400640 1 -- 172.21.15.49:0/3930367143 >> v1:172.21.15.195:6789/0 conn(0x7fcc1c0c63d0 legacy=0x7fcc1c0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:05.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.578+0000 7fcc1b400640 1 -- 172.21.15.49:0/3930367143 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c0c6d90 con 0x7fcc1c15e7e0 2024-01-31T05:05:05.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.582+0000 7fcc1b400640 1 --2- 172.21.15.49:0/3930367143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c15e7e0 0x7fcc1c0b2370 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c0c46a0 tx=0x7fcc0c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6444f80e4aef63 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:05.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.582+0000 7fcc1a000640 1 -- 172.21.15.49:0/3930367143 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c0a89f0 con 0x7fcc1c15e7e0 2024-01-31T05:05:05.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.582+0000 7fcc1a000640 1 -- 172.21.15.49:0/3930367143 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0c0a8b50 con 0x7fcc1c15e7e0 2024-01-31T05:05:05.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.582+0000 7fcc1a000640 1 -- 172.21.15.49:0/3930367143 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c0b0440 con 0x7fcc1c15e7e0 2024-01-31T05:05:05.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.582+0000 7fcc22800640 1 -- 172.21.15.49:0/3930367143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c15e7e0 msgr2=0x7fcc1c0b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:05.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.582+0000 7fcc22800640 1 --2- 172.21.15.49:0/3930367143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c15e7e0 0x7fcc1c0b2370 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c0c46a0 tx=0x7fcc0c01ecf0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.582+0000 7fcc22800640 1 -- 172.21.15.49:0/3930367143 shutdown_connections 2024-01-31T05:05:05.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.582+0000 7fcc22800640 1 --2- 172.21.15.49:0/3930367143 >> v2:172.21.15.195:3300/0 conn(0x7fcc1c0cf670 0x7fcc1c0cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.582+0000 7fcc22800640 1 --2- 172.21.15.49:0/3930367143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c15e7e0 0x7fcc1c0b2370 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.582+0000 7fcc22800640 1 -- 172.21.15.49:0/3930367143 >> 172.21.15.49:0/3930367143 conn(0x7fcc1c0d0e60 msgr2=0x7fcc1c0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:05.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.582+0000 7fcc22800640 1 -- 172.21.15.49:0/3930367143 shutdown_connections 2024-01-31T05:05:05.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.582+0000 7fcc22800640 1 -- 172.21.15.49:0/3930367143 wait complete. 2024-01-31T05:05:05.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc22800640 1 Processor -- start 2024-01-31T05:05:05.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc22800640 1 -- start start 2024-01-31T05:05:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc22800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc1c0c63d0 0x7fcc1c1482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc22800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c0cf670 0x7fcc1c0cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc22800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc1c15e7e0 0x7fcc1c0cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc22800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c1487f0 con 0x7fcc1c0cf670 2024-01-31T05:05:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc22800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0b4610 con 0x7fcc1c15e7e0 2024-01-31T05:05:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc22800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0b48f0 con 0x7fcc1c0c63d0 2024-01-31T05:05:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc1aa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c0cf670 0x7fcc1c0cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc1aa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c0cf670 0x7fcc1c0cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45770/0 (socket says 172.21.15.49:45770) 2024-01-31T05:05:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc1aa00640 1 -- 172.21.15.49:0/781734238 learned_addr learned my addr 172.21.15.49:0/781734238 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc1b400640 1 --2- 172.21.15.49:0/781734238 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc1c0c63d0 0x7fcc1c1482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc1be00640 1 --2- 172.21.15.49:0/781734238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc1c15e7e0 0x7fcc1c0cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:05.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc1aa00640 1 -- 172.21.15.49:0/781734238 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc1c0c63d0 msgr2=0x7fcc1c1482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc1aa00640 1 --2- 172.21.15.49:0/781734238 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc1c0c63d0 0x7fcc1c1482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc1aa00640 1 -- 172.21.15.49:0/781734238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc1c15e7e0 msgr2=0x7fcc1c0cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc1aa00640 1 --2- 172.21.15.49:0/781734238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc1c15e7e0 0x7fcc1c0cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc1aa00640 1 -- 172.21.15.49:0/781734238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c0094d0 con 0x7fcc1c0cf670 2024-01-31T05:05:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc1be00640 1 --2- 172.21.15.49:0/781734238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc1c15e7e0 0x7fcc1c0cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:05.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc1aa00640 1 --2- 172.21.15.49:0/781734238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c0cf670 0x7fcc1c0cc990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400c370 tx=0x7fcc0400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:05.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc13400640 1 -- 172.21.15.49:0/781734238 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc040052d0 con 0x7fcc1c0cf670 2024-01-31T05:05:05.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc13400640 1 -- 172.21.15.49:0/781734238 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc04005430 con 0x7fcc1c0cf670 2024-01-31T05:05:05.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.586+0000 7fcc22800640 1 -- 172.21.15.49:0/781734238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c0b4ca0 con 0x7fcc1c0cf670 2024-01-31T05:05:05.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.590+0000 7fcc13400640 1 -- 172.21.15.49:0/781734238 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc04007260 con 0x7fcc1c0cf670 2024-01-31T05:05:05.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.590+0000 7fcc22800640 1 -- 172.21.15.49:0/781734238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1c0b5260 con 0x7fcc1c0cf670 2024-01-31T05:05:05.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.590+0000 7fcc22800640 1 -- 172.21.15.49:0/781734238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1c074860 con 0x7fcc1c0cf670 2024-01-31T05:05:05.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.590+0000 7fcc13400640 1 -- 172.21.15.49:0/781734238 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fcc040073c0 con 0x7fcc1c0cf670 2024-01-31T05:05:05.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.590+0000 7fcc13400640 1 --2- 172.21.15.49:0/781734238 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcbf4066500 0x7fcbf40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:05.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.590+0000 7fcc13400640 1 -- 172.21.15.49:0/781734238 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcc04083600 con 0x7fcc1c0cf670 2024-01-31T05:05:05.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.590+0000 7fcc1b400640 1 --2- 172.21.15.49:0/781734238 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcbf4066500 0x7fcbf40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:05.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.590+0000 7fcc1b400640 1 --2- 172.21.15.49:0/781734238 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcbf4066500 0x7fcbf40689c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c0b2000 tx=0x7fcc0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:05.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.594+0000 7fcc13400640 1 -- 172.21.15.49:0/781734238 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fcc04050500 con 0x7fcc1c0cf670 2024-01-31T05:05:05.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.754+0000 7fcc22800640 1 -- 172.21.15.49:0/781734238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc1c067bf0 con 0x7fcc1c0cf670 2024-01-31T05:05:05.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.754+0000 7fcc13400640 1 -- 172.21.15.49:0/781734238 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc04053b20 con 0x7fcc1c0cf670 2024-01-31T05:05:05.755 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:05:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.758+0000 7fcc22800640 1 -- 172.21.15.49:0/781734238 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcbf4066500 msgr2=0x7fcbf40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.758+0000 7fcc22800640 1 --2- 172.21.15.49:0/781734238 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcbf4066500 0x7fcbf40689c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c0b2000 tx=0x7fcc0c009040 comp rx=0 tx=0).stop 2024-01-31T05:05:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.758+0000 7fcc22800640 1 -- 172.21.15.49:0/781734238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c0cf670 msgr2=0x7fcc1c0cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.758+0000 7fcc22800640 1 --2- 172.21.15.49:0/781734238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c0cf670 0x7fcc1c0cc990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400c370 tx=0x7fcc0400c830 comp rx=0 tx=0).stop 2024-01-31T05:05:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.758+0000 7fcc22800640 1 -- 172.21.15.49:0/781734238 shutdown_connections 2024-01-31T05:05:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.758+0000 7fcc22800640 1 --2- 172.21.15.49:0/781734238 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcbf4066500 0x7fcbf40689c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.758+0000 7fcc22800640 1 --2- 172.21.15.49:0/781734238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc1c15e7e0 0x7fcc1c0cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.758+0000 7fcc22800640 1 --2- 172.21.15.49:0/781734238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc1c0cf670 0x7fcc1c0cc990 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.758+0000 7fcc22800640 1 --2- 172.21.15.49:0/781734238 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc1c0c63d0 0x7fcc1c1482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.758+0000 7fcc22800640 1 -- 172.21.15.49:0/781734238 >> 172.21.15.49:0/781734238 conn(0x7fcc1c0d0e60 msgr2=0x7fcc1c0cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.758+0000 7fcc22800640 1 -- 172.21.15.49:0/781734238 shutdown_connections 2024-01-31T05:05:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.758+0000 7fcc22800640 1 -- 172.21.15.49:0/781734238 wait complete. 2024-01-31T05:05:05.776 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:05:05.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.922+0000 7fd5c7200640 1 Processor -- start 2024-01-31T05:05:05.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.922+0000 7fd5c7200640 1 -- start start 2024-01-31T05:05:05.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.922+0000 7fd5c7200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd5c00b30e0 0x7fd5c015e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.922+0000 7fd5c7200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd5c00b34c0 0x7fd5c00720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.922+0000 7fd5c7200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c00703c0 con 0x7fd5c006c2d0 2024-01-31T05:05:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.922+0000 7fd5c7200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c00b1dd0 con 0x7fd5c00b34c0 2024-01-31T05:05:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.922+0000 7fd5c7200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c0070610 con 0x7fd5c00b30e0 2024-01-31T05:05:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.922+0000 7fd5bf400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd5c00b34c0 0x7fd5c00720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.922+0000 7fd5bf400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd5c00b34c0 0x7fd5c00720e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45780/0 (socket says 172.21.15.49:45780) 2024-01-31T05:05:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.922+0000 7fd5bf400640 1 -- 172.21.15.49:0/3114537246 learned_addr learned my addr 172.21.15.49:0/3114537246 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:05.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.922+0000 7fd5bf400640 1 -- 172.21.15.49:0/3114537246 >> v2:172.21.15.195:3300/0 conn(0x7fd5c00b30e0 msgr2=0x7fd5c015e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:05.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.922+0000 7fd5bf400640 1 --2- 172.21.15.49:0/3114537246 >> v2:172.21.15.195:3300/0 conn(0x7fd5c00b30e0 0x7fd5c015e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.922+0000 7fd5bf400640 1 -- 172.21.15.49:0/3114537246 >> v1:172.21.15.195:6789/0 conn(0x7fd5c006c2d0 legacy=0x7fd5c00b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:05.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.922+0000 7fd5bf400640 1 -- 172.21.15.49:0/3114537246 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c00708f0 con 0x7fd5c00b34c0 2024-01-31T05:05:05.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.926+0000 7fd5bf400640 1 --2- 172.21.15.49:0/3114537246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c00b34c0 0x7fd5c00720e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0072e10 tx=0x7fd5a801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e80687886947eeb server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:05.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.926+0000 7fd5bea00640 1 -- 172.21.15.49:0/3114537246 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a80ab600 con 0x7fd5c00b34c0 2024-01-31T05:05:05.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.926+0000 7fd5bea00640 1 -- 172.21.15.49:0/3114537246 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a80a7050 con 0x7fd5c00b34c0 2024-01-31T05:05:05.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.926+0000 7fd5bea00640 1 -- 172.21.15.49:0/3114537246 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a80ab980 con 0x7fd5c00b34c0 2024-01-31T05:05:05.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.926+0000 7fd5c7200640 1 -- 172.21.15.49:0/3114537246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c00b34c0 msgr2=0x7fd5c00720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:05.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.926+0000 7fd5c7200640 1 --2- 172.21.15.49:0/3114537246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c00b34c0 0x7fd5c00720e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0072e10 tx=0x7fd5a801c3a0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.926+0000 7fd5c7200640 1 -- 172.21.15.49:0/3114537246 shutdown_connections 2024-01-31T05:05:05.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.926+0000 7fd5c7200640 1 --2- 172.21.15.49:0/3114537246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c00b34c0 0x7fd5c00720e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.926+0000 7fd5c7200640 1 --2- 172.21.15.49:0/3114537246 >> v2:172.21.15.195:3300/0 conn(0x7fd5c00b30e0 0x7fd5c015e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.926+0000 7fd5c7200640 1 -- 172.21.15.49:0/3114537246 >> 172.21.15.49:0/3114537246 conn(0x7fd5c00b09a0 msgr2=0x7fd5c00b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:05.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.926+0000 7fd5c7200640 1 -- 172.21.15.49:0/3114537246 shutdown_connections 2024-01-31T05:05:05.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.926+0000 7fd5c7200640 1 -- 172.21.15.49:0/3114537246 wait complete. 2024-01-31T05:05:05.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5c7200640 1 Processor -- start 2024-01-31T05:05:05.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5c7200640 1 -- start start 2024-01-31T05:05:05.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5c7200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c006c2d0 0x7fd5c014af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:05.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5c7200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5c00b30e0 0x7fd5c009c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:05.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5c7200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5c00b34c0 0x7fd5c0152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:05.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5c7200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c01518e0 con 0x7fd5c006c2d0 2024-01-31T05:05:05.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5c7200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c0151bc0 con 0x7fd5c00b30e0 2024-01-31T05:05:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5c7200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c0151ea0 con 0x7fd5c00b34c0 2024-01-31T05:05:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5bfe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c006c2d0 0x7fd5c014af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5bfe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c006c2d0 0x7fd5c014af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45796/0 (socket says 172.21.15.49:45796) 2024-01-31T05:05:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5bfe00640 1 -- 172.21.15.49:0/4119263693 learned_addr learned my addr 172.21.15.49:0/4119263693 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5bf400640 1 --2- 172.21.15.49:0/4119263693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5c00b30e0 0x7fd5c009c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5c5200640 1 --2- 172.21.15.49:0/4119263693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5c00b34c0 0x7fd5c0152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5bfe00640 1 -- 172.21.15.49:0/4119263693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5c00b34c0 msgr2=0x7fd5c0152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5bfe00640 1 --2- 172.21.15.49:0/4119263693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5c00b34c0 0x7fd5c0152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5bfe00640 1 -- 172.21.15.49:0/4119263693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5c00b30e0 msgr2=0x7fd5c009c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5bfe00640 1 --2- 172.21.15.49:0/4119263693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5c00b30e0 0x7fd5c009c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5bfe00640 1 -- 172.21.15.49:0/4119263693 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a80094d0 con 0x7fd5c006c2d0 2024-01-31T05:05:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5bf400640 1 --2- 172.21.15.49:0/4119263693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5c00b30e0 0x7fd5c009c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5bfe00640 1 --2- 172.21.15.49:0/4119263693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c006c2d0 0x7fd5c014af20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd5b000b410 tx=0x7fd5b000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5b7e00640 1 -- 172.21.15.49:0/4119263693 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0011830 con 0x7fd5c006c2d0 2024-01-31T05:05:05.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5b7e00640 1 -- 172.21.15.49:0/4119263693 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b0011990 con 0x7fd5c006c2d0 2024-01-31T05:05:05.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5b7e00640 1 -- 172.21.15.49:0/4119263693 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0011d40 con 0x7fd5c006c2d0 2024-01-31T05:05:05.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5c7200640 1 -- 172.21.15.49:0/4119263693 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c0152180 con 0x7fd5c006c2d0 2024-01-31T05:05:05.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.930+0000 7fd5c7200640 1 -- 172.21.15.49:0/4119263693 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c014b460 con 0x7fd5c006c2d0 2024-01-31T05:05:05.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.934+0000 7fd5c7200640 1 -- 172.21.15.49:0/4119263693 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c01526a0 con 0x7fd5c006c2d0 2024-01-31T05:05:05.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.934+0000 7fd5b7e00640 1 -- 172.21.15.49:0/4119263693 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd5b001a400 con 0x7fd5c006c2d0 2024-01-31T05:05:05.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.934+0000 7fd5b7e00640 1 --2- 172.21.15.49:0/4119263693 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd598066500 0x7fd5980689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:05.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.934+0000 7fd5b7e00640 1 -- 172.21.15.49:0/4119263693 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd5b00843b0 con 0x7fd5c006c2d0 2024-01-31T05:05:05.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.934+0000 7fd5bf400640 1 --2- 172.21.15.49:0/4119263693 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd598066500 0x7fd5980689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:05.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.934+0000 7fd5bf400640 1 --2- 172.21.15.49:0/4119263693 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd598066500 0x7fd5980689c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd5c006e8a0 tx=0x7fd5a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:05.938+0000 7fd5b7e00640 1 -- 172.21.15.49:0/4119263693 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd5c01526a0 con 0x7fd5c006c2d0 2024-01-31T05:05:06.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.098+0000 7fd5c7200640 1 -- 172.21.15.49:0/4119263693 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd5c01526a0 con 0x7fd5c006c2d0 2024-01-31T05:05:06.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.098+0000 7fd5b7e00640 1 -- 172.21.15.49:0/4119263693 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd5c01526a0 con 0x7fd5c006c2d0 2024-01-31T05:05:06.096 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:06.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.098+0000 7fd5c7200640 1 -- 172.21.15.49:0/4119263693 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd598066500 msgr2=0x7fd5980689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:06.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.098+0000 7fd5c7200640 1 --2- 172.21.15.49:0/4119263693 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd598066500 0x7fd5980689c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd5c006e8a0 tx=0x7fd5a8009040 comp rx=0 tx=0).stop 2024-01-31T05:05:06.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.098+0000 7fd5c7200640 1 -- 172.21.15.49:0/4119263693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c006c2d0 msgr2=0x7fd5c014af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:06.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.098+0000 7fd5c7200640 1 --2- 172.21.15.49:0/4119263693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c006c2d0 0x7fd5c014af20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd5b000b410 tx=0x7fd5b000b8d0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.098+0000 7fd5c7200640 1 -- 172.21.15.49:0/4119263693 shutdown_connections 2024-01-31T05:05:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.098+0000 7fd5c7200640 1 --2- 172.21.15.49:0/4119263693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd5c00b34c0 0x7fd5c0152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.098+0000 7fd5c7200640 1 --2- 172.21.15.49:0/4119263693 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd598066500 0x7fd5980689c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.098+0000 7fd5c7200640 1 --2- 172.21.15.49:0/4119263693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5c00b30e0 0x7fd5c009c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.098+0000 7fd5c7200640 1 --2- 172.21.15.49:0/4119263693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5c006c2d0 0x7fd5c014af20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.098+0000 7fd5c7200640 1 -- 172.21.15.49:0/4119263693 >> 172.21.15.49:0/4119263693 conn(0x7fd5c00b09a0 msgr2=0x7fd5c006cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.098+0000 7fd5c7200640 1 -- 172.21.15.49:0/4119263693 shutdown_connections 2024-01-31T05:05:06.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.098+0000 7fd5c7200640 1 -- 172.21.15.49:0/4119263693 wait complete. 2024-01-31T05:05:06.119 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:05:06.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.262+0000 7f69a5400640 1 Processor -- start 2024-01-31T05:05:06.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.262+0000 7f69a5400640 1 -- start start 2024-01-31T05:05:06.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.266+0000 7f69a5400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f69a0070660 0x7f69a0070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.266+0000 7f69a5400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f69a00ac050 0x7f69a00ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.266+0000 7f69a5400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a0071000 con 0x7f69a0159790 2024-01-31T05:05:06.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.266+0000 7f69a5400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a0159b70 con 0x7f69a0070660 2024-01-31T05:05:06.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.266+0000 7f69a5400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a00b2750 con 0x7f69a00ac050 2024-01-31T05:05:06.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.266+0000 7f699de00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f69a0070660 0x7f69a0070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.266+0000 7f699e800640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f69a0159790 0x7f69a00b37c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33582/0 (socket says 172.21.15.49:33582) 2024-01-31T05:05:06.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.266+0000 7f699e800640 1 -- 172.21.15.49:0/253416709 learned_addr learned my addr 172.21.15.49:0/253416709 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.266+0000 7f699f200640 1 --2- 172.21.15.49:0/253416709 >> v2:172.21.15.195:3300/0 conn(0x7f69a00ac050 0x7f69a00ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.266+0000 7f699de00640 1 -- 172.21.15.49:0/253416709 >> v2:172.21.15.195:3300/0 conn(0x7f69a00ac050 msgr2=0x7f69a00ac4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.266+0000 7f699de00640 1 --2- 172.21.15.49:0/253416709 >> v2:172.21.15.195:3300/0 conn(0x7f69a00ac050 0x7f69a00ac4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.266+0000 7f699de00640 1 -- 172.21.15.49:0/253416709 >> v1:172.21.15.49:6789/0 conn(0x7f69a0159790 legacy=0x7f69a00b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.266+0000 7f699d400640 1 -- 172.21.15.49:0/253416709 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900734318 0 0) 0x7f69a0071000 con 0x7f69a0159790 2024-01-31T05:05:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.266+0000 7f699de00640 1 -- 172.21.15.49:0/253416709 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a00b2a30 con 0x7f69a0070660 2024-01-31T05:05:06.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.270+0000 7f699de00640 1 --2- 172.21.15.49:0/253416709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69a0070660 0x7f69a0070ac0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f69a00b1690 tx=0x7f698801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba451b0b34fabc5 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:06.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.270+0000 7f699d400640 1 -- 172.21.15.49:0/253416709 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69880ac410 con 0x7f69a0070660 2024-01-31T05:05:06.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.270+0000 7f699d400640 1 -- 172.21.15.49:0/253416709 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69880ac570 con 0x7f69a0070660 2024-01-31T05:05:06.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.270+0000 7f699d400640 1 -- 172.21.15.49:0/253416709 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69880ac900 con 0x7f69a0070660 2024-01-31T05:05:06.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.270+0000 7f69a5400640 1 -- 172.21.15.49:0/253416709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69a0070660 msgr2=0x7f69a0070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:06.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.270+0000 7f69a5400640 1 --2- 172.21.15.49:0/253416709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69a0070660 0x7f69a0070ac0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f69a00b1690 tx=0x7f698801c430 comp rx=0 tx=0).stop 2024-01-31T05:05:06.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.270+0000 7f69a5400640 1 -- 172.21.15.49:0/253416709 shutdown_connections 2024-01-31T05:05:06.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.270+0000 7f69a5400640 1 --2- 172.21.15.49:0/253416709 >> v2:172.21.15.195:3300/0 conn(0x7f69a00ac050 0x7f69a00ac4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.270+0000 7f69a5400640 1 --2- 172.21.15.49:0/253416709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69a0070660 0x7f69a0070ac0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.270+0000 7f69a5400640 1 -- 172.21.15.49:0/253416709 >> 172.21.15.49:0/253416709 conn(0x7f69a00b09a0 msgr2=0x7f69a00b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:06.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.270+0000 7f69a5400640 1 -- 172.21.15.49:0/253416709 shutdown_connections 2024-01-31T05:05:06.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.270+0000 7f69a5400640 1 -- 172.21.15.49:0/253416709 wait complete. 2024-01-31T05:05:06.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.270+0000 7f69a5400640 1 Processor -- start 2024-01-31T05:05:06.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f69a5400640 1 -- start start 2024-01-31T05:05:06.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f69a5400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69a0070660 0x7f69a00cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f69a5400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f69a00ac050 0x7f69a0153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f69a5400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69a0159790 0x7f69a013f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f69a5400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a0151d30 con 0x7f69a0159790 2024-01-31T05:05:06.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f69a5400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a0154130 con 0x7f69a0070660 2024-01-31T05:05:06.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f69a5400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a01513d0 con 0x7f69a00ac050 2024-01-31T05:05:06.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f699f200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69a0159790 0x7f69a013f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f699f200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69a0159790 0x7f69a013f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45810/0 (socket says 172.21.15.49:45810) 2024-01-31T05:05:06.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f699f200640 1 -- 172.21.15.49:0/543532573 learned_addr learned my addr 172.21.15.49:0/543532573 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:06.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f699de00640 1 --2- 172.21.15.49:0/543532573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f69a00ac050 0x7f69a0153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f699e800640 1 --2- 172.21.15.49:0/543532573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69a0070660 0x7f69a00cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f699f200640 1 -- 172.21.15.49:0/543532573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f69a00ac050 msgr2=0x7f69a0153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:06.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f699f200640 1 --2- 172.21.15.49:0/543532573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f69a00ac050 0x7f69a0153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f699f200640 1 -- 172.21.15.49:0/543532573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69a0070660 msgr2=0x7f69a00cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:06.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f699f200640 1 --2- 172.21.15.49:0/543532573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69a0070660 0x7f69a00cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f699f200640 1 -- 172.21.15.49:0/543532573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6988009420 con 0x7f69a0159790 2024-01-31T05:05:06.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f699f200640 1 --2- 172.21.15.49:0/543532573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69a0159790 0x7f69a013f450 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6998007e40 tx=0x7f699800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:06.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f6996a00640 1 -- 172.21.15.49:0/543532573 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6998014620 con 0x7f69a0159790 2024-01-31T05:05:06.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f6996a00640 1 -- 172.21.15.49:0/543532573 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699800ee90 con 0x7f69a0159790 2024-01-31T05:05:06.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f69a5400640 1 -- 172.21.15.49:0/543532573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a0151670 con 0x7f69a0159790 2024-01-31T05:05:06.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f6996a00640 1 -- 172.21.15.49:0/543532573 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69980149e0 con 0x7f69a0159790 2024-01-31T05:05:06.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f69a5400640 1 -- 172.21.15.49:0/543532573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a00cbc60 con 0x7f69a0159790 2024-01-31T05:05:06.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.274+0000 7f69a5400640 1 -- 172.21.15.49:0/543532573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a0151e70 con 0x7f69a0159790 2024-01-31T05:05:06.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.278+0000 7f6996a00640 1 -- 172.21.15.49:0/543532573 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f6998014b40 con 0x7f69a0159790 2024-01-31T05:05:06.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.278+0000 7f6996a00640 1 --2- 172.21.15.49:0/543532573 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6978066500 0x7f69780689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.278+0000 7f6996a00640 1 -- 172.21.15.49:0/543532573 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6998084a50 con 0x7f69a0159790 2024-01-31T05:05:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.278+0000 7f699e800640 1 --2- 172.21.15.49:0/543532573 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6978066500 0x7f69780689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.278+0000 7f699e800640 1 --2- 172.21.15.49:0/543532573 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6978066500 0x7f69780689c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6990000f70 tx=0x7f6990007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:06.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.282+0000 7f6996a00640 1 -- 172.21.15.49:0/543532573 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f69a0151e70 con 0x7f69a0159790 2024-01-31T05:05:06.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.442+0000 7f69a5400640 1 -- 172.21.15.49:0/543532573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69a0151e70 con 0x7f69a0159790 2024-01-31T05:05:06.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.442+0000 7f6996a00640 1 -- 172.21.15.49:0/543532573 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f69a0151e70 con 0x7f69a0159790 2024-01-31T05:05:06.444 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-31T05:05:06.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.446+0000 7f69a5400640 1 -- 172.21.15.49:0/543532573 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6978066500 msgr2=0x7f69780689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:06.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.446+0000 7f69a5400640 1 --2- 172.21.15.49:0/543532573 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6978066500 0x7f69780689c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6990000f70 tx=0x7f6990007df0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.446+0000 7f69a5400640 1 -- 172.21.15.49:0/543532573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69a0159790 msgr2=0x7f69a013f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:06.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.446+0000 7f69a5400640 1 --2- 172.21.15.49:0/543532573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69a0159790 0x7f69a013f450 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6998007e40 tx=0x7f699800e4b0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.446+0000 7f69a5400640 1 -- 172.21.15.49:0/543532573 shutdown_connections 2024-01-31T05:05:06.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.446+0000 7f69a5400640 1 --2- 172.21.15.49:0/543532573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69a0159790 0x7f69a013f450 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.446+0000 7f69a5400640 1 --2- 172.21.15.49:0/543532573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f69a00ac050 0x7f69a0153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.446+0000 7f69a5400640 1 --2- 172.21.15.49:0/543532573 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6978066500 0x7f69780689c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.446+0000 7f69a5400640 1 --2- 172.21.15.49:0/543532573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69a0070660 0x7f69a00cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.446+0000 7f69a5400640 1 -- 172.21.15.49:0/543532573 >> 172.21.15.49:0/543532573 conn(0x7f69a00b09a0 msgr2=0x7f69a0158340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:06.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.446+0000 7f69a5400640 1 -- 172.21.15.49:0/543532573 shutdown_connections 2024-01-31T05:05:06.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.446+0000 7f69a5400640 1 -- 172.21.15.49:0/543532573 wait complete. 2024-01-31T05:05:06.465 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-31T05:05:06.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.610+0000 7f8145e00640 1 Processor -- start 2024-01-31T05:05:06.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.610+0000 7f8145e00640 1 -- start start 2024-01-31T05:05:06.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.614+0000 7f8145e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f814015b110 0x7f814006c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.614+0000 7f8145e00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814015b4f0 con 0x7f81400cdf10 2024-01-31T05:05:06.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.614+0000 7f8145e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81400abf20 con 0x7f81400714e0 2024-01-31T05:05:06.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.614+0000 7f8145e00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81400ce460 con 0x7f814015b110 2024-01-31T05:05:06.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.614+0000 7f813ea00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f814015b110 0x7f814006c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.614+0000 7f813ea00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f814015b110 0x7f814006c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45820/0 (socket says 172.21.15.49:45820) 2024-01-31T05:05:06.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.614+0000 7f813ea00640 1 -- 172.21.15.49:0/3391214684 learned_addr learned my addr 172.21.15.49:0/3391214684 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:06.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.614+0000 7f813ea00640 1 -- 172.21.15.49:0/3391214684 >> v1:172.21.15.195:6789/0 conn(0x7f81400714e0 legacy=0x7f81400ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:06.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.614+0000 7f813ea00640 1 -- 172.21.15.49:0/3391214684 >> v1:172.21.15.49:6789/0 conn(0x7f81400cdf10 legacy=0x7f8140070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:06.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.614+0000 7f813ea00640 1 -- 172.21.15.49:0/3391214684 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81400ac200 con 0x7f814015b110 2024-01-31T05:05:06.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.618+0000 7f813ea00640 1 --2- 172.21.15.49:0/3391214684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f814015b110 0x7f814006c2d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8130009870 tx=0x7f813001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d6e3a0bc991ffd8 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:06.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.618+0000 7f813d600640 1 -- 172.21.15.49:0/3391214684 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81300ab620 con 0x7f814015b110 2024-01-31T05:05:06.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.618+0000 7f813d600640 1 -- 172.21.15.49:0/3391214684 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81300ab780 con 0x7f814015b110 2024-01-31T05:05:06.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.618+0000 7f813d600640 1 -- 172.21.15.49:0/3391214684 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81300abb10 con 0x7f814015b110 2024-01-31T05:05:06.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.618+0000 7f8145e00640 1 -- 172.21.15.49:0/3391214684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f814015b110 msgr2=0x7f814006c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:06.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.618+0000 7f8145e00640 1 --2- 172.21.15.49:0/3391214684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f814015b110 0x7f814006c2d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8130009870 tx=0x7f813001c510 comp rx=0 tx=0).stop 2024-01-31T05:05:06.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.618+0000 7f8145e00640 1 -- 172.21.15.49:0/3391214684 shutdown_connections 2024-01-31T05:05:06.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.618+0000 7f8145e00640 1 --2- 172.21.15.49:0/3391214684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f814015b110 0x7f814006c2d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.618+0000 7f8145e00640 1 -- 172.21.15.49:0/3391214684 >> 172.21.15.49:0/3391214684 conn(0x7f81400b09a0 msgr2=0x7f81400b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:06.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.618+0000 7f8145e00640 1 -- 172.21.15.49:0/3391214684 shutdown_connections 2024-01-31T05:05:06.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.618+0000 7f8145e00640 1 -- 172.21.15.49:0/3391214684 wait complete. 2024-01-31T05:05:06.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.618+0000 7f8145e00640 1 Processor -- start 2024-01-31T05:05:06.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.618+0000 7f8145e00640 1 -- start start 2024-01-31T05:05:06.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f8145e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81400714e0 0x7f8140146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f8145e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81400cdf10 0x7f8140166300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f8145e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f814015b110 0x7f814015b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f8145e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81400b3e00 con 0x7f814015b110 2024-01-31T05:05:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f8145e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8140146da0 con 0x7f81400714e0 2024-01-31T05:05:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f8145e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8140166da0 con 0x7f81400cdf10 2024-01-31T05:05:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f813f400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f814015b110 0x7f814015b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f813f400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f814015b110 0x7f814015b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45834/0 (socket says 172.21.15.49:45834) 2024-01-31T05:05:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f813f400640 1 -- 172.21.15.49:0/2916010677 learned_addr learned my addr 172.21.15.49:0/2916010677 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f813ea00640 1 --2- 172.21.15.49:0/2916010677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81400714e0 0x7f8140146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f813e000640 1 --2- 172.21.15.49:0/2916010677 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81400cdf10 0x7f8140166300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f813f400640 1 -- 172.21.15.49:0/2916010677 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81400cdf10 msgr2=0x7f8140166300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:06.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f813f400640 1 --2- 172.21.15.49:0/2916010677 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81400cdf10 0x7f8140166300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f813f400640 1 -- 172.21.15.49:0/2916010677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81400714e0 msgr2=0x7f8140146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:06.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f813f400640 1 --2- 172.21.15.49:0/2916010677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81400714e0 0x7f8140146860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f813f400640 1 -- 172.21.15.49:0/2916010677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81300094d0 con 0x7f814015b110 2024-01-31T05:05:06.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f813f400640 1 --2- 172.21.15.49:0/2916010677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f814015b110 0x7f814015b980 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f813800c730 tx=0x7f813800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:06.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f8137400640 1 -- 172.21.15.49:0/2916010677 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138003b80 con 0x7f814015b110 2024-01-31T05:05:06.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f8137400640 1 -- 172.21.15.49:0/2916010677 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8138003ce0 con 0x7f814015b110 2024-01-31T05:05:06.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f8145e00640 1 -- 172.21.15.49:0/2916010677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8140166840 con 0x7f814015b110 2024-01-31T05:05:06.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f8137400640 1 -- 172.21.15.49:0/2916010677 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813800aa30 con 0x7f814015b110 2024-01-31T05:05:06.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f8145e00640 1 -- 172.21.15.49:0/2916010677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81401fa070 con 0x7f814015b110 2024-01-31T05:05:06.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f8145e00640 1 -- 172.21.15.49:0/2916010677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81401f9ed0 con 0x7f814015b110 2024-01-31T05:05:06.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.622+0000 7f8137400640 1 -- 172.21.15.49:0/2916010677 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f813800ab90 con 0x7f814015b110 2024-01-31T05:05:06.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.626+0000 7f8137400640 1 --2- 172.21.15.49:0/2916010677 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8118066500 0x7f81180689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.626+0000 7f8137400640 1 -- 172.21.15.49:0/2916010677 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8138083fe0 con 0x7f814015b110 2024-01-31T05:05:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.626+0000 7f813ea00640 1 --2- 172.21.15.49:0/2916010677 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8118066500 0x7f81180689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.626+0000 7f813ea00640 1 --2- 172.21.15.49:0/2916010677 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8118066500 0x7f81180689c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81300af000 tx=0x7f81300b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:06.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.630+0000 7f8137400640 1 -- 172.21.15.49:0/2916010677 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f81401f9ed0 con 0x7f814015b110 2024-01-31T05:05:06.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.786+0000 7f8145e00640 1 -- 172.21.15.49:0/2916010677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f81401f9ed0 con 0x7f814015b110 2024-01-31T05:05:06.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.786+0000 7f8137400640 1 -- 172.21.15.49:0/2916010677 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f81401f9ed0 con 0x7f814015b110 2024-01-31T05:05:06.787 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.790+0000 7f8145e00640 1 -- 172.21.15.49:0/2916010677 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8118066500 msgr2=0x7f81180689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:06.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.790+0000 7f8145e00640 1 --2- 172.21.15.49:0/2916010677 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8118066500 0x7f81180689c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81300af000 tx=0x7f81300b6040 comp rx=0 tx=0).stop 2024-01-31T05:05:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.790+0000 7f8145e00640 1 -- 172.21.15.49:0/2916010677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f814015b110 msgr2=0x7f814015b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.790+0000 7f8145e00640 1 --2- 172.21.15.49:0/2916010677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f814015b110 0x7f814015b980 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f813800c730 tx=0x7f813800cbf0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.790+0000 7f8145e00640 1 -- 172.21.15.49:0/2916010677 shutdown_connections 2024-01-31T05:05:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.790+0000 7f8145e00640 1 --2- 172.21.15.49:0/2916010677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f814015b110 0x7f814015b980 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.790+0000 7f8145e00640 1 --2- 172.21.15.49:0/2916010677 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81400cdf10 0x7f8140166300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.790+0000 7f8145e00640 1 --2- 172.21.15.49:0/2916010677 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8118066500 0x7f81180689c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.790+0000 7f8145e00640 1 --2- 172.21.15.49:0/2916010677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81400714e0 0x7f8140146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.790+0000 7f8145e00640 1 -- 172.21.15.49:0/2916010677 >> 172.21.15.49:0/2916010677 conn(0x7f81400b09a0 msgr2=0x7f81400af7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.790+0000 7f8145e00640 1 -- 172.21.15.49:0/2916010677 shutdown_connections 2024-01-31T05:05:06.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.790+0000 7f8145e00640 1 -- 172.21.15.49:0/2916010677 wait complete. 2024-01-31T05:05:06.810 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:06.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.950+0000 7efcf4200640 1 Processor -- start 2024-01-31T05:05:06.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.950+0000 7efcf4200640 1 -- start start 2024-01-31T05:05:06.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcf4200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efcec159790 0x7efcec0b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcf4200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7efcec0b3d00 0x7efcec070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcf4200640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcec159b70 con 0x7efcec070ba0 2024-01-31T05:05:06.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcf4200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcec071030 con 0x7efcec0b3d00 2024-01-31T05:05:06.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcf4200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcec0b2750 con 0x7efcec159790 2024-01-31T05:05:06.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcf2200640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7efcec070ba0 0x7efcec06cb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33592/0 (socket says 172.21.15.49:33592) 2024-01-31T05:05:06.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcf2200640 1 -- 172.21.15.49:0/1364268395 learned_addr learned my addr 172.21.15.49:0/1364268395 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:06.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcebe00640 1 -- 172.21.15.49:0/1364268395 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014312281 0 0) 0x7efcec159b70 con 0x7efcec070ba0 2024-01-31T05:05:06.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcebe00640 1 -- 172.21.15.49:0/1364268395 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efccc003530 con 0x7efcec070ba0 2024-01-31T05:05:06.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcf1800640 1 --2- 172.21.15.49:0/1364268395 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efcec159790 0x7efcec0b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcf0e00640 1 --2- 172.21.15.49:0/1364268395 >> v2:172.21.15.195:3300/0 conn(0x7efcec0b3d00 0x7efcec070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcebe00640 1 -- 172.21.15.49:0/1364268395 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 832488413 0 0) 0x7efccc003530 con 0x7efcec070ba0 2024-01-31T05:05:06.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcebe00640 1 -- 172.21.15.49:0/1364268395 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efcec159790 msgr2=0x7efcec0b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:06.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcebe00640 1 --2- 172.21.15.49:0/1364268395 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efcec159790 0x7efcec0b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcebe00640 1 -- 172.21.15.49:0/1364268395 >> v2:172.21.15.195:3300/0 conn(0x7efcec0b3d00 msgr2=0x7efcec070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:06.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcebe00640 1 --2- 172.21.15.49:0/1364268395 >> v2:172.21.15.195:3300/0 conn(0x7efcec0b3d00 0x7efcec070660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcebe00640 1 -- 172.21.15.49:0/1364268395 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcec0b2a30 con 0x7efcec070ba0 2024-01-31T05:05:06.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcebe00640 1 -- 172.21.15.49:0/1364268395 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7efce4001a00 con 0x7efcec070ba0 2024-01-31T05:05:06.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcebe00640 1 -- 172.21.15.49:0/1364268395 >> v1:172.21.15.49:6789/0 conn(0x7efcec070ba0 legacy=0x7efcec06cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:06.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcebe00640 1 --2- 172.21.15.49:0/1364268395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efccc003980 0x7efccc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcebe00640 1 --2- 172.21.15.49:0/1364268395 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efcec159790 0x7efccc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcebe00640 1 --2- 172.21.15.49:0/1364268395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efccc004d10 0x7efccc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcebe00640 1 -- 172.21.15.49:0/1364268395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcec071030 con 0x7efccc004d10 2024-01-31T05:05:06.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcebe00640 1 -- 172.21.15.49:0/1364268395 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcec0b2750 con 0x7efccc003980 2024-01-31T05:05:06.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcebe00640 1 -- 172.21.15.49:0/1364268395 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efccc00b990 con 0x7efcec159790 2024-01-31T05:05:06.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcf0e00640 1 --2- 172.21.15.49:0/1364268395 >> v2:172.21.15.195:3300/0 conn(0x7efcec0b3d00 0x7efcec070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:06.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcf2200640 1 --2- 172.21.15.49:0/1364268395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efccc004d10 0x7efccc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcf1800640 1 --2- 172.21.15.49:0/1364268395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efccc003980 0x7efccc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcf0e00640 1 --2- 172.21.15.49:0/1364268395 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efcec159790 0x7efccc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcf2200640 1 -- 172.21.15.49:0/1364268395 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efcec159790 msgr2=0x7efccc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:06.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcf2200640 1 --2- 172.21.15.49:0/1364268395 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efcec159790 0x7efccc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcf2200640 1 -- 172.21.15.49:0/1364268395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efccc003980 msgr2=0x7efccc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:06.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcf2200640 1 --2- 172.21.15.49:0/1364268395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efccc003980 0x7efccc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.954+0000 7efcf2200640 1 -- 172.21.15.49:0/1364268395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc003530 con 0x7efccc004d10 2024-01-31T05:05:06.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.958+0000 7efcf2200640 1 --2- 172.21.15.49:0/1364268395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efccc004d10 0x7efccc005190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efce400a900 tx=0x7efce401d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435733be96b0bc3d server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:06.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.958+0000 7efcebe00640 1 -- 172.21.15.49:0/1364268395 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce40ad630 con 0x7efccc004d10 2024-01-31T05:05:06.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.958+0000 7efcebe00640 1 -- 172.21.15.49:0/1364268395 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce40a8070 con 0x7efccc004d10 2024-01-31T05:05:06.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.958+0000 7efcebe00640 1 -- 172.21.15.49:0/1364268395 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce40ad9f0 con 0x7efccc004d10 2024-01-31T05:05:06.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.958+0000 7efcf4200640 1 -- 172.21.15.49:0/1364268395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efccc004d10 msgr2=0x7efccc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:06.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.958+0000 7efcf4200640 1 --2- 172.21.15.49:0/1364268395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efccc004d10 0x7efccc005190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efce400a900 tx=0x7efce401d3c0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.958+0000 7efcf2200640 1 -- 172.21.15.49:0/1364268395 reap_dead start 2024-01-31T05:05:06.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.958+0000 7efcf4200640 1 -- 172.21.15.49:0/1364268395 shutdown_connections 2024-01-31T05:05:06.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.958+0000 7efcf4200640 1 -- 172.21.15.49:0/1364268395 >> 172.21.15.49:0/1364268395 conn(0x7efcec0b09a0 msgr2=0x7efcec0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:06.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.958+0000 7efcf4200640 1 -- 172.21.15.49:0/1364268395 shutdown_connections 2024-01-31T05:05:06.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.958+0000 7efcf4200640 1 -- 172.21.15.49:0/1364268395 wait complete. 2024-01-31T05:05:06.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf4200640 1 Processor -- start 2024-01-31T05:05:06.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf4200640 1 -- start start 2024-01-31T05:05:06.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf4200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efccc004d10 0x7efcec14d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf4200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efcec147890 0x7efcec145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf4200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcec06c280 0x7efcec06c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf4200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcec06cc40 con 0x7efcec06c280 2024-01-31T05:05:06.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf4200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcec1470b0 con 0x7efccc004d10 2024-01-31T05:05:06.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf4200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcec14dd80 con 0x7efcec147890 2024-01-31T05:05:06.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf2200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcec06c280 0x7efcec06c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf2200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcec06c280 0x7efcec06c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45844/0 (socket says 172.21.15.49:45844) 2024-01-31T05:05:06.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf2200640 1 -- 172.21.15.49:0/3930745534 learned_addr learned my addr 172.21.15.49:0/3930745534 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:06.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf0e00640 1 --2- 172.21.15.49:0/3930745534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efcec147890 0x7efcec145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf1800640 1 --2- 172.21.15.49:0/3930745534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efccc004d10 0x7efcec14d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf2200640 1 -- 172.21.15.49:0/3930745534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efcec147890 msgr2=0x7efcec145ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:06.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf2200640 1 --2- 172.21.15.49:0/3930745534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efcec147890 0x7efcec145ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf2200640 1 -- 172.21.15.49:0/3930745534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efccc004d10 msgr2=0x7efcec14d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:06.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf2200640 1 --2- 172.21.15.49:0/3930745534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efccc004d10 0x7efcec14d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:06.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf2200640 1 -- 172.21.15.49:0/3930745534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcec1464a0 con 0x7efcec06c280 2024-01-31T05:05:06.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf2200640 1 --2- 172.21.15.49:0/3930745534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcec06c280 0x7efcec06c700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efce400a900 tx=0x7efccc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:06.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efce9600640 1 -- 172.21.15.49:0/3930745534 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce40017c0 con 0x7efcec06c280 2024-01-31T05:05:06.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efce9600640 1 -- 172.21.15.49:0/3930745534 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce4001920 con 0x7efcec06c280 2024-01-31T05:05:06.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf4200640 1 -- 172.21.15.49:0/3930745534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcec146780 con 0x7efcec06c280 2024-01-31T05:05:06.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efce9600640 1 -- 172.21.15.49:0/3930745534 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4004d90 con 0x7efcec06c280 2024-01-31T05:05:06.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.962+0000 7efcf4200640 1 -- 172.21.15.49:0/3930745534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcec146d40 con 0x7efcec06c280 2024-01-31T05:05:06.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.966+0000 7efcf4200640 1 -- 172.21.15.49:0/3930745534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcec074860 con 0x7efcec06c280 2024-01-31T05:05:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.966+0000 7efce9600640 1 -- 172.21.15.49:0/3930745534 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7efce40aa030 con 0x7efcec06c280 2024-01-31T05:05:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.966+0000 7efce9600640 1 --2- 172.21.15.49:0/3930745534 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7efcc4066500 0x7efcc40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.966+0000 7efce9600640 1 -- 172.21.15.49:0/3930745534 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efce411e100 con 0x7efcec06c280 2024-01-31T05:05:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.966+0000 7efcf1800640 1 --2- 172.21.15.49:0/3930745534 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7efcc4066500 0x7efcc40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:06.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.966+0000 7efcf1800640 1 --2- 172.21.15.49:0/3930745534 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7efcc4066500 0x7efcc40689c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efcdc009aa0 tx=0x7efcdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:06.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:06.970+0000 7efce9600640 1 -- 172.21.15.49:0/3930745534 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7efce40eaf40 con 0x7efcec06c280 2024-01-31T05:05:07.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.130+0000 7efcf4200640 1 -- 172.21.15.49:0/3930745534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcec14ef70 con 0x7efcec06c280 2024-01-31T05:05:07.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.134+0000 7efce9600640 1 -- 172.21.15.49:0/3930745534 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7efce40ee560 con 0x7efcec06c280 2024-01-31T05:05:07.133 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:07.133 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:58.277568+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:07.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.134+0000 7efcf4200640 1 -- 172.21.15.49:0/3930745534 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7efcc4066500 msgr2=0x7efcc40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:07.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.134+0000 7efcf4200640 1 --2- 172.21.15.49:0/3930745534 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7efcc4066500 0x7efcc40689c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efcdc009aa0 tx=0x7efcdc008040 comp rx=0 tx=0).stop 2024-01-31T05:05:07.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.134+0000 7efcf4200640 1 -- 172.21.15.49:0/3930745534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcec06c280 msgr2=0x7efcec06c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:07.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.134+0000 7efcf4200640 1 --2- 172.21.15.49:0/3930745534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcec06c280 0x7efcec06c700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efce400a900 tx=0x7efccc005800 comp rx=0 tx=0).stop 2024-01-31T05:05:07.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.134+0000 7efcf4200640 1 -- 172.21.15.49:0/3930745534 shutdown_connections 2024-01-31T05:05:07.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.134+0000 7efcf4200640 1 --2- 172.21.15.49:0/3930745534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcec06c280 0x7efcec06c700 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.134+0000 7efcf4200640 1 --2- 172.21.15.49:0/3930745534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efcec147890 0x7efcec145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.134+0000 7efcf4200640 1 --2- 172.21.15.49:0/3930745534 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7efcc4066500 0x7efcc40689c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.134+0000 7efcf4200640 1 --2- 172.21.15.49:0/3930745534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efccc004d10 0x7efcec14d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.134+0000 7efcf4200640 1 -- 172.21.15.49:0/3930745534 >> 172.21.15.49:0/3930745534 conn(0x7efcec0b09a0 msgr2=0x7efcec14e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:07.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.134+0000 7efcf4200640 1 -- 172.21.15.49:0/3930745534 shutdown_connections 2024-01-31T05:05:07.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.134+0000 7efcf4200640 1 -- 172.21.15.49:0/3930745534 wait complete. 2024-01-31T05:05:07.155 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:04:14.566345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:04:15.231265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-31T05:04:18.316756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-31T05:05:07.155 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:05:07.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.302+0000 7f7250600640 1 Processor -- start 2024-01-31T05:05:07.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.302+0000 7f7250600640 1 -- start start 2024-01-31T05:05:07.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.302+0000 7f7250600640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7248159790 0x7f72480b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:07.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.302+0000 7f7250600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72480b3d00 0x7f7248070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:07.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.302+0000 7f7250600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7248070ba0 0x7f724806cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:07.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.302+0000 7f7250600640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7248071030 con 0x7f7248159790 2024-01-31T05:05:07.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.302+0000 7f7250600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7248159b70 con 0x7f7248070ba0 2024-01-31T05:05:07.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.302+0000 7f7250600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72480b2750 con 0x7f72480b3d00 2024-01-31T05:05:07.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.302+0000 7f724dc00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7248159790 0x7f72480b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:07.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.302+0000 7f724dc00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7248159790 0x7f72480b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45852/0 (socket says 172.21.15.49:45852) 2024-01-31T05:05:07.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.302+0000 7f724dc00640 1 -- 172.21.15.49:0/2598414986 learned_addr learned my addr 172.21.15.49:0/2598414986 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:07.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.302+0000 7f724e600640 1 --2- 172.21.15.49:0/2598414986 >> v2:172.21.15.195:3300/0 conn(0x7f7248070ba0 0x7f724806cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:07.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.302+0000 7f724d200640 1 --2- 172.21.15.49:0/2598414986 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72480b3d00 0x7f7248070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:07.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.302+0000 7f724dc00640 1 -- 172.21.15.49:0/2598414986 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72480b3d00 msgr2=0x7f7248070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:07.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.302+0000 7f724dc00640 1 --2- 172.21.15.49:0/2598414986 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72480b3d00 0x7f7248070660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.302+0000 7f724dc00640 1 -- 172.21.15.49:0/2598414986 >> v2:172.21.15.195:3300/0 conn(0x7f7248070ba0 msgr2=0x7f724806cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:07.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.302+0000 7f724dc00640 1 --2- 172.21.15.49:0/2598414986 >> v2:172.21.15.195:3300/0 conn(0x7f7248070ba0 0x7f724806cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.302+0000 7f724dc00640 1 -- 172.21.15.49:0/2598414986 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72480b2a30 con 0x7f7248159790 2024-01-31T05:05:07.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.302+0000 7f724e600640 1 --2- 172.21.15.49:0/2598414986 >> v2:172.21.15.195:3300/0 conn(0x7f7248070ba0 0x7f724806cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:07.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.306+0000 7f724dc00640 1 --2- 172.21.15.49:0/2598414986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7248159790 0x7f72480b37c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f724806e3a0 tx=0x7f723801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75494f056aa268a4 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:07.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.306+0000 7f7247e00640 1 -- 172.21.15.49:0/2598414986 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72380ab610 con 0x7f7248159790 2024-01-31T05:05:07.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.306+0000 7f7247e00640 1 -- 172.21.15.49:0/2598414986 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72380ab770 con 0x7f7248159790 2024-01-31T05:05:07.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.306+0000 7f7247e00640 1 -- 172.21.15.49:0/2598414986 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72380abb00 con 0x7f7248159790 2024-01-31T05:05:07.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.306+0000 7f7250600640 1 -- 172.21.15.49:0/2598414986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7248159790 msgr2=0x7f72480b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:07.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.306+0000 7f7250600640 1 --2- 172.21.15.49:0/2598414986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7248159790 0x7f72480b37c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f724806e3a0 tx=0x7f723801c4d0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.306+0000 7f7250600640 1 -- 172.21.15.49:0/2598414986 shutdown_connections 2024-01-31T05:05:07.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.306+0000 7f7250600640 1 --2- 172.21.15.49:0/2598414986 >> v2:172.21.15.195:3300/0 conn(0x7f7248070ba0 0x7f724806cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.306+0000 7f7250600640 1 --2- 172.21.15.49:0/2598414986 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72480b3d00 0x7f7248070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.306+0000 7f7250600640 1 --2- 172.21.15.49:0/2598414986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7248159790 0x7f72480b37c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.306+0000 7f7250600640 1 -- 172.21.15.49:0/2598414986 >> 172.21.15.49:0/2598414986 conn(0x7f72480b09a0 msgr2=0x7f72480b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:07.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.306+0000 7f7250600640 1 -- 172.21.15.49:0/2598414986 shutdown_connections 2024-01-31T05:05:07.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.306+0000 7f7250600640 1 -- 172.21.15.49:0/2598414986 wait complete. 2024-01-31T05:05:07.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f7250600640 1 Processor -- start 2024-01-31T05:05:07.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f7250600640 1 -- start start 2024-01-31T05:05:07.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f7250600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7248070ba0 0x7f724809ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:07.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f7250600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72480b3d00 0x7f72481445a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:07.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f7250600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7248159790 0x7f72481476c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:07.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f7250600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724809c4c0 con 0x7f7248070ba0 2024-01-31T05:05:07.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f7250600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7248144ae0 con 0x7f7248159790 2024-01-31T05:05:07.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f7250600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7248099f80 con 0x7f72480b3d00 2024-01-31T05:05:07.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f724dc00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7248070ba0 0x7f724809ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:07.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f724dc00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7248070ba0 0x7f724809ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45868/0 (socket says 172.21.15.49:45868) 2024-01-31T05:05:07.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f724dc00640 1 -- 172.21.15.49:0/915078834 learned_addr learned my addr 172.21.15.49:0/915078834 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:07.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f724d200640 1 --2- 172.21.15.49:0/915078834 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72480b3d00 0x7f72481445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:07.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f724e600640 1 --2- 172.21.15.49:0/915078834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7248159790 0x7f72481476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:07.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f724dc00640 1 -- 172.21.15.49:0/915078834 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72480b3d00 msgr2=0x7f72481445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:07.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f724dc00640 1 --2- 172.21.15.49:0/915078834 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72480b3d00 0x7f72481445a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f724dc00640 1 -- 172.21.15.49:0/915078834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7248159790 msgr2=0x7f72481476c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:07.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f724dc00640 1 --2- 172.21.15.49:0/915078834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7248159790 0x7f72481476c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f724dc00640 1 -- 172.21.15.49:0/915078834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72380094d0 con 0x7f7248070ba0 2024-01-31T05:05:07.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f724dc00640 1 --2- 172.21.15.49:0/915078834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7248070ba0 0x7f724809ac20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f723801ab80 tx=0x7f723801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:07.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f7245600640 1 -- 172.21.15.49:0/915078834 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72380b4800 con 0x7f7248070ba0 2024-01-31T05:05:07.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f7245600640 1 -- 172.21.15.49:0/915078834 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72380b4980 con 0x7f7248070ba0 2024-01-31T05:05:07.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f7245600640 1 -- 172.21.15.49:0/915078834 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72380b4d30 con 0x7f7248070ba0 2024-01-31T05:05:07.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f7250600640 1 -- 172.21.15.49:0/915078834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f724809c8e0 con 0x7f7248070ba0 2024-01-31T05:05:07.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.310+0000 7f7250600640 1 -- 172.21.15.49:0/915078834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7248144f70 con 0x7f7248070ba0 2024-01-31T05:05:07.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.314+0000 7f7250600640 1 -- 172.21.15.49:0/915078834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7248074860 con 0x7f7248070ba0 2024-01-31T05:05:07.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.314+0000 7f7245600640 1 -- 172.21.15.49:0/915078834 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f72380c7390 con 0x7f7248070ba0 2024-01-31T05:05:07.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.314+0000 7f7245600640 1 --2- 172.21.15.49:0/915078834 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7220066500 0x7f72200689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:07.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.314+0000 7f7245600640 1 -- 172.21.15.49:0/915078834 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f723811e9b0 con 0x7f7248070ba0 2024-01-31T05:05:07.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.314+0000 7f724d200640 1 --2- 172.21.15.49:0/915078834 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7220066500 0x7f72200689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:07.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.314+0000 7f724d200640 1 --2- 172.21.15.49:0/915078834 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7220066500 0x7f72200689c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f72481f6cb0 tx=0x7f7230008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:07.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.318+0000 7f7245600640 1 -- 172.21.15.49:0/915078834 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f72380eb940 con 0x7f7248070ba0 2024-01-31T05:05:07.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.482+0000 7f7250600640 1 -- 172.21.15.49:0/915078834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f72481507a0 con 0x7f7248070ba0 2024-01-31T05:05:07.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.482+0000 7f7245600640 1 -- 172.21.15.49:0/915078834 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f72380eef60 con 0x7f7248070ba0 2024-01-31T05:05:07.481 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:05:07.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.482+0000 7f7250600640 1 -- 172.21.15.49:0/915078834 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7220066500 msgr2=0x7f72200689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:07.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.482+0000 7f7250600640 1 --2- 172.21.15.49:0/915078834 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7220066500 0x7f72200689c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f72481f6cb0 tx=0x7f7230008040 comp rx=0 tx=0).stop 2024-01-31T05:05:07.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.482+0000 7f7250600640 1 -- 172.21.15.49:0/915078834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7248070ba0 msgr2=0x7f724809ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:07.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.482+0000 7f7250600640 1 --2- 172.21.15.49:0/915078834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7248070ba0 0x7f724809ac20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f723801ab80 tx=0x7f723801ad10 comp rx=0 tx=0).stop 2024-01-31T05:05:07.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.482+0000 7f7250600640 1 -- 172.21.15.49:0/915078834 shutdown_connections 2024-01-31T05:05:07.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.482+0000 7f7250600640 1 --2- 172.21.15.49:0/915078834 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7220066500 0x7f72200689c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.482+0000 7f7250600640 1 --2- 172.21.15.49:0/915078834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7248159790 0x7f72481476c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.482+0000 7f7250600640 1 --2- 172.21.15.49:0/915078834 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72480b3d00 0x7f72481445a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.482+0000 7f7250600640 1 --2- 172.21.15.49:0/915078834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7248070ba0 0x7f724809ac20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.482+0000 7f7250600640 1 -- 172.21.15.49:0/915078834 >> 172.21.15.49:0/915078834 conn(0x7f72480b09a0 msgr2=0x7f72480cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:07.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.482+0000 7f7250600640 1 -- 172.21.15.49:0/915078834 shutdown_connections 2024-01-31T05:05:07.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.482+0000 7f7250600640 1 -- 172.21.15.49:0/915078834 wait complete. 2024-01-31T05:05:07.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:05:07.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.645+0000 7f4e13400640 1 Processor -- start 2024-01-31T05:05:07.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.645+0000 7f4e13400640 1 -- start start 2024-01-31T05:05:07.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.649+0000 7f4e13400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4e0c0b30e0 0x7f4e0c15e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:07.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.649+0000 7f4e13400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0c0703c0 con 0x7f4e0c0b34c0 2024-01-31T05:05:07.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.649+0000 7f4e13400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0c0b1dd0 con 0x7f4e0c06c2d0 2024-01-31T05:05:07.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.649+0000 7f4e13400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0c070610 con 0x7f4e0c0b30e0 2024-01-31T05:05:07.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.649+0000 7f4e10a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4e0c0b30e0 0x7f4e0c15e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:07.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.649+0000 7f4e10a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4e0c0b30e0 0x7f4e0c15e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45884/0 (socket says 172.21.15.49:45884) 2024-01-31T05:05:07.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.649+0000 7f4e0be00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4e0c0b34c0 0x7f4e0c0720e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:33608/0 (socket says 172.21.15.49:33608) 2024-01-31T05:05:07.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.649+0000 7f4e10a00640 1 -- 172.21.15.49:0/1394334966 learned_addr learned my addr 172.21.15.49:0/1394334966 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:07.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.649+0000 7f4e10a00640 1 -- 172.21.15.49:0/1394334966 >> v1:172.21.15.195:6789/0 conn(0x7f4e0c06c2d0 legacy=0x7f4e0c0b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:07.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.649+0000 7f4e10a00640 1 -- 172.21.15.49:0/1394334966 >> v1:172.21.15.49:6789/0 conn(0x7f4e0c0b34c0 legacy=0x7f4e0c0720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:07.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.649+0000 7f4e10a00640 1 -- 172.21.15.49:0/1394334966 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c0708f0 con 0x7f4e0c0b30e0 2024-01-31T05:05:07.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.653+0000 7f4e10a00640 1 --2- 172.21.15.49:0/1394334966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e0c0b30e0 0x7f4e0c15e1c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009870 tx=0x7f4dfc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480f50f42adb930b server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:07.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.653+0000 7f4e0b400640 1 -- 172.21.15.49:0/1394334966 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0ab600 con 0x7f4e0c0b30e0 2024-01-31T05:05:07.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.653+0000 7f4e0b400640 1 -- 172.21.15.49:0/1394334966 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc0a7050 con 0x7f4e0c0b30e0 2024-01-31T05:05:07.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.653+0000 7f4e0b400640 1 -- 172.21.15.49:0/1394334966 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0ab980 con 0x7f4e0c0b30e0 2024-01-31T05:05:07.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.653+0000 7f4e13400640 1 -- 172.21.15.49:0/1394334966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e0c0b30e0 msgr2=0x7f4e0c15e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:07.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.653+0000 7f4e13400640 1 --2- 172.21.15.49:0/1394334966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e0c0b30e0 0x7f4e0c15e1c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009870 tx=0x7f4dfc01c420 comp rx=0 tx=0).stop 2024-01-31T05:05:07.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.653+0000 7f4e13400640 1 -- 172.21.15.49:0/1394334966 shutdown_connections 2024-01-31T05:05:07.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.653+0000 7f4e13400640 1 --2- 172.21.15.49:0/1394334966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e0c0b30e0 0x7f4e0c15e1c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.653+0000 7f4e13400640 1 -- 172.21.15.49:0/1394334966 >> 172.21.15.49:0/1394334966 conn(0x7f4e0c0b09a0 msgr2=0x7f4e0c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:07.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.653+0000 7f4e13400640 1 -- 172.21.15.49:0/1394334966 shutdown_connections 2024-01-31T05:05:07.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.653+0000 7f4e13400640 1 -- 172.21.15.49:0/1394334966 wait complete. 2024-01-31T05:05:07.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.653+0000 7f4e13400640 1 Processor -- start 2024-01-31T05:05:07.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.653+0000 7f4e13400640 1 -- start start 2024-01-31T05:05:07.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e13400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e0c06c2d0 0x7f4e0c0ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:07.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e13400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e0c0b30e0 0x7f4e0c1461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:07.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e13400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e0c0b34c0 0x7f4e0c146710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:07.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e13400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c145030 con 0x7f4e0c06c2d0 2024-01-31T05:05:07.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e13400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c145310 con 0x7f4e0c0b30e0 2024-01-31T05:05:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e13400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c1455f0 con 0x7f4e0c0b34c0 2024-01-31T05:05:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e10a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e0c06c2d0 0x7f4e0c0ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e10a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e0c06c2d0 0x7f4e0c0ac7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45892/0 (socket says 172.21.15.49:45892) 2024-01-31T05:05:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e10a00640 1 -- 172.21.15.49:0/3551414379 learned_addr learned my addr 172.21.15.49:0/3551414379 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e0be00640 1 --2- 172.21.15.49:0/3551414379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e0c0b30e0 0x7f4e0c1461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e11400640 1 --2- 172.21.15.49:0/3551414379 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e0c0b34c0 0x7f4e0c146710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e10a00640 1 -- 172.21.15.49:0/3551414379 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e0c0b34c0 msgr2=0x7f4e0c146710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e10a00640 1 --2- 172.21.15.49:0/3551414379 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e0c0b34c0 0x7f4e0c146710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e10a00640 1 -- 172.21.15.49:0/3551414379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e0c0b30e0 msgr2=0x7f4e0c1461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e10a00640 1 --2- 172.21.15.49:0/3551414379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e0c0b30e0 0x7f4e0c1461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e10a00640 1 -- 172.21.15.49:0/3551414379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc0094d0 con 0x7f4e0c06c2d0 2024-01-31T05:05:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e11400640 1 --2- 172.21.15.49:0/3551414379 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e0c0b34c0 0x7f4e0c146710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e10a00640 1 --2- 172.21.15.49:0/3551414379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e0c06c2d0 0x7f4e0c0ac7e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0ae040 tx=0x7f4dfc0191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e08c00640 1 -- 172.21.15.49:0/3551414379 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0b4640 con 0x7f4e0c06c2d0 2024-01-31T05:05:07.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e08c00640 1 -- 172.21.15.49:0/3551414379 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc0b47a0 con 0x7f4e0c06c2d0 2024-01-31T05:05:07.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e08c00640 1 -- 172.21.15.49:0/3551414379 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0b4b30 con 0x7f4e0c06c2d0 2024-01-31T05:05:07.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e13400640 1 -- 172.21.15.49:0/3551414379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0c1458d0 con 0x7f4e0c06c2d0 2024-01-31T05:05:07.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e13400640 1 -- 172.21.15.49:0/3551414379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0c1445a0 con 0x7f4e0c06c2d0 2024-01-31T05:05:07.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e13400640 1 -- 172.21.15.49:0/3551414379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0c074860 con 0x7f4e0c06c2d0 2024-01-31T05:05:07.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.657+0000 7f4e08c00640 1 -- 172.21.15.49:0/3551414379 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f4dfc0b2070 con 0x7f4e0c06c2d0 2024-01-31T05:05:07.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.661+0000 7f4e08c00640 1 --2- 172.21.15.49:0/3551414379 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4de4066500 0x7f4de40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:07.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.661+0000 7f4e08c00640 1 -- 172.21.15.49:0/3551414379 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4dfc11e490 con 0x7f4e0c06c2d0 2024-01-31T05:05:07.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.661+0000 7f4e0be00640 1 --2- 172.21.15.49:0/3551414379 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4de4066500 0x7f4de40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:07.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.661+0000 7f4e0be00640 1 --2- 172.21.15.49:0/3551414379 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4de4066500 0x7f4de40689c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c067b20 tx=0x7f4df4007e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:07.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.661+0000 7f4e08c00640 1 -- 172.21.15.49:0/3551414379 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f4dfc0eb3e0 con 0x7f4e0c06c2d0 2024-01-31T05:05:07.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.821+0000 7f4e13400640 1 -- 172.21.15.49:0/3551414379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4e0c145170 con 0x7f4e0c06c2d0 2024-01-31T05:05:07.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.821+0000 7f4e08c00640 1 -- 172.21.15.49:0/3551414379 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4e0c145170 con 0x7f4e0c06c2d0 2024-01-31T05:05:07.822 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:07.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.825+0000 7f4e13400640 1 -- 172.21.15.49:0/3551414379 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4de4066500 msgr2=0x7f4de40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:07.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.825+0000 7f4e13400640 1 --2- 172.21.15.49:0/3551414379 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4de4066500 0x7f4de40689c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c067b20 tx=0x7f4df4007e50 comp rx=0 tx=0).stop 2024-01-31T05:05:07.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.825+0000 7f4e13400640 1 -- 172.21.15.49:0/3551414379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e0c06c2d0 msgr2=0x7f4e0c0ac7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:07.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.825+0000 7f4e13400640 1 --2- 172.21.15.49:0/3551414379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e0c06c2d0 0x7f4e0c0ac7e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0ae040 tx=0x7f4dfc0191c0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.825+0000 7f4e13400640 1 -- 172.21.15.49:0/3551414379 shutdown_connections 2024-01-31T05:05:07.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.825+0000 7f4e13400640 1 --2- 172.21.15.49:0/3551414379 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e0c0b34c0 0x7f4e0c146710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.825+0000 7f4e13400640 1 --2- 172.21.15.49:0/3551414379 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4de4066500 0x7f4de40689c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.825+0000 7f4e13400640 1 --2- 172.21.15.49:0/3551414379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e0c0b30e0 0x7f4e0c1461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.825+0000 7f4e13400640 1 --2- 172.21.15.49:0/3551414379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e0c06c2d0 0x7f4e0c0ac7e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.825+0000 7f4e13400640 1 -- 172.21.15.49:0/3551414379 >> 172.21.15.49:0/3551414379 conn(0x7f4e0c0b09a0 msgr2=0x7f4e0c0b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:07.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.825+0000 7f4e13400640 1 -- 172.21.15.49:0/3551414379 shutdown_connections 2024-01-31T05:05:07.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.825+0000 7f4e13400640 1 -- 172.21.15.49:0/3551414379 wait complete. 2024-01-31T05:05:07.845 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:05:07.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.989+0000 7f73e1600640 1 Processor -- start 2024-01-31T05:05:07.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.989+0000 7f73e1600640 1 -- start start 2024-01-31T05:05:07.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.989+0000 7f73e1600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73dc06c290 0x7f73dc0cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:07.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.989+0000 7f73e1600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f73dc0cbf80 0x7f73dc0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:07.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.989+0000 7f73e1600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73dc15d7e0 con 0x7f73dc06ba90 2024-01-31T05:05:07.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.989+0000 7f73e1600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73dc0d0470 con 0x7f73dc0cbf80 2024-01-31T05:05:07.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.989+0000 7f73e1600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0d0190 con 0x7f73dc06c290 2024-01-31T05:05:07.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.993+0000 7f73daa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73dc06c290 0x7f73dc0cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:07.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.993+0000 7f73da000640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f73dc06ba90 0x7f73dc06c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:46402/0 (socket says 172.21.15.49:46402) 2024-01-31T05:05:07.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.993+0000 7f73da000640 1 -- 172.21.15.49:0/1844754818 learned_addr learned my addr 172.21.15.49:0/1844754818 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:07.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.993+0000 7f73db400640 1 --2- 172.21.15.49:0/1844754818 >> v2:172.21.15.195:3300/0 conn(0x7f73dc0cbf80 0x7f73dc0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:07.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.993+0000 7f73d9600640 1 -- 172.21.15.49:0/1844754818 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596420586 0 0) 0x7f73dc15d7e0 con 0x7f73dc06ba90 2024-01-31T05:05:07.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.993+0000 7f73d9600640 1 -- 172.21.15.49:0/1844754818 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73bc003530 con 0x7f73dc06ba90 2024-01-31T05:05:07.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.993+0000 7f73daa00640 1 -- 172.21.15.49:0/1844754818 >> v2:172.21.15.195:3300/0 conn(0x7f73dc0cbf80 msgr2=0x7f73dc0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:07.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.993+0000 7f73daa00640 1 --2- 172.21.15.49:0/1844754818 >> v2:172.21.15.195:3300/0 conn(0x7f73dc0cbf80 0x7f73dc0cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.993+0000 7f73daa00640 1 -- 172.21.15.49:0/1844754818 >> v1:172.21.15.195:6789/0 conn(0x7f73dc06ba90 legacy=0x7f73dc06c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:07.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.993+0000 7f73daa00640 1 -- 172.21.15.49:0/1844754818 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc0cb4a0 con 0x7f73dc06c290 2024-01-31T05:05:07.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.993+0000 7f73db400640 1 --2- 172.21.15.49:0/1844754818 >> v2:172.21.15.195:3300/0 conn(0x7f73dc0cbf80 0x7f73dc0cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:07.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.993+0000 7f73daa00640 1 --2- 172.21.15.49:0/1844754818 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73dc06c290 0x7f73dc0cfad0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0097c0 tx=0x7f73cc01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=617569b6c10a9e77 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:07.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.993+0000 7f73d9600640 1 -- 172.21.15.49:0/1844754818 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc0ab600 con 0x7f73dc06c290 2024-01-31T05:05:07.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.993+0000 7f73d9600640 1 -- 172.21.15.49:0/1844754818 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc0a7050 con 0x7f73dc06c290 2024-01-31T05:05:07.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.993+0000 7f73d9600640 1 -- 172.21.15.49:0/1844754818 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc0ab980 con 0x7f73dc06c290 2024-01-31T05:05:07.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.997+0000 7f73e1600640 1 -- 172.21.15.49:0/1844754818 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73dc06c290 msgr2=0x7f73dc0cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:07.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.997+0000 7f73e1600640 1 --2- 172.21.15.49:0/1844754818 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73dc06c290 0x7f73dc0cfad0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0097c0 tx=0x7f73cc01c3c0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.997+0000 7f73e1600640 1 -- 172.21.15.49:0/1844754818 shutdown_connections 2024-01-31T05:05:07.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.997+0000 7f73e1600640 1 --2- 172.21.15.49:0/1844754818 >> v2:172.21.15.195:3300/0 conn(0x7f73dc0cbf80 0x7f73dc0cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.997+0000 7f73e1600640 1 --2- 172.21.15.49:0/1844754818 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73dc06c290 0x7f73dc0cfad0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:07.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.997+0000 7f73e1600640 1 -- 172.21.15.49:0/1844754818 >> 172.21.15.49:0/1844754818 conn(0x7f73dc0b28e0 msgr2=0x7f73dc0b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:07.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.997+0000 7f73e1600640 1 -- 172.21.15.49:0/1844754818 shutdown_connections 2024-01-31T05:05:07.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.997+0000 7f73e1600640 1 -- 172.21.15.49:0/1844754818 wait complete. 2024-01-31T05:05:07.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.997+0000 7f73e1600640 1 Processor -- start 2024-01-31T05:05:07.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.997+0000 7f73e1600640 1 -- start start 2024-01-31T05:05:07.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.997+0000 7f73e1600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73dc06ba90 0x7f73dc154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:08.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.997+0000 7f73e1600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73dc06c290 0x7f73dc0c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:08.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.997+0000 7f73e1600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73dc0cbf80 0x7f73dc0c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:08.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.997+0000 7f73e1600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0c52c0 con 0x7f73dc06ba90 2024-01-31T05:05:08.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.997+0000 7f73e1600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0c5580 con 0x7f73dc0cbf80 2024-01-31T05:05:08.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.997+0000 7f73e1600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0c5860 con 0x7f73dc06c290 2024-01-31T05:05:08.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.997+0000 7f73daa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73dc06ba90 0x7f73dc154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:08.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.997+0000 7f73daa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73dc06ba90 0x7f73dc154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45900/0 (socket says 172.21.15.49:45900) 2024-01-31T05:05:08.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:07.997+0000 7f73daa00640 1 -- 172.21.15.49:0/771544415 learned_addr learned my addr 172.21.15.49:0/771544415 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:08.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.001+0000 7f73da000640 1 --2- 172.21.15.49:0/771544415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73dc06c290 0x7f73dc0c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:08.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.001+0000 7f73db400640 1 --2- 172.21.15.49:0/771544415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73dc0cbf80 0x7f73dc0c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:08.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.001+0000 7f73daa00640 1 -- 172.21.15.49:0/771544415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73dc06c290 msgr2=0x7f73dc0c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:08.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.001+0000 7f73daa00640 1 --2- 172.21.15.49:0/771544415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73dc06c290 0x7f73dc0c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.001+0000 7f73daa00640 1 -- 172.21.15.49:0/771544415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73dc0cbf80 msgr2=0x7f73dc0c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:08.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.001+0000 7f73daa00640 1 --2- 172.21.15.49:0/771544415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73dc0cbf80 0x7f73dc0c7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.001+0000 7f73daa00640 1 -- 172.21.15.49:0/771544415 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d4009a70 con 0x7f73dc06ba90 2024-01-31T05:05:08.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.001+0000 7f73daa00640 1 --2- 172.21.15.49:0/771544415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73dc06ba90 0x7f73dc154d70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f73cc019ff0 tx=0x7f73cc01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:08.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.001+0000 7f73d2a00640 1 -- 172.21.15.49:0/771544415 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc006e20 con 0x7f73dc06ba90 2024-01-31T05:05:08.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.001+0000 7f73d2a00640 1 -- 172.21.15.49:0/771544415 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc0b7450 con 0x7f73dc06ba90 2024-01-31T05:05:08.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.001+0000 7f73e1600640 1 -- 172.21.15.49:0/771544415 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73cc009420 con 0x7f73dc06ba90 2024-01-31T05:05:08.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.001+0000 7f73d2a00640 1 -- 172.21.15.49:0/771544415 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc0b77e0 con 0x7f73dc06ba90 2024-01-31T05:05:08.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.001+0000 7f73e1600640 1 -- 172.21.15.49:0/771544415 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73dc0c5e20 con 0x7f73dc06ba90 2024-01-31T05:05:08.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.001+0000 7f73e1600640 1 -- 172.21.15.49:0/771544415 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73dc067c80 con 0x7f73dc06ba90 2024-01-31T05:05:08.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.001+0000 7f73d2a00640 1 -- 172.21.15.49:0/771544415 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f73cc0b7940 con 0x7f73dc06ba90 2024-01-31T05:05:08.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.001+0000 7f73d2a00640 1 --2- 172.21.15.49:0/771544415 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f73b4066500 0x7f73b40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:08.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.001+0000 7f73d2a00640 1 -- 172.21.15.49:0/771544415 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f73cc11ea10 con 0x7f73dc06ba90 2024-01-31T05:05:08.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.005+0000 7f73da000640 1 --2- 172.21.15.49:0/771544415 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f73b4066500 0x7f73b40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:08.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.005+0000 7f73da000640 1 --2- 172.21.15.49:0/771544415 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f73b4066500 0x7f73b40689c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f73dc06fad0 tx=0x7f73c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:08.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.005+0000 7f73d2a00640 1 -- 172.21.15.49:0/771544415 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f73cc0eb7c0 con 0x7f73dc06ba90 2024-01-31T05:05:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.165+0000 7f73e1600640 1 -- 172.21.15.49:0/771544415 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f73dc074860 con 0x7f73dc06ba90 2024-01-31T05:05:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.165+0000 7f73d2a00640 1 -- 172.21.15.49:0/771544415 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f73cc0eede0 con 0x7f73dc06ba90 2024-01-31T05:05:08.167 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-31T05:05:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.169+0000 7f73e1600640 1 -- 172.21.15.49:0/771544415 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f73b4066500 msgr2=0x7f73b40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.169+0000 7f73e1600640 1 --2- 172.21.15.49:0/771544415 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f73b4066500 0x7f73b40689c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f73dc06fad0 tx=0x7f73c4009040 comp rx=0 tx=0).stop 2024-01-31T05:05:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.169+0000 7f73e1600640 1 -- 172.21.15.49:0/771544415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73dc06ba90 msgr2=0x7f73dc154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.169+0000 7f73e1600640 1 --2- 172.21.15.49:0/771544415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73dc06ba90 0x7f73dc154d70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f73cc019ff0 tx=0x7f73cc01ac00 comp rx=0 tx=0).stop 2024-01-31T05:05:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.169+0000 7f73e1600640 1 -- 172.21.15.49:0/771544415 shutdown_connections 2024-01-31T05:05:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.169+0000 7f73e1600640 1 --2- 172.21.15.49:0/771544415 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f73b4066500 0x7f73b40689c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.169+0000 7f73e1600640 1 --2- 172.21.15.49:0/771544415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73dc0cbf80 0x7f73dc0c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.169+0000 7f73e1600640 1 --2- 172.21.15.49:0/771544415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f73dc06c290 0x7f73dc0c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.169+0000 7f73e1600640 1 --2- 172.21.15.49:0/771544415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73dc06ba90 0x7f73dc154d70 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.169+0000 7f73e1600640 1 -- 172.21.15.49:0/771544415 >> 172.21.15.49:0/771544415 conn(0x7f73dc0b28e0 msgr2=0x7f73dc0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:08.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.169+0000 7f73e1600640 1 -- 172.21.15.49:0/771544415 shutdown_connections 2024-01-31T05:05:08.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.169+0000 7f73e1600640 1 -- 172.21.15.49:0/771544415 wait complete. 2024-01-31T05:05:08.189 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-31T05:05:08.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.333+0000 7f1b30c00640 1 Processor -- start 2024-01-31T05:05:08.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.333+0000 7f1b30c00640 1 -- start start 2024-01-31T05:05:08.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.333+0000 7f1b30c00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b2c15b110 0x7f1b2c06c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:08.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.333+0000 7f1b30c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b2c0cdf10 0x7f1b2c070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:08.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.333+0000 7f1b30c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2c15b4f0 con 0x7f1b2c0ce610 2024-01-31T05:05:08.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.333+0000 7f1b30c00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2c0ce460 con 0x7f1b2c15b110 2024-01-31T05:05:08.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.333+0000 7f1b30c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0abf20 con 0x7f1b2c0cdf10 2024-01-31T05:05:08.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.333+0000 7f1b29e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b2c15b110 0x7f1b2c06c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:08.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.333+0000 7f1b29e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f1b2c15b110 0x7f1b2c06c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45904/0 (socket says 172.21.15.49:45904) 2024-01-31T05:05:08.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.333+0000 7f1b29e00640 1 -- 172.21.15.49:0/673678326 learned_addr learned my addr 172.21.15.49:0/673678326 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:08.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.333+0000 7f1b29400640 1 --2- 172.21.15.49:0/673678326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b2c0cdf10 0x7f1b2c070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:08.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.337+0000 7f1b29e00640 1 -- 172.21.15.49:0/673678326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b2c0cdf10 msgr2=0x7f1b2c070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:08.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.337+0000 7f1b29e00640 1 --2- 172.21.15.49:0/673678326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b2c0cdf10 0x7f1b2c070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.337+0000 7f1b29e00640 1 -- 172.21.15.49:0/673678326 >> v1:172.21.15.195:6789/0 conn(0x7f1b2c0ce610 legacy=0x7f1b2c0ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:08.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.337+0000 7f1b29e00640 1 -- 172.21.15.49:0/673678326 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c0ac200 con 0x7f1b2c15b110 2024-01-31T05:05:08.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.337+0000 7f1b29e00640 1 --2- 172.21.15.49:0/673678326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b2c15b110 0x7f1b2c06c2d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c009870 tx=0x7f1b1c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e80ecd3ca9d951 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:08.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.337+0000 7f1b28a00640 1 -- 172.21.15.49:0/673678326 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0ab620 con 0x7f1b2c15b110 2024-01-31T05:05:08.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.337+0000 7f1b28a00640 1 -- 172.21.15.49:0/673678326 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c0ab780 con 0x7f1b2c15b110 2024-01-31T05:05:08.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.337+0000 7f1b28a00640 1 -- 172.21.15.49:0/673678326 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0abb10 con 0x7f1b2c15b110 2024-01-31T05:05:08.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.337+0000 7f1b30c00640 1 -- 172.21.15.49:0/673678326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b2c15b110 msgr2=0x7f1b2c06c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:08.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.337+0000 7f1b30c00640 1 --2- 172.21.15.49:0/673678326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b2c15b110 0x7f1b2c06c2d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c009870 tx=0x7f1b1c01c510 comp rx=0 tx=0).stop 2024-01-31T05:05:08.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b30c00640 1 -- 172.21.15.49:0/673678326 shutdown_connections 2024-01-31T05:05:08.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b30c00640 1 --2- 172.21.15.49:0/673678326 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b2c0cdf10 0x7f1b2c070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b30c00640 1 --2- 172.21.15.49:0/673678326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b2c15b110 0x7f1b2c06c2d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b30c00640 1 -- 172.21.15.49:0/673678326 >> 172.21.15.49:0/673678326 conn(0x7f1b2c0b09a0 msgr2=0x7f1b2c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:08.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b30c00640 1 -- 172.21.15.49:0/673678326 shutdown_connections 2024-01-31T05:05:08.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b30c00640 1 -- 172.21.15.49:0/673678326 wait complete. 2024-01-31T05:05:08.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b30c00640 1 Processor -- start 2024-01-31T05:05:08.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b30c00640 1 -- start start 2024-01-31T05:05:08.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b30c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b2c0cdf10 0x7f1b2c150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:08.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b30c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b2c0ce610 0x7f1b2c0afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:08.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b30c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b2c15b110 0x7f1b2c13d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:08.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b30c00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c14e800 con 0x7f1b2c15b110 2024-01-31T05:05:08.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b30c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c1513a0 con 0x7f1b2c0cdf10 2024-01-31T05:05:08.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b30c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c151680 con 0x7f1b2c0ce610 2024-01-31T05:05:08.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b2a800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b2c15b110 0x7f1b2c13d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:08.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b2a800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b2c15b110 0x7f1b2c13d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45918/0 (socket says 172.21.15.49:45918) 2024-01-31T05:05:08.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b2a800640 1 -- 172.21.15.49:0/3902912615 learned_addr learned my addr 172.21.15.49:0/3902912615 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:08.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b29400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b2c0ce610 0x7f1b2c0afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:08.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b29e00640 1 --2- 172.21.15.49:0/3902912615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b2c0cdf10 0x7f1b2c150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:08.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b2a800640 1 -- 172.21.15.49:0/3902912615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b2c0ce610 msgr2=0x7f1b2c0afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:08.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b2a800640 1 --2- 172.21.15.49:0/3902912615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b2c0ce610 0x7f1b2c0afbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b2a800640 1 -- 172.21.15.49:0/3902912615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b2c0cdf10 msgr2=0x7f1b2c150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:08.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b2a800640 1 --2- 172.21.15.49:0/3902912615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b2c0cdf10 0x7f1b2c150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.341+0000 7f1b2a800640 1 -- 172.21.15.49:0/3902912615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1c0094d0 con 0x7f1b2c15b110 2024-01-31T05:05:08.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.345+0000 7f1b2a800640 1 --2- 172.21.15.49:0/3902912615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b2c15b110 0x7f1b2c13d590 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1b2400c770 tx=0x7f1b2400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:08.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.345+0000 7f1b22000640 1 -- 172.21.15.49:0/3902912615 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24003b80 con 0x7f1b2c15b110 2024-01-31T05:05:08.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.345+0000 7f1b22000640 1 -- 172.21.15.49:0/3902912615 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b24003ce0 con 0x7f1b2c15b110 2024-01-31T05:05:08.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.345+0000 7f1b30c00640 1 -- 172.21.15.49:0/3902912615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2c151960 con 0x7f1b2c15b110 2024-01-31T05:05:08.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.345+0000 7f1b22000640 1 -- 172.21.15.49:0/3902912615 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2400aa90 con 0x7f1b2c15b110 2024-01-31T05:05:08.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.345+0000 7f1b30c00640 1 -- 172.21.15.49:0/3902912615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2c15ba10 con 0x7f1b2c15b110 2024-01-31T05:05:08.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.345+0000 7f1b30c00640 1 -- 172.21.15.49:0/3902912615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2c074860 con 0x7f1b2c15b110 2024-01-31T05:05:08.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.345+0000 7f1b22000640 1 -- 172.21.15.49:0/3902912615 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1b2400abf0 con 0x7f1b2c15b110 2024-01-31T05:05:08.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.349+0000 7f1b22000640 1 --2- 172.21.15.49:0/3902912615 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1b04066500 0x7f1b040689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:08.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.349+0000 7f1b22000640 1 -- 172.21.15.49:0/3902912615 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1b24083dc0 con 0x7f1b2c15b110 2024-01-31T05:05:08.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.349+0000 7f1b29e00640 1 --2- 172.21.15.49:0/3902912615 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1b04066500 0x7f1b040689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:08.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.349+0000 7f1b29e00640 1 --2- 172.21.15.49:0/3902912615 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1b04066500 0x7f1b040689c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0af000 tx=0x7f1b1c0b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:08.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.353+0000 7f1b22000640 1 -- 172.21.15.49:0/3902912615 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1b24050d50 con 0x7f1b2c15b110 2024-01-31T05:05:08.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.513+0000 7f1b30c00640 1 -- 172.21.15.49:0/3902912615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1b2c15b4f0 con 0x7f1b2c15b110 2024-01-31T05:05:08.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.513+0000 7f1b22000640 1 -- 172.21.15.49:0/3902912615 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1b2c15b4f0 con 0x7f1b2c15b110 2024-01-31T05:05:08.513 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.513+0000 7f1b30c00640 1 -- 172.21.15.49:0/3902912615 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1b04066500 msgr2=0x7f1b040689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.513+0000 7f1b30c00640 1 --2- 172.21.15.49:0/3902912615 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1b04066500 0x7f1b040689c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0af000 tx=0x7f1b1c0b6040 comp rx=0 tx=0).stop 2024-01-31T05:05:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.513+0000 7f1b30c00640 1 -- 172.21.15.49:0/3902912615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b2c15b110 msgr2=0x7f1b2c13d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.513+0000 7f1b30c00640 1 --2- 172.21.15.49:0/3902912615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b2c15b110 0x7f1b2c13d590 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1b2400c770 tx=0x7f1b2400cc30 comp rx=0 tx=0).stop 2024-01-31T05:05:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.513+0000 7f1b30c00640 1 -- 172.21.15.49:0/3902912615 shutdown_connections 2024-01-31T05:05:08.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.513+0000 7f1b30c00640 1 --2- 172.21.15.49:0/3902912615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b2c15b110 0x7f1b2c13d590 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.513+0000 7f1b30c00640 1 --2- 172.21.15.49:0/3902912615 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1b2c0ce610 0x7f1b2c0afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.513+0000 7f1b30c00640 1 --2- 172.21.15.49:0/3902912615 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1b04066500 0x7f1b040689c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.513+0000 7f1b30c00640 1 --2- 172.21.15.49:0/3902912615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b2c0cdf10 0x7f1b2c150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.513+0000 7f1b30c00640 1 -- 172.21.15.49:0/3902912615 >> 172.21.15.49:0/3902912615 conn(0x7f1b2c0b09a0 msgr2=0x7f1b2c0b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:08.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.513+0000 7f1b30c00640 1 -- 172.21.15.49:0/3902912615 shutdown_connections 2024-01-31T05:05:08.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.513+0000 7f1b30c00640 1 -- 172.21.15.49:0/3902912615 wait complete. 2024-01-31T05:05:08.567 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-01-31T05:05:08.568 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:08.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce1b800640 1 Processor -- start 2024-01-31T05:05:08.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce1b800640 1 -- start start 2024-01-31T05:05:08.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce1b800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fce140715e0 0x7fce140cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:08.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce1b800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce1406c2d0 0x7fce140ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:08.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce1b800640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce14071e40 con 0x7fce1415a000 2024-01-31T05:05:08.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce1b800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce140b3760 con 0x7fce140715e0 2024-01-31T05:05:08.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce1b800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1406c990 con 0x7fce1406c2d0 2024-01-31T05:05:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce18e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fce1415a000 0x7fce14070ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59122/0 (socket says 172.21.15.49:59122) 2024-01-31T05:05:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce18e00640 1 -- 172.21.15.49:0/3253069776 learned_addr learned my addr 172.21.15.49:0/3253069776 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce13e00640 1 --2- 172.21.15.49:0/3253069776 >> v2:172.21.15.195:3300/0 conn(0x7fce140715e0 0x7fce140cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce19800640 1 --2- 172.21.15.49:0/3253069776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce1406c2d0 0x7fce140ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce13400640 1 -- 172.21.15.49:0/3253069776 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583182074 0 0) 0x7fce14071e40 con 0x7fce1415a000 2024-01-31T05:05:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce13400640 1 -- 172.21.15.49:0/3253069776 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdf4005740 con 0x7fce1415a000 2024-01-31T05:05:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce13400640 1 -- 172.21.15.49:0/3253069776 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3490185407 0 0) 0x7fcdf4005740 con 0x7fce1415a000 2024-01-31T05:05:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce13400640 1 -- 172.21.15.49:0/3253069776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce1406c2d0 msgr2=0x7fce140ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce13400640 1 --2- 172.21.15.49:0/3253069776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce1406c2d0 0x7fce140ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce13400640 1 -- 172.21.15.49:0/3253069776 >> v2:172.21.15.195:3300/0 conn(0x7fce140715e0 msgr2=0x7fce140cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce13400640 1 --2- 172.21.15.49:0/3253069776 >> v2:172.21.15.195:3300/0 conn(0x7fce140715e0 0x7fce140cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce13400640 1 -- 172.21.15.49:0/3253069776 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1406c720 con 0x7fce1415a000 2024-01-31T05:05:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.709+0000 7fce13400640 1 -- 172.21.15.49:0/3253069776 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7fce040016a0 con 0x7fce1415a000 2024-01-31T05:05:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.713+0000 7fce13400640 1 -- 172.21.15.49:0/3253069776 >> v1:172.21.15.49:6789/0 conn(0x7fce1415a000 legacy=0x7fce14070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:08.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.713+0000 7fce13400640 1 --2- 172.21.15.49:0/3253069776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdf4005b90 0x7fcdf4005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:08.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.713+0000 7fce13400640 1 --2- 172.21.15.49:0/3253069776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce1406c2d0 0x7fcdf40069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:08.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.713+0000 7fce13400640 1 --2- 172.21.15.49:0/3253069776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdf4006f20 0x7fcdf40073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:08.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.713+0000 7fce13400640 1 -- 172.21.15.49:0/3253069776 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce140b3760 con 0x7fcdf4006f20 2024-01-31T05:05:08.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.713+0000 7fce13400640 1 -- 172.21.15.49:0/3253069776 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1406c990 con 0x7fcdf4005b90 2024-01-31T05:05:08.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.713+0000 7fce13400640 1 -- 172.21.15.49:0/3253069776 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf400dba0 con 0x7fce1406c2d0 2024-01-31T05:05:08.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.713+0000 7fce19800640 1 --2- 172.21.15.49:0/3253069776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdf4006f20 0x7fcdf40073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:08.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.713+0000 7fce13e00640 1 --2- 172.21.15.49:0/3253069776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce1406c2d0 0x7fcdf40069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:08.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.713+0000 7fce18e00640 1 --2- 172.21.15.49:0/3253069776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdf4005b90 0x7fcdf4005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:08.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.713+0000 7fce19800640 1 -- 172.21.15.49:0/3253069776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce1406c2d0 msgr2=0x7fcdf40069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:08.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.713+0000 7fce19800640 1 --2- 172.21.15.49:0/3253069776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce1406c2d0 0x7fcdf40069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.713+0000 7fce19800640 1 -- 172.21.15.49:0/3253069776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdf4005b90 msgr2=0x7fcdf4005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:08.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.713+0000 7fce19800640 1 --2- 172.21.15.49:0/3253069776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdf4005b90 0x7fcdf4005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.713+0000 7fce19800640 1 -- 172.21.15.49:0/3253069776 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf4005740 con 0x7fcdf4006f20 2024-01-31T05:05:08.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.713+0000 7fce19800640 1 --2- 172.21.15.49:0/3253069776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdf4006f20 0x7fcdf40073a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009fc0 tx=0x7fce0c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242533937c260b83 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:08.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.713+0000 7fce13400640 1 -- 172.21.15.49:0/3253069776 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c0a5c70 con 0x7fcdf4006f20 2024-01-31T05:05:08.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.713+0000 7fce13400640 1 -- 172.21.15.49:0/3253069776 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c00f040 con 0x7fcdf4006f20 2024-01-31T05:05:08.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.713+0000 7fce13400640 1 -- 172.21.15.49:0/3253069776 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c0ad440 con 0x7fcdf4006f20 2024-01-31T05:05:08.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.717+0000 7fce1b800640 1 -- 172.21.15.49:0/3253069776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdf4006f20 msgr2=0x7fcdf40073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:08.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.717+0000 7fce1b800640 1 --2- 172.21.15.49:0/3253069776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdf4006f20 0x7fcdf40073a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009fc0 tx=0x7fce0c01cc60 comp rx=0 tx=0).stop 2024-01-31T05:05:08.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.717+0000 7fce19800640 1 -- 172.21.15.49:0/3253069776 reap_dead start 2024-01-31T05:05:08.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.717+0000 7fce1b800640 1 -- 172.21.15.49:0/3253069776 shutdown_connections 2024-01-31T05:05:08.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.717+0000 7fce1b800640 1 -- 172.21.15.49:0/3253069776 >> 172.21.15.49:0/3253069776 conn(0x7fce140b09a0 msgr2=0x7fce140b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:08.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.717+0000 7fce1b800640 1 -- 172.21.15.49:0/3253069776 shutdown_connections 2024-01-31T05:05:08.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.717+0000 7fce1b800640 1 -- 172.21.15.49:0/3253069776 wait complete. 2024-01-31T05:05:08.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.717+0000 7fce1b800640 1 Processor -- start 2024-01-31T05:05:08.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.717+0000 7fce1b800640 1 -- start start 2024-01-31T05:05:08.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.717+0000 7fce1b800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdf4006f20 0x7fce1415b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.717+0000 7fce1b800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce14151650 0x7fce141e6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.717+0000 7fce1b800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce141e7310 0x7fce1415c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.717+0000 7fce1b800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce141521d0 con 0x7fce141e7310 2024-01-31T05:05:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.717+0000 7fce1b800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce141e7790 con 0x7fcdf4006f20 2024-01-31T05:05:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.717+0000 7fce1b800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1415af60 con 0x7fce14151650 2024-01-31T05:05:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.717+0000 7fce19800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce141e7310 0x7fce1415c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.717+0000 7fce19800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce141e7310 0x7fce1415c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52604/0 (socket says 172.21.15.49:52604) 2024-01-31T05:05:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.717+0000 7fce19800640 1 -- 172.21.15.49:0/1453922857 learned_addr learned my addr 172.21.15.49:0/1453922857 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:08.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.717+0000 7fce18e00640 1 --2- 172.21.15.49:0/1453922857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdf4006f20 0x7fce1415b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:08.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.721+0000 7fce13e00640 1 --2- 172.21.15.49:0/1453922857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce14151650 0x7fce141e6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:08.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.721+0000 7fce19800640 1 -- 172.21.15.49:0/1453922857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce14151650 msgr2=0x7fce141e6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:08.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.721+0000 7fce19800640 1 --2- 172.21.15.49:0/1453922857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce14151650 0x7fce141e6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.721+0000 7fce19800640 1 -- 172.21.15.49:0/1453922857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdf4006f20 msgr2=0x7fce1415b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:08.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.721+0000 7fce19800640 1 --2- 172.21.15.49:0/1453922857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdf4006f20 0x7fce1415b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.721+0000 7fce19800640 1 -- 172.21.15.49:0/1453922857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1415a6a0 con 0x7fce141e7310 2024-01-31T05:05:08.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.721+0000 7fce19800640 1 --2- 172.21.15.49:0/1453922857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce141e7310 0x7fce1415c140 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0b0040 tx=0x7fce0c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:08.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.721+0000 7fce10c00640 1 -- 172.21.15.49:0/1453922857 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c0039a0 con 0x7fce141e7310 2024-01-31T05:05:08.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.721+0000 7fce10c00640 1 -- 172.21.15.49:0/1453922857 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c003b00 con 0x7fce141e7310 2024-01-31T05:05:08.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.721+0000 7fce1b800640 1 -- 172.21.15.49:0/1453922857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce1415a910 con 0x7fce141e7310 2024-01-31T05:05:08.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.721+0000 7fce10c00640 1 -- 172.21.15.49:0/1453922857 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c003e90 con 0x7fce141e7310 2024-01-31T05:05:08.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.721+0000 7fce1b800640 1 -- 172.21.15.49:0/1453922857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce1415b930 con 0x7fce141e7310 2024-01-31T05:05:08.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.721+0000 7fce1b800640 1 -- 172.21.15.49:0/1453922857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce14074860 con 0x7fce141e7310 2024-01-31T05:05:08.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.721+0000 7fce10c00640 1 -- 172.21.15.49:0/1453922857 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fce0c0b4040 con 0x7fce141e7310 2024-01-31T05:05:08.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.721+0000 7fce10c00640 1 --2- 172.21.15.49:0/1453922857 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcdec066500 0x7fcdec0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:08.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.721+0000 7fce10c00640 1 -- 172.21.15.49:0/1453922857 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fce0c11e3a0 con 0x7fce141e7310 2024-01-31T05:05:08.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.725+0000 7fce18e00640 1 --2- 172.21.15.49:0/1453922857 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcdec066500 0x7fcdec0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:08.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.725+0000 7fce18e00640 1 --2- 172.21.15.49:0/1453922857 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcdec066500 0x7fcdec0689c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce04000c10 tx=0x7fce04007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:08.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.725+0000 7fce10c00640 1 -- 172.21.15.49:0/1453922857 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fce0c0eb290 con 0x7fce141e7310 2024-01-31T05:05:08.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.889+0000 7fce1b800640 1 -- 172.21.15.49:0/1453922857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce140c8810 con 0x7fce141e7310 2024-01-31T05:05:08.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.889+0000 7fce10c00640 1 -- 172.21.15.49:0/1453922857 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7fce0c0ee8b0 con 0x7fce141e7310 2024-01-31T05:05:08.889 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:08.889 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:58.277568+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:08.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.889+0000 7fce1b800640 1 -- 172.21.15.49:0/1453922857 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcdec066500 msgr2=0x7fcdec0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:08.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.889+0000 7fce1b800640 1 --2- 172.21.15.49:0/1453922857 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcdec066500 0x7fcdec0689c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce04000c10 tx=0x7fce04007040 comp rx=0 tx=0).stop 2024-01-31T05:05:08.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.889+0000 7fce1b800640 1 -- 172.21.15.49:0/1453922857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce141e7310 msgr2=0x7fce1415c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:08.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.889+0000 7fce1b800640 1 --2- 172.21.15.49:0/1453922857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce141e7310 0x7fce1415c140 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0b0040 tx=0x7fce0c009750 comp rx=0 tx=0).stop 2024-01-31T05:05:08.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.889+0000 7fce1b800640 1 -- 172.21.15.49:0/1453922857 shutdown_connections 2024-01-31T05:05:08.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.889+0000 7fce1b800640 1 --2- 172.21.15.49:0/1453922857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce141e7310 0x7fce1415c140 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.889+0000 7fce1b800640 1 --2- 172.21.15.49:0/1453922857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fce14151650 0x7fce141e6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.889+0000 7fce1b800640 1 --2- 172.21.15.49:0/1453922857 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcdec066500 0x7fcdec0689c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.889+0000 7fce1b800640 1 --2- 172.21.15.49:0/1453922857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdf4006f20 0x7fce1415b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.889+0000 7fce1b800640 1 -- 172.21.15.49:0/1453922857 >> 172.21.15.49:0/1453922857 conn(0x7fce140b09a0 msgr2=0x7fce14152520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:08.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.893+0000 7fce1b800640 1 -- 172.21.15.49:0/1453922857 shutdown_connections 2024-01-31T05:05:08.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:08.893+0000 7fce1b800640 1 -- 172.21.15.49:0/1453922857 wait complete. 2024-01-31T05:05:08.912 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:04:14.566345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:04:15.231265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-31T05:04:18.316756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-31T05:05:08.913 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:05:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.057+0000 7f2767a00640 1 Processor -- start 2024-01-31T05:05:09.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.057+0000 7f2767a00640 1 -- start start 2024-01-31T05:05:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.057+0000 7f2767a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27600715e0 0x7f27600cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.057+0000 7f2767a00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276006c740 con 0x7f276006c2d0 2024-01-31T05:05:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.057+0000 7f2767a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2760071e40 con 0x7f276015a000 2024-01-31T05:05:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.057+0000 7f2767a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27600b3760 con 0x7f27600715e0 2024-01-31T05:05:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.057+0000 7f2765a00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f276006c2d0 0x7f27600ac8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59126/0 (socket says 172.21.15.49:59126) 2024-01-31T05:05:09.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.057+0000 7f2765a00640 1 -- 172.21.15.49:0/4219794723 learned_addr learned my addr 172.21.15.49:0/4219794723 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:09.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.057+0000 7f275fe00640 1 --2- 172.21.15.49:0/4219794723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27600715e0 0x7f27600cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:09.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.057+0000 7f275f400640 1 -- 172.21.15.49:0/4219794723 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668931013 0 0) 0x7f276006c740 con 0x7f276006c2d0 2024-01-31T05:05:09.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.057+0000 7f275f400640 1 -- 172.21.15.49:0/4219794723 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2740003530 con 0x7f276006c2d0 2024-01-31T05:05:09.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.057+0000 7f275f400640 1 -- 172.21.15.49:0/4219794723 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732038260 0 0) 0x7f2760071e40 con 0x7f276015a000 2024-01-31T05:05:09.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.057+0000 7f275f400640 1 -- 172.21.15.49:0/4219794723 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f276006c740 con 0x7f276015a000 2024-01-31T05:05:09.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.057+0000 7f275fe00640 1 -- 172.21.15.49:0/4219794723 >> v1:172.21.15.195:6789/0 conn(0x7f276015a000 legacy=0x7f2760070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.057+0000 7f275fe00640 1 -- 172.21.15.49:0/4219794723 >> v1:172.21.15.49:6789/0 conn(0x7f276006c2d0 legacy=0x7f27600ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.057+0000 7f275fe00640 1 -- 172.21.15.49:0/4219794723 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276006c990 con 0x7f27600715e0 2024-01-31T05:05:09.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.061+0000 7f275fe00640 1 --2- 172.21.15.49:0/4219794723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27600715e0 0x7f27600cb040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f27480097f0 tx=0x7f274801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2fdef9ecf08b7d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.061+0000 7f275f400640 1 -- 172.21.15.49:0/4219794723 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27480aa620 con 0x7f27600715e0 2024-01-31T05:05:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.061+0000 7f275f400640 1 -- 172.21.15.49:0/4219794723 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27480aa780 con 0x7f27600715e0 2024-01-31T05:05:09.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.061+0000 7f275f400640 1 -- 172.21.15.49:0/4219794723 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27480aaaf0 con 0x7f27600715e0 2024-01-31T05:05:09.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.061+0000 7f2767a00640 1 -- 172.21.15.49:0/4219794723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27600715e0 msgr2=0x7f27600cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.061+0000 7f2767a00640 1 --2- 172.21.15.49:0/4219794723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27600715e0 0x7f27600cb040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f27480097f0 tx=0x7f274801c4c0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.061+0000 7f2767a00640 1 -- 172.21.15.49:0/4219794723 shutdown_connections 2024-01-31T05:05:09.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.061+0000 7f2767a00640 1 --2- 172.21.15.49:0/4219794723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27600715e0 0x7f27600cb040 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.061+0000 7f2767a00640 1 -- 172.21.15.49:0/4219794723 >> 172.21.15.49:0/4219794723 conn(0x7f27600b09a0 msgr2=0x7f27600b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:09.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.061+0000 7f2767a00640 1 -- 172.21.15.49:0/4219794723 shutdown_connections 2024-01-31T05:05:09.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.061+0000 7f2767a00640 1 -- 172.21.15.49:0/4219794723 wait complete. 2024-01-31T05:05:09.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2767a00640 1 Processor -- start 2024-01-31T05:05:09.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2767a00640 1 -- start start 2024-01-31T05:05:09.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2767a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f276006c2d0 0x7f2760099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:09.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2767a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27600715e0 0x7f276014fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:09.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2767a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276015a000 0x7f276009bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:09.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2767a00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27600c8c20 con 0x7f276006c2d0 2024-01-31T05:05:09.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2767a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276009a840 con 0x7f276015a000 2024-01-31T05:05:09.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2767a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276009a280 con 0x7f27600715e0 2024-01-31T05:05:09.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2765000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f276006c2d0 0x7f2760099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:09.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2765000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f276006c2d0 0x7f2760099a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52612/0 (socket says 172.21.15.49:52612) 2024-01-31T05:05:09.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2765000640 1 -- 172.21.15.49:0/2533237935 learned_addr learned my addr 172.21.15.49:0/2533237935 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:09.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2765a00640 1 --2- 172.21.15.49:0/2533237935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276015a000 0x7f276009bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:09.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f275fe00640 1 --2- 172.21.15.49:0/2533237935 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27600715e0 0x7f276014fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:09.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2765000640 1 -- 172.21.15.49:0/2533237935 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27600715e0 msgr2=0x7f276014fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2765000640 1 --2- 172.21.15.49:0/2533237935 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27600715e0 0x7f276014fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2765000640 1 -- 172.21.15.49:0/2533237935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276015a000 msgr2=0x7f276009bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2765000640 1 --2- 172.21.15.49:0/2533237935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276015a000 0x7f276009bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2765000640 1 -- 172.21.15.49:0/2533237935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2748009420 con 0x7f276006c2d0 2024-01-31T05:05:09.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2765a00640 1 --2- 172.21.15.49:0/2533237935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276015a000 0x7f276009bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:09.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f275fe00640 1 --2- 172.21.15.49:0/2533237935 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27600715e0 0x7f276014fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:09.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2765000640 1 --2- 172.21.15.49:0/2533237935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f276006c2d0 0x7f2760099a50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f275000c430 tx=0x7f275000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:09.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f275cc00640 1 -- 172.21.15.49:0/2533237935 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500052d0 con 0x7f276006c2d0 2024-01-31T05:05:09.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f275cc00640 1 -- 172.21.15.49:0/2533237935 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2750005450 con 0x7f276006c2d0 2024-01-31T05:05:09.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f275cc00640 1 -- 172.21.15.49:0/2533237935 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750003840 con 0x7f276006c2d0 2024-01-31T05:05:09.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.065+0000 7f2767a00640 1 -- 172.21.15.49:0/2533237935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276009a560 con 0x7f276006c2d0 2024-01-31T05:05:09.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.069+0000 7f2767a00640 1 -- 172.21.15.49:0/2533237935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2760099f90 con 0x7f276006c2d0 2024-01-31T05:05:09.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.069+0000 7f2767a00640 1 -- 172.21.15.49:0/2533237935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27600c8a80 con 0x7f276006c2d0 2024-01-31T05:05:09.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.069+0000 7f275cc00640 1 -- 172.21.15.49:0/2533237935 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f27500039a0 con 0x7f276006c2d0 2024-01-31T05:05:09.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.069+0000 7f275cc00640 1 --2- 172.21.15.49:0/2533237935 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2738066500 0x7f27380689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:09.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.069+0000 7f275cc00640 1 -- 172.21.15.49:0/2533237935 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2750083930 con 0x7f276006c2d0 2024-01-31T05:05:09.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.069+0000 7f275fe00640 1 --2- 172.21.15.49:0/2533237935 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2738066500 0x7f27380689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:09.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.073+0000 7f275fe00640 1 --2- 172.21.15.49:0/2533237935 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2738066500 0x7f27380689c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f27480ae000 tx=0x7f27480a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:09.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.073+0000 7f275cc00640 1 -- 172.21.15.49:0/2533237935 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f27600c8a80 con 0x7f276006c2d0 2024-01-31T05:05:09.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.233+0000 7f2767a00640 1 -- 172.21.15.49:0/2533237935 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27600c8a80 con 0x7f276006c2d0 2024-01-31T05:05:09.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.233+0000 7f275cc00640 1 -- 172.21.15.49:0/2533237935 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2750017020 con 0x7f276006c2d0 2024-01-31T05:05:09.236 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:05:09.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.237+0000 7f2767a00640 1 -- 172.21.15.49:0/2533237935 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2738066500 msgr2=0x7f27380689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.237+0000 7f2767a00640 1 --2- 172.21.15.49:0/2533237935 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2738066500 0x7f27380689c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f27480ae000 tx=0x7f27480a7000 comp rx=0 tx=0).stop 2024-01-31T05:05:09.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.237+0000 7f2767a00640 1 -- 172.21.15.49:0/2533237935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f276006c2d0 msgr2=0x7f2760099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.237+0000 7f2767a00640 1 --2- 172.21.15.49:0/2533237935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f276006c2d0 0x7f2760099a50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f275000c430 tx=0x7f275000c8f0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.237+0000 7f2767a00640 1 -- 172.21.15.49:0/2533237935 shutdown_connections 2024-01-31T05:05:09.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.237+0000 7f2767a00640 1 --2- 172.21.15.49:0/2533237935 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2738066500 0x7f27380689c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.237+0000 7f2767a00640 1 --2- 172.21.15.49:0/2533237935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f276015a000 0x7f276009bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.237+0000 7f2767a00640 1 --2- 172.21.15.49:0/2533237935 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f27600715e0 0x7f276014fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.237+0000 7f2767a00640 1 --2- 172.21.15.49:0/2533237935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f276006c2d0 0x7f2760099a50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.237+0000 7f2767a00640 1 -- 172.21.15.49:0/2533237935 >> 172.21.15.49:0/2533237935 conn(0x7f27600b09a0 msgr2=0x7f27601591d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:09.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.237+0000 7f2767a00640 1 -- 172.21.15.49:0/2533237935 shutdown_connections 2024-01-31T05:05:09.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.237+0000 7f2767a00640 1 -- 172.21.15.49:0/2533237935 wait complete. 2024-01-31T05:05:09.258 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:05:09.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.401+0000 7ff49d200640 1 Processor -- start 2024-01-31T05:05:09.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.401+0000 7ff49d200640 1 -- start start 2024-01-31T05:05:09.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.405+0000 7ff49d200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff498159790 0x7ff4980b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:09.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.405+0000 7ff49d200640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff498159b70 con 0x7ff4980b3d00 2024-01-31T05:05:09.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.405+0000 7ff49d200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4980b2750 con 0x7ff498070d70 2024-01-31T05:05:09.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.405+0000 7ff49d200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4980b2a30 con 0x7ff498159790 2024-01-31T05:05:09.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.405+0000 7ff495400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff4980b3d00 0x7ff498070660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59132/0 (socket says 172.21.15.49:59132) 2024-01-31T05:05:09.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.405+0000 7ff495400640 1 -- 172.21.15.49:0/1039577697 learned_addr learned my addr 172.21.15.49:0/1039577697 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:09.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.405+0000 7ff495e00640 1 --2- 172.21.15.49:0/1039577697 >> v2:172.21.15.195:3300/0 conn(0x7ff498159790 0x7ff4980b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:09.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.405+0000 7ff494a00640 1 -- 172.21.15.49:0/1039577697 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945650817 0 0) 0x7ff498159b70 con 0x7ff4980b3d00 2024-01-31T05:05:09.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.405+0000 7ff494a00640 1 -- 172.21.15.49:0/1039577697 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff478003530 con 0x7ff4980b3d00 2024-01-31T05:05:09.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.405+0000 7ff495e00640 1 -- 172.21.15.49:0/1039577697 >> v1:172.21.15.195:6789/0 conn(0x7ff498070d70 legacy=0x7ff4980ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.405+0000 7ff495e00640 1 -- 172.21.15.49:0/1039577697 >> v1:172.21.15.49:6789/0 conn(0x7ff4980b3d00 legacy=0x7ff498070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.405+0000 7ff495e00640 1 -- 172.21.15.49:0/1039577697 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4980b2d10 con 0x7ff498159790 2024-01-31T05:05:09.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.409+0000 7ff495e00640 1 --2- 172.21.15.49:0/1039577697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff498159790 0x7ff4980b37c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff4880097c0 tx=0x7ff48801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=845a291be51b47c0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:09.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.409+0000 7ff494a00640 1 -- 172.21.15.49:0/1039577697 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4880ab600 con 0x7ff498159790 2024-01-31T05:05:09.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.409+0000 7ff494a00640 1 -- 172.21.15.49:0/1039577697 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4880a7050 con 0x7ff498159790 2024-01-31T05:05:09.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.409+0000 7ff494a00640 1 -- 172.21.15.49:0/1039577697 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4880ab980 con 0x7ff498159790 2024-01-31T05:05:09.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.409+0000 7ff49d200640 1 -- 172.21.15.49:0/1039577697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff498159790 msgr2=0x7ff4980b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.409+0000 7ff49d200640 1 --2- 172.21.15.49:0/1039577697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff498159790 0x7ff4980b37c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff4880097c0 tx=0x7ff48801c3c0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.409+0000 7ff49d200640 1 -- 172.21.15.49:0/1039577697 shutdown_connections 2024-01-31T05:05:09.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.409+0000 7ff49d200640 1 --2- 172.21.15.49:0/1039577697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff498159790 0x7ff4980b37c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.409+0000 7ff49d200640 1 -- 172.21.15.49:0/1039577697 >> 172.21.15.49:0/1039577697 conn(0x7ff4980b09a0 msgr2=0x7ff4980b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:09.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.409+0000 7ff49d200640 1 -- 172.21.15.49:0/1039577697 shutdown_connections 2024-01-31T05:05:09.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.409+0000 7ff49d200640 1 -- 172.21.15.49:0/1039577697 wait complete. 2024-01-31T05:05:09.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.409+0000 7ff49d200640 1 Processor -- start 2024-01-31T05:05:09.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.409+0000 7ff49d200640 1 -- start start 2024-01-31T05:05:09.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.409+0000 7ff49d200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff498070d70 0x7ff498156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:09.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff49d200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4980b3d00 0x7ff498159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:09.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff49d200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff498159790 0x7ff4981582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:09.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff49d200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff498157ed0 con 0x7ff498070d70 2024-01-31T05:05:09.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff49d200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff498157250 con 0x7ff498159790 2024-01-31T05:05:09.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff49d200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff498157530 con 0x7ff4980b3d00 2024-01-31T05:05:09.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff495e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff498070d70 0x7ff498156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:09.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff495e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff498070d70 0x7ff498156c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52626/0 (socket says 172.21.15.49:52626) 2024-01-31T05:05:09.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff495e00640 1 -- 172.21.15.49:0/1955131439 learned_addr learned my addr 172.21.15.49:0/1955131439 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:09.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff496800640 1 --2- 172.21.15.49:0/1955131439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff498159790 0x7ff4981582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff495400640 1 --2- 172.21.15.49:0/1955131439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4980b3d00 0x7ff498159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff495e00640 1 -- 172.21.15.49:0/1955131439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4980b3d00 msgr2=0x7ff498159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff495e00640 1 --2- 172.21.15.49:0/1955131439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4980b3d00 0x7ff498159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff495e00640 1 -- 172.21.15.49:0/1955131439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff498159790 msgr2=0x7ff4981582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff495e00640 1 --2- 172.21.15.49:0/1955131439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff498159790 0x7ff4981582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff495e00640 1 -- 172.21.15.49:0/1955131439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff488009420 con 0x7ff498070d70 2024-01-31T05:05:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff495e00640 1 --2- 172.21.15.49:0/1955131439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff498070d70 0x7ff498156c70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff488019ff0 tx=0x7ff488019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff48e000640 1 -- 172.21.15.49:0/1955131439 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4880b4400 con 0x7ff498070d70 2024-01-31T05:05:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff48e000640 1 -- 172.21.15.49:0/1955131439 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4880b4560 con 0x7ff498070d70 2024-01-31T05:05:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff48e000640 1 -- 172.21.15.49:0/1955131439 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4880b4910 con 0x7ff498070d70 2024-01-31T05:05:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff49d200640 1 -- 172.21.15.49:0/1955131439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff498157810 con 0x7ff498070d70 2024-01-31T05:05:09.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff49d200640 1 -- 172.21.15.49:0/1955131439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4981418c0 con 0x7ff498070d70 2024-01-31T05:05:09.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff49d200640 1 -- 172.21.15.49:0/1955131439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff498158140 con 0x7ff498070d70 2024-01-31T05:05:09.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.413+0000 7ff48e000640 1 -- 172.21.15.49:0/1955131439 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff4880b2040 con 0x7ff498070d70 2024-01-31T05:05:09.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.417+0000 7ff48e000640 1 --2- 172.21.15.49:0/1955131439 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff470066500 0x7ff4700689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:09.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.417+0000 7ff48e000640 1 -- 172.21.15.49:0/1955131439 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff48811dfd0 con 0x7ff498070d70 2024-01-31T05:05:09.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.417+0000 7ff495400640 1 --2- 172.21.15.49:0/1955131439 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff470066500 0x7ff4700689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:09.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.417+0000 7ff495400640 1 --2- 172.21.15.49:0/1955131439 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff470066500 0x7ff4700689c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff49809cd80 tx=0x7ff480007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:09.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.421+0000 7ff48e000640 1 -- 172.21.15.49:0/1955131439 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff4880eaf60 con 0x7ff498070d70 2024-01-31T05:05:09.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.581+0000 7ff49d200640 1 -- 172.21.15.49:0/1955131439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff498074860 con 0x7ff498070d70 2024-01-31T05:05:09.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.581+0000 7ff48e000640 1 -- 172.21.15.49:0/1955131439 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff4880ee580 con 0x7ff498070d70 2024-01-31T05:05:09.581 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:09.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.581+0000 7ff49d200640 1 -- 172.21.15.49:0/1955131439 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff470066500 msgr2=0x7ff4700689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.581+0000 7ff49d200640 1 --2- 172.21.15.49:0/1955131439 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff470066500 0x7ff4700689c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff49809cd80 tx=0x7ff480007d40 comp rx=0 tx=0).stop 2024-01-31T05:05:09.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.581+0000 7ff49d200640 1 -- 172.21.15.49:0/1955131439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff498070d70 msgr2=0x7ff498156c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.581+0000 7ff49d200640 1 --2- 172.21.15.49:0/1955131439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff498070d70 0x7ff498156c70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff488019ff0 tx=0x7ff488019160 comp rx=0 tx=0).stop 2024-01-31T05:05:09.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.581+0000 7ff49d200640 1 -- 172.21.15.49:0/1955131439 shutdown_connections 2024-01-31T05:05:09.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.581+0000 7ff49d200640 1 --2- 172.21.15.49:0/1955131439 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff470066500 0x7ff4700689c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.581+0000 7ff49d200640 1 --2- 172.21.15.49:0/1955131439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff498159790 0x7ff4981582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.581+0000 7ff49d200640 1 --2- 172.21.15.49:0/1955131439 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4980b3d00 0x7ff498159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.581+0000 7ff49d200640 1 --2- 172.21.15.49:0/1955131439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff498070d70 0x7ff498156c70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.581+0000 7ff49d200640 1 -- 172.21.15.49:0/1955131439 >> 172.21.15.49:0/1955131439 conn(0x7ff4980b09a0 msgr2=0x7ff4980cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:09.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.581+0000 7ff49d200640 1 -- 172.21.15.49:0/1955131439 shutdown_connections 2024-01-31T05:05:09.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.581+0000 7ff49d200640 1 -- 172.21.15.49:0/1955131439 wait complete. 2024-01-31T05:05:09.603 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:05:09.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.749+0000 7f2fa1400640 1 Processor -- start 2024-01-31T05:05:09.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.749+0000 7f2fa1400640 1 -- start start 2024-01-31T05:05:09.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.749+0000 7f2fa1400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f9c159790 0x7f2f9c0b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:09.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.749+0000 7f2fa1400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2f9c0b3d00 0x7f2f9c070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:09.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.749+0000 7f2fa1400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9c159b70 con 0x7f2f9c070ba0 2024-01-31T05:05:09.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.749+0000 7f2fa1400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9c071030 con 0x7f2f9c159790 2024-01-31T05:05:09.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.749+0000 7f2fa1400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9c0b2750 con 0x7f2f9c0b3d00 2024-01-31T05:05:09.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.749+0000 7f2f9a800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f9c159790 0x7f2f9c0b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:09.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.749+0000 7f2f9a800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f9c159790 0x7f2f9c0b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52636/0 (socket says 172.21.15.49:52636) 2024-01-31T05:05:09.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.749+0000 7f2f9b200640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2f9c070ba0 0x7f2f9c06cb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59140/0 (socket says 172.21.15.49:59140) 2024-01-31T05:05:09.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.749+0000 7f2f9a800640 1 -- 172.21.15.49:0/2306847010 learned_addr learned my addr 172.21.15.49:0/2306847010 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:09.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.749+0000 7f2f99e00640 1 --2- 172.21.15.49:0/2306847010 >> v2:172.21.15.195:3300/0 conn(0x7f2f9c0b3d00 0x7f2f9c070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:09.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.749+0000 7f2f9a800640 1 -- 172.21.15.49:0/2306847010 >> v2:172.21.15.195:3300/0 conn(0x7f2f9c0b3d00 msgr2=0x7f2f9c070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:09.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.749+0000 7f2f9a800640 1 --2- 172.21.15.49:0/2306847010 >> v2:172.21.15.195:3300/0 conn(0x7f2f9c0b3d00 0x7f2f9c070660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.749+0000 7f2f9a800640 1 -- 172.21.15.49:0/2306847010 >> v1:172.21.15.49:6789/0 conn(0x7f2f9c070ba0 legacy=0x7f2f9c06cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.749+0000 7f2f9a800640 1 -- 172.21.15.49:0/2306847010 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c0b2a30 con 0x7f2f9c159790 2024-01-31T05:05:09.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.753+0000 7f2f9a800640 1 --2- 172.21.15.49:0/2306847010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c159790 0x7f2f9c0b37c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c072cb0 tx=0x7f2f8c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73359497388838b7 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:09.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.753+0000 7f2f99400640 1 -- 172.21.15.49:0/2306847010 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c0ab600 con 0x7f2f9c159790 2024-01-31T05:05:09.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.753+0000 7f2f99400640 1 -- 172.21.15.49:0/2306847010 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8c0a7050 con 0x7f2f9c159790 2024-01-31T05:05:09.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.753+0000 7f2f99400640 1 -- 172.21.15.49:0/2306847010 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c0ab980 con 0x7f2f9c159790 2024-01-31T05:05:09.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.753+0000 7f2fa1400640 1 -- 172.21.15.49:0/2306847010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c159790 msgr2=0x7f2f9c0b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.753+0000 7f2fa1400640 1 --2- 172.21.15.49:0/2306847010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c159790 0x7f2f9c0b37c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c072cb0 tx=0x7f2f8c01c4d0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.753+0000 7f2fa1400640 1 -- 172.21.15.49:0/2306847010 shutdown_connections 2024-01-31T05:05:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.753+0000 7f2fa1400640 1 --2- 172.21.15.49:0/2306847010 >> v2:172.21.15.195:3300/0 conn(0x7f2f9c0b3d00 0x7f2f9c070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.753+0000 7f2fa1400640 1 --2- 172.21.15.49:0/2306847010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c159790 0x7f2f9c0b37c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.753+0000 7f2fa1400640 1 -- 172.21.15.49:0/2306847010 >> 172.21.15.49:0/2306847010 conn(0x7f2f9c0b09a0 msgr2=0x7f2f9c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.753+0000 7f2fa1400640 1 -- 172.21.15.49:0/2306847010 shutdown_connections 2024-01-31T05:05:09.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.753+0000 7f2fa1400640 1 -- 172.21.15.49:0/2306847010 wait complete. 2024-01-31T05:05:09.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2fa1400640 1 Processor -- start 2024-01-31T05:05:09.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2fa1400640 1 -- start start 2024-01-31T05:05:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2fa1400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f9c070ba0 0x7f2f9c0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2fa1400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c0b3d00 0x7f2f9c15b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2fa1400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f9c159790 0x7f2f9c15a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2fa1400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c15c710 con 0x7f2f9c0b3d00 2024-01-31T05:05:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2fa1400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c15a5a0 con 0x7f2f9c159790 2024-01-31T05:05:09.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2fa1400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c15c430 con 0x7f2f9c070ba0 2024-01-31T05:05:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2f99e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c0b3d00 0x7f2f9c15b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2f99e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c0b3d00 0x7f2f9c15b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52638/0 (socket says 172.21.15.49:52638) 2024-01-31T05:05:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2f99e00640 1 -- 172.21.15.49:0/2102135388 learned_addr learned my addr 172.21.15.49:0/2102135388 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2f9a800640 1 --2- 172.21.15.49:0/2102135388 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f9c070ba0 0x7f2f9c0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2f9b200640 1 --2- 172.21.15.49:0/2102135388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f9c159790 0x7f2f9c15a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2f99e00640 1 -- 172.21.15.49:0/2102135388 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f9c070ba0 msgr2=0x7f2f9c0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2f99e00640 1 --2- 172.21.15.49:0/2102135388 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f9c070ba0 0x7f2f9c0cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2f99e00640 1 -- 172.21.15.49:0/2102135388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f9c159790 msgr2=0x7f2f9c15a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2f99e00640 1 --2- 172.21.15.49:0/2102135388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f9c159790 0x7f2f9c15a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2f99e00640 1 -- 172.21.15.49:0/2102135388 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0094d0 con 0x7f2f9c0b3d00 2024-01-31T05:05:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2f99e00640 1 --2- 172.21.15.49:0/2102135388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c0b3d00 0x7f2f9c15b9b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400d830 tx=0x7f2f8400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2f92a00640 1 -- 172.21.15.49:0/2102135388 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8400b6c0 con 0x7f2f9c0b3d00 2024-01-31T05:05:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2f92a00640 1 -- 172.21.15.49:0/2102135388 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8400b820 con 0x7f2f9c0b3d00 2024-01-31T05:05:09.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2f92a00640 1 -- 172.21.15.49:0/2102135388 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8400bb90 con 0x7f2f9c0b3d00 2024-01-31T05:05:09.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2fa1400640 1 -- 172.21.15.49:0/2102135388 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9c159ee0 con 0x7f2f9c0b3d00 2024-01-31T05:05:09.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2fa1400640 1 -- 172.21.15.49:0/2102135388 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9c14cf00 con 0x7f2f9c0b3d00 2024-01-31T05:05:09.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.757+0000 7f2fa1400640 1 -- 172.21.15.49:0/2102135388 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f9c074860 con 0x7f2f9c0b3d00 2024-01-31T05:05:09.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.761+0000 7f2f92a00640 1 -- 172.21.15.49:0/2102135388 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f2f8401e460 con 0x7f2f9c0b3d00 2024-01-31T05:05:09.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.761+0000 7f2f92a00640 1 --2- 172.21.15.49:0/2102135388 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2f74066500 0x7f2f740689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:09.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.761+0000 7f2f92a00640 1 -- 172.21.15.49:0/2102135388 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2f84084960 con 0x7f2f9c0b3d00 2024-01-31T05:05:09.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.761+0000 7f2f9a800640 1 --2- 172.21.15.49:0/2102135388 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2f74066500 0x7f2f740689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:09.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.761+0000 7f2f9a800640 1 --2- 172.21.15.49:0/2102135388 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2f74066500 0x7f2f740689c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c06dbe0 tx=0x7f2f8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:09.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.765+0000 7f2f92a00640 1 -- 172.21.15.49:0/2102135388 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f2f840518d0 con 0x7f2f9c0b3d00 2024-01-31T05:05:09.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.929+0000 7f2fa1400640 1 -- 172.21.15.49:0/2102135388 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f9c150280 con 0x7f2f9c0b3d00 2024-01-31T05:05:09.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.929+0000 7f2f92a00640 1 -- 172.21.15.49:0/2102135388 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2f84054ef0 con 0x7f2f9c0b3d00 2024-01-31T05:05:09.929 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-31T05:05:09.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.929+0000 7f2fa1400640 1 -- 172.21.15.49:0/2102135388 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2f74066500 msgr2=0x7f2f740689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.929+0000 7f2fa1400640 1 --2- 172.21.15.49:0/2102135388 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2f74066500 0x7f2f740689c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c06dbe0 tx=0x7f2f8c008040 comp rx=0 tx=0).stop 2024-01-31T05:05:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.929+0000 7f2fa1400640 1 -- 172.21.15.49:0/2102135388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c0b3d00 msgr2=0x7f2f9c15b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.929+0000 7f2fa1400640 1 --2- 172.21.15.49:0/2102135388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c0b3d00 0x7f2f9c15b9b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400d830 tx=0x7f2f8400dcf0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.929+0000 7f2fa1400640 1 -- 172.21.15.49:0/2102135388 shutdown_connections 2024-01-31T05:05:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.929+0000 7f2fa1400640 1 --2- 172.21.15.49:0/2102135388 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2f74066500 0x7f2f740689c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.929+0000 7f2fa1400640 1 --2- 172.21.15.49:0/2102135388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f9c159790 0x7f2f9c15a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.929+0000 7f2fa1400640 1 --2- 172.21.15.49:0/2102135388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f9c0b3d00 0x7f2f9c15b9b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.929+0000 7f2fa1400640 1 --2- 172.21.15.49:0/2102135388 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f9c070ba0 0x7f2f9c0cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.929+0000 7f2fa1400640 1 -- 172.21.15.49:0/2102135388 >> 172.21.15.49:0/2102135388 conn(0x7f2f9c0b09a0 msgr2=0x7f2f9c0b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.929+0000 7f2fa1400640 1 -- 172.21.15.49:0/2102135388 shutdown_connections 2024-01-31T05:05:09.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:09.929+0000 7f2fa1400640 1 -- 172.21.15.49:0/2102135388 wait complete. 2024-01-31T05:05:09.950 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-31T05:05:10.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.093+0000 7f6244200640 1 Processor -- start 2024-01-31T05:05:10.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.093+0000 7f6244200640 1 -- start start 2024-01-31T05:05:10.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.093+0000 7f6244200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f623c15d540 0x7f623c0cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:10.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.093+0000 7f6244200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f623c0cbbc0 0x7f623c15d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:10.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.093+0000 7f6244200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f623c0cef80 con 0x7f623c06c290 2024-01-31T05:05:10.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.093+0000 7f6244200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623c06cae0 con 0x7f623c0cbbc0 2024-01-31T05:05:10.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.093+0000 7f6244200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623c0cf1b0 con 0x7f623c15d540 2024-01-31T05:05:10.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.093+0000 7f6242200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f623c0cbbc0 0x7f623c15d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:10.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.093+0000 7f6242200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f623c0cbbc0 0x7f623c15d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52646/0 (socket says 172.21.15.49:52646) 2024-01-31T05:05:10.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.093+0000 7f6242200640 1 -- 172.21.15.49:0/3509867524 learned_addr learned my addr 172.21.15.49:0/3509867524 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:10.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.093+0000 7f6241800640 1 --2- 172.21.15.49:0/3509867524 >> v2:172.21.15.195:3300/0 conn(0x7f623c15d540 0x7f623c0cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:10.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.097+0000 7f6242200640 1 -- 172.21.15.49:0/3509867524 >> v2:172.21.15.195:3300/0 conn(0x7f623c15d540 msgr2=0x7f623c0cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:10.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.097+0000 7f6242200640 1 --2- 172.21.15.49:0/3509867524 >> v2:172.21.15.195:3300/0 conn(0x7f623c15d540 0x7f623c0cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:10.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.097+0000 7f6242200640 1 -- 172.21.15.49:0/3509867524 >> v1:172.21.15.195:6789/0 conn(0x7f623c06c290 legacy=0x7f623c0cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:10.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.097+0000 7f6242200640 1 -- 172.21.15.49:0/3509867524 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623c0cf490 con 0x7f623c0cbbc0 2024-01-31T05:05:10.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.097+0000 7f6242200640 1 --2- 172.21.15.49:0/3509867524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0cbbc0 0x7f623c15d920 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f623c071f60 tx=0x7f623401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd3f13449b2fc7e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:10.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.097+0000 7f623be00640 1 -- 172.21.15.49:0/3509867524 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62340a5860 con 0x7f623c0cbbc0 2024-01-31T05:05:10.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.097+0000 7f623be00640 1 -- 172.21.15.49:0/3509867524 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62340a59c0 con 0x7f623c0cbbc0 2024-01-31T05:05:10.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.097+0000 7f623be00640 1 -- 172.21.15.49:0/3509867524 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62340a5d50 con 0x7f623c0cbbc0 2024-01-31T05:05:10.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6244200640 1 -- 172.21.15.49:0/3509867524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0cbbc0 msgr2=0x7f623c15d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:10.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6244200640 1 --2- 172.21.15.49:0/3509867524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0cbbc0 0x7f623c15d920 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f623c071f60 tx=0x7f623401c9a0 comp rx=0 tx=0).stop 2024-01-31T05:05:10.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6244200640 1 -- 172.21.15.49:0/3509867524 shutdown_connections 2024-01-31T05:05:10.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6244200640 1 --2- 172.21.15.49:0/3509867524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0cbbc0 0x7f623c15d920 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:10.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6244200640 1 --2- 172.21.15.49:0/3509867524 >> v2:172.21.15.195:3300/0 conn(0x7f623c15d540 0x7f623c0cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:10.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6244200640 1 -- 172.21.15.49:0/3509867524 >> 172.21.15.49:0/3509867524 conn(0x7f623c0d0e60 msgr2=0x7f623c0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:10.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6244200640 1 -- 172.21.15.49:0/3509867524 shutdown_connections 2024-01-31T05:05:10.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6244200640 1 -- 172.21.15.49:0/3509867524 wait complete. 2024-01-31T05:05:10.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6244200640 1 Processor -- start 2024-01-31T05:05:10.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6244200640 1 -- start start 2024-01-31T05:05:10.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6244200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c06c290 0x7f623c153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:10.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6244200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f623c0cbbc0 0x7f623c149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:10.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6244200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f623c15d540 0x7f623c1511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:10.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6244200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c153400 con 0x7f623c06c290 2024-01-31T05:05:10.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6244200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c151c00 con 0x7f623c0cbbc0 2024-01-31T05:05:10.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6244200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623c153670 con 0x7f623c15d540 2024-01-31T05:05:10.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6241800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c06c290 0x7f623c153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:10.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6241800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c06c290 0x7f623c153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52654/0 (socket says 172.21.15.49:52654) 2024-01-31T05:05:10.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6241800640 1 -- 172.21.15.49:0/2720087942 learned_addr learned my addr 172.21.15.49:0/2720087942 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:10.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6240e00640 1 --2- 172.21.15.49:0/2720087942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f623c0cbbc0 0x7f623c149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:10.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6242200640 1 --2- 172.21.15.49:0/2720087942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f623c15d540 0x7f623c1511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:10.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6241800640 1 -- 172.21.15.49:0/2720087942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f623c15d540 msgr2=0x7f623c1511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:10.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6241800640 1 --2- 172.21.15.49:0/2720087942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f623c15d540 0x7f623c1511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:10.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6241800640 1 -- 172.21.15.49:0/2720087942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f623c0cbbc0 msgr2=0x7f623c149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:10.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6241800640 1 --2- 172.21.15.49:0/2720087942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f623c0cbbc0 0x7f623c149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:10.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.101+0000 7f6241800640 1 -- 172.21.15.49:0/2720087942 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6234009b30 con 0x7f623c06c290 2024-01-31T05:05:10.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.105+0000 7f6241800640 1 --2- 172.21.15.49:0/2720087942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c06c290 0x7f623c153e70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f622c00d5f0 tx=0x7f622c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:10.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.105+0000 7f6239600640 1 -- 172.21.15.49:0/2720087942 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c0125f0 con 0x7f623c06c290 2024-01-31T05:05:10.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.105+0000 7f6239600640 1 -- 172.21.15.49:0/2720087942 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622c012750 con 0x7f623c06c290 2024-01-31T05:05:10.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.105+0000 7f6239600640 1 -- 172.21.15.49:0/2720087942 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c012ae0 con 0x7f623c06c290 2024-01-31T05:05:10.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.105+0000 7f6244200640 1 -- 172.21.15.49:0/2720087942 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623c153950 con 0x7f623c06c290 2024-01-31T05:05:10.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.105+0000 7f6244200640 1 -- 172.21.15.49:0/2720087942 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623c154af0 con 0x7f623c06c290 2024-01-31T05:05:10.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.105+0000 7f6244200640 1 -- 172.21.15.49:0/2720087942 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623c0ce880 con 0x7f623c06c290 2024-01-31T05:05:10.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.105+0000 7f6239600640 1 -- 172.21.15.49:0/2720087942 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f622c012c40 con 0x7f623c06c290 2024-01-31T05:05:10.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.105+0000 7f6239600640 1 --2- 172.21.15.49:0/2720087942 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6214066500 0x7f62140689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:10.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.105+0000 7f6239600640 1 -- 172.21.15.49:0/2720087942 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f622c084630 con 0x7f623c06c290 2024-01-31T05:05:10.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.105+0000 7f6240e00640 1 --2- 172.21.15.49:0/2720087942 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6214066500 0x7f62140689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:10.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.109+0000 7f6240e00640 1 --2- 172.21.15.49:0/2720087942 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6214066500 0x7f62140689c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6224001810 tx=0x7f6224009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:10.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.109+0000 7f6239600640 1 -- 172.21.15.49:0/2720087942 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f622c0515a0 con 0x7f623c06c290 2024-01-31T05:05:10.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.269+0000 7f6244200640 1 -- 172.21.15.49:0/2720087942 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f623c074860 con 0x7f623c06c290 2024-01-31T05:05:10.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.269+0000 7f6239600640 1 -- 172.21.15.49:0/2720087942 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f622c054bc0 con 0x7f623c06c290 2024-01-31T05:05:10.268 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:10.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.269+0000 7f6244200640 1 -- 172.21.15.49:0/2720087942 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6214066500 msgr2=0x7f62140689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:10.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.269+0000 7f6244200640 1 --2- 172.21.15.49:0/2720087942 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6214066500 0x7f62140689c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6224001810 tx=0x7f6224009040 comp rx=0 tx=0).stop 2024-01-31T05:05:10.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.269+0000 7f6244200640 1 -- 172.21.15.49:0/2720087942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c06c290 msgr2=0x7f623c153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:10.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.269+0000 7f6244200640 1 --2- 172.21.15.49:0/2720087942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c06c290 0x7f623c153e70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f622c00d5f0 tx=0x7f622c00dab0 comp rx=0 tx=0).stop 2024-01-31T05:05:10.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.269+0000 7f6244200640 1 -- 172.21.15.49:0/2720087942 shutdown_connections 2024-01-31T05:05:10.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.269+0000 7f6244200640 1 --2- 172.21.15.49:0/2720087942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f623c15d540 0x7f623c1511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:10.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.269+0000 7f6244200640 1 --2- 172.21.15.49:0/2720087942 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6214066500 0x7f62140689c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:10.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.269+0000 7f6244200640 1 --2- 172.21.15.49:0/2720087942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f623c0cbbc0 0x7f623c149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:10.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.269+0000 7f6244200640 1 --2- 172.21.15.49:0/2720087942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c06c290 0x7f623c153e70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:10.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.269+0000 7f6244200640 1 -- 172.21.15.49:0/2720087942 >> 172.21.15.49:0/2720087942 conn(0x7f623c0d0e60 msgr2=0x7f623c0cb490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:10.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.269+0000 7f6244200640 1 -- 172.21.15.49:0/2720087942 shutdown_connections 2024-01-31T05:05:10.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.269+0000 7f6244200640 1 -- 172.21.15.49:0/2720087942 wait complete. 2024-01-31T05:05:10.291 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-01-31T05:05:10.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.433+0000 7f8f1aa00640 1 Processor -- start 2024-01-31T05:05:10.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.433+0000 7f8f1aa00640 1 -- start start 2024-01-31T05:05:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.433+0000 7f8f1aa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f14071b90 0x7f8f140cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.433+0000 7f8f1aa00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8f140cbbe0 0x7f8f1406e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:10.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.433+0000 7f8f1aa00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f140cafe0 con 0x7f8f141579f0 2024-01-31T05:05:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.433+0000 7f8f1aa00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f140ca3f0 con 0x7f8f140cbbe0 2024-01-31T05:05:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.433+0000 7f8f1aa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f14157dd0 con 0x7f8f14071b90 2024-01-31T05:05:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.433+0000 7f8f13e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f8f141579f0 0x7f8f14071480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59146/0 (socket says 172.21.15.49:59146) 2024-01-31T05:05:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.433+0000 7f8f13e00640 1 -- 172.21.15.49:0/4277140713 learned_addr learned my addr 172.21.15.49:0/4277140713 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.433+0000 7f8f13400640 1 --2- 172.21.15.49:0/4277140713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f14071b90 0x7f8f140cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.433+0000 7f8f18a00640 1 --2- 172.21.15.49:0/4277140713 >> v2:172.21.15.195:3300/0 conn(0x7f8f140cbbe0 0x7f8f1406e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.433+0000 7f8f12a00640 1 -- 172.21.15.49:0/4277140713 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842778344 0 0) 0x7f8f140cafe0 con 0x7f8f141579f0 2024-01-31T05:05:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.433+0000 7f8f12a00640 1 -- 172.21.15.49:0/4277140713 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ef4003530 con 0x7f8f141579f0 2024-01-31T05:05:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.433+0000 7f8f12a00640 1 -- 172.21.15.49:0/4277140713 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2303801801 0 0) 0x7f8ef4003530 con 0x7f8f141579f0 2024-01-31T05:05:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.433+0000 7f8f13400640 1 -- 172.21.15.49:0/4277140713 >> v2:172.21.15.195:3300/0 conn(0x7f8f140cbbe0 msgr2=0x7f8f1406e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.433+0000 7f8f13400640 1 --2- 172.21.15.49:0/4277140713 >> v2:172.21.15.195:3300/0 conn(0x7f8f140cbbe0 0x7f8f1406e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.437+0000 7f8f13400640 1 -- 172.21.15.49:0/4277140713 >> v1:172.21.15.49:6789/0 conn(0x7f8f141579f0 legacy=0x7f8f14071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:10.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.437+0000 7f8f13400640 1 -- 172.21.15.49:0/4277140713 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f140ca6b0 con 0x7f8f14071b90 2024-01-31T05:05:10.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.437+0000 7f8f13400640 1 --2- 172.21.15.49:0/4277140713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f14071b90 0x7f8f140cb6a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0097c0 tx=0x7f8efc01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac8bff238409a8f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.437+0000 7f8f12a00640 1 -- 172.21.15.49:0/4277140713 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f04001680 con 0x7f8f14071b90 2024-01-31T05:05:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.437+0000 7f8f12a00640 1 -- 172.21.15.49:0/4277140713 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8efc0a7050 con 0x7f8f14071b90 2024-01-31T05:05:10.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.437+0000 7f8f12a00640 1 -- 172.21.15.49:0/4277140713 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc0ab620 con 0x7f8f14071b90 2024-01-31T05:05:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.437+0000 7f8f1aa00640 1 -- 172.21.15.49:0/4277140713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f14071b90 msgr2=0x7f8f140cb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.437+0000 7f8f1aa00640 1 --2- 172.21.15.49:0/4277140713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f14071b90 0x7f8f140cb6a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0097c0 tx=0x7f8efc01c370 comp rx=0 tx=0).stop 2024-01-31T05:05:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f1aa00640 1 -- 172.21.15.49:0/4277140713 shutdown_connections 2024-01-31T05:05:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f1aa00640 1 --2- 172.21.15.49:0/4277140713 >> v2:172.21.15.195:3300/0 conn(0x7f8f140cbbe0 0x7f8f1406e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f1aa00640 1 --2- 172.21.15.49:0/4277140713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f14071b90 0x7f8f140cb6a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f1aa00640 1 -- 172.21.15.49:0/4277140713 >> 172.21.15.49:0/4277140713 conn(0x7f8f140cfda0 msgr2=0x7f8f140d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f1aa00640 1 -- 172.21.15.49:0/4277140713 shutdown_connections 2024-01-31T05:05:10.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f1aa00640 1 -- 172.21.15.49:0/4277140713 wait complete. 2024-01-31T05:05:10.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f1aa00640 1 Processor -- start 2024-01-31T05:05:10.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f1aa00640 1 -- start start 2024-01-31T05:05:10.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f1aa00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f14071b90 0x7f8f1415c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:10.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f1aa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f140cbbe0 0x7f8f141512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:10.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f1aa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f141579f0 0x7f8f140b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:10.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f1aa00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f14153590 con 0x7f8f141579f0 2024-01-31T05:05:10.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f1aa00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f140b3950 con 0x7f8f14071b90 2024-01-31T05:05:10.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f1aa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f14156c80 con 0x7f8f140cbbe0 2024-01-31T05:05:10.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f18a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f141579f0 0x7f8f140b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:10.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f18a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f141579f0 0x7f8f140b3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52658/0 (socket says 172.21.15.49:52658) 2024-01-31T05:05:10.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f18a00640 1 -- 172.21.15.49:0/398958030 learned_addr learned my addr 172.21.15.49:0/398958030 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:10.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f13e00640 1 --2- 172.21.15.49:0/398958030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f14071b90 0x7f8f1415c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:10.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f13400640 1 --2- 172.21.15.49:0/398958030 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f140cbbe0 0x7f8f141512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:10.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f18a00640 1 -- 172.21.15.49:0/398958030 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f140cbbe0 msgr2=0x7f8f141512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:10.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f18a00640 1 --2- 172.21.15.49:0/398958030 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f140cbbe0 0x7f8f141512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:10.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f18a00640 1 -- 172.21.15.49:0/398958030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f14071b90 msgr2=0x7f8f1415c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:10.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f18a00640 1 --2- 172.21.15.49:0/398958030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f14071b90 0x7f8f1415c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:10.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f18a00640 1 -- 172.21.15.49:0/398958030 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc009420 con 0x7f8f141579f0 2024-01-31T05:05:10.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f13e00640 1 --2- 172.21.15.49:0/398958030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f14071b90 0x7f8f1415c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:10.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.441+0000 7f8f18a00640 1 --2- 172.21.15.49:0/398958030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f141579f0 0x7f8f140b3d70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009dd0 tx=0x7f8f0c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:10.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.445+0000 7f8f0be00640 1 -- 172.21.15.49:0/398958030 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c014480 con 0x7f8f141579f0 2024-01-31T05:05:10.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.445+0000 7f8f0be00640 1 -- 172.21.15.49:0/398958030 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0c00f040 con 0x7f8f141579f0 2024-01-31T05:05:10.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.445+0000 7f8f0be00640 1 -- 172.21.15.49:0/398958030 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c014840 con 0x7f8f141579f0 2024-01-31T05:05:10.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.445+0000 7f8f1aa00640 1 -- 172.21.15.49:0/398958030 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f14152fd0 con 0x7f8f141579f0 2024-01-31T05:05:10.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.445+0000 7f8f1aa00640 1 -- 172.21.15.49:0/398958030 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f140b3570 con 0x7f8f141579f0 2024-01-31T05:05:10.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.445+0000 7f8f1aa00640 1 -- 172.21.15.49:0/398958030 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f140b33d0 con 0x7f8f141579f0 2024-01-31T05:05:10.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.445+0000 7f8f0be00640 1 -- 172.21.15.49:0/398958030 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f8f0c0149a0 con 0x7f8f141579f0 2024-01-31T05:05:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.445+0000 7f8f0be00640 1 --2- 172.21.15.49:0/398958030 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8eec066500 0x7f8eec0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.445+0000 7f8f0be00640 1 -- 172.21.15.49:0/398958030 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8f0c085050 con 0x7f8f141579f0 2024-01-31T05:05:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.445+0000 7f8f13e00640 1 --2- 172.21.15.49:0/398958030 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8eec066500 0x7f8eec0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.449+0000 7f8f13e00640 1 --2- 172.21.15.49:0/398958030 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8eec066500 0x7f8eec0689c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8f04007a10 tx=0x7f8f04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:10.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.449+0000 7f8f0be00640 1 -- 172.21.15.49:0/398958030 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f8f140b33d0 con 0x7f8f141579f0 2024-01-31T05:05:10.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:10.665+0000 7f8f1aa00640 1 -- 172.21.15.49:0/398958030 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f8f140b3a90 con 0x7f8f141579f0 2024-01-31T05:05:11.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.333+0000 7f8f0be00640 1 -- 172.21.15.49:0/398958030 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v75) v1 ==== 147+0+0 (secure 0 0 0) 0x7f8f140b3a90 con 0x7f8f141579f0 2024-01-31T05:05:11.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.337+0000 7f8f1aa00640 1 -- 172.21.15.49:0/398958030 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8eec066500 msgr2=0x7f8eec0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:11.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.337+0000 7f8f1aa00640 1 --2- 172.21.15.49:0/398958030 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8eec066500 0x7f8eec0689c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8f04007a10 tx=0x7f8f04009040 comp rx=0 tx=0).stop 2024-01-31T05:05:11.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.337+0000 7f8f1aa00640 1 -- 172.21.15.49:0/398958030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f141579f0 msgr2=0x7f8f140b3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:11.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.337+0000 7f8f1aa00640 1 --2- 172.21.15.49:0/398958030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f141579f0 0x7f8f140b3d70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009dd0 tx=0x7f8f0c00c490 comp rx=0 tx=0).stop 2024-01-31T05:05:11.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.337+0000 7f8f1aa00640 1 -- 172.21.15.49:0/398958030 shutdown_connections 2024-01-31T05:05:11.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.337+0000 7f8f1aa00640 1 --2- 172.21.15.49:0/398958030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f141579f0 0x7f8f140b3d70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:11.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.337+0000 7f8f1aa00640 1 --2- 172.21.15.49:0/398958030 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8f140cbbe0 0x7f8f141512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:11.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.337+0000 7f8f1aa00640 1 --2- 172.21.15.49:0/398958030 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8eec066500 0x7f8eec0689c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:11.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.337+0000 7f8f1aa00640 1 --2- 172.21.15.49:0/398958030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f14071b90 0x7f8f1415c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:11.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.337+0000 7f8f1aa00640 1 -- 172.21.15.49:0/398958030 >> 172.21.15.49:0/398958030 conn(0x7f8f140cfda0 msgr2=0x7f8f140c9260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:11.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.337+0000 7f8f1aa00640 1 -- 172.21.15.49:0/398958030 shutdown_connections 2024-01-31T05:05:11.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.337+0000 7f8f1aa00640 1 -- 172.21.15.49:0/398958030 wait complete. 2024-01-31T05:05:11.359 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-31T05:05:11.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.505+0000 7f4d7da00640 1 Processor -- start 2024-01-31T05:05:11.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.505+0000 7f4d7da00640 1 -- start start 2024-01-31T05:05:11.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.505+0000 7f4d7da00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d7815b110 0x7f4d7806c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:11.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.505+0000 7f4d7da00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7815b4f0 con 0x7f4d780cdf10 2024-01-31T05:05:11.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.505+0000 7f4d7da00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d780abf20 con 0x7f4d780714e0 2024-01-31T05:05:11.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.505+0000 7f4d7da00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d780ce460 con 0x7f4d7815b110 2024-01-31T05:05:11.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.505+0000 7f4d76a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d7815b110 0x7f4d7806c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:11.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.505+0000 7f4d76a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4d7815b110 0x7f4d7806c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52666/0 (socket says 172.21.15.49:52666) 2024-01-31T05:05:11.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.505+0000 7f4d76000640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4d780cdf10 0x7f4d78070dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59162/0 (socket says 172.21.15.49:59162) 2024-01-31T05:05:11.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.505+0000 7f4d76a00640 1 -- 172.21.15.49:0/66479187 learned_addr learned my addr 172.21.15.49:0/66479187 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:11.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.505+0000 7f4d76a00640 1 -- 172.21.15.49:0/66479187 >> v1:172.21.15.195:6789/0 conn(0x7f4d780714e0 legacy=0x7f4d780ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:11.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.505+0000 7f4d76a00640 1 -- 172.21.15.49:0/66479187 >> v1:172.21.15.49:6789/0 conn(0x7f4d780cdf10 legacy=0x7f4d78070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:11.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.505+0000 7f4d76a00640 1 -- 172.21.15.49:0/66479187 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d780ac200 con 0x7f4d7815b110 2024-01-31T05:05:11.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.509+0000 7f4d76a00640 1 --2- 172.21.15.49:0/66479187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d7815b110 0x7f4d7806c2d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4d68009870 tx=0x7f4d6801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413a77b7462a8967 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:11.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.509+0000 7f4d75600640 1 -- 172.21.15.49:0/66479187 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d680ac640 con 0x7f4d7815b110 2024-01-31T05:05:11.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.509+0000 7f4d75600640 1 -- 172.21.15.49:0/66479187 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d680ac7a0 con 0x7f4d7815b110 2024-01-31T05:05:11.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.509+0000 7f4d75600640 1 -- 172.21.15.49:0/66479187 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d680acb30 con 0x7f4d7815b110 2024-01-31T05:05:11.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.509+0000 7f4d7da00640 1 -- 172.21.15.49:0/66479187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d7815b110 msgr2=0x7f4d7806c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:11.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.509+0000 7f4d7da00640 1 --2- 172.21.15.49:0/66479187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d7815b110 0x7f4d7806c2d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4d68009870 tx=0x7f4d6801c4d0 comp rx=0 tx=0).stop 2024-01-31T05:05:11.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.509+0000 7f4d7da00640 1 -- 172.21.15.49:0/66479187 shutdown_connections 2024-01-31T05:05:11.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.509+0000 7f4d7da00640 1 --2- 172.21.15.49:0/66479187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d7815b110 0x7f4d7806c2d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:11.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.509+0000 7f4d7da00640 1 -- 172.21.15.49:0/66479187 >> 172.21.15.49:0/66479187 conn(0x7f4d780b09a0 msgr2=0x7f4d780b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:11.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d7da00640 1 -- 172.21.15.49:0/66479187 shutdown_connections 2024-01-31T05:05:11.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d7da00640 1 -- 172.21.15.49:0/66479187 wait complete. 2024-01-31T05:05:11.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d7da00640 1 Processor -- start 2024-01-31T05:05:11.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d7da00640 1 -- start start 2024-01-31T05:05:11.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d7da00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d780714e0 0x7f4d7815b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:11.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d7da00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d780cdf10 0x7f4d78148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:11.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d7da00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d7815b110 0x7f4d78142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:11.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d7da00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d78149160 con 0x7f4d780714e0 2024-01-31T05:05:11.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d7da00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d78148850 con 0x7f4d780cdf10 2024-01-31T05:05:11.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d7da00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d78143140 con 0x7f4d7815b110 2024-01-31T05:05:11.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d76a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d780714e0 0x7f4d7815b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:11.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d76a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d780714e0 0x7f4d7815b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52680/0 (socket says 172.21.15.49:52680) 2024-01-31T05:05:11.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d76a00640 1 -- 172.21.15.49:0/4153070932 learned_addr learned my addr 172.21.15.49:0/4153070932 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:11.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d76000640 1 --2- 172.21.15.49:0/4153070932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d780cdf10 0x7f4d78148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:11.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d76a00640 1 -- 172.21.15.49:0/4153070932 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d7815b110 msgr2=0x7f4d78142c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:11.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d77400640 1 --2- 172.21.15.49:0/4153070932 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d7815b110 0x7f4d78142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:11.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d76a00640 1 --2- 172.21.15.49:0/4153070932 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d7815b110 0x7f4d78142c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:11.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d76a00640 1 -- 172.21.15.49:0/4153070932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d780cdf10 msgr2=0x7f4d78148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:11.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d76a00640 1 --2- 172.21.15.49:0/4153070932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d780cdf10 0x7f4d78148c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:11.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d76a00640 1 -- 172.21.15.49:0/4153070932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d680094d0 con 0x7f4d780714e0 2024-01-31T05:05:11.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d76000640 1 --2- 172.21.15.49:0/4153070932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d780cdf10 0x7f4d78148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:11.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d77400640 1 --2- 172.21.15.49:0/4153070932 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d7815b110 0x7f4d78142c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:11.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d76a00640 1 --2- 172.21.15.49:0/4153070932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d780714e0 0x7f4d7815b7d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4d680af040 tx=0x7f4d6801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:11.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.513+0000 7f4d6ea00640 1 -- 172.21.15.49:0/4153070932 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d680b7830 con 0x7f4d780714e0 2024-01-31T05:05:11.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.517+0000 7f4d6ea00640 1 -- 172.21.15.49:0/4153070932 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d680b79b0 con 0x7f4d780714e0 2024-01-31T05:05:11.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.517+0000 7f4d7da00640 1 -- 172.21.15.49:0/4153070932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7815e8b0 con 0x7f4d780714e0 2024-01-31T05:05:11.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.517+0000 7f4d6ea00640 1 -- 172.21.15.49:0/4153070932 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d680b7d60 con 0x7f4d780714e0 2024-01-31T05:05:11.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.517+0000 7f4d7da00640 1 -- 172.21.15.49:0/4153070932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7815e5d0 con 0x7f4d780714e0 2024-01-31T05:05:11.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.517+0000 7f4d7da00640 1 -- 172.21.15.49:0/4153070932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d78074860 con 0x7f4d780714e0 2024-01-31T05:05:11.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.517+0000 7f4d6ea00640 1 -- 172.21.15.49:0/4153070932 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f4d680b3040 con 0x7f4d780714e0 2024-01-31T05:05:11.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.517+0000 7f4d6ea00640 1 --2- 172.21.15.49:0/4153070932 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4d50066530 0x7f4d500689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:11.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.517+0000 7f4d6ea00640 1 -- 172.21.15.49:0/4153070932 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4d6811e9d0 con 0x7f4d780714e0 2024-01-31T05:05:11.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.517+0000 7f4d76000640 1 --2- 172.21.15.49:0/4153070932 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4d50066530 0x7f4d500689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:11.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.521+0000 7f4d76000640 1 --2- 172.21.15.49:0/4153070932 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4d50066530 0x7f4d500689f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4d60007fd0 tx=0x7f4d60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:11.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.521+0000 7f4d6ea00640 1 -- 172.21.15.49:0/4153070932 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f4d680eb950 con 0x7f4d780714e0 2024-01-31T05:05:11.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.681+0000 7f4d7da00640 1 -- 172.21.15.49:0/4153070932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4d780b17d0 con 0x7f4d780714e0 2024-01-31T05:05:11.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.685+0000 7f4d6ea00640 1 -- 172.21.15.49:0/4153070932 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4d680eef70 con 0x7f4d780714e0 2024-01-31T05:05:11.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.685+0000 7f4d7da00640 1 -- 172.21.15.49:0/4153070932 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4d50066530 msgr2=0x7f4d500689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:11.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.685+0000 7f4d7da00640 1 --2- 172.21.15.49:0/4153070932 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4d50066530 0x7f4d500689f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4d60007fd0 tx=0x7f4d60009040 comp rx=0 tx=0).stop 2024-01-31T05:05:11.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.685+0000 7f4d7da00640 1 -- 172.21.15.49:0/4153070932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d780714e0 msgr2=0x7f4d7815b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:11.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.685+0000 7f4d7da00640 1 --2- 172.21.15.49:0/4153070932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d780714e0 0x7f4d7815b7d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4d680af040 tx=0x7f4d6801ad10 comp rx=0 tx=0).stop 2024-01-31T05:05:11.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.685+0000 7f4d7da00640 1 -- 172.21.15.49:0/4153070932 shutdown_connections 2024-01-31T05:05:11.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.685+0000 7f4d7da00640 1 --2- 172.21.15.49:0/4153070932 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d7815b110 0x7f4d78142c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:11.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.685+0000 7f4d7da00640 1 --2- 172.21.15.49:0/4153070932 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4d50066530 0x7f4d500689f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:11.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.685+0000 7f4d7da00640 1 --2- 172.21.15.49:0/4153070932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d780cdf10 0x7f4d78148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:11.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.685+0000 7f4d7da00640 1 --2- 172.21.15.49:0/4153070932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d780714e0 0x7f4d7815b7d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:11.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.685+0000 7f4d7da00640 1 -- 172.21.15.49:0/4153070932 >> 172.21.15.49:0/4153070932 conn(0x7f4d780b09a0 msgr2=0x7f4d78149950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:11.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.685+0000 7f4d7da00640 1 -- 172.21.15.49:0/4153070932 shutdown_connections 2024-01-31T05:05:11.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:11.685+0000 7f4d7da00640 1 -- 172.21.15.49:0/4153070932 wait complete. 2024-01-31T05:05:11.707 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-31T05:05:11.707 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-31T05:05:11.806 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-31T05:05:11.902 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-31T05:05:11.902 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:05:11.903 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T05:05:11.911 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:05:11.912 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T05:05:11.963 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:12.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.149+0000 7f46d8000640 1 Processor -- start 2024-01-31T05:05:12.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.149+0000 7f46d8000640 1 -- start start 2024-01-31T05:05:12.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.149+0000 7f46d8000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46d015e7e0 0x7f46d00b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:12.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.149+0000 7f46d8000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46d00cf670 0x7f46d00cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:12.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.149+0000 7f46d8000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d00c67f0 con 0x7f46d00c63d0 2024-01-31T05:05:12.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.149+0000 7f46d8000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d00d1d40 con 0x7f46d015e7e0 2024-01-31T05:05:12.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.149+0000 7f46d8000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d00c6ab0 con 0x7f46d00cf670 2024-01-31T05:05:12.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.149+0000 7f46d5600640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46d015e7e0 0x7f46d00b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:12.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.149+0000 7f46d5600640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46d015e7e0 0x7f46d00b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52690/0 (socket says 172.21.15.49:52690) 2024-01-31T05:05:12.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.149+0000 7f46d5600640 1 -- 172.21.15.49:0/2053029290 learned_addr learned my addr 172.21.15.49:0/2053029290 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:12.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.149+0000 7f46d6000640 1 --2- 172.21.15.49:0/2053029290 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46d00cf670 0x7f46d00cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:12.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.149+0000 7f46d5600640 1 -- 172.21.15.49:0/2053029290 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46d00cf670 msgr2=0x7f46d00cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:12.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.149+0000 7f46d5600640 1 --2- 172.21.15.49:0/2053029290 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46d00cf670 0x7f46d00cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.149+0000 7f46d5600640 1 -- 172.21.15.49:0/2053029290 >> v1:172.21.15.195:6789/0 conn(0x7f46d00c63d0 legacy=0x7f46d00cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:12.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.149+0000 7f46d5600640 1 -- 172.21.15.49:0/2053029290 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d00c6d90 con 0x7f46d015e7e0 2024-01-31T05:05:12.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.153+0000 7f46d5600640 1 --2- 172.21.15.49:0/2053029290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46d015e7e0 0x7f46d00b2370 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009870 tx=0x7f46c001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740875ef5ecd64ff server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:12.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.153+0000 7f46cfe00640 1 -- 172.21.15.49:0/2053029290 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c00a8a30 con 0x7f46d015e7e0 2024-01-31T05:05:12.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.153+0000 7f46cfe00640 1 -- 172.21.15.49:0/2053029290 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c00a8b90 con 0x7f46d015e7e0 2024-01-31T05:05:12.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.153+0000 7f46cfe00640 1 -- 172.21.15.49:0/2053029290 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c00b0440 con 0x7f46d015e7e0 2024-01-31T05:05:12.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.153+0000 7f46d8000640 1 -- 172.21.15.49:0/2053029290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46d015e7e0 msgr2=0x7f46d00b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:12.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.153+0000 7f46d8000640 1 --2- 172.21.15.49:0/2053029290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46d015e7e0 0x7f46d00b2370 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009870 tx=0x7f46c001ed30 comp rx=0 tx=0).stop 2024-01-31T05:05:12.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.153+0000 7f46d8000640 1 -- 172.21.15.49:0/2053029290 shutdown_connections 2024-01-31T05:05:12.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.153+0000 7f46d8000640 1 --2- 172.21.15.49:0/2053029290 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46d00cf670 0x7f46d00cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.153+0000 7f46d8000640 1 --2- 172.21.15.49:0/2053029290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46d015e7e0 0x7f46d00b2370 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.153+0000 7f46d8000640 1 -- 172.21.15.49:0/2053029290 >> 172.21.15.49:0/2053029290 conn(0x7f46d00d0e60 msgr2=0x7f46d00d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:12.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.153+0000 7f46d8000640 1 -- 172.21.15.49:0/2053029290 shutdown_connections 2024-01-31T05:05:12.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.153+0000 7f46d8000640 1 -- 172.21.15.49:0/2053029290 wait complete. 2024-01-31T05:05:12.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d8000640 1 Processor -- start 2024-01-31T05:05:12.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d8000640 1 -- start start 2024-01-31T05:05:12.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d8000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46d00c63d0 0x7f46d0154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:12.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d8000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46d00cf670 0x7f46d015d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:12.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d8000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46d015e7e0 0x7f46d015d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:12.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d8000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d00b4510 con 0x7f46d015e7e0 2024-01-31T05:05:12.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d8000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d015c480 con 0x7f46d00cf670 2024-01-31T05:05:12.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d8000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d015c760 con 0x7f46d00c63d0 2024-01-31T05:05:12.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d6000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46d015e7e0 0x7f46d015d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:12.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d6000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46d015e7e0 0x7f46d015d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52694/0 (socket says 172.21.15.49:52694) 2024-01-31T05:05:12.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d6000640 1 -- 172.21.15.49:0/1744208727 learned_addr learned my addr 172.21.15.49:0/1744208727 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:12.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d5600640 1 --2- 172.21.15.49:0/1744208727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46d00c63d0 0x7f46d0154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:12.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d4c00640 1 --2- 172.21.15.49:0/1744208727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46d00cf670 0x7f46d015d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:12.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d6000640 1 -- 172.21.15.49:0/1744208727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46d00c63d0 msgr2=0x7f46d0154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:12.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d6000640 1 --2- 172.21.15.49:0/1744208727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46d00c63d0 0x7f46d0154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d6000640 1 -- 172.21.15.49:0/1744208727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46d00cf670 msgr2=0x7f46d015d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:12.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d6000640 1 --2- 172.21.15.49:0/1744208727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46d00cf670 0x7f46d015d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d6000640 1 -- 172.21.15.49:0/1744208727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c00094d0 con 0x7f46d015e7e0 2024-01-31T05:05:12.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d6000640 1 --2- 172.21.15.49:0/1744208727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46d015e7e0 0x7f46d015d8c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f46c8007de0 tx=0x7f46c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:12.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46cd600640 1 -- 172.21.15.49:0/1744208727 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c8014620 con 0x7f46d015e7e0 2024-01-31T05:05:12.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46cd600640 1 -- 172.21.15.49:0/1744208727 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c800ee90 con 0x7f46d015e7e0 2024-01-31T05:05:12.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46cd600640 1 -- 172.21.15.49:0/1744208727 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c80149e0 con 0x7f46d015e7e0 2024-01-31T05:05:12.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d8000640 1 -- 172.21.15.49:0/1744208727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d015ca40 con 0x7f46d015e7e0 2024-01-31T05:05:12.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.157+0000 7f46d8000640 1 -- 172.21.15.49:0/1744208727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d01548d0 con 0x7f46d015e7e0 2024-01-31T05:05:12.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.161+0000 7f46d8000640 1 -- 172.21.15.49:0/1744208727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d0074860 con 0x7f46d015e7e0 2024-01-31T05:05:12.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.161+0000 7f46cd600640 1 -- 172.21.15.49:0/1744208727 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f46c8014b40 con 0x7f46d015e7e0 2024-01-31T05:05:12.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.161+0000 7f46cd600640 1 --2- 172.21.15.49:0/1744208727 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f46a8066500 0x7f46a80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:12.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.161+0000 7f46cd600640 1 -- 172.21.15.49:0/1744208727 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f46c8084ca0 con 0x7f46d015e7e0 2024-01-31T05:05:12.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.161+0000 7f46d5600640 1 --2- 172.21.15.49:0/1744208727 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f46a8066500 0x7f46a80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:12.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.161+0000 7f46d5600640 1 --2- 172.21.15.49:0/1744208727 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f46a8066500 0x7f46a80689c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f46c00b2000 tx=0x7f46c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:12.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.165+0000 7f46cd600640 1 -- 172.21.15.49:0/1744208727 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f46c8051b00 con 0x7f46d015e7e0 2024-01-31T05:05:12.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.329+0000 7f46d8000640 1 -- 172.21.15.49:0/1744208727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46d00c42f0 con 0x7f46d015e7e0 2024-01-31T05:05:12.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.329+0000 7f46cd600640 1 -- 172.21.15.49:0/1744208727 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7f46c8055120 con 0x7f46d015e7e0 2024-01-31T05:05:12.330 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:12.330 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:58.277568+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:12.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.333+0000 7f46d8000640 1 -- 172.21.15.49:0/1744208727 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f46a8066500 msgr2=0x7f46a80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:12.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.333+0000 7f46d8000640 1 --2- 172.21.15.49:0/1744208727 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f46a8066500 0x7f46a80689c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f46c00b2000 tx=0x7f46c0009040 comp rx=0 tx=0).stop 2024-01-31T05:05:12.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.333+0000 7f46d8000640 1 -- 172.21.15.49:0/1744208727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46d015e7e0 msgr2=0x7f46d015d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:12.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.333+0000 7f46d8000640 1 --2- 172.21.15.49:0/1744208727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46d015e7e0 0x7f46d015d8c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f46c8007de0 tx=0x7f46c800e4b0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.333+0000 7f46d8000640 1 -- 172.21.15.49:0/1744208727 shutdown_connections 2024-01-31T05:05:12.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.333+0000 7f46d8000640 1 --2- 172.21.15.49:0/1744208727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46d015e7e0 0x7f46d015d8c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.333+0000 7f46d8000640 1 --2- 172.21.15.49:0/1744208727 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f46a8066500 0x7f46a80689c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.333+0000 7f46d8000640 1 --2- 172.21.15.49:0/1744208727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46d00cf670 0x7f46d015d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.333+0000 7f46d8000640 1 --2- 172.21.15.49:0/1744208727 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46d00c63d0 0x7f46d0154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.333+0000 7f46d8000640 1 -- 172.21.15.49:0/1744208727 >> 172.21.15.49:0/1744208727 conn(0x7f46d00d0e60 msgr2=0x7f46d006e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:12.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.333+0000 7f46d8000640 1 -- 172.21.15.49:0/1744208727 shutdown_connections 2024-01-31T05:05:12.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.333+0000 7f46d8000640 1 -- 172.21.15.49:0/1744208727 wait complete. 2024-01-31T05:05:12.352 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:04:14.566345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:04:15.231265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-31T05:04:18.316756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-31T05:05:12.353 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:05:12.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.497+0000 7f8efd000640 1 Processor -- start 2024-01-31T05:05:12.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.497+0000 7f8efd000640 1 -- start start 2024-01-31T05:05:12.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.497+0000 7f8efd000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8ef815d510 0x7f8ef8072050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:12.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.497+0000 7f8efd000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8ef80b4b20 0x7f8ef806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:12.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.497+0000 7f8efd000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef8072590 con 0x7f8ef806d920 2024-01-31T05:05:12.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.497+0000 7f8efd000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef806f010 con 0x7f8ef80b4b20 2024-01-31T05:05:12.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.497+0000 7f8efd000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef8071570 con 0x7f8ef815d510 2024-01-31T05:05:12.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.497+0000 7f8ef5400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8ef80b4b20 0x7f8ef806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:12.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.497+0000 7f8ef5400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8ef80b4b20 0x7f8ef806d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52708/0 (socket says 172.21.15.49:52708) 2024-01-31T05:05:12.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.497+0000 7f8ef5400640 1 -- 172.21.15.49:0/4277701151 learned_addr learned my addr 172.21.15.49:0/4277701151 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:12.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.497+0000 7f8ef5e00640 1 --2- 172.21.15.49:0/4277701151 >> v2:172.21.15.195:3300/0 conn(0x7f8ef815d510 0x7f8ef8072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:12.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.497+0000 7f8ef5400640 1 -- 172.21.15.49:0/4277701151 >> v2:172.21.15.195:3300/0 conn(0x7f8ef815d510 msgr2=0x7f8ef8072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:12.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.497+0000 7f8ef5400640 1 --2- 172.21.15.49:0/4277701151 >> v2:172.21.15.195:3300/0 conn(0x7f8ef815d510 0x7f8ef8072050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.497+0000 7f8ef5400640 1 -- 172.21.15.49:0/4277701151 >> v1:172.21.15.195:6789/0 conn(0x7f8ef806d920 legacy=0x7f8ef806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:12.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.497+0000 7f8ef5400640 1 -- 172.21.15.49:0/4277701151 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef8071850 con 0x7f8ef80b4b20 2024-01-31T05:05:12.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.501+0000 7f8ef5400640 1 --2- 172.21.15.49:0/4277701151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ef80b4b20 0x7f8ef806d3e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80d0d90 tx=0x7f8ee001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def7dc81c97fb8c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:12.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.501+0000 7f8ef4a00640 1 -- 172.21.15.49:0/4277701151 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee00ab660 con 0x7f8ef80b4b20 2024-01-31T05:05:12.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.501+0000 7f8ef4a00640 1 -- 172.21.15.49:0/4277701151 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee00ab7c0 con 0x7f8ef80b4b20 2024-01-31T05:05:12.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.501+0000 7f8ef4a00640 1 -- 172.21.15.49:0/4277701151 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee00abb50 con 0x7f8ef80b4b20 2024-01-31T05:05:12.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.501+0000 7f8efd000640 1 -- 172.21.15.49:0/4277701151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ef80b4b20 msgr2=0x7f8ef806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:12.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.501+0000 7f8efd000640 1 --2- 172.21.15.49:0/4277701151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ef80b4b20 0x7f8ef806d3e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80d0d90 tx=0x7f8ee001c440 comp rx=0 tx=0).stop 2024-01-31T05:05:12.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.501+0000 7f8efd000640 1 -- 172.21.15.49:0/4277701151 shutdown_connections 2024-01-31T05:05:12.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.501+0000 7f8efd000640 1 --2- 172.21.15.49:0/4277701151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ef80b4b20 0x7f8ef806d3e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.501+0000 7f8efd000640 1 --2- 172.21.15.49:0/4277701151 >> v2:172.21.15.195:3300/0 conn(0x7f8ef815d510 0x7f8ef8072050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.501+0000 7f8efd000640 1 -- 172.21.15.49:0/4277701151 >> 172.21.15.49:0/4277701151 conn(0x7f8ef80b1ab0 msgr2=0x7f8ef80b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:12.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.501+0000 7f8efd000640 1 -- 172.21.15.49:0/4277701151 shutdown_connections 2024-01-31T05:05:12.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.501+0000 7f8efd000640 1 -- 172.21.15.49:0/4277701151 wait complete. 2024-01-31T05:05:12.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8efd000640 1 Processor -- start 2024-01-31T05:05:12.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8efd000640 1 -- start start 2024-01-31T05:05:12.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8efd000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ef806d920 0x7f8ef8150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:12.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8efd000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ef80b4b20 0x7f8ef8150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:12.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8efd000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ef815d510 0x7f8ef814ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:12.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8efd000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef814e0b0 con 0x7f8ef815d510 2024-01-31T05:05:12.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8efd000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef814e390 con 0x7f8ef80b4b20 2024-01-31T05:05:12.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8efd000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef814e670 con 0x7f8ef806d920 2024-01-31T05:05:12.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8ef6800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ef815d510 0x7f8ef814ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:12.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8ef6800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ef815d510 0x7f8ef814ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52710/0 (socket says 172.21.15.49:52710) 2024-01-31T05:05:12.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8ef6800640 1 -- 172.21.15.49:0/2456207926 learned_addr learned my addr 172.21.15.49:0/2456207926 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:12.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8ef5400640 1 --2- 172.21.15.49:0/2456207926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ef80b4b20 0x7f8ef8150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:12.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8ef5e00640 1 --2- 172.21.15.49:0/2456207926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ef806d920 0x7f8ef8150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:12.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8ef6800640 1 -- 172.21.15.49:0/2456207926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ef806d920 msgr2=0x7f8ef8150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:12.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8ef6800640 1 --2- 172.21.15.49:0/2456207926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ef806d920 0x7f8ef8150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8ef6800640 1 -- 172.21.15.49:0/2456207926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ef80b4b20 msgr2=0x7f8ef8150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:12.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8ef6800640 1 --2- 172.21.15.49:0/2456207926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ef80b4b20 0x7f8ef8150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8ef6800640 1 -- 172.21.15.49:0/2456207926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee00094d0 con 0x7f8ef815d510 2024-01-31T05:05:12.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8ef5400640 1 --2- 172.21.15.49:0/2456207926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ef80b4b20 0x7f8ef8150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:12.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8ef5e00640 1 --2- 172.21.15.49:0/2456207926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ef806d920 0x7f8ef8150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:12.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8ef6800640 1 --2- 172.21.15.49:0/2456207926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ef815d510 0x7f8ef814ce10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8ef000c730 tx=0x7f8ef000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:12.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8eee000640 1 -- 172.21.15.49:0/2456207926 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0003b80 con 0x7f8ef815d510 2024-01-31T05:05:12.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8eee000640 1 -- 172.21.15.49:0/2456207926 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef0003ce0 con 0x7f8ef815d510 2024-01-31T05:05:12.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8eee000640 1 -- 172.21.15.49:0/2456207926 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef000aa30 con 0x7f8ef815d510 2024-01-31T05:05:12.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8efd000640 1 -- 172.21.15.49:0/2456207926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef814e950 con 0x7f8ef815d510 2024-01-31T05:05:12.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.505+0000 7f8efd000640 1 -- 172.21.15.49:0/2456207926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef814ef10 con 0x7f8ef815d510 2024-01-31T05:05:12.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.509+0000 7f8efd000640 1 -- 172.21.15.49:0/2456207926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef806c770 con 0x7f8ef815d510 2024-01-31T05:05:12.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.509+0000 7f8eee000640 1 -- 172.21.15.49:0/2456207926 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f8ef000ab90 con 0x7f8ef815d510 2024-01-31T05:05:12.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.509+0000 7f8eee000640 1 --2- 172.21.15.49:0/2456207926 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8ed0066500 0x7f8ed00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:12.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.509+0000 7f8eee000640 1 -- 172.21.15.49:0/2456207926 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8ef0084100 con 0x7f8ef815d510 2024-01-31T05:05:12.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.509+0000 7f8ef5e00640 1 --2- 172.21.15.49:0/2456207926 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8ed0066500 0x7f8ed00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:12.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.513+0000 7f8ef5e00640 1 --2- 172.21.15.49:0/2456207926 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8ed0066500 0x7f8ed00689c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8ef815fef0 tx=0x7f8ee8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:12.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.513+0000 7f8eee000640 1 -- 172.21.15.49:0/2456207926 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f8ef0050f40 con 0x7f8ef815d510 2024-01-31T05:05:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.677+0000 7f8efd000640 1 -- 172.21.15.49:0/2456207926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8ef814f100 con 0x7f8ef815d510 2024-01-31T05:05:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.677+0000 7f8eee000640 1 -- 172.21.15.49:0/2456207926 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8ef0054560 con 0x7f8ef815d510 2024-01-31T05:05:12.676 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:05:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.677+0000 7f8efd000640 1 -- 172.21.15.49:0/2456207926 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8ed0066500 msgr2=0x7f8ed00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.677+0000 7f8efd000640 1 --2- 172.21.15.49:0/2456207926 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8ed0066500 0x7f8ed00689c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8ef815fef0 tx=0x7f8ee8008040 comp rx=0 tx=0).stop 2024-01-31T05:05:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.677+0000 7f8efd000640 1 -- 172.21.15.49:0/2456207926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ef815d510 msgr2=0x7f8ef814ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.677+0000 7f8efd000640 1 --2- 172.21.15.49:0/2456207926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ef815d510 0x7f8ef814ce10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8ef000c730 tx=0x7f8ef000cbf0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.677+0000 7f8efd000640 1 -- 172.21.15.49:0/2456207926 shutdown_connections 2024-01-31T05:05:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.677+0000 7f8efd000640 1 --2- 172.21.15.49:0/2456207926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ef815d510 0x7f8ef814ce10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.677+0000 7f8efd000640 1 --2- 172.21.15.49:0/2456207926 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8ed0066500 0x7f8ed00689c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.677+0000 7f8efd000640 1 --2- 172.21.15.49:0/2456207926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ef80b4b20 0x7f8ef8150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.677+0000 7f8efd000640 1 --2- 172.21.15.49:0/2456207926 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ef806d920 0x7f8ef8150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.677+0000 7f8efd000640 1 -- 172.21.15.49:0/2456207926 >> 172.21.15.49:0/2456207926 conn(0x7f8ef80b1ab0 msgr2=0x7f8ef815a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.677+0000 7f8efd000640 1 -- 172.21.15.49:0/2456207926 shutdown_connections 2024-01-31T05:05:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.677+0000 7f8efd000640 1 -- 172.21.15.49:0/2456207926 wait complete. 2024-01-31T05:05:12.699 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:05:12.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.841+0000 7f1193a00640 1 Processor -- start 2024-01-31T05:05:12.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.841+0000 7f1193a00640 1 -- start start 2024-01-31T05:05:12.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.845+0000 7f1193a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f118c0cde80 0x7f118c15cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:12.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.845+0000 7f1193a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f118c0cf0f0 0x7f118c15d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:12.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.845+0000 7f1193a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c0cf660 con 0x7f118c0cd0c0 2024-01-31T05:05:12.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.845+0000 7f1193a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c0d02e0 con 0x7f118c0cde80 2024-01-31T05:05:12.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.845+0000 7f1193a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0cf940 con 0x7f118c0cf0f0 2024-01-31T05:05:12.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.845+0000 7f1191a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f118c0cf0f0 0x7f118c15d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:12.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.845+0000 7f118be00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f118c0cde80 0x7f118c15cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:12.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.845+0000 7f1191000640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f118c0cd0c0 0x7f118c0cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:48270/0 (socket says 172.21.15.49:48270) 2024-01-31T05:05:12.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.845+0000 7f118be00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f118c0cde80 0x7f118c15cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:60214/0 (socket says 172.21.15.49:60214) 2024-01-31T05:05:12.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.845+0000 7f1191000640 1 -- 172.21.15.49:0/3823019715 learned_addr learned my addr 172.21.15.49:0/3823019715 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:12.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.845+0000 7f118be00640 1 -- 172.21.15.49:0/3823019715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f118c0cf0f0 msgr2=0x7f118c15d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:12.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.845+0000 7f118be00640 1 --2- 172.21.15.49:0/3823019715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f118c0cf0f0 0x7f118c15d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.845+0000 7f118be00640 1 -- 172.21.15.49:0/3823019715 >> v1:172.21.15.195:6789/0 conn(0x7f118c0cd0c0 legacy=0x7f118c0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:12.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.845+0000 7f118be00640 1 -- 172.21.15.49:0/3823019715 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c0cfc20 con 0x7f118c0cde80 2024-01-31T05:05:12.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.845+0000 7f1191a00640 1 --2- 172.21.15.49:0/3823019715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f118c0cf0f0 0x7f118c15d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:12.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.849+0000 7f118be00640 1 --2- 172.21.15.49:0/3823019715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f118c0cde80 0x7f118c15cb60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f11740097c0 tx=0x7f117401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acabb396c68aab4f server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:12.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.849+0000 7f118b400640 1 -- 172.21.15.49:0/3823019715 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11740ad660 con 0x7f118c0cde80 2024-01-31T05:05:12.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.849+0000 7f118b400640 1 -- 172.21.15.49:0/3823019715 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11740ad7c0 con 0x7f118c0cde80 2024-01-31T05:05:12.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.849+0000 7f118b400640 1 -- 172.21.15.49:0/3823019715 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11740adb50 con 0x7f118c0cde80 2024-01-31T05:05:12.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.849+0000 7f1193a00640 1 -- 172.21.15.49:0/3823019715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f118c0cde80 msgr2=0x7f118c15cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:12.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.849+0000 7f1193a00640 1 --2- 172.21.15.49:0/3823019715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f118c0cde80 0x7f118c15cb60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f11740097c0 tx=0x7f117401c3c0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.849+0000 7f1193a00640 1 -- 172.21.15.49:0/3823019715 shutdown_connections 2024-01-31T05:05:12.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.849+0000 7f1193a00640 1 --2- 172.21.15.49:0/3823019715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f118c0cf0f0 0x7f118c15d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.849+0000 7f1193a00640 1 --2- 172.21.15.49:0/3823019715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f118c0cde80 0x7f118c15cb60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.849+0000 7f1193a00640 1 -- 172.21.15.49:0/3823019715 >> 172.21.15.49:0/3823019715 conn(0x7f118c0d0ef0 msgr2=0x7f118c0d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:12.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.849+0000 7f1193a00640 1 -- 172.21.15.49:0/3823019715 shutdown_connections 2024-01-31T05:05:12.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.849+0000 7f1193a00640 1 -- 172.21.15.49:0/3823019715 wait complete. 2024-01-31T05:05:12.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.849+0000 7f1193a00640 1 Processor -- start 2024-01-31T05:05:12.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.849+0000 7f1193a00640 1 -- start start 2024-01-31T05:05:12.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1193a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f118c0cd0c0 0x7f118c159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:12.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1193a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f118c0cde80 0x7f118c154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:12.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1193a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f118c0cf0f0 0x7f118c0b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:12.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1193a00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0c5f20 con 0x7f118c0cd0c0 2024-01-31T05:05:12.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1193a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0c61c0 con 0x7f118c0cf0f0 2024-01-31T05:05:12.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1193a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0c64a0 con 0x7f118c0cde80 2024-01-31T05:05:12.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1191000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f118c0cd0c0 0x7f118c159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:12.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1191000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f118c0cd0c0 0x7f118c159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52712/0 (socket says 172.21.15.49:52712) 2024-01-31T05:05:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1191000640 1 -- 172.21.15.49:0/2670875110 learned_addr learned my addr 172.21.15.49:0/2670875110 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1191a00640 1 --2- 172.21.15.49:0/2670875110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f118c0cf0f0 0x7f118c0b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f118be00640 1 --2- 172.21.15.49:0/2670875110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f118c0cde80 0x7f118c154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1191000640 1 -- 172.21.15.49:0/2670875110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f118c0cde80 msgr2=0x7f118c154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1191000640 1 --2- 172.21.15.49:0/2670875110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f118c0cde80 0x7f118c154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1191000640 1 -- 172.21.15.49:0/2670875110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f118c0cf0f0 msgr2=0x7f118c0b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1191000640 1 --2- 172.21.15.49:0/2670875110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f118c0cf0f0 0x7f118c0b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1191000640 1 -- 172.21.15.49:0/2670875110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1184009a70 con 0x7f118c0cd0c0 2024-01-31T05:05:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1191000640 1 --2- 172.21.15.49:0/2670875110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f118c0cd0c0 0x7f118c159dc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f117c00c420 tx=0x7f117c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1188c00640 1 -- 172.21.15.49:0/2670875110 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c005cf0 con 0x7f118c0cd0c0 2024-01-31T05:05:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1188c00640 1 -- 172.21.15.49:0/2670875110 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117c005e50 con 0x7f118c0cd0c0 2024-01-31T05:05:12.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1193a00640 1 -- 172.21.15.49:0/2670875110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1174009420 con 0x7f118c0cd0c0 2024-01-31T05:05:12.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1188c00640 1 -- 172.21.15.49:0/2670875110 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c0072f0 con 0x7f118c0cd0c0 2024-01-31T05:05:12.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1193a00640 1 -- 172.21.15.49:0/2670875110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118c0c6a60 con 0x7f118c0cd0c0 2024-01-31T05:05:12.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1193a00640 1 -- 172.21.15.49:0/2670875110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118c0ceb30 con 0x7f118c0cd0c0 2024-01-31T05:05:12.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.853+0000 7f1188c00640 1 -- 172.21.15.49:0/2670875110 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f117c007450 con 0x7f118c0cd0c0 2024-01-31T05:05:12.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.857+0000 7f1188c00640 1 --2- 172.21.15.49:0/2670875110 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1164066530 0x7f11640689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:12.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.857+0000 7f1188c00640 1 -- 172.21.15.49:0/2670875110 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f117c0836b0 con 0x7f118c0cd0c0 2024-01-31T05:05:12.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.857+0000 7f118be00640 1 --2- 172.21.15.49:0/2670875110 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1164066530 0x7f11640689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:12.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.857+0000 7f118be00640 1 --2- 172.21.15.49:0/2670875110 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1164066530 0x7f11640689f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f11740af000 tx=0x7f1174008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:12.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:12.861+0000 7f1188c00640 1 -- 172.21.15.49:0/2670875110 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f117c0506b0 con 0x7f118c0cd0c0 2024-01-31T05:05:13.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.017+0000 7f1193a00640 1 -- 172.21.15.49:0/2670875110 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f118c074860 con 0x7f118c0cd0c0 2024-01-31T05:05:13.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.017+0000 7f1188c00640 1 -- 172.21.15.49:0/2670875110 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f117c053cd0 con 0x7f118c0cd0c0 2024-01-31T05:05:13.018 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:13.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.021+0000 7f1193a00640 1 -- 172.21.15.49:0/2670875110 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1164066530 msgr2=0x7f11640689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.021+0000 7f1193a00640 1 --2- 172.21.15.49:0/2670875110 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1164066530 0x7f11640689f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f11740af000 tx=0x7f1174008040 comp rx=0 tx=0).stop 2024-01-31T05:05:13.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.021+0000 7f1193a00640 1 -- 172.21.15.49:0/2670875110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f118c0cd0c0 msgr2=0x7f118c159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.021+0000 7f1193a00640 1 --2- 172.21.15.49:0/2670875110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f118c0cd0c0 0x7f118c159dc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f117c00c420 tx=0x7f117c00c820 comp rx=0 tx=0).stop 2024-01-31T05:05:13.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.021+0000 7f1193a00640 1 -- 172.21.15.49:0/2670875110 shutdown_connections 2024-01-31T05:05:13.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.021+0000 7f1193a00640 1 --2- 172.21.15.49:0/2670875110 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1164066530 0x7f11640689f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.021+0000 7f1193a00640 1 --2- 172.21.15.49:0/2670875110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f118c0cf0f0 0x7f118c0b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.021+0000 7f1193a00640 1 --2- 172.21.15.49:0/2670875110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f118c0cde80 0x7f118c154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.021+0000 7f1193a00640 1 --2- 172.21.15.49:0/2670875110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f118c0cd0c0 0x7f118c159dc0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.021+0000 7f1193a00640 1 -- 172.21.15.49:0/2670875110 >> 172.21.15.49:0/2670875110 conn(0x7f118c0d0ef0 msgr2=0x7f118c0af480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:13.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.021+0000 7f1193a00640 1 -- 172.21.15.49:0/2670875110 shutdown_connections 2024-01-31T05:05:13.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.021+0000 7f1193a00640 1 -- 172.21.15.49:0/2670875110 wait complete. 2024-01-31T05:05:13.041 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:05:13.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.185+0000 7fb121400640 1 Processor -- start 2024-01-31T05:05:13.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.185+0000 7fb121400640 1 -- start start 2024-01-31T05:05:13.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.185+0000 7fb121400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb11c0cdf10 0x7fb11c070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.185+0000 7fb121400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb11c0ce610 0x7fb11c071310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.185+0000 7fb121400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11c15b4f0 con 0x7fb11c15b110 2024-01-31T05:05:13.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.185+0000 7fb121400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11c0ce460 con 0x7fb11c0ce610 2024-01-31T05:05:13.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.185+0000 7fb121400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c071850 con 0x7fb11c0cdf10 2024-01-31T05:05:13.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.185+0000 7fb119e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb11c0cdf10 0x7fb11c070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.185+0000 7fb11a800640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fb11c15b110 0x7fb11c06c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:48286/0 (socket says 172.21.15.49:48286) 2024-01-31T05:05:13.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.185+0000 7fb11b200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb11c0ce610 0x7fb11c071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.185+0000 7fb11a800640 1 -- 172.21.15.49:0/3944836888 learned_addr learned my addr 172.21.15.49:0/3944836888 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:13.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.189+0000 7fb119400640 1 -- 172.21.15.49:0/3944836888 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514573573 0 0) 0x7fb10c001120 con 0x7fb11c15b110 2024-01-31T05:05:13.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.189+0000 7fb119400640 1 -- 172.21.15.49:0/3944836888 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0fc003530 con 0x7fb11c15b110 2024-01-31T05:05:13.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.189+0000 7fb119e00640 1 -- 172.21.15.49:0/3944836888 >> v2:172.21.15.195:3300/0 conn(0x7fb11c0ce610 msgr2=0x7fb11c071310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:13.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.189+0000 7fb119e00640 1 --2- 172.21.15.49:0/3944836888 >> v2:172.21.15.195:3300/0 conn(0x7fb11c0ce610 0x7fb11c071310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.189+0000 7fb119e00640 1 -- 172.21.15.49:0/3944836888 >> v1:172.21.15.195:6789/0 conn(0x7fb11c15b110 legacy=0x7fb11c06c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.189+0000 7fb119e00640 1 -- 172.21.15.49:0/3944836888 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c0abf20 con 0x7fb11c0cdf10 2024-01-31T05:05:13.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.189+0000 7fb11b200640 1 --2- 172.21.15.49:0/3944836888 >> v2:172.21.15.195:3300/0 conn(0x7fb11c0ce610 0x7fb11c071310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:13.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.189+0000 7fb119e00640 1 --2- 172.21.15.49:0/3944836888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb11c0cdf10 0x7fb11c070dd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb1040097c0 tx=0x7fb10401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=490e372f645de94 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:13.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.189+0000 7fb119400640 1 -- 172.21.15.49:0/3944836888 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1040ab670 con 0x7fb11c0cdf10 2024-01-31T05:05:13.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.189+0000 7fb119400640 1 -- 172.21.15.49:0/3944836888 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1040ab7d0 con 0x7fb11c0cdf10 2024-01-31T05:05:13.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.189+0000 7fb119400640 1 -- 172.21.15.49:0/3944836888 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1040abb60 con 0x7fb11c0cdf10 2024-01-31T05:05:13.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb121400640 1 -- 172.21.15.49:0/3944836888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb11c0cdf10 msgr2=0x7fb11c070dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb121400640 1 --2- 172.21.15.49:0/3944836888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb11c0cdf10 0x7fb11c070dd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb1040097c0 tx=0x7fb10401c450 comp rx=0 tx=0).stop 2024-01-31T05:05:13.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb121400640 1 -- 172.21.15.49:0/3944836888 shutdown_connections 2024-01-31T05:05:13.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb121400640 1 --2- 172.21.15.49:0/3944836888 >> v2:172.21.15.195:3300/0 conn(0x7fb11c0ce610 0x7fb11c071310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb121400640 1 --2- 172.21.15.49:0/3944836888 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb11c0cdf10 0x7fb11c070dd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb121400640 1 -- 172.21.15.49:0/3944836888 >> 172.21.15.49:0/3944836888 conn(0x7fb11c0b09a0 msgr2=0x7fb11c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:13.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb121400640 1 -- 172.21.15.49:0/3944836888 shutdown_connections 2024-01-31T05:05:13.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb121400640 1 -- 172.21.15.49:0/3944836888 wait complete. 2024-01-31T05:05:13.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb121400640 1 Processor -- start 2024-01-31T05:05:13.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb121400640 1 -- start start 2024-01-31T05:05:13.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb121400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb11c0cdf10 0x7fb11c09c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb121400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb11c0ce610 0x7fb11c148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb121400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb11c15b110 0x7fb11c1f8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb121400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c149000 con 0x7fb11c0cdf10 2024-01-31T05:05:13.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb121400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c1f97b0 con 0x7fb11c0ce610 2024-01-31T05:05:13.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb121400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c1f9a90 con 0x7fb11c15b110 2024-01-31T05:05:13.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb11a800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb11c0cdf10 0x7fb11c09c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb11a800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb11c0cdf10 0x7fb11c09c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52720/0 (socket says 172.21.15.49:52720) 2024-01-31T05:05:13.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb11a800640 1 -- 172.21.15.49:0/1005391625 learned_addr learned my addr 172.21.15.49:0/1005391625 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:13.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb119e00640 1 --2- 172.21.15.49:0/1005391625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb11c0ce610 0x7fb11c148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.193+0000 7fb11b200640 1 --2- 172.21.15.49:0/1005391625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb11c15b110 0x7fb11c1f8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.197+0000 7fb11a800640 1 -- 172.21.15.49:0/1005391625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb11c15b110 msgr2=0x7fb11c1f8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.197+0000 7fb11a800640 1 --2- 172.21.15.49:0/1005391625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb11c15b110 0x7fb11c1f8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.197+0000 7fb11a800640 1 -- 172.21.15.49:0/1005391625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb11c0ce610 msgr2=0x7fb11c148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.197+0000 7fb11a800640 1 --2- 172.21.15.49:0/1005391625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb11c0ce610 0x7fb11c148ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.197+0000 7fb11a800640 1 -- 172.21.15.49:0/1005391625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb114009a70 con 0x7fb11c0cdf10 2024-01-31T05:05:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.197+0000 7fb11a800640 1 --2- 172.21.15.49:0/1005391625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb11c0cdf10 0x7fb11c09c4f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00c400 tx=0x7fb10c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.197+0000 7fb112a00640 1 -- 172.21.15.49:0/1005391625 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c005cf0 con 0x7fb11c0cdf10 2024-01-31T05:05:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.197+0000 7fb112a00640 1 -- 172.21.15.49:0/1005391625 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c005e70 con 0x7fb11c0cdf10 2024-01-31T05:05:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.197+0000 7fb112a00640 1 -- 172.21.15.49:0/1005391625 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c0072f0 con 0x7fb11c0cdf10 2024-01-31T05:05:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.197+0000 7fb121400640 1 -- 172.21.15.49:0/1005391625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb104009420 con 0x7fb11c0cdf10 2024-01-31T05:05:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.197+0000 7fb121400640 1 -- 172.21.15.49:0/1005391625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb11c152d00 con 0x7fb11c0cdf10 2024-01-31T05:05:13.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.197+0000 7fb121400640 1 -- 172.21.15.49:0/1005391625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb11c074860 con 0x7fb11c0cdf10 2024-01-31T05:05:13.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.197+0000 7fb112a00640 1 -- 172.21.15.49:0/1005391625 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb10c007450 con 0x7fb11c0cdf10 2024-01-31T05:05:13.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.201+0000 7fb112a00640 1 --2- 172.21.15.49:0/1005391625 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb0f4066500 0x7fb0f40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.201+0000 7fb112a00640 1 -- 172.21.15.49:0/1005391625 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb10c0835f0 con 0x7fb11c0cdf10 2024-01-31T05:05:13.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.201+0000 7fb119e00640 1 --2- 172.21.15.49:0/1005391625 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb0f4066500 0x7fb0f40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.201+0000 7fb119e00640 1 --2- 172.21.15.49:0/1005391625 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb0f4066500 0x7fb0f40689c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb1040097c0 tx=0x7fb1040a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:13.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.205+0000 7fb112a00640 1 -- 172.21.15.49:0/1005391625 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fb10c053f70 con 0x7fb11c0cdf10 2024-01-31T05:05:13.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.365+0000 7fb121400640 1 -- 172.21.15.49:0/1005391625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb11c15b4f0 con 0x7fb11c0cdf10 2024-01-31T05:05:13.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.365+0000 7fb112a00640 1 -- 172.21.15.49:0/1005391625 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb11c15b4f0 con 0x7fb11c0cdf10 2024-01-31T05:05:13.364 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-31T05:05:13.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.365+0000 7fb121400640 1 -- 172.21.15.49:0/1005391625 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb0f4066500 msgr2=0x7fb0f40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.365+0000 7fb121400640 1 --2- 172.21.15.49:0/1005391625 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb0f4066500 0x7fb0f40689c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb1040097c0 tx=0x7fb1040a7000 comp rx=0 tx=0).stop 2024-01-31T05:05:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.365+0000 7fb121400640 1 -- 172.21.15.49:0/1005391625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb11c0cdf10 msgr2=0x7fb11c09c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.365+0000 7fb121400640 1 --2- 172.21.15.49:0/1005391625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb11c0cdf10 0x7fb11c09c4f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00c400 tx=0x7fb10c00c800 comp rx=0 tx=0).stop 2024-01-31T05:05:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.365+0000 7fb121400640 1 -- 172.21.15.49:0/1005391625 shutdown_connections 2024-01-31T05:05:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.365+0000 7fb121400640 1 --2- 172.21.15.49:0/1005391625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb11c15b110 0x7fb11c1f8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.365+0000 7fb121400640 1 --2- 172.21.15.49:0/1005391625 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb0f4066500 0x7fb0f40689c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.365+0000 7fb121400640 1 --2- 172.21.15.49:0/1005391625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb11c0ce610 0x7fb11c148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.365+0000 7fb121400640 1 --2- 172.21.15.49:0/1005391625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb11c0cdf10 0x7fb11c09c4f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.365+0000 7fb121400640 1 -- 172.21.15.49:0/1005391625 >> 172.21.15.49:0/1005391625 conn(0x7fb11c0b09a0 msgr2=0x7fb11c0703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.365+0000 7fb121400640 1 -- 172.21.15.49:0/1005391625 shutdown_connections 2024-01-31T05:05:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.365+0000 7fb121400640 1 -- 172.21.15.49:0/1005391625 wait complete. 2024-01-31T05:05:13.387 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-31T05:05:13.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.529+0000 7f64aa800640 1 Processor -- start 2024-01-31T05:05:13.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.529+0000 7f64aa800640 1 -- start start 2024-01-31T05:05:13.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.533+0000 7f64aa800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f64a4070660 0x7f64a4070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.533+0000 7f64aa800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64a40ac050 0x7f64a40ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.533+0000 7f64aa800640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a4071000 con 0x7f64a4159790 2024-01-31T05:05:13.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.533+0000 7f64aa800640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a4159b70 con 0x7f64a4070660 2024-01-31T05:05:13.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.533+0000 7f64aa800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a40b2750 con 0x7f64a40ac050 2024-01-31T05:05:13.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.533+0000 7f64a2a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f64a4070660 0x7f64a4070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.533+0000 7f64a3400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f64a4159790 0x7f64a40b37c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59172/0 (socket says 172.21.15.49:59172) 2024-01-31T05:05:13.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.533+0000 7f64a3400640 1 -- 172.21.15.49:0/3571352546 learned_addr learned my addr 172.21.15.49:0/3571352546 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:13.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.533+0000 7f64a3e00640 1 --2- 172.21.15.49:0/3571352546 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64a40ac050 0x7f64a40ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.533+0000 7f64a2a00640 1 -- 172.21.15.49:0/3571352546 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64a40ac050 msgr2=0x7f64a40ac4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:13.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.533+0000 7f64a2a00640 1 --2- 172.21.15.49:0/3571352546 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64a40ac050 0x7f64a40ac4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.533+0000 7f64a2a00640 1 -- 172.21.15.49:0/3571352546 >> v1:172.21.15.49:6789/0 conn(0x7f64a4159790 legacy=0x7f64a40b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.533+0000 7f64a2a00640 1 -- 172.21.15.49:0/3571352546 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a40b2a30 con 0x7f64a4070660 2024-01-31T05:05:13.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.533+0000 7f64a3e00640 1 --2- 172.21.15.49:0/3571352546 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64a40ac050 0x7f64a40ac4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.537+0000 7f64a2a00640 1 --2- 172.21.15.49:0/3571352546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64a4070660 0x7f64a4070ac0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f648c0097c0 tx=0x7f648c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909d1a5a31e80be5 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.537+0000 7f64a2000640 1 -- 172.21.15.49:0/3571352546 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c0ab600 con 0x7f64a4070660 2024-01-31T05:05:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.537+0000 7f64a2000640 1 -- 172.21.15.49:0/3571352546 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c0a7050 con 0x7f64a4070660 2024-01-31T05:05:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.537+0000 7f64a2000640 1 -- 172.21.15.49:0/3571352546 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c0ab980 con 0x7f64a4070660 2024-01-31T05:05:13.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.537+0000 7f64aa800640 1 -- 172.21.15.49:0/3571352546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64a4070660 msgr2=0x7f64a4070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.537+0000 7f64aa800640 1 --2- 172.21.15.49:0/3571352546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64a4070660 0x7f64a4070ac0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f648c0097c0 tx=0x7f648c01c450 comp rx=0 tx=0).stop 2024-01-31T05:05:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.537+0000 7f64aa800640 1 -- 172.21.15.49:0/3571352546 shutdown_connections 2024-01-31T05:05:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.537+0000 7f64aa800640 1 --2- 172.21.15.49:0/3571352546 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64a40ac050 0x7f64a40ac4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.537+0000 7f64aa800640 1 --2- 172.21.15.49:0/3571352546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64a4070660 0x7f64a4070ac0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.537+0000 7f64aa800640 1 -- 172.21.15.49:0/3571352546 >> 172.21.15.49:0/3571352546 conn(0x7f64a40b09a0 msgr2=0x7f64a40b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.537+0000 7f64aa800640 1 -- 172.21.15.49:0/3571352546 shutdown_connections 2024-01-31T05:05:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.537+0000 7f64aa800640 1 -- 172.21.15.49:0/3571352546 wait complete. 2024-01-31T05:05:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.537+0000 7f64aa800640 1 Processor -- start 2024-01-31T05:05:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.537+0000 7f64aa800640 1 -- start start 2024-01-31T05:05:13.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64aa800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64a4070660 0x7f64a414fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64aa800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64a40ac050 0x7f64a40cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64aa800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64a4159790 0x7f64a415a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64aa800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a4150070 con 0x7f64a40ac050 2024-01-31T05:05:13.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64aa800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a40ccb50 con 0x7f64a4070660 2024-01-31T05:05:13.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64aa800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a40cce30 con 0x7f64a4159790 2024-01-31T05:05:13.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64a2a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64a40ac050 0x7f64a40cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64a2a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64a40ac050 0x7f64a40cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52744/0 (socket says 172.21.15.49:52744) 2024-01-31T05:05:13.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64a2a00640 1 -- 172.21.15.49:0/1939489066 learned_addr learned my addr 172.21.15.49:0/1939489066 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:13.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64a3400640 1 --2- 172.21.15.49:0/1939489066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64a4070660 0x7f64a414fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64a3e00640 1 --2- 172.21.15.49:0/1939489066 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64a4159790 0x7f64a415a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64a2a00640 1 -- 172.21.15.49:0/1939489066 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64a4159790 msgr2=0x7f64a415a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64a2a00640 1 --2- 172.21.15.49:0/1939489066 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64a4159790 0x7f64a415a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64a2a00640 1 -- 172.21.15.49:0/1939489066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64a4070660 msgr2=0x7f64a414fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64a2a00640 1 --2- 172.21.15.49:0/1939489066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64a4070660 0x7f64a414fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64a2a00640 1 -- 172.21.15.49:0/1939489066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c009420 con 0x7f64a40ac050 2024-01-31T05:05:13.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64a2a00640 1 --2- 172.21.15.49:0/1939489066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64a40ac050 0x7f64a40cdbf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f648c0ae040 tx=0x7f648c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:13.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f649b400640 1 -- 172.21.15.49:0/1939489066 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c0b4840 con 0x7f64a40ac050 2024-01-31T05:05:13.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f649b400640 1 -- 172.21.15.49:0/1939489066 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c0b49a0 con 0x7f64a40ac050 2024-01-31T05:05:13.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f649b400640 1 -- 172.21.15.49:0/1939489066 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c0b4d50 con 0x7f64a40ac050 2024-01-31T05:05:13.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64aa800640 1 -- 172.21.15.49:0/1939489066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a40cd110 con 0x7f64a40ac050 2024-01-31T05:05:13.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64aa800640 1 -- 172.21.15.49:0/1939489066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a40cd6d0 con 0x7f64a40ac050 2024-01-31T05:05:13.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f64aa800640 1 -- 172.21.15.49:0/1939489066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a40cd8c0 con 0x7f64a40ac050 2024-01-31T05:05:13.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.541+0000 7f649b400640 1 -- 172.21.15.49:0/1939489066 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f648c0b2040 con 0x7f64a40ac050 2024-01-31T05:05:13.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.545+0000 7f649b400640 1 --2- 172.21.15.49:0/1939489066 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f647c066500 0x7f647c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.545+0000 7f649b400640 1 -- 172.21.15.49:0/1939489066 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f648c11e5e0 con 0x7f64a40ac050 2024-01-31T05:05:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.545+0000 7f64a3400640 1 --2- 172.21.15.49:0/1939489066 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f647c066500 0x7f647c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.545+0000 7f64a3400640 1 --2- 172.21.15.49:0/1939489066 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f647c066500 0x7f647c0689c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6494000f70 tx=0x7f6494007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:13.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.549+0000 7f649b400640 1 -- 172.21.15.49:0/1939489066 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f648c0eb4d0 con 0x7f64a40ac050 2024-01-31T05:05:13.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.705+0000 7f64aa800640 1 -- 172.21.15.49:0/1939489066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f64a4074860 con 0x7f64a40ac050 2024-01-31T05:05:13.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.705+0000 7f649b400640 1 -- 172.21.15.49:0/1939489066 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f648c0eeaf0 con 0x7f64a40ac050 2024-01-31T05:05:13.706 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:13.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.709+0000 7f64aa800640 1 -- 172.21.15.49:0/1939489066 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f647c066500 msgr2=0x7f647c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.709+0000 7f64aa800640 1 --2- 172.21.15.49:0/1939489066 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f647c066500 0x7f647c0689c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6494000f70 tx=0x7f6494007e90 comp rx=0 tx=0).stop 2024-01-31T05:05:13.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.709+0000 7f64aa800640 1 -- 172.21.15.49:0/1939489066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64a40ac050 msgr2=0x7f64a40cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.709+0000 7f64aa800640 1 --2- 172.21.15.49:0/1939489066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64a40ac050 0x7f64a40cdbf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f648c0ae040 tx=0x7f648c0191f0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.709+0000 7f64aa800640 1 -- 172.21.15.49:0/1939489066 shutdown_connections 2024-01-31T05:05:13.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.709+0000 7f64aa800640 1 --2- 172.21.15.49:0/1939489066 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64a4159790 0x7f64a415a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.709+0000 7f64aa800640 1 --2- 172.21.15.49:0/1939489066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64a40ac050 0x7f64a40cdbf0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.709+0000 7f64aa800640 1 --2- 172.21.15.49:0/1939489066 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f647c066500 0x7f647c0689c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.709+0000 7f64aa800640 1 --2- 172.21.15.49:0/1939489066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64a4070660 0x7f64a414fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.709+0000 7f64aa800640 1 -- 172.21.15.49:0/1939489066 >> 172.21.15.49:0/1939489066 conn(0x7f64a40b09a0 msgr2=0x7f64a40b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:13.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.709+0000 7f64aa800640 1 -- 172.21.15.49:0/1939489066 shutdown_connections 2024-01-31T05:05:13.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.709+0000 7f64aa800640 1 -- 172.21.15.49:0/1939489066 wait complete. 2024-01-31T05:05:13.728 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-31T05:05:13.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.869+0000 7f6950000640 1 Processor -- start 2024-01-31T05:05:13.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.869+0000 7f6950000640 1 -- start start 2024-01-31T05:05:13.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.869+0000 7f6950000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6948159790 0x7f69480b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.869+0000 7f6950000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6948070d70 0x7f69480ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.873+0000 7f6950000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6948159b70 con 0x7f69480b3d00 2024-01-31T05:05:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.873+0000 7f6950000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69480b2750 con 0x7f6948159790 2024-01-31T05:05:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.873+0000 7f6950000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69480b2a30 con 0x7f6948070d70 2024-01-31T05:05:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.873+0000 7f694d600640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6948159790 0x7f69480b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.873+0000 7f694d600640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6948159790 0x7f69480b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52746/0 (socket says 172.21.15.49:52746) 2024-01-31T05:05:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.873+0000 7f694d600640 1 -- 172.21.15.49:0/2854681639 learned_addr learned my addr 172.21.15.49:0/2854681639 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.873+0000 7f694e000640 1 --2- 172.21.15.49:0/2854681639 >> v2:172.21.15.195:3300/0 conn(0x7f6948070d70 0x7f69480ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.873+0000 7f694d600640 1 -- 172.21.15.49:0/2854681639 >> v2:172.21.15.195:3300/0 conn(0x7f6948070d70 msgr2=0x7f69480ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.873+0000 7f694d600640 1 --2- 172.21.15.49:0/2854681639 >> v2:172.21.15.195:3300/0 conn(0x7f6948070d70 0x7f69480ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.873+0000 7f694d600640 1 -- 172.21.15.49:0/2854681639 >> v1:172.21.15.195:6789/0 conn(0x7f69480b3d00 legacy=0x7f6948070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.873+0000 7f694d600640 1 -- 172.21.15.49:0/2854681639 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69480b2d10 con 0x7f6948159790 2024-01-31T05:05:13.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.873+0000 7f694d600640 1 --2- 172.21.15.49:0/2854681639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6948159790 0x7f69480b37c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f69480719a0 tx=0x7f693801eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d23f82af48cb1e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:13.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.873+0000 7f6947e00640 1 -- 172.21.15.49:0/2854681639 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69380a7b60 con 0x7f6948159790 2024-01-31T05:05:13.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.873+0000 7f6947e00640 1 -- 172.21.15.49:0/2854681639 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69380a7cc0 con 0x7f6948159790 2024-01-31T05:05:13.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.873+0000 7f6947e00640 1 -- 172.21.15.49:0/2854681639 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69380af660 con 0x7f6948159790 2024-01-31T05:05:13.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.877+0000 7f6950000640 1 -- 172.21.15.49:0/2854681639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6948159790 msgr2=0x7f69480b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.877+0000 7f6950000640 1 --2- 172.21.15.49:0/2854681639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6948159790 0x7f69480b37c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f69480719a0 tx=0x7f693801eb10 comp rx=0 tx=0).stop 2024-01-31T05:05:13.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.877+0000 7f6950000640 1 -- 172.21.15.49:0/2854681639 shutdown_connections 2024-01-31T05:05:13.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.877+0000 7f6950000640 1 --2- 172.21.15.49:0/2854681639 >> v2:172.21.15.195:3300/0 conn(0x7f6948070d70 0x7f69480ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.877+0000 7f6950000640 1 --2- 172.21.15.49:0/2854681639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6948159790 0x7f69480b37c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.877+0000 7f6950000640 1 -- 172.21.15.49:0/2854681639 >> 172.21.15.49:0/2854681639 conn(0x7f69480b09a0 msgr2=0x7f69480b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:13.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.877+0000 7f6950000640 1 -- 172.21.15.49:0/2854681639 shutdown_connections 2024-01-31T05:05:13.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.877+0000 7f6950000640 1 -- 172.21.15.49:0/2854681639 wait complete. 2024-01-31T05:05:13.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.877+0000 7f6950000640 1 Processor -- start 2024-01-31T05:05:13.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.877+0000 7f6950000640 1 -- start start 2024-01-31T05:05:13.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.877+0000 7f6950000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6948070d70 0x7f694809b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.877+0000 7f6950000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69480b3d00 0x7f6948150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.877+0000 7f6950000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6948159790 0x7f694815afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.877+0000 7f6950000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694809bdd0 con 0x7f69480b3d00 2024-01-31T05:05:13.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.877+0000 7f6950000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694809c0b0 con 0x7f6948159790 2024-01-31T05:05:13.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.877+0000 7f6950000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694809c390 con 0x7f6948070d70 2024-01-31T05:05:13.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.877+0000 7f694cc00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69480b3d00 0x7f6948150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.877+0000 7f694cc00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69480b3d00 0x7f6948150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52748/0 (socket says 172.21.15.49:52748) 2024-01-31T05:05:13.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.881+0000 7f694cc00640 1 -- 172.21.15.49:0/144329365 learned_addr learned my addr 172.21.15.49:0/144329365 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:13.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.881+0000 7f694d600640 1 --2- 172.21.15.49:0/144329365 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6948070d70 0x7f694809b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.881+0000 7f694e000640 1 --2- 172.21.15.49:0/144329365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6948159790 0x7f694815afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.881+0000 7f694cc00640 1 -- 172.21.15.49:0/144329365 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6948070d70 msgr2=0x7f694809b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.881+0000 7f694cc00640 1 --2- 172.21.15.49:0/144329365 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6948070d70 0x7f694809b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.881+0000 7f694cc00640 1 -- 172.21.15.49:0/144329365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6948159790 msgr2=0x7f694815afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.881+0000 7f694cc00640 1 --2- 172.21.15.49:0/144329365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6948159790 0x7f694815afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.881+0000 7f694cc00640 1 -- 172.21.15.49:0/144329365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693800b770 con 0x7f69480b3d00 2024-01-31T05:05:13.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.881+0000 7f694e000640 1 --2- 172.21.15.49:0/144329365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6948159790 0x7f694815afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:13.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.881+0000 7f694cc00640 1 --2- 172.21.15.49:0/144329365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69480b3d00 0x7f6948150c70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f693000c420 tx=0x7f693000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:13.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.881+0000 7f6945600640 1 -- 172.21.15.49:0/144329365 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69300052d0 con 0x7f69480b3d00 2024-01-31T05:05:13.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.881+0000 7f6945600640 1 -- 172.21.15.49:0/144329365 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6930005430 con 0x7f69480b3d00 2024-01-31T05:05:13.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.881+0000 7f6945600640 1 -- 172.21.15.49:0/144329365 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6930007260 con 0x7f69480b3d00 2024-01-31T05:05:13.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.881+0000 7f6950000640 1 -- 172.21.15.49:0/144329365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f694809c670 con 0x7f69480b3d00 2024-01-31T05:05:13.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.881+0000 7f6950000640 1 -- 172.21.15.49:0/144329365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69481556b0 con 0x7f69480b3d00 2024-01-31T05:05:13.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.881+0000 7f6950000640 1 -- 172.21.15.49:0/144329365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6948074860 con 0x7f69480b3d00 2024-01-31T05:05:13.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.881+0000 7f6945600640 1 -- 172.21.15.49:0/144329365 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f69300073c0 con 0x7f69480b3d00 2024-01-31T05:05:13.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.881+0000 7f6945600640 1 --2- 172.21.15.49:0/144329365 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6920066500 0x7f69200689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.885+0000 7f6945600640 1 -- 172.21.15.49:0/144329365 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6930083660 con 0x7f69480b3d00 2024-01-31T05:05:13.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.885+0000 7f694d600640 1 --2- 172.21.15.49:0/144329365 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6920066500 0x7f69200689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.885+0000 7f694d600640 1 --2- 172.21.15.49:0/144329365 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6920066500 0x7f69200689c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f69380b1000 tx=0x7f69380a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:13.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:13.885+0000 7f6945600640 1 -- 172.21.15.49:0/144329365 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f6930050550 con 0x7f69480b3d00 2024-01-31T05:05:14.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.061+0000 7f6950000640 1 -- 172.21.15.49:0/144329365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f69481579b0 con 0x7f69480b3d00 2024-01-31T05:05:14.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.061+0000 7f6945600640 1 -- 172.21.15.49:0/144329365 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6930053b70 con 0x7f69480b3d00 2024-01-31T05:05:14.061 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2024-01-31T05:05:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.061+0000 7f6950000640 1 -- 172.21.15.49:0/144329365 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6920066500 msgr2=0x7f69200689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.061+0000 7f6950000640 1 --2- 172.21.15.49:0/144329365 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6920066500 0x7f69200689c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f69380b1000 tx=0x7f69380a9070 comp rx=0 tx=0).stop 2024-01-31T05:05:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.061+0000 7f6950000640 1 -- 172.21.15.49:0/144329365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69480b3d00 msgr2=0x7f6948150c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.061+0000 7f6950000640 1 --2- 172.21.15.49:0/144329365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69480b3d00 0x7f6948150c70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f693000c420 tx=0x7f693000c8e0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.061+0000 7f6950000640 1 -- 172.21.15.49:0/144329365 shutdown_connections 2024-01-31T05:05:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.061+0000 7f6950000640 1 --2- 172.21.15.49:0/144329365 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6920066500 0x7f69200689c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.061+0000 7f6950000640 1 --2- 172.21.15.49:0/144329365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6948159790 0x7f694815afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.061+0000 7f6950000640 1 --2- 172.21.15.49:0/144329365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69480b3d00 0x7f6948150c70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.061+0000 7f6950000640 1 --2- 172.21.15.49:0/144329365 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6948070d70 0x7f694809b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.061+0000 7f6950000640 1 -- 172.21.15.49:0/144329365 >> 172.21.15.49:0/144329365 conn(0x7f69480b09a0 msgr2=0x7f69480cde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.061+0000 7f6950000640 1 -- 172.21.15.49:0/144329365 shutdown_connections 2024-01-31T05:05:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.061+0000 7f6950000640 1 -- 172.21.15.49:0/144329365 wait complete. 2024-01-31T05:05:14.082 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:05:14.082 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T05:05:14.091 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:14.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.281+0000 7facca800640 1 Processor -- start 2024-01-31T05:05:14.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.281+0000 7facca800640 1 -- start start 2024-01-31T05:05:14.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.281+0000 7facca800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facc415e760 0x7facc40cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.281+0000 7facca800640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc406f460 con 0x7facc40d1970 2024-01-31T05:05:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.281+0000 7facca800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc406fad0 con 0x7facc40704d0 2024-01-31T05:05:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.281+0000 7facca800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc40c7da0 con 0x7facc415e760 2024-01-31T05:05:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.281+0000 7facc3e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7facc40d1970 0x7facc40af5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59184/0 (socket says 172.21.15.49:59184) 2024-01-31T05:05:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.281+0000 7facc3e00640 1 -- 172.21.15.49:0/939209320 learned_addr learned my addr 172.21.15.49:0/939209320 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.281+0000 7facc3400640 1 --2- 172.21.15.49:0/939209320 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facc415e760 0x7facc40cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.281+0000 7facc2000640 1 -- 172.21.15.49:0/939209320 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579885149 0 0) 0x7facc406f460 con 0x7facc40d1970 2024-01-31T05:05:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.281+0000 7facc2000640 1 -- 172.21.15.49:0/939209320 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faca4003530 con 0x7facc40d1970 2024-01-31T05:05:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.281+0000 7facc3400640 1 -- 172.21.15.49:0/939209320 >> v1:172.21.15.195:6789/0 conn(0x7facc40704d0 legacy=0x7facc406e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.281+0000 7facc2000640 1 -- 172.21.15.49:0/939209320 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094041784 0 0) 0x7facc406fad0 con 0x7facc40704d0 2024-01-31T05:05:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.281+0000 7facc3400640 1 -- 172.21.15.49:0/939209320 >> v1:172.21.15.49:6789/0 conn(0x7facc40d1970 legacy=0x7facc40af5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.281+0000 7facc3400640 1 -- 172.21.15.49:0/939209320 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc406fdb0 con 0x7facc415e760 2024-01-31T05:05:14.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.285+0000 7facc3400640 1 --2- 172.21.15.49:0/939209320 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facc415e760 0x7facc40cf6a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7facb40097f0 tx=0x7facb401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90820d97d28f15b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:14.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.285+0000 7facc2000640 1 -- 172.21.15.49:0/939209320 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb40ac600 con 0x7facc415e760 2024-01-31T05:05:14.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.285+0000 7facc2000640 1 -- 172.21.15.49:0/939209320 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb40a8050 con 0x7facc415e760 2024-01-31T05:05:14.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.285+0000 7facc2000640 1 -- 172.21.15.49:0/939209320 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb40ac980 con 0x7facc415e760 2024-01-31T05:05:14.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.285+0000 7facca800640 1 -- 172.21.15.49:0/939209320 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facc415e760 msgr2=0x7facc40cf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:14.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.285+0000 7facca800640 1 --2- 172.21.15.49:0/939209320 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facc415e760 0x7facc40cf6a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7facb40097f0 tx=0x7facb401c490 comp rx=0 tx=0).stop 2024-01-31T05:05:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.285+0000 7facca800640 1 -- 172.21.15.49:0/939209320 shutdown_connections 2024-01-31T05:05:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.285+0000 7facca800640 1 --2- 172.21.15.49:0/939209320 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facc415e760 0x7facc40cf6a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.285+0000 7facca800640 1 -- 172.21.15.49:0/939209320 >> 172.21.15.49:0/939209320 conn(0x7facc40d0e50 msgr2=0x7facc40d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.285+0000 7facca800640 1 -- 172.21.15.49:0/939209320 shutdown_connections 2024-01-31T05:05:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.285+0000 7facca800640 1 -- 172.21.15.49:0/939209320 wait complete. 2024-01-31T05:05:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facca800640 1 Processor -- start 2024-01-31T05:05:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facca800640 1 -- start start 2024-01-31T05:05:14.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facca800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7facc40704d0 0x7facc4155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:14.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facca800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facc40d1970 0x7facc4143bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facca800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc415e760 0x7facc4144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facca800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc40ccba0 con 0x7facc40704d0 2024-01-31T05:05:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facca800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc40cce80 con 0x7facc415e760 2024-01-31T05:05:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facca800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc40cd160 con 0x7facc40d1970 2024-01-31T05:05:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facc3400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7facc40704d0 0x7facc4155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facc3400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7facc40704d0 0x7facc4155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52756/0 (socket says 172.21.15.49:52756) 2024-01-31T05:05:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facc3400640 1 -- 172.21.15.49:0/673335200 learned_addr learned my addr 172.21.15.49:0/673335200 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facc2a00640 1 --2- 172.21.15.49:0/673335200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facc40d1970 0x7facc4143bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facc3e00640 1 --2- 172.21.15.49:0/673335200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc415e760 0x7facc4144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facc3400640 1 -- 172.21.15.49:0/673335200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facc40d1970 msgr2=0x7facc4143bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facc3400640 1 --2- 172.21.15.49:0/673335200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facc40d1970 0x7facc4143bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facc3400640 1 -- 172.21.15.49:0/673335200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc415e760 msgr2=0x7facc4144110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facc3400640 1 --2- 172.21.15.49:0/673335200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc415e760 0x7facc4144110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facc3400640 1 -- 172.21.15.49:0/673335200 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb4009420 con 0x7facc40704d0 2024-01-31T05:05:14.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facc3400640 1 --2- 172.21.15.49:0/673335200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7facc40704d0 0x7facc4155940 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7facb4009740 tx=0x7facb401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:14.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facbb400640 1 -- 172.21.15.49:0/673335200 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb40bd070 con 0x7facc40704d0 2024-01-31T05:05:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facbb400640 1 -- 172.21.15.49:0/673335200 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb40acdc0 con 0x7facc40704d0 2024-01-31T05:05:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facbb400640 1 -- 172.21.15.49:0/673335200 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb40b7620 con 0x7facc40704d0 2024-01-31T05:05:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facca800640 1 -- 172.21.15.49:0/673335200 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc40cd440 con 0x7facc40704d0 2024-01-31T05:05:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.289+0000 7facca800640 1 -- 172.21.15.49:0/673335200 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc40cc7e0 con 0x7facc40704d0 2024-01-31T05:05:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.293+0000 7facca800640 1 -- 172.21.15.49:0/673335200 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc4074860 con 0x7facc40704d0 2024-01-31T05:05:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.293+0000 7facbb400640 1 -- 172.21.15.49:0/673335200 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7facb40b3040 con 0x7facc40704d0 2024-01-31T05:05:14.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.293+0000 7facbb400640 1 --2- 172.21.15.49:0/673335200 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fac9c066500 0x7fac9c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:14.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.293+0000 7facbb400640 1 -- 172.21.15.49:0/673335200 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7facb411dbb0 con 0x7facc40704d0 2024-01-31T05:05:14.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.293+0000 7facc2a00640 1 --2- 172.21.15.49:0/673335200 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fac9c066500 0x7fac9c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:14.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.293+0000 7facc2a00640 1 --2- 172.21.15.49:0/673335200 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fac9c066500 0x7fac9c0689c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7facc41f97e0 tx=0x7facac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:14.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.297+0000 7facbb400640 1 -- 172.21.15.49:0/673335200 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7facb40eab30 con 0x7facc40704d0 2024-01-31T05:05:14.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.461+0000 7facca800640 1 -- 172.21.15.49:0/673335200 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facc406eba0 con 0x7facc40704d0 2024-01-31T05:05:14.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.461+0000 7facbb400640 1 -- 172.21.15.49:0/673335200 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7facb40ee150 con 0x7facc40704d0 2024-01-31T05:05:14.463 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:14.463 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:58.277568+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:14.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.465+0000 7facca800640 1 -- 172.21.15.49:0/673335200 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fac9c066500 msgr2=0x7fac9c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:14.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.465+0000 7facca800640 1 --2- 172.21.15.49:0/673335200 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fac9c066500 0x7fac9c0689c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7facc41f97e0 tx=0x7facac009040 comp rx=0 tx=0).stop 2024-01-31T05:05:14.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.465+0000 7facca800640 1 -- 172.21.15.49:0/673335200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7facc40704d0 msgr2=0x7facc4155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:14.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.465+0000 7facca800640 1 --2- 172.21.15.49:0/673335200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7facc40704d0 0x7facc4155940 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7facb4009740 tx=0x7facb401acd0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.465+0000 7facca800640 1 -- 172.21.15.49:0/673335200 shutdown_connections 2024-01-31T05:05:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.465+0000 7facca800640 1 --2- 172.21.15.49:0/673335200 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fac9c066500 0x7fac9c0689c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.465+0000 7facca800640 1 --2- 172.21.15.49:0/673335200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc415e760 0x7facc4144110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.465+0000 7facca800640 1 --2- 172.21.15.49:0/673335200 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facc40d1970 0x7facc4143bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.465+0000 7facca800640 1 --2- 172.21.15.49:0/673335200 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7facc40704d0 0x7facc4155940 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.465+0000 7facca800640 1 -- 172.21.15.49:0/673335200 >> 172.21.15.49:0/673335200 conn(0x7facc40d0e50 msgr2=0x7facc415d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.465+0000 7facca800640 1 -- 172.21.15.49:0/673335200 shutdown_connections 2024-01-31T05:05:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.465+0000 7facca800640 1 -- 172.21.15.49:0/673335200 wait complete. 2024-01-31T05:05:14.486 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:04:14.566345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:04:15.231265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-31T05:04:18.316756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-31T05:05:14.486 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:05:14.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.629+0000 7f4e86e00640 1 Processor -- start 2024-01-31T05:05:14.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.629+0000 7f4e86e00640 1 -- start start 2024-01-31T05:05:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.629+0000 7f4e86e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e8015b110 0x7f4e8006c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.629+0000 7f4e86e00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8015b4f0 con 0x7f4e800714e0 2024-01-31T05:05:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.633+0000 7f4e86e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e800abf20 con 0x7f4e800cdf10 2024-01-31T05:05:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.633+0000 7f4e86e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e800ce460 con 0x7f4e8015b110 2024-01-31T05:05:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.633+0000 7f4e84e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4e800714e0 0x7f4e800ad800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59196/0 (socket says 172.21.15.49:59196) 2024-01-31T05:05:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.633+0000 7f4e84e00640 1 -- 172.21.15.49:0/2458768814 learned_addr learned my addr 172.21.15.49:0/2458768814 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.633+0000 7f4e7fe00640 1 --2- 172.21.15.49:0/2458768814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e8015b110 0x7f4e8006c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:14.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.633+0000 7f4e7ea00640 1 -- 172.21.15.49:0/2458768814 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905229002 0 0) 0x7f4e780014a0 con 0x7f4e800714e0 2024-01-31T05:05:14.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.633+0000 7f4e7ea00640 1 -- 172.21.15.49:0/2458768814 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e60003530 con 0x7f4e800714e0 2024-01-31T05:05:14.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.633+0000 7f4e7fe00640 1 -- 172.21.15.49:0/2458768814 >> v1:172.21.15.195:6789/0 conn(0x7f4e800cdf10 legacy=0x7f4e80070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:14.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.633+0000 7f4e7fe00640 1 -- 172.21.15.49:0/2458768814 >> v1:172.21.15.49:6789/0 conn(0x7f4e800714e0 legacy=0x7f4e800ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:14.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.633+0000 7f4e7fe00640 1 -- 172.21.15.49:0/2458768814 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e800ac200 con 0x7f4e8015b110 2024-01-31T05:05:14.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.637+0000 7f4e7fe00640 1 --2- 172.21.15.49:0/2458768814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e8015b110 0x7f4e8006c2d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4e700097f0 tx=0x7f4e7001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c799ceec675c3318 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:14.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.637+0000 7f4e7ea00640 1 -- 172.21.15.49:0/2458768814 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e700ad660 con 0x7f4e8015b110 2024-01-31T05:05:14.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.637+0000 7f4e7ea00640 1 -- 172.21.15.49:0/2458768814 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e700ad7c0 con 0x7f4e8015b110 2024-01-31T05:05:14.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.637+0000 7f4e7ea00640 1 -- 172.21.15.49:0/2458768814 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e700adb50 con 0x7f4e8015b110 2024-01-31T05:05:14.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.637+0000 7f4e86e00640 1 -- 172.21.15.49:0/2458768814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e8015b110 msgr2=0x7f4e8006c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:14.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.637+0000 7f4e86e00640 1 --2- 172.21.15.49:0/2458768814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e8015b110 0x7f4e8006c2d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4e700097f0 tx=0x7f4e7001c450 comp rx=0 tx=0).stop 2024-01-31T05:05:14.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.637+0000 7f4e86e00640 1 -- 172.21.15.49:0/2458768814 shutdown_connections 2024-01-31T05:05:14.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.637+0000 7f4e86e00640 1 --2- 172.21.15.49:0/2458768814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e8015b110 0x7f4e8006c2d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.637+0000 7f4e86e00640 1 -- 172.21.15.49:0/2458768814 >> 172.21.15.49:0/2458768814 conn(0x7f4e800b09a0 msgr2=0x7f4e800b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:14.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.637+0000 7f4e86e00640 1 -- 172.21.15.49:0/2458768814 shutdown_connections 2024-01-31T05:05:14.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.637+0000 7f4e86e00640 1 -- 172.21.15.49:0/2458768814 wait complete. 2024-01-31T05:05:14.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.637+0000 7f4e86e00640 1 Processor -- start 2024-01-31T05:05:14.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.637+0000 7f4e86e00640 1 -- start start 2024-01-31T05:05:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e86e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e800714e0 0x7f4e80144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e86e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e800cdf10 0x7f4e8014b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:14.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e86e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e8015b110 0x7f4e801f6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e86e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e80145160 con 0x7f4e800714e0 2024-01-31T05:05:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e86e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8014c900 con 0x7f4e800cdf10 2024-01-31T05:05:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e86e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8014bcf0 con 0x7f4e8015b110 2024-01-31T05:05:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e7fe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e800714e0 0x7f4e80144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e7fe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e800714e0 0x7f4e80144c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52766/0 (socket says 172.21.15.49:52766) 2024-01-31T05:05:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e7fe00640 1 -- 172.21.15.49:0/1227265199 learned_addr learned my addr 172.21.15.49:0/1227265199 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e7f400640 1 --2- 172.21.15.49:0/1227265199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e800cdf10 0x7f4e8014b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e84e00640 1 --2- 172.21.15.49:0/1227265199 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e8015b110 0x7f4e801f6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e7fe00640 1 -- 172.21.15.49:0/1227265199 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e8015b110 msgr2=0x7f4e801f6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e7fe00640 1 --2- 172.21.15.49:0/1227265199 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e8015b110 0x7f4e801f6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e7fe00640 1 -- 172.21.15.49:0/1227265199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e800cdf10 msgr2=0x7f4e8014b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e7fe00640 1 --2- 172.21.15.49:0/1227265199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e800cdf10 0x7f4e8014b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e7fe00640 1 -- 172.21.15.49:0/1227265199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e70009420 con 0x7f4e800714e0 2024-01-31T05:05:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e7fe00640 1 --2- 172.21.15.49:0/1227265199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e800714e0 0x7f4e80144c20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4e7001a080 tx=0x7f4e700191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:14.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e77e00640 1 -- 172.21.15.49:0/1227265199 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e700b7670 con 0x7f4e800714e0 2024-01-31T05:05:14.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e77e00640 1 -- 172.21.15.49:0/1227265199 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e700b77d0 con 0x7f4e800714e0 2024-01-31T05:05:14.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e77e00640 1 -- 172.21.15.49:0/1227265199 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e700b7b80 con 0x7f4e800714e0 2024-01-31T05:05:14.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e86e00640 1 -- 172.21.15.49:0/1227265199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8014bfd0 con 0x7f4e800714e0 2024-01-31T05:05:14.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e86e00640 1 -- 172.21.15.49:0/1227265199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8014c590 con 0x7f4e800714e0 2024-01-31T05:05:14.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e86e00640 1 -- 172.21.15.49:0/1227265199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e80074860 con 0x7f4e800714e0 2024-01-31T05:05:14.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.641+0000 7f4e77e00640 1 -- 172.21.15.49:0/1227265199 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f4e700b4040 con 0x7f4e800714e0 2024-01-31T05:05:14.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.645+0000 7f4e77e00640 1 --2- 172.21.15.49:0/1227265199 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4e58066500 0x7f4e580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:14.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.645+0000 7f4e77e00640 1 -- 172.21.15.49:0/1227265199 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4e7011ea00 con 0x7f4e800714e0 2024-01-31T05:05:14.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.645+0000 7f4e7f400640 1 --2- 172.21.15.49:0/1227265199 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4e58066500 0x7f4e580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:14.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.645+0000 7f4e7f400640 1 --2- 172.21.15.49:0/1227265199 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4e58066500 0x7f4e580689c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4e8006df50 tx=0x7f4e68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:14.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.649+0000 7f4e77e00640 1 -- 172.21.15.49:0/1227265199 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f4e700eba00 con 0x7f4e800714e0 2024-01-31T05:05:14.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.809+0000 7f4e86e00640 1 -- 172.21.15.49:0/1227265199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e800b17d0 con 0x7f4e800714e0 2024-01-31T05:05:14.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.809+0000 7f4e77e00640 1 -- 172.21.15.49:0/1227265199 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e700b20a0 con 0x7f4e800714e0 2024-01-31T05:05:14.809 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:05:14.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.809+0000 7f4e86e00640 1 -- 172.21.15.49:0/1227265199 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4e58066500 msgr2=0x7f4e580689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:14.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.809+0000 7f4e86e00640 1 --2- 172.21.15.49:0/1227265199 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4e58066500 0x7f4e580689c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4e8006df50 tx=0x7f4e68009040 comp rx=0 tx=0).stop 2024-01-31T05:05:14.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.809+0000 7f4e86e00640 1 -- 172.21.15.49:0/1227265199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e800714e0 msgr2=0x7f4e80144c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:14.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.809+0000 7f4e86e00640 1 --2- 172.21.15.49:0/1227265199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e800714e0 0x7f4e80144c20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4e7001a080 tx=0x7f4e700191f0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.809+0000 7f4e86e00640 1 -- 172.21.15.49:0/1227265199 shutdown_connections 2024-01-31T05:05:14.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.809+0000 7f4e86e00640 1 --2- 172.21.15.49:0/1227265199 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e8015b110 0x7f4e801f6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.809+0000 7f4e86e00640 1 --2- 172.21.15.49:0/1227265199 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4e58066500 0x7f4e580689c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.809+0000 7f4e86e00640 1 --2- 172.21.15.49:0/1227265199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e800cdf10 0x7f4e8014b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.809+0000 7f4e86e00640 1 --2- 172.21.15.49:0/1227265199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e800714e0 0x7f4e80144c20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.809+0000 7f4e86e00640 1 -- 172.21.15.49:0/1227265199 >> 172.21.15.49:0/1227265199 conn(0x7f4e800b09a0 msgr2=0x7f4e800cf500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:14.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.809+0000 7f4e86e00640 1 -- 172.21.15.49:0/1227265199 shutdown_connections 2024-01-31T05:05:14.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.809+0000 7f4e86e00640 1 -- 172.21.15.49:0/1227265199 wait complete. 2024-01-31T05:05:14.831 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:05:14.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.973+0000 7fad05a00640 1 Processor -- start 2024-01-31T05:05:14.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.973+0000 7fad05a00640 1 -- start start 2024-01-31T05:05:14.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.977+0000 7fad05a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fad0015d3a0 0x7fad0006e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:14.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.977+0000 7fad05a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad000cce30 0x7fad0006f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:14.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.977+0000 7fad05a00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad000cb990 con 0x7fad0006ee50 2024-01-31T05:05:14.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.977+0000 7fad05a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad000d1c20 con 0x7fad0015d3a0 2024-01-31T05:05:14.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.977+0000 7fad05a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad000cfed0 con 0x7fad000cce30 2024-01-31T05:05:14.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.977+0000 7facfe000640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fad0006ee50 0x7fad000cd6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59202/0 (socket says 172.21.15.49:59202) 2024-01-31T05:05:14.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.977+0000 7facfe000640 1 -- 172.21.15.49:0/682606414 learned_addr learned my addr 172.21.15.49:0/682606414 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:14.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.977+0000 7facfea00640 1 --2- 172.21.15.49:0/682606414 >> v2:172.21.15.195:3300/0 conn(0x7fad0015d3a0 0x7fad0006e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:14.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.977+0000 7facff400640 1 --2- 172.21.15.49:0/682606414 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad000cce30 0x7fad0006f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:14.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.977+0000 7facfd600640 1 -- 172.21.15.49:0/682606414 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482724572 0 0) 0x7fad000cb990 con 0x7fad0006ee50 2024-01-31T05:05:14.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.977+0000 7facfd600640 1 -- 172.21.15.49:0/682606414 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7face0003530 con 0x7fad0006ee50 2024-01-31T05:05:14.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.977+0000 7facfea00640 1 -- 172.21.15.49:0/682606414 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad000cce30 msgr2=0x7fad0006f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:14.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.977+0000 7facfea00640 1 --2- 172.21.15.49:0/682606414 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad000cce30 0x7fad0006f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.977+0000 7facfea00640 1 -- 172.21.15.49:0/682606414 >> v1:172.21.15.49:6789/0 conn(0x7fad0006ee50 legacy=0x7fad000cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:14.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.977+0000 7facfea00640 1 -- 172.21.15.49:0/682606414 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad000d01b0 con 0x7fad0015d3a0 2024-01-31T05:05:14.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.981+0000 7facfea00640 1 --2- 172.21.15.49:0/682606414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad0015d3a0 0x7fad0006e910 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7facf00097c0 tx=0x7facf001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0a14e4bf9b3f647 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:14.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.981+0000 7facfd600640 1 -- 172.21.15.49:0/682606414 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf00a6040 con 0x7fad0015d3a0 2024-01-31T05:05:14.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.981+0000 7facfd600640 1 -- 172.21.15.49:0/682606414 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf00aa600 con 0x7fad0015d3a0 2024-01-31T05:05:14.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.981+0000 7facfd600640 1 -- 172.21.15.49:0/682606414 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf00aa970 con 0x7fad0015d3a0 2024-01-31T05:05:14.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.981+0000 7fad05a00640 1 -- 172.21.15.49:0/682606414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad0015d3a0 msgr2=0x7fad0006e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:14.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.981+0000 7fad05a00640 1 --2- 172.21.15.49:0/682606414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad0015d3a0 0x7fad0006e910 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7facf00097c0 tx=0x7facf001c480 comp rx=0 tx=0).stop 2024-01-31T05:05:14.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.981+0000 7fad05a00640 1 -- 172.21.15.49:0/682606414 shutdown_connections 2024-01-31T05:05:14.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.981+0000 7fad05a00640 1 --2- 172.21.15.49:0/682606414 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad000cce30 0x7fad0006f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.981+0000 7fad05a00640 1 --2- 172.21.15.49:0/682606414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad0015d3a0 0x7fad0006e910 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.981+0000 7fad05a00640 1 -- 172.21.15.49:0/682606414 >> 172.21.15.49:0/682606414 conn(0x7fad000d0e50 msgr2=0x7fad000d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:14.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.981+0000 7fad05a00640 1 -- 172.21.15.49:0/682606414 shutdown_connections 2024-01-31T05:05:14.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.981+0000 7fad05a00640 1 -- 172.21.15.49:0/682606414 wait complete. 2024-01-31T05:05:14.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.981+0000 7fad05a00640 1 Processor -- start 2024-01-31T05:05:14.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.981+0000 7fad05a00640 1 -- start start 2024-01-31T05:05:14.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7fad05a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad0006ee50 0x7fad000b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:14.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7fad05a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad000cce30 0x7fad000caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:14.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7fad05a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad0015d3a0 0x7fad0015bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:14.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7fad05a00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad000b6440 con 0x7fad000cce30 2024-01-31T05:05:14.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7fad05a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad000b47e0 con 0x7fad0006ee50 2024-01-31T05:05:14.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7fad05a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad000c9260 con 0x7fad0015d3a0 2024-01-31T05:05:14.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7facfe000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad000cce30 0x7fad000caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:14.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7facfe000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad000cce30 0x7fad000caa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52778/0 (socket says 172.21.15.49:52778) 2024-01-31T05:05:14.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7facfe000640 1 -- 172.21.15.49:0/775398370 learned_addr learned my addr 172.21.15.49:0/775398370 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:14.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7facfea00640 1 --2- 172.21.15.49:0/775398370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad0006ee50 0x7fad000b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:14.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7facff400640 1 --2- 172.21.15.49:0/775398370 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad0015d3a0 0x7fad0015bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:14.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7facfe000640 1 -- 172.21.15.49:0/775398370 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad0015d3a0 msgr2=0x7fad0015bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:14.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7facfe000640 1 --2- 172.21.15.49:0/775398370 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad0015d3a0 0x7fad0015bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7facfe000640 1 -- 172.21.15.49:0/775398370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad0006ee50 msgr2=0x7fad000b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:14.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7facfe000640 1 --2- 172.21.15.49:0/775398370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad0006ee50 0x7fad000b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:14.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7facfe000640 1 -- 172.21.15.49:0/775398370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf0009420 con 0x7fad000cce30 2024-01-31T05:05:14.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7facfe000640 1 --2- 172.21.15.49:0/775398370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad000cce30 0x7fad000caa20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7face800c3c0 tx=0x7face800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:14.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7facf6a00640 1 -- 172.21.15.49:0/775398370 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face8005cf0 con 0x7fad000cce30 2024-01-31T05:05:14.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7facf6a00640 1 -- 172.21.15.49:0/775398370 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face8005e50 con 0x7fad000cce30 2024-01-31T05:05:14.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7facf6a00640 1 -- 172.21.15.49:0/775398370 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face80072f0 con 0x7fad000cce30 2024-01-31T05:05:14.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7fad05a00640 1 -- 172.21.15.49:0/775398370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad000b6c30 con 0x7fad000cce30 2024-01-31T05:05:14.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7fad05a00640 1 -- 172.21.15.49:0/775398370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad000b6950 con 0x7fad000cce30 2024-01-31T05:05:14.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7fad05a00640 1 -- 172.21.15.49:0/775398370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0006fdb0 con 0x7fad000cce30 2024-01-31T05:05:14.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.985+0000 7facf6a00640 1 -- 172.21.15.49:0/775398370 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7face8007450 con 0x7fad000cce30 2024-01-31T05:05:14.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.989+0000 7facf6a00640 1 --2- 172.21.15.49:0/775398370 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7facd8066500 0x7facd80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:14.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.989+0000 7facf6a00640 1 -- 172.21.15.49:0/775398370 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7face8083820 con 0x7fad000cce30 2024-01-31T05:05:14.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.989+0000 7facfea00640 1 --2- 172.21.15.49:0/775398370 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7facd8066500 0x7facd80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:14.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.989+0000 7facfea00640 1 --2- 172.21.15.49:0/775398370 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7facd8066500 0x7facd80689c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7facf00ae000 tx=0x7facf0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:14.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:14.993+0000 7facf6a00640 1 -- 172.21.15.49:0/775398370 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7face8050710 con 0x7fad000cce30 2024-01-31T05:05:15.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.149+0000 7fad05a00640 1 -- 172.21.15.49:0/775398370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad00074860 con 0x7fad000cce30 2024-01-31T05:05:15.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.149+0000 7facf6a00640 1 -- 172.21.15.49:0/775398370 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7face8017020 con 0x7fad000cce30 2024-01-31T05:05:15.152 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.153+0000 7fad05a00640 1 -- 172.21.15.49:0/775398370 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7facd8066500 msgr2=0x7facd80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.153+0000 7fad05a00640 1 --2- 172.21.15.49:0/775398370 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7facd8066500 0x7facd80689c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7facf00ae000 tx=0x7facf0008040 comp rx=0 tx=0).stop 2024-01-31T05:05:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.153+0000 7fad05a00640 1 -- 172.21.15.49:0/775398370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad000cce30 msgr2=0x7fad000caa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.153+0000 7fad05a00640 1 --2- 172.21.15.49:0/775398370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad000cce30 0x7fad000caa20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7face800c3c0 tx=0x7face800c880 comp rx=0 tx=0).stop 2024-01-31T05:05:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.153+0000 7fad05a00640 1 -- 172.21.15.49:0/775398370 shutdown_connections 2024-01-31T05:05:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.153+0000 7fad05a00640 1 --2- 172.21.15.49:0/775398370 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad0015d3a0 0x7fad0015bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.153+0000 7fad05a00640 1 --2- 172.21.15.49:0/775398370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad000cce30 0x7fad000caa20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.153+0000 7fad05a00640 1 --2- 172.21.15.49:0/775398370 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7facd8066500 0x7facd80689c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.153+0000 7fad05a00640 1 --2- 172.21.15.49:0/775398370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad0006ee50 0x7fad000b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.153+0000 7fad05a00640 1 -- 172.21.15.49:0/775398370 >> 172.21.15.49:0/775398370 conn(0x7fad000d0e50 msgr2=0x7fad000cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:15.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.153+0000 7fad05a00640 1 -- 172.21.15.49:0/775398370 shutdown_connections 2024-01-31T05:05:15.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.153+0000 7fad05a00640 1 -- 172.21.15.49:0/775398370 wait complete. 2024-01-31T05:05:15.173 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:05:15.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.317+0000 7fd186400640 1 Processor -- start 2024-01-31T05:05:15.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.317+0000 7fd186400640 1 -- start start 2024-01-31T05:05:15.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.317+0000 7fd186400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1800cdf10 0x7fd180070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:15.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.317+0000 7fd186400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd1800ce610 0x7fd180071310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:15.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.317+0000 7fd186400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18015b4f0 con 0x7fd18015b110 2024-01-31T05:05:15.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.317+0000 7fd186400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1800ce460 con 0x7fd1800ce610 2024-01-31T05:05:15.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.317+0000 7fd186400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd180071850 con 0x7fd1800cdf10 2024-01-31T05:05:15.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.317+0000 7fd17fe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd1800ce610 0x7fd180071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:15.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.317+0000 7fd17fe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fd1800ce610 0x7fd180071310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52792/0 (socket says 172.21.15.49:52792) 2024-01-31T05:05:15.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.317+0000 7fd17fe00640 1 -- 172.21.15.49:0/361814738 learned_addr learned my addr 172.21.15.49:0/361814738 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:15.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.317+0000 7fd17ea00640 1 --2- 172.21.15.49:0/361814738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1800cdf10 0x7fd180070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:15.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.317+0000 7fd17fe00640 1 -- 172.21.15.49:0/361814738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1800cdf10 msgr2=0x7fd180070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:15.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.317+0000 7fd17fe00640 1 --2- 172.21.15.49:0/361814738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1800cdf10 0x7fd180070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.317+0000 7fd17fe00640 1 -- 172.21.15.49:0/361814738 >> v1:172.21.15.195:6789/0 conn(0x7fd18015b110 legacy=0x7fd18006c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:15.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.317+0000 7fd17fe00640 1 -- 172.21.15.49:0/361814738 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1800abf20 con 0x7fd1800ce610 2024-01-31T05:05:15.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.321+0000 7fd17fe00640 1 --2- 172.21.15.49:0/361814738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1800ce610 0x7fd180071310 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd178009e80 tx=0x7fd17801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87df9a06b276304b server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:15.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.321+0000 7fd17e000640 1 -- 172.21.15.49:0/361814738 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1780a5880 con 0x7fd1800ce610 2024-01-31T05:05:15.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.321+0000 7fd17e000640 1 -- 172.21.15.49:0/361814738 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1780a59e0 con 0x7fd1800ce610 2024-01-31T05:05:15.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.321+0000 7fd17e000640 1 -- 172.21.15.49:0/361814738 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1780a5d70 con 0x7fd1800ce610 2024-01-31T05:05:15.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.321+0000 7fd186400640 1 -- 172.21.15.49:0/361814738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1800ce610 msgr2=0x7fd180071310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:15.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.321+0000 7fd186400640 1 --2- 172.21.15.49:0/361814738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1800ce610 0x7fd180071310 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd178009e80 tx=0x7fd17801c9c0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.321+0000 7fd186400640 1 -- 172.21.15.49:0/361814738 shutdown_connections 2024-01-31T05:05:15.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.321+0000 7fd186400640 1 --2- 172.21.15.49:0/361814738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1800ce610 0x7fd180071310 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.321+0000 7fd186400640 1 --2- 172.21.15.49:0/361814738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1800cdf10 0x7fd180070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.321+0000 7fd186400640 1 -- 172.21.15.49:0/361814738 >> 172.21.15.49:0/361814738 conn(0x7fd1800b09a0 msgr2=0x7fd1800b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:15.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.321+0000 7fd186400640 1 -- 172.21.15.49:0/361814738 shutdown_connections 2024-01-31T05:05:15.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.321+0000 7fd186400640 1 -- 172.21.15.49:0/361814738 wait complete. 2024-01-31T05:05:15.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd186400640 1 Processor -- start 2024-01-31T05:05:15.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd186400640 1 -- start start 2024-01-31T05:05:15.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd186400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1800cdf10 0x7fd180099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:15.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd186400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1800ce610 0x7fd18009c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:15.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd186400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd18015b110 0x7fd1800b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:15.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd186400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18015a7d0 con 0x7fd18015b110 2024-01-31T05:05:15.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd186400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18009c860 con 0x7fd1800cdf10 2024-01-31T05:05:15.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd186400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18009a150 con 0x7fd1800ce610 2024-01-31T05:05:15.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd17fe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd18015b110 0x7fd1800b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:15.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd17fe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd18015b110 0x7fd1800b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52798/0 (socket says 172.21.15.49:52798) 2024-01-31T05:05:15.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd17fe00640 1 -- 172.21.15.49:0/317332807 learned_addr learned my addr 172.21.15.49:0/317332807 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:15.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd17ea00640 1 --2- 172.21.15.49:0/317332807 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1800ce610 0x7fd18009c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:15.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd17f400640 1 --2- 172.21.15.49:0/317332807 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1800cdf10 0x7fd180099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:15.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd17fe00640 1 -- 172.21.15.49:0/317332807 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1800ce610 msgr2=0x7fd18009c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:15.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd17fe00640 1 --2- 172.21.15.49:0/317332807 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1800ce610 0x7fd18009c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd17fe00640 1 -- 172.21.15.49:0/317332807 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1800cdf10 msgr2=0x7fd180099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:15.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd17fe00640 1 --2- 172.21.15.49:0/317332807 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1800cdf10 0x7fd180099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd17fe00640 1 -- 172.21.15.49:0/317332807 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd178009b30 con 0x7fd18015b110 2024-01-31T05:05:15.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd17fe00640 1 --2- 172.21.15.49:0/317332807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd18015b110 0x7fd1800b3040 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd1780af040 tx=0x7fd178019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:15.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd177400640 1 -- 172.21.15.49:0/317332807 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1780b8670 con 0x7fd18015b110 2024-01-31T05:05:15.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd177400640 1 -- 172.21.15.49:0/317332807 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1780b87f0 con 0x7fd18015b110 2024-01-31T05:05:15.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd177400640 1 -- 172.21.15.49:0/317332807 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1780b8ba0 con 0x7fd18015b110 2024-01-31T05:05:15.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd186400640 1 -- 172.21.15.49:0/317332807 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18009a430 con 0x7fd18015b110 2024-01-31T05:05:15.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.325+0000 7fd186400640 1 -- 172.21.15.49:0/317332807 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18014aa90 con 0x7fd18015b110 2024-01-31T05:05:15.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.329+0000 7fd186400640 1 -- 172.21.15.49:0/317332807 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18014ac80 con 0x7fd18015b110 2024-01-31T05:05:15.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.329+0000 7fd177400640 1 -- 172.21.15.49:0/317332807 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd1780b8d00 con 0x7fd18015b110 2024-01-31T05:05:15.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.329+0000 7fd177400640 1 --2- 172.21.15.49:0/317332807 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd158066500 0x7fd1580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:15.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.329+0000 7fd177400640 1 -- 172.21.15.49:0/317332807 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd17811f7a0 con 0x7fd18015b110 2024-01-31T05:05:15.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.329+0000 7fd17f400640 1 --2- 172.21.15.49:0/317332807 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd158066500 0x7fd1580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:15.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.329+0000 7fd17f400640 1 --2- 172.21.15.49:0/317332807 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd158066500 0x7fd1580689c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd170001770 tx=0x7fd170009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:15.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.333+0000 7fd177400640 1 -- 172.21.15.49:0/317332807 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd1780ec730 con 0x7fd18015b110 2024-01-31T05:05:15.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.493+0000 7fd186400640 1 -- 172.21.15.49:0/317332807 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd180074860 con 0x7fd18015b110 2024-01-31T05:05:15.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.493+0000 7fd177400640 1 -- 172.21.15.49:0/317332807 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd1780efd50 con 0x7fd18015b110 2024-01-31T05:05:15.493 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-31T05:05:15.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.493+0000 7fd186400640 1 -- 172.21.15.49:0/317332807 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd158066500 msgr2=0x7fd1580689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:15.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.493+0000 7fd186400640 1 --2- 172.21.15.49:0/317332807 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd158066500 0x7fd1580689c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd170001770 tx=0x7fd170009040 comp rx=0 tx=0).stop 2024-01-31T05:05:15.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.493+0000 7fd186400640 1 -- 172.21.15.49:0/317332807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd18015b110 msgr2=0x7fd1800b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:15.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.493+0000 7fd186400640 1 --2- 172.21.15.49:0/317332807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd18015b110 0x7fd1800b3040 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd1780af040 tx=0x7fd178019760 comp rx=0 tx=0).stop 2024-01-31T05:05:15.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.493+0000 7fd186400640 1 -- 172.21.15.49:0/317332807 shutdown_connections 2024-01-31T05:05:15.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.493+0000 7fd186400640 1 --2- 172.21.15.49:0/317332807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd18015b110 0x7fd1800b3040 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.493+0000 7fd186400640 1 --2- 172.21.15.49:0/317332807 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1800ce610 0x7fd18009c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.493+0000 7fd186400640 1 --2- 172.21.15.49:0/317332807 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd158066500 0x7fd1580689c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.493+0000 7fd186400640 1 --2- 172.21.15.49:0/317332807 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1800cdf10 0x7fd180099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.493+0000 7fd186400640 1 -- 172.21.15.49:0/317332807 >> 172.21.15.49:0/317332807 conn(0x7fd1800b09a0 msgr2=0x7fd1800703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:15.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.493+0000 7fd186400640 1 -- 172.21.15.49:0/317332807 shutdown_connections 2024-01-31T05:05:15.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.493+0000 7fd186400640 1 -- 172.21.15.49:0/317332807 wait complete. 2024-01-31T05:05:15.516 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-31T05:05:15.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.657+0000 7fefb2400640 1 Processor -- start 2024-01-31T05:05:15.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.657+0000 7fefb2400640 1 -- start start 2024-01-31T05:05:15.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.661+0000 7fefb2400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefac070ac0 0x7fefac0ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:15.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.661+0000 7fefb2400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefac159b70 con 0x7fefac070660 2024-01-31T05:05:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.661+0000 7fefb2400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefac0b2750 con 0x7fefac159790 2024-01-31T05:05:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.661+0000 7fefb2400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefac0b2a30 con 0x7fefac070ac0 2024-01-31T05:05:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.661+0000 7fefaaa00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fefac070660 0x7fefac0ac050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59216/0 (socket says 172.21.15.49:59216) 2024-01-31T05:05:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.661+0000 7fefaaa00640 1 -- 172.21.15.49:0/3348922322 learned_addr learned my addr 172.21.15.49:0/3348922322 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.661+0000 7fefabe00640 1 --2- 172.21.15.49:0/3348922322 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefac070ac0 0x7fefac0ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.661+0000 7fefaa000640 1 -- 172.21.15.49:0/3348922322 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420471737 0 0) 0x7fefac159b70 con 0x7fefac070660 2024-01-31T05:05:15.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.661+0000 7fefaa000640 1 -- 172.21.15.49:0/3348922322 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef8c003450 con 0x7fefac070660 2024-01-31T05:05:15.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.661+0000 7fefaa000640 1 -- 172.21.15.49:0/3348922322 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104687982 0 0) 0x7fefac0b2750 con 0x7fefac159790 2024-01-31T05:05:15.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.661+0000 7fefaa000640 1 -- 172.21.15.49:0/3348922322 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefac159b70 con 0x7fefac159790 2024-01-31T05:05:15.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.661+0000 7fefaa000640 1 -- 172.21.15.49:0/3348922322 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 308438035 0 0) 0x7fef8c003450 con 0x7fefac070660 2024-01-31T05:05:15.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.661+0000 7fefabe00640 1 -- 172.21.15.49:0/3348922322 >> v1:172.21.15.195:6789/0 conn(0x7fefac159790 legacy=0x7fefac0b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:15.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.661+0000 7fefabe00640 1 -- 172.21.15.49:0/3348922322 >> v1:172.21.15.49:6789/0 conn(0x7fefac070660 legacy=0x7fefac0ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:15.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.661+0000 7fefabe00640 1 -- 172.21.15.49:0/3348922322 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac0b2d10 con 0x7fefac070ac0 2024-01-31T05:05:15.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.665+0000 7fefabe00640 1 --2- 172.21.15.49:0/3348922322 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefac070ac0 0x7fefac0ac760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009dc0 tx=0x7fefa401c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dace69f7dfe7fa9e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:15.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.665+0000 7fefaa000640 1 -- 172.21.15.49:0/3348922322 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94001680 con 0x7fefac070ac0 2024-01-31T05:05:15.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.665+0000 7fefaa000640 1 -- 172.21.15.49:0/3348922322 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa40a55c0 con 0x7fefac070ac0 2024-01-31T05:05:15.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.665+0000 7fefaa000640 1 -- 172.21.15.49:0/3348922322 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa40a5950 con 0x7fefac070ac0 2024-01-31T05:05:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.665+0000 7fefb2400640 1 -- 172.21.15.49:0/3348922322 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefac070ac0 msgr2=0x7fefac0ac760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.665+0000 7fefb2400640 1 --2- 172.21.15.49:0/3348922322 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefac070ac0 0x7fefac0ac760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009dc0 tx=0x7fefa401c830 comp rx=0 tx=0).stop 2024-01-31T05:05:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.665+0000 7fefb2400640 1 -- 172.21.15.49:0/3348922322 shutdown_connections 2024-01-31T05:05:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.665+0000 7fefb2400640 1 --2- 172.21.15.49:0/3348922322 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefac070ac0 0x7fefac0ac760 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.665+0000 7fefb2400640 1 -- 172.21.15.49:0/3348922322 >> 172.21.15.49:0/3348922322 conn(0x7fefac0b09a0 msgr2=0x7fefac0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.665+0000 7fefb2400640 1 -- 172.21.15.49:0/3348922322 shutdown_connections 2024-01-31T05:05:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.665+0000 7fefb2400640 1 -- 172.21.15.49:0/3348922322 wait complete. 2024-01-31T05:05:15.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefb2400640 1 Processor -- start 2024-01-31T05:05:15.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefb2400640 1 -- start start 2024-01-31T05:05:15.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefb2400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefac070660 0x7fefac09c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:15.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefb2400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefac070ac0 0x7fefac14f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:15.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefb2400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefac159790 0x7fefac14fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:15.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefb2400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac159f70 con 0x7fefac159790 2024-01-31T05:05:15.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefb2400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac15a250 con 0x7fefac070ac0 2024-01-31T05:05:15.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefb2400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefac099a50 con 0x7fefac070660 2024-01-31T05:05:15.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefabe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefac159790 0x7fefac14fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:15.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefabe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefac159790 0x7fefac14fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52802/0 (socket says 172.21.15.49:52802) 2024-01-31T05:05:15.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefabe00640 1 -- 172.21.15.49:0/3302291091 learned_addr learned my addr 172.21.15.49:0/3302291091 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:15.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefaaa00640 1 --2- 172.21.15.49:0/3302291091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefac070ac0 0x7fefac14f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:15.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefab400640 1 --2- 172.21.15.49:0/3302291091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefac070660 0x7fefac09c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:15.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefabe00640 1 -- 172.21.15.49:0/3302291091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefac070660 msgr2=0x7fefac09c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:15.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefabe00640 1 --2- 172.21.15.49:0/3302291091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefac070660 0x7fefac09c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefabe00640 1 -- 172.21.15.49:0/3302291091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefac070ac0 msgr2=0x7fefac14f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:15.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefabe00640 1 --2- 172.21.15.49:0/3302291091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefac070ac0 0x7fefac14f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefabe00640 1 -- 172.21.15.49:0/3302291091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa4009a70 con 0x7fefac159790 2024-01-31T05:05:15.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefabe00640 1 --2- 172.21.15.49:0/3302291091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefac159790 0x7fefac14fe30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fefa401cd10 tx=0x7fefa40195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:15.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefa3400640 1 -- 172.21.15.49:0/3302291091 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa40b9650 con 0x7fefac159790 2024-01-31T05:05:15.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefa3400640 1 -- 172.21.15.49:0/3302291091 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa40b97b0 con 0x7fefac159790 2024-01-31T05:05:15.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefa3400640 1 -- 172.21.15.49:0/3302291091 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa40b9b20 con 0x7fefac159790 2024-01-31T05:05:15.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefb2400640 1 -- 172.21.15.49:0/3302291091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefac153ac0 con 0x7fefac159790 2024-01-31T05:05:15.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.669+0000 7fefb2400640 1 -- 172.21.15.49:0/3302291091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefac154080 con 0x7fefac159790 2024-01-31T05:05:15.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.673+0000 7fefb2400640 1 -- 172.21.15.49:0/3302291091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefac15a400 con 0x7fefac159790 2024-01-31T05:05:15.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.673+0000 7fefa3400640 1 -- 172.21.15.49:0/3302291091 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fefa40b9c80 con 0x7fefac159790 2024-01-31T05:05:15.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.673+0000 7fefa3400640 1 --2- 172.21.15.49:0/3302291091 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fef84066500 0x7fef840689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:15.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.673+0000 7fefa3400640 1 -- 172.21.15.49:0/3302291091 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fefa411f4d0 con 0x7fefac159790 2024-01-31T05:05:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.673+0000 7fefab400640 1 --2- 172.21.15.49:0/3302291091 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fef84066500 0x7fef840689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.673+0000 7fefab400640 1 --2- 172.21.15.49:0/3302291091 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fef84066500 0x7fef840689c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0011f0 tx=0x7fef9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:15.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.677+0000 7fefa3400640 1 -- 172.21.15.49:0/3302291091 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fefac15a400 con 0x7fefac159790 2024-01-31T05:05:15.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.837+0000 7fefb2400640 1 -- 172.21.15.49:0/3302291091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fefac154210 con 0x7fefac159790 2024-01-31T05:05:15.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.837+0000 7fefa3400640 1 -- 172.21.15.49:0/3302291091 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fefa40ec4e0 con 0x7fefac159790 2024-01-31T05:05:15.837 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:15.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.837+0000 7fefb2400640 1 -- 172.21.15.49:0/3302291091 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fef84066500 msgr2=0x7fef840689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:15.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.837+0000 7fefb2400640 1 --2- 172.21.15.49:0/3302291091 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fef84066500 0x7fef840689c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0011f0 tx=0x7fef9c009040 comp rx=0 tx=0).stop 2024-01-31T05:05:15.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.837+0000 7fefb2400640 1 -- 172.21.15.49:0/3302291091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefac159790 msgr2=0x7fefac14fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:15.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.837+0000 7fefb2400640 1 --2- 172.21.15.49:0/3302291091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefac159790 0x7fefac14fe30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fefa401cd10 tx=0x7fefa40195d0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.837+0000 7fefb2400640 1 -- 172.21.15.49:0/3302291091 shutdown_connections 2024-01-31T05:05:15.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.837+0000 7fefb2400640 1 --2- 172.21.15.49:0/3302291091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefac159790 0x7fefac14fe30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.837+0000 7fefb2400640 1 --2- 172.21.15.49:0/3302291091 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fef84066500 0x7fef840689c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.837+0000 7fefb2400640 1 --2- 172.21.15.49:0/3302291091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefac070ac0 0x7fefac14f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.837+0000 7fefb2400640 1 --2- 172.21.15.49:0/3302291091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fefac070660 0x7fefac09c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:15.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.837+0000 7fefb2400640 1 -- 172.21.15.49:0/3302291091 >> 172.21.15.49:0/3302291091 conn(0x7fefac0b09a0 msgr2=0x7fefac073e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:15.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.837+0000 7fefb2400640 1 -- 172.21.15.49:0/3302291091 shutdown_connections 2024-01-31T05:05:15.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:15.837+0000 7fefb2400640 1 -- 172.21.15.49:0/3302291091 wait complete. 2024-01-31T05:05:15.860 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-31T05:05:16.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.001+0000 7f6502a00640 1 Processor -- start 2024-01-31T05:05:16.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.001+0000 7f6502a00640 1 -- start start 2024-01-31T05:05:16.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.001+0000 7f6502a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64fc15b3e0 0x7f64fc0ce170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.001+0000 7f6502a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f64fc0ae4d0 0x7f64fc0ae940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.001+0000 7f6502a00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64fc0ccd50 con 0x7f64fc0cd680 2024-01-31T05:05:16.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.001+0000 7f6502a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64fc0cc790 con 0x7f64fc0ae4d0 2024-01-31T05:05:16.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.001+0000 7f6502a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0cca70 con 0x7f64fc15b3e0 2024-01-31T05:05:16.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.001+0000 7f64fbe00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f64fc0cd680 0x7f64fc0cda60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59230/0 (socket says 172.21.15.49:59230) 2024-01-31T05:05:16.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.001+0000 7f64fbe00640 1 -- 172.21.15.49:0/2019970206 learned_addr learned my addr 172.21.15.49:0/2019970206 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:16.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f6500a00640 1 --2- 172.21.15.49:0/2019970206 >> v2:172.21.15.195:3300/0 conn(0x7f64fc0ae4d0 0x7f64fc0ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64fb400640 1 --2- 172.21.15.49:0/2019970206 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64fc15b3e0 0x7f64fc0ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64faa00640 1 -- 172.21.15.49:0/2019970206 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912023024 0 0) 0x7f64fc0ccd50 con 0x7f64fc0cd680 2024-01-31T05:05:16.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64faa00640 1 -- 172.21.15.49:0/2019970206 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64dc003530 con 0x7f64fc0cd680 2024-01-31T05:05:16.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64faa00640 1 -- 172.21.15.49:0/2019970206 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 280919263 0 0) 0x7f64dc003530 con 0x7f64fc0cd680 2024-01-31T05:05:16.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64faa00640 1 -- 172.21.15.49:0/2019970206 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64fc15b3e0 msgr2=0x7f64fc0ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:16.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64faa00640 1 --2- 172.21.15.49:0/2019970206 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64fc15b3e0 0x7f64fc0ce170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64faa00640 1 -- 172.21.15.49:0/2019970206 >> v2:172.21.15.195:3300/0 conn(0x7f64fc0ae4d0 msgr2=0x7f64fc0ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:16.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64faa00640 1 --2- 172.21.15.49:0/2019970206 >> v2:172.21.15.195:3300/0 conn(0x7f64fc0ae4d0 0x7f64fc0ae940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64faa00640 1 -- 172.21.15.49:0/2019970206 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc0adcd0 con 0x7f64fc0cd680 2024-01-31T05:05:16.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64faa00640 1 -- 172.21.15.49:0/2019970206 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7f64ec001680 con 0x7f64fc0cd680 2024-01-31T05:05:16.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64faa00640 1 -- 172.21.15.49:0/2019970206 >> v1:172.21.15.49:6789/0 conn(0x7f64fc0cd680 legacy=0x7f64fc0cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:16.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64faa00640 1 --2- 172.21.15.49:0/2019970206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64dc003980 0x7f64dc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64faa00640 1 --2- 172.21.15.49:0/2019970206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0047d0 0x7f64dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64faa00640 1 --2- 172.21.15.49:0/2019970206 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64fc15b3e0 0x7f64dc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64faa00640 1 -- 172.21.15.49:0/2019970206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0cc790 con 0x7f64dc0047d0 2024-01-31T05:05:16.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64faa00640 1 -- 172.21.15.49:0/2019970206 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0cca70 con 0x7f64dc003980 2024-01-31T05:05:16.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64faa00640 1 -- 172.21.15.49:0/2019970206 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc00b9e0 con 0x7f64fc15b3e0 2024-01-31T05:05:16.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64fb400640 1 --2- 172.21.15.49:0/2019970206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0047d0 0x7f64dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64fbe00640 1 --2- 172.21.15.49:0/2019970206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64dc003980 0x7f64dc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f6500a00640 1 --2- 172.21.15.49:0/2019970206 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64fc15b3e0 0x7f64dc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64fb400640 1 -- 172.21.15.49:0/2019970206 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64fc15b3e0 msgr2=0x7f64dc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:16.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64fb400640 1 --2- 172.21.15.49:0/2019970206 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64fc15b3e0 0x7f64dc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64fb400640 1 -- 172.21.15.49:0/2019970206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64dc003980 msgr2=0x7f64dc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:16.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64fb400640 1 --2- 172.21.15.49:0/2019970206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64dc003980 0x7f64dc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.005+0000 7f64fb400640 1 -- 172.21.15.49:0/2019970206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc003530 con 0x7f64dc0047d0 2024-01-31T05:05:16.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.009+0000 7f64fb400640 1 --2- 172.21.15.49:0/2019970206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0047d0 0x7f64dc004c50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f64e4009b10 tx=0x7f64e401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec6981d054078d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:16.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.009+0000 7f64faa00640 1 -- 172.21.15.49:0/2019970206 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e40a64e0 con 0x7f64dc0047d0 2024-01-31T05:05:16.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.009+0000 7f64faa00640 1 -- 172.21.15.49:0/2019970206 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e40a6640 con 0x7f64dc0047d0 2024-01-31T05:05:16.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.009+0000 7f64faa00640 1 -- 172.21.15.49:0/2019970206 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e40a69f0 con 0x7f64dc0047d0 2024-01-31T05:05:16.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.009+0000 7f6502a00640 1 -- 172.21.15.49:0/2019970206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0047d0 msgr2=0x7f64dc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:16.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.009+0000 7f6502a00640 1 --2- 172.21.15.49:0/2019970206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0047d0 0x7f64dc004c50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f64e4009b10 tx=0x7f64e401ca20 comp rx=0 tx=0).stop 2024-01-31T05:05:16.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.009+0000 7f6500a00640 1 -- 172.21.15.49:0/2019970206 reap_dead start 2024-01-31T05:05:16.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.009+0000 7f6502a00640 1 -- 172.21.15.49:0/2019970206 shutdown_connections 2024-01-31T05:05:16.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.009+0000 7f6502a00640 1 -- 172.21.15.49:0/2019970206 >> 172.21.15.49:0/2019970206 conn(0x7f64fc0b28e0 msgr2=0x7f64fc0b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:16.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.009+0000 7f6502a00640 1 -- 172.21.15.49:0/2019970206 shutdown_connections 2024-01-31T05:05:16.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.009+0000 7f6502a00640 1 -- 172.21.15.49:0/2019970206 wait complete. 2024-01-31T05:05:16.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.009+0000 7f6502a00640 1 Processor -- start 2024-01-31T05:05:16.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.009+0000 7f6502a00640 1 -- start start 2024-01-31T05:05:16.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f6502a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0047d0 0x7f64fc153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f6502a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64fc0b2160 0x7f64fc15bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f6502a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64fc15d910 0x7f64fc1f9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f6502a00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc15e700 con 0x7f64dc0047d0 2024-01-31T05:05:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f6502a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc15c460 con 0x7f64fc0b2160 2024-01-31T05:05:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f6502a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc15de60 con 0x7f64fc15d910 2024-01-31T05:05:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f64fbe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0047d0 0x7f64fc153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f64fbe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0047d0 0x7f64fc153310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52822/0 (socket says 172.21.15.49:52822) 2024-01-31T05:05:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f64fbe00640 1 -- 172.21.15.49:0/3759219804 learned_addr learned my addr 172.21.15.49:0/3759219804 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f64fb400640 1 --2- 172.21.15.49:0/3759219804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64fc0b2160 0x7f64fc15bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f6500a00640 1 --2- 172.21.15.49:0/3759219804 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64fc15d910 0x7f64fc1f9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f64fbe00640 1 -- 172.21.15.49:0/3759219804 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64fc15d910 msgr2=0x7f64fc1f9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f64fbe00640 1 --2- 172.21.15.49:0/3759219804 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64fc15d910 0x7f64fc1f9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f64fbe00640 1 -- 172.21.15.49:0/3759219804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64fc0b2160 msgr2=0x7f64fc15bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f64fbe00640 1 --2- 172.21.15.49:0/3759219804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64fc0b2160 0x7f64fc15bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f64fbe00640 1 -- 172.21.15.49:0/3759219804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc15e140 con 0x7f64dc0047d0 2024-01-31T05:05:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f6500a00640 1 --2- 172.21.15.49:0/3759219804 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64fc15d910 0x7f64fc1f9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f64fbe00640 1 --2- 172.21.15.49:0/3759219804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0047d0 0x7f64fc153310 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f64ec000c10 tx=0x7f64ec0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f64f3e00640 1 -- 172.21.15.49:0/3759219804 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00f780 con 0x7f64dc0047d0 2024-01-31T05:05:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f64f3e00640 1 -- 172.21.15.49:0/3759219804 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec00f900 con 0x7f64dc0047d0 2024-01-31T05:05:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f6502a00640 1 -- 172.21.15.49:0/3759219804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc15e420 con 0x7f64dc0047d0 2024-01-31T05:05:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f64f3e00640 1 -- 172.21.15.49:0/3759219804 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00fcb0 con 0x7f64dc0047d0 2024-01-31T05:05:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f6502a00640 1 -- 172.21.15.49:0/3759219804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64fc1fa2c0 con 0x7f64dc0047d0 2024-01-31T05:05:16.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f6502a00640 1 -- 172.21.15.49:0/3759219804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64fc1f96c0 con 0x7f64dc0047d0 2024-01-31T05:05:16.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.013+0000 7f64f3e00640 1 -- 172.21.15.49:0/3759219804 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f64ec01d460 con 0x7f64dc0047d0 2024-01-31T05:05:16.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.017+0000 7f64f3e00640 1 --2- 172.21.15.49:0/3759219804 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f64d4066500 0x7f64d40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.017+0000 7f64f3e00640 1 -- 172.21.15.49:0/3759219804 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f64ec0843a0 con 0x7f64dc0047d0 2024-01-31T05:05:16.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.017+0000 7f64fb400640 1 --2- 172.21.15.49:0/3759219804 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f64d4066500 0x7f64d40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.017+0000 7f64fb400640 1 --2- 172.21.15.49:0/3759219804 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f64d4066500 0x7f64d40689c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f64e40af000 tx=0x7f64e40046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:16.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.021+0000 7f64f3e00640 1 -- 172.21.15.49:0/3759219804 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f64fc1f96c0 con 0x7f64dc0047d0 2024-01-31T05:05:16.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.193+0000 7f6502a00640 1 -- 172.21.15.49:0/3759219804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f64fc1f96c0 con 0x7f64dc0047d0 2024-01-31T05:05:16.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.193+0000 7f64f3e00640 1 -- 172.21.15.49:0/3759219804 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f64fc1f96c0 con 0x7f64dc0047d0 2024-01-31T05:05:16.192 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2024-01-31T05:05:16.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.193+0000 7f6502a00640 1 -- 172.21.15.49:0/3759219804 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f64d4066500 msgr2=0x7f64d40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:16.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.193+0000 7f6502a00640 1 --2- 172.21.15.49:0/3759219804 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f64d4066500 0x7f64d40689c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f64e40af000 tx=0x7f64e40046d0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.193+0000 7f6502a00640 1 -- 172.21.15.49:0/3759219804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0047d0 msgr2=0x7f64fc153310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:16.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.193+0000 7f6502a00640 1 --2- 172.21.15.49:0/3759219804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0047d0 0x7f64fc153310 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f64ec000c10 tx=0x7f64ec0074f0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.193+0000 7f6502a00640 1 -- 172.21.15.49:0/3759219804 shutdown_connections 2024-01-31T05:05:16.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.193+0000 7f6502a00640 1 --2- 172.21.15.49:0/3759219804 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f64fc15d910 0x7f64fc1f9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.193+0000 7f6502a00640 1 --2- 172.21.15.49:0/3759219804 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f64d4066500 0x7f64d40689c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.193+0000 7f6502a00640 1 --2- 172.21.15.49:0/3759219804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64fc0b2160 0x7f64fc15bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.193+0000 7f6502a00640 1 --2- 172.21.15.49:0/3759219804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0047d0 0x7f64fc153310 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.193+0000 7f6502a00640 1 -- 172.21.15.49:0/3759219804 >> 172.21.15.49:0/3759219804 conn(0x7f64fc0b28e0 msgr2=0x7f64fc06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:16.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.193+0000 7f6502a00640 1 -- 172.21.15.49:0/3759219804 shutdown_connections 2024-01-31T05:05:16.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.193+0000 7f6502a00640 1 -- 172.21.15.49:0/3759219804 wait complete. 2024-01-31T05:05:16.214 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-01-31T05:05:16.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:16.214 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-31T05:05:16.234 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T05:05:16.234 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-31T05:05:16.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:16.235 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-31T05:05:16.288 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:05:16.288 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T05:05:16.298 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:05:16.299 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T05:05:16.348 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:16.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.489+0000 7f950b200640 1 Processor -- start 2024-01-31T05:05:16.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.489+0000 7f950b200640 1 -- start start 2024-01-31T05:05:16.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.493+0000 7f950b200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f95040cfad0 0x7f95040cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.493+0000 7f950b200640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95040cff60 con 0x7f950406c290 2024-01-31T05:05:16.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.493+0000 7f950b200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f950415d7e0 con 0x7f950406ba90 2024-01-31T05:05:16.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.493+0000 7f950b200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95040d0470 con 0x7f95040cfad0 2024-01-31T05:05:16.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.493+0000 7f9509200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f95040cfad0 0x7f95040cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.493+0000 7f9503e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f950406c290 0x7f950406c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59246/0 (socket says 172.21.15.49:59246) 2024-01-31T05:05:16.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.493+0000 7f9509200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f95040cfad0 0x7f95040cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52826/0 (socket says 172.21.15.49:52826) 2024-01-31T05:05:16.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.493+0000 7f9503e00640 1 -- 172.21.15.49:0/1790845227 learned_addr learned my addr 172.21.15.49:0/1790845227 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:16.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.493+0000 7f9509200640 1 -- 172.21.15.49:0/1790845227 >> v1:172.21.15.195:6789/0 conn(0x7f950406ba90 legacy=0x7f95040cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:16.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.493+0000 7f9509200640 1 -- 172.21.15.49:0/1790845227 >> v1:172.21.15.49:6789/0 conn(0x7f950406c290 legacy=0x7f950406c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:16.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.493+0000 7f9502a00640 1 -- 172.21.15.49:0/1790845227 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244872671 0 0) 0x7f95040cff60 con 0x7f950406c290 2024-01-31T05:05:16.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.493+0000 7f9509200640 1 -- 172.21.15.49:0/1790845227 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95040d0190 con 0x7f95040cfad0 2024-01-31T05:05:16.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.497+0000 7f9509200640 1 --2- 172.21.15.49:0/1790845227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95040cfad0 0x7f95040cc690 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009d90 tx=0x7f94fc01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7e595cd842c997 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:16.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.497+0000 7f9502a00640 1 -- 172.21.15.49:0/1790845227 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc0a5860 con 0x7f95040cfad0 2024-01-31T05:05:16.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.497+0000 7f9502a00640 1 -- 172.21.15.49:0/1790845227 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94fc0a59c0 con 0x7f95040cfad0 2024-01-31T05:05:16.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.497+0000 7f9502a00640 1 -- 172.21.15.49:0/1790845227 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc0a5d50 con 0x7f95040cfad0 2024-01-31T05:05:16.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.497+0000 7f950b200640 1 -- 172.21.15.49:0/1790845227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95040cfad0 msgr2=0x7f95040cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:16.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.497+0000 7f950b200640 1 --2- 172.21.15.49:0/1790845227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95040cfad0 0x7f95040cc690 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009d90 tx=0x7f94fc01c890 comp rx=0 tx=0).stop 2024-01-31T05:05:16.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.497+0000 7f950b200640 1 -- 172.21.15.49:0/1790845227 shutdown_connections 2024-01-31T05:05:16.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.497+0000 7f950b200640 1 --2- 172.21.15.49:0/1790845227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95040cfad0 0x7f95040cc690 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.497+0000 7f950b200640 1 -- 172.21.15.49:0/1790845227 >> 172.21.15.49:0/1790845227 conn(0x7f95040b28e0 msgr2=0x7f95040b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:16.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.497+0000 7f950b200640 1 -- 172.21.15.49:0/1790845227 shutdown_connections 2024-01-31T05:05:16.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.497+0000 7f950b200640 1 -- 172.21.15.49:0/1790845227 wait complete. 2024-01-31T05:05:16.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.497+0000 7f950b200640 1 Processor -- start 2024-01-31T05:05:16.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.497+0000 7f950b200640 1 -- start start 2024-01-31T05:05:16.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f950b200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f950406ba90 0x7f95041464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f950b200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f950406c290 0x7f95040adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f950b200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95040cfad0 0x7f95040ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f950b200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9504146ae0 con 0x7f950406ba90 2024-01-31T05:05:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f950b200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95041549a0 con 0x7f95040cfad0 2024-01-31T05:05:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f950b200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9504154c80 con 0x7f950406c290 2024-01-31T05:05:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f9503e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f950406ba90 0x7f95041464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f9503e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f950406ba90 0x7f95041464b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52830/0 (socket says 172.21.15.49:52830) 2024-01-31T05:05:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f9503e00640 1 -- 172.21.15.49:0/462010675 learned_addr learned my addr 172.21.15.49:0/462010675 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f9503400640 1 --2- 172.21.15.49:0/462010675 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f950406c290 0x7f95040adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f9509200640 1 --2- 172.21.15.49:0/462010675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95040cfad0 0x7f95040ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f9503e00640 1 -- 172.21.15.49:0/462010675 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f950406c290 msgr2=0x7f95040adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f9503e00640 1 --2- 172.21.15.49:0/462010675 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f950406c290 0x7f95040adbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f9503e00640 1 -- 172.21.15.49:0/462010675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95040cfad0 msgr2=0x7f95040ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f9503e00640 1 --2- 172.21.15.49:0/462010675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95040cfad0 0x7f95040ae100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f9503e00640 1 -- 172.21.15.49:0/462010675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94fc009a70 con 0x7f950406ba90 2024-01-31T05:05:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f9509200640 1 --2- 172.21.15.49:0/462010675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95040cfad0 0x7f95040ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f9503e00640 1 --2- 172.21.15.49:0/462010675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f950406ba90 0x7f95041464b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f94f400c410 tx=0x7f94f400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f94fbe00640 1 -- 172.21.15.49:0/462010675 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f40074e0 con 0x7f950406ba90 2024-01-31T05:05:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f94fbe00640 1 -- 172.21.15.49:0/462010675 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f4007640 con 0x7f950406ba90 2024-01-31T05:05:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f94fbe00640 1 -- 172.21.15.49:0/462010675 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f4004a30 con 0x7f950406ba90 2024-01-31T05:05:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f950b200640 1 -- 172.21.15.49:0/462010675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95040b0810 con 0x7f950406ba90 2024-01-31T05:05:16.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f950b200640 1 -- 172.21.15.49:0/462010675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950415a7c0 con 0x7f950406ba90 2024-01-31T05:05:16.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f950b200640 1 -- 172.21.15.49:0/462010675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9504074860 con 0x7f950406ba90 2024-01-31T05:05:16.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.501+0000 7f94fbe00640 1 -- 172.21.15.49:0/462010675 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f94f4004b90 con 0x7f950406ba90 2024-01-31T05:05:16.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.505+0000 7f94fbe00640 1 --2- 172.21.15.49:0/462010675 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f94dc066500 0x7f94dc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.505+0000 7f94fbe00640 1 -- 172.21.15.49:0/462010675 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f94f4083f90 con 0x7f950406ba90 2024-01-31T05:05:16.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.505+0000 7f9503400640 1 --2- 172.21.15.49:0/462010675 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f94dc066500 0x7f94dc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.505+0000 7f9503400640 1 --2- 172.21.15.49:0/462010675 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f94dc066500 0x7f94dc0689c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f95041f9430 tx=0x7f94ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:16.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.509+0000 7f94fbe00640 1 -- 172.21.15.49:0/462010675 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f94f4050e60 con 0x7f950406ba90 2024-01-31T05:05:16.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.669+0000 7f950b200640 1 -- 172.21.15.49:0/462010675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f950406c070 con 0x7f950406ba90 2024-01-31T05:05:16.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.669+0000 7f94fbe00640 1 -- 172.21.15.49:0/462010675 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7f94f4054480 con 0x7f950406ba90 2024-01-31T05:05:16.670 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:16.671 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:58.277568+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:16.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.673+0000 7f950b200640 1 -- 172.21.15.49:0/462010675 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f94dc066500 msgr2=0x7f94dc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:16.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.673+0000 7f950b200640 1 --2- 172.21.15.49:0/462010675 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f94dc066500 0x7f94dc0689c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f95041f9430 tx=0x7f94ec009040 comp rx=0 tx=0).stop 2024-01-31T05:05:16.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.673+0000 7f950b200640 1 -- 172.21.15.49:0/462010675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f950406ba90 msgr2=0x7f95041464b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:16.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.673+0000 7f950b200640 1 --2- 172.21.15.49:0/462010675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f950406ba90 0x7f95041464b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f94f400c410 tx=0x7f94f400c8d0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.673+0000 7f950b200640 1 -- 172.21.15.49:0/462010675 shutdown_connections 2024-01-31T05:05:16.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.673+0000 7f950b200640 1 --2- 172.21.15.49:0/462010675 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f94dc066500 0x7f94dc0689c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.673+0000 7f950b200640 1 --2- 172.21.15.49:0/462010675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95040cfad0 0x7f95040ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.673+0000 7f950b200640 1 --2- 172.21.15.49:0/462010675 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f950406c290 0x7f95040adbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.673+0000 7f950b200640 1 --2- 172.21.15.49:0/462010675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f950406ba90 0x7f95041464b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.673+0000 7f950b200640 1 -- 172.21.15.49:0/462010675 >> 172.21.15.49:0/462010675 conn(0x7f95040b28e0 msgr2=0x7f95041564c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:16.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.673+0000 7f950b200640 1 -- 172.21.15.49:0/462010675 shutdown_connections 2024-01-31T05:05:16.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.673+0000 7f950b200640 1 -- 172.21.15.49:0/462010675 wait complete. 2024-01-31T05:05:16.693 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:04:14.566345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:04:15.231265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-31T05:04:18.316756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-31T05:05:16.693 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:05:16.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.837+0000 7f9b19e00640 1 Processor -- start 2024-01-31T05:05:16.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.837+0000 7f9b19e00640 1 -- start start 2024-01-31T05:05:16.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.837+0000 7f9b19e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b1415d510 0x7f9b14072050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.837+0000 7f9b19e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9b140b4b20 0x7f9b1406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.837+0000 7f9b19e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9b1406d920 0x7f9b1406a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.837+0000 7f9b19e00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b14072590 con 0x7f9b140b4b20 2024-01-31T05:05:16.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.837+0000 7f9b19e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1406f010 con 0x7f9b1406d920 2024-01-31T05:05:16.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.837+0000 7f9b19e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b14071570 con 0x7f9b1415d510 2024-01-31T05:05:16.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.837+0000 7f9b12000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9b140b4b20 0x7f9b1406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.837+0000 7f9b12000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f9b140b4b20 0x7f9b1406d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52844/0 (socket says 172.21.15.49:52844) 2024-01-31T05:05:16.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.837+0000 7f9b12000640 1 -- 172.21.15.49:0/3931238255 learned_addr learned my addr 172.21.15.49:0/3931238255 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:16.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.837+0000 7f9b12a00640 1 --2- 172.21.15.49:0/3931238255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b1415d510 0x7f9b14072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.837+0000 7f9b13400640 1 --2- 172.21.15.49:0/3931238255 >> v2:172.21.15.195:3300/0 conn(0x7f9b1406d920 0x7f9b1406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.837+0000 7f9b12000640 1 -- 172.21.15.49:0/3931238255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b1415d510 msgr2=0x7f9b14072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:16.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.837+0000 7f9b12000640 1 --2- 172.21.15.49:0/3931238255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b1415d510 0x7f9b14072050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.837+0000 7f9b12000640 1 -- 172.21.15.49:0/3931238255 >> v2:172.21.15.195:3300/0 conn(0x7f9b1406d920 msgr2=0x7f9b1406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:16.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.837+0000 7f9b12000640 1 --2- 172.21.15.49:0/3931238255 >> v2:172.21.15.195:3300/0 conn(0x7f9b1406d920 0x7f9b1406a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.837+0000 7f9b12000640 1 -- 172.21.15.49:0/3931238255 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b14071850 con 0x7f9b140b4b20 2024-01-31T05:05:16.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.837+0000 7f9b13400640 1 --2- 172.21.15.49:0/3931238255 >> v2:172.21.15.195:3300/0 conn(0x7f9b1406d920 0x7f9b1406a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:16.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.841+0000 7f9b12000640 1 --2- 172.21.15.49:0/3931238255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b140b4b20 0x7f9b1406d3e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9b140b1a40 tx=0x7f9afc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b418a78ead80e4 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:16.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.841+0000 7f9b11600640 1 -- 172.21.15.49:0/3931238255 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0ab620 con 0x7f9b140b4b20 2024-01-31T05:05:16.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.841+0000 7f9b11600640 1 -- 172.21.15.49:0/3931238255 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc0ab780 con 0x7f9b140b4b20 2024-01-31T05:05:16.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.841+0000 7f9b11600640 1 -- 172.21.15.49:0/3931238255 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0abb10 con 0x7f9b140b4b20 2024-01-31T05:05:16.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.841+0000 7f9b19e00640 1 -- 172.21.15.49:0/3931238255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b140b4b20 msgr2=0x7f9b1406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:16.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.841+0000 7f9b19e00640 1 --2- 172.21.15.49:0/3931238255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b140b4b20 0x7f9b1406d3e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9b140b1a40 tx=0x7f9afc01c440 comp rx=0 tx=0).stop 2024-01-31T05:05:16.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.841+0000 7f9b19e00640 1 -- 172.21.15.49:0/3931238255 shutdown_connections 2024-01-31T05:05:16.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.841+0000 7f9b19e00640 1 --2- 172.21.15.49:0/3931238255 >> v2:172.21.15.195:3300/0 conn(0x7f9b1406d920 0x7f9b1406a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.841+0000 7f9b19e00640 1 --2- 172.21.15.49:0/3931238255 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b140b4b20 0x7f9b1406d3e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.841+0000 7f9b19e00640 1 --2- 172.21.15.49:0/3931238255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b1415d510 0x7f9b14072050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.841+0000 7f9b19e00640 1 -- 172.21.15.49:0/3931238255 >> 172.21.15.49:0/3931238255 conn(0x7f9b140b1ab0 msgr2=0x7f9b140b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:16.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.841+0000 7f9b19e00640 1 -- 172.21.15.49:0/3931238255 shutdown_connections 2024-01-31T05:05:16.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.841+0000 7f9b19e00640 1 -- 172.21.15.49:0/3931238255 wait complete. 2024-01-31T05:05:16.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b19e00640 1 Processor -- start 2024-01-31T05:05:16.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b19e00640 1 -- start start 2024-01-31T05:05:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b19e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b1406d920 0x7f9b1414f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b19e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b140b4b20 0x7f9b1415f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b19e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b1415d510 0x7f9b140b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b19e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1415fd10 con 0x7f9b1415d510 2024-01-31T05:05:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b19e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1415c720 con 0x7f9b1406d920 2024-01-31T05:05:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b19e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1415ca00 con 0x7f9b140b4b20 2024-01-31T05:05:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b13400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b1415d510 0x7f9b140b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b13400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b1415d510 0x7f9b140b0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52854/0 (socket says 172.21.15.49:52854) 2024-01-31T05:05:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b13400640 1 -- 172.21.15.49:0/2587782308 learned_addr learned my addr 172.21.15.49:0/2587782308 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b12000640 1 --2- 172.21.15.49:0/2587782308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b140b4b20 0x7f9b1415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b12a00640 1 --2- 172.21.15.49:0/2587782308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b1406d920 0x7f9b1414f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b13400640 1 -- 172.21.15.49:0/2587782308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b140b4b20 msgr2=0x7f9b1415f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:16.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b13400640 1 --2- 172.21.15.49:0/2587782308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b140b4b20 0x7f9b1415f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b13400640 1 -- 172.21.15.49:0/2587782308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b1406d920 msgr2=0x7f9b1414f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:16.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b13400640 1 --2- 172.21.15.49:0/2587782308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b1406d920 0x7f9b1414f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:16.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b13400640 1 -- 172.21.15.49:0/2587782308 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc0094d0 con 0x7f9b1415d510 2024-01-31T05:05:16.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b12000640 1 --2- 172.21.15.49:0/2587782308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b140b4b20 0x7f9b1415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:16.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b13400640 1 --2- 172.21.15.49:0/2587782308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b1415d510 0x7f9b140b0c50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c007e10 tx=0x7f9b0c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:16.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b0b400640 1 -- 172.21.15.49:0/2587782308 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c003ba0 con 0x7f9b1415d510 2024-01-31T05:05:16.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b0b400640 1 -- 172.21.15.49:0/2587782308 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0c00f040 con 0x7f9b1415d510 2024-01-31T05:05:16.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b0b400640 1 -- 172.21.15.49:0/2587782308 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c00de80 con 0x7f9b1415d510 2024-01-31T05:05:16.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b19e00640 1 -- 172.21.15.49:0/2587782308 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1415cce0 con 0x7f9b1415d510 2024-01-31T05:05:16.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.845+0000 7f9b19e00640 1 -- 172.21.15.49:0/2587782308 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1414f5b0 con 0x7f9b1415d510 2024-01-31T05:05:16.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.849+0000 7f9b19e00640 1 -- 172.21.15.49:0/2587782308 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1406c770 con 0x7f9b1415d510 2024-01-31T05:05:16.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.849+0000 7f9b0b400640 1 -- 172.21.15.49:0/2587782308 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f9b0c004030 con 0x7f9b1415d510 2024-01-31T05:05:16.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.849+0000 7f9b0b400640 1 --2- 172.21.15.49:0/2587782308 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9aec066500 0x7f9aec0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:16.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.849+0000 7f9b0b400640 1 -- 172.21.15.49:0/2587782308 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9b0c084500 con 0x7f9b1415d510 2024-01-31T05:05:16.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.849+0000 7f9b12a00640 1 --2- 172.21.15.49:0/2587782308 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9aec066500 0x7f9aec0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:16.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.853+0000 7f9b12a00640 1 --2- 172.21.15.49:0/2587782308 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9aec066500 0x7f9aec0689c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9b1415ff20 tx=0x7f9b04009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:16.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:16.853+0000 7f9b0b400640 1 -- 172.21.15.49:0/2587782308 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9b0c051480 con 0x7f9b1415d510 2024-01-31T05:05:17.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.013+0000 7f9b19e00640 1 -- 172.21.15.49:0/2587782308 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b14074860 con 0x7f9b1415d510 2024-01-31T05:05:17.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.017+0000 7f9b0b400640 1 -- 172.21.15.49:0/2587782308 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b0c054aa0 con 0x7f9b1415d510 2024-01-31T05:05:17.016 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:05:17.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.017+0000 7f9b19e00640 1 -- 172.21.15.49:0/2587782308 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9aec066500 msgr2=0x7f9aec0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:17.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.017+0000 7f9b19e00640 1 --2- 172.21.15.49:0/2587782308 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9aec066500 0x7f9aec0689c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9b1415ff20 tx=0x7f9b04009190 comp rx=0 tx=0).stop 2024-01-31T05:05:17.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.017+0000 7f9b19e00640 1 -- 172.21.15.49:0/2587782308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b1415d510 msgr2=0x7f9b140b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:17.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.017+0000 7f9b19e00640 1 --2- 172.21.15.49:0/2587782308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b1415d510 0x7f9b140b0c50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c007e10 tx=0x7f9b0c00d4a0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.017+0000 7f9b19e00640 1 -- 172.21.15.49:0/2587782308 shutdown_connections 2024-01-31T05:05:17.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.017+0000 7f9b19e00640 1 --2- 172.21.15.49:0/2587782308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b1415d510 0x7f9b140b0c50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.017+0000 7f9b19e00640 1 --2- 172.21.15.49:0/2587782308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b140b4b20 0x7f9b1415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.017+0000 7f9b19e00640 1 --2- 172.21.15.49:0/2587782308 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9aec066500 0x7f9aec0689c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.017+0000 7f9b19e00640 1 --2- 172.21.15.49:0/2587782308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b1406d920 0x7f9b1414f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.017+0000 7f9b19e00640 1 -- 172.21.15.49:0/2587782308 >> 172.21.15.49:0/2587782308 conn(0x7f9b140b1ab0 msgr2=0x7f9b140cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:17.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.017+0000 7f9b19e00640 1 -- 172.21.15.49:0/2587782308 shutdown_connections 2024-01-31T05:05:17.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.017+0000 7f9b19e00640 1 -- 172.21.15.49:0/2587782308 wait complete. 2024-01-31T05:05:17.038 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:05:17.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.181+0000 7fef63000640 1 Processor -- start 2024-01-31T05:05:17.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.181+0000 7fef63000640 1 -- start start 2024-01-31T05:05:17.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef63000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef5c0cdf10 0x7fef5c070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:17.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef63000640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5c15b4f0 con 0x7fef5c15b110 2024-01-31T05:05:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef63000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5c0abf20 con 0x7fef5c0ce610 2024-01-31T05:05:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef63000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c0ce460 con 0x7fef5c0cdf10 2024-01-31T05:05:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5be00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fef5c15b110 0x7fef5c06c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59250/0 (socket says 172.21.15.49:59250) 2024-01-31T05:05:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5be00640 1 -- 172.21.15.49:0/3756362 learned_addr learned my addr 172.21.15.49:0/3756362 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5b400640 1 --2- 172.21.15.49:0/3756362 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef5c0cdf10 0x7fef5c070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5aa00640 1 -- 172.21.15.49:0/3756362 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203436161 0 0) 0x7fef4c001120 con 0x7fef5c15b110 2024-01-31T05:05:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5aa00640 1 -- 172.21.15.49:0/3756362 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef3c003530 con 0x7fef5c15b110 2024-01-31T05:05:17.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5aa00640 1 -- 172.21.15.49:0/3756362 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2856785502 0 0) 0x7fef3c003530 con 0x7fef5c15b110 2024-01-31T05:05:17.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5aa00640 1 -- 172.21.15.49:0/3756362 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef5c0cdf10 msgr2=0x7fef5c070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:17.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5aa00640 1 --2- 172.21.15.49:0/3756362 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef5c0cdf10 0x7fef5c070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5aa00640 1 -- 172.21.15.49:0/3756362 >> v1:172.21.15.195:6789/0 conn(0x7fef5c0ce610 legacy=0x7fef5c0ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:17.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5aa00640 1 -- 172.21.15.49:0/3756362 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c0ac200 con 0x7fef5c15b110 2024-01-31T05:05:17.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5aa00640 1 -- 172.21.15.49:0/3756362 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7fef4c001810 con 0x7fef5c15b110 2024-01-31T05:05:17.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5aa00640 1 -- 172.21.15.49:0/3756362 >> v1:172.21.15.49:6789/0 conn(0x7fef5c15b110 legacy=0x7fef5c06c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:17.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5aa00640 1 --2- 172.21.15.49:0/3756362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef3c0039b0 0x7fef3c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:17.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5aa00640 1 --2- 172.21.15.49:0/3756362 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef5c0cdf10 0x7fef3c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:17.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5aa00640 1 --2- 172.21.15.49:0/3756362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef3c004d10 0x7fef3c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:17.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5aa00640 1 -- 172.21.15.49:0/3756362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c0ce460 con 0x7fef3c0039b0 2024-01-31T05:05:17.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5aa00640 1 -- 172.21.15.49:0/3756362 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c00ba40 con 0x7fef3c004d10 2024-01-31T05:05:17.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5aa00640 1 -- 172.21.15.49:0/3756362 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c00bbb0 con 0x7fef5c0cdf10 2024-01-31T05:05:17.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5be00640 1 --2- 172.21.15.49:0/3756362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef3c0039b0 0x7fef3c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:17.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5b400640 1 --2- 172.21.15.49:0/3756362 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef5c0cdf10 0x7fef3c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:17.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef61000640 1 --2- 172.21.15.49:0/3756362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef3c004d10 0x7fef3c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:17.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5be00640 1 -- 172.21.15.49:0/3756362 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef5c0cdf10 msgr2=0x7fef3c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:17.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5be00640 1 --2- 172.21.15.49:0/3756362 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef5c0cdf10 0x7fef3c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5be00640 1 -- 172.21.15.49:0/3756362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef3c004d10 msgr2=0x7fef3c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:17.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5be00640 1 --2- 172.21.15.49:0/3756362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef3c004d10 0x7fef3c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.185+0000 7fef5be00640 1 -- 172.21.15.49:0/3756362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c003530 con 0x7fef3c0039b0 2024-01-31T05:05:17.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.189+0000 7fef5be00640 1 --2- 172.21.15.49:0/3756362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef3c0039b0 0x7fef3c003d90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00c110 tx=0x7fef4c01cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5912923e403561f server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:17.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.189+0000 7fef5aa00640 1 -- 172.21.15.49:0/3756362 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c005ae0 con 0x7fef3c0039b0 2024-01-31T05:05:17.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.189+0000 7fef5aa00640 1 -- 172.21.15.49:0/3756362 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c005c40 con 0x7fef3c0039b0 2024-01-31T05:05:17.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.189+0000 7fef5aa00640 1 -- 172.21.15.49:0/3756362 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c0a59a0 con 0x7fef3c0039b0 2024-01-31T05:05:17.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.189+0000 7fef63000640 1 -- 172.21.15.49:0/3756362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef3c0039b0 msgr2=0x7fef3c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:17.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.189+0000 7fef63000640 1 --2- 172.21.15.49:0/3756362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef3c0039b0 0x7fef3c003d90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00c110 tx=0x7fef4c01cb70 comp rx=0 tx=0).stop 2024-01-31T05:05:17.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.189+0000 7fef61000640 1 -- 172.21.15.49:0/3756362 reap_dead start 2024-01-31T05:05:17.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.189+0000 7fef63000640 1 -- 172.21.15.49:0/3756362 shutdown_connections 2024-01-31T05:05:17.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.189+0000 7fef63000640 1 -- 172.21.15.49:0/3756362 >> 172.21.15.49:0/3756362 conn(0x7fef5c0b09a0 msgr2=0x7fef5c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:17.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.189+0000 7fef63000640 1 -- 172.21.15.49:0/3756362 shutdown_connections 2024-01-31T05:05:17.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.189+0000 7fef63000640 1 -- 172.21.15.49:0/3756362 wait complete. 2024-01-31T05:05:17.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.189+0000 7fef63000640 1 Processor -- start 2024-01-31T05:05:17.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.189+0000 7fef63000640 1 -- start start 2024-01-31T05:05:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef63000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef3c0039b0 0x7fef5c09c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef63000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef5c099a50 0x7fef5c159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef63000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef5c09a3c0 0x7fef5c09a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef63000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c09ad80 con 0x7fef5c099a50 2024-01-31T05:05:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef63000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c09c8b0 con 0x7fef5c09a3c0 2024-01-31T05:05:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef63000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c153090 con 0x7fef3c0039b0 2024-01-31T05:05:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef5b400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef5c099a50 0x7fef5c159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef5b400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef5c099a50 0x7fef5c159860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52878/0 (socket says 172.21.15.49:52878) 2024-01-31T05:05:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef5b400640 1 -- 172.21.15.49:0/1305843012 learned_addr learned my addr 172.21.15.49:0/1305843012 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef61000640 1 --2- 172.21.15.49:0/1305843012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef5c09a3c0 0x7fef5c09a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef5be00640 1 --2- 172.21.15.49:0/1305843012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef3c0039b0 0x7fef5c09c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef5b400640 1 -- 172.21.15.49:0/1305843012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef3c0039b0 msgr2=0x7fef5c09c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef5b400640 1 --2- 172.21.15.49:0/1305843012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef3c0039b0 0x7fef5c09c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef5b400640 1 -- 172.21.15.49:0/1305843012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef5c09a3c0 msgr2=0x7fef5c09a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef5b400640 1 --2- 172.21.15.49:0/1305843012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef5c09a3c0 0x7fef5c09a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef5b400640 1 -- 172.21.15.49:0/1305843012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c1540d0 con 0x7fef5c099a50 2024-01-31T05:05:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef61000640 1 --2- 172.21.15.49:0/1305843012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef5c09a3c0 0x7fef5c09a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef5be00640 1 --2- 172.21.15.49:0/1305843012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef3c0039b0 0x7fef5c09c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef5b400640 1 --2- 172.21.15.49:0/1305843012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef5c099a50 0x7fef5c159860 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fef44011a30 tx=0x7fef44011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef53e00640 1 -- 172.21.15.49:0/1305843012 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4400fb50 con 0x7fef5c099a50 2024-01-31T05:05:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef53e00640 1 -- 172.21.15.49:0/1305843012 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4400fcb0 con 0x7fef5c099a50 2024-01-31T05:05:17.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef63000640 1 -- 172.21.15.49:0/1305843012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5c154970 con 0x7fef5c099a50 2024-01-31T05:05:17.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef53e00640 1 -- 172.21.15.49:0/1305843012 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44014440 con 0x7fef5c099a50 2024-01-31T05:05:17.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef63000640 1 -- 172.21.15.49:0/1305843012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5c1532e0 con 0x7fef5c099a50 2024-01-31T05:05:17.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.193+0000 7fef63000640 1 -- 172.21.15.49:0/1305843012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5c154b00 con 0x7fef5c099a50 2024-01-31T05:05:17.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.197+0000 7fef53e00640 1 -- 172.21.15.49:0/1305843012 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fef440145a0 con 0x7fef5c099a50 2024-01-31T05:05:17.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.197+0000 7fef53e00640 1 --2- 172.21.15.49:0/1305843012 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fef34066530 0x7fef340689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:17.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.197+0000 7fef53e00640 1 -- 172.21.15.49:0/1305843012 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fef440849c0 con 0x7fef5c099a50 2024-01-31T05:05:17.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.197+0000 7fef5be00640 1 --2- 172.21.15.49:0/1305843012 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fef34066530 0x7fef340689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:17.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.197+0000 7fef5be00640 1 --2- 172.21.15.49:0/1305843012 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fef34066530 0x7fef340689f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0ab000 tx=0x7fef4c0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:17.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.201+0000 7fef53e00640 1 -- 172.21.15.49:0/1305843012 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fef44051960 con 0x7fef5c099a50 2024-01-31T05:05:17.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.357+0000 7fef63000640 1 -- 172.21.15.49:0/1305843012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fef5c0b17d0 con 0x7fef5c099a50 2024-01-31T05:05:17.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.357+0000 7fef53e00640 1 -- 172.21.15.49:0/1305843012 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fef44054f80 con 0x7fef5c099a50 2024-01-31T05:05:17.359 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:17.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.361+0000 7fef63000640 1 -- 172.21.15.49:0/1305843012 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fef34066530 msgr2=0x7fef340689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:17.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.361+0000 7fef63000640 1 --2- 172.21.15.49:0/1305843012 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fef34066530 0x7fef340689f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0ab000 tx=0x7fef4c0a7070 comp rx=0 tx=0).stop 2024-01-31T05:05:17.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.361+0000 7fef63000640 1 -- 172.21.15.49:0/1305843012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef5c099a50 msgr2=0x7fef5c159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:17.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.361+0000 7fef63000640 1 --2- 172.21.15.49:0/1305843012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef5c099a50 0x7fef5c159860 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fef44011a30 tx=0x7fef44011ef0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.361+0000 7fef63000640 1 -- 172.21.15.49:0/1305843012 shutdown_connections 2024-01-31T05:05:17.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.361+0000 7fef63000640 1 --2- 172.21.15.49:0/1305843012 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fef34066530 0x7fef340689f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.361+0000 7fef63000640 1 --2- 172.21.15.49:0/1305843012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef5c09a3c0 0x7fef5c09a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.361+0000 7fef63000640 1 --2- 172.21.15.49:0/1305843012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef5c099a50 0x7fef5c159860 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.361+0000 7fef63000640 1 --2- 172.21.15.49:0/1305843012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef3c0039b0 0x7fef5c09c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.361+0000 7fef63000640 1 -- 172.21.15.49:0/1305843012 >> 172.21.15.49:0/1305843012 conn(0x7fef5c0b09a0 msgr2=0x7fef5c15fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:17.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.361+0000 7fef63000640 1 -- 172.21.15.49:0/1305843012 shutdown_connections 2024-01-31T05:05:17.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.361+0000 7fef63000640 1 -- 172.21.15.49:0/1305843012 wait complete. 2024-01-31T05:05:17.381 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:05:17.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.525+0000 7f20eea00640 1 Processor -- start 2024-01-31T05:05:17.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.525+0000 7f20eea00640 1 -- start start 2024-01-31T05:05:17.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.525+0000 7f20eea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e815b110 0x7f20e806c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:17.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.525+0000 7f20eea00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e815b4f0 con 0x7f20e80cdf10 2024-01-31T05:05:17.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.525+0000 7f20eea00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e80abf20 con 0x7f20e80714e0 2024-01-31T05:05:17.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.525+0000 7f20eea00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e80ce460 con 0x7f20e815b110 2024-01-31T05:05:17.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.525+0000 7f20e7400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f20e80cdf10 0x7f20e8070dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59252/0 (socket says 172.21.15.49:59252) 2024-01-31T05:05:17.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.525+0000 7f20e7400640 1 -- 172.21.15.49:0/3516623801 learned_addr learned my addr 172.21.15.49:0/3516623801 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:17.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.525+0000 7f20e7e00640 1 --2- 172.21.15.49:0/3516623801 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e815b110 0x7f20e806c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:17.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.529+0000 7f20e6a00640 1 -- 172.21.15.49:0/3516623801 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745155717 0 0) 0x7f20d0001120 con 0x7f20e80cdf10 2024-01-31T05:05:17.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.529+0000 7f20e6a00640 1 -- 172.21.15.49:0/3516623801 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20c8003530 con 0x7f20e80cdf10 2024-01-31T05:05:17.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.529+0000 7f20e6a00640 1 -- 172.21.15.49:0/3516623801 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910221083 0 0) 0x7f20e80abf20 con 0x7f20e80714e0 2024-01-31T05:05:17.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.529+0000 7f20e6a00640 1 -- 172.21.15.49:0/3516623801 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20d0001120 con 0x7f20e80714e0 2024-01-31T05:05:17.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.529+0000 7f20e7e00640 1 -- 172.21.15.49:0/3516623801 >> v1:172.21.15.195:6789/0 conn(0x7f20e80714e0 legacy=0x7f20e80ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:17.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.529+0000 7f20e7e00640 1 -- 172.21.15.49:0/3516623801 >> v1:172.21.15.49:6789/0 conn(0x7f20e80cdf10 legacy=0x7f20e8070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:17.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.529+0000 7f20e7e00640 1 -- 172.21.15.49:0/3516623801 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e80ac200 con 0x7f20e815b110 2024-01-31T05:05:17.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.529+0000 7f20e7e00640 1 --2- 172.21.15.49:0/3516623801 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e815b110 0x7f20e806c2d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f20d80097f0 tx=0x7f20d801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c9965024309e666 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:17.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.529+0000 7f20e6a00640 1 -- 172.21.15.49:0/3516623801 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d80ac600 con 0x7f20e815b110 2024-01-31T05:05:17.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.529+0000 7f20e6a00640 1 -- 172.21.15.49:0/3516623801 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d80a8050 con 0x7f20e815b110 2024-01-31T05:05:17.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.529+0000 7f20e6a00640 1 -- 172.21.15.49:0/3516623801 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d80ac980 con 0x7f20e815b110 2024-01-31T05:05:17.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.533+0000 7f20eea00640 1 -- 172.21.15.49:0/3516623801 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e815b110 msgr2=0x7f20e806c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:17.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.533+0000 7f20eea00640 1 --2- 172.21.15.49:0/3516623801 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e815b110 0x7f20e806c2d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f20d80097f0 tx=0x7f20d801c490 comp rx=0 tx=0).stop 2024-01-31T05:05:17.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.533+0000 7f20eea00640 1 -- 172.21.15.49:0/3516623801 shutdown_connections 2024-01-31T05:05:17.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.533+0000 7f20eea00640 1 --2- 172.21.15.49:0/3516623801 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e815b110 0x7f20e806c2d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.533+0000 7f20eea00640 1 -- 172.21.15.49:0/3516623801 >> 172.21.15.49:0/3516623801 conn(0x7f20e80b09a0 msgr2=0x7f20e80b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.533+0000 7f20eea00640 1 -- 172.21.15.49:0/3516623801 shutdown_connections 2024-01-31T05:05:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.533+0000 7f20eea00640 1 -- 172.21.15.49:0/3516623801 wait complete. 2024-01-31T05:05:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.533+0000 7f20eea00640 1 Processor -- start 2024-01-31T05:05:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.533+0000 7f20eea00640 1 -- start start 2024-01-31T05:05:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.533+0000 7f20eea00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20e80714e0 0x7f20e814b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.533+0000 7f20eea00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20e80cdf10 0x7f20e814bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.533+0000 7f20eea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e815b110 0x7f20e8145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:17.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.533+0000 7f20eea00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e815c0f0 con 0x7f20e80714e0 2024-01-31T05:05:17.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.533+0000 7f20eea00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e8148ff0 con 0x7f20e80cdf10 2024-01-31T05:05:17.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.533+0000 7f20eea00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e8148a30 con 0x7f20e815b110 2024-01-31T05:05:17.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.533+0000 7f20e7e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20e80714e0 0x7f20e814b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:17.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.533+0000 7f20e7e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20e80714e0 0x7f20e814b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52886/0 (socket says 172.21.15.49:52886) 2024-01-31T05:05:17.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.533+0000 7f20e7e00640 1 -- 172.21.15.49:0/3470789530 learned_addr learned my addr 172.21.15.49:0/3470789530 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:17.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.533+0000 7f20e7400640 1 --2- 172.21.15.49:0/3470789530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20e80cdf10 0x7f20e814bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:17.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.537+0000 7f20eca00640 1 --2- 172.21.15.49:0/3470789530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e815b110 0x7f20e8145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:17.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.537+0000 7f20e7e00640 1 -- 172.21.15.49:0/3470789530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e815b110 msgr2=0x7f20e8145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:17.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.537+0000 7f20e7e00640 1 --2- 172.21.15.49:0/3470789530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e815b110 0x7f20e8145ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.537+0000 7f20e7e00640 1 -- 172.21.15.49:0/3470789530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20e80cdf10 msgr2=0x7f20e814bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:17.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.537+0000 7f20e7e00640 1 --2- 172.21.15.49:0/3470789530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20e80cdf10 0x7f20e814bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.537+0000 7f20e7e00640 1 -- 172.21.15.49:0/3470789530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d8009420 con 0x7f20e80714e0 2024-01-31T05:05:17.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.537+0000 7f20e7e00640 1 --2- 172.21.15.49:0/3470789530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20e80714e0 0x7f20e814b7d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f20d80190a0 tx=0x7f20d8019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:17.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.537+0000 7f20dfe00640 1 -- 172.21.15.49:0/3470789530 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d80b6470 con 0x7f20e80714e0 2024-01-31T05:05:17.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.537+0000 7f20dfe00640 1 -- 172.21.15.49:0/3470789530 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d80b65f0 con 0x7f20e80714e0 2024-01-31T05:05:17.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.537+0000 7f20dfe00640 1 -- 172.21.15.49:0/3470789530 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d80b69a0 con 0x7f20e80714e0 2024-01-31T05:05:17.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.537+0000 7f20eea00640 1 -- 172.21.15.49:0/3470789530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e8148d10 con 0x7f20e80714e0 2024-01-31T05:05:17.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.537+0000 7f20eea00640 1 -- 172.21.15.49:0/3470789530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e814e080 con 0x7f20e80714e0 2024-01-31T05:05:17.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.537+0000 7f20eea00640 1 -- 172.21.15.49:0/3470789530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e8149160 con 0x7f20e80714e0 2024-01-31T05:05:17.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.537+0000 7f20dfe00640 1 -- 172.21.15.49:0/3470789530 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f20d80b3040 con 0x7f20e80714e0 2024-01-31T05:05:17.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.537+0000 7f20dfe00640 1 --2- 172.21.15.49:0/3470789530 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f20c0066500 0x7f20c00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:17.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.537+0000 7f20dfe00640 1 -- 172.21.15.49:0/3470789530 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f20d811e4c0 con 0x7f20e80714e0 2024-01-31T05:05:17.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.541+0000 7f20e7400640 1 --2- 172.21.15.49:0/3470789530 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f20c0066500 0x7f20c00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:17.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.541+0000 7f20e7400640 1 --2- 172.21.15.49:0/3470789530 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f20c0066500 0x7f20c00689c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f20e81484c0 tx=0x7f20d0007d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:17.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.541+0000 7f20dfe00640 1 -- 172.21.15.49:0/3470789530 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f20d80eb4e0 con 0x7f20e80714e0 2024-01-31T05:05:17.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.701+0000 7f20eea00640 1 -- 172.21.15.49:0/3470789530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20e8074860 con 0x7f20e80714e0 2024-01-31T05:05:17.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.701+0000 7f20dfe00640 1 -- 172.21.15.49:0/3470789530 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f20d80eeb00 con 0x7f20e80714e0 2024-01-31T05:05:17.703 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-31T05:05:17.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.705+0000 7f20eea00640 1 -- 172.21.15.49:0/3470789530 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f20c0066500 msgr2=0x7f20c00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:17.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.705+0000 7f20eea00640 1 --2- 172.21.15.49:0/3470789530 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f20c0066500 0x7f20c00689c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f20e81484c0 tx=0x7f20d0007d80 comp rx=0 tx=0).stop 2024-01-31T05:05:17.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.705+0000 7f20eea00640 1 -- 172.21.15.49:0/3470789530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20e80714e0 msgr2=0x7f20e814b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:17.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.705+0000 7f20eea00640 1 --2- 172.21.15.49:0/3470789530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20e80714e0 0x7f20e814b7d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f20d80190a0 tx=0x7f20d8019230 comp rx=0 tx=0).stop 2024-01-31T05:05:17.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.705+0000 7f20eea00640 1 -- 172.21.15.49:0/3470789530 shutdown_connections 2024-01-31T05:05:17.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.705+0000 7f20eea00640 1 --2- 172.21.15.49:0/3470789530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e815b110 0x7f20e8145ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.705+0000 7f20eea00640 1 --2- 172.21.15.49:0/3470789530 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f20c0066500 0x7f20c00689c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.705+0000 7f20eea00640 1 --2- 172.21.15.49:0/3470789530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20e80cdf10 0x7f20e814bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.705+0000 7f20eea00640 1 --2- 172.21.15.49:0/3470789530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20e80714e0 0x7f20e814b7d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.705+0000 7f20eea00640 1 -- 172.21.15.49:0/3470789530 >> 172.21.15.49:0/3470789530 conn(0x7f20e80b09a0 msgr2=0x7f20e8099b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:17.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.705+0000 7f20eea00640 1 -- 172.21.15.49:0/3470789530 shutdown_connections 2024-01-31T05:05:17.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.705+0000 7f20eea00640 1 -- 172.21.15.49:0/3470789530 wait complete. 2024-01-31T05:05:17.724 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-31T05:05:17.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.865+0000 7f88a3c00640 1 Processor -- start 2024-01-31T05:05:17.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.865+0000 7f88a3c00640 1 -- start start 2024-01-31T05:05:17.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.869+0000 7f88a3c00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f889c159790 0x7f889c0b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:17.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.869+0000 7f88a3c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f889c0b3d00 0x7f889c070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:17.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.869+0000 7f88a3c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889c159b70 con 0x7f889c070ba0 2024-01-31T05:05:17.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.869+0000 7f88a3c00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f889c071030 con 0x7f889c159790 2024-01-31T05:05:17.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.869+0000 7f88a3c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c0b2750 con 0x7f889c0b3d00 2024-01-31T05:05:17.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.869+0000 7f88a1200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f889c159790 0x7f889c0b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:17.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.869+0000 7f88a1200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f889c159790 0x7f889c0b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52892/0 (socket says 172.21.15.49:52892) 2024-01-31T05:05:17.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.869+0000 7f88a1200640 1 -- 172.21.15.49:0/1687332503 learned_addr learned my addr 172.21.15.49:0/1687332503 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:17.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.869+0000 7f88a1200640 1 -- 172.21.15.49:0/1687332503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f889c0b3d00 msgr2=0x7f889c070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:17.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.869+0000 7f88a1200640 1 --2- 172.21.15.49:0/1687332503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f889c0b3d00 0x7f889c070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.869+0000 7f88a1200640 1 -- 172.21.15.49:0/1687332503 >> v1:172.21.15.195:6789/0 conn(0x7f889c070ba0 legacy=0x7f889c06cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:17.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.869+0000 7f88a1200640 1 -- 172.21.15.49:0/1687332503 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c0b2a30 con 0x7f889c159790 2024-01-31T05:05:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.873+0000 7f88a1200640 1 --2- 172.21.15.49:0/1687332503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f889c159790 0x7f889c0b37c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f888c009870 tx=0x7f888c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29839b165867c43d server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.873+0000 7f889b400640 1 -- 172.21.15.49:0/1687332503 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c0aa5f0 con 0x7f889c159790 2024-01-31T05:05:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.873+0000 7f889b400640 1 -- 172.21.15.49:0/1687332503 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c0aa750 con 0x7f889c159790 2024-01-31T05:05:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.873+0000 7f889b400640 1 -- 172.21.15.49:0/1687332503 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c0aaae0 con 0x7f889c159790 2024-01-31T05:05:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.873+0000 7f88a3c00640 1 -- 172.21.15.49:0/1687332503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f889c159790 msgr2=0x7f889c0b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.873+0000 7f88a3c00640 1 --2- 172.21.15.49:0/1687332503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f889c159790 0x7f889c0b37c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f888c009870 tx=0x7f888c01c4d0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.873+0000 7f88a3c00640 1 -- 172.21.15.49:0/1687332503 shutdown_connections 2024-01-31T05:05:17.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.873+0000 7f88a3c00640 1 --2- 172.21.15.49:0/1687332503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f889c0b3d00 0x7f889c070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.873+0000 7f88a3c00640 1 --2- 172.21.15.49:0/1687332503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f889c159790 0x7f889c0b37c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.873+0000 7f88a3c00640 1 -- 172.21.15.49:0/1687332503 >> 172.21.15.49:0/1687332503 conn(0x7f889c0b09a0 msgr2=0x7f889c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:17.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.873+0000 7f88a3c00640 1 -- 172.21.15.49:0/1687332503 shutdown_connections 2024-01-31T05:05:17.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.873+0000 7f88a3c00640 1 -- 172.21.15.49:0/1687332503 wait complete. 2024-01-31T05:05:17.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.873+0000 7f88a3c00640 1 Processor -- start 2024-01-31T05:05:17.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a3c00640 1 -- start start 2024-01-31T05:05:17.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a3c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f889c070ba0 0x7f889c0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:17.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a3c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f889c0b3d00 0x7f889c0ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:17.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a3c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f889c159790 0x7f889c0ad470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:17.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a3c00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c0ce660 con 0x7f889c070ba0 2024-01-31T05:05:17.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a3c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c15ae00 con 0x7f889c159790 2024-01-31T05:05:17.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a3c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c15bc20 con 0x7f889c0b3d00 2024-01-31T05:05:17.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a1200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f889c070ba0 0x7f889c0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:17.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a1200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f889c070ba0 0x7f889c0cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52908/0 (socket says 172.21.15.49:52908) 2024-01-31T05:05:17.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a1200640 1 -- 172.21.15.49:0/2674448305 learned_addr learned my addr 172.21.15.49:0/2674448305 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:17.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f889be00640 1 --2- 172.21.15.49:0/2674448305 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f889c0b3d00 0x7f889c0ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:17.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a1c00640 1 --2- 172.21.15.49:0/2674448305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f889c159790 0x7f889c0ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:17.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a1200640 1 -- 172.21.15.49:0/2674448305 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f889c0b3d00 msgr2=0x7f889c0ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:17.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a1200640 1 --2- 172.21.15.49:0/2674448305 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f889c0b3d00 0x7f889c0ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a1200640 1 -- 172.21.15.49:0/2674448305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f889c159790 msgr2=0x7f889c0ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:17.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a1200640 1 --2- 172.21.15.49:0/2674448305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f889c159790 0x7f889c0ad470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:17.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a1200640 1 -- 172.21.15.49:0/2674448305 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c0094d0 con 0x7f889c070ba0 2024-01-31T05:05:17.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a1200640 1 --2- 172.21.15.49:0/2674448305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f889c070ba0 0x7f889c0cc780 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f888c0ac040 tx=0x7f888c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:17.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f8898c00640 1 -- 172.21.15.49:0/2674448305 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c0b3800 con 0x7f889c070ba0 2024-01-31T05:05:17.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f8898c00640 1 -- 172.21.15.49:0/2674448305 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c0b3980 con 0x7f889c070ba0 2024-01-31T05:05:17.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f8898c00640 1 -- 172.21.15.49:0/2674448305 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c0b3d30 con 0x7f889c070ba0 2024-01-31T05:05:17.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a3c00640 1 -- 172.21.15.49:0/2674448305 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889c15b010 con 0x7f889c070ba0 2024-01-31T05:05:17.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a3c00640 1 -- 172.21.15.49:0/2674448305 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889c15b5d0 con 0x7f889c070ba0 2024-01-31T05:05:17.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.877+0000 7f88a3c00640 1 -- 172.21.15.49:0/2674448305 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889c074860 con 0x7f889c070ba0 2024-01-31T05:05:17.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.881+0000 7f8898c00640 1 -- 172.21.15.49:0/2674448305 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f888c0c6390 con 0x7f889c070ba0 2024-01-31T05:05:17.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.881+0000 7f8898c00640 1 --2- 172.21.15.49:0/2674448305 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8874066500 0x7f88740689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:17.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.881+0000 7f8898c00640 1 -- 172.21.15.49:0/2674448305 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f888c0a7070 con 0x7f889c070ba0 2024-01-31T05:05:17.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.881+0000 7f889be00640 1 --2- 172.21.15.49:0/2674448305 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8874066500 0x7f88740689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:17.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.881+0000 7f889be00640 1 --2- 172.21.15.49:0/2674448305 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8874066500 0x7f88740689c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f889c0cccc0 tx=0x7f8884009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:17.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:17.885+0000 7f8898c00640 1 -- 172.21.15.49:0/2674448305 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f888c0ebc70 con 0x7f889c070ba0 2024-01-31T05:05:18.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.041+0000 7f88a3c00640 1 -- 172.21.15.49:0/2674448305 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f889c0b3ac0 con 0x7f889c070ba0 2024-01-31T05:05:18.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.041+0000 7f8898c00640 1 -- 172.21.15.49:0/2674448305 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f888c0ef290 con 0x7f889c070ba0 2024-01-31T05:05:18.044 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:18.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.045+0000 7f88a3c00640 1 -- 172.21.15.49:0/2674448305 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8874066500 msgr2=0x7f88740689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:18.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.045+0000 7f88a3c00640 1 --2- 172.21.15.49:0/2674448305 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8874066500 0x7f88740689c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f889c0cccc0 tx=0x7f8884009110 comp rx=0 tx=0).stop 2024-01-31T05:05:18.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.045+0000 7f88a3c00640 1 -- 172.21.15.49:0/2674448305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f889c070ba0 msgr2=0x7f889c0cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:18.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.045+0000 7f88a3c00640 1 --2- 172.21.15.49:0/2674448305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f889c070ba0 0x7f889c0cc780 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f888c0ac040 tx=0x7f888c01ad10 comp rx=0 tx=0).stop 2024-01-31T05:05:18.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.045+0000 7f88a3c00640 1 -- 172.21.15.49:0/2674448305 shutdown_connections 2024-01-31T05:05:18.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.045+0000 7f88a3c00640 1 --2- 172.21.15.49:0/2674448305 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8874066500 0x7f88740689c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.045+0000 7f88a3c00640 1 --2- 172.21.15.49:0/2674448305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f889c159790 0x7f889c0ad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.045+0000 7f88a3c00640 1 --2- 172.21.15.49:0/2674448305 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f889c0b3d00 0x7f889c0ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.045+0000 7f88a3c00640 1 --2- 172.21.15.49:0/2674448305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f889c070ba0 0x7f889c0cc780 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.045+0000 7f88a3c00640 1 -- 172.21.15.49:0/2674448305 >> 172.21.15.49:0/2674448305 conn(0x7f889c0b09a0 msgr2=0x7f889c14d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:18.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.045+0000 7f88a3c00640 1 -- 172.21.15.49:0/2674448305 shutdown_connections 2024-01-31T05:05:18.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.045+0000 7f88a3c00640 1 -- 172.21.15.49:0/2674448305 wait complete. 2024-01-31T05:05:18.065 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-31T05:05:18.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.205+0000 7f0cf1e00640 1 Processor -- start 2024-01-31T05:05:18.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.205+0000 7f0cf1e00640 1 -- start start 2024-01-31T05:05:18.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.209+0000 7f0cf1e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0cec0cd0c0 0x7f0cec0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:18.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.209+0000 7f0cf1e00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cec0ce0e0 con 0x7f0cec0cf0f0 2024-01-31T05:05:18.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.209+0000 7f0cf1e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cec161c80 con 0x7f0cec0cdcb0 2024-01-31T05:05:18.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.209+0000 7f0cf1e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0d02e0 con 0x7f0cec0cd0c0 2024-01-31T05:05:18.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.209+0000 7f0cea000640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f0cec0cf0f0 0x7f0cec160e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:59268/0 (socket says 172.21.15.49:59268) 2024-01-31T05:05:18.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.209+0000 7f0cea000640 1 -- 172.21.15.49:0/339210179 learned_addr learned my addr 172.21.15.49:0/339210179 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:18.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.209+0000 7f0ceaa00640 1 --2- 172.21.15.49:0/339210179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0cec0cd0c0 0x7f0cec0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:18.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.209+0000 7f0ce9600640 1 -- 172.21.15.49:0/339210179 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103047529 0 0) 0x7f0cec0ce0e0 con 0x7f0cec0cf0f0 2024-01-31T05:05:18.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.209+0000 7f0ce9600640 1 -- 172.21.15.49:0/339210179 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ccc003530 con 0x7f0cec0cf0f0 2024-01-31T05:05:18.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.209+0000 7f0ce9600640 1 -- 172.21.15.49:0/339210179 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 472123415 0 0) 0x7f0ccc003530 con 0x7f0cec0cf0f0 2024-01-31T05:05:18.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.209+0000 7f0ceaa00640 1 -- 172.21.15.49:0/339210179 >> v1:172.21.15.195:6789/0 conn(0x7f0cec0cdcb0 legacy=0x7f0cec161570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:18.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.209+0000 7f0ceaa00640 1 -- 172.21.15.49:0/339210179 >> v1:172.21.15.49:6789/0 conn(0x7f0cec0cf0f0 legacy=0x7f0cec160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:18.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.209+0000 7f0ceaa00640 1 -- 172.21.15.49:0/339210179 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec0cf660 con 0x7f0cec0cd0c0 2024-01-31T05:05:18.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.213+0000 7f0ceaa00640 1 --2- 172.21.15.49:0/339210179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0cec0cd0c0 0x7f0cec0cd770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0097f0 tx=0x7f0cdc01c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1340dc0e415b5d18 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:18.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.213+0000 7f0ce9600640 1 -- 172.21.15.49:0/339210179 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd4001680 con 0x7f0cec0cd0c0 2024-01-31T05:05:18.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.213+0000 7f0ce9600640 1 -- 172.21.15.49:0/339210179 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc0a7050 con 0x7f0cec0cd0c0 2024-01-31T05:05:18.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.213+0000 7f0ce9600640 1 -- 172.21.15.49:0/339210179 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc0ab620 con 0x7f0cec0cd0c0 2024-01-31T05:05:18.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.213+0000 7f0cf1e00640 1 -- 172.21.15.49:0/339210179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0cec0cd0c0 msgr2=0x7f0cec0cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:18.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.213+0000 7f0cf1e00640 1 --2- 172.21.15.49:0/339210179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0cec0cd0c0 0x7f0cec0cd770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0097f0 tx=0x7f0cdc01c320 comp rx=0 tx=0).stop 2024-01-31T05:05:18.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.213+0000 7f0cf1e00640 1 -- 172.21.15.49:0/339210179 shutdown_connections 2024-01-31T05:05:18.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.213+0000 7f0cf1e00640 1 --2- 172.21.15.49:0/339210179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0cec0cd0c0 0x7f0cec0cd770 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.213+0000 7f0cf1e00640 1 -- 172.21.15.49:0/339210179 >> 172.21.15.49:0/339210179 conn(0x7f0cec0d0ef0 msgr2=0x7f0cec0d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:18.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.213+0000 7f0cf1e00640 1 -- 172.21.15.49:0/339210179 shutdown_connections 2024-01-31T05:05:18.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.213+0000 7f0cf1e00640 1 -- 172.21.15.49:0/339210179 wait complete. 2024-01-31T05:05:18.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.213+0000 7f0cf1e00640 1 Processor -- start 2024-01-31T05:05:18.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.213+0000 7f0cf1e00640 1 -- start start 2024-01-31T05:05:18.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0cf1e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cec0cd0c0 0x7f0cec161020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:18.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0cf1e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cec0cdcb0 0x7f0cec15ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:18.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0cf1e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0cec0cf0f0 0x7f0cec0c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:18.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0cf1e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0c5fa0 con 0x7f0cec0cd0c0 2024-01-31T05:05:18.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0cf1e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0c6280 con 0x7f0cec0cdcb0 2024-01-31T05:05:18.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0cf1e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0c6560 con 0x7f0cec0cf0f0 2024-01-31T05:05:18.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0ceaa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cec0cd0c0 0x7f0cec161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:18.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0ceaa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cec0cd0c0 0x7f0cec161020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52920/0 (socket says 172.21.15.49:52920) 2024-01-31T05:05:18.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0ceaa00640 1 -- 172.21.15.49:0/1658417250 learned_addr learned my addr 172.21.15.49:0/1658417250 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:18.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0cea000640 1 --2- 172.21.15.49:0/1658417250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cec0cdcb0 0x7f0cec15ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:18.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0ceb400640 1 --2- 172.21.15.49:0/1658417250 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0cec0cf0f0 0x7f0cec0c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:18.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0ceaa00640 1 -- 172.21.15.49:0/1658417250 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0cec0cf0f0 msgr2=0x7f0cec0c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:18.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0ceaa00640 1 --2- 172.21.15.49:0/1658417250 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0cec0cf0f0 0x7f0cec0c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0ceaa00640 1 -- 172.21.15.49:0/1658417250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cec0cdcb0 msgr2=0x7f0cec15ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:18.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0ceaa00640 1 --2- 172.21.15.49:0/1658417250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cec0cdcb0 0x7f0cec15ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0ceaa00640 1 -- 172.21.15.49:0/1658417250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc009420 con 0x7f0cec0cd0c0 2024-01-31T05:05:18.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0ceaa00640 1 --2- 172.21.15.49:0/1658417250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cec0cd0c0 0x7f0cec161020 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0097f0 tx=0x7f0cdc01ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:18.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0ce3400640 1 -- 172.21.15.49:0/1658417250 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc0abda0 con 0x7f0cec0cd0c0 2024-01-31T05:05:18.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0ce3400640 1 -- 172.21.15.49:0/1658417250 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc004020 con 0x7f0cec0cd0c0 2024-01-31T05:05:18.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0ce3400640 1 -- 172.21.15.49:0/1658417250 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc004390 con 0x7f0cec0cd0c0 2024-01-31T05:05:18.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0cf1e00640 1 -- 172.21.15.49:0/1658417250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cec0c6840 con 0x7f0cec0cd0c0 2024-01-31T05:05:18.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0cf1e00640 1 -- 172.21.15.49:0/1658417250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cec161560 con 0x7f0cec0cd0c0 2024-01-31T05:05:18.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0cf1e00640 1 -- 172.21.15.49:0/1658417250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cec074860 con 0x7f0cec0cd0c0 2024-01-31T05:05:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.217+0000 7f0ce3400640 1 -- 172.21.15.49:0/1658417250 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f0cdc003620 con 0x7f0cec0cd0c0 2024-01-31T05:05:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.221+0000 7f0ce3400640 1 --2- 172.21.15.49:0/1658417250 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0cc4066530 0x7f0cc40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.221+0000 7f0ce3400640 1 -- 172.21.15.49:0/1658417250 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0cdc11e3d0 con 0x7f0cec0cd0c0 2024-01-31T05:05:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.221+0000 7f0cea000640 1 --2- 172.21.15.49:0/1658417250 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0cc4066530 0x7f0cc40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.221+0000 7f0cea000640 1 --2- 172.21.15.49:0/1658417250 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0cc4066530 0x7f0cc40689f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0aea50 tx=0x7f0cd40019c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.225+0000 7f0ce3400640 1 -- 172.21.15.49:0/1658417250 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f0cdc0eb480 con 0x7f0cec0cd0c0 2024-01-31T05:05:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.397+0000 7f0cf1e00640 1 -- 172.21.15.49:0/1658417250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0cec06b4e0 con 0x7f0cec0cd0c0 2024-01-31T05:05:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.397+0000 7f0ce3400640 1 -- 172.21.15.49:0/1658417250 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0cdc0eeaa0 con 0x7f0cec0cd0c0 2024-01-31T05:05:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2024-01-31T05:05:18.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.397+0000 7f0cf1e00640 1 -- 172.21.15.49:0/1658417250 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0cc4066530 msgr2=0x7f0cc40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:18.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.397+0000 7f0cf1e00640 1 --2- 172.21.15.49:0/1658417250 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0cc4066530 0x7f0cc40689f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0aea50 tx=0x7f0cd40019c0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.397+0000 7f0cf1e00640 1 -- 172.21.15.49:0/1658417250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cec0cd0c0 msgr2=0x7f0cec161020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:18.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.397+0000 7f0cf1e00640 1 --2- 172.21.15.49:0/1658417250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cec0cd0c0 0x7f0cec161020 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0097f0 tx=0x7f0cdc01ab60 comp rx=0 tx=0).stop 2024-01-31T05:05:18.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.397+0000 7f0cf1e00640 1 -- 172.21.15.49:0/1658417250 shutdown_connections 2024-01-31T05:05:18.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.397+0000 7f0cf1e00640 1 --2- 172.21.15.49:0/1658417250 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0cec0cf0f0 0x7f0cec0c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.397+0000 7f0cf1e00640 1 --2- 172.21.15.49:0/1658417250 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0cc4066530 0x7f0cc40689f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.397+0000 7f0cf1e00640 1 --2- 172.21.15.49:0/1658417250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cec0cdcb0 0x7f0cec15ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.397+0000 7f0cf1e00640 1 --2- 172.21.15.49:0/1658417250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0cec0cd0c0 0x7f0cec161020 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.397+0000 7f0cf1e00640 1 -- 172.21.15.49:0/1658417250 >> 172.21.15.49:0/1658417250 conn(0x7f0cec0d0ef0 msgr2=0x7f0cec0b6120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:18.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.397+0000 7f0cf1e00640 1 -- 172.21.15.49:0/1658417250 shutdown_connections 2024-01-31T05:05:18.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.397+0000 7f0cf1e00640 1 -- 172.21.15.49:0/1658417250 wait complete. 2024-01-31T05:05:18.420 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:05:18.420 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T05:05:18.430 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:18.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.569+0000 7fb111800640 1 Processor -- start 2024-01-31T05:05:18.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.569+0000 7fb111800640 1 -- start start 2024-01-31T05:05:18.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.573+0000 7fb111800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb10c070660 0x7fb10c070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:18.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.573+0000 7fb111800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb10c0ac050 0x7fb10c0ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:18.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.573+0000 7fb111800640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10c071000 con 0x7fb10c159790 2024-01-31T05:05:18.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.573+0000 7fb111800640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10c159b70 con 0x7fb10c070660 2024-01-31T05:05:18.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.573+0000 7fb111800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10c0b2750 con 0x7fb10c0ac050 2024-01-31T05:05:18.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.573+0000 7fb10a000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb10c070660 0x7fb10c070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:18.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.573+0000 7fb10aa00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb10c159790 0x7fb10c0b37c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57888/0 (socket says 172.21.15.49:57888) 2024-01-31T05:05:18.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.573+0000 7fb10aa00640 1 -- 172.21.15.49:0/618546057 learned_addr learned my addr 172.21.15.49:0/618546057 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:18.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.573+0000 7fb10b400640 1 --2- 172.21.15.49:0/618546057 >> v2:172.21.15.195:3300/0 conn(0x7fb10c0ac050 0x7fb10c0ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:18.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.573+0000 7fb10a000640 1 -- 172.21.15.49:0/618546057 >> v2:172.21.15.195:3300/0 conn(0x7fb10c0ac050 msgr2=0x7fb10c0ac4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:18.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.573+0000 7fb10a000640 1 --2- 172.21.15.49:0/618546057 >> v2:172.21.15.195:3300/0 conn(0x7fb10c0ac050 0x7fb10c0ac4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.573+0000 7fb10a000640 1 -- 172.21.15.49:0/618546057 >> v1:172.21.15.49:6789/0 conn(0x7fb10c159790 legacy=0x7fb10c0b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:18.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.573+0000 7fb109600640 1 -- 172.21.15.49:0/618546057 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758690479 0 0) 0x7fb10c071000 con 0x7fb10c159790 2024-01-31T05:05:18.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.573+0000 7fb10a000640 1 -- 172.21.15.49:0/618546057 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c0b2a30 con 0x7fb10c070660 2024-01-31T05:05:18.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.573+0000 7fb10b400640 1 --2- 172.21.15.49:0/618546057 >> v2:172.21.15.195:3300/0 conn(0x7fb10c0ac050 0x7fb10c0ac4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:18.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.577+0000 7fb10a000640 1 --2- 172.21.15.49:0/618546057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb10c070660 0x7fb10c070ac0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0b1690 tx=0x7fb0f401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506ade616eb185c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:18.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.577+0000 7fb109600640 1 -- 172.21.15.49:0/618546057 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f40a7070 con 0x7fb10c070660 2024-01-31T05:05:18.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.577+0000 7fb109600640 1 -- 172.21.15.49:0/618546057 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f40ab430 con 0x7fb10c070660 2024-01-31T05:05:18.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.577+0000 7fb109600640 1 -- 172.21.15.49:0/618546057 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f40ab7c0 con 0x7fb10c070660 2024-01-31T05:05:18.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.577+0000 7fb111800640 1 -- 172.21.15.49:0/618546057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb10c070660 msgr2=0x7fb10c070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:18.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.577+0000 7fb111800640 1 --2- 172.21.15.49:0/618546057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb10c070660 0x7fb10c070ac0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0b1690 tx=0x7fb0f401c430 comp rx=0 tx=0).stop 2024-01-31T05:05:18.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.577+0000 7fb111800640 1 -- 172.21.15.49:0/618546057 shutdown_connections 2024-01-31T05:05:18.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.577+0000 7fb111800640 1 --2- 172.21.15.49:0/618546057 >> v2:172.21.15.195:3300/0 conn(0x7fb10c0ac050 0x7fb10c0ac4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.577+0000 7fb111800640 1 --2- 172.21.15.49:0/618546057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb10c070660 0x7fb10c070ac0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.577+0000 7fb111800640 1 -- 172.21.15.49:0/618546057 >> 172.21.15.49:0/618546057 conn(0x7fb10c0b09a0 msgr2=0x7fb10c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:18.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.577+0000 7fb111800640 1 -- 172.21.15.49:0/618546057 shutdown_connections 2024-01-31T05:05:18.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.577+0000 7fb111800640 1 -- 172.21.15.49:0/618546057 wait complete. 2024-01-31T05:05:18.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.577+0000 7fb111800640 1 Processor -- start 2024-01-31T05:05:18.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.577+0000 7fb111800640 1 -- start start 2024-01-31T05:05:18.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb111800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb10c070660 0x7fb10c15c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:18.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb111800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb10c0ac050 0x7fb10c1558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:18.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb111800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb10c159790 0x7fb10c1f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:18.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb111800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c1548c0 con 0x7fb10c070660 2024-01-31T05:05:18.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb111800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c154b30 con 0x7fb10c159790 2024-01-31T05:05:18.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb111800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c154e10 con 0x7fb10c0ac050 2024-01-31T05:05:18.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb10aa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb10c070660 0x7fb10c15c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:18.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb10aa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb10c070660 0x7fb10c15c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34704/0 (socket says 172.21.15.49:34704) 2024-01-31T05:05:18.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb10aa00640 1 -- 172.21.15.49:0/2535623592 learned_addr learned my addr 172.21.15.49:0/2535623592 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:18.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb10b400640 1 --2- 172.21.15.49:0/2535623592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb10c159790 0x7fb10c1f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:18.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb10a000640 1 --2- 172.21.15.49:0/2535623592 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb10c0ac050 0x7fb10c1558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:18.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb10aa00640 1 -- 172.21.15.49:0/2535623592 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb10c0ac050 msgr2=0x7fb10c1558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:18.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb10aa00640 1 --2- 172.21.15.49:0/2535623592 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb10c0ac050 0x7fb10c1558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb10aa00640 1 -- 172.21.15.49:0/2535623592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb10c159790 msgr2=0x7fb10c1f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:18.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb10aa00640 1 --2- 172.21.15.49:0/2535623592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb10c159790 0x7fb10c1f6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb10aa00640 1 -- 172.21.15.49:0/2535623592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f4009420 con 0x7fb10c070660 2024-01-31T05:05:18.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb10aa00640 1 --2- 172.21.15.49:0/2535623592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb10c070660 0x7fb10c15c280 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00c480 tx=0x7fb0fc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:18.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb102a00640 1 -- 172.21.15.49:0/2535623592 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc0074e0 con 0x7fb10c070660 2024-01-31T05:05:18.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb102a00640 1 -- 172.21.15.49:0/2535623592 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0fc007660 con 0x7fb10c070660 2024-01-31T05:05:18.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb111800640 1 -- 172.21.15.49:0/2535623592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10c1550f0 con 0x7fb10c070660 2024-01-31T05:05:18.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb102a00640 1 -- 172.21.15.49:0/2535623592 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc004a30 con 0x7fb10c070660 2024-01-31T05:05:18.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb111800640 1 -- 172.21.15.49:0/2535623592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10c15c7c0 con 0x7fb10c070660 2024-01-31T05:05:18.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.581+0000 7fb111800640 1 -- 172.21.15.49:0/2535623592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10c074860 con 0x7fb10c070660 2024-01-31T05:05:18.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.585+0000 7fb102a00640 1 -- 172.21.15.49:0/2535623592 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb0fc004b90 con 0x7fb10c070660 2024-01-31T05:05:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.585+0000 7fb102a00640 1 --2- 172.21.15.49:0/2535623592 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb0e4066500 0x7fb0e40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.585+0000 7fb102a00640 1 -- 172.21.15.49:0/2535623592 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb0fc0837a0 con 0x7fb10c070660 2024-01-31T05:05:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.585+0000 7fb10a000640 1 --2- 172.21.15.49:0/2535623592 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb0e4066500 0x7fb0e40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.585+0000 7fb10a000640 1 --2- 172.21.15.49:0/2535623592 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb0e4066500 0x7fb0e40689c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40af000 tx=0x7fb0f40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.589+0000 7fb102a00640 1 -- 172.21.15.49:0/2535623592 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fb0fc054100 con 0x7fb10c070660 2024-01-31T05:05:18.593 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:05:18.596 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:05:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.749+0000 7fb111800640 1 -- 172.21.15.49:0/2535623592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb10c157b60 con 0x7fb10c070660 2024-01-31T05:05:18.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.749+0000 7fb102a00640 1 -- 172.21.15.49:0/2535623592 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7fb0fc053c90 con 0x7fb10c070660 2024-01-31T05:05:18.750 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:18.751 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:58.277568+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.749+0000 7fb111800640 1 -- 172.21.15.49:0/2535623592 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb0e4066500 msgr2=0x7fb0e40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.749+0000 7fb111800640 1 --2- 172.21.15.49:0/2535623592 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb0e4066500 0x7fb0e40689c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40af000 tx=0x7fb0f40a7000 comp rx=0 tx=0).stop 2024-01-31T05:05:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.753+0000 7fb111800640 1 -- 172.21.15.49:0/2535623592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb10c070660 msgr2=0x7fb10c15c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.753+0000 7fb111800640 1 --2- 172.21.15.49:0/2535623592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb10c070660 0x7fb10c15c280 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00c480 tx=0x7fb0fc00c940 comp rx=0 tx=0).stop 2024-01-31T05:05:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.753+0000 7fb111800640 1 -- 172.21.15.49:0/2535623592 shutdown_connections 2024-01-31T05:05:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.753+0000 7fb111800640 1 --2- 172.21.15.49:0/2535623592 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb0e4066500 0x7fb0e40689c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.753+0000 7fb111800640 1 --2- 172.21.15.49:0/2535623592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb10c159790 0x7fb10c1f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.753+0000 7fb111800640 1 --2- 172.21.15.49:0/2535623592 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb10c0ac050 0x7fb10c1558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.753+0000 7fb111800640 1 --2- 172.21.15.49:0/2535623592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb10c070660 0x7fb10c15c280 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.753+0000 7fb111800640 1 -- 172.21.15.49:0/2535623592 >> 172.21.15.49:0/2535623592 conn(0x7fb10c0b09a0 msgr2=0x7fb10c0ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:18.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.753+0000 7fb111800640 1 -- 172.21.15.49:0/2535623592 shutdown_connections 2024-01-31T05:05:18.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.753+0000 7fb111800640 1 -- 172.21.15.49:0/2535623592 wait complete. 2024-01-31T05:05:18.772 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:04:14.566345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:04:15.231265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-31T05:04:18.316756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-31T05:05:18.773 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:05:18.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.917+0000 7f30bce00640 1 Processor -- start 2024-01-31T05:05:18.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.917+0000 7f30bce00640 1 -- start start 2024-01-31T05:05:18.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.917+0000 7f30bce00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f30b80cff70 0x7f30b80cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:18.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.917+0000 7f30bce00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f30b80cb9f0 0x7f30b80cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:18.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.917+0000 7f30bce00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b80cef80 con 0x7f30b815d540 2024-01-31T05:05:18.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.917+0000 7f30bce00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b80d03d0 con 0x7f30b80cff70 2024-01-31T05:05:18.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.917+0000 7f30bce00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b806cae0 con 0x7f30b80cb9f0 2024-01-31T05:05:18.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.917+0000 7f30b5400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f30b80cff70 0x7f30b80cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:18.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.917+0000 7f30b5400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f30b80cff70 0x7f30b80cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34718/0 (socket says 172.21.15.49:34718) 2024-01-31T05:05:18.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.917+0000 7f30b5400640 1 -- 172.21.15.49:0/3153762865 learned_addr learned my addr 172.21.15.49:0/3153762865 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:18.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.917+0000 7f30b6800640 1 --2- 172.21.15.49:0/3153762865 >> v2:172.21.15.195:3300/0 conn(0x7f30b80cb9f0 0x7f30b80cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:18.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.917+0000 7f30b5400640 1 -- 172.21.15.49:0/3153762865 >> v2:172.21.15.195:3300/0 conn(0x7f30b80cb9f0 msgr2=0x7f30b80cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:18.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.917+0000 7f30b5400640 1 --2- 172.21.15.49:0/3153762865 >> v2:172.21.15.195:3300/0 conn(0x7f30b80cb9f0 0x7f30b80cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.917+0000 7f30b5400640 1 -- 172.21.15.49:0/3153762865 >> v1:172.21.15.49:6789/0 conn(0x7f30b815d540 legacy=0x7f30b806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:18.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.917+0000 7f30b4a00640 1 -- 172.21.15.49:0/3153762865 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440982172 0 0) 0x7f30b80cef80 con 0x7f30b815d540 2024-01-31T05:05:18.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.917+0000 7f30b5400640 1 -- 172.21.15.49:0/3153762865 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b80cf1b0 con 0x7f30b80cff70 2024-01-31T05:05:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.921+0000 7f30b5400640 1 --2- 172.21.15.49:0/3153762865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30b80cff70 0x7f30b80cb4b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f30b80d1f40 tx=0x7f30a001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65d7dd98e707c37 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.921+0000 7f30b4a00640 1 -- 172.21.15.49:0/3153762865 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a00aa430 con 0x7f30b80cff70 2024-01-31T05:05:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.921+0000 7f30b4a00640 1 -- 172.21.15.49:0/3153762865 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a00aa590 con 0x7f30b80cff70 2024-01-31T05:05:18.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.921+0000 7f30b4a00640 1 -- 172.21.15.49:0/3153762865 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a00aa920 con 0x7f30b80cff70 2024-01-31T05:05:18.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.921+0000 7f30bce00640 1 -- 172.21.15.49:0/3153762865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30b80cff70 msgr2=0x7f30b80cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:18.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.921+0000 7f30bce00640 1 --2- 172.21.15.49:0/3153762865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30b80cff70 0x7f30b80cb4b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f30b80d1f40 tx=0x7f30a001c4d0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.921+0000 7f30bce00640 1 -- 172.21.15.49:0/3153762865 shutdown_connections 2024-01-31T05:05:18.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.921+0000 7f30bce00640 1 --2- 172.21.15.49:0/3153762865 >> v2:172.21.15.195:3300/0 conn(0x7f30b80cb9f0 0x7f30b80cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.921+0000 7f30bce00640 1 --2- 172.21.15.49:0/3153762865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30b80cff70 0x7f30b80cb4b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.921+0000 7f30bce00640 1 -- 172.21.15.49:0/3153762865 >> 172.21.15.49:0/3153762865 conn(0x7f30b80d0e60 msgr2=0x7f30b80d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:18.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.921+0000 7f30bce00640 1 -- 172.21.15.49:0/3153762865 shutdown_connections 2024-01-31T05:05:18.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.921+0000 7f30bce00640 1 -- 172.21.15.49:0/3153762865 wait complete. 2024-01-31T05:05:18.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.921+0000 7f30bce00640 1 Processor -- start 2024-01-31T05:05:18.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30bce00640 1 -- start start 2024-01-31T05:05:18.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30bce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30b80cb9f0 0x7f30b80b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:18.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30bce00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30b80cff70 0x7f30b8154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:18.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30bce00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30b815d540 0x7f30b806e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:18.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30bce00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b80c8c40 con 0x7f30b80cff70 2024-01-31T05:05:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30bce00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b80c8f20 con 0x7f30b815d540 2024-01-31T05:05:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30bce00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b80c5c60 con 0x7f30b80cb9f0 2024-01-31T05:05:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30b5400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30b80cff70 0x7f30b8154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30b5400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30b80cff70 0x7f30b8154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34724/0 (socket says 172.21.15.49:34724) 2024-01-31T05:05:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30b5400640 1 -- 172.21.15.49:0/2249767070 learned_addr learned my addr 172.21.15.49:0/2249767070 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30b6800640 1 --2- 172.21.15.49:0/2249767070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30b815d540 0x7f30b806e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30b5400640 1 -- 172.21.15.49:0/2249767070 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30b80cb9f0 msgr2=0x7f30b80b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30b5400640 1 --2- 172.21.15.49:0/2249767070 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30b80cb9f0 0x7f30b80b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30b5400640 1 -- 172.21.15.49:0/2249767070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30b815d540 msgr2=0x7f30b806e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30b5400640 1 --2- 172.21.15.49:0/2249767070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30b815d540 0x7f30b806e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30b5400640 1 -- 172.21.15.49:0/2249767070 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a00094d0 con 0x7f30b80cff70 2024-01-31T05:05:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30b6800640 1 --2- 172.21.15.49:0/2249767070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30b815d540 0x7f30b806e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:18.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30b5400640 1 --2- 172.21.15.49:0/2249767070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30b80cff70 0x7f30b8154fe0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f30a00190e0 tx=0x7f30a001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30ae000640 1 -- 172.21.15.49:0/2249767070 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a00b3800 con 0x7f30b80cff70 2024-01-31T05:05:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30ae000640 1 -- 172.21.15.49:0/2249767070 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a00b3960 con 0x7f30b80cff70 2024-01-31T05:05:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30ae000640 1 -- 172.21.15.49:0/2249767070 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a00b3d10 con 0x7f30b80cff70 2024-01-31T05:05:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30bce00640 1 -- 172.21.15.49:0/2249767070 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b80c5f40 con 0x7f30b80cff70 2024-01-31T05:05:18.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30bce00640 1 -- 172.21.15.49:0/2249767070 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b80b3f10 con 0x7f30b80cff70 2024-01-31T05:05:18.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.925+0000 7f30bce00640 1 -- 172.21.15.49:0/2249767070 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30b80ce880 con 0x7f30b80cff70 2024-01-31T05:05:18.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.929+0000 7f30ae000640 1 -- 172.21.15.49:0/2249767070 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f30a00b2380 con 0x7f30b80cff70 2024-01-31T05:05:18.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.929+0000 7f30ae000640 1 --2- 172.21.15.49:0/2249767070 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3090066500 0x7f30900689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:18.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.929+0000 7f30ae000640 1 -- 172.21.15.49:0/2249767070 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f30a011e7d0 con 0x7f30b80cff70 2024-01-31T05:05:18.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.929+0000 7f30b5e00640 1 --2- 172.21.15.49:0/2249767070 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3090066500 0x7f30900689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:18.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.929+0000 7f30b5e00640 1 --2- 172.21.15.49:0/2249767070 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3090066500 0x7f30900689c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f30a8007fd0 tx=0x7f30a8007940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:18.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:18.933+0000 7f30ae000640 1 -- 172.21.15.49:0/2249767070 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f30a00eb750 con 0x7f30b80cff70 2024-01-31T05:05:19.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.093+0000 7f30bce00640 1 -- 172.21.15.49:0/2249767070 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f30b8067c80 con 0x7f30b80cff70 2024-01-31T05:05:19.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.093+0000 7f30ae000640 1 -- 172.21.15.49:0/2249767070 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f30a00eed70 con 0x7f30b80cff70 2024-01-31T05:05:19.093 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:05:19.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.093+0000 7f30bce00640 1 -- 172.21.15.49:0/2249767070 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3090066500 msgr2=0x7f30900689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:19.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.093+0000 7f30bce00640 1 --2- 172.21.15.49:0/2249767070 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3090066500 0x7f30900689c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f30a8007fd0 tx=0x7f30a8007940 comp rx=0 tx=0).stop 2024-01-31T05:05:19.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.093+0000 7f30bce00640 1 -- 172.21.15.49:0/2249767070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30b80cff70 msgr2=0x7f30b8154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:19.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.093+0000 7f30bce00640 1 --2- 172.21.15.49:0/2249767070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30b80cff70 0x7f30b8154fe0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f30a00190e0 tx=0x7f30a001ad10 comp rx=0 tx=0).stop 2024-01-31T05:05:19.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.093+0000 7f30bce00640 1 -- 172.21.15.49:0/2249767070 shutdown_connections 2024-01-31T05:05:19.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.093+0000 7f30bce00640 1 --2- 172.21.15.49:0/2249767070 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3090066500 0x7f30900689c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.093+0000 7f30bce00640 1 --2- 172.21.15.49:0/2249767070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30b815d540 0x7f30b806e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.093+0000 7f30bce00640 1 --2- 172.21.15.49:0/2249767070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30b80cff70 0x7f30b8154fe0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.093+0000 7f30bce00640 1 --2- 172.21.15.49:0/2249767070 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30b80cb9f0 0x7f30b80b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.093+0000 7f30bce00640 1 -- 172.21.15.49:0/2249767070 >> 172.21.15.49:0/2249767070 conn(0x7f30b80d0e60 msgr2=0x7f30b8073e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:19.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.093+0000 7f30bce00640 1 -- 172.21.15.49:0/2249767070 shutdown_connections 2024-01-31T05:05:19.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.093+0000 7f30bce00640 1 -- 172.21.15.49:0/2249767070 wait complete. 2024-01-31T05:05:19.116 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:05:19.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.261+0000 7f4b79e00640 1 Processor -- start 2024-01-31T05:05:19.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.261+0000 7f4b79e00640 1 -- start start 2024-01-31T05:05:19.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.261+0000 7f4b79e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4b7415b110 0x7f4b7406c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:19.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.261+0000 7f4b79e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4b740714e0 0x7f4b740ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:19.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.261+0000 7f4b79e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7415b4f0 con 0x7f4b740cdf10 2024-01-31T05:05:19.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.261+0000 7f4b79e00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b740ce460 con 0x7f4b7415b110 2024-01-31T05:05:19.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.261+0000 7f4b79e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b740abf20 con 0x7f4b740714e0 2024-01-31T05:05:19.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.261+0000 7f4b72a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4b7415b110 0x7f4b7406c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:19.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.261+0000 7f4b72a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4b7415b110 0x7f4b7406c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34728/0 (socket says 172.21.15.49:34728) 2024-01-31T05:05:19.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.261+0000 7f4b72a00640 1 -- 172.21.15.49:0/3579657154 learned_addr learned my addr 172.21.15.49:0/3579657154 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:19.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.261+0000 7f4b73400640 1 --2- 172.21.15.49:0/3579657154 >> v2:172.21.15.195:3300/0 conn(0x7f4b740714e0 0x7f4b740ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:19.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.261+0000 7f4b72a00640 1 -- 172.21.15.49:0/3579657154 >> v2:172.21.15.195:3300/0 conn(0x7f4b740714e0 msgr2=0x7f4b740ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:19.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.261+0000 7f4b72a00640 1 --2- 172.21.15.49:0/3579657154 >> v2:172.21.15.195:3300/0 conn(0x7f4b740714e0 0x7f4b740ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.261+0000 7f4b72a00640 1 -- 172.21.15.49:0/3579657154 >> v1:172.21.15.195:6789/0 conn(0x7f4b740cdf10 legacy=0x7f4b74070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:19.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.261+0000 7f4b72a00640 1 -- 172.21.15.49:0/3579657154 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b740ac200 con 0x7f4b7415b110 2024-01-31T05:05:19.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.265+0000 7f4b72a00640 1 --2- 172.21.15.49:0/3579657154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b7415b110 0x7f4b7406c2d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4b74072f80 tx=0x7f4b6401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac386f24a968a7c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:19.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.265+0000 7f4b71600640 1 -- 172.21.15.49:0/3579657154 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b640aa650 con 0x7f4b7415b110 2024-01-31T05:05:19.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.265+0000 7f4b71600640 1 -- 172.21.15.49:0/3579657154 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b640aa7b0 con 0x7f4b7415b110 2024-01-31T05:05:19.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.265+0000 7f4b71600640 1 -- 172.21.15.49:0/3579657154 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b640aab40 con 0x7f4b7415b110 2024-01-31T05:05:19.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.265+0000 7f4b79e00640 1 -- 172.21.15.49:0/3579657154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b7415b110 msgr2=0x7f4b7406c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:19.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.265+0000 7f4b79e00640 1 --2- 172.21.15.49:0/3579657154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b7415b110 0x7f4b7406c2d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4b74072f80 tx=0x7f4b6401c4d0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.265+0000 7f4b79e00640 1 -- 172.21.15.49:0/3579657154 shutdown_connections 2024-01-31T05:05:19.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.265+0000 7f4b79e00640 1 --2- 172.21.15.49:0/3579657154 >> v2:172.21.15.195:3300/0 conn(0x7f4b740714e0 0x7f4b740ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.265+0000 7f4b79e00640 1 --2- 172.21.15.49:0/3579657154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b7415b110 0x7f4b7406c2d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.265+0000 7f4b79e00640 1 -- 172.21.15.49:0/3579657154 >> 172.21.15.49:0/3579657154 conn(0x7f4b740b09a0 msgr2=0x7f4b740b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:19.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.265+0000 7f4b79e00640 1 -- 172.21.15.49:0/3579657154 shutdown_connections 2024-01-31T05:05:19.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.265+0000 7f4b79e00640 1 -- 172.21.15.49:0/3579657154 wait complete. 2024-01-31T05:05:19.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b79e00640 1 Processor -- start 2024-01-31T05:05:19.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b79e00640 1 -- start start 2024-01-31T05:05:19.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b79e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b740714e0 0x7f4b74135890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:19.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b79e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b740cdf10 0x7f4b741509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:19.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b79e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b7415b110 0x7f4b74158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:19.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b79e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7415e9b0 con 0x7f4b7415b110 2024-01-31T05:05:19.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b79e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b74150510 con 0x7f4b740cdf10 2024-01-31T05:05:19.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b79e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b74135dd0 con 0x7f4b740714e0 2024-01-31T05:05:19.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b73400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b7415b110 0x7f4b74158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:19.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b73400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b7415b110 0x7f4b74158b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34736/0 (socket says 172.21.15.49:34736) 2024-01-31T05:05:19.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b73400640 1 -- 172.21.15.49:0/324448482 learned_addr learned my addr 172.21.15.49:0/324448482 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:19.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b72a00640 1 --2- 172.21.15.49:0/324448482 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b740714e0 0x7f4b74135890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:19.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b72000640 1 --2- 172.21.15.49:0/324448482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b740cdf10 0x7f4b741509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:19.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b73400640 1 -- 172.21.15.49:0/324448482 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b740714e0 msgr2=0x7f4b74135890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:19.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b73400640 1 --2- 172.21.15.49:0/324448482 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b740714e0 0x7f4b74135890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b73400640 1 -- 172.21.15.49:0/324448482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b740cdf10 msgr2=0x7f4b741509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:19.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b73400640 1 --2- 172.21.15.49:0/324448482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b740cdf10 0x7f4b741509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b73400640 1 -- 172.21.15.49:0/324448482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b640094d0 con 0x7f4b7415b110 2024-01-31T05:05:19.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b73400640 1 --2- 172.21.15.49:0/324448482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b7415b110 0x7f4b74158b20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009d30 tx=0x7f4b6c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:19.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b6b400640 1 -- 172.21.15.49:0/324448482 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c009ba0 con 0x7f4b7415b110 2024-01-31T05:05:19.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b6b400640 1 -- 172.21.15.49:0/324448482 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c00f040 con 0x7f4b7415b110 2024-01-31T05:05:19.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b79e00640 1 -- 172.21.15.49:0/324448482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7414b4a0 con 0x7f4b7415b110 2024-01-31T05:05:19.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b6b400640 1 -- 172.21.15.49:0/324448482 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c0146c0 con 0x7f4b7415b110 2024-01-31T05:05:19.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.269+0000 7f4b79e00640 1 -- 172.21.15.49:0/324448482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7414fec0 con 0x7f4b7415b110 2024-01-31T05:05:19.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.273+0000 7f4b79e00640 1 -- 172.21.15.49:0/324448482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b741506a0 con 0x7f4b7415b110 2024-01-31T05:05:19.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.273+0000 7f4b6b400640 1 -- 172.21.15.49:0/324448482 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f4b6c014820 con 0x7f4b7415b110 2024-01-31T05:05:19.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.273+0000 7f4b6b400640 1 --2- 172.21.15.49:0/324448482 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4b4c066500 0x7f4b4c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:19.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.273+0000 7f4b6b400640 1 -- 172.21.15.49:0/324448482 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4b6c084b60 con 0x7f4b7415b110 2024-01-31T05:05:19.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.273+0000 7f4b72a00640 1 --2- 172.21.15.49:0/324448482 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4b4c066500 0x7f4b4c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:19.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.273+0000 7f4b72a00640 1 --2- 172.21.15.49:0/324448482 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4b4c066500 0x7f4b4c0689c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4b640ae000 tx=0x7f4b640b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:19.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.277+0000 7f4b6b400640 1 -- 172.21.15.49:0/324448482 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f4b6c051ae0 con 0x7f4b7415b110 2024-01-31T05:05:19.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.437+0000 7f4b79e00640 1 -- 172.21.15.49:0/324448482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b74074860 con 0x7f4b7415b110 2024-01-31T05:05:19.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.437+0000 7f4b6b400640 1 -- 172.21.15.49:0/324448482 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4b6c0180a0 con 0x7f4b7415b110 2024-01-31T05:05:19.439 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:19.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.441+0000 7f4b79e00640 1 -- 172.21.15.49:0/324448482 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4b4c066500 msgr2=0x7f4b4c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:19.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.441+0000 7f4b79e00640 1 --2- 172.21.15.49:0/324448482 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4b4c066500 0x7f4b4c0689c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4b640ae000 tx=0x7f4b640b5040 comp rx=0 tx=0).stop 2024-01-31T05:05:19.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.441+0000 7f4b79e00640 1 -- 172.21.15.49:0/324448482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b7415b110 msgr2=0x7f4b74158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:19.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.441+0000 7f4b79e00640 1 --2- 172.21.15.49:0/324448482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b7415b110 0x7f4b74158b20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009d30 tx=0x7f4b6c00c490 comp rx=0 tx=0).stop 2024-01-31T05:05:19.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.441+0000 7f4b79e00640 1 -- 172.21.15.49:0/324448482 shutdown_connections 2024-01-31T05:05:19.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.441+0000 7f4b79e00640 1 --2- 172.21.15.49:0/324448482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4b7415b110 0x7f4b74158b20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.441+0000 7f4b79e00640 1 --2- 172.21.15.49:0/324448482 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4b4c066500 0x7f4b4c0689c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.441+0000 7f4b79e00640 1 --2- 172.21.15.49:0/324448482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b740cdf10 0x7f4b741509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.441+0000 7f4b79e00640 1 --2- 172.21.15.49:0/324448482 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b740714e0 0x7f4b74135890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.441+0000 7f4b79e00640 1 -- 172.21.15.49:0/324448482 >> 172.21.15.49:0/324448482 conn(0x7f4b740b09a0 msgr2=0x7f4b7414ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.441+0000 7f4b79e00640 1 -- 172.21.15.49:0/324448482 shutdown_connections 2024-01-31T05:05:19.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.441+0000 7f4b79e00640 1 -- 172.21.15.49:0/324448482 wait complete. 2024-01-31T05:05:19.461 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:05:19.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.605+0000 7f15f7800640 1 Processor -- start 2024-01-31T05:05:19.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.605+0000 7f15f7800640 1 -- start start 2024-01-31T05:05:19.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.609+0000 7f15f7800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f15f0159790 0x7f15f00b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:19.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.609+0000 7f15f7800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f15f00b3d00 0x7f15f0070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:19.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.609+0000 7f15f7800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15f0070ba0 0x7f15f006cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:19.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.609+0000 7f15f7800640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f0071030 con 0x7f15f0159790 2024-01-31T05:05:19.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.609+0000 7f15f7800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f0159b70 con 0x7f15f00b3d00 2024-01-31T05:05:19.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.609+0000 7f15f7800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00b2750 con 0x7f15f0070ba0 2024-01-31T05:05:19.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.609+0000 7f15f4e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f15f0159790 0x7f15f00b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:19.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.609+0000 7f15f4e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f15f0159790 0x7f15f00b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34740/0 (socket says 172.21.15.49:34740) 2024-01-31T05:05:19.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.609+0000 7f15f4e00640 1 -- 172.21.15.49:0/1003573498 learned_addr learned my addr 172.21.15.49:0/1003573498 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:19.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.609+0000 7f15f4e00640 1 -- 172.21.15.49:0/1003573498 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15f0070ba0 msgr2=0x7f15f006cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:19.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.609+0000 7f15f4e00640 1 --2- 172.21.15.49:0/1003573498 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15f0070ba0 0x7f15f006cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.609+0000 7f15efe00640 1 --2- 172.21.15.49:0/1003573498 >> v2:172.21.15.195:3300/0 conn(0x7f15f00b3d00 0x7f15f0070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:19.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.609+0000 7f15f4e00640 1 -- 172.21.15.49:0/1003573498 >> v2:172.21.15.195:3300/0 conn(0x7f15f00b3d00 msgr2=0x7f15f0070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:19.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.609+0000 7f15f4e00640 1 --2- 172.21.15.49:0/1003573498 >> v2:172.21.15.195:3300/0 conn(0x7f15f00b3d00 0x7f15f0070660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.609+0000 7f15f4e00640 1 -- 172.21.15.49:0/1003573498 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f00b2a30 con 0x7f15f0159790 2024-01-31T05:05:19.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.609+0000 7f15efe00640 1 --2- 172.21.15.49:0/1003573498 >> v2:172.21.15.195:3300/0 conn(0x7f15f00b3d00 0x7f15f0070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:19.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.613+0000 7f15f4e00640 1 --2- 172.21.15.49:0/1003573498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15f0159790 0x7f15f00b37c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f15f0072cb0 tx=0x7f15e001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6f016545d02651 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:19.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.613+0000 7f15ef400640 1 -- 172.21.15.49:0/1003573498 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e00ab610 con 0x7f15f0159790 2024-01-31T05:05:19.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.613+0000 7f15ef400640 1 -- 172.21.15.49:0/1003573498 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e00ab770 con 0x7f15f0159790 2024-01-31T05:05:19.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.613+0000 7f15ef400640 1 -- 172.21.15.49:0/1003573498 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e00abb00 con 0x7f15f0159790 2024-01-31T05:05:19.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.613+0000 7f15f7800640 1 -- 172.21.15.49:0/1003573498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15f0159790 msgr2=0x7f15f00b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:19.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.613+0000 7f15f7800640 1 --2- 172.21.15.49:0/1003573498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15f0159790 0x7f15f00b37c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f15f0072cb0 tx=0x7f15e001c4d0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.613+0000 7f15f7800640 1 -- 172.21.15.49:0/1003573498 shutdown_connections 2024-01-31T05:05:19.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.613+0000 7f15f7800640 1 --2- 172.21.15.49:0/1003573498 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15f0070ba0 0x7f15f006cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.613+0000 7f15f7800640 1 --2- 172.21.15.49:0/1003573498 >> v2:172.21.15.195:3300/0 conn(0x7f15f00b3d00 0x7f15f0070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.613+0000 7f15f7800640 1 --2- 172.21.15.49:0/1003573498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15f0159790 0x7f15f00b37c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.613+0000 7f15f7800640 1 -- 172.21.15.49:0/1003573498 >> 172.21.15.49:0/1003573498 conn(0x7f15f00b09a0 msgr2=0x7f15f00b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:19.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.613+0000 7f15f7800640 1 -- 172.21.15.49:0/1003573498 shutdown_connections 2024-01-31T05:05:19.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.613+0000 7f15f7800640 1 -- 172.21.15.49:0/1003573498 wait complete. 2024-01-31T05:05:19.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.613+0000 7f15f7800640 1 Processor -- start 2024-01-31T05:05:19.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.613+0000 7f15f7800640 1 -- start start 2024-01-31T05:05:19.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15f7800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15f0070ba0 0x7f15f00afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:19.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15f7800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15f00b3d00 0x7f15f014f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:19.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15f7800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15f0159790 0x7f15f015c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:19.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15f7800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00aee00 con 0x7f15f00b3d00 2024-01-31T05:05:19.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15f7800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00af0e0 con 0x7f15f0070ba0 2024-01-31T05:05:19.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15f7800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00af3c0 con 0x7f15f0159790 2024-01-31T05:05:19.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15efe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15f00b3d00 0x7f15f014f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:19.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15efe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15f00b3d00 0x7f15f014f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34742/0 (socket says 172.21.15.49:34742) 2024-01-31T05:05:19.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15efe00640 1 -- 172.21.15.49:0/1555233479 learned_addr learned my addr 172.21.15.49:0/1555233479 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:19.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15f4e00640 1 --2- 172.21.15.49:0/1555233479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15f0070ba0 0x7f15f00afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:19.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15f5800640 1 --2- 172.21.15.49:0/1555233479 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15f0159790 0x7f15f015c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:19.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15efe00640 1 -- 172.21.15.49:0/1555233479 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15f0159790 msgr2=0x7f15f015c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:19.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15efe00640 1 --2- 172.21.15.49:0/1555233479 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15f0159790 0x7f15f015c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15efe00640 1 -- 172.21.15.49:0/1555233479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15f0070ba0 msgr2=0x7f15f00afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:19.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15efe00640 1 --2- 172.21.15.49:0/1555233479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15f0070ba0 0x7f15f00afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15efe00640 1 -- 172.21.15.49:0/1555233479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e00094d0 con 0x7f15f00b3d00 2024-01-31T05:05:19.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15efe00640 1 --2- 172.21.15.49:0/1555233479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15f00b3d00 0x7f15f014f500 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f15d800c7c0 tx=0x7f15d800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:19.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15ecc00640 1 -- 172.21.15.49:0/1555233479 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8007a30 con 0x7f15f00b3d00 2024-01-31T05:05:19.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15ecc00640 1 -- 172.21.15.49:0/1555233479 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d8007b90 con 0x7f15f00b3d00 2024-01-31T05:05:19.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15ecc00640 1 -- 172.21.15.49:0/1555233479 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d800ce70 con 0x7f15f00b3d00 2024-01-31T05:05:19.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15f7800640 1 -- 172.21.15.49:0/1555233479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f00af6a0 con 0x7f15f00b3d00 2024-01-31T05:05:19.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15f7800640 1 -- 172.21.15.49:0/1555233479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f00ce020 con 0x7f15f00b3d00 2024-01-31T05:05:19.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.617+0000 7f15f7800640 1 -- 172.21.15.49:0/1555233479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f00b3760 con 0x7f15f00b3d00 2024-01-31T05:05:19.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.621+0000 7f15ecc00640 1 -- 172.21.15.49:0/1555233479 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f15d80113f0 con 0x7f15f00b3d00 2024-01-31T05:05:19.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.621+0000 7f15ecc00640 1 --2- 172.21.15.49:0/1555233479 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f15c8066500 0x7f15c80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:19.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.621+0000 7f15ecc00640 1 -- 172.21.15.49:0/1555233479 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f15d80845b0 con 0x7f15f00b3d00 2024-01-31T05:05:19.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.621+0000 7f15f4e00640 1 --2- 172.21.15.49:0/1555233479 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f15c8066500 0x7f15c80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:19.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.621+0000 7f15f4e00640 1 --2- 172.21.15.49:0/1555233479 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f15c8066500 0x7f15c80689c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f15e00af000 tx=0x7f15e00b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:19.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.625+0000 7f15ecc00640 1 -- 172.21.15.49:0/1555233479 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f15d80515d0 con 0x7f15f00b3d00 2024-01-31T05:05:19.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.785+0000 7f15f7800640 1 -- 172.21.15.49:0/1555233479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f15f0074860 con 0x7f15f00b3d00 2024-01-31T05:05:19.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.785+0000 7f15ecc00640 1 -- 172.21.15.49:0/1555233479 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f15d8054bf0 con 0x7f15f00b3d00 2024-01-31T05:05:19.785 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-31T05:05:19.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.785+0000 7f15f7800640 1 -- 172.21.15.49:0/1555233479 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f15c8066500 msgr2=0x7f15c80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:19.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.785+0000 7f15f7800640 1 --2- 172.21.15.49:0/1555233479 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f15c8066500 0x7f15c80689c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f15e00af000 tx=0x7f15e00b6040 comp rx=0 tx=0).stop 2024-01-31T05:05:19.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.785+0000 7f15f7800640 1 -- 172.21.15.49:0/1555233479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15f00b3d00 msgr2=0x7f15f014f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:19.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.785+0000 7f15f7800640 1 --2- 172.21.15.49:0/1555233479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15f00b3d00 0x7f15f014f500 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f15d800c7c0 tx=0x7f15d800cc80 comp rx=0 tx=0).stop 2024-01-31T05:05:19.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.785+0000 7f15f7800640 1 -- 172.21.15.49:0/1555233479 shutdown_connections 2024-01-31T05:05:19.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.785+0000 7f15f7800640 1 --2- 172.21.15.49:0/1555233479 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f15f0159790 0x7f15f015c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.785+0000 7f15f7800640 1 --2- 172.21.15.49:0/1555233479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15f00b3d00 0x7f15f014f500 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.785+0000 7f15f7800640 1 --2- 172.21.15.49:0/1555233479 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f15c8066500 0x7f15c80689c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.785+0000 7f15f7800640 1 --2- 172.21.15.49:0/1555233479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15f0070ba0 0x7f15f00afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.785+0000 7f15f7800640 1 -- 172.21.15.49:0/1555233479 >> 172.21.15.49:0/1555233479 conn(0x7f15f00b09a0 msgr2=0x7f15f0156ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:19.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.785+0000 7f15f7800640 1 -- 172.21.15.49:0/1555233479 shutdown_connections 2024-01-31T05:05:19.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.785+0000 7f15f7800640 1 -- 172.21.15.49:0/1555233479 wait complete. 2024-01-31T05:05:19.808 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-31T05:05:19.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.953+0000 7f4ed1000640 1 Processor -- start 2024-01-31T05:05:19.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.953+0000 7f4ed1000640 1 -- start start 2024-01-31T05:05:19.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.953+0000 7f4ed1000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ecc0cd680 0x7f4ecc0cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:19.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.953+0000 7f4ed1000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4ecc15b3e0 0x7f4ecc0cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:19.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.953+0000 7f4ed1000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ecc0ccd50 con 0x7f4ecc0ce4e0 2024-01-31T05:05:19.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.953+0000 7f4ed1000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ecc0cc790 con 0x7f4ecc15b3e0 2024-01-31T05:05:19.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.953+0000 7f4ed1000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc0cca70 con 0x7f4ecc0cd680 2024-01-31T05:05:19.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.953+0000 7f4ec9400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4ecc15b3e0 0x7f4ecc0cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:19.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.953+0000 7f4ec9400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4ecc15b3e0 0x7f4ecc0cdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34748/0 (socket says 172.21.15.49:34748) 2024-01-31T05:05:19.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.953+0000 7f4ec9400640 1 -- 172.21.15.49:0/1151259296 learned_addr learned my addr 172.21.15.49:0/1151259296 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:19.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.953+0000 7f4ec9400640 1 -- 172.21.15.49:0/1151259296 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ecc0cd680 msgr2=0x7f4ecc0cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:19.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.953+0000 7f4ec9400640 1 --2- 172.21.15.49:0/1151259296 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ecc0cd680 0x7f4ecc0cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.953+0000 7f4ec9400640 1 -- 172.21.15.49:0/1151259296 >> v1:172.21.15.195:6789/0 conn(0x7f4ecc0ce4e0 legacy=0x7f4ecc0ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:19.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.953+0000 7f4ec9400640 1 -- 172.21.15.49:0/1151259296 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc0adcd0 con 0x7f4ecc15b3e0 2024-01-31T05:05:19.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.957+0000 7f4ec9400640 1 --2- 172.21.15.49:0/1151259296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ecc15b3e0 0x7f4ecc0cdfa0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4009870 tx=0x7f4eb401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8237c3aa2d40de41 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:19.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.957+0000 7f4ec8a00640 1 -- 172.21.15.49:0/1151259296 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb40ac620 con 0x7f4ecc15b3e0 2024-01-31T05:05:19.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.957+0000 7f4ec8a00640 1 -- 172.21.15.49:0/1151259296 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb40ac780 con 0x7f4ecc15b3e0 2024-01-31T05:05:19.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.957+0000 7f4ec8a00640 1 -- 172.21.15.49:0/1151259296 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb40acb10 con 0x7f4ecc15b3e0 2024-01-31T05:05:19.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.957+0000 7f4ed1000640 1 -- 172.21.15.49:0/1151259296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ecc15b3e0 msgr2=0x7f4ecc0cdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:19.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.957+0000 7f4ed1000640 1 --2- 172.21.15.49:0/1151259296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ecc15b3e0 0x7f4ecc0cdfa0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4009870 tx=0x7f4eb401c440 comp rx=0 tx=0).stop 2024-01-31T05:05:19.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.957+0000 7f4ed1000640 1 -- 172.21.15.49:0/1151259296 shutdown_connections 2024-01-31T05:05:19.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.957+0000 7f4ed1000640 1 --2- 172.21.15.49:0/1151259296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ecc15b3e0 0x7f4ecc0cdfa0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.957+0000 7f4ed1000640 1 --2- 172.21.15.49:0/1151259296 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ecc0cd680 0x7f4ecc0cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.957+0000 7f4ed1000640 1 -- 172.21.15.49:0/1151259296 >> 172.21.15.49:0/1151259296 conn(0x7f4ecc0b28e0 msgr2=0x7f4ecc0b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:19.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4ed1000640 1 -- 172.21.15.49:0/1151259296 shutdown_connections 2024-01-31T05:05:19.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4ed1000640 1 -- 172.21.15.49:0/1151259296 wait complete. 2024-01-31T05:05:19.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4ed1000640 1 Processor -- start 2024-01-31T05:05:19.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4ed1000640 1 -- start start 2024-01-31T05:05:19.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4ed1000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ecc0cd680 0x7f4ecc0c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:19.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4ed1000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ecc0ce4e0 0x7f4ecc0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:19.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4ed1000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ecc15b3e0 0x7f4ecc156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:19.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4ed1000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc0c7660 con 0x7f4ecc15b3e0 2024-01-31T05:05:19.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4ed1000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc0c4d70 con 0x7f4ecc0cd680 2024-01-31T05:05:19.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4ed1000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc0c5050 con 0x7f4ecc0ce4e0 2024-01-31T05:05:19.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4eca800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ecc15b3e0 0x7f4ecc156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:19.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4eca800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ecc15b3e0 0x7f4ecc156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34756/0 (socket says 172.21.15.49:34756) 2024-01-31T05:05:19.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4eca800640 1 -- 172.21.15.49:0/3137984590 learned_addr learned my addr 172.21.15.49:0/3137984590 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:19.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4ec9e00640 1 --2- 172.21.15.49:0/3137984590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ecc0cd680 0x7f4ecc0c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:19.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4ec9400640 1 --2- 172.21.15.49:0/3137984590 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ecc0ce4e0 0x7f4ecc0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:19.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4eca800640 1 -- 172.21.15.49:0/3137984590 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ecc0ce4e0 msgr2=0x7f4ecc0b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:19.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4eca800640 1 --2- 172.21.15.49:0/3137984590 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ecc0ce4e0 0x7f4ecc0b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4eca800640 1 -- 172.21.15.49:0/3137984590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ecc0cd680 msgr2=0x7f4ecc0c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4eca800640 1 --2- 172.21.15.49:0/3137984590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ecc0cd680 0x7f4ecc0c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4eca800640 1 -- 172.21.15.49:0/3137984590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb40094d0 con 0x7f4ecc15b3e0 2024-01-31T05:05:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.961+0000 7f4ec9400640 1 --2- 172.21.15.49:0/3137984590 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ecc0ce4e0 0x7f4ecc0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:19.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.965+0000 7f4eca800640 1 --2- 172.21.15.49:0/3137984590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ecc15b3e0 0x7f4ecc156350 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400c780 tx=0x7f4ec400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:19.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.965+0000 7f4ec2000640 1 -- 172.21.15.49:0/3137984590 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4003d90 con 0x7f4ecc15b3e0 2024-01-31T05:05:19.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.965+0000 7f4ec2000640 1 -- 172.21.15.49:0/3137984590 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec400ce30 con 0x7f4ecc15b3e0 2024-01-31T05:05:19.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.965+0000 7f4ed1000640 1 -- 172.21.15.49:0/3137984590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ecc0c5330 con 0x7f4ecc15b3e0 2024-01-31T05:05:19.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.965+0000 7f4ec2000640 1 -- 172.21.15.49:0/3137984590 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4005290 con 0x7f4ecc15b3e0 2024-01-31T05:05:19.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.965+0000 7f4ed1000640 1 -- 172.21.15.49:0/3137984590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ecc0c6e00 con 0x7f4ecc15b3e0 2024-01-31T05:05:19.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.965+0000 7f4ed1000640 1 -- 172.21.15.49:0/3137984590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ecc074860 con 0x7f4ecc15b3e0 2024-01-31T05:05:19.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.965+0000 7f4ec2000640 1 -- 172.21.15.49:0/3137984590 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f4ec40053f0 con 0x7f4ecc15b3e0 2024-01-31T05:05:19.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.965+0000 7f4ec2000640 1 --2- 172.21.15.49:0/3137984590 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4ea4066530 0x7f4ea40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:19.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.965+0000 7f4ec2000640 1 -- 172.21.15.49:0/3137984590 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4ec4083a90 con 0x7f4ecc15b3e0 2024-01-31T05:05:19.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.969+0000 7f4ec9e00640 1 --2- 172.21.15.49:0/3137984590 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4ea4066530 0x7f4ea40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:19.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.969+0000 7f4ec9e00640 1 --2- 172.21.15.49:0/3137984590 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4ea4066530 0x7f4ea40689f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc006fd0 tx=0x7f4ebc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:19.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:19.969+0000 7f4ec2000640 1 -- 172.21.15.49:0/3137984590 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f4ec4050960 con 0x7f4ecc15b3e0 2024-01-31T05:05:20.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.129+0000 7f4ed1000640 1 -- 172.21.15.49:0/3137984590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4ecc0c7910 con 0x7f4ecc15b3e0 2024-01-31T05:05:20.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.129+0000 7f4ec2000640 1 -- 172.21.15.49:0/3137984590 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4ec4017020 con 0x7f4ecc15b3e0 2024-01-31T05:05:20.130 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:20.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.129+0000 7f4ed1000640 1 -- 172.21.15.49:0/3137984590 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4ea4066530 msgr2=0x7f4ea40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:20.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.129+0000 7f4ed1000640 1 --2- 172.21.15.49:0/3137984590 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4ea4066530 0x7f4ea40689f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc006fd0 tx=0x7f4ebc008040 comp rx=0 tx=0).stop 2024-01-31T05:05:20.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.129+0000 7f4ed1000640 1 -- 172.21.15.49:0/3137984590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ecc15b3e0 msgr2=0x7f4ecc156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:20.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.129+0000 7f4ed1000640 1 --2- 172.21.15.49:0/3137984590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ecc15b3e0 0x7f4ecc156350 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400c780 tx=0x7f4ec400cc40 comp rx=0 tx=0).stop 2024-01-31T05:05:20.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.129+0000 7f4ed1000640 1 -- 172.21.15.49:0/3137984590 shutdown_connections 2024-01-31T05:05:20.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.129+0000 7f4ed1000640 1 --2- 172.21.15.49:0/3137984590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ecc15b3e0 0x7f4ecc156350 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.129+0000 7f4ed1000640 1 --2- 172.21.15.49:0/3137984590 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ecc0ce4e0 0x7f4ecc0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.129+0000 7f4ed1000640 1 --2- 172.21.15.49:0/3137984590 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4ea4066530 0x7f4ea40689f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.129+0000 7f4ed1000640 1 --2- 172.21.15.49:0/3137984590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ecc0cd680 0x7f4ecc0c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.129+0000 7f4ed1000640 1 -- 172.21.15.49:0/3137984590 >> 172.21.15.49:0/3137984590 conn(0x7f4ecc0b28e0 msgr2=0x7f4ecc06b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:20.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.133+0000 7f4ed1000640 1 -- 172.21.15.49:0/3137984590 shutdown_connections 2024-01-31T05:05:20.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.133+0000 7f4ed1000640 1 -- 172.21.15.49:0/3137984590 wait complete. 2024-01-31T05:05:20.152 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-31T05:05:20.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.297+0000 7f2f1ce00640 1 Processor -- start 2024-01-31T05:05:20.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.297+0000 7f2f1ce00640 1 -- start start 2024-01-31T05:05:20.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.297+0000 7f2f1ce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f1815d540 0x7f2f180cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:20.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.297+0000 7f2f1ce00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f180cbbc0 0x7f2f1815d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:20.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.297+0000 7f2f1ce00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f180cef80 con 0x7f2f1806c290 2024-01-31T05:05:20.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.297+0000 7f2f1ce00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1806cae0 con 0x7f2f180cbbc0 2024-01-31T05:05:20.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.297+0000 7f2f1ce00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f180cf1b0 con 0x7f2f1815d540 2024-01-31T05:05:20.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.297+0000 7f2f16800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f180cbbc0 0x7f2f1815d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.297+0000 7f2f15e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f1815d540 0x7f2f180cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.297+0000 7f2f16800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f180cbbc0 0x7f2f1815d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34762/0 (socket says 172.21.15.49:34762) 2024-01-31T05:05:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.297+0000 7f2f16800640 1 -- 172.21.15.49:0/1869597746 learned_addr learned my addr 172.21.15.49:0/1869597746 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.297+0000 7f2f15400640 1 --1- 172.21.15.49:0/1869597746 >> v1:172.21.15.195:6789/0 conn(0x7f2f1806c290 0x7f2f180cb4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:39528/0 (socket says 172.21.15.49:39528) 2024-01-31T05:05:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.297+0000 7f2f16800640 1 -- 172.21.15.49:0/1869597746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f1815d540 msgr2=0x7f2f180cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.297+0000 7f2f16800640 1 --2- 172.21.15.49:0/1869597746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f1815d540 0x7f2f180cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.297+0000 7f2f16800640 1 -- 172.21.15.49:0/1869597746 >> v1:172.21.15.195:6789/0 conn(0x7f2f1806c290 legacy=0x7f2f180cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:20.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.297+0000 7f2f16800640 1 -- 172.21.15.49:0/1869597746 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f180cf490 con 0x7f2f180cbbc0 2024-01-31T05:05:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.301+0000 7f2f16800640 1 --2- 172.21.15.49:0/1869597746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f180cbbc0 0x7f2f1815d920 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2f10009e50 tx=0x7f2f1001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2102498fb84ffd server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.301+0000 7f2f14a00640 1 -- 172.21.15.49:0/1869597746 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f100a58a0 con 0x7f2f180cbbc0 2024-01-31T05:05:20.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.301+0000 7f2f14a00640 1 -- 172.21.15.49:0/1869597746 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f100a5a00 con 0x7f2f180cbbc0 2024-01-31T05:05:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.301+0000 7f2f14a00640 1 -- 172.21.15.49:0/1869597746 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f100a5d90 con 0x7f2f180cbbc0 2024-01-31T05:05:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.301+0000 7f2f1ce00640 1 -- 172.21.15.49:0/1869597746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f180cbbc0 msgr2=0x7f2f1815d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:20.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.301+0000 7f2f1ce00640 1 --2- 172.21.15.49:0/1869597746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f180cbbc0 0x7f2f1815d920 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2f10009e50 tx=0x7f2f1001c9e0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.301+0000 7f2f1ce00640 1 -- 172.21.15.49:0/1869597746 shutdown_connections 2024-01-31T05:05:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.301+0000 7f2f1ce00640 1 --2- 172.21.15.49:0/1869597746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f180cbbc0 0x7f2f1815d920 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.301+0000 7f2f1ce00640 1 --2- 172.21.15.49:0/1869597746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f1815d540 0x7f2f180cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.301+0000 7f2f1ce00640 1 -- 172.21.15.49:0/1869597746 >> 172.21.15.49:0/1869597746 conn(0x7f2f180d0e60 msgr2=0x7f2f180d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.301+0000 7f2f1ce00640 1 -- 172.21.15.49:0/1869597746 shutdown_connections 2024-01-31T05:05:20.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.301+0000 7f2f1ce00640 1 -- 172.21.15.49:0/1869597746 wait complete. 2024-01-31T05:05:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f1ce00640 1 Processor -- start 2024-01-31T05:05:20.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f1ce00640 1 -- start start 2024-01-31T05:05:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f1ce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f1806c290 0x7f2f181523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f1ce00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f180cbbc0 0x7f2f180b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f1ce00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f1815d540 0x7f2f1814fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f1ce00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f180b4df0 con 0x7f2f180cbbc0 2024-01-31T05:05:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f1ce00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f180b6110 con 0x7f2f1815d540 2024-01-31T05:05:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f1ce00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f18158a30 con 0x7f2f1806c290 2024-01-31T05:05:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f15400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f180cbbc0 0x7f2f180b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f15400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f180cbbc0 0x7f2f180b39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34776/0 (socket says 172.21.15.49:34776) 2024-01-31T05:05:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f15400640 1 -- 172.21.15.49:0/1471852386 learned_addr learned my addr 172.21.15.49:0/1471852386 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f15e00640 1 --2- 172.21.15.49:0/1471852386 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f1806c290 0x7f2f181523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f16800640 1 --2- 172.21.15.49:0/1471852386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f1815d540 0x7f2f1814fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:20.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f15400640 1 -- 172.21.15.49:0/1471852386 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f1806c290 msgr2=0x7f2f181523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f15400640 1 --2- 172.21.15.49:0/1471852386 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f1806c290 0x7f2f181523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f15400640 1 -- 172.21.15.49:0/1471852386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f1815d540 msgr2=0x7f2f1814fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f15400640 1 --2- 172.21.15.49:0/1471852386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f1815d540 0x7f2f1814fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f15400640 1 -- 172.21.15.49:0/1471852386 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f10009b30 con 0x7f2f180cbbc0 2024-01-31T05:05:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f15400640 1 --2- 172.21.15.49:0/1471852386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f180cbbc0 0x7f2f180b39d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000c420 tx=0x7f2f0000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f0e000640 1 -- 172.21.15.49:0/1471852386 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f000074e0 con 0x7f2f180cbbc0 2024-01-31T05:05:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f0e000640 1 -- 172.21.15.49:0/1471852386 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f00007640 con 0x7f2f180cbbc0 2024-01-31T05:05:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f0e000640 1 -- 172.21.15.49:0/1471852386 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00004a30 con 0x7f2f180cbbc0 2024-01-31T05:05:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f1ce00640 1 -- 172.21.15.49:0/1471852386 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f180b57e0 con 0x7f2f180cbbc0 2024-01-31T05:05:20.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.305+0000 7f2f1ce00640 1 -- 172.21.15.49:0/1471852386 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f180b5da0 con 0x7f2f180cbbc0 2024-01-31T05:05:20.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.309+0000 7f2f1ce00640 1 -- 172.21.15.49:0/1471852386 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f180ce880 con 0x7f2f180cbbc0 2024-01-31T05:05:20.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.309+0000 7f2f0e000640 1 -- 172.21.15.49:0/1471852386 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f2f00004b90 con 0x7f2f180cbbc0 2024-01-31T05:05:20.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.309+0000 7f2f0e000640 1 --2- 172.21.15.49:0/1471852386 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2ef0066500 0x7f2ef00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:20.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.309+0000 7f2f0e000640 1 -- 172.21.15.49:0/1471852386 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2f00083b70 con 0x7f2f180cbbc0 2024-01-31T05:05:20.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.309+0000 7f2f15e00640 1 --2- 172.21.15.49:0/1471852386 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2ef0066500 0x7f2ef00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:20.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.309+0000 7f2f15e00640 1 --2- 172.21.15.49:0/1471852386 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2ef0066500 0x7f2ef00689c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009ac0 tx=0x7f2f08009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:20.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.313+0000 7f2f0e000640 1 -- 172.21.15.49:0/1471852386 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f2f00050af0 con 0x7f2f180cbbc0 2024-01-31T05:05:20.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.489+0000 7f2f1ce00640 1 -- 172.21.15.49:0/1471852386 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2f18067c80 con 0x7f2f180cbbc0 2024-01-31T05:05:20.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.489+0000 7f2f0e000640 1 -- 172.21.15.49:0/1471852386 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2f00054110 con 0x7f2f180cbbc0 2024-01-31T05:05:20.629 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2024-01-31T05:05:20.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.493+0000 7f2f1ce00640 1 -- 172.21.15.49:0/1471852386 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2ef0066500 msgr2=0x7f2ef00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:20.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.493+0000 7f2f1ce00640 1 --2- 172.21.15.49:0/1471852386 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2ef0066500 0x7f2ef00689c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009ac0 tx=0x7f2f08009190 comp rx=0 tx=0).stop 2024-01-31T05:05:20.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.493+0000 7f2f1ce00640 1 -- 172.21.15.49:0/1471852386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f180cbbc0 msgr2=0x7f2f180b39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:20.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.493+0000 7f2f1ce00640 1 --2- 172.21.15.49:0/1471852386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f180cbbc0 0x7f2f180b39d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000c420 tx=0x7f2f0000c8e0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.493+0000 7f2f1ce00640 1 -- 172.21.15.49:0/1471852386 shutdown_connections 2024-01-31T05:05:20.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.493+0000 7f2f1ce00640 1 --2- 172.21.15.49:0/1471852386 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2ef0066500 0x7f2ef00689c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.493+0000 7f2f1ce00640 1 --2- 172.21.15.49:0/1471852386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f1815d540 0x7f2f1814fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.493+0000 7f2f1ce00640 1 --2- 172.21.15.49:0/1471852386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f180cbbc0 0x7f2f180b39d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.493+0000 7f2f1ce00640 1 --2- 172.21.15.49:0/1471852386 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f1806c290 0x7f2f181523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.493+0000 7f2f1ce00640 1 -- 172.21.15.49:0/1471852386 >> 172.21.15.49:0/1471852386 conn(0x7f2f180d0e60 msgr2=0x7f2f180ccb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:20.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.493+0000 7f2f1ce00640 1 -- 172.21.15.49:0/1471852386 shutdown_connections 2024-01-31T05:05:20.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.493+0000 7f2f1ce00640 1 -- 172.21.15.49:0/1471852386 wait complete. 2024-01-31T05:05:20.631 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi195.front.sepia.ceph.com... 2024-01-31T05:05:20.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:20.631 DEBUG:teuthology.orchestra.run.smithi195:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-01-31T05:05:20.688 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T05:05:20.688 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-01-31T05:05:20.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:20.689 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-31T05:05:20.707 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:05:20.707 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T05:05:20.716 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:05:20.716 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T05:05:20.768 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:20.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.953+0000 7f7aefa00640 1 Processor -- start 2024-01-31T05:05:20.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.953+0000 7f7aefa00640 1 -- start start 2024-01-31T05:05:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.953+0000 7f7aefa00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7ae815d540 0x7f7ae80cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.953+0000 7f7aefa00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7ae80cbbc0 0x7f7ae815d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.953+0000 7f7aefa00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae80cef80 con 0x7f7ae806c290 2024-01-31T05:05:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.953+0000 7f7aefa00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae806cae0 con 0x7f7ae80cbbc0 2024-01-31T05:05:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.953+0000 7f7aefa00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae80cf1b0 con 0x7f7ae815d540 2024-01-31T05:05:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.953+0000 7f7aeda00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7ae80cbbc0 0x7f7ae815d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.953+0000 7f7ae7e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f7ae806c290 0x7f7ae80cb4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57914/0 (socket says 172.21.15.49:57914) 2024-01-31T05:05:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.953+0000 7f7ae7e00640 1 -- 172.21.15.49:0/631409421 learned_addr learned my addr 172.21.15.49:0/631409421 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.953+0000 7f7aed000640 1 --2- 172.21.15.49:0/631409421 >> v2:172.21.15.195:3300/0 conn(0x7f7ae815d540 0x7f7ae80cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.953+0000 7f7aeda00640 1 -- 172.21.15.49:0/631409421 >> v2:172.21.15.195:3300/0 conn(0x7f7ae815d540 msgr2=0x7f7ae80cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.953+0000 7f7aeda00640 1 --2- 172.21.15.49:0/631409421 >> v2:172.21.15.195:3300/0 conn(0x7f7ae815d540 0x7f7ae80cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.953+0000 7f7aeda00640 1 -- 172.21.15.49:0/631409421 >> v1:172.21.15.49:6789/0 conn(0x7f7ae806c290 legacy=0x7f7ae80cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.953+0000 7f7aeda00640 1 -- 172.21.15.49:0/631409421 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae80cf490 con 0x7f7ae80cbbc0 2024-01-31T05:05:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.957+0000 7f7aeda00640 1 --2- 172.21.15.49:0/631409421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae80cbbc0 0x7f7ae815d920 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8071f60 tx=0x7f7ae001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb2257ddeb10fc8 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.957+0000 7f7ae7400640 1 -- 172.21.15.49:0/631409421 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae00a59a0 con 0x7f7ae80cbbc0 2024-01-31T05:05:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.957+0000 7f7ae7400640 1 -- 172.21.15.49:0/631409421 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae00a5b00 con 0x7f7ae80cbbc0 2024-01-31T05:05:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.957+0000 7f7ae7400640 1 -- 172.21.15.49:0/631409421 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae00a5e90 con 0x7f7ae80cbbc0 2024-01-31T05:05:20.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.957+0000 7f7aefa00640 1 -- 172.21.15.49:0/631409421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae80cbbc0 msgr2=0x7f7ae815d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:20.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.957+0000 7f7aefa00640 1 --2- 172.21.15.49:0/631409421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae80cbbc0 0x7f7ae815d920 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8071f60 tx=0x7f7ae001c8e0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.957+0000 7f7aefa00640 1 -- 172.21.15.49:0/631409421 shutdown_connections 2024-01-31T05:05:20.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.957+0000 7f7aefa00640 1 --2- 172.21.15.49:0/631409421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae80cbbc0 0x7f7ae815d920 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.957+0000 7f7aefa00640 1 --2- 172.21.15.49:0/631409421 >> v2:172.21.15.195:3300/0 conn(0x7f7ae815d540 0x7f7ae80cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.957+0000 7f7aefa00640 1 -- 172.21.15.49:0/631409421 >> 172.21.15.49:0/631409421 conn(0x7f7ae80d0e60 msgr2=0x7f7ae80d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:20.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.957+0000 7f7aefa00640 1 -- 172.21.15.49:0/631409421 shutdown_connections 2024-01-31T05:05:20.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.957+0000 7f7aefa00640 1 -- 172.21.15.49:0/631409421 wait complete. 2024-01-31T05:05:20.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aefa00640 1 Processor -- start 2024-01-31T05:05:20.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aefa00640 1 -- start start 2024-01-31T05:05:20.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aefa00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ae806c290 0x7f7ae814dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:20.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aefa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7ae80cbbc0 0x7f7ae81569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aefa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae815d540 0x7f7ae814ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aefa00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae8150c20 con 0x7f7ae815d540 2024-01-31T05:05:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aefa00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae8150e30 con 0x7f7ae806c290 2024-01-31T05:05:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aefa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae8151110 con 0x7f7ae80cbbc0 2024-01-31T05:05:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aeda00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae815d540 0x7f7ae814ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aeda00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae815d540 0x7f7ae814ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34790/0 (socket says 172.21.15.49:34790) 2024-01-31T05:05:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aeda00640 1 -- 172.21.15.49:0/1031809498 learned_addr learned my addr 172.21.15.49:0/1031809498 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aed000640 1 --2- 172.21.15.49:0/1031809498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ae806c290 0x7f7ae814dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7ae7e00640 1 --2- 172.21.15.49:0/1031809498 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7ae80cbbc0 0x7f7ae81569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aeda00640 1 -- 172.21.15.49:0/1031809498 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7ae80cbbc0 msgr2=0x7f7ae81569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aeda00640 1 --2- 172.21.15.49:0/1031809498 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7ae80cbbc0 0x7f7ae81569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aeda00640 1 -- 172.21.15.49:0/1031809498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ae806c290 msgr2=0x7f7ae814dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aeda00640 1 --2- 172.21.15.49:0/1031809498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ae806c290 0x7f7ae814dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aeda00640 1 -- 172.21.15.49:0/1031809498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae0009a70 con 0x7f7ae815d540 2024-01-31T05:05:20.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aeda00640 1 --2- 172.21.15.49:0/1031809498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae815d540 0x7f7ae814ec20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7ae00194f0 tx=0x7f7ae0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:20.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7ae4c00640 1 -- 172.21.15.49:0/1031809498 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae00ade20 con 0x7f7ae815d540 2024-01-31T05:05:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7ae4c00640 1 -- 172.21.15.49:0/1031809498 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae0009450 con 0x7f7ae815d540 2024-01-31T05:05:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7ae4c00640 1 -- 172.21.15.49:0/1031809498 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae00b9690 con 0x7f7ae815d540 2024-01-31T05:05:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aefa00640 1 -- 172.21.15.49:0/1031809498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae81513f0 con 0x7f7ae815d540 2024-01-31T05:05:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.961+0000 7f7aefa00640 1 -- 172.21.15.49:0/1031809498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae815abe0 con 0x7f7ae815d540 2024-01-31T05:05:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.965+0000 7f7aefa00640 1 -- 172.21.15.49:0/1031809498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae80ce880 con 0x7f7ae815d540 2024-01-31T05:05:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.965+0000 7f7ae4c00640 1 -- 172.21.15.49:0/1031809498 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f7ae00b97f0 con 0x7f7ae815d540 2024-01-31T05:05:20.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.965+0000 7f7ae4c00640 1 --2- 172.21.15.49:0/1031809498 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7ac0066500 0x7f7ac00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:20.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.965+0000 7f7ae4c00640 1 -- 172.21.15.49:0/1031809498 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7ae011fa30 con 0x7f7ae815d540 2024-01-31T05:05:20.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.965+0000 7f7aed000640 1 --2- 172.21.15.49:0/1031809498 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7ac0066500 0x7f7ac00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:20.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.965+0000 7f7aed000640 1 --2- 172.21.15.49:0/1031809498 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7ac0066500 0x7f7ac00689c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80079c0 tx=0x7f7ad8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:20.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:20.969+0000 7f7ae4c00640 1 -- 172.21.15.49:0/1031809498 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f7ae00eca40 con 0x7f7ae815d540 2024-01-31T05:05:21.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.133+0000 7f7aefa00640 1 -- 172.21.15.49:0/1031809498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ae8150f70 con 0x7f7ae815d540 2024-01-31T05:05:21.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.133+0000 7f7ae4c00640 1 -- 172.21.15.49:0/1031809498 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7f7ae8150f70 con 0x7f7ae815d540 2024-01-31T05:05:21.135 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:21.135 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:58.277568+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:21.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.137+0000 7f7aefa00640 1 -- 172.21.15.49:0/1031809498 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7ac0066500 msgr2=0x7f7ac00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:21.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.137+0000 7f7aefa00640 1 --2- 172.21.15.49:0/1031809498 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7ac0066500 0x7f7ac00689c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80079c0 tx=0x7f7ad8008040 comp rx=0 tx=0).stop 2024-01-31T05:05:21.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.137+0000 7f7aefa00640 1 -- 172.21.15.49:0/1031809498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae815d540 msgr2=0x7f7ae814ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:21.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.137+0000 7f7aefa00640 1 --2- 172.21.15.49:0/1031809498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae815d540 0x7f7ae814ec20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7ae00194f0 tx=0x7f7ae0019680 comp rx=0 tx=0).stop 2024-01-31T05:05:21.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.137+0000 7f7aefa00640 1 -- 172.21.15.49:0/1031809498 shutdown_connections 2024-01-31T05:05:21.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.137+0000 7f7aefa00640 1 --2- 172.21.15.49:0/1031809498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae815d540 0x7f7ae814ec20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.137+0000 7f7aefa00640 1 --2- 172.21.15.49:0/1031809498 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7ae80cbbc0 0x7f7ae81569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.137+0000 7f7aefa00640 1 --2- 172.21.15.49:0/1031809498 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7ac0066500 0x7f7ac00689c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.137+0000 7f7aefa00640 1 --2- 172.21.15.49:0/1031809498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ae806c290 0x7f7ae814dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.137+0000 7f7aefa00640 1 -- 172.21.15.49:0/1031809498 >> 172.21.15.49:0/1031809498 conn(0x7f7ae80d0e60 msgr2=0x7f7ae815bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:21.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.137+0000 7f7aefa00640 1 -- 172.21.15.49:0/1031809498 shutdown_connections 2024-01-31T05:05:21.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.137+0000 7f7aefa00640 1 -- 172.21.15.49:0/1031809498 wait complete. 2024-01-31T05:05:21.157 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:04:14.566345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:04:15.231265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-31T05:04:18.316756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-31T05:05:21.158 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:05:21.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.301+0000 7fb544e00640 1 Processor -- start 2024-01-31T05:05:21.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.301+0000 7fb544e00640 1 -- start start 2024-01-31T05:05:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.301+0000 7fb544e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb540157610 0x7fb5400b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.301+0000 7fb544e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb54015d7d0 0x7fb540070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.301+0000 7fb544e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb5400713f0 0x7fb540160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.301+0000 7fb544e00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb540071840 con 0x7fb540157610 2024-01-31T05:05:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.301+0000 7fb544e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54006dec0 con 0x7fb5400713f0 2024-01-31T05:05:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.301+0000 7fb544e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400b2fb0 con 0x7fb54015d7d0 2024-01-31T05:05:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.301+0000 7fb53de00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb540157610 0x7fb5400b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.301+0000 7fb53de00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb540157610 0x7fb5400b26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34792/0 (socket says 172.21.15.49:34792) 2024-01-31T05:05:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.301+0000 7fb53de00640 1 -- 172.21.15.49:0/1603123330 learned_addr learned my addr 172.21.15.49:0/1603123330 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.301+0000 7fb53e800640 1 --2- 172.21.15.49:0/1603123330 >> v2:172.21.15.195:3300/0 conn(0x7fb5400713f0 0x7fb540160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.301+0000 7fb53d400640 1 --2- 172.21.15.49:0/1603123330 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb54015d7d0 0x7fb540070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.301+0000 7fb53de00640 1 -- 172.21.15.49:0/1603123330 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb54015d7d0 msgr2=0x7fb540070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.301+0000 7fb53de00640 1 --2- 172.21.15.49:0/1603123330 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb54015d7d0 0x7fb540070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.301+0000 7fb53de00640 1 -- 172.21.15.49:0/1603123330 >> v2:172.21.15.195:3300/0 conn(0x7fb5400713f0 msgr2=0x7fb540160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.301+0000 7fb53de00640 1 --2- 172.21.15.49:0/1603123330 >> v2:172.21.15.195:3300/0 conn(0x7fb5400713f0 0x7fb540160ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.301+0000 7fb53de00640 1 -- 172.21.15.49:0/1603123330 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5400b3290 con 0x7fb540157610 2024-01-31T05:05:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.301+0000 7fb53e800640 1 --2- 172.21.15.49:0/1603123330 >> v2:172.21.15.195:3300/0 conn(0x7fb5400713f0 0x7fb540160ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:21.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.305+0000 7fb53de00640 1 --2- 172.21.15.49:0/1603123330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb540157610 0x7fb5400b26b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb54006d8d0 tx=0x7fb53001c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740855a74e3f382f server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:21.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.305+0000 7fb53ca00640 1 -- 172.21.15.49:0/1603123330 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5300ab600 con 0x7fb540157610 2024-01-31T05:05:21.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.305+0000 7fb53ca00640 1 -- 172.21.15.49:0/1603123330 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5300a7050 con 0x7fb540157610 2024-01-31T05:05:21.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.305+0000 7fb53ca00640 1 -- 172.21.15.49:0/1603123330 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5300ab980 con 0x7fb540157610 2024-01-31T05:05:21.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.305+0000 7fb544e00640 1 -- 172.21.15.49:0/1603123330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb540157610 msgr2=0x7fb5400b26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:21.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.305+0000 7fb544e00640 1 --2- 172.21.15.49:0/1603123330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb540157610 0x7fb5400b26b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb54006d8d0 tx=0x7fb53001c180 comp rx=0 tx=0).stop 2024-01-31T05:05:21.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.305+0000 7fb544e00640 1 -- 172.21.15.49:0/1603123330 shutdown_connections 2024-01-31T05:05:21.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.305+0000 7fb544e00640 1 --2- 172.21.15.49:0/1603123330 >> v2:172.21.15.195:3300/0 conn(0x7fb5400713f0 0x7fb540160ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.305+0000 7fb544e00640 1 --2- 172.21.15.49:0/1603123330 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb54015d7d0 0x7fb540070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.305+0000 7fb544e00640 1 --2- 172.21.15.49:0/1603123330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb540157610 0x7fb5400b26b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.305+0000 7fb544e00640 1 -- 172.21.15.49:0/1603123330 >> 172.21.15.49:0/1603123330 conn(0x7fb54006a940 msgr2=0x7fb54006ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:21.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.305+0000 7fb544e00640 1 -- 172.21.15.49:0/1603123330 shutdown_connections 2024-01-31T05:05:21.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.305+0000 7fb544e00640 1 -- 172.21.15.49:0/1603123330 wait complete. 2024-01-31T05:05:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb544e00640 1 Processor -- start 2024-01-31T05:05:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb544e00640 1 -- start start 2024-01-31T05:05:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb544e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5400713f0 0x7fb54014e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb544e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb540157610 0x7fb54015ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb544e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb54015d7d0 0x7fb5401545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb544e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54014fd10 con 0x7fb5400713f0 2024-01-31T05:05:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb544e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54014ea50 con 0x7fb54015d7d0 2024-01-31T05:05:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb544e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54015f250 con 0x7fb540157610 2024-01-31T05:05:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb53de00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5400713f0 0x7fb54014e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb53de00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5400713f0 0x7fb54014e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34804/0 (socket says 172.21.15.49:34804) 2024-01-31T05:05:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb53de00640 1 -- 172.21.15.49:0/2134142031 learned_addr learned my addr 172.21.15.49:0/2134142031 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:21.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb53d400640 1 --2- 172.21.15.49:0/2134142031 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb540157610 0x7fb54015ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:21.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb53e800640 1 --2- 172.21.15.49:0/2134142031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb54015d7d0 0x7fb5401545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:21.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb53de00640 1 -- 172.21.15.49:0/2134142031 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb540157610 msgr2=0x7fb54015ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:21.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb53de00640 1 --2- 172.21.15.49:0/2134142031 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb540157610 0x7fb54015ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb53de00640 1 -- 172.21.15.49:0/2134142031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb54015d7d0 msgr2=0x7fb5401545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:21.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb53de00640 1 --2- 172.21.15.49:0/2134142031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb54015d7d0 0x7fb5401545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb53de00640 1 -- 172.21.15.49:0/2134142031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5300094d0 con 0x7fb5400713f0 2024-01-31T05:05:21.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb53de00640 1 --2- 172.21.15.49:0/2134142031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5400713f0 0x7fb54014e510 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb53001ca20 tx=0x7fb53001a9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:21.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb536000640 1 -- 172.21.15.49:0/2134142031 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5300b6620 con 0x7fb5400713f0 2024-01-31T05:05:21.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb536000640 1 -- 172.21.15.49:0/2134142031 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5300b6780 con 0x7fb5400713f0 2024-01-31T05:05:21.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb536000640 1 -- 172.21.15.49:0/2134142031 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5300b6b10 con 0x7fb5400713f0 2024-01-31T05:05:21.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.309+0000 7fb544e00640 1 -- 172.21.15.49:0/2134142031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb540153860 con 0x7fb5400713f0 2024-01-31T05:05:21.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.313+0000 7fb544e00640 1 -- 172.21.15.49:0/2134142031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb540153e20 con 0x7fb5400713f0 2024-01-31T05:05:21.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.313+0000 7fb544e00640 1 -- 172.21.15.49:0/2134142031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54006b700 con 0x7fb5400713f0 2024-01-31T05:05:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.313+0000 7fb536000640 1 -- 172.21.15.49:0/2134142031 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb5300b2040 con 0x7fb5400713f0 2024-01-31T05:05:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.313+0000 7fb536000640 1 --2- 172.21.15.49:0/2134142031 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb518066500 0x7fb5180689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.313+0000 7fb536000640 1 -- 172.21.15.49:0/2134142031 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb53011e770 con 0x7fb5400713f0 2024-01-31T05:05:21.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.313+0000 7fb53d400640 1 --2- 172.21.15.49:0/2134142031 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb518066500 0x7fb5180689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:21.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.313+0000 7fb53d400640 1 --2- 172.21.15.49:0/2134142031 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb518066500 0x7fb5180689c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb540152130 tx=0x7fb528008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:21.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.317+0000 7fb536000640 1 -- 172.21.15.49:0/2134142031 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fb5300eb660 con 0x7fb5400713f0 2024-01-31T05:05:21.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.477+0000 7fb544e00640 1 -- 172.21.15.49:0/2134142031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb5400cb8a0 con 0x7fb5400713f0 2024-01-31T05:05:21.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.481+0000 7fb536000640 1 -- 172.21.15.49:0/2134142031 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb5300eec80 con 0x7fb5400713f0 2024-01-31T05:05:21.480 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:05:21.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.481+0000 7fb544e00640 1 -- 172.21.15.49:0/2134142031 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb518066500 msgr2=0x7fb5180689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:21.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.481+0000 7fb544e00640 1 --2- 172.21.15.49:0/2134142031 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb518066500 0x7fb5180689c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb540152130 tx=0x7fb528008040 comp rx=0 tx=0).stop 2024-01-31T05:05:21.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.481+0000 7fb544e00640 1 -- 172.21.15.49:0/2134142031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5400713f0 msgr2=0x7fb54014e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:21.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.481+0000 7fb544e00640 1 --2- 172.21.15.49:0/2134142031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5400713f0 0x7fb54014e510 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb53001ca20 tx=0x7fb53001a9c0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.481+0000 7fb544e00640 1 -- 172.21.15.49:0/2134142031 shutdown_connections 2024-01-31T05:05:21.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.481+0000 7fb544e00640 1 --2- 172.21.15.49:0/2134142031 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb518066500 0x7fb5180689c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.481+0000 7fb544e00640 1 --2- 172.21.15.49:0/2134142031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb54015d7d0 0x7fb5401545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.481+0000 7fb544e00640 1 --2- 172.21.15.49:0/2134142031 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb540157610 0x7fb54015ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.481+0000 7fb544e00640 1 --2- 172.21.15.49:0/2134142031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5400713f0 0x7fb54014e510 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.481+0000 7fb544e00640 1 -- 172.21.15.49:0/2134142031 >> 172.21.15.49:0/2134142031 conn(0x7fb54006a940 msgr2=0x7fb540160ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:21.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.481+0000 7fb544e00640 1 -- 172.21.15.49:0/2134142031 shutdown_connections 2024-01-31T05:05:21.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.481+0000 7fb544e00640 1 -- 172.21.15.49:0/2134142031 wait complete. 2024-01-31T05:05:21.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:05:21.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.645+0000 7f6d3b400640 1 Processor -- start 2024-01-31T05:05:21.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.645+0000 7f6d3b400640 1 -- start start 2024-01-31T05:05:21.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.649+0000 7f6d3b400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6d340b30e0 0x7f6d3415e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:21.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.649+0000 7f6d3b400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d340703c0 con 0x7f6d340b34c0 2024-01-31T05:05:21.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.649+0000 7f6d3b400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d340b1dd0 con 0x7f6d3406c2d0 2024-01-31T05:05:21.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.649+0000 7f6d3b400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d34070610 con 0x7f6d340b30e0 2024-01-31T05:05:21.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.649+0000 7f6d38a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6d340b30e0 0x7f6d3415e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:21.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.649+0000 7f6d38a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6d340b30e0 0x7f6d3415e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34812/0 (socket says 172.21.15.49:34812) 2024-01-31T05:05:21.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.649+0000 7f6d33e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f6d340b34c0 0x7f6d340720e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57920/0 (socket says 172.21.15.49:57920) 2024-01-31T05:05:21.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.649+0000 7f6d38a00640 1 -- 172.21.15.49:0/1898401380 learned_addr learned my addr 172.21.15.49:0/1898401380 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:21.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.649+0000 7f6d38a00640 1 -- 172.21.15.49:0/1898401380 >> v1:172.21.15.195:6789/0 conn(0x7f6d3406c2d0 legacy=0x7f6d340b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:21.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.649+0000 7f6d38a00640 1 -- 172.21.15.49:0/1898401380 >> v1:172.21.15.49:6789/0 conn(0x7f6d340b34c0 legacy=0x7f6d340720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:21.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.649+0000 7f6d33400640 1 -- 172.21.15.49:0/1898401380 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536400449 0 0) 0x7f6d340703c0 con 0x7f6d340b34c0 2024-01-31T05:05:21.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.649+0000 7f6d38a00640 1 -- 172.21.15.49:0/1898401380 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d340708f0 con 0x7f6d340b30e0 2024-01-31T05:05:21.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.653+0000 7f6d38a00640 1 --2- 172.21.15.49:0/1898401380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d340b30e0 0x7f6d3415e1c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009870 tx=0x7f6d2401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d13a86e16dfab55 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:21.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.653+0000 7f6d33400640 1 -- 172.21.15.49:0/1898401380 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d240ac620 con 0x7f6d340b30e0 2024-01-31T05:05:21.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.653+0000 7f6d33400640 1 -- 172.21.15.49:0/1898401380 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d240ac780 con 0x7f6d340b30e0 2024-01-31T05:05:21.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.653+0000 7f6d33400640 1 -- 172.21.15.49:0/1898401380 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d240acb10 con 0x7f6d340b30e0 2024-01-31T05:05:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.653+0000 7f6d3b400640 1 -- 172.21.15.49:0/1898401380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d340b30e0 msgr2=0x7f6d3415e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.653+0000 7f6d3b400640 1 --2- 172.21.15.49:0/1898401380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d340b30e0 0x7f6d3415e1c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009870 tx=0x7f6d2401c420 comp rx=0 tx=0).stop 2024-01-31T05:05:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.653+0000 7f6d3b400640 1 -- 172.21.15.49:0/1898401380 shutdown_connections 2024-01-31T05:05:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.653+0000 7f6d3b400640 1 --2- 172.21.15.49:0/1898401380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d340b30e0 0x7f6d3415e1c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.653+0000 7f6d3b400640 1 -- 172.21.15.49:0/1898401380 >> 172.21.15.49:0/1898401380 conn(0x7f6d340b09a0 msgr2=0x7f6d340b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.653+0000 7f6d3b400640 1 -- 172.21.15.49:0/1898401380 shutdown_connections 2024-01-31T05:05:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.653+0000 7f6d3b400640 1 -- 172.21.15.49:0/1898401380 wait complete. 2024-01-31T05:05:21.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.653+0000 7f6d3b400640 1 Processor -- start 2024-01-31T05:05:21.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.653+0000 7f6d3b400640 1 -- start start 2024-01-31T05:05:21.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d3b400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d3406c2d0 0x7f6d340afb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:21.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d3b400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d340b30e0 0x7f6d34144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d3b400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d340b34c0 0x7f6d34144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d3b400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d34156f30 con 0x7f6d340b30e0 2024-01-31T05:05:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d3b400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3409c560 con 0x7f6d340b34c0 2024-01-31T05:05:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d3b400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3409c840 con 0x7f6d3406c2d0 2024-01-31T05:05:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d33e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d340b30e0 0x7f6d34144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d33e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d340b30e0 0x7f6d34144600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34824/0 (socket says 172.21.15.49:34824) 2024-01-31T05:05:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d33e00640 1 -- 172.21.15.49:0/3987369857 learned_addr learned my addr 172.21.15.49:0/3987369857 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d38a00640 1 --2- 172.21.15.49:0/3987369857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d3406c2d0 0x7f6d340afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d33e00640 1 -- 172.21.15.49:0/3987369857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d3406c2d0 msgr2=0x7f6d340afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d39400640 1 --2- 172.21.15.49:0/3987369857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d340b34c0 0x7f6d34144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:21.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d33e00640 1 --2- 172.21.15.49:0/3987369857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d3406c2d0 0x7f6d340afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d33e00640 1 -- 172.21.15.49:0/3987369857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d340b34c0 msgr2=0x7f6d34144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:21.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d33e00640 1 --2- 172.21.15.49:0/3987369857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d340b34c0 0x7f6d34144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d33e00640 1 -- 172.21.15.49:0/3987369857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d240094d0 con 0x7f6d340b30e0 2024-01-31T05:05:21.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d38a00640 1 --2- 172.21.15.49:0/3987369857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d3406c2d0 0x7f6d340afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:21.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d39400640 1 --2- 172.21.15.49:0/3987369857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d340b34c0 0x7f6d34144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:21.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d33e00640 1 --2- 172.21.15.49:0/3987369857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d340b30e0 0x7f6d34144600 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00c4a0 tx=0x7f6d1c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:21.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d30c00640 1 -- 172.21.15.49:0/3987369857 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0074e0 con 0x7f6d340b30e0 2024-01-31T05:05:21.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d3b400640 1 -- 172.21.15.49:0/3987369857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d341568e0 con 0x7f6d340b30e0 2024-01-31T05:05:21.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d30c00640 1 -- 172.21.15.49:0/3987369857 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c007640 con 0x7f6d340b30e0 2024-01-31T05:05:21.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d30c00640 1 -- 172.21.15.49:0/3987369857 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c004a30 con 0x7f6d340b30e0 2024-01-31T05:05:21.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d3b400640 1 -- 172.21.15.49:0/3987369857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d341573c0 con 0x7f6d340b30e0 2024-01-31T05:05:21.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d3b400640 1 -- 172.21.15.49:0/3987369857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d341570e0 con 0x7f6d340b30e0 2024-01-31T05:05:21.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.657+0000 7f6d30c00640 1 -- 172.21.15.49:0/3987369857 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f6d1c004b90 con 0x7f6d340b30e0 2024-01-31T05:05:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.661+0000 7f6d30c00640 1 --2- 172.21.15.49:0/3987369857 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6d0c066500 0x7f6d0c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.661+0000 7f6d30c00640 1 -- 172.21.15.49:0/3987369857 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6d1c0835f0 con 0x7f6d340b30e0 2024-01-31T05:05:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.661+0000 7f6d38a00640 1 --2- 172.21.15.49:0/3987369857 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6d0c066500 0x7f6d0c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:21.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.661+0000 7f6d38a00640 1 --2- 172.21.15.49:0/3987369857 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6d0c066500 0x7f6d0c0689c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6d240ae000 tx=0x7f6d24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.665+0000 7f6d30c00640 1 -- 172.21.15.49:0/3987369857 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f6d341570e0 con 0x7f6d340b30e0 2024-01-31T05:05:21.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.821+0000 7f6d3b400640 1 -- 172.21.15.49:0/3987369857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6d34074860 con 0x7f6d340b30e0 2024-01-31T05:05:21.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.821+0000 7f6d30c00640 1 -- 172.21.15.49:0/3987369857 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6d1c0503b0 con 0x7f6d340b30e0 2024-01-31T05:05:21.822 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:21.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.825+0000 7f6d3b400640 1 -- 172.21.15.49:0/3987369857 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6d0c066500 msgr2=0x7f6d0c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:21.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.825+0000 7f6d3b400640 1 --2- 172.21.15.49:0/3987369857 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6d0c066500 0x7f6d0c0689c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6d240ae000 tx=0x7f6d24008040 comp rx=0 tx=0).stop 2024-01-31T05:05:21.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.825+0000 7f6d3b400640 1 -- 172.21.15.49:0/3987369857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d340b30e0 msgr2=0x7f6d34144600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:21.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.825+0000 7f6d3b400640 1 --2- 172.21.15.49:0/3987369857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d340b30e0 0x7f6d34144600 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00c4a0 tx=0x7f6d1c00c960 comp rx=0 tx=0).stop 2024-01-31T05:05:21.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.825+0000 7f6d3b400640 1 -- 172.21.15.49:0/3987369857 shutdown_connections 2024-01-31T05:05:21.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.825+0000 7f6d3b400640 1 --2- 172.21.15.49:0/3987369857 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6d0c066500 0x7f6d0c0689c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.825+0000 7f6d3b400640 1 --2- 172.21.15.49:0/3987369857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d340b34c0 0x7f6d34144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.825+0000 7f6d3b400640 1 --2- 172.21.15.49:0/3987369857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6d340b30e0 0x7f6d34144600 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.825+0000 7f6d3b400640 1 --2- 172.21.15.49:0/3987369857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d3406c2d0 0x7f6d340afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.825+0000 7f6d3b400640 1 -- 172.21.15.49:0/3987369857 >> 172.21.15.49:0/3987369857 conn(0x7f6d340b09a0 msgr2=0x7f6d3415d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:21.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.825+0000 7f6d3b400640 1 -- 172.21.15.49:0/3987369857 shutdown_connections 2024-01-31T05:05:21.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.825+0000 7f6d3b400640 1 -- 172.21.15.49:0/3987369857 wait complete. 2024-01-31T05:05:21.845 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:05:21.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.989+0000 7f02e8000640 1 Processor -- start 2024-01-31T05:05:21.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.989+0000 7f02e8000640 1 -- start start 2024-01-31T05:05:21.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.989+0000 7f02e8000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f02e00cff70 0x7f02e00cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:21.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.989+0000 7f02e8000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02e00cb9f0 0x7f02e00cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:21.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.989+0000 7f02e8000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e00cef80 con 0x7f02e015d540 2024-01-31T05:05:21.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.989+0000 7f02e8000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e00d03d0 con 0x7f02e00cff70 2024-01-31T05:05:21.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.989+0000 7f02e8000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e006cae0 con 0x7f02e00cb9f0 2024-01-31T05:05:21.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.989+0000 7f02e4c00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f02e00cff70 0x7f02e00cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:21.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.989+0000 7f02e4c00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f02e00cff70 0x7f02e00cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34826/0 (socket says 172.21.15.49:34826) 2024-01-31T05:05:21.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.989+0000 7f02e5600640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f02e015d540 0x7f02e006c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:39552/0 (socket says 172.21.15.49:39552) 2024-01-31T05:05:21.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.989+0000 7f02e4c00640 1 -- 172.21.15.49:0/983210251 learned_addr learned my addr 172.21.15.49:0/983210251 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:21.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.989+0000 7f02e6000640 1 --2- 172.21.15.49:0/983210251 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02e00cb9f0 0x7f02e00cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:21.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.989+0000 7f02e4c00640 1 -- 172.21.15.49:0/983210251 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02e00cb9f0 msgr2=0x7f02e00cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:21.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.989+0000 7f02e4c00640 1 --2- 172.21.15.49:0/983210251 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02e00cb9f0 0x7f02e00cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.989+0000 7f02e4c00640 1 -- 172.21.15.49:0/983210251 >> v1:172.21.15.195:6789/0 conn(0x7f02e015d540 legacy=0x7f02e006c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:21.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.989+0000 7f02e4c00640 1 -- 172.21.15.49:0/983210251 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e00cf1b0 con 0x7f02e00cff70 2024-01-31T05:05:21.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.993+0000 7f02e4c00640 1 --2- 172.21.15.49:0/983210251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e00cff70 0x7f02e00cb4b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009870 tx=0x7f02c801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f9f25d8f48aa40 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:21.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.993+0000 7f02dfe00640 1 -- 172.21.15.49:0/983210251 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c80aa670 con 0x7f02e00cff70 2024-01-31T05:05:21.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.993+0000 7f02dfe00640 1 -- 172.21.15.49:0/983210251 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c80aa7d0 con 0x7f02e00cff70 2024-01-31T05:05:21.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.993+0000 7f02dfe00640 1 -- 172.21.15.49:0/983210251 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c80aab60 con 0x7f02e00cff70 2024-01-31T05:05:21.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.993+0000 7f02e8000640 1 -- 172.21.15.49:0/983210251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e00cff70 msgr2=0x7f02e00cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:21.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.993+0000 7f02e8000640 1 --2- 172.21.15.49:0/983210251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e00cff70 0x7f02e00cb4b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009870 tx=0x7f02c801c510 comp rx=0 tx=0).stop 2024-01-31T05:05:21.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.993+0000 7f02e8000640 1 -- 172.21.15.49:0/983210251 shutdown_connections 2024-01-31T05:05:21.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.993+0000 7f02e8000640 1 --2- 172.21.15.49:0/983210251 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02e00cb9f0 0x7f02e00cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.993+0000 7f02e8000640 1 --2- 172.21.15.49:0/983210251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e00cff70 0x7f02e00cb4b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:21.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.993+0000 7f02e8000640 1 -- 172.21.15.49:0/983210251 >> 172.21.15.49:0/983210251 conn(0x7f02e00d0e60 msgr2=0x7f02e00d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:21.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.993+0000 7f02e8000640 1 -- 172.21.15.49:0/983210251 shutdown_connections 2024-01-31T05:05:21.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.993+0000 7f02e8000640 1 -- 172.21.15.49:0/983210251 wait complete. 2024-01-31T05:05:21.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e8000640 1 Processor -- start 2024-01-31T05:05:21.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e8000640 1 -- start start 2024-01-31T05:05:22.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e8000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02e00cb9f0 0x7f02e0152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:22.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e8000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02e00cff70 0x7f02e014d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:22.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e8000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e015d540 0x7f02e014b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:22.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e8000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e014ddf0 con 0x7f02e015d540 2024-01-31T05:05:22.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e8000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e014e0d0 con 0x7f02e00cb9f0 2024-01-31T05:05:22.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e8000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e014e3b0 con 0x7f02e00cff70 2024-01-31T05:05:22.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e6000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e015d540 0x7f02e014b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:22.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e6000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e015d540 0x7f02e014b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34842/0 (socket says 172.21.15.49:34842) 2024-01-31T05:05:22.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e6000640 1 -- 172.21.15.49:0/387955699 learned_addr learned my addr 172.21.15.49:0/387955699 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:22.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e4c00640 1 --2- 172.21.15.49:0/387955699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02e00cff70 0x7f02e014d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:22.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e5600640 1 --2- 172.21.15.49:0/387955699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02e00cb9f0 0x7f02e0152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:22.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e6000640 1 -- 172.21.15.49:0/387955699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02e00cff70 msgr2=0x7f02e014d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:22.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e6000640 1 --2- 172.21.15.49:0/387955699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02e00cff70 0x7f02e014d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e6000640 1 -- 172.21.15.49:0/387955699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02e00cb9f0 msgr2=0x7f02e0152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:22.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e6000640 1 --2- 172.21.15.49:0/387955699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02e00cb9f0 0x7f02e0152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e6000640 1 -- 172.21.15.49:0/387955699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c80094d0 con 0x7f02e015d540 2024-01-31T05:05:22.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e6000640 1 --2- 172.21.15.49:0/387955699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e015d540 0x7f02e014b930 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f02d800efc0 tx=0x7f02d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:22.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02dd600640 1 -- 172.21.15.49:0/387955699 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8014480 con 0x7f02e015d540 2024-01-31T05:05:22.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02dd600640 1 -- 172.21.15.49:0/387955699 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d800f040 con 0x7f02e015d540 2024-01-31T05:05:22.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02dd600640 1 -- 172.21.15.49:0/387955699 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8014820 con 0x7f02e015d540 2024-01-31T05:05:22.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:21.997+0000 7f02e8000640 1 -- 172.21.15.49:0/387955699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e014e690 con 0x7f02e015d540 2024-01-31T05:05:22.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.001+0000 7f02e8000640 1 -- 172.21.15.49:0/387955699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e014c720 con 0x7f02e015d540 2024-01-31T05:05:22.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.001+0000 7f02e8000640 1 -- 172.21.15.49:0/387955699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e00ce880 con 0x7f02e015d540 2024-01-31T05:05:22.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.001+0000 7f02dd600640 1 -- 172.21.15.49:0/387955699 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f02d8014980 con 0x7f02e015d540 2024-01-31T05:05:22.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.001+0000 7f02dd600640 1 --2- 172.21.15.49:0/387955699 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f02b8066530 0x7f02b80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:22.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.001+0000 7f02dd600640 1 -- 172.21.15.49:0/387955699 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f02d8084c70 con 0x7f02e015d540 2024-01-31T05:05:22.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.001+0000 7f02e5600640 1 --2- 172.21.15.49:0/387955699 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f02b8066530 0x7f02b80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:22.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.005+0000 7f02e5600640 1 --2- 172.21.15.49:0/387955699 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f02b8066530 0x7f02b80689f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f02e00cadc0 tx=0x7f02d0007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:22.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.005+0000 7f02dd600640 1 -- 172.21.15.49:0/387955699 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f02d8051bf0 con 0x7f02e015d540 2024-01-31T05:05:22.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.161+0000 7f02e8000640 1 -- 172.21.15.49:0/387955699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f02e0067c80 con 0x7f02e015d540 2024-01-31T05:05:22.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.165+0000 7f02dd600640 1 -- 172.21.15.49:0/387955699 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f02d8018020 con 0x7f02e015d540 2024-01-31T05:05:22.164 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-31T05:05:22.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.165+0000 7f02e8000640 1 -- 172.21.15.49:0/387955699 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f02b8066530 msgr2=0x7f02b80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:22.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.165+0000 7f02e8000640 1 --2- 172.21.15.49:0/387955699 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f02b8066530 0x7f02b80689f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f02e00cadc0 tx=0x7f02d0007e90 comp rx=0 tx=0).stop 2024-01-31T05:05:22.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.165+0000 7f02e8000640 1 -- 172.21.15.49:0/387955699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e015d540 msgr2=0x7f02e014b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:22.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.165+0000 7f02e8000640 1 --2- 172.21.15.49:0/387955699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e015d540 0x7f02e014b930 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f02d800efc0 tx=0x7f02d800c490 comp rx=0 tx=0).stop 2024-01-31T05:05:22.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.165+0000 7f02e8000640 1 -- 172.21.15.49:0/387955699 shutdown_connections 2024-01-31T05:05:22.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.165+0000 7f02e8000640 1 --2- 172.21.15.49:0/387955699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02e015d540 0x7f02e014b930 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.165+0000 7f02e8000640 1 --2- 172.21.15.49:0/387955699 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f02e00cff70 0x7f02e014d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.165+0000 7f02e8000640 1 --2- 172.21.15.49:0/387955699 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f02b8066530 0x7f02b80689f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.165+0000 7f02e8000640 1 --2- 172.21.15.49:0/387955699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02e00cb9f0 0x7f02e0152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.165+0000 7f02e8000640 1 -- 172.21.15.49:0/387955699 >> 172.21.15.49:0/387955699 conn(0x7f02e00d0e60 msgr2=0x7f02e00cca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:22.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.165+0000 7f02e8000640 1 -- 172.21.15.49:0/387955699 shutdown_connections 2024-01-31T05:05:22.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.165+0000 7f02e8000640 1 -- 172.21.15.49:0/387955699 wait complete. 2024-01-31T05:05:22.187 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-31T05:05:22.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.329+0000 7f1ff9800640 1 Processor -- start 2024-01-31T05:05:22.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.329+0000 7f1ff9800640 1 -- start start 2024-01-31T05:05:22.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.333+0000 7f1ff9800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1ff415b110 0x7f1ff406c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:22.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.333+0000 7f1ff9800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ff40cdf10 0x7f1ff4070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:22.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.333+0000 7f1ff9800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff415b4f0 con 0x7f1ff40ce610 2024-01-31T05:05:22.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.333+0000 7f1ff9800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff40ce460 con 0x7f1ff415b110 2024-01-31T05:05:22.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.333+0000 7f1ff9800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff40abf20 con 0x7f1ff40cdf10 2024-01-31T05:05:22.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.333+0000 7f1ff2000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ff40cdf10 0x7f1ff4070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:22.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.333+0000 7f1ff2000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ff40cdf10 0x7f1ff4070dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:56258/0 (socket says 172.21.15.49:56258) 2024-01-31T05:05:22.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.333+0000 7f1ff2000640 1 -- 172.21.15.49:0/142425853 learned_addr learned my addr 172.21.15.49:0/142425853 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:22.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.333+0000 7f1ff2a00640 1 --2- 172.21.15.49:0/142425853 >> v2:172.21.15.195:3300/0 conn(0x7f1ff415b110 0x7f1ff406c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:22.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.333+0000 7f1ff2000640 1 -- 172.21.15.49:0/142425853 >> v2:172.21.15.195:3300/0 conn(0x7f1ff415b110 msgr2=0x7f1ff406c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:22.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.333+0000 7f1ff2000640 1 --2- 172.21.15.49:0/142425853 >> v2:172.21.15.195:3300/0 conn(0x7f1ff415b110 0x7f1ff406c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.333+0000 7f1ff2000640 1 -- 172.21.15.49:0/142425853 >> v1:172.21.15.195:6789/0 conn(0x7f1ff40ce610 legacy=0x7f1ff40ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:22.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.333+0000 7f1ff2000640 1 -- 172.21.15.49:0/142425853 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff40ac200 con 0x7f1ff40cdf10 2024-01-31T05:05:22.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.337+0000 7f1ff2000640 1 --2- 172.21.15.49:0/142425853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ff40cdf10 0x7f1ff4070dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009870 tx=0x7f1fdc01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7be1085df6b77e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:22.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.337+0000 7f1ff1600640 1 -- 172.21.15.49:0/142425853 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc0ab620 con 0x7f1ff40cdf10 2024-01-31T05:05:22.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.337+0000 7f1ff1600640 1 -- 172.21.15.49:0/142425853 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc0ab780 con 0x7f1ff40cdf10 2024-01-31T05:05:22.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.337+0000 7f1ff1600640 1 -- 172.21.15.49:0/142425853 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc0abb10 con 0x7f1ff40cdf10 2024-01-31T05:05:22.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.337+0000 7f1ff9800640 1 -- 172.21.15.49:0/142425853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ff40cdf10 msgr2=0x7f1ff4070dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:22.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.337+0000 7f1ff9800640 1 --2- 172.21.15.49:0/142425853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ff40cdf10 0x7f1ff4070dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009870 tx=0x7f1fdc01c510 comp rx=0 tx=0).stop 2024-01-31T05:05:22.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.337+0000 7f1ff9800640 1 -- 172.21.15.49:0/142425853 shutdown_connections 2024-01-31T05:05:22.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.337+0000 7f1ff9800640 1 --2- 172.21.15.49:0/142425853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ff40cdf10 0x7f1ff4070dd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.337+0000 7f1ff9800640 1 --2- 172.21.15.49:0/142425853 >> v2:172.21.15.195:3300/0 conn(0x7f1ff415b110 0x7f1ff406c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.337+0000 7f1ff9800640 1 -- 172.21.15.49:0/142425853 >> 172.21.15.49:0/142425853 conn(0x7f1ff40b09a0 msgr2=0x7f1ff40b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:22.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.337+0000 7f1ff9800640 1 -- 172.21.15.49:0/142425853 shutdown_connections 2024-01-31T05:05:22.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.337+0000 7f1ff9800640 1 -- 172.21.15.49:0/142425853 wait complete. 2024-01-31T05:05:22.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff9800640 1 Processor -- start 2024-01-31T05:05:22.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff9800640 1 -- start start 2024-01-31T05:05:22.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff9800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ff40cdf10 0x7f1ff409a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:22.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff9800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ff40ce610 0x7f1ff409c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:22.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff9800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ff415b110 0x7f1ff413c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:22.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff9800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff414b1e0 con 0x7f1ff415b110 2024-01-31T05:05:22.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff9800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff414a280 con 0x7f1ff40cdf10 2024-01-31T05:05:22.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff9800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff414a560 con 0x7f1ff40ce610 2024-01-31T05:05:22.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff3400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ff415b110 0x7f1ff413c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:22.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff3400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ff415b110 0x7f1ff413c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34852/0 (socket says 172.21.15.49:34852) 2024-01-31T05:05:22.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff3400640 1 -- 172.21.15.49:0/1646992902 learned_addr learned my addr 172.21.15.49:0/1646992902 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:22.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff2000640 1 --2- 172.21.15.49:0/1646992902 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ff40ce610 0x7f1ff409c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:22.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff2a00640 1 --2- 172.21.15.49:0/1646992902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ff40cdf10 0x7f1ff409a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:22.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff3400640 1 -- 172.21.15.49:0/1646992902 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ff40ce610 msgr2=0x7f1ff409c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:22.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff3400640 1 --2- 172.21.15.49:0/1646992902 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ff40ce610 0x7f1ff409c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff3400640 1 -- 172.21.15.49:0/1646992902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ff40cdf10 msgr2=0x7f1ff409a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:22.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff3400640 1 --2- 172.21.15.49:0/1646992902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ff40cdf10 0x7f1ff409a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff3400640 1 -- 172.21.15.49:0/1646992902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc0094d0 con 0x7f1ff415b110 2024-01-31T05:05:22.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff3400640 1 --2- 172.21.15.49:0/1646992902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ff415b110 0x7f1ff413c150 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00c770 tx=0x7f1fec00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:22.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1feaa00640 1 -- 172.21.15.49:0/1646992902 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec003b80 con 0x7f1ff415b110 2024-01-31T05:05:22.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1feaa00640 1 -- 172.21.15.49:0/1646992902 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fec003ce0 con 0x7f1ff415b110 2024-01-31T05:05:22.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1feaa00640 1 -- 172.21.15.49:0/1646992902 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec00aa90 con 0x7f1ff415b110 2024-01-31T05:05:22.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff9800640 1 -- 172.21.15.49:0/1646992902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff414a840 con 0x7f1ff415b110 2024-01-31T05:05:22.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff9800640 1 -- 172.21.15.49:0/1646992902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff414ae00 con 0x7f1ff415b110 2024-01-31T05:05:22.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.341+0000 7f1ff9800640 1 -- 172.21.15.49:0/1646992902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff414b320 con 0x7f1ff415b110 2024-01-31T05:05:22.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.345+0000 7f1feaa00640 1 -- 172.21.15.49:0/1646992902 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1fec00abf0 con 0x7f1ff415b110 2024-01-31T05:05:22.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.345+0000 7f1feaa00640 1 --2- 172.21.15.49:0/1646992902 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1fcc066500 0x7f1fcc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:22.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.345+0000 7f1feaa00640 1 -- 172.21.15.49:0/1646992902 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1fec083dd0 con 0x7f1ff415b110 2024-01-31T05:05:22.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.345+0000 7f1ff2a00640 1 --2- 172.21.15.49:0/1646992902 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1fcc066500 0x7f1fcc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:22.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.345+0000 7f1ff2a00640 1 --2- 172.21.15.49:0/1646992902 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1fcc066500 0x7f1fcc0689c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4009ac0 tx=0x7f1fe4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:22.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.349+0000 7f1feaa00640 1 -- 172.21.15.49:0/1646992902 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1ff414b320 con 0x7f1ff415b110 2024-01-31T05:05:22.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.505+0000 7f1ff9800640 1 -- 172.21.15.49:0/1646992902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1ff415b4f0 con 0x7f1ff415b110 2024-01-31T05:05:22.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.509+0000 7f1feaa00640 1 -- 172.21.15.49:0/1646992902 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1ff415b4f0 con 0x7f1ff415b110 2024-01-31T05:05:22.508 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:22.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.509+0000 7f1ff9800640 1 -- 172.21.15.49:0/1646992902 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1fcc066500 msgr2=0x7f1fcc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:22.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.509+0000 7f1ff9800640 1 --2- 172.21.15.49:0/1646992902 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1fcc066500 0x7f1fcc0689c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4009ac0 tx=0x7f1fe4009190 comp rx=0 tx=0).stop 2024-01-31T05:05:22.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.509+0000 7f1ff9800640 1 -- 172.21.15.49:0/1646992902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ff415b110 msgr2=0x7f1ff413c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:22.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.509+0000 7f1ff9800640 1 --2- 172.21.15.49:0/1646992902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ff415b110 0x7f1ff413c150 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00c770 tx=0x7f1fec00cc30 comp rx=0 tx=0).stop 2024-01-31T05:05:22.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.509+0000 7f1ff9800640 1 -- 172.21.15.49:0/1646992902 shutdown_connections 2024-01-31T05:05:22.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.509+0000 7f1ff9800640 1 --2- 172.21.15.49:0/1646992902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ff415b110 0x7f1ff413c150 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.509+0000 7f1ff9800640 1 --2- 172.21.15.49:0/1646992902 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ff40ce610 0x7f1ff409c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.509+0000 7f1ff9800640 1 --2- 172.21.15.49:0/1646992902 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1fcc066500 0x7f1fcc0689c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.509+0000 7f1ff9800640 1 --2- 172.21.15.49:0/1646992902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ff40cdf10 0x7f1ff409a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.509+0000 7f1ff9800640 1 -- 172.21.15.49:0/1646992902 >> 172.21.15.49:0/1646992902 conn(0x7f1ff40b09a0 msgr2=0x7f1ff4151410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:22.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.509+0000 7f1ff9800640 1 -- 172.21.15.49:0/1646992902 shutdown_connections 2024-01-31T05:05:22.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.509+0000 7f1ff9800640 1 -- 172.21.15.49:0/1646992902 wait complete. 2024-01-31T05:05:22.530 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-31T05:05:22.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.673+0000 7fb07ee00640 1 Processor -- start 2024-01-31T05:05:22.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.673+0000 7fb07ee00640 1 -- start start 2024-01-31T05:05:22.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.673+0000 7fb07ee00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb0780cff70 0x7fb0780cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.673+0000 7fb07ee00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0780cef80 con 0x7fb07815d540 2024-01-31T05:05:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.673+0000 7fb07ee00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07806cae0 con 0x7fb0780cb9f0 2024-01-31T05:05:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.673+0000 7fb07ee00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0780d03d0 con 0x7fb0780cff70 2024-01-31T05:05:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.673+0000 7fb077400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb0780cff70 0x7fb0780cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.673+0000 7fb077e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb07815d540 0x7fb07806c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57928/0 (socket says 172.21.15.49:57928) 2024-01-31T05:05:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.673+0000 7fb077e00640 1 -- 172.21.15.49:0/3449829054 learned_addr learned my addr 172.21.15.49:0/3449829054 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.673+0000 7fb077400640 1 -- 172.21.15.49:0/3449829054 >> v1:172.21.15.195:6789/0 conn(0x7fb0780cb9f0 legacy=0x7fb07815d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.673+0000 7fb077400640 1 -- 172.21.15.49:0/3449829054 >> v1:172.21.15.49:6789/0 conn(0x7fb07815d540 legacy=0x7fb07806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:22.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.673+0000 7fb077400640 1 -- 172.21.15.49:0/3449829054 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0780cf1b0 con 0x7fb0780cff70 2024-01-31T05:05:22.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.673+0000 7fb076a00640 1 -- 172.21.15.49:0/3449829054 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65613041 0 0) 0x7fb0780cef80 con 0x7fb07815d540 2024-01-31T05:05:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.677+0000 7fb077400640 1 --2- 172.21.15.49:0/3449829054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0780cff70 0x7fb0780cb4b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb0600097c0 tx=0x7fb06001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ab693f3069484e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.677+0000 7fb076a00640 1 -- 172.21.15.49:0/3449829054 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0600ad660 con 0x7fb0780cff70 2024-01-31T05:05:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.677+0000 7fb076a00640 1 -- 172.21.15.49:0/3449829054 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0600ad7c0 con 0x7fb0780cff70 2024-01-31T05:05:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.677+0000 7fb076a00640 1 -- 172.21.15.49:0/3449829054 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0600adb50 con 0x7fb0780cff70 2024-01-31T05:05:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.677+0000 7fb07ee00640 1 -- 172.21.15.49:0/3449829054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0780cff70 msgr2=0x7fb0780cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.677+0000 7fb07ee00640 1 --2- 172.21.15.49:0/3449829054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0780cff70 0x7fb0780cb4b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb0600097c0 tx=0x7fb06001c450 comp rx=0 tx=0).stop 2024-01-31T05:05:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.677+0000 7fb07ee00640 1 -- 172.21.15.49:0/3449829054 shutdown_connections 2024-01-31T05:05:22.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.677+0000 7fb07ee00640 1 --2- 172.21.15.49:0/3449829054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0780cff70 0x7fb0780cb4b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.677+0000 7fb07ee00640 1 -- 172.21.15.49:0/3449829054 >> 172.21.15.49:0/3449829054 conn(0x7fb0780d0e60 msgr2=0x7fb0780d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:22.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.677+0000 7fb07ee00640 1 -- 172.21.15.49:0/3449829054 shutdown_connections 2024-01-31T05:05:22.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.677+0000 7fb07ee00640 1 -- 172.21.15.49:0/3449829054 wait complete. 2024-01-31T05:05:22.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb07ee00640 1 Processor -- start 2024-01-31T05:05:22.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb07ee00640 1 -- start start 2024-01-31T05:05:22.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb07ee00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0780cb9f0 0x7fb0780c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:22.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb07ee00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0780cff70 0x7fb078150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb07ee00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb07815d540 0x7fb0781506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb07ee00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0780b6a40 con 0x7fb0780cff70 2024-01-31T05:05:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb07ee00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb078150c00 con 0x7fb07815d540 2024-01-31T05:05:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb07ee00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0780b4bd0 con 0x7fb0780cb9f0 2024-01-31T05:05:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb077400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0780cff70 0x7fb078150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb077400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0780cff70 0x7fb078150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34868/0 (socket says 172.21.15.49:34868) 2024-01-31T05:05:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb077400640 1 -- 172.21.15.49:0/3433054805 learned_addr learned my addr 172.21.15.49:0/3433054805 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb077e00640 1 --2- 172.21.15.49:0/3433054805 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0780cb9f0 0x7fb0780c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb07ce00640 1 --2- 172.21.15.49:0/3433054805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb07815d540 0x7fb0781506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb077400640 1 -- 172.21.15.49:0/3433054805 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0780cb9f0 msgr2=0x7fb0780c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb077400640 1 --2- 172.21.15.49:0/3433054805 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0780cb9f0 0x7fb0780c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb077400640 1 -- 172.21.15.49:0/3433054805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb07815d540 msgr2=0x7fb0781506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb077400640 1 --2- 172.21.15.49:0/3433054805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb07815d540 0x7fb0781506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb077400640 1 -- 172.21.15.49:0/3433054805 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb060009420 con 0x7fb0780cff70 2024-01-31T05:05:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb07ce00640 1 --2- 172.21.15.49:0/3433054805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb07815d540 0x7fb0781506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb077400640 1 --2- 172.21.15.49:0/3433054805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0780cff70 0x7fb078150180 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb060019060 tx=0x7fb0600191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb06fe00640 1 -- 172.21.15.49:0/3433054805 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0600b6820 con 0x7fb0780cff70 2024-01-31T05:05:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb06fe00640 1 -- 172.21.15.49:0/3433054805 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0600b69a0 con 0x7fb0780cff70 2024-01-31T05:05:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb06fe00640 1 -- 172.21.15.49:0/3433054805 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0600b6d50 con 0x7fb0780cff70 2024-01-31T05:05:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb07ee00640 1 -- 172.21.15.49:0/3433054805 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0780b6760 con 0x7fb0780cff70 2024-01-31T05:05:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.681+0000 7fb07ee00640 1 -- 172.21.15.49:0/3433054805 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0780b4860 con 0x7fb0780cff70 2024-01-31T05:05:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.685+0000 7fb07ee00640 1 -- 172.21.15.49:0/3433054805 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0780ce880 con 0x7fb0780cff70 2024-01-31T05:05:22.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.685+0000 7fb06fe00640 1 -- 172.21.15.49:0/3433054805 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb0600b4040 con 0x7fb0780cff70 2024-01-31T05:05:22.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.685+0000 7fb06fe00640 1 --2- 172.21.15.49:0/3433054805 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb050066500 0x7fb0500689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:22.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.685+0000 7fb06fe00640 1 -- 172.21.15.49:0/3433054805 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb06011e650 con 0x7fb0780cff70 2024-01-31T05:05:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.685+0000 7fb077e00640 1 --2- 172.21.15.49:0/3433054805 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb050066500 0x7fb0500689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.685+0000 7fb077e00640 1 --2- 172.21.15.49:0/3433054805 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb050066500 0x7fb0500689c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb068000f70 tx=0x7fb068007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:22.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.689+0000 7fb06fe00640 1 -- 172.21.15.49:0/3433054805 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fb0600eb490 con 0x7fb0780cff70 2024-01-31T05:05:22.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.861+0000 7fb07ee00640 1 -- 172.21.15.49:0/3433054805 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb0780b43e0 con 0x7fb0780cff70 2024-01-31T05:05:22.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.861+0000 7fb06fe00640 1 -- 172.21.15.49:0/3433054805 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb0780b43e0 con 0x7fb0780cff70 2024-01-31T05:05:22.861 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2024-01-31T05:05:22.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.861+0000 7fb07ee00640 1 -- 172.21.15.49:0/3433054805 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb050066500 msgr2=0x7fb0500689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:22.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.861+0000 7fb07ee00640 1 --2- 172.21.15.49:0/3433054805 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb050066500 0x7fb0500689c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb068000f70 tx=0x7fb068007d30 comp rx=0 tx=0).stop 2024-01-31T05:05:22.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.861+0000 7fb07ee00640 1 -- 172.21.15.49:0/3433054805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0780cff70 msgr2=0x7fb078150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:22.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.861+0000 7fb07ee00640 1 --2- 172.21.15.49:0/3433054805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0780cff70 0x7fb078150180 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb060019060 tx=0x7fb0600191f0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.861+0000 7fb07ee00640 1 -- 172.21.15.49:0/3433054805 shutdown_connections 2024-01-31T05:05:22.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.861+0000 7fb07ee00640 1 --2- 172.21.15.49:0/3433054805 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb050066500 0x7fb0500689c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.861+0000 7fb07ee00640 1 --2- 172.21.15.49:0/3433054805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb07815d540 0x7fb0781506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.861+0000 7fb07ee00640 1 --2- 172.21.15.49:0/3433054805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0780cff70 0x7fb078150180 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.861+0000 7fb07ee00640 1 --2- 172.21.15.49:0/3433054805 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0780cb9f0 0x7fb0780c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:22.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.861+0000 7fb07ee00640 1 -- 172.21.15.49:0/3433054805 >> 172.21.15.49:0/3433054805 conn(0x7fb0780d0e60 msgr2=0x7fb07815bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:22.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.861+0000 7fb07ee00640 1 -- 172.21.15.49:0/3433054805 shutdown_connections 2024-01-31T05:05:22.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:22.861+0000 7fb07ee00640 1 -- 172.21.15.49:0/3433054805 wait complete. 2024-01-31T05:05:22.883 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:05:22.884 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T05:05:22.893 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:23.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.081+0000 7f50ab000640 1 Processor -- start 2024-01-31T05:05:23.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.081+0000 7f50ab000640 1 -- start start 2024-01-31T05:05:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.081+0000 7f50ab000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f50a415d510 0x7f50a4072050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.081+0000 7f50ab000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f50a40b4b20 0x7f50a406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.081+0000 7f50ab000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50a406d920 0x7f50a406a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.081+0000 7f50ab000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a4072590 con 0x7f50a40b4b20 2024-01-31T05:05:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.081+0000 7f50ab000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a406f010 con 0x7f50a415d510 2024-01-31T05:05:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.081+0000 7f50ab000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a4071570 con 0x7f50a406d920 2024-01-31T05:05:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.081+0000 7f50a3400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f50a40b4b20 0x7f50a406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.081+0000 7f50a3400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f50a40b4b20 0x7f50a406d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34874/0 (socket says 172.21.15.49:34874) 2024-01-31T05:05:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.081+0000 7f50a3400640 1 -- 172.21.15.49:0/3275154494 learned_addr learned my addr 172.21.15.49:0/3275154494 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.081+0000 7f50a3e00640 1 --2- 172.21.15.49:0/3275154494 >> v2:172.21.15.195:3300/0 conn(0x7f50a415d510 0x7f50a4072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.081+0000 7f50a9000640 1 --2- 172.21.15.49:0/3275154494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50a406d920 0x7f50a406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:23.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.081+0000 7f50a3400640 1 -- 172.21.15.49:0/3275154494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50a406d920 msgr2=0x7f50a406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:23.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.081+0000 7f50a3400640 1 --2- 172.21.15.49:0/3275154494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50a406d920 0x7f50a406a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.081+0000 7f50a3400640 1 -- 172.21.15.49:0/3275154494 >> v2:172.21.15.195:3300/0 conn(0x7f50a415d510 msgr2=0x7f50a4072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:23.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.081+0000 7f50a3400640 1 --2- 172.21.15.49:0/3275154494 >> v2:172.21.15.195:3300/0 conn(0x7f50a415d510 0x7f50a4072050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.081+0000 7f50a3400640 1 -- 172.21.15.49:0/3275154494 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a4071850 con 0x7f50a40b4b20 2024-01-31T05:05:23.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.085+0000 7f50a3400640 1 --2- 172.21.15.49:0/3275154494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50a40b4b20 0x7f50a406d3e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f50a40d0d90 tx=0x7f508c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c781f05ea99333f3 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:23.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.085+0000 7f50a2a00640 1 -- 172.21.15.49:0/3275154494 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c0ab620 con 0x7f50a40b4b20 2024-01-31T05:05:23.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.085+0000 7f50a2a00640 1 -- 172.21.15.49:0/3275154494 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508c0ab780 con 0x7f50a40b4b20 2024-01-31T05:05:23.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.085+0000 7f50a2a00640 1 -- 172.21.15.49:0/3275154494 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c0abb10 con 0x7f50a40b4b20 2024-01-31T05:05:23.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.085+0000 7f50ab000640 1 -- 172.21.15.49:0/3275154494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50a40b4b20 msgr2=0x7f50a406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:23.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.085+0000 7f50ab000640 1 --2- 172.21.15.49:0/3275154494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50a40b4b20 0x7f50a406d3e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f50a40d0d90 tx=0x7f508c01c440 comp rx=0 tx=0).stop 2024-01-31T05:05:23.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.085+0000 7f50ab000640 1 -- 172.21.15.49:0/3275154494 shutdown_connections 2024-01-31T05:05:23.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.085+0000 7f50ab000640 1 --2- 172.21.15.49:0/3275154494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50a406d920 0x7f50a406a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.085+0000 7f50ab000640 1 --2- 172.21.15.49:0/3275154494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50a40b4b20 0x7f50a406d3e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.085+0000 7f50ab000640 1 --2- 172.21.15.49:0/3275154494 >> v2:172.21.15.195:3300/0 conn(0x7f50a415d510 0x7f50a4072050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.085+0000 7f50ab000640 1 -- 172.21.15.49:0/3275154494 >> 172.21.15.49:0/3275154494 conn(0x7f50a40b1ab0 msgr2=0x7f50a40b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:23.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.085+0000 7f50ab000640 1 -- 172.21.15.49:0/3275154494 shutdown_connections 2024-01-31T05:05:23.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.085+0000 7f50ab000640 1 -- 172.21.15.49:0/3275154494 wait complete. 2024-01-31T05:05:23.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50ab000640 1 Processor -- start 2024-01-31T05:05:23.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50ab000640 1 -- start start 2024-01-31T05:05:23.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50ab000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50a406d920 0x7f50a40cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:23.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50ab000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50a40b4b20 0x7f50a40cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:23.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50ab000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50a415d510 0x7f50a40cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:23.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50ab000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a40b14c0 con 0x7f50a415d510 2024-01-31T05:05:23.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50ab000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a4150b20 con 0x7f50a406d920 2024-01-31T05:05:23.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50ab000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a4150e00 con 0x7f50a40b4b20 2024-01-31T05:05:23.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50a9000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50a415d510 0x7f50a40cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:23.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50a9000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50a415d510 0x7f50a40cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34882/0 (socket says 172.21.15.49:34882) 2024-01-31T05:05:23.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50a9000640 1 -- 172.21.15.49:0/785383047 learned_addr learned my addr 172.21.15.49:0/785383047 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:23.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50a3400640 1 --2- 172.21.15.49:0/785383047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50a40b4b20 0x7f50a40cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:23.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50a3e00640 1 --2- 172.21.15.49:0/785383047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50a406d920 0x7f50a40cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:23.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50a9000640 1 -- 172.21.15.49:0/785383047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50a40b4b20 msgr2=0x7f50a40cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:23.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50a9000640 1 --2- 172.21.15.49:0/785383047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50a40b4b20 0x7f50a40cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50a9000640 1 -- 172.21.15.49:0/785383047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50a406d920 msgr2=0x7f50a40cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:23.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50a9000640 1 --2- 172.21.15.49:0/785383047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50a406d920 0x7f50a40cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50a9000640 1 -- 172.21.15.49:0/785383047 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c0094d0 con 0x7f50a415d510 2024-01-31T05:05:23.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50a3400640 1 --2- 172.21.15.49:0/785383047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50a40b4b20 0x7f50a40cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:23.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50a9000640 1 --2- 172.21.15.49:0/785383047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50a415d510 0x7f50a40cccd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f509c00eed0 tx=0x7f509c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:23.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f509be00640 1 -- 172.21.15.49:0/785383047 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c010040 con 0x7f50a415d510 2024-01-31T05:05:23.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f509be00640 1 -- 172.21.15.49:0/785383047 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509c014400 con 0x7f50a415d510 2024-01-31T05:05:23.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50ab000640 1 -- 172.21.15.49:0/785383047 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a41510e0 con 0x7f50a415d510 2024-01-31T05:05:23.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f509be00640 1 -- 172.21.15.49:0/785383047 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c009ea0 con 0x7f50a415d510 2024-01-31T05:05:23.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50ab000640 1 -- 172.21.15.49:0/785383047 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a41516a0 con 0x7f50a415d510 2024-01-31T05:05:23.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.089+0000 7f50ab000640 1 -- 172.21.15.49:0/785383047 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a406c770 con 0x7f50a415d510 2024-01-31T05:05:23.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.093+0000 7f509be00640 1 -- 172.21.15.49:0/785383047 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f509c0147b0 con 0x7f50a415d510 2024-01-31T05:05:23.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.093+0000 7f509be00640 1 --2- 172.21.15.49:0/785383047 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f507c066530 0x7f507c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:23.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.093+0000 7f509be00640 1 -- 172.21.15.49:0/785383047 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f509c084800 con 0x7f50a415d510 2024-01-31T05:05:23.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.093+0000 7f50a3e00640 1 --2- 172.21.15.49:0/785383047 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f507c066530 0x7f507c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:23.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.093+0000 7f50a3e00640 1 --2- 172.21.15.49:0/785383047 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f507c066530 0x7f507c0689f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5094009ac0 tx=0x7f5094009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:23.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.097+0000 7f509be00640 1 -- 172.21.15.49:0/785383047 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f509c0516f0 con 0x7f50a415d510 2024-01-31T05:05:23.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.257+0000 7f50ab000640 1 -- 172.21.15.49:0/785383047 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50a4151890 con 0x7f50a415d510 2024-01-31T05:05:23.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.257+0000 7f509be00640 1 -- 172.21.15.49:0/785383047 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7f509c054d10 con 0x7f50a415d510 2024-01-31T05:05:23.258 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:23.258 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:58.277568+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:23.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.261+0000 7f50ab000640 1 -- 172.21.15.49:0/785383047 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f507c066530 msgr2=0x7f507c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:23.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.261+0000 7f50ab000640 1 --2- 172.21.15.49:0/785383047 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f507c066530 0x7f507c0689f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5094009ac0 tx=0x7f5094009190 comp rx=0 tx=0).stop 2024-01-31T05:05:23.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.261+0000 7f50ab000640 1 -- 172.21.15.49:0/785383047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50a415d510 msgr2=0x7f50a40cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:23.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.261+0000 7f50ab000640 1 --2- 172.21.15.49:0/785383047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50a415d510 0x7f50a40cccd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f509c00eed0 tx=0x7f509c00b480 comp rx=0 tx=0).stop 2024-01-31T05:05:23.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.261+0000 7f50ab000640 1 -- 172.21.15.49:0/785383047 shutdown_connections 2024-01-31T05:05:23.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.261+0000 7f50ab000640 1 --2- 172.21.15.49:0/785383047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50a415d510 0x7f50a40cccd0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.261+0000 7f50ab000640 1 --2- 172.21.15.49:0/785383047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50a40b4b20 0x7f50a40cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.261+0000 7f50ab000640 1 --2- 172.21.15.49:0/785383047 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f507c066530 0x7f507c0689f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.261+0000 7f50ab000640 1 --2- 172.21.15.49:0/785383047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50a406d920 0x7f50a40cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.261+0000 7f50ab000640 1 -- 172.21.15.49:0/785383047 >> 172.21.15.49:0/785383047 conn(0x7f50a40b1ab0 msgr2=0x7f50a40b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:23.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.261+0000 7f50ab000640 1 -- 172.21.15.49:0/785383047 shutdown_connections 2024-01-31T05:05:23.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.261+0000 7f50ab000640 1 -- 172.21.15.49:0/785383047 wait complete. 2024-01-31T05:05:23.281 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:04:14.566345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:04:15.231265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-31T05:04:18.316756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-31T05:05:23.281 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:05:23.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.425+0000 7f0080200640 1 Processor -- start 2024-01-31T05:05:23.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.425+0000 7f0080200640 1 -- start start 2024-01-31T05:05:23.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.425+0000 7f0080200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f007815d3a0 0x7f007806e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.429+0000 7f0080200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00780cce30 0x7f007806f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.429+0000 7f0080200640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00780cb990 con 0x7f007806ee50 2024-01-31T05:05:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.429+0000 7f0080200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00780d1c20 con 0x7f007815d3a0 2024-01-31T05:05:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.429+0000 7f0080200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00780cfed0 con 0x7f00780cce30 2024-01-31T05:05:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.429+0000 7f007d800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f007815d3a0 0x7f007806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.429+0000 7f007ce00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f007806ee50 0x7f00780cd6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57930/0 (socket says 172.21.15.49:57930) 2024-01-31T05:05:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.429+0000 7f007d800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f007815d3a0 0x7f007806e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34892/0 (socket says 172.21.15.49:34892) 2024-01-31T05:05:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.429+0000 7f007ce00640 1 -- 172.21.15.49:0/2638376742 learned_addr learned my addr 172.21.15.49:0/2638376742 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.429+0000 7f007e200640 1 --2- 172.21.15.49:0/2638376742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00780cce30 0x7f007806f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.429+0000 7f007d800640 1 -- 172.21.15.49:0/2638376742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00780cce30 msgr2=0x7f007806f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.429+0000 7f007d800640 1 --2- 172.21.15.49:0/2638376742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00780cce30 0x7f007806f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.429+0000 7f0077e00640 1 -- 172.21.15.49:0/2638376742 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742516645 0 0) 0x7f00780cb990 con 0x7f007806ee50 2024-01-31T05:05:23.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.429+0000 7f007d800640 1 -- 172.21.15.49:0/2638376742 >> v1:172.21.15.49:6789/0 conn(0x7f007806ee50 legacy=0x7f00780cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:23.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.429+0000 7f007d800640 1 -- 172.21.15.49:0/2638376742 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00780d01b0 con 0x7f007815d3a0 2024-01-31T05:05:23.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.429+0000 7f007d800640 1 --2- 172.21.15.49:0/2638376742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f007815d3a0 0x7f007806e910 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f00680097c0 tx=0x7f006801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc907af710ccf79 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:23.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.429+0000 7f0077e00640 1 -- 172.21.15.49:0/2638376742 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00680a6040 con 0x7f007815d3a0 2024-01-31T05:05:23.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.429+0000 7f0077e00640 1 -- 172.21.15.49:0/2638376742 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00680aa600 con 0x7f007815d3a0 2024-01-31T05:05:23.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.429+0000 7f0077e00640 1 -- 172.21.15.49:0/2638376742 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00680aa990 con 0x7f007815d3a0 2024-01-31T05:05:23.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.433+0000 7f0080200640 1 -- 172.21.15.49:0/2638376742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f007815d3a0 msgr2=0x7f007806e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:23.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.433+0000 7f0080200640 1 --2- 172.21.15.49:0/2638376742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f007815d3a0 0x7f007806e910 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f00680097c0 tx=0x7f006801c480 comp rx=0 tx=0).stop 2024-01-31T05:05:23.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.433+0000 7f0080200640 1 -- 172.21.15.49:0/2638376742 shutdown_connections 2024-01-31T05:05:23.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.433+0000 7f0080200640 1 --2- 172.21.15.49:0/2638376742 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00780cce30 0x7f007806f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.433+0000 7f0080200640 1 --2- 172.21.15.49:0/2638376742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f007815d3a0 0x7f007806e910 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.433+0000 7f0080200640 1 -- 172.21.15.49:0/2638376742 >> 172.21.15.49:0/2638376742 conn(0x7f00780d0e50 msgr2=0x7f00780d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:23.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.433+0000 7f0080200640 1 -- 172.21.15.49:0/2638376742 shutdown_connections 2024-01-31T05:05:23.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.433+0000 7f0080200640 1 -- 172.21.15.49:0/2638376742 wait complete. 2024-01-31T05:05:23.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.433+0000 7f0080200640 1 Processor -- start 2024-01-31T05:05:23.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.433+0000 7f0080200640 1 -- start start 2024-01-31T05:05:23.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.433+0000 7f0080200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f007806ee50 0x7f00780aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:23.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.433+0000 7f0080200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00780cce30 0x7f00780b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:23.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.433+0000 7f0080200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f007815d3a0 0x7f00780b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:23.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.433+0000 7f0080200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0078159370 con 0x7f007806ee50 2024-01-31T05:05:23.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.433+0000 7f0080200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00780c52d0 con 0x7f007815d3a0 2024-01-31T05:05:23.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.433+0000 7f0080200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0078158db0 con 0x7f00780cce30 2024-01-31T05:05:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.433+0000 7f007d800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f007806ee50 0x7f00780aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f007d800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f007806ee50 0x7f00780aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34896/0 (socket says 172.21.15.49:34896) 2024-01-31T05:05:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f007d800640 1 -- 172.21.15.49:0/1454190289 learned_addr learned my addr 172.21.15.49:0/1454190289 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f007ce00640 1 --2- 172.21.15.49:0/1454190289 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00780cce30 0x7f00780b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f007d800640 1 -- 172.21.15.49:0/1454190289 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00780cce30 msgr2=0x7f00780b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f007e200640 1 --2- 172.21.15.49:0/1454190289 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f007815d3a0 0x7f00780b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f007d800640 1 --2- 172.21.15.49:0/1454190289 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00780cce30 0x7f00780b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f007d800640 1 -- 172.21.15.49:0/1454190289 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f007815d3a0 msgr2=0x7f00780b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f007d800640 1 --2- 172.21.15.49:0/1454190289 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f007815d3a0 0x7f00780b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f007d800640 1 -- 172.21.15.49:0/1454190289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0068009420 con 0x7f007806ee50 2024-01-31T05:05:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f007e200640 1 --2- 172.21.15.49:0/1454190289 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f007815d3a0 0x7f00780b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f007ce00640 1 --2- 172.21.15.49:0/1454190289 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00780cce30 0x7f00780b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f007d800640 1 --2- 172.21.15.49:0/1454190289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f007806ee50 0x7f00780aef70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f006801a0b0 tx=0x7f006801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:23.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f0075600640 1 -- 172.21.15.49:0/1454190289 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00680b3600 con 0x7f007806ee50 2024-01-31T05:05:23.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f0075600640 1 -- 172.21.15.49:0/1454190289 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00680b3760 con 0x7f007806ee50 2024-01-31T05:05:23.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f0075600640 1 -- 172.21.15.49:0/1454190289 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00680b3af0 con 0x7f007806ee50 2024-01-31T05:05:23.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f0080200640 1 -- 172.21.15.49:0/1454190289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0078159090 con 0x7f007806ee50 2024-01-31T05:05:23.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f0080200640 1 -- 172.21.15.49:0/1454190289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00780c5850 con 0x7f007806ee50 2024-01-31T05:05:23.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f0080200640 1 -- 172.21.15.49:0/1454190289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007806fdb0 con 0x7f007806ee50 2024-01-31T05:05:23.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f0075600640 1 -- 172.21.15.49:0/1454190289 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f00680b3c50 con 0x7f007806ee50 2024-01-31T05:05:23.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.437+0000 7f0075600640 1 --2- 172.21.15.49:0/1454190289 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0050066500 0x7f00500689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:23.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.441+0000 7f0075600640 1 -- 172.21.15.49:0/1454190289 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f006811e3c0 con 0x7f007806ee50 2024-01-31T05:05:23.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.441+0000 7f007ce00640 1 --2- 172.21.15.49:0/1454190289 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0050066500 0x7f00500689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:23.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.441+0000 7f007ce00640 1 --2- 172.21.15.49:0/1454190289 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0050066500 0x7f00500689c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0078155bd0 tx=0x7f0060009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:23.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.445+0000 7f0075600640 1 -- 172.21.15.49:0/1454190289 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f00680eb290 con 0x7f007806ee50 2024-01-31T05:05:23.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.605+0000 7f0080200640 1 -- 172.21.15.49:0/1454190289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00780c5a40 con 0x7f007806ee50 2024-01-31T05:05:23.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.605+0000 7f0075600640 1 -- 172.21.15.49:0/1454190289 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00680ee8b0 con 0x7f007806ee50 2024-01-31T05:05:23.605 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:05:23.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.605+0000 7f0080200640 1 -- 172.21.15.49:0/1454190289 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0050066500 msgr2=0x7f00500689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:23.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.605+0000 7f0080200640 1 --2- 172.21.15.49:0/1454190289 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0050066500 0x7f00500689c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0078155bd0 tx=0x7f0060009040 comp rx=0 tx=0).stop 2024-01-31T05:05:23.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.605+0000 7f0080200640 1 -- 172.21.15.49:0/1454190289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f007806ee50 msgr2=0x7f00780aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:23.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.605+0000 7f0080200640 1 --2- 172.21.15.49:0/1454190289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f007806ee50 0x7f00780aef70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f006801a0b0 tx=0x7f006801acc0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.605+0000 7f0080200640 1 -- 172.21.15.49:0/1454190289 shutdown_connections 2024-01-31T05:05:23.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.605+0000 7f0080200640 1 --2- 172.21.15.49:0/1454190289 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0050066500 0x7f00500689c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.605+0000 7f0080200640 1 --2- 172.21.15.49:0/1454190289 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f007815d3a0 0x7f00780b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.605+0000 7f0080200640 1 --2- 172.21.15.49:0/1454190289 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00780cce30 0x7f00780b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.605+0000 7f0080200640 1 --2- 172.21.15.49:0/1454190289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f007806ee50 0x7f00780aef70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.605+0000 7f0080200640 1 -- 172.21.15.49:0/1454190289 >> 172.21.15.49:0/1454190289 conn(0x7f00780d0e50 msgr2=0x7f00780cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:23.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.605+0000 7f0080200640 1 -- 172.21.15.49:0/1454190289 shutdown_connections 2024-01-31T05:05:23.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.605+0000 7f0080200640 1 -- 172.21.15.49:0/1454190289 wait complete. 2024-01-31T05:05:23.626 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:05:23.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.769+0000 7f7c60e00640 1 Processor -- start 2024-01-31T05:05:23.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.769+0000 7f7c60e00640 1 -- start start 2024-01-31T05:05:23.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.769+0000 7f7c60e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7c5c15d470 0x7f7c5c0cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:23.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.769+0000 7f7c60e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c5c06bb90 0x7f7c5c06c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:23.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.769+0000 7f7c60e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5c06c9e0 con 0x7f7c5c06c590 2024-01-31T05:05:23.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.769+0000 7f7c60e00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5c0d0650 con 0x7f7c5c06bb90 2024-01-31T05:05:23.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.769+0000 7f7c60e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5c0cb610 con 0x7f7c5c15d470 2024-01-31T05:05:23.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.769+0000 7f7c59400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c5c06bb90 0x7f7c5c06c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:23.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.769+0000 7f7c59400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c5c06bb90 0x7f7c5c06c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34904/0 (socket says 172.21.15.49:34904) 2024-01-31T05:05:23.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.769+0000 7f7c59400640 1 -- 172.21.15.49:0/2945648400 learned_addr learned my addr 172.21.15.49:0/2945648400 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:23.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.769+0000 7f7c59e00640 1 --2- 172.21.15.49:0/2945648400 >> v2:172.21.15.195:3300/0 conn(0x7f7c5c15d470 0x7f7c5c0cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:23.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.769+0000 7f7c59400640 1 -- 172.21.15.49:0/2945648400 >> v2:172.21.15.195:3300/0 conn(0x7f7c5c15d470 msgr2=0x7f7c5c0cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:23.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.769+0000 7f7c59400640 1 --2- 172.21.15.49:0/2945648400 >> v2:172.21.15.195:3300/0 conn(0x7f7c5c15d470 0x7f7c5c0cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.769+0000 7f7c59400640 1 -- 172.21.15.49:0/2945648400 >> v1:172.21.15.195:6789/0 conn(0x7f7c5c06c590 legacy=0x7f7c5c0cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:23.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.769+0000 7f7c59400640 1 -- 172.21.15.49:0/2945648400 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c0d0090 con 0x7f7c5c06bb90 2024-01-31T05:05:23.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.769+0000 7f7c59e00640 1 --2- 172.21.15.49:0/2945648400 >> v2:172.21.15.195:3300/0 conn(0x7f7c5c15d470 0x7f7c5c0cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:23.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.773+0000 7f7c59400640 1 --2- 172.21.15.49:0/2945648400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c5c06bb90 0x7f7c5c06c050 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009870 tx=0x7f7c4401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c97a88d9f29530 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:23.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.773+0000 7f7c58a00640 1 -- 172.21.15.49:0/2945648400 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440aa5f0 con 0x7f7c5c06bb90 2024-01-31T05:05:23.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.773+0000 7f7c58a00640 1 -- 172.21.15.49:0/2945648400 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c440aa750 con 0x7f7c5c06bb90 2024-01-31T05:05:23.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.773+0000 7f7c58a00640 1 -- 172.21.15.49:0/2945648400 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440aaae0 con 0x7f7c5c06bb90 2024-01-31T05:05:23.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.773+0000 7f7c60e00640 1 -- 172.21.15.49:0/2945648400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c5c06bb90 msgr2=0x7f7c5c06c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:23.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.773+0000 7f7c60e00640 1 --2- 172.21.15.49:0/2945648400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c5c06bb90 0x7f7c5c06c050 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009870 tx=0x7f7c4401c490 comp rx=0 tx=0).stop 2024-01-31T05:05:23.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.773+0000 7f7c60e00640 1 -- 172.21.15.49:0/2945648400 shutdown_connections 2024-01-31T05:05:23.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.773+0000 7f7c60e00640 1 --2- 172.21.15.49:0/2945648400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c5c06bb90 0x7f7c5c06c050 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.773+0000 7f7c60e00640 1 --2- 172.21.15.49:0/2945648400 >> v2:172.21.15.195:3300/0 conn(0x7f7c5c15d470 0x7f7c5c0cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.773+0000 7f7c60e00640 1 -- 172.21.15.49:0/2945648400 >> 172.21.15.49:0/2945648400 conn(0x7f7c5c0d0e20 msgr2=0x7f7c5c0d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:23.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.773+0000 7f7c60e00640 1 -- 172.21.15.49:0/2945648400 shutdown_connections 2024-01-31T05:05:23.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.773+0000 7f7c60e00640 1 -- 172.21.15.49:0/2945648400 wait complete. 2024-01-31T05:05:23.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.777+0000 7f7c60e00640 1 Processor -- start 2024-01-31T05:05:23.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.777+0000 7f7c60e00640 1 -- start start 2024-01-31T05:05:23.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.777+0000 7f7c60e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c5c06bb90 0x7f7c5c153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:23.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.777+0000 7f7c60e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c5c06c590 0x7f7c5c1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:23.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.777+0000 7f7c60e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c5c15d470 0x7f7c5c157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:23.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.777+0000 7f7c60e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c155330 con 0x7f7c5c06c590 2024-01-31T05:05:23.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.777+0000 7f7c60e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c154720 con 0x7f7c5c06bb90 2024-01-31T05:05:23.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.777+0000 7f7c60e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c154a00 con 0x7f7c5c15d470 2024-01-31T05:05:23.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.777+0000 7f7c59400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c5c06c590 0x7f7c5c1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:23.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.777+0000 7f7c59400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c5c06c590 0x7f7c5c1540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34918/0 (socket says 172.21.15.49:34918) 2024-01-31T05:05:23.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.777+0000 7f7c59400640 1 -- 172.21.15.49:0/93685199 learned_addr learned my addr 172.21.15.49:0/93685199 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:23.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.777+0000 7f7c5a800640 1 --2- 172.21.15.49:0/93685199 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c5c15d470 0x7f7c5c157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:23.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.777+0000 7f7c59e00640 1 --2- 172.21.15.49:0/93685199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c5c06bb90 0x7f7c5c153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:23.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.777+0000 7f7c59400640 1 -- 172.21.15.49:0/93685199 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c5c15d470 msgr2=0x7f7c5c157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:23.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.777+0000 7f7c59400640 1 --2- 172.21.15.49:0/93685199 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c5c15d470 0x7f7c5c157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.777+0000 7f7c59400640 1 -- 172.21.15.49:0/93685199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c5c06bb90 msgr2=0x7f7c5c153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:23.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.777+0000 7f7c59400640 1 --2- 172.21.15.49:0/93685199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c5c06bb90 0x7f7c5c153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.777+0000 7f7c59400640 1 -- 172.21.15.49:0/93685199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c440094d0 con 0x7f7c5c06c590 2024-01-31T05:05:23.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.777+0000 7f7c59400640 1 --2- 172.21.15.49:0/93685199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c5c06c590 0x7f7c5c1540f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7c440ac040 tx=0x7f7c4401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:23.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.781+0000 7f7c52000640 1 -- 172.21.15.49:0/93685199 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440b3800 con 0x7f7c5c06c590 2024-01-31T05:05:23.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.781+0000 7f7c52000640 1 -- 172.21.15.49:0/93685199 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c440b3980 con 0x7f7c5c06c590 2024-01-31T05:05:23.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.781+0000 7f7c52000640 1 -- 172.21.15.49:0/93685199 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440b3d30 con 0x7f7c5c06c590 2024-01-31T05:05:23.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.781+0000 7f7c60e00640 1 -- 172.21.15.49:0/93685199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5c154ce0 con 0x7f7c5c06c590 2024-01-31T05:05:23.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.781+0000 7f7c60e00640 1 -- 172.21.15.49:0/93685199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5c14dd70 con 0x7f7c5c06c590 2024-01-31T05:05:23.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.781+0000 7f7c60e00640 1 -- 172.21.15.49:0/93685199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c5c0cb2c0 con 0x7f7c5c06c590 2024-01-31T05:05:23.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.781+0000 7f7c52000640 1 -- 172.21.15.49:0/93685199 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f7c440c6390 con 0x7f7c5c06c590 2024-01-31T05:05:23.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.781+0000 7f7c52000640 1 --2- 172.21.15.49:0/93685199 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7c34066500 0x7f7c340689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:23.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.781+0000 7f7c52000640 1 -- 172.21.15.49:0/93685199 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7c440a7070 con 0x7f7c5c06c590 2024-01-31T05:05:23.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.781+0000 7f7c59e00640 1 --2- 172.21.15.49:0/93685199 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7c34066500 0x7f7c340689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:23.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.785+0000 7f7c59e00640 1 --2- 172.21.15.49:0/93685199 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7c34066500 0x7f7c340689c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00ab60 tx=0x7f7c4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:23.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.785+0000 7f7c52000640 1 -- 172.21.15.49:0/93685199 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f7c440ebab0 con 0x7f7c5c06c590 2024-01-31T05:05:23.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.945+0000 7f7c60e00640 1 -- 172.21.15.49:0/93685199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c5c06c9e0 con 0x7f7c5c06c590 2024-01-31T05:05:23.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.945+0000 7f7c52000640 1 -- 172.21.15.49:0/93685199 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c5c06c9e0 con 0x7f7c5c06c590 2024-01-31T05:05:23.945 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:23.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.945+0000 7f7c60e00640 1 -- 172.21.15.49:0/93685199 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7c34066500 msgr2=0x7f7c340689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.945+0000 7f7c60e00640 1 --2- 172.21.15.49:0/93685199 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7c34066500 0x7f7c340689c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00ab60 tx=0x7f7c4c008040 comp rx=0 tx=0).stop 2024-01-31T05:05:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.945+0000 7f7c60e00640 1 -- 172.21.15.49:0/93685199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c5c06c590 msgr2=0x7f7c5c1540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.945+0000 7f7c60e00640 1 --2- 172.21.15.49:0/93685199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c5c06c590 0x7f7c5c1540f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7c440ac040 tx=0x7f7c4401acd0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.945+0000 7f7c60e00640 1 -- 172.21.15.49:0/93685199 shutdown_connections 2024-01-31T05:05:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.945+0000 7f7c60e00640 1 --2- 172.21.15.49:0/93685199 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c5c15d470 0x7f7c5c157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.945+0000 7f7c60e00640 1 --2- 172.21.15.49:0/93685199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c5c06c590 0x7f7c5c1540f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.945+0000 7f7c60e00640 1 --2- 172.21.15.49:0/93685199 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7c34066500 0x7f7c340689c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.945+0000 7f7c60e00640 1 --2- 172.21.15.49:0/93685199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c5c06bb90 0x7f7c5c153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.945+0000 7f7c60e00640 1 -- 172.21.15.49:0/93685199 >> 172.21.15.49:0/93685199 conn(0x7f7c5c0d0e20 msgr2=0x7f7c5c073da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.945+0000 7f7c60e00640 1 -- 172.21.15.49:0/93685199 shutdown_connections 2024-01-31T05:05:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:23.945+0000 7f7c60e00640 1 -- 172.21.15.49:0/93685199 wait complete. 2024-01-31T05:05:23.967 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:05:24.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.109+0000 7f5285c00640 1 Processor -- start 2024-01-31T05:05:24.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.109+0000 7f5285c00640 1 -- start start 2024-01-31T05:05:24.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.113+0000 7f5285c00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f528015a000 0x7f52800cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.113+0000 7f5285c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f528006c2d0 0x7f5280070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.113+0000 7f5285c00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f528006c750 con 0x7f5280071410 2024-01-31T05:05:24.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.113+0000 7f5285c00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52800b3760 con 0x7f528015a000 2024-01-31T05:05:24.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.113+0000 7f5285c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5280071e40 con 0x7f528006c2d0 2024-01-31T05:05:24.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.113+0000 7f527ea00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f528015a000 0x7f52800cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:24.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.113+0000 7f527f400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5280071410 0x7f52800b1ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57932/0 (socket says 172.21.15.49:57932) 2024-01-31T05:05:24.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.113+0000 7f527f400640 1 -- 172.21.15.49:0/3204204725 learned_addr learned my addr 172.21.15.49:0/3204204725 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:24.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.113+0000 7f527e000640 1 --2- 172.21.15.49:0/3204204725 >> v2:172.21.15.195:3300/0 conn(0x7f528006c2d0 0x7f5280070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:24.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.113+0000 7f527ea00640 1 -- 172.21.15.49:0/3204204725 >> v2:172.21.15.195:3300/0 conn(0x7f528006c2d0 msgr2=0x7f5280070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:24.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.113+0000 7f527d600640 1 -- 172.21.15.49:0/3204204725 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179788323 0 0) 0x7f52780014a0 con 0x7f5280071410 2024-01-31T05:05:24.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.113+0000 7f527ea00640 1 --2- 172.21.15.49:0/3204204725 >> v2:172.21.15.195:3300/0 conn(0x7f528006c2d0 0x7f5280070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.113+0000 7f527ea00640 1 -- 172.21.15.49:0/3204204725 >> v1:172.21.15.49:6789/0 conn(0x7f5280071410 legacy=0x7f52800b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:24.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.113+0000 7f527ea00640 1 -- 172.21.15.49:0/3204204725 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528006c990 con 0x7f528015a000 2024-01-31T05:05:24.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.117+0000 7f527ea00640 1 --2- 172.21.15.49:0/3204204725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f528015a000 0x7f52800cb040 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5280072e80 tx=0x7f527001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8c86ebffaa7430 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:24.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.117+0000 7f527d600640 1 -- 172.21.15.49:0/3204204725 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52800b2bc0 con 0x7f528015a000 2024-01-31T05:05:24.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.117+0000 7f527d600640 1 -- 172.21.15.49:0/3204204725 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52700a7050 con 0x7f528015a000 2024-01-31T05:05:24.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.117+0000 7f527d600640 1 -- 172.21.15.49:0/3204204725 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5270004450 con 0x7f528015a000 2024-01-31T05:05:24.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.117+0000 7f5285c00640 1 -- 172.21.15.49:0/3204204725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f528015a000 msgr2=0x7f52800cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:24.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.117+0000 7f5285c00640 1 --2- 172.21.15.49:0/3204204725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f528015a000 0x7f52800cb040 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5280072e80 tx=0x7f527001c460 comp rx=0 tx=0).stop 2024-01-31T05:05:24.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.117+0000 7f5285c00640 1 -- 172.21.15.49:0/3204204725 shutdown_connections 2024-01-31T05:05:24.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.117+0000 7f5285c00640 1 --2- 172.21.15.49:0/3204204725 >> v2:172.21.15.195:3300/0 conn(0x7f528006c2d0 0x7f5280070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.117+0000 7f5285c00640 1 --2- 172.21.15.49:0/3204204725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f528015a000 0x7f52800cb040 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.117+0000 7f5285c00640 1 -- 172.21.15.49:0/3204204725 >> 172.21.15.49:0/3204204725 conn(0x7f52800b09a0 msgr2=0x7f52800b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:24.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.117+0000 7f5285c00640 1 -- 172.21.15.49:0/3204204725 shutdown_connections 2024-01-31T05:05:24.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.117+0000 7f5285c00640 1 -- 172.21.15.49:0/3204204725 wait complete. 2024-01-31T05:05:24.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.117+0000 7f5285c00640 1 Processor -- start 2024-01-31T05:05:24.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.117+0000 7f5285c00640 1 -- start start 2024-01-31T05:05:24.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f5285c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f528006c2d0 0x7f52801567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f5285c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5280071410 0x7f52801556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f5285c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f528015a000 0x7f52801505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f5285c00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5280157410 con 0x7f528006c2d0 2024-01-31T05:05:24.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f5285c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528014e5e0 con 0x7f528015a000 2024-01-31T05:05:24.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f5285c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528014dfb0 con 0x7f5280071410 2024-01-31T05:05:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f527ea00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f528006c2d0 0x7f52801567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f527ea00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f528006c2d0 0x7f52801567c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34946/0 (socket says 172.21.15.49:34946) 2024-01-31T05:05:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f527ea00640 1 -- 172.21.15.49:0/597001235 learned_addr learned my addr 172.21.15.49:0/597001235 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f527f400640 1 --2- 172.21.15.49:0/597001235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f528015a000 0x7f52801505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f527e000640 1 --2- 172.21.15.49:0/597001235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5280071410 0x7f52801556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f527ea00640 1 -- 172.21.15.49:0/597001235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5280071410 msgr2=0x7f52801556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f527ea00640 1 --2- 172.21.15.49:0/597001235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5280071410 0x7f52801556f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f527ea00640 1 -- 172.21.15.49:0/597001235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f528015a000 msgr2=0x7f52801505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f527ea00640 1 --2- 172.21.15.49:0/597001235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f528015a000 0x7f52801505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f527ea00640 1 -- 172.21.15.49:0/597001235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5270009420 con 0x7f528006c2d0 2024-01-31T05:05:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f527e000640 1 --2- 172.21.15.49:0/597001235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5280071410 0x7f52801556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f527ea00640 1 --2- 172.21.15.49:0/597001235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f528006c2d0 0x7f52801567c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5270019070 tx=0x7f5270019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:24.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f5276a00640 1 -- 172.21.15.49:0/597001235 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5270003e60 con 0x7f528006c2d0 2024-01-31T05:05:24.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f5276a00640 1 -- 172.21.15.49:0/597001235 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5270006e20 con 0x7f528006c2d0 2024-01-31T05:05:24.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f5276a00640 1 -- 172.21.15.49:0/597001235 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52700ab680 con 0x7f528006c2d0 2024-01-31T05:05:24.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f5285c00640 1 -- 172.21.15.49:0/597001235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5280155c30 con 0x7f528006c2d0 2024-01-31T05:05:24.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f5285c00640 1 -- 172.21.15.49:0/597001235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5280157130 con 0x7f528006c2d0 2024-01-31T05:05:24.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.121+0000 7f5285c00640 1 -- 172.21.15.49:0/597001235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f528014e720 con 0x7f528006c2d0 2024-01-31T05:05:24.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.125+0000 7f5276a00640 1 -- 172.21.15.49:0/597001235 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f52700b2040 con 0x7f528006c2d0 2024-01-31T05:05:24.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.125+0000 7f5276a00640 1 --2- 172.21.15.49:0/597001235 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5258066500 0x7f52580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.125+0000 7f5276a00640 1 -- 172.21.15.49:0/597001235 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f527011e670 con 0x7f528006c2d0 2024-01-31T05:05:24.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.125+0000 7f527e000640 1 --2- 172.21.15.49:0/597001235 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5258066500 0x7f52580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:24.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.125+0000 7f527e000640 1 --2- 172.21.15.49:0/597001235 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5258066500 0x7f52580689c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f52801538c0 tx=0x7f5268008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:24.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.129+0000 7f5276a00640 1 -- 172.21.15.49:0/597001235 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f52700eb660 con 0x7f528006c2d0 2024-01-31T05:05:24.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.289+0000 7f5285c00640 1 -- 172.21.15.49:0/597001235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5280074860 con 0x7f528006c2d0 2024-01-31T05:05:24.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.289+0000 7f5276a00640 1 -- 172.21.15.49:0/597001235 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f52700eec80 con 0x7f528006c2d0 2024-01-31T05:05:24.290 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-31T05:05:24.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.289+0000 7f5285c00640 1 -- 172.21.15.49:0/597001235 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5258066500 msgr2=0x7f52580689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:24.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.289+0000 7f5285c00640 1 --2- 172.21.15.49:0/597001235 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5258066500 0x7f52580689c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f52801538c0 tx=0x7f5268008040 comp rx=0 tx=0).stop 2024-01-31T05:05:24.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.289+0000 7f5285c00640 1 -- 172.21.15.49:0/597001235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f528006c2d0 msgr2=0x7f52801567c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:24.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.289+0000 7f5285c00640 1 --2- 172.21.15.49:0/597001235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f528006c2d0 0x7f52801567c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5270019070 tx=0x7f5270019200 comp rx=0 tx=0).stop 2024-01-31T05:05:24.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.289+0000 7f5285c00640 1 -- 172.21.15.49:0/597001235 shutdown_connections 2024-01-31T05:05:24.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.289+0000 7f5285c00640 1 --2- 172.21.15.49:0/597001235 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5258066500 0x7f52580689c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.289+0000 7f5285c00640 1 --2- 172.21.15.49:0/597001235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f528015a000 0x7f52801505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.289+0000 7f5285c00640 1 --2- 172.21.15.49:0/597001235 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5280071410 0x7f52801556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.289+0000 7f5285c00640 1 --2- 172.21.15.49:0/597001235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f528006c2d0 0x7f52801567c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.289+0000 7f5285c00640 1 -- 172.21.15.49:0/597001235 >> 172.21.15.49:0/597001235 conn(0x7f52800b09a0 msgr2=0x7f52800b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:24.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.289+0000 7f5285c00640 1 -- 172.21.15.49:0/597001235 shutdown_connections 2024-01-31T05:05:24.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.289+0000 7f5285c00640 1 -- 172.21.15.49:0/597001235 wait complete. 2024-01-31T05:05:24.312 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-31T05:05:24.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.457+0000 7fa615e00640 1 Processor -- start 2024-01-31T05:05:24.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.457+0000 7fa615e00640 1 -- start start 2024-01-31T05:05:24.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa615e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa61015b110 0x7fa61006c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa615e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6100714e0 0x7fa6100ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa615e00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61015b4f0 con 0x7fa6100cdf10 2024-01-31T05:05:24.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa615e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6100ce460 con 0x7fa61015b110 2024-01-31T05:05:24.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa615e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6100abf20 con 0x7fa6100714e0 2024-01-31T05:05:24.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60e000640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa6100cdf10 0x7fa610070dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57934/0 (socket says 172.21.15.49:57934) 2024-01-31T05:05:24.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60e000640 1 -- 172.21.15.49:0/2240640565 learned_addr learned my addr 172.21.15.49:0/2240640565 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:24.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60f400640 1 --2- 172.21.15.49:0/2240640565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6100714e0 0x7fa6100ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:24.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60ea00640 1 --2- 172.21.15.49:0/2240640565 >> v2:172.21.15.195:3300/0 conn(0x7fa61015b110 0x7fa61006c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:24.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60d600640 1 -- 172.21.15.49:0/2240640565 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45687880 0 0) 0x7fa5f8001120 con 0x7fa6100cdf10 2024-01-31T05:05:24.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60d600640 1 -- 172.21.15.49:0/2240640565 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5f0003530 con 0x7fa6100cdf10 2024-01-31T05:05:24.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60d600640 1 -- 172.21.15.49:0/2240640565 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2158947621 0 0) 0x7fa5f0003530 con 0x7fa6100cdf10 2024-01-31T05:05:24.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60d600640 1 -- 172.21.15.49:0/2240640565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6100714e0 msgr2=0x7fa6100ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:24.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60d600640 1 --2- 172.21.15.49:0/2240640565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6100714e0 0x7fa6100ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60d600640 1 -- 172.21.15.49:0/2240640565 >> v2:172.21.15.195:3300/0 conn(0x7fa61015b110 msgr2=0x7fa61006c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:24.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60d600640 1 --2- 172.21.15.49:0/2240640565 >> v2:172.21.15.195:3300/0 conn(0x7fa61015b110 0x7fa61006c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60d600640 1 -- 172.21.15.49:0/2240640565 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6100ac200 con 0x7fa6100cdf10 2024-01-31T05:05:24.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60d600640 1 -- 172.21.15.49:0/2240640565 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7fa5f8001810 con 0x7fa6100cdf10 2024-01-31T05:05:24.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60d600640 1 -- 172.21.15.49:0/2240640565 >> v1:172.21.15.49:6789/0 conn(0x7fa6100cdf10 legacy=0x7fa610070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:24.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60d600640 1 --2- 172.21.15.49:0/2240640565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5f0003980 0x7fa5f0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60d600640 1 --2- 172.21.15.49:0/2240640565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6100714e0 0x7fa5f00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60d600640 1 --2- 172.21.15.49:0/2240640565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5f0004d10 0x7fa5f0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60d600640 1 -- 172.21.15.49:0/2240640565 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6100ce460 con 0x7fa5f0003980 2024-01-31T05:05:24.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60d600640 1 -- 172.21.15.49:0/2240640565 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6100abf20 con 0x7fa5f0004d10 2024-01-31T05:05:24.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60d600640 1 -- 172.21.15.49:0/2240640565 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f000b990 con 0x7fa6100714e0 2024-01-31T05:05:24.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60ea00640 1 --2- 172.21.15.49:0/2240640565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5f0003980 0x7fa5f0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:24.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60f400640 1 --2- 172.21.15.49:0/2240640565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5f0004d10 0x7fa5f0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:24.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60e000640 1 --2- 172.21.15.49:0/2240640565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6100714e0 0x7fa5f00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:24.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60ea00640 1 -- 172.21.15.49:0/2240640565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6100714e0 msgr2=0x7fa5f00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:24.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60ea00640 1 --2- 172.21.15.49:0/2240640565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6100714e0 0x7fa5f00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60ea00640 1 -- 172.21.15.49:0/2240640565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5f0004d10 msgr2=0x7fa5f0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:24.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60ea00640 1 --2- 172.21.15.49:0/2240640565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5f0004d10 0x7fa5f0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60ea00640 1 -- 172.21.15.49:0/2240640565 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f0003530 con 0x7fa5f0003980 2024-01-31T05:05:24.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.461+0000 7fa60e000640 1 --2- 172.21.15.49:0/2240640565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6100714e0 0x7fa5f00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:24.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.465+0000 7fa60ea00640 1 --2- 172.21.15.49:0/2240640565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5f0003980 0x7fa5f0003da0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa600009b10 tx=0x7fa60001ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1ae4e580e96576 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:24.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.465+0000 7fa60d600640 1 -- 172.21.15.49:0/2240640565 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6000a5650 con 0x7fa5f0003980 2024-01-31T05:05:24.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.465+0000 7fa60d600640 1 -- 172.21.15.49:0/2240640565 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6000a57b0 con 0x7fa5f0003980 2024-01-31T05:05:24.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.465+0000 7fa60d600640 1 -- 172.21.15.49:0/2240640565 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6000a5b60 con 0x7fa5f0003980 2024-01-31T05:05:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.465+0000 7fa615e00640 1 -- 172.21.15.49:0/2240640565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5f0003980 msgr2=0x7fa5f0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.465+0000 7fa615e00640 1 --2- 172.21.15.49:0/2240640565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5f0003980 0x7fa5f0003da0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa600009b10 tx=0x7fa60001ca60 comp rx=0 tx=0).stop 2024-01-31T05:05:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.465+0000 7fa60f400640 1 -- 172.21.15.49:0/2240640565 reap_dead start 2024-01-31T05:05:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.465+0000 7fa615e00640 1 -- 172.21.15.49:0/2240640565 shutdown_connections 2024-01-31T05:05:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.465+0000 7fa615e00640 1 -- 172.21.15.49:0/2240640565 >> 172.21.15.49:0/2240640565 conn(0x7fa6100b09a0 msgr2=0x7fa6100b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.465+0000 7fa615e00640 1 -- 172.21.15.49:0/2240640565 shutdown_connections 2024-01-31T05:05:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.465+0000 7fa615e00640 1 -- 172.21.15.49:0/2240640565 wait complete. 2024-01-31T05:05:24.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.465+0000 7fa615e00640 1 Processor -- start 2024-01-31T05:05:24.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa615e00640 1 -- start start 2024-01-31T05:05:24.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa615e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5f0003980 0x7fa61015e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa615e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa610151c10 0x7fa610152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa615e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6100afbe0 0x7fa6100b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa615e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61014f1a0 con 0x7fa610151c10 2024-01-31T05:05:24.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa615e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6100b05d0 con 0x7fa6100afbe0 2024-01-31T05:05:24.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa615e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa610152690 con 0x7fa5f0003980 2024-01-31T05:05:24.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa60e000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa610151c10 0x7fa610152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:24.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa60e000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa610151c10 0x7fa610152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34962/0 (socket says 172.21.15.49:34962) 2024-01-31T05:05:24.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa60e000640 1 -- 172.21.15.49:0/37935304 learned_addr learned my addr 172.21.15.49:0/37935304 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:24.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa60f400640 1 --2- 172.21.15.49:0/37935304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6100afbe0 0x7fa6100b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:24.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa60e000640 1 -- 172.21.15.49:0/37935304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5f0003980 msgr2=0x7fa61015e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:24.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa60e000640 1 --2- 172.21.15.49:0/37935304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5f0003980 0x7fa61015e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa60e000640 1 -- 172.21.15.49:0/37935304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6100afbe0 msgr2=0x7fa6100b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:24.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa60e000640 1 --2- 172.21.15.49:0/37935304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6100afbe0 0x7fa6100b0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa60e000640 1 -- 172.21.15.49:0/37935304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa610152970 con 0x7fa610151c10 2024-01-31T05:05:24.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa60e000640 1 --2- 172.21.15.49:0/37935304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa610151c10 0x7fa610152090 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80013a0 tx=0x7fa5f800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:24.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa607400640 1 -- 172.21.15.49:0/37935304 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f800c840 con 0x7fa610151c10 2024-01-31T05:05:24.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa607400640 1 -- 172.21.15.49:0/37935304 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f800c9a0 con 0x7fa610151c10 2024-01-31T05:05:24.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa607400640 1 -- 172.21.15.49:0/37935304 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f800cd10 con 0x7fa610151c10 2024-01-31T05:05:24.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa615e00640 1 -- 172.21.15.49:0/37935304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa610152c50 con 0x7fa610151c10 2024-01-31T05:05:24.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa615e00640 1 -- 172.21.15.49:0/37935304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa610153210 con 0x7fa610151c10 2024-01-31T05:05:24.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.469+0000 7fa615e00640 1 -- 172.21.15.49:0/37935304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa610074860 con 0x7fa610151c10 2024-01-31T05:05:24.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.473+0000 7fa607400640 1 -- 172.21.15.49:0/37935304 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa5f8013420 con 0x7fa610151c10 2024-01-31T05:05:24.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.473+0000 7fa607400640 1 --2- 172.21.15.49:0/37935304 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa5e8066530 0x7fa5e80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.473+0000 7fa607400640 1 -- 172.21.15.49:0/37935304 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa5f8083d30 con 0x7fa610151c10 2024-01-31T05:05:24.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.473+0000 7fa60ea00640 1 --2- 172.21.15.49:0/37935304 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa5e8066530 0x7fa5e80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:24.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.473+0000 7fa60ea00640 1 --2- 172.21.15.49:0/37935304 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa5e8066530 0x7fa5e80689f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa6000af000 tx=0x7fa600004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:24.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.477+0000 7fa607400640 1 -- 172.21.15.49:0/37935304 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa5f8050b70 con 0x7fa610151c10 2024-01-31T05:05:24.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.637+0000 7fa615e00640 1 -- 172.21.15.49:0/37935304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa61006d330 con 0x7fa610151c10 2024-01-31T05:05:24.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.637+0000 7fa607400640 1 -- 172.21.15.49:0/37935304 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa5f8054190 con 0x7fa610151c10 2024-01-31T05:05:24.638 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:24.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.641+0000 7fa615e00640 1 -- 172.21.15.49:0/37935304 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa5e8066530 msgr2=0x7fa5e80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:24.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.641+0000 7fa615e00640 1 --2- 172.21.15.49:0/37935304 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa5e8066530 0x7fa5e80689f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa6000af000 tx=0x7fa600004740 comp rx=0 tx=0).stop 2024-01-31T05:05:24.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.641+0000 7fa615e00640 1 -- 172.21.15.49:0/37935304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa610151c10 msgr2=0x7fa610152090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:24.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.641+0000 7fa615e00640 1 --2- 172.21.15.49:0/37935304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa610151c10 0x7fa610152090 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80013a0 tx=0x7fa5f800ec80 comp rx=0 tx=0).stop 2024-01-31T05:05:24.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.641+0000 7fa615e00640 1 -- 172.21.15.49:0/37935304 shutdown_connections 2024-01-31T05:05:24.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.641+0000 7fa615e00640 1 --2- 172.21.15.49:0/37935304 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa5e8066530 0x7fa5e80689f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.641+0000 7fa615e00640 1 --2- 172.21.15.49:0/37935304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6100afbe0 0x7fa6100b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.641+0000 7fa615e00640 1 --2- 172.21.15.49:0/37935304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa610151c10 0x7fa610152090 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.641+0000 7fa615e00640 1 --2- 172.21.15.49:0/37935304 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa5f0003980 0x7fa61015e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.641+0000 7fa615e00640 1 -- 172.21.15.49:0/37935304 >> 172.21.15.49:0/37935304 conn(0x7fa6100b09a0 msgr2=0x7fa61006ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:24.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.641+0000 7fa615e00640 1 -- 172.21.15.49:0/37935304 shutdown_connections 2024-01-31T05:05:24.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.641+0000 7fa615e00640 1 -- 172.21.15.49:0/37935304 wait complete. 2024-01-31T05:05:24.660 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-31T05:05:24.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.801+0000 7f9ba4c00640 1 Processor -- start 2024-01-31T05:05:24.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.801+0000 7f9ba4c00640 1 -- start start 2024-01-31T05:05:24.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.801+0000 7f9ba4c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ba015d3a0 0x7f9ba006e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.801+0000 7f9ba4c00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba00cb990 con 0x7f9ba00cce30 2024-01-31T05:05:24.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.801+0000 7f9ba4c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba00d1c20 con 0x7f9ba006ee50 2024-01-31T05:05:24.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.801+0000 7f9ba4c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba00cfed0 con 0x7f9ba015d3a0 2024-01-31T05:05:24.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.801+0000 7f9b9e800640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f9ba00cce30 0x7f9ba00cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57950/0 (socket says 172.21.15.49:57950) 2024-01-31T05:05:24.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.801+0000 7f9b9e800640 1 -- 172.21.15.49:0/3862378000 learned_addr learned my addr 172.21.15.49:0/3862378000 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:24.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.801+0000 7f9b9de00640 1 --2- 172.21.15.49:0/3862378000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ba015d3a0 0x7f9ba006e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:24.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.805+0000 7f9b9ca00640 1 -- 172.21.15.49:0/3862378000 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463969727 0 0) 0x7f9ba00cb990 con 0x7f9ba00cce30 2024-01-31T05:05:24.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.805+0000 7f9b9ca00640 1 -- 172.21.15.49:0/3862378000 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b80003530 con 0x7f9ba00cce30 2024-01-31T05:05:24.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.805+0000 7f9b9ca00640 1 -- 172.21.15.49:0/3862378000 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877792760 0 0) 0x7f9ba00d1c20 con 0x7f9ba006ee50 2024-01-31T05:05:24.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.805+0000 7f9b9ca00640 1 -- 172.21.15.49:0/3862378000 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ba00cb990 con 0x7f9ba006ee50 2024-01-31T05:05:24.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.805+0000 7f9b9de00640 1 -- 172.21.15.49:0/3862378000 >> v1:172.21.15.195:6789/0 conn(0x7f9ba006ee50 legacy=0x7f9ba00cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:24.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.805+0000 7f9b9ca00640 1 -- 172.21.15.49:0/3862378000 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4242132900 0 0) 0x7f9b80003530 con 0x7f9ba00cce30 2024-01-31T05:05:24.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.805+0000 7f9b9de00640 1 -- 172.21.15.49:0/3862378000 >> v1:172.21.15.49:6789/0 conn(0x7f9ba00cce30 legacy=0x7f9ba00cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:24.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.805+0000 7f9b9de00640 1 -- 172.21.15.49:0/3862378000 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba00d01b0 con 0x7f9ba015d3a0 2024-01-31T05:05:24.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.805+0000 7f9b9de00640 1 --2- 172.21.15.49:0/3862378000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ba015d3a0 0x7f9ba006e910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9b900097f0 tx=0x7f9b9001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22cefae1fa36d255 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:24.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.805+0000 7f9b9ca00640 1 -- 172.21.15.49:0/3862378000 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b98001a00 con 0x7f9ba015d3a0 2024-01-31T05:05:24.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.805+0000 7f9b9ca00640 1 -- 172.21.15.49:0/3862378000 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b900ad480 con 0x7f9ba015d3a0 2024-01-31T05:05:24.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.805+0000 7f9b9ca00640 1 -- 172.21.15.49:0/3862378000 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b900ad810 con 0x7f9ba015d3a0 2024-01-31T05:05:24.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.809+0000 7f9ba4c00640 1 -- 172.21.15.49:0/3862378000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ba015d3a0 msgr2=0x7f9ba006e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:24.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.809+0000 7f9ba4c00640 1 --2- 172.21.15.49:0/3862378000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ba015d3a0 0x7f9ba006e910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9b900097f0 tx=0x7f9b9001c3e0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.809+0000 7f9ba4c00640 1 -- 172.21.15.49:0/3862378000 shutdown_connections 2024-01-31T05:05:24.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.809+0000 7f9ba4c00640 1 --2- 172.21.15.49:0/3862378000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ba015d3a0 0x7f9ba006e910 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.809+0000 7f9ba4c00640 1 -- 172.21.15.49:0/3862378000 >> 172.21.15.49:0/3862378000 conn(0x7f9ba00d0e50 msgr2=0x7f9ba00d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:24.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.809+0000 7f9ba4c00640 1 -- 172.21.15.49:0/3862378000 shutdown_connections 2024-01-31T05:05:24.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.809+0000 7f9ba4c00640 1 -- 172.21.15.49:0/3862378000 wait complete. 2024-01-31T05:05:24.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.809+0000 7f9ba4c00640 1 Processor -- start 2024-01-31T05:05:24.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.809+0000 7f9ba4c00640 1 -- start start 2024-01-31T05:05:24.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.809+0000 7f9ba4c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ba006ee50 0x7f9ba014b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.809+0000 7f9ba4c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ba00cce30 0x7f9ba00c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.809+0000 7f9ba4c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ba015d3a0 0x7f9ba00c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.809+0000 7f9ba4c00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba014b8c0 con 0x7f9ba006ee50 2024-01-31T05:05:24.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.809+0000 7f9ba4c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba0157370 con 0x7f9ba015d3a0 2024-01-31T05:05:24.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.809+0000 7f9ba4c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba0156760 con 0x7f9ba00cce30 2024-01-31T05:05:24.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.809+0000 7f9b9de00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ba006ee50 0x7f9ba014b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:24.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.809+0000 7f9b9de00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ba006ee50 0x7f9ba014b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34966/0 (socket says 172.21.15.49:34966) 2024-01-31T05:05:24.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.809+0000 7f9b9de00640 1 -- 172.21.15.49:0/2231928919 learned_addr learned my addr 172.21.15.49:0/2231928919 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:24.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.813+0000 7f9b9d400640 1 --2- 172.21.15.49:0/2231928919 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ba00cce30 0x7f9ba00c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:24.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.813+0000 7f9b9e800640 1 --2- 172.21.15.49:0/2231928919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ba015d3a0 0x7f9ba00c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:24.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.813+0000 7f9b9de00640 1 -- 172.21.15.49:0/2231928919 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ba00cce30 msgr2=0x7f9ba00c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:24.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.813+0000 7f9b9de00640 1 --2- 172.21.15.49:0/2231928919 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ba00cce30 0x7f9ba00c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.813+0000 7f9b9de00640 1 -- 172.21.15.49:0/2231928919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ba015d3a0 msgr2=0x7f9ba00c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:24.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.813+0000 7f9b9de00640 1 --2- 172.21.15.49:0/2231928919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ba015d3a0 0x7f9ba00c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.813+0000 7f9b9de00640 1 -- 172.21.15.49:0/2231928919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b90009420 con 0x7f9ba006ee50 2024-01-31T05:05:24.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.813+0000 7f9b9de00640 1 --2- 172.21.15.49:0/2231928919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ba006ee50 0x7f9ba014b380 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9b900097f0 tx=0x7f9b90019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:24.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.813+0000 7f9b96000640 1 -- 172.21.15.49:0/2231928919 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b900adc40 con 0x7f9ba006ee50 2024-01-31T05:05:24.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.813+0000 7f9b96000640 1 -- 172.21.15.49:0/2231928919 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b900adda0 con 0x7f9ba006ee50 2024-01-31T05:05:24.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.813+0000 7f9ba4c00640 1 -- 172.21.15.49:0/2231928919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba0156a40 con 0x7f9ba006ee50 2024-01-31T05:05:24.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.813+0000 7f9b96000640 1 -- 172.21.15.49:0/2231928919 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b900b7670 con 0x7f9ba006ee50 2024-01-31T05:05:24.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.813+0000 7f9ba4c00640 1 -- 172.21.15.49:0/2231928919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba0157000 con 0x7f9ba006ee50 2024-01-31T05:05:24.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.813+0000 7f9ba4c00640 1 -- 172.21.15.49:0/2231928919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba006fdb0 con 0x7f9ba006ee50 2024-01-31T05:05:24.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.813+0000 7f9b96000640 1 -- 172.21.15.49:0/2231928919 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f9b900b4040 con 0x7f9ba006ee50 2024-01-31T05:05:24.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.817+0000 7f9b96000640 1 --2- 172.21.15.49:0/2231928919 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9b78066500 0x7f9b780689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:24.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.817+0000 7f9b96000640 1 -- 172.21.15.49:0/2231928919 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9b9011e4e0 con 0x7f9ba006ee50 2024-01-31T05:05:24.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.817+0000 7f9b9d400640 1 --2- 172.21.15.49:0/2231928919 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9b78066500 0x7f9b780689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:24.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.817+0000 7f9b9d400640 1 --2- 172.21.15.49:0/2231928919 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9b78066500 0x7f9b780689c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9ba009ef10 tx=0x7f9b88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:24.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.817+0000 7f9b96000640 1 -- 172.21.15.49:0/2231928919 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9b900eb3e0 con 0x7f9ba006ee50 2024-01-31T05:05:24.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.989+0000 7f9ba4c00640 1 -- 172.21.15.49:0/2231928919 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9ba0074860 con 0x7f9ba006ee50 2024-01-31T05:05:24.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.989+0000 7f9b96000640 1 -- 172.21.15.49:0/2231928919 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9b900eea00 con 0x7f9ba006ee50 2024-01-31T05:05:24.989 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2024-01-31T05:05:24.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.989+0000 7f9ba4c00640 1 -- 172.21.15.49:0/2231928919 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9b78066500 msgr2=0x7f9b780689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:24.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.989+0000 7f9ba4c00640 1 --2- 172.21.15.49:0/2231928919 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9b78066500 0x7f9b780689c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9ba009ef10 tx=0x7f9b88009040 comp rx=0 tx=0).stop 2024-01-31T05:05:24.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.989+0000 7f9ba4c00640 1 -- 172.21.15.49:0/2231928919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ba006ee50 msgr2=0x7f9ba014b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:24.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.989+0000 7f9ba4c00640 1 --2- 172.21.15.49:0/2231928919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ba006ee50 0x7f9ba014b380 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9b900097f0 tx=0x7f9b90019180 comp rx=0 tx=0).stop 2024-01-31T05:05:24.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.989+0000 7f9ba4c00640 1 -- 172.21.15.49:0/2231928919 shutdown_connections 2024-01-31T05:05:24.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.989+0000 7f9ba4c00640 1 --2- 172.21.15.49:0/2231928919 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9b78066500 0x7f9b780689c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.989+0000 7f9ba4c00640 1 --2- 172.21.15.49:0/2231928919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ba015d3a0 0x7f9ba00c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.989+0000 7f9ba4c00640 1 --2- 172.21.15.49:0/2231928919 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ba00cce30 0x7f9ba00c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.989+0000 7f9ba4c00640 1 --2- 172.21.15.49:0/2231928919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ba006ee50 0x7f9ba014b380 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:24.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.989+0000 7f9ba4c00640 1 -- 172.21.15.49:0/2231928919 >> 172.21.15.49:0/2231928919 conn(0x7f9ba00d0e50 msgr2=0x7f9ba00d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:24.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.989+0000 7f9ba4c00640 1 -- 172.21.15.49:0/2231928919 shutdown_connections 2024-01-31T05:05:24.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:24.989+0000 7f9ba4c00640 1 -- 172.21.15.49:0/2231928919 wait complete. 2024-01-31T05:05:25.011 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-01-31T05:05:25.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:25.011 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-01-31T05:05:25.031 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T05:05:25.032 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-31T05:05:25.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:25.032 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-01-31T05:05:25.089 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:05:25.089 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T05:05:25.098 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:05:25.098 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T05:05:25.148 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:25.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.289+0000 7fb13d400640 1 Processor -- start 2024-01-31T05:05:25.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.289+0000 7fb13d400640 1 -- start start 2024-01-31T05:05:25.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.289+0000 7fb13d400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb13815e7e0 0x7fb1380b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.289+0000 7fb13d400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb1380c63d0 0x7fb1380cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.289+0000 7fb13d400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1380c67f0 con 0x7fb1380cf4a0 2024-01-31T05:05:25.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.289+0000 7fb13d400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1380d1d40 con 0x7fb1380c63d0 2024-01-31T05:05:25.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.289+0000 7fb13d400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1380cf930 con 0x7fb13815e7e0 2024-01-31T05:05:25.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.289+0000 7fb135e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb1380c63d0 0x7fb1380cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:25.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.289+0000 7fb135e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb1380c63d0 0x7fb1380cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34974/0 (socket says 172.21.15.49:34974) 2024-01-31T05:05:25.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.289+0000 7fb135e00640 1 -- 172.21.15.49:0/1986652898 learned_addr learned my addr 172.21.15.49:0/1986652898 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:25.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.289+0000 7fb135e00640 1 -- 172.21.15.49:0/1986652898 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb13815e7e0 msgr2=0x7fb1380b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:25.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.289+0000 7fb136800640 1 --2- 172.21.15.49:0/1986652898 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb13815e7e0 0x7fb1380b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:25.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.289+0000 7fb135e00640 1 --2- 172.21.15.49:0/1986652898 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb13815e7e0 0x7fb1380b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.289+0000 7fb135e00640 1 -- 172.21.15.49:0/1986652898 >> v1:172.21.15.195:6789/0 conn(0x7fb1380cf4a0 legacy=0x7fb1380c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:25.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.289+0000 7fb135e00640 1 -- 172.21.15.49:0/1986652898 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1380c6ab0 con 0x7fb1380c63d0 2024-01-31T05:05:25.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.289+0000 7fb136800640 1 --2- 172.21.15.49:0/1986652898 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb13815e7e0 0x7fb1380b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:25.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.293+0000 7fb135e00640 1 --2- 172.21.15.49:0/1986652898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1380c63d0 0x7fb1380cef60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb120009870 tx=0x7fb12001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10938b584af4e3bd server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:25.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.293+0000 7fb135400640 1 -- 172.21.15.49:0/1986652898 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1200a89b0 con 0x7fb1380c63d0 2024-01-31T05:05:25.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.293+0000 7fb135400640 1 -- 172.21.15.49:0/1986652898 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1200a8b10 con 0x7fb1380c63d0 2024-01-31T05:05:25.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.293+0000 7fb135400640 1 -- 172.21.15.49:0/1986652898 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1200a8ea0 con 0x7fb1380c63d0 2024-01-31T05:05:25.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.293+0000 7fb13d400640 1 -- 172.21.15.49:0/1986652898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1380c63d0 msgr2=0x7fb1380cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:25.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.293+0000 7fb13d400640 1 --2- 172.21.15.49:0/1986652898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1380c63d0 0x7fb1380cef60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb120009870 tx=0x7fb12001ecf0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.293+0000 7fb13d400640 1 -- 172.21.15.49:0/1986652898 shutdown_connections 2024-01-31T05:05:25.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.293+0000 7fb13d400640 1 --2- 172.21.15.49:0/1986652898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1380c63d0 0x7fb1380cef60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.293+0000 7fb13d400640 1 --2- 172.21.15.49:0/1986652898 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb13815e7e0 0x7fb1380b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.293+0000 7fb13d400640 1 -- 172.21.15.49:0/1986652898 >> 172.21.15.49:0/1986652898 conn(0x7fb1380d0e60 msgr2=0x7fb1380d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:25.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.293+0000 7fb13d400640 1 -- 172.21.15.49:0/1986652898 shutdown_connections 2024-01-31T05:05:25.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.293+0000 7fb13d400640 1 -- 172.21.15.49:0/1986652898 wait complete. 2024-01-31T05:05:25.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb13d400640 1 Processor -- start 2024-01-31T05:05:25.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb13d400640 1 -- start start 2024-01-31T05:05:25.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb13d400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1380c63d0 0x7fb1380b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb13d400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1380cf4a0 0x7fb1380b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb13d400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb13815e7e0 0x7fb13814ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb13d400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13806c050 con 0x7fb1380cf4a0 2024-01-31T05:05:25.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb13d400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb138152a00 con 0x7fb13815e7e0 2024-01-31T05:05:25.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb13d400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1380b6920 con 0x7fb1380c63d0 2024-01-31T05:05:25.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb135e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1380cf4a0 0x7fb1380b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:25.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb135e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1380cf4a0 0x7fb1380b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34986/0 (socket says 172.21.15.49:34986) 2024-01-31T05:05:25.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb135e00640 1 -- 172.21.15.49:0/3279064213 learned_addr learned my addr 172.21.15.49:0/3279064213 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:25.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb137200640 1 --2- 172.21.15.49:0/3279064213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb13815e7e0 0x7fb13814ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:25.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb136800640 1 --2- 172.21.15.49:0/3279064213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1380c63d0 0x7fb1380b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:25.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb135e00640 1 -- 172.21.15.49:0/3279064213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1380c63d0 msgr2=0x7fb1380b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:25.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb135e00640 1 --2- 172.21.15.49:0/3279064213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1380c63d0 0x7fb1380b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb135e00640 1 -- 172.21.15.49:0/3279064213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb13815e7e0 msgr2=0x7fb13814ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:25.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb135e00640 1 --2- 172.21.15.49:0/3279064213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb13815e7e0 0x7fb13814ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb135e00640 1 -- 172.21.15.49:0/3279064213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1200094d0 con 0x7fb1380cf4a0 2024-01-31T05:05:25.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb136800640 1 --2- 172.21.15.49:0/3279064213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1380c63d0 0x7fb1380b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:25.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb135e00640 1 --2- 172.21.15.49:0/3279064213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1380cf4a0 0x7fb1380b4700 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb1200b3040 tx=0x7fb12001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:25.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb12ea00640 1 -- 172.21.15.49:0/3279064213 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1200be070 con 0x7fb1380cf4a0 2024-01-31T05:05:25.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb12ea00640 1 -- 172.21.15.49:0/3279064213 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1200ba400 con 0x7fb1380cf4a0 2024-01-31T05:05:25.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb12ea00640 1 -- 172.21.15.49:0/3279064213 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1200ba7b0 con 0x7fb1380cf4a0 2024-01-31T05:05:25.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb13d400640 1 -- 172.21.15.49:0/3279064213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1380b6c00 con 0x7fb1380cf4a0 2024-01-31T05:05:25.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.297+0000 7fb13d400640 1 -- 172.21.15.49:0/3279064213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1380b65d0 con 0x7fb1380cf4a0 2024-01-31T05:05:25.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.301+0000 7fb13d400640 1 -- 172.21.15.49:0/3279064213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb13806c190 con 0x7fb1380cf4a0 2024-01-31T05:05:25.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.301+0000 7fb12ea00640 1 -- 172.21.15.49:0/3279064213 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb1200ba910 con 0x7fb1380cf4a0 2024-01-31T05:05:25.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.301+0000 7fb12ea00640 1 --2- 172.21.15.49:0/3279064213 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb110066500 0x7fb1100689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.301+0000 7fb12ea00640 1 -- 172.21.15.49:0/3279064213 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb120121fe0 con 0x7fb1380cf4a0 2024-01-31T05:05:25.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.301+0000 7fb136800640 1 --2- 172.21.15.49:0/3279064213 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb110066500 0x7fb1100689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:25.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.305+0000 7fb136800640 1 --2- 172.21.15.49:0/3279064213 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb110066500 0x7fb1100689c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb128006fd0 tx=0x7fb128008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:25.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.305+0000 7fb12ea00640 1 -- 172.21.15.49:0/3279064213 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fb13806c190 con 0x7fb1380cf4a0 2024-01-31T05:05:25.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.465+0000 7fb13d400640 1 -- 172.21.15.49:0/3279064213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb13806c190 con 0x7fb1380cf4a0 2024-01-31T05:05:25.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.465+0000 7fb12ea00640 1 -- 172.21.15.49:0/3279064213 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7fb13806c190 con 0x7fb1380cf4a0 2024-01-31T05:05:25.468 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:25.468 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:58.277568+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.469+0000 7fb13d400640 1 -- 172.21.15.49:0/3279064213 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb110066500 msgr2=0x7fb1100689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.469+0000 7fb13d400640 1 --2- 172.21.15.49:0/3279064213 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb110066500 0x7fb1100689c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb128006fd0 tx=0x7fb128008040 comp rx=0 tx=0).stop 2024-01-31T05:05:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.469+0000 7fb13d400640 1 -- 172.21.15.49:0/3279064213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1380cf4a0 msgr2=0x7fb1380b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.469+0000 7fb13d400640 1 --2- 172.21.15.49:0/3279064213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1380cf4a0 0x7fb1380b4700 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb1200b3040 tx=0x7fb12001ba90 comp rx=0 tx=0).stop 2024-01-31T05:05:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.469+0000 7fb13d400640 1 -- 172.21.15.49:0/3279064213 shutdown_connections 2024-01-31T05:05:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.469+0000 7fb13d400640 1 --2- 172.21.15.49:0/3279064213 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb110066500 0x7fb1100689c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.469+0000 7fb13d400640 1 --2- 172.21.15.49:0/3279064213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb13815e7e0 0x7fb13814ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.469+0000 7fb13d400640 1 --2- 172.21.15.49:0/3279064213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1380cf4a0 0x7fb1380b4700 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.469+0000 7fb13d400640 1 --2- 172.21.15.49:0/3279064213 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1380c63d0 0x7fb1380b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.469+0000 7fb13d400640 1 -- 172.21.15.49:0/3279064213 >> 172.21.15.49:0/3279064213 conn(0x7fb1380d0e60 msgr2=0x7fb13806f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:25.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.469+0000 7fb13d400640 1 -- 172.21.15.49:0/3279064213 shutdown_connections 2024-01-31T05:05:25.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.469+0000 7fb13d400640 1 -- 172.21.15.49:0/3279064213 wait complete. 2024-01-31T05:05:25.490 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:04:14.566345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:04:15.231265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-31T05:04:18.316756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-31T05:05:25.490 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:05:25.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.632+0000 7f512c200640 1 Processor -- start 2024-01-31T05:05:25.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.632+0000 7f512c200640 1 -- start start 2024-01-31T05:05:25.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.632+0000 7f512c200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f51240cf670 0x7f51240b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.632+0000 7f512c200640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51240c6800 con 0x7f512415e7e0 2024-01-31T05:05:25.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.632+0000 7f512c200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51240c6ab0 con 0x7f51240c63d0 2024-01-31T05:05:25.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.632+0000 7f512c200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51240d1d40 con 0x7f51240cf670 2024-01-31T05:05:25.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.632+0000 7f5128e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f51240cf670 0x7f51240b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:25.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.636+0000 7f5128e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f51240cf670 0x7f51240b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34996/0 (socket says 172.21.15.49:34996) 2024-01-31T05:05:25.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.636+0000 7f5128e00640 1 -- 172.21.15.49:0/1799257666 learned_addr learned my addr 172.21.15.49:0/1799257666 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:25.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.636+0000 7f5129800640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f512415e7e0 0x7f51240cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57952/0 (socket says 172.21.15.49:57952) 2024-01-31T05:05:25.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.636+0000 7f5128e00640 1 -- 172.21.15.49:0/1799257666 >> v1:172.21.15.195:6789/0 conn(0x7f51240c63d0 legacy=0x7f51240cbab0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-31T05:05:25.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.636+0000 7f5128e00640 1 -- 172.21.15.49:0/1799257666 >> v1:172.21.15.49:6789/0 conn(0x7f512415e7e0 legacy=0x7f51240cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:25.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.636+0000 7f5128e00640 1 -- 172.21.15.49:0/1799257666 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51240c6d90 con 0x7f51240cf670 2024-01-31T05:05:25.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.636+0000 7f5128e00640 1 --2- 172.21.15.49:0/1799257666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51240cf670 0x7f51240b2370 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f510c009870 tx=0x7f510c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28f3b8cc8e3d6a4 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:25.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.636+0000 7f5123e00640 1 -- 172.21.15.49:0/1799257666 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c0a89f0 con 0x7f51240cf670 2024-01-31T05:05:25.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.636+0000 7f5123e00640 1 -- 172.21.15.49:0/1799257666 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c0a8b50 con 0x7f51240cf670 2024-01-31T05:05:25.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.636+0000 7f5123e00640 1 -- 172.21.15.49:0/1799257666 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c0b0440 con 0x7f51240cf670 2024-01-31T05:05:25.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.640+0000 7f512c200640 1 -- 172.21.15.49:0/1799257666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51240cf670 msgr2=0x7f51240b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:25.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.640+0000 7f512c200640 1 --2- 172.21.15.49:0/1799257666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51240cf670 0x7f51240b2370 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f510c009870 tx=0x7f510c01ecf0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.640+0000 7f512c200640 1 -- 172.21.15.49:0/1799257666 shutdown_connections 2024-01-31T05:05:25.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.640+0000 7f512c200640 1 --2- 172.21.15.49:0/1799257666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51240cf670 0x7f51240b2370 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.640+0000 7f512c200640 1 -- 172.21.15.49:0/1799257666 >> 172.21.15.49:0/1799257666 conn(0x7f51240d0e60 msgr2=0x7f51240d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:25.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.640+0000 7f512c200640 1 -- 172.21.15.49:0/1799257666 shutdown_connections 2024-01-31T05:05:25.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.640+0000 7f512c200640 1 -- 172.21.15.49:0/1799257666 wait complete. 2024-01-31T05:05:25.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.640+0000 7f512c200640 1 Processor -- start 2024-01-31T05:05:25.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.640+0000 7f512c200640 1 -- start start 2024-01-31T05:05:25.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.640+0000 7f512c200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51240c63d0 0x7f512414c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.640+0000 7f512c200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51240cf670 0x7f51240b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.640+0000 7f512c200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f512415e7e0 0x7f512406b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.640+0000 7f512c200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51240b52e0 con 0x7f512415e7e0 2024-01-31T05:05:25.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.640+0000 7f512c200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51240b5000 con 0x7f51240c63d0 2024-01-31T05:05:25.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.640+0000 7f512c200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51240c94d0 con 0x7f51240cf670 2024-01-31T05:05:25.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.640+0000 7f512a200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f512415e7e0 0x7f512406b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:25.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.640+0000 7f512a200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f512415e7e0 0x7f512406b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34998/0 (socket says 172.21.15.49:34998) 2024-01-31T05:05:25.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.640+0000 7f512a200640 1 -- 172.21.15.49:0/4120168233 learned_addr learned my addr 172.21.15.49:0/4120168233 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.644+0000 7f512a200640 1 -- 172.21.15.49:0/4120168233 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51240cf670 msgr2=0x7f51240b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.644+0000 7f512a200640 1 --2- 172.21.15.49:0/4120168233 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51240cf670 0x7f51240b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.644+0000 7f512a200640 1 -- 172.21.15.49:0/4120168233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51240c63d0 msgr2=0x7f512414c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.644+0000 7f512a200640 1 --2- 172.21.15.49:0/4120168233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51240c63d0 0x7f512414c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.644+0000 7f512a200640 1 -- 172.21.15.49:0/4120168233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c0094d0 con 0x7f512415e7e0 2024-01-31T05:05:25.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.644+0000 7f512a200640 1 --2- 172.21.15.49:0/4120168233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f512415e7e0 0x7f512406b880 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f511c00b990 tx=0x7f511c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:25.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.644+0000 7f5121600640 1 -- 172.21.15.49:0/4120168233 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c00cba0 con 0x7f512415e7e0 2024-01-31T05:05:25.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.644+0000 7f5121600640 1 -- 172.21.15.49:0/4120168233 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c00cd00 con 0x7f512415e7e0 2024-01-31T05:05:25.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.644+0000 7f5121600640 1 -- 172.21.15.49:0/4120168233 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c014680 con 0x7f512415e7e0 2024-01-31T05:05:25.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.644+0000 7f512c200640 1 -- 172.21.15.49:0/4120168233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51240c97b0 con 0x7f512415e7e0 2024-01-31T05:05:25.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.644+0000 7f512c200640 1 -- 172.21.15.49:0/4120168233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512414c750 con 0x7f512415e7e0 2024-01-31T05:05:25.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.644+0000 7f512c200640 1 -- 172.21.15.49:0/4120168233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5124067c80 con 0x7f512415e7e0 2024-01-31T05:05:25.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.644+0000 7f5121600640 1 -- 172.21.15.49:0/4120168233 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f511c01d3b0 con 0x7f512415e7e0 2024-01-31T05:05:25.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.644+0000 7f5121600640 1 --2- 172.21.15.49:0/4120168233 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f50fc066530 0x7f50fc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.648+0000 7f5121600640 1 -- 172.21.15.49:0/4120168233 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f511c0842e0 con 0x7f512415e7e0 2024-01-31T05:05:25.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.648+0000 7f5129800640 1 --2- 172.21.15.49:0/4120168233 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f50fc066530 0x7f50fc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:25.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.648+0000 7f5129800640 1 --2- 172.21.15.49:0/4120168233 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f50fc066530 0x7f50fc0689f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5114000f70 tx=0x7f5114007a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:25.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.652+0000 7f5121600640 1 -- 172.21.15.49:0/4120168233 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f511c051090 con 0x7f512415e7e0 2024-01-31T05:05:25.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.808+0000 7f512c200640 1 -- 172.21.15.49:0/4120168233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51240c9cd0 con 0x7f512415e7e0 2024-01-31T05:05:25.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.808+0000 7f5121600640 1 -- 172.21.15.49:0/4120168233 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51240c9cd0 con 0x7f512415e7e0 2024-01-31T05:05:25.811 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:05:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.812+0000 7f512c200640 1 -- 172.21.15.49:0/4120168233 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f50fc066530 msgr2=0x7f50fc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.812+0000 7f512c200640 1 --2- 172.21.15.49:0/4120168233 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f50fc066530 0x7f50fc0689f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5114000f70 tx=0x7f5114007a10 comp rx=0 tx=0).stop 2024-01-31T05:05:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.812+0000 7f512c200640 1 -- 172.21.15.49:0/4120168233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f512415e7e0 msgr2=0x7f512406b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.812+0000 7f512c200640 1 --2- 172.21.15.49:0/4120168233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f512415e7e0 0x7f512406b880 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f511c00b990 tx=0x7f511c00be50 comp rx=0 tx=0).stop 2024-01-31T05:05:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.812+0000 7f512c200640 1 -- 172.21.15.49:0/4120168233 shutdown_connections 2024-01-31T05:05:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.812+0000 7f512c200640 1 --2- 172.21.15.49:0/4120168233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f512415e7e0 0x7f512406b880 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.812+0000 7f512c200640 1 --2- 172.21.15.49:0/4120168233 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51240cf670 0x7f51240b46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.812+0000 7f512c200640 1 --2- 172.21.15.49:0/4120168233 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f50fc066530 0x7f50fc0689f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.812+0000 7f512c200640 1 --2- 172.21.15.49:0/4120168233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51240c63d0 0x7f512414c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.812+0000 7f512c200640 1 -- 172.21.15.49:0/4120168233 >> 172.21.15.49:0/4120168233 conn(0x7f51240d0e60 msgr2=0x7f51240b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.812+0000 7f512c200640 1 -- 172.21.15.49:0/4120168233 shutdown_connections 2024-01-31T05:05:25.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.812+0000 7f512c200640 1 -- 172.21.15.49:0/4120168233 wait complete. 2024-01-31T05:05:25.833 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:05:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd9c800640 1 Processor -- start 2024-01-31T05:05:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd9c800640 1 -- start start 2024-01-31T05:05:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd9c800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcd9406c290 0x7fcd940cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd9c800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd940cbf80 0x7fcd940cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd9c800640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9415d7e0 con 0x7fcd9406ba90 2024-01-31T05:05:25.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd9c800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd940d0470 con 0x7fcd9406c290 2024-01-31T05:05:25.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd9c800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd940d0190 con 0x7fcd940cbf80 2024-01-31T05:05:25.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd99400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcd9406ba90 0x7fcd9406c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57956/0 (socket says 172.21.15.49:57956) 2024-01-31T05:05:25.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd99400640 1 -- 172.21.15.49:0/2137476612 learned_addr learned my addr 172.21.15.49:0/2137476612 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:25.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd99e00640 1 --2- 172.21.15.49:0/2137476612 >> v2:172.21.15.195:3300/0 conn(0x7fcd9406c290 0x7fcd940cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:25.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd9a800640 1 --2- 172.21.15.49:0/2137476612 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd940cbf80 0x7fcd940cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:25.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd98a00640 1 -- 172.21.15.49:0/2137476612 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075701609 0 0) 0x7fcd9415d7e0 con 0x7fcd9406ba90 2024-01-31T05:05:25.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd98a00640 1 -- 172.21.15.49:0/2137476612 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd74003530 con 0x7fcd9406ba90 2024-01-31T05:05:25.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd98a00640 1 -- 172.21.15.49:0/2137476612 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 739665652 0 0) 0x7fcd74003530 con 0x7fcd9406ba90 2024-01-31T05:05:25.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd98a00640 1 -- 172.21.15.49:0/2137476612 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd940cbf80 msgr2=0x7fcd940cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:25.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd98a00640 1 --2- 172.21.15.49:0/2137476612 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd940cbf80 0x7fcd940cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd98a00640 1 -- 172.21.15.49:0/2137476612 >> v2:172.21.15.195:3300/0 conn(0x7fcd9406c290 msgr2=0x7fcd940cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:25.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd98a00640 1 --2- 172.21.15.49:0/2137476612 >> v2:172.21.15.195:3300/0 conn(0x7fcd9406c290 0x7fcd940cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd98a00640 1 -- 172.21.15.49:0/2137476612 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd940cb4a0 con 0x7fcd9406ba90 2024-01-31T05:05:25.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd98a00640 1 -- 172.21.15.49:0/2137476612 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7fcd7c001680 con 0x7fcd9406ba90 2024-01-31T05:05:25.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd9a800640 1 --2- 172.21.15.49:0/2137476612 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd940cbf80 0x7fcd940cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:25.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd98a00640 1 -- 172.21.15.49:0/2137476612 >> v1:172.21.15.49:6789/0 conn(0x7fcd9406ba90 legacy=0x7fcd9406c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:25.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd98a00640 1 --2- 172.21.15.49:0/2137476612 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd940cbf80 0x7fcd74003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd98a00640 1 --2- 172.21.15.49:0/2137476612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd74003ec0 0x7fcd740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd98a00640 1 --2- 172.21.15.49:0/2137476612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd74004d10 0x7fcd74005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd98a00640 1 -- 172.21.15.49:0/2137476612 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd940d0470 con 0x7fcd74004d10 2024-01-31T05:05:25.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd98a00640 1 -- 172.21.15.49:0/2137476612 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd940d0190 con 0x7fcd74003ec0 2024-01-31T05:05:25.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd98a00640 1 -- 172.21.15.49:0/2137476612 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7400ba40 con 0x7fcd940cbf80 2024-01-31T05:05:25.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd9a800640 1 --2- 172.21.15.49:0/2137476612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd74004d10 0x7fcd74005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:25.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd99e00640 1 --2- 172.21.15.49:0/2137476612 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd940cbf80 0x7fcd74003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:25.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd99400640 1 --2- 172.21.15.49:0/2137476612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd74003ec0 0x7fcd740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:25.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd9a800640 1 -- 172.21.15.49:0/2137476612 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd940cbf80 msgr2=0x7fcd74003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:25.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd9a800640 1 --2- 172.21.15.49:0/2137476612 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd940cbf80 0x7fcd74003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd9a800640 1 -- 172.21.15.49:0/2137476612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd74003ec0 msgr2=0x7fcd740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:25.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd9a800640 1 --2- 172.21.15.49:0/2137476612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd74003ec0 0x7fcd740047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.976+0000 7fcd9a800640 1 -- 172.21.15.49:0/2137476612 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd74003530 con 0x7fcd74004d10 2024-01-31T05:05:25.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.980+0000 7fcd9a800640 1 --2- 172.21.15.49:0/2137476612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd74004d10 0x7fcd74005190 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0073e0 tx=0x7fcd8c01cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f757064b8764442b server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:25.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.980+0000 7fcd98a00640 1 -- 172.21.15.49:0/2137476612 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0a5da0 con 0x7fcd74004d10 2024-01-31T05:05:25.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.980+0000 7fcd98a00640 1 -- 172.21.15.49:0/2137476612 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c0ad440 con 0x7fcd74004d10 2024-01-31T05:05:25.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.980+0000 7fcd98a00640 1 -- 172.21.15.49:0/2137476612 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0ad7b0 con 0x7fcd74004d10 2024-01-31T05:05:25.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.980+0000 7fcd9c800640 1 -- 172.21.15.49:0/2137476612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd74004d10 msgr2=0x7fcd74005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:25.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.980+0000 7fcd9c800640 1 --2- 172.21.15.49:0/2137476612 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd74004d10 0x7fcd74005190 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0073e0 tx=0x7fcd8c01cea0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.980+0000 7fcd9a800640 1 -- 172.21.15.49:0/2137476612 reap_dead start 2024-01-31T05:05:25.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.980+0000 7fcd9c800640 1 -- 172.21.15.49:0/2137476612 shutdown_connections 2024-01-31T05:05:25.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.980+0000 7fcd9c800640 1 -- 172.21.15.49:0/2137476612 >> 172.21.15.49:0/2137476612 conn(0x7fcd940b28e0 msgr2=0x7fcd940b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:25.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.980+0000 7fcd9c800640 1 -- 172.21.15.49:0/2137476612 shutdown_connections 2024-01-31T05:05:25.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.980+0000 7fcd9c800640 1 -- 172.21.15.49:0/2137476612 wait complete. 2024-01-31T05:05:25.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd9c800640 1 Processor -- start 2024-01-31T05:05:25.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd9c800640 1 -- start start 2024-01-31T05:05:25.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd9c800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd74004d10 0x7fcd941f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd9c800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd9415ac30 0x7fcd9415b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd9c800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd940c6b40 0x7fcd940c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd9c800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9415c840 con 0x7fcd74004d10 2024-01-31T05:05:25.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd9c800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9414cd30 con 0x7fcd940c6b40 2024-01-31T05:05:25.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd9c800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9415b7a0 con 0x7fcd9415ac30 2024-01-31T05:05:25.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd99e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd74004d10 0x7fcd941f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:25.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd99e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd74004d10 0x7fcd941f25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35026/0 (socket says 172.21.15.49:35026) 2024-01-31T05:05:25.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd99e00640 1 -- 172.21.15.49:0/1156537649 learned_addr learned my addr 172.21.15.49:0/1156537649 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:25.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd99400640 1 --2- 172.21.15.49:0/1156537649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd9415ac30 0x7fcd9415b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:25.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd9a800640 1 --2- 172.21.15.49:0/1156537649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd940c6b40 0x7fcd940c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:25.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd99e00640 1 -- 172.21.15.49:0/1156537649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd9415ac30 msgr2=0x7fcd9415b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:25.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd99e00640 1 --2- 172.21.15.49:0/1156537649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd9415ac30 0x7fcd9415b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd99e00640 1 -- 172.21.15.49:0/1156537649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd940c6b40 msgr2=0x7fcd940c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:25.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd99e00640 1 --2- 172.21.15.49:0/1156537649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd940c6b40 0x7fcd940c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:25.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd99e00640 1 -- 172.21.15.49:0/1156537649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9415ba80 con 0x7fcd74004d10 2024-01-31T05:05:25.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd99e00640 1 --2- 172.21.15.49:0/1156537649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd74004d10 0x7fcd941f25e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcd84011aa0 tx=0x7fcd84011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:25.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd92000640 1 -- 172.21.15.49:0/1156537649 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8400fac0 con 0x7fcd74004d10 2024-01-31T05:05:25.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd92000640 1 -- 172.21.15.49:0/1156537649 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8400fc20 con 0x7fcd74004d10 2024-01-31T05:05:25.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.984+0000 7fcd9c800640 1 -- 172.21.15.49:0/1156537649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9415bd60 con 0x7fcd74004d10 2024-01-31T05:05:25.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.988+0000 7fcd92000640 1 -- 172.21.15.49:0/1156537649 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84014440 con 0x7fcd74004d10 2024-01-31T05:05:25.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.988+0000 7fcd9c800640 1 -- 172.21.15.49:0/1156537649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9415c320 con 0x7fcd74004d10 2024-01-31T05:05:25.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.988+0000 7fcd9c800640 1 -- 172.21.15.49:0/1156537649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd94067c80 con 0x7fcd74004d10 2024-01-31T05:05:25.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.988+0000 7fcd92000640 1 -- 172.21.15.49:0/1156537649 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fcd840145a0 con 0x7fcd74004d10 2024-01-31T05:05:25.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.988+0000 7fcd92000640 1 --2- 172.21.15.49:0/1156537649 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcd6c066530 0x7fcd6c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:25.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.988+0000 7fcd92000640 1 -- 172.21.15.49:0/1156537649 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcd84084af0 con 0x7fcd74004d10 2024-01-31T05:05:25.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.988+0000 7fcd99400640 1 --2- 172.21.15.49:0/1156537649 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcd6c066530 0x7fcd6c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:25.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.988+0000 7fcd99400640 1 --2- 172.21.15.49:0/1156537649 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcd6c066530 0x7fcd6c0689f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcd9415a450 tx=0x7fcd7c007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:25.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:25.992+0000 7fcd92000640 1 -- 172.21.15.49:0/1156537649 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fcd84051930 con 0x7fcd74004d10 2024-01-31T05:05:26.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.152+0000 7fcd9c800640 1 -- 172.21.15.49:0/1156537649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd9415c4b0 con 0x7fcd74004d10 2024-01-31T05:05:26.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.152+0000 7fcd92000640 1 -- 172.21.15.49:0/1156537649 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd84054f50 con 0x7fcd74004d10 2024-01-31T05:05:26.153 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:26.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.152+0000 7fcd9c800640 1 -- 172.21.15.49:0/1156537649 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcd6c066530 msgr2=0x7fcd6c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:26.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.152+0000 7fcd9c800640 1 --2- 172.21.15.49:0/1156537649 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcd6c066530 0x7fcd6c0689f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcd9415a450 tx=0x7fcd7c007900 comp rx=0 tx=0).stop 2024-01-31T05:05:26.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.152+0000 7fcd9c800640 1 -- 172.21.15.49:0/1156537649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd74004d10 msgr2=0x7fcd941f25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:26.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.152+0000 7fcd9c800640 1 --2- 172.21.15.49:0/1156537649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd74004d10 0x7fcd941f25e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcd84011aa0 tx=0x7fcd84011ea0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.152+0000 7fcd9c800640 1 -- 172.21.15.49:0/1156537649 shutdown_connections 2024-01-31T05:05:26.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.152+0000 7fcd9c800640 1 --2- 172.21.15.49:0/1156537649 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcd6c066530 0x7fcd6c0689f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.152+0000 7fcd9c800640 1 --2- 172.21.15.49:0/1156537649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd940c6b40 0x7fcd940c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.152+0000 7fcd9c800640 1 --2- 172.21.15.49:0/1156537649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd9415ac30 0x7fcd9415b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.152+0000 7fcd9c800640 1 --2- 172.21.15.49:0/1156537649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd74004d10 0x7fcd941f25e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.152+0000 7fcd9c800640 1 -- 172.21.15.49:0/1156537649 >> 172.21.15.49:0/1156537649 conn(0x7fcd940b28e0 msgr2=0x7fcd940cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:26.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.152+0000 7fcd9c800640 1 -- 172.21.15.49:0/1156537649 shutdown_connections 2024-01-31T05:05:26.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.152+0000 7fcd9c800640 1 -- 172.21.15.49:0/1156537649 wait complete. 2024-01-31T05:05:26.176 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:05:26.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.320+0000 7f01f0e00640 1 Processor -- start 2024-01-31T05:05:26.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.320+0000 7f01f0e00640 1 -- start start 2024-01-31T05:05:26.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.320+0000 7f01f0e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec15a000 0x7f01ec0cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:26.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.320+0000 7f01f0e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f01ec0715e0 0x7f01ec0ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.320+0000 7f01f0e00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ec06c750 con 0x7f01ec06c2d0 2024-01-31T05:05:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.320+0000 7f01f0e00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ec0b3760 con 0x7f01ec0715e0 2024-01-31T05:05:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.320+0000 7f01f0e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec071e40 con 0x7f01ec15a000 2024-01-31T05:05:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.320+0000 7f01ea800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f01ec0715e0 0x7f01ec0ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.320+0000 7f01ea800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f01ec0715e0 0x7f01ec0ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35038/0 (socket says 172.21.15.49:35038) 2024-01-31T05:05:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.320+0000 7f01ea800640 1 -- 172.21.15.49:0/1329395537 learned_addr learned my addr 172.21.15.49:0/1329395537 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.320+0000 7f01e9400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f01ec06c2d0 0x7f01ec070ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57968/0 (socket says 172.21.15.49:57968) 2024-01-31T05:05:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.320+0000 7f01e9e00640 1 --2- 172.21.15.49:0/1329395537 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec15a000 0x7f01ec0cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.320+0000 7f01ea800640 1 -- 172.21.15.49:0/1329395537 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec15a000 msgr2=0x7f01ec0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.320+0000 7f01ea800640 1 --2- 172.21.15.49:0/1329395537 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec15a000 0x7f01ec0cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.320+0000 7f01ea800640 1 -- 172.21.15.49:0/1329395537 >> v1:172.21.15.49:6789/0 conn(0x7f01ec06c2d0 legacy=0x7f01ec070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.320+0000 7f01e8a00640 1 -- 172.21.15.49:0/1329395537 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270005474 0 0) 0x7f01d4001120 con 0x7f01ec06c2d0 2024-01-31T05:05:26.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.320+0000 7f01ea800640 1 -- 172.21.15.49:0/1329395537 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec06c990 con 0x7f01ec0715e0 2024-01-31T05:05:26.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.324+0000 7f01ea800640 1 --2- 172.21.15.49:0/1329395537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01ec0715e0 0x7f01ec0ac8d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009e50 tx=0x7f01e401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44507d26ef8c70b server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:26.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.324+0000 7f01e8a00640 1 -- 172.21.15.49:0/1329395537 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e40a58e0 con 0x7f01ec0715e0 2024-01-31T05:05:26.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.324+0000 7f01e8a00640 1 -- 172.21.15.49:0/1329395537 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e40a5a40 con 0x7f01ec0715e0 2024-01-31T05:05:26.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.324+0000 7f01e8a00640 1 -- 172.21.15.49:0/1329395537 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e40a5dd0 con 0x7f01ec0715e0 2024-01-31T05:05:26.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.324+0000 7f01f0e00640 1 -- 172.21.15.49:0/1329395537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01ec0715e0 msgr2=0x7f01ec0ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:26.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.324+0000 7f01f0e00640 1 --2- 172.21.15.49:0/1329395537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01ec0715e0 0x7f01ec0ac8d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009e50 tx=0x7f01e401ca10 comp rx=0 tx=0).stop 2024-01-31T05:05:26.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.324+0000 7f01f0e00640 1 -- 172.21.15.49:0/1329395537 shutdown_connections 2024-01-31T05:05:26.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.324+0000 7f01f0e00640 1 --2- 172.21.15.49:0/1329395537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01ec0715e0 0x7f01ec0ac8d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.324+0000 7f01f0e00640 1 --2- 172.21.15.49:0/1329395537 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec15a000 0x7f01ec0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.324+0000 7f01f0e00640 1 -- 172.21.15.49:0/1329395537 >> 172.21.15.49:0/1329395537 conn(0x7f01ec0b09a0 msgr2=0x7f01ec0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:26.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.324+0000 7f01f0e00640 1 -- 172.21.15.49:0/1329395537 shutdown_connections 2024-01-31T05:05:26.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.324+0000 7f01f0e00640 1 -- 172.21.15.49:0/1329395537 wait complete. 2024-01-31T05:05:26.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01f0e00640 1 Processor -- start 2024-01-31T05:05:26.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01f0e00640 1 -- start start 2024-01-31T05:05:26.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01f0e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06c2d0 0x7f01ec150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:26.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01f0e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01ec0715e0 0x7f01ec0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:26.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01f0e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01ec15a000 0x7f01ec150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:26.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01f0e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec099df0 con 0x7f01ec15a000 2024-01-31T05:05:26.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01f0e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec099af0 con 0x7f01ec0715e0 2024-01-31T05:05:26.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01f0e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec09c0f0 con 0x7f01ec06c2d0 2024-01-31T05:05:26.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01ea800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01ec15a000 0x7f01ec150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:26.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01ea800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01ec15a000 0x7f01ec150f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35052/0 (socket says 172.21.15.49:35052) 2024-01-31T05:05:26.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01ea800640 1 -- 172.21.15.49:0/508212802 learned_addr learned my addr 172.21.15.49:0/508212802 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:26.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01e9e00640 1 --2- 172.21.15.49:0/508212802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06c2d0 0x7f01ec150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:26.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01e9400640 1 --2- 172.21.15.49:0/508212802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01ec0715e0 0x7f01ec0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:26.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01ea800640 1 -- 172.21.15.49:0/508212802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06c2d0 msgr2=0x7f01ec150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:26.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01ea800640 1 --2- 172.21.15.49:0/508212802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06c2d0 0x7f01ec150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01ea800640 1 -- 172.21.15.49:0/508212802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01ec0715e0 msgr2=0x7f01ec0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:26.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01ea800640 1 --2- 172.21.15.49:0/508212802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01ec0715e0 0x7f01ec0cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01ea800640 1 -- 172.21.15.49:0/508212802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e4009b30 con 0x7f01ec15a000 2024-01-31T05:05:26.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01ea800640 1 --2- 172.21.15.49:0/508212802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01ec15a000 0x7f01ec150f30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f01e401a640 tx=0x7f01e40197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:26.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01e2000640 1 -- 172.21.15.49:0/508212802 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e40b8880 con 0x7f01ec15a000 2024-01-31T05:05:26.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01e2000640 1 -- 172.21.15.49:0/508212802 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e40b8a00 con 0x7f01ec15a000 2024-01-31T05:05:26.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01e2000640 1 -- 172.21.15.49:0/508212802 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e40b8db0 con 0x7f01ec15a000 2024-01-31T05:05:26.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01f0e00640 1 -- 172.21.15.49:0/508212802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ec09c3d0 con 0x7f01ec15a000 2024-01-31T05:05:26.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.328+0000 7f01f0e00640 1 -- 172.21.15.49:0/508212802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec150c40 con 0x7f01ec15a000 2024-01-31T05:05:26.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.332+0000 7f01f0e00640 1 -- 172.21.15.49:0/508212802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ec099f60 con 0x7f01ec15a000 2024-01-31T05:05:26.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.332+0000 7f01e2000640 1 -- 172.21.15.49:0/508212802 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f01e4007470 con 0x7f01ec15a000 2024-01-31T05:05:26.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.332+0000 7f01e2000640 1 --2- 172.21.15.49:0/508212802 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f01c4066500 0x7f01c40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:26.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.332+0000 7f01e2000640 1 -- 172.21.15.49:0/508212802 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f01e411fae0 con 0x7f01ec15a000 2024-01-31T05:05:26.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.332+0000 7f01e9e00640 1 --2- 172.21.15.49:0/508212802 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f01c4066500 0x7f01c40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:26.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.332+0000 7f01e9e00640 1 --2- 172.21.15.49:0/508212802 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f01c4066500 0x7f01c40689c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f01ec09c020 tx=0x7f01dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:26.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.336+0000 7f01e2000640 1 -- 172.21.15.49:0/508212802 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f01e40ec9e0 con 0x7f01ec15a000 2024-01-31T05:05:26.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.500+0000 7f01f0e00640 1 -- 172.21.15.49:0/508212802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01ec074860 con 0x7f01ec15a000 2024-01-31T05:05:26.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.500+0000 7f01e2000640 1 -- 172.21.15.49:0/508212802 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f01e40f0000 con 0x7f01ec15a000 2024-01-31T05:05:26.501 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-31T05:05:26.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.500+0000 7f01f0e00640 1 -- 172.21.15.49:0/508212802 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f01c4066500 msgr2=0x7f01c40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:26.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.500+0000 7f01f0e00640 1 --2- 172.21.15.49:0/508212802 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f01c4066500 0x7f01c40689c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f01ec09c020 tx=0x7f01dc008040 comp rx=0 tx=0).stop 2024-01-31T05:05:26.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.500+0000 7f01f0e00640 1 -- 172.21.15.49:0/508212802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01ec15a000 msgr2=0x7f01ec150f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:26.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.500+0000 7f01f0e00640 1 --2- 172.21.15.49:0/508212802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01ec15a000 0x7f01ec150f30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f01e401a640 tx=0x7f01e40197b0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.500+0000 7f01f0e00640 1 -- 172.21.15.49:0/508212802 shutdown_connections 2024-01-31T05:05:26.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.500+0000 7f01f0e00640 1 --2- 172.21.15.49:0/508212802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01ec15a000 0x7f01ec150f30 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.500+0000 7f01f0e00640 1 --2- 172.21.15.49:0/508212802 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f01c4066500 0x7f01c40689c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.500+0000 7f01f0e00640 1 --2- 172.21.15.49:0/508212802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01ec0715e0 0x7f01ec0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.500+0000 7f01f0e00640 1 --2- 172.21.15.49:0/508212802 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01ec06c2d0 0x7f01ec150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.500+0000 7f01f0e00640 1 -- 172.21.15.49:0/508212802 >> 172.21.15.49:0/508212802 conn(0x7f01ec0b09a0 msgr2=0x7f01ec1568f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:26.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.500+0000 7f01f0e00640 1 -- 172.21.15.49:0/508212802 shutdown_connections 2024-01-31T05:05:26.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.500+0000 7f01f0e00640 1 -- 172.21.15.49:0/508212802 wait complete. 2024-01-31T05:05:26.523 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-31T05:05:26.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.664+0000 7f2b66600640 1 Processor -- start 2024-01-31T05:05:26.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.664+0000 7f2b66600640 1 -- start start 2024-01-31T05:05:26.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.668+0000 7f2b66600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b6015d510 0x7f2b60072050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:26.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.668+0000 7f2b66600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2b6006daf0 0x7f2b60160f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:26.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.668+0000 7f2b66600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b60072590 con 0x7f2b600b4b20 2024-01-31T05:05:26.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.668+0000 7f2b66600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6006df60 con 0x7f2b6006daf0 2024-01-31T05:05:26.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.668+0000 7f2b66600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6006f010 con 0x7f2b6015d510 2024-01-31T05:05:26.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.668+0000 7f2b5f400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b6015d510 0x7f2b60072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:26.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.668+0000 7f2b5fe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2b6006daf0 0x7f2b60160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:26.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.668+0000 7f2b5fe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2b6006daf0 0x7f2b60160f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:52402/0 (socket says 172.21.15.49:52402) 2024-01-31T05:05:26.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.668+0000 7f2b5fe00640 1 -- 172.21.15.49:0/889362196 learned_addr learned my addr 172.21.15.49:0/889362196 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:26.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.668+0000 7f2b5f400640 1 -- 172.21.15.49:0/889362196 >> v2:172.21.15.195:3300/0 conn(0x7f2b6006daf0 msgr2=0x7f2b60160f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:26.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.668+0000 7f2b5f400640 1 --2- 172.21.15.49:0/889362196 >> v2:172.21.15.195:3300/0 conn(0x7f2b6006daf0 0x7f2b60160f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.668+0000 7f2b5f400640 1 -- 172.21.15.49:0/889362196 >> v1:172.21.15.195:6789/0 conn(0x7f2b600b4b20 legacy=0x7f2b6006d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:26.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.668+0000 7f2b5f400640 1 -- 172.21.15.49:0/889362196 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b60071570 con 0x7f2b6015d510 2024-01-31T05:05:26.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.672+0000 7f2b5f400640 1 --2- 172.21.15.49:0/889362196 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b6015d510 0x7f2b60072050 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2b500097c0 tx=0x7f2b5001c100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faa763419c314a53 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:26.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.672+0000 7f2b5e000640 1 -- 172.21.15.49:0/889362196 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b500ab600 con 0x7f2b6015d510 2024-01-31T05:05:26.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.672+0000 7f2b5e000640 1 -- 172.21.15.49:0/889362196 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b500a7050 con 0x7f2b6015d510 2024-01-31T05:05:26.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.672+0000 7f2b5e000640 1 -- 172.21.15.49:0/889362196 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b500ab980 con 0x7f2b6015d510 2024-01-31T05:05:26.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.672+0000 7f2b66600640 1 -- 172.21.15.49:0/889362196 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b6015d510 msgr2=0x7f2b60072050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:26.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.672+0000 7f2b66600640 1 --2- 172.21.15.49:0/889362196 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b6015d510 0x7f2b60072050 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2b500097c0 tx=0x7f2b5001c100 comp rx=0 tx=0).stop 2024-01-31T05:05:26.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.672+0000 7f2b66600640 1 -- 172.21.15.49:0/889362196 shutdown_connections 2024-01-31T05:05:26.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.672+0000 7f2b66600640 1 --2- 172.21.15.49:0/889362196 >> v2:172.21.15.195:3300/0 conn(0x7f2b6006daf0 0x7f2b60160f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.672+0000 7f2b66600640 1 --2- 172.21.15.49:0/889362196 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b6015d510 0x7f2b60072050 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.672+0000 7f2b66600640 1 -- 172.21.15.49:0/889362196 >> 172.21.15.49:0/889362196 conn(0x7f2b600b1ab0 msgr2=0x7f2b600b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:26.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.672+0000 7f2b66600640 1 -- 172.21.15.49:0/889362196 shutdown_connections 2024-01-31T05:05:26.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.672+0000 7f2b66600640 1 -- 172.21.15.49:0/889362196 wait complete. 2024-01-31T05:05:26.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.672+0000 7f2b66600640 1 Processor -- start 2024-01-31T05:05:26.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.672+0000 7f2b66600640 1 -- start start 2024-01-31T05:05:26.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b66600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b6006daf0 0x7f2b60148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:26.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b66600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b600b4b20 0x7f2b60152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:26.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b66600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b6015d510 0x7f2b60155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:26.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b66600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6014aaf0 con 0x7f2b6006daf0 2024-01-31T05:05:26.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b66600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6015f550 con 0x7f2b6015d510 2024-01-31T05:05:26.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b66600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6015eed0 con 0x7f2b600b4b20 2024-01-31T05:05:26.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b5f400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b6006daf0 0x7f2b60148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:26.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b5f400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b6006daf0 0x7f2b60148f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35068/0 (socket says 172.21.15.49:35068) 2024-01-31T05:05:26.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b5f400640 1 -- 172.21.15.49:0/2411689336 learned_addr learned my addr 172.21.15.49:0/2411689336 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:26.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b5fe00640 1 --2- 172.21.15.49:0/2411689336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b6015d510 0x7f2b60155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:26.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b5ea00640 1 --2- 172.21.15.49:0/2411689336 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b600b4b20 0x7f2b60152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:26.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b5fe00640 1 -- 172.21.15.49:0/2411689336 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b600b4b20 msgr2=0x7f2b60152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:26.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b5fe00640 1 --2- 172.21.15.49:0/2411689336 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b600b4b20 0x7f2b60152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b5fe00640 1 -- 172.21.15.49:0/2411689336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b6006daf0 msgr2=0x7f2b60148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:26.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b5fe00640 1 --2- 172.21.15.49:0/2411689336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b6006daf0 0x7f2b60148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b5fe00640 1 -- 172.21.15.49:0/2411689336 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b50009420 con 0x7f2b6015d510 2024-01-31T05:05:26.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b5f400640 1 --2- 172.21.15.49:0/2411689336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b6006daf0 0x7f2b60148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:26.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b5fe00640 1 --2- 172.21.15.49:0/2411689336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b6015d510 0x7f2b60155ae0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800ebd0 tx=0x7f2b5800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:26.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b57400640 1 -- 172.21.15.49:0/2411689336 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5800cb20 con 0x7f2b6015d510 2024-01-31T05:05:26.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b57400640 1 -- 172.21.15.49:0/2411689336 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5800f040 con 0x7f2b6015d510 2024-01-31T05:05:26.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b57400640 1 -- 172.21.15.49:0/2411689336 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5800cea0 con 0x7f2b6015d510 2024-01-31T05:05:26.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b66600640 1 -- 172.21.15.49:0/2411689336 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6014a530 con 0x7f2b6015d510 2024-01-31T05:05:26.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b66600640 1 -- 172.21.15.49:0/2411689336 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6015f170 con 0x7f2b6015d510 2024-01-31T05:05:26.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.676+0000 7f2b66600640 1 -- 172.21.15.49:0/2411689336 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6015f690 con 0x7f2b6015d510 2024-01-31T05:05:26.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.680+0000 7f2b57400640 1 -- 172.21.15.49:0/2411689336 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f2b580039a0 con 0x7f2b6015d510 2024-01-31T05:05:26.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.680+0000 7f2b57400640 1 --2- 172.21.15.49:0/2411689336 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2b38066500 0x7f2b380689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:26.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.680+0000 7f2b57400640 1 -- 172.21.15.49:0/2411689336 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2b580845f0 con 0x7f2b6015d510 2024-01-31T05:05:26.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.680+0000 7f2b5f400640 1 --2- 172.21.15.49:0/2411689336 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2b38066500 0x7f2b380689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:26.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.680+0000 7f2b5f400640 1 --2- 172.21.15.49:0/2411689336 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2b38066500 0x7f2b380689c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2b5001c140 tx=0x7f2b500a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:26.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.684+0000 7f2b57400640 1 -- 172.21.15.49:0/2411689336 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f2b6015f690 con 0x7f2b6015d510 2024-01-31T05:05:26.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.840+0000 7f2b66600640 1 -- 172.21.15.49:0/2411689336 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2b6015f690 con 0x7f2b6015d510 2024-01-31T05:05:26.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.844+0000 7f2b57400640 1 -- 172.21.15.49:0/2411689336 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2b6015f690 con 0x7f2b6015d510 2024-01-31T05:05:26.848 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.844+0000 7f2b66600640 1 -- 172.21.15.49:0/2411689336 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2b38066500 msgr2=0x7f2b380689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.844+0000 7f2b66600640 1 --2- 172.21.15.49:0/2411689336 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2b38066500 0x7f2b380689c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2b5001c140 tx=0x7f2b500a6000 comp rx=0 tx=0).stop 2024-01-31T05:05:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.844+0000 7f2b66600640 1 -- 172.21.15.49:0/2411689336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b6015d510 msgr2=0x7f2b60155ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.844+0000 7f2b66600640 1 --2- 172.21.15.49:0/2411689336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b6015d510 0x7f2b60155ae0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800ebd0 tx=0x7f2b5800c490 comp rx=0 tx=0).stop 2024-01-31T05:05:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.844+0000 7f2b66600640 1 -- 172.21.15.49:0/2411689336 shutdown_connections 2024-01-31T05:05:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.844+0000 7f2b66600640 1 --2- 172.21.15.49:0/2411689336 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2b38066500 0x7f2b380689c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.844+0000 7f2b66600640 1 --2- 172.21.15.49:0/2411689336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b6015d510 0x7f2b60155ae0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.844+0000 7f2b66600640 1 --2- 172.21.15.49:0/2411689336 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2b600b4b20 0x7f2b60152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.844+0000 7f2b66600640 1 --2- 172.21.15.49:0/2411689336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b6006daf0 0x7f2b60148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.844+0000 7f2b66600640 1 -- 172.21.15.49:0/2411689336 >> 172.21.15.49:0/2411689336 conn(0x7f2b600b1ab0 msgr2=0x7f2b600afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.844+0000 7f2b66600640 1 -- 172.21.15.49:0/2411689336 shutdown_connections 2024-01-31T05:05:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:26.844+0000 7f2b66600640 1 -- 172.21.15.49:0/2411689336 wait complete. 2024-01-31T05:05:26.866 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-31T05:05:27.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37e1000640 1 Processor -- start 2024-01-31T05:05:27.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37e1000640 1 -- start start 2024-01-31T05:05:27.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37e1000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37dc072050 0x7f37dc06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37e1000640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37dc06f010 con 0x7f37dc15d510 2024-01-31T05:05:27.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37e1000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37dc071570 con 0x7f37dc06d920 2024-01-31T05:05:27.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37e1000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc071850 con 0x7f37dc072050 2024-01-31T05:05:27.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d9e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f37dc15d510 0x7f37dc0b4b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57982/0 (socket says 172.21.15.49:57982) 2024-01-31T05:05:27.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d9e00640 1 -- 172.21.15.49:0/2375391510 learned_addr learned my addr 172.21.15.49:0/2375391510 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:27.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d9400640 1 --2- 172.21.15.49:0/2375391510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37dc072050 0x7f37dc06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d8a00640 1 -- 172.21.15.49:0/2375391510 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779670377 0 0) 0x7f37dc06f010 con 0x7f37dc15d510 2024-01-31T05:05:27.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d8a00640 1 -- 172.21.15.49:0/2375391510 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37bc003530 con 0x7f37dc15d510 2024-01-31T05:05:27.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d8a00640 1 -- 172.21.15.49:0/2375391510 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980721163 0 0) 0x7f37dc071570 con 0x7f37dc06d920 2024-01-31T05:05:27.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d8a00640 1 -- 172.21.15.49:0/2375391510 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37dc06f010 con 0x7f37dc06d920 2024-01-31T05:05:27.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d8a00640 1 -- 172.21.15.49:0/2375391510 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 321720431 0 0) 0x7f37bc003530 con 0x7f37dc15d510 2024-01-31T05:05:27.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d8a00640 1 -- 172.21.15.49:0/2375391510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37dc072050 msgr2=0x7f37dc06d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:27.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d8a00640 1 --2- 172.21.15.49:0/2375391510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37dc072050 0x7f37dc06d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d8a00640 1 -- 172.21.15.49:0/2375391510 >> v1:172.21.15.195:6789/0 conn(0x7f37dc06d920 legacy=0x7f37dc160f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:27.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d8a00640 1 -- 172.21.15.49:0/2375391510 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc071b30 con 0x7f37dc15d510 2024-01-31T05:05:27.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d8a00640 1 -- 172.21.15.49:0/2375391510 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7f37cc001680 con 0x7f37dc15d510 2024-01-31T05:05:27.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d8a00640 1 -- 172.21.15.49:0/2375391510 >> v1:172.21.15.49:6789/0 conn(0x7f37dc15d510 legacy=0x7f37dc0b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:27.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d8a00640 1 --2- 172.21.15.49:0/2375391510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37bc003b40 0x7f37bc003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d8a00640 1 --2- 172.21.15.49:0/2375391510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37bc0047d0 0x7f37bc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d8a00640 1 --2- 172.21.15.49:0/2375391510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37bc005190 0x7f37bc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d8a00640 1 -- 172.21.15.49:0/2375391510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc071850 con 0x7f37bc005190 2024-01-31T05:05:27.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d8a00640 1 -- 172.21.15.49:0/2375391510 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc00c000 con 0x7f37bc0047d0 2024-01-31T05:05:27.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d8a00640 1 -- 172.21.15.49:0/2375391510 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc00c1c0 con 0x7f37bc003b40 2024-01-31T05:05:27.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37da800640 1 --2- 172.21.15.49:0/2375391510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37bc005190 0x7f37bc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d9400640 1 --2- 172.21.15.49:0/2375391510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37bc0047d0 0x7f37bc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d9e00640 1 --2- 172.21.15.49:0/2375391510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37bc003b40 0x7f37bc003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37da800640 1 -- 172.21.15.49:0/2375391510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37bc003b40 msgr2=0x7f37bc003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:27.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37da800640 1 --2- 172.21.15.49:0/2375391510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37bc003b40 0x7f37bc003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37da800640 1 -- 172.21.15.49:0/2375391510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37bc0047d0 msgr2=0x7f37bc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:27.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37da800640 1 --2- 172.21.15.49:0/2375391510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37bc0047d0 0x7f37bc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37da800640 1 -- 172.21.15.49:0/2375391510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc003530 con 0x7f37bc005190 2024-01-31T05:05:27.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.008+0000 7f37d9400640 1 --2- 172.21.15.49:0/2375391510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37bc0047d0 0x7f37bc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:27.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.012+0000 7f37da800640 1 --2- 172.21.15.49:0/2375391510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37bc005190 0x7f37bc00b990 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f37d4001fd0 tx=0x7f37d401f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c28d3d08833577e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:27.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.012+0000 7f37d8a00640 1 -- 172.21.15.49:0/2375391510 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d40a8c70 con 0x7f37bc005190 2024-01-31T05:05:27.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.012+0000 7f37d8a00640 1 -- 172.21.15.49:0/2375391510 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d40a8df0 con 0x7f37bc005190 2024-01-31T05:05:27.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.012+0000 7f37d8a00640 1 -- 172.21.15.49:0/2375391510 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d4003bc0 con 0x7f37bc005190 2024-01-31T05:05:27.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.012+0000 7f37e1000640 1 -- 172.21.15.49:0/2375391510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37bc005190 msgr2=0x7f37bc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:27.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.012+0000 7f37e1000640 1 --2- 172.21.15.49:0/2375391510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37bc005190 0x7f37bc00b990 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f37d4001fd0 tx=0x7f37d401f050 comp rx=0 tx=0).stop 2024-01-31T05:05:27.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.012+0000 7f37da800640 1 -- 172.21.15.49:0/2375391510 reap_dead start 2024-01-31T05:05:27.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.012+0000 7f37e1000640 1 -- 172.21.15.49:0/2375391510 shutdown_connections 2024-01-31T05:05:27.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.012+0000 7f37e1000640 1 -- 172.21.15.49:0/2375391510 >> 172.21.15.49:0/2375391510 conn(0x7f37dc0b1ab0 msgr2=0x7f37dc0b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:27.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.012+0000 7f37e1000640 1 -- 172.21.15.49:0/2375391510 shutdown_connections 2024-01-31T05:05:27.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.012+0000 7f37e1000640 1 -- 172.21.15.49:0/2375391510 wait complete. 2024-01-31T05:05:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37e1000640 1 Processor -- start 2024-01-31T05:05:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37e1000640 1 -- start start 2024-01-31T05:05:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37e1000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37bc005190 0x7f37dc0cde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37e1000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37dc159af0 0x7f37dc150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37e1000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37dc0c68f0 0x7f37dc0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37e1000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0c8400 con 0x7f37dc0c68f0 2024-01-31T05:05:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37e1000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0c72b0 con 0x7f37dc159af0 2024-01-31T05:05:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37e1000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0cd170 con 0x7f37bc005190 2024-01-31T05:05:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37da800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37dc0c68f0 0x7f37dc0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37da800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37dc0c68f0 0x7f37dc0c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35084/0 (socket says 172.21.15.49:35084) 2024-01-31T05:05:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37da800640 1 -- 172.21.15.49:0/1973143752 learned_addr learned my addr 172.21.15.49:0/1973143752 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37d9400640 1 --2- 172.21.15.49:0/1973143752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37dc159af0 0x7f37dc150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37d9e00640 1 --2- 172.21.15.49:0/1973143752 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37bc005190 0x7f37dc0cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37da800640 1 -- 172.21.15.49:0/1973143752 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37bc005190 msgr2=0x7f37dc0cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37da800640 1 --2- 172.21.15.49:0/1973143752 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37bc005190 0x7f37dc0cde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37da800640 1 -- 172.21.15.49:0/1973143752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37dc159af0 msgr2=0x7f37dc150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37da800640 1 --2- 172.21.15.49:0/1973143752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37dc159af0 0x7f37dc150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37da800640 1 -- 172.21.15.49:0/1973143752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc0cda00 con 0x7f37dc0c68f0 2024-01-31T05:05:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37da800640 1 --2- 172.21.15.49:0/1973143752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37dc0c68f0 0x7f37dc0c6d70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f37d4005040 tx=0x7f37bc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37d2000640 1 -- 172.21.15.49:0/1973143752 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d4003e80 con 0x7f37dc0c68f0 2024-01-31T05:05:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37d2000640 1 -- 172.21.15.49:0/1973143752 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d4007e00 con 0x7f37dc0c68f0 2024-01-31T05:05:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.016+0000 7f37e1000640 1 -- 172.21.15.49:0/1973143752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37dc0ced40 con 0x7f37dc0c68f0 2024-01-31T05:05:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.020+0000 7f37d2000640 1 -- 172.21.15.49:0/1973143752 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d40a8c70 con 0x7f37dc0c68f0 2024-01-31T05:05:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.020+0000 7f37e1000640 1 -- 172.21.15.49:0/1973143752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37dc0cd3b0 con 0x7f37dc0c68f0 2024-01-31T05:05:27.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.020+0000 7f37e1000640 1 -- 172.21.15.49:0/1973143752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37dc0cf300 con 0x7f37dc0c68f0 2024-01-31T05:05:27.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.020+0000 7f37d2000640 1 -- 172.21.15.49:0/1973143752 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f37d4006b60 con 0x7f37dc0c68f0 2024-01-31T05:05:27.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.020+0000 7f37d2000640 1 --2- 172.21.15.49:0/1973143752 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f37b4066530 0x7f37b40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.020+0000 7f37d2000640 1 -- 172.21.15.49:0/1973143752 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f37d4120ae0 con 0x7f37dc0c68f0 2024-01-31T05:05:27.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.020+0000 7f37d9e00640 1 --2- 172.21.15.49:0/1973143752 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f37b4066530 0x7f37b40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.020+0000 7f37d9e00640 1 --2- 172.21.15.49:0/1973143752 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f37b4066530 0x7f37b40689f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f37cc001210 tx=0x7f37cc001e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:27.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.024+0000 7f37d2000640 1 -- 172.21.15.49:0/1973143752 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f37d40ed940 con 0x7f37dc0c68f0 2024-01-31T05:05:27.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.192+0000 7f37e1000640 1 -- 172.21.15.49:0/1973143752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f37dc0cf300 con 0x7f37dc0c68f0 2024-01-31T05:05:27.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.192+0000 7f37d2000640 1 -- 172.21.15.49:0/1973143752 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f37d40bf080 con 0x7f37dc0c68f0 2024-01-31T05:05:27.196 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2024-01-31T05:05:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.196+0000 7f37e1000640 1 -- 172.21.15.49:0/1973143752 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f37b4066530 msgr2=0x7f37b40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.196+0000 7f37e1000640 1 --2- 172.21.15.49:0/1973143752 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f37b4066530 0x7f37b40689f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f37cc001210 tx=0x7f37cc001e30 comp rx=0 tx=0).stop 2024-01-31T05:05:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.196+0000 7f37e1000640 1 -- 172.21.15.49:0/1973143752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37dc0c68f0 msgr2=0x7f37dc0c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.196+0000 7f37e1000640 1 --2- 172.21.15.49:0/1973143752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37dc0c68f0 0x7f37dc0c6d70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f37d4005040 tx=0x7f37bc005800 comp rx=0 tx=0).stop 2024-01-31T05:05:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.196+0000 7f37e1000640 1 -- 172.21.15.49:0/1973143752 shutdown_connections 2024-01-31T05:05:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.196+0000 7f37e1000640 1 --2- 172.21.15.49:0/1973143752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37dc0c68f0 0x7f37dc0c6d70 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.196+0000 7f37e1000640 1 --2- 172.21.15.49:0/1973143752 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f37b4066530 0x7f37b40689f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.196+0000 7f37e1000640 1 --2- 172.21.15.49:0/1973143752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37dc159af0 0x7f37dc150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.196+0000 7f37e1000640 1 --2- 172.21.15.49:0/1973143752 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f37bc005190 0x7f37dc0cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.196+0000 7f37e1000640 1 -- 172.21.15.49:0/1973143752 >> 172.21.15.49:0/1973143752 conn(0x7f37dc0b1ab0 msgr2=0x7f37dc15caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.196+0000 7f37e1000640 1 -- 172.21.15.49:0/1973143752 shutdown_connections 2024-01-31T05:05:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.196+0000 7f37e1000640 1 -- 172.21.15.49:0/1973143752 wait complete. 2024-01-31T05:05:27.219 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T05:05:27.219 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T05:05:27.229 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:27.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.368+0000 7efc71000640 1 Processor -- start 2024-01-31T05:05:27.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.368+0000 7efc71000640 1 -- start start 2024-01-31T05:05:27.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.368+0000 7efc71000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc6c0b30e0 0x7efc6c15e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.368+0000 7efc71000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc6c0b34c0 0x7efc6c0720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.368+0000 7efc71000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7efc6c06c2d0 0x7efc6c0b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.368+0000 7efc71000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6c0703c0 con 0x7efc6c0b34c0 2024-01-31T05:05:27.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.368+0000 7efc71000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6c0b1dd0 con 0x7efc6c06c2d0 2024-01-31T05:05:27.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.368+0000 7efc71000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c070610 con 0x7efc6c0b30e0 2024-01-31T05:05:27.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.368+0000 7efc69400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc6c0b34c0 0x7efc6c0720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.368+0000 7efc69400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7efc6c0b34c0 0x7efc6c0720e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35094/0 (socket says 172.21.15.49:35094) 2024-01-31T05:05:27.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.368+0000 7efc69400640 1 -- 172.21.15.49:0/3959493022 learned_addr learned my addr 172.21.15.49:0/3959493022 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:27.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.368+0000 7efc6a800640 1 --2- 172.21.15.49:0/3959493022 >> v2:172.21.15.195:3300/0 conn(0x7efc6c06c2d0 0x7efc6c0b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.368+0000 7efc69e00640 1 --2- 172.21.15.49:0/3959493022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc6c0b30e0 0x7efc6c15e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.372+0000 7efc69400640 1 -- 172.21.15.49:0/3959493022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc6c0b30e0 msgr2=0x7efc6c15e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:27.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.372+0000 7efc69400640 1 --2- 172.21.15.49:0/3959493022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc6c0b30e0 0x7efc6c15e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.372+0000 7efc69400640 1 -- 172.21.15.49:0/3959493022 >> v2:172.21.15.195:3300/0 conn(0x7efc6c06c2d0 msgr2=0x7efc6c0b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:27.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.372+0000 7efc69400640 1 --2- 172.21.15.49:0/3959493022 >> v2:172.21.15.195:3300/0 conn(0x7efc6c06c2d0 0x7efc6c0b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.372+0000 7efc69400640 1 -- 172.21.15.49:0/3959493022 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c0708f0 con 0x7efc6c0b34c0 2024-01-31T05:05:27.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.372+0000 7efc69e00640 1 --2- 172.21.15.49:0/3959493022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc6c0b30e0 0x7efc6c15e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:27.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.372+0000 7efc69400640 1 --2- 172.21.15.49:0/3959493022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c0b34c0 0x7efc6c0720e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0b1670 tx=0x7efc5401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c48c05207ac330 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:27.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.372+0000 7efc68a00640 1 -- 172.21.15.49:0/3959493022 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc540ab600 con 0x7efc6c0b34c0 2024-01-31T05:05:27.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.372+0000 7efc68a00640 1 -- 172.21.15.49:0/3959493022 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc540a7050 con 0x7efc6c0b34c0 2024-01-31T05:05:27.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.372+0000 7efc68a00640 1 -- 172.21.15.49:0/3959493022 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc540ab980 con 0x7efc6c0b34c0 2024-01-31T05:05:27.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc71000640 1 -- 172.21.15.49:0/3959493022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c0b34c0 msgr2=0x7efc6c0720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:27.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc71000640 1 --2- 172.21.15.49:0/3959493022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c0b34c0 0x7efc6c0720e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0b1670 tx=0x7efc5401c3e0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc71000640 1 -- 172.21.15.49:0/3959493022 shutdown_connections 2024-01-31T05:05:27.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc71000640 1 --2- 172.21.15.49:0/3959493022 >> v2:172.21.15.195:3300/0 conn(0x7efc6c06c2d0 0x7efc6c0b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc71000640 1 --2- 172.21.15.49:0/3959493022 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c0b34c0 0x7efc6c0720e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc71000640 1 --2- 172.21.15.49:0/3959493022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc6c0b30e0 0x7efc6c15e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc71000640 1 -- 172.21.15.49:0/3959493022 >> 172.21.15.49:0/3959493022 conn(0x7efc6c0b09a0 msgr2=0x7efc6c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:27.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc71000640 1 -- 172.21.15.49:0/3959493022 shutdown_connections 2024-01-31T05:05:27.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc71000640 1 -- 172.21.15.49:0/3959493022 wait complete. 2024-01-31T05:05:27.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc71000640 1 Processor -- start 2024-01-31T05:05:27.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc71000640 1 -- start start 2024-01-31T05:05:27.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc71000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc6c06c2d0 0x7efc6c0af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc71000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c0b30e0 0x7efc6c14abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc71000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc6c0b34c0 0x7efc6c151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc71000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c14b130 con 0x7efc6c0b30e0 2024-01-31T05:05:27.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc71000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0ae0d0 con 0x7efc6c06c2d0 2024-01-31T05:05:27.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc71000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0ae3b0 con 0x7efc6c0b34c0 2024-01-31T05:05:27.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc69400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c0b30e0 0x7efc6c14abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc69400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c0b30e0 0x7efc6c14abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35100/0 (socket says 172.21.15.49:35100) 2024-01-31T05:05:27.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc69400640 1 -- 172.21.15.49:0/1036787986 learned_addr learned my addr 172.21.15.49:0/1036787986 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:27.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc69e00640 1 --2- 172.21.15.49:0/1036787986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc6c06c2d0 0x7efc6c0af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc6a800640 1 --2- 172.21.15.49:0/1036787986 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc6c0b34c0 0x7efc6c151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc69400640 1 -- 172.21.15.49:0/1036787986 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc6c0b34c0 msgr2=0x7efc6c151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc69400640 1 --2- 172.21.15.49:0/1036787986 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc6c0b34c0 0x7efc6c151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc69400640 1 -- 172.21.15.49:0/1036787986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc6c06c2d0 msgr2=0x7efc6c0af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc69400640 1 --2- 172.21.15.49:0/1036787986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc6c06c2d0 0x7efc6c0af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.376+0000 7efc69400640 1 -- 172.21.15.49:0/1036787986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc540094d0 con 0x7efc6c0b30e0 2024-01-31T05:05:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.380+0000 7efc6a800640 1 --2- 172.21.15.49:0/1036787986 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc6c0b34c0 0x7efc6c151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.380+0000 7efc69400640 1 --2- 172.21.15.49:0/1036787986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c0b30e0 0x7efc6c14abf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efc5401cc80 tx=0x7efc6c072830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.380+0000 7efc62000640 1 -- 172.21.15.49:0/1036787986 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc540b4420 con 0x7efc6c0b30e0 2024-01-31T05:05:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.380+0000 7efc62000640 1 -- 172.21.15.49:0/1036787986 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc540b4580 con 0x7efc6c0b30e0 2024-01-31T05:05:27.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.380+0000 7efc71000640 1 -- 172.21.15.49:0/1036787986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6c0ae690 con 0x7efc6c0b30e0 2024-01-31T05:05:27.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.380+0000 7efc62000640 1 -- 172.21.15.49:0/1036787986 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc540b4930 con 0x7efc6c0b30e0 2024-01-31T05:05:27.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.380+0000 7efc71000640 1 -- 172.21.15.49:0/1036787986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6c0aec50 con 0x7efc6c0b30e0 2024-01-31T05:05:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.380+0000 7efc71000640 1 -- 172.21.15.49:0/1036787986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6c074860 con 0x7efc6c0b30e0 2024-01-31T05:05:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.380+0000 7efc62000640 1 -- 172.21.15.49:0/1036787986 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7efc540b2070 con 0x7efc6c0b30e0 2024-01-31T05:05:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.380+0000 7efc62000640 1 --2- 172.21.15.49:0/1036787986 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7efc44066500 0x7efc440689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.380+0000 7efc62000640 1 -- 172.21.15.49:0/1036787986 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efc5411dd20 con 0x7efc6c0b30e0 2024-01-31T05:05:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.380+0000 7efc69e00640 1 --2- 172.21.15.49:0/1036787986 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7efc44066500 0x7efc440689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.384+0000 7efc69e00640 1 --2- 172.21.15.49:0/1036787986 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7efc44066500 0x7efc440689c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0b2300 tx=0x7efc5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:27.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.384+0000 7efc62000640 1 -- 172.21.15.49:0/1036787986 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7efc540eab80 con 0x7efc6c0b30e0 2024-01-31T05:05:27.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.556+0000 7efc71000640 1 -- 172.21.15.49:0/1036787986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc6c0b15e0 con 0x7efc6c0b30e0 2024-01-31T05:05:27.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.556+0000 7efc62000640 1 -- 172.21.15.49:0/1036787986 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7efc5410c090 con 0x7efc6c0b30e0 2024-01-31T05:05:27.558 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:27.558 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:58.277568+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:27.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.560+0000 7efc71000640 1 -- 172.21.15.49:0/1036787986 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7efc44066500 msgr2=0x7efc440689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:27.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.560+0000 7efc71000640 1 --2- 172.21.15.49:0/1036787986 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7efc44066500 0x7efc440689c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0b2300 tx=0x7efc5c008040 comp rx=0 tx=0).stop 2024-01-31T05:05:27.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.560+0000 7efc71000640 1 -- 172.21.15.49:0/1036787986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c0b30e0 msgr2=0x7efc6c14abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:27.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.560+0000 7efc71000640 1 --2- 172.21.15.49:0/1036787986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c0b30e0 0x7efc6c14abf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efc5401cc80 tx=0x7efc6c072830 comp rx=0 tx=0).stop 2024-01-31T05:05:27.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.560+0000 7efc71000640 1 -- 172.21.15.49:0/1036787986 shutdown_connections 2024-01-31T05:05:27.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.560+0000 7efc71000640 1 --2- 172.21.15.49:0/1036787986 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efc6c0b34c0 0x7efc6c151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.560+0000 7efc71000640 1 --2- 172.21.15.49:0/1036787986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc6c0b30e0 0x7efc6c14abf0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.560+0000 7efc71000640 1 --2- 172.21.15.49:0/1036787986 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7efc44066500 0x7efc440689c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.560+0000 7efc71000640 1 --2- 172.21.15.49:0/1036787986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc6c06c2d0 0x7efc6c0af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.560+0000 7efc71000640 1 -- 172.21.15.49:0/1036787986 >> 172.21.15.49:0/1036787986 conn(0x7efc6c0b09a0 msgr2=0x7efc6c15ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:27.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.560+0000 7efc71000640 1 -- 172.21.15.49:0/1036787986 shutdown_connections 2024-01-31T05:05:27.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.560+0000 7efc71000640 1 -- 172.21.15.49:0/1036787986 wait complete. 2024-01-31T05:05:27.581 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:04:14.566345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:04:15.231265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-31T05:04:18.316756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-31T05:05:27.582 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:05:27.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.724+0000 7f321a600640 1 Processor -- start 2024-01-31T05:05:27.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.724+0000 7f321a600640 1 -- start start 2024-01-31T05:05:27.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.724+0000 7f321a600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32140d1cd0 0x7f32140d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.724+0000 7f321a600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f32140ce700 0x7f32140b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.724+0000 7f321a600640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32140cf150 con 0x7f321415d4a0 2024-01-31T05:05:27.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.724+0000 7f321a600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321415d880 con 0x7f32140ce700 2024-01-31T05:05:27.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.724+0000 7f321a600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32140cee70 con 0x7f32140d1cd0 2024-01-31T05:05:27.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.724+0000 7f3213400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f321415d4a0 0x7f32140d15c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:57992/0 (socket says 172.21.15.49:57992) 2024-01-31T05:05:27.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.724+0000 7f3213400640 1 -- 172.21.15.49:0/2522868081 learned_addr learned my addr 172.21.15.49:0/2522868081 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:27.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.724+0000 7f3213e00640 1 --2- 172.21.15.49:0/2522868081 >> v2:172.21.15.195:3300/0 conn(0x7f32140ce700 0x7f32140b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.724+0000 7f3212a00640 1 --2- 172.21.15.49:0/2522868081 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32140d1cd0 0x7f32140d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.728+0000 7f3212000640 1 -- 172.21.15.49:0/2522868081 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519851381 0 0) 0x7f32140cf150 con 0x7f321415d4a0 2024-01-31T05:05:27.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.728+0000 7f3212000640 1 -- 172.21.15.49:0/2522868081 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31f4003530 con 0x7f321415d4a0 2024-01-31T05:05:27.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.728+0000 7f3213e00640 1 -- 172.21.15.49:0/2522868081 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32140d1cd0 msgr2=0x7f32140d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:27.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.728+0000 7f3213e00640 1 --2- 172.21.15.49:0/2522868081 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32140d1cd0 0x7f32140d3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.728+0000 7f3213e00640 1 -- 172.21.15.49:0/2522868081 >> v1:172.21.15.49:6789/0 conn(0x7f321415d4a0 legacy=0x7f32140d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:27.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.728+0000 7f3213e00640 1 -- 172.21.15.49:0/2522868081 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32140b2610 con 0x7f32140ce700 2024-01-31T05:05:27.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.728+0000 7f3212a00640 1 --2- 172.21.15.49:0/2522868081 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32140d1cd0 0x7f32140d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:27.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.728+0000 7f3213e00640 1 --2- 172.21.15.49:0/2522868081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32140ce700 0x7f32140b30f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f320c009d90 tx=0x7f320c01f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8070d2145c1f4512 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:27.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.728+0000 7f3212000640 1 -- 172.21.15.49:0/2522868081 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c0af600 con 0x7f32140ce700 2024-01-31T05:05:27.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.728+0000 7f3212000640 1 -- 172.21.15.49:0/2522868081 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320c0ab050 con 0x7f32140ce700 2024-01-31T05:05:27.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.728+0000 7f3212000640 1 -- 172.21.15.49:0/2522868081 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c0af960 con 0x7f32140ce700 2024-01-31T05:05:27.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f321a600640 1 -- 172.21.15.49:0/2522868081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32140ce700 msgr2=0x7f32140b30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:27.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f321a600640 1 --2- 172.21.15.49:0/2522868081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32140ce700 0x7f32140b30f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f320c009d90 tx=0x7f320c01f130 comp rx=0 tx=0).stop 2024-01-31T05:05:27.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f321a600640 1 -- 172.21.15.49:0/2522868081 shutdown_connections 2024-01-31T05:05:27.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f321a600640 1 --2- 172.21.15.49:0/2522868081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32140ce700 0x7f32140b30f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f321a600640 1 --2- 172.21.15.49:0/2522868081 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32140d1cd0 0x7f32140d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f321a600640 1 -- 172.21.15.49:0/2522868081 >> 172.21.15.49:0/2522868081 conn(0x7f321409c3f0 msgr2=0x7f32140d2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:27.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f321a600640 1 -- 172.21.15.49:0/2522868081 shutdown_connections 2024-01-31T05:05:27.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f321a600640 1 -- 172.21.15.49:0/2522868081 wait complete. 2024-01-31T05:05:27.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f321a600640 1 Processor -- start 2024-01-31T05:05:27.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f321a600640 1 -- start start 2024-01-31T05:05:27.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f321a600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32140ce700 0x7f32141f3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f321a600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32140d1cd0 0x7f32141f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f321a600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f321415d4a0 0x7f32140b7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f321a600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32141f3990 con 0x7f32140ce700 2024-01-31T05:05:27.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f321a600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32140b5fe0 con 0x7f321415d4a0 2024-01-31T05:05:27.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f321a600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32140b62c0 con 0x7f32140d1cd0 2024-01-31T05:05:27.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f3213400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32140ce700 0x7f32141f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f3213400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32140ce700 0x7f32141f3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35112/0 (socket says 172.21.15.49:35112) 2024-01-31T05:05:27.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f3213400640 1 -- 172.21.15.49:0/2527908009 learned_addr learned my addr 172.21.15.49:0/2527908009 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:27.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f3212a00640 1 --2- 172.21.15.49:0/2527908009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32140d1cd0 0x7f32141f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.732+0000 7f3213e00640 1 --2- 172.21.15.49:0/2527908009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f321415d4a0 0x7f32140b7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.736+0000 7f3213400640 1 -- 172.21.15.49:0/2527908009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32140d1cd0 msgr2=0x7f32141f21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:27.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.736+0000 7f3213400640 1 --2- 172.21.15.49:0/2527908009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32140d1cd0 0x7f32141f21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.736+0000 7f3213400640 1 -- 172.21.15.49:0/2527908009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f321415d4a0 msgr2=0x7f32140b7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:27.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.736+0000 7f3213400640 1 --2- 172.21.15.49:0/2527908009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f321415d4a0 0x7f32140b7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.736+0000 7f3213400640 1 -- 172.21.15.49:0/2527908009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc009420 con 0x7f32140ce700 2024-01-31T05:05:27.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.736+0000 7f3213400640 1 --2- 172.21.15.49:0/2527908009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32140ce700 0x7f32141f3450 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f320400c3c0 tx=0x7f320400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:27.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.736+0000 7f320b400640 1 -- 172.21.15.49:0/2527908009 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3204005cf0 con 0x7f32140ce700 2024-01-31T05:05:27.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.736+0000 7f321a600640 1 -- 172.21.15.49:0/2527908009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320c009a70 con 0x7f32140ce700 2024-01-31T05:05:27.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.736+0000 7f320b400640 1 -- 172.21.15.49:0/2527908009 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3204005e50 con 0x7f32140ce700 2024-01-31T05:05:27.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.736+0000 7f320b400640 1 -- 172.21.15.49:0/2527908009 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32040072f0 con 0x7f32140ce700 2024-01-31T05:05:27.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.736+0000 7f321a600640 1 -- 172.21.15.49:0/2527908009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32140b6880 con 0x7f32140ce700 2024-01-31T05:05:27.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.736+0000 7f321a600640 1 -- 172.21.15.49:0/2527908009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3214074860 con 0x7f32140ce700 2024-01-31T05:05:27.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.736+0000 7f320b400640 1 -- 172.21.15.49:0/2527908009 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f3204007450 con 0x7f32140ce700 2024-01-31T05:05:27.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.736+0000 7f320b400640 1 --2- 172.21.15.49:0/2527908009 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f31ec066530 0x7f31ec0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:27.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.736+0000 7f320b400640 1 -- 172.21.15.49:0/2527908009 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f32040838a0 con 0x7f32140ce700 2024-01-31T05:05:27.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.740+0000 7f3212a00640 1 --2- 172.21.15.49:0/2527908009 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f31ec066530 0x7f31ec0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:27.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.740+0000 7f3212a00640 1 --2- 172.21.15.49:0/2527908009 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f31ec066530 0x7f31ec0689f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f32140cc680 tx=0x7f31fc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:27.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.740+0000 7f320b400640 1 -- 172.21.15.49:0/2527908009 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f3204050710 con 0x7f32140ce700 2024-01-31T05:05:27.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.904+0000 7f321a600640 1 -- 172.21.15.49:0/2527908009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32140d33f0 con 0x7f32140ce700 2024-01-31T05:05:27.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.904+0000 7f320b400640 1 -- 172.21.15.49:0/2527908009 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3204017020 con 0x7f32140ce700 2024-01-31T05:05:27.905 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:05:27.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.904+0000 7f321a600640 1 -- 172.21.15.49:0/2527908009 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f31ec066530 msgr2=0x7f31ec0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:27.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.904+0000 7f321a600640 1 --2- 172.21.15.49:0/2527908009 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f31ec066530 0x7f31ec0689f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f32140cc680 tx=0x7f31fc009190 comp rx=0 tx=0).stop 2024-01-31T05:05:27.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.904+0000 7f321a600640 1 -- 172.21.15.49:0/2527908009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32140ce700 msgr2=0x7f32141f3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:27.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.904+0000 7f321a600640 1 --2- 172.21.15.49:0/2527908009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32140ce700 0x7f32141f3450 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f320400c3c0 tx=0x7f320400c880 comp rx=0 tx=0).stop 2024-01-31T05:05:27.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.904+0000 7f321a600640 1 -- 172.21.15.49:0/2527908009 shutdown_connections 2024-01-31T05:05:27.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.904+0000 7f321a600640 1 --2- 172.21.15.49:0/2527908009 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f31ec066530 0x7f31ec0689f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.904+0000 7f321a600640 1 --2- 172.21.15.49:0/2527908009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f321415d4a0 0x7f32140b7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.904+0000 7f321a600640 1 --2- 172.21.15.49:0/2527908009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32140d1cd0 0x7f32141f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.904+0000 7f321a600640 1 --2- 172.21.15.49:0/2527908009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32140ce700 0x7f32141f3450 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:27.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.904+0000 7f321a600640 1 -- 172.21.15.49:0/2527908009 >> 172.21.15.49:0/2527908009 conn(0x7f321409c3f0 msgr2=0x7f321406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:27.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.904+0000 7f321a600640 1 -- 172.21.15.49:0/2527908009 shutdown_connections 2024-01-31T05:05:27.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:27.904+0000 7f321a600640 1 -- 172.21.15.49:0/2527908009 wait complete. 2024-01-31T05:05:27.927 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:05:28.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.068+0000 7f3fcd200640 1 Processor -- start 2024-01-31T05:05:28.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.068+0000 7f3fcd200640 1 -- start start 2024-01-31T05:05:28.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.072+0000 7f3fcd200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3fc8159790 0x7f3fc80b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:28.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.072+0000 7f3fcd200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fc80b3d00 0x7f3fc8070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:28.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.072+0000 7f3fcd200640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc8159b70 con 0x7f3fc8070ba0 2024-01-31T05:05:28.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.072+0000 7f3fcd200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc8071030 con 0x7f3fc8159790 2024-01-31T05:05:28.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.072+0000 7f3fcd200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc80b2750 con 0x7f3fc80b3d00 2024-01-31T05:05:28.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.072+0000 7f3fc6800640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3fc8070ba0 0x7f3fc806cb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:58002/0 (socket says 172.21.15.49:58002) 2024-01-31T05:05:28.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.072+0000 7f3fc6800640 1 -- 172.21.15.49:0/1596335340 learned_addr learned my addr 172.21.15.49:0/1596335340 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:28.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.072+0000 7f3fc5e00640 1 --2- 172.21.15.49:0/1596335340 >> v2:172.21.15.195:3300/0 conn(0x7f3fc8159790 0x7f3fc80b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:28.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.072+0000 7f3fc5400640 1 --2- 172.21.15.49:0/1596335340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fc80b3d00 0x7f3fc8070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:28.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.072+0000 7f3fc4a00640 1 -- 172.21.15.49:0/1596335340 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979717937 0 0) 0x7f3fc8159b70 con 0x7f3fc8070ba0 2024-01-31T05:05:28.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.072+0000 7f3fc4a00640 1 -- 172.21.15.49:0/1596335340 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fa8003530 con 0x7f3fc8070ba0 2024-01-31T05:05:28.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.072+0000 7f3fc5e00640 1 -- 172.21.15.49:0/1596335340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fc80b3d00 msgr2=0x7f3fc8070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:28.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.072+0000 7f3fc5e00640 1 --2- 172.21.15.49:0/1596335340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fc80b3d00 0x7f3fc8070660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.072+0000 7f3fc5e00640 1 -- 172.21.15.49:0/1596335340 >> v1:172.21.15.49:6789/0 conn(0x7f3fc8070ba0 legacy=0x7f3fc806cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:28.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.072+0000 7f3fc5e00640 1 -- 172.21.15.49:0/1596335340 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc80b2a30 con 0x7f3fc8159790 2024-01-31T05:05:28.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.076+0000 7f3fc5e00640 1 --2- 172.21.15.49:0/1596335340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fc8159790 0x7f3fc80b37c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800a960 tx=0x7f3fb801d820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c3ef100bf87470b server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:28.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.076+0000 7f3fc4a00640 1 -- 172.21.15.49:0/1596335340 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb80a6850 con 0x7f3fc8159790 2024-01-31T05:05:28.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.076+0000 7f3fc4a00640 1 -- 172.21.15.49:0/1596335340 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb80a69b0 con 0x7f3fc8159790 2024-01-31T05:05:28.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.076+0000 7f3fc4a00640 1 -- 172.21.15.49:0/1596335340 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb80a6d20 con 0x7f3fc8159790 2024-01-31T05:05:28.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.076+0000 7f3fcd200640 1 -- 172.21.15.49:0/1596335340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fc8159790 msgr2=0x7f3fc80b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:28.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.076+0000 7f3fcd200640 1 --2- 172.21.15.49:0/1596335340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fc8159790 0x7f3fc80b37c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800a960 tx=0x7f3fb801d820 comp rx=0 tx=0).stop 2024-01-31T05:05:28.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.076+0000 7f3fcd200640 1 -- 172.21.15.49:0/1596335340 shutdown_connections 2024-01-31T05:05:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.076+0000 7f3fcd200640 1 --2- 172.21.15.49:0/1596335340 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fc80b3d00 0x7f3fc8070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.076+0000 7f3fcd200640 1 --2- 172.21.15.49:0/1596335340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fc8159790 0x7f3fc80b37c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.076+0000 7f3fcd200640 1 -- 172.21.15.49:0/1596335340 >> 172.21.15.49:0/1596335340 conn(0x7f3fc80b09a0 msgr2=0x7f3fc80b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.076+0000 7f3fcd200640 1 -- 172.21.15.49:0/1596335340 shutdown_connections 2024-01-31T05:05:28.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.076+0000 7f3fcd200640 1 -- 172.21.15.49:0/1596335340 wait complete. 2024-01-31T05:05:28.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.076+0000 7f3fcd200640 1 Processor -- start 2024-01-31T05:05:28.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fcd200640 1 -- start start 2024-01-31T05:05:28.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fcd200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fc8070ba0 0x7f3fc813a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:28.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fcd200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc80b3d00 0x7f3fc815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:28.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fcd200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fc8159790 0x7f3fc80b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:28.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fcd200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc815bbe0 con 0x7f3fc80b3d00 2024-01-31T05:05:28.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fcd200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc815ad00 con 0x7f3fc8159790 2024-01-31T05:05:28.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fcd200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc815afd0 con 0x7f3fc8070ba0 2024-01-31T05:05:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fc5400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc80b3d00 0x7f3fc815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fc5400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc80b3d00 0x7f3fc815a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35124/0 (socket says 172.21.15.49:35124) 2024-01-31T05:05:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fc5400640 1 -- 172.21.15.49:0/1337411284 learned_addr learned my addr 172.21.15.49:0/1337411284 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fc5e00640 1 --2- 172.21.15.49:0/1337411284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fc8070ba0 0x7f3fc813a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fc6800640 1 --2- 172.21.15.49:0/1337411284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fc8159790 0x7f3fc80b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fc5400640 1 -- 172.21.15.49:0/1337411284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fc8070ba0 msgr2=0x7f3fc813a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fc5400640 1 --2- 172.21.15.49:0/1337411284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fc8070ba0 0x7f3fc813a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fc5400640 1 -- 172.21.15.49:0/1337411284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fc8159790 msgr2=0x7f3fc80b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fc5400640 1 --2- 172.21.15.49:0/1337411284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fc8159790 0x7f3fc80b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fc5400640 1 -- 172.21.15.49:0/1337411284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb800a5c0 con 0x7f3fc80b3d00 2024-01-31T05:05:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fc5400640 1 --2- 172.21.15.49:0/1337411284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc80b3d00 0x7f3fc815a7c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000e930 tx=0x7f3fb000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fbe000640 1 -- 172.21.15.49:0/1337411284 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0009690 con 0x7f3fc80b3d00 2024-01-31T05:05:28.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fbe000640 1 -- 172.21.15.49:0/1337411284 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb000ca00 con 0x7f3fc80b3d00 2024-01-31T05:05:28.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fbe000640 1 -- 172.21.15.49:0/1337411284 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb000cd70 con 0x7f3fc80b3d00 2024-01-31T05:05:28.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fcd200640 1 -- 172.21.15.49:0/1337411284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc815b2b0 con 0x7f3fc80b3d00 2024-01-31T05:05:28.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fcd200640 1 -- 172.21.15.49:0/1337411284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc815b870 con 0x7f3fc80b3d00 2024-01-31T05:05:28.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.080+0000 7f3fcd200640 1 -- 172.21.15.49:0/1337411284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc8074860 con 0x7f3fc80b3d00 2024-01-31T05:05:28.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.084+0000 7f3fbe000640 1 -- 172.21.15.49:0/1337411284 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f3fb0013470 con 0x7f3fc80b3d00 2024-01-31T05:05:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.084+0000 7f3fbe000640 1 --2- 172.21.15.49:0/1337411284 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3fa0066500 0x7f3fa00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.084+0000 7f3fbe000640 1 -- 172.21.15.49:0/1337411284 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3fb00847e0 con 0x7f3fc80b3d00 2024-01-31T05:05:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.084+0000 7f3fc5e00640 1 --2- 172.21.15.49:0/1337411284 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3fa0066500 0x7f3fa00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:28.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.084+0000 7f3fc5e00640 1 --2- 172.21.15.49:0/1337411284 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3fa0066500 0x7f3fa00689c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80b0000 tx=0x7f3fb80a8070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:28.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.088+0000 7f3fbe000640 1 -- 172.21.15.49:0/1337411284 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f3fb0051820 con 0x7f3fc80b3d00 2024-01-31T05:05:28.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.248+0000 7f3fcd200640 1 -- 172.21.15.49:0/1337411284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3fc8156a50 con 0x7f3fc80b3d00 2024-01-31T05:05:28.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.248+0000 7f3fbe000640 1 -- 172.21.15.49:0/1337411284 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3fb0054e40 con 0x7f3fc80b3d00 2024-01-31T05:05:28.249 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:28.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.248+0000 7f3fcd200640 1 -- 172.21.15.49:0/1337411284 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3fa0066500 msgr2=0x7f3fa00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:28.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.248+0000 7f3fcd200640 1 --2- 172.21.15.49:0/1337411284 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3fa0066500 0x7f3fa00689c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80b0000 tx=0x7f3fb80a8070 comp rx=0 tx=0).stop 2024-01-31T05:05:28.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.248+0000 7f3fcd200640 1 -- 172.21.15.49:0/1337411284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc80b3d00 msgr2=0x7f3fc815a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:28.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.248+0000 7f3fcd200640 1 --2- 172.21.15.49:0/1337411284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc80b3d00 0x7f3fc815a7c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000e930 tx=0x7f3fb000edf0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.248+0000 7f3fcd200640 1 -- 172.21.15.49:0/1337411284 shutdown_connections 2024-01-31T05:05:28.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.248+0000 7f3fcd200640 1 --2- 172.21.15.49:0/1337411284 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3fa0066500 0x7f3fa00689c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.248+0000 7f3fcd200640 1 --2- 172.21.15.49:0/1337411284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fc8159790 0x7f3fc80b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.248+0000 7f3fcd200640 1 --2- 172.21.15.49:0/1337411284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3fc80b3d00 0x7f3fc815a7c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.248+0000 7f3fcd200640 1 --2- 172.21.15.49:0/1337411284 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3fc8070ba0 0x7f3fc813a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.248+0000 7f3fcd200640 1 -- 172.21.15.49:0/1337411284 >> 172.21.15.49:0/1337411284 conn(0x7f3fc80b09a0 msgr2=0x7f3fc8071170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:28.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.248+0000 7f3fcd200640 1 -- 172.21.15.49:0/1337411284 shutdown_connections 2024-01-31T05:05:28.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.248+0000 7f3fcd200640 1 -- 172.21.15.49:0/1337411284 wait complete. 2024-01-31T05:05:28.272 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:05:28.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.420+0000 7f8949e00640 1 Processor -- start 2024-01-31T05:05:28.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.420+0000 7f8949e00640 1 -- start start 2024-01-31T05:05:28.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.420+0000 7f8949e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f894415d3a0 0x7f894406e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:28.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.420+0000 7f8949e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89440cce30 0x7f894406f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:28.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.420+0000 7f8949e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89440cb990 con 0x7f894406ee50 2024-01-31T05:05:28.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.420+0000 7f8949e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89440d1c20 con 0x7f894415d3a0 2024-01-31T05:05:28.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.420+0000 7f8949e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89440cfed0 con 0x7f89440cce30 2024-01-31T05:05:28.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.420+0000 7f8942a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f894415d3a0 0x7f894406e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:28.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.420+0000 7f8942a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f894415d3a0 0x7f894406e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:51240/0 (socket says 172.21.15.49:51240) 2024-01-31T05:05:28.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.420+0000 7f8942a00640 1 -- 172.21.15.49:0/991652939 learned_addr learned my addr 172.21.15.49:0/991652939 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:28.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.420+0000 7f8943400640 1 --2- 172.21.15.49:0/991652939 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89440cce30 0x7f894406f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:28.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.420+0000 7f8941600640 1 -- 172.21.15.49:0/991652939 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3791710972 0 0) 0x7f89440cb990 con 0x7f894406ee50 2024-01-31T05:05:28.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.420+0000 7f8941600640 1 -- 172.21.15.49:0/991652939 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8924003530 con 0x7f894406ee50 2024-01-31T05:05:28.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.420+0000 7f8942a00640 1 -- 172.21.15.49:0/991652939 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89440cce30 msgr2=0x7f894406f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:28.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.420+0000 7f8942a00640 1 --2- 172.21.15.49:0/991652939 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89440cce30 0x7f894406f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.420+0000 7f8942a00640 1 -- 172.21.15.49:0/991652939 >> v1:172.21.15.195:6789/0 conn(0x7f894406ee50 legacy=0x7f89440cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:28.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.420+0000 7f8942a00640 1 -- 172.21.15.49:0/991652939 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89440d01b0 con 0x7f894415d3a0 2024-01-31T05:05:28.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.424+0000 7f8942a00640 1 --2- 172.21.15.49:0/991652939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f894415d3a0 0x7f894406e910 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8934009870 tx=0x7f893401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3d9d93477216c59 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:28.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.424+0000 7f8941600640 1 -- 172.21.15.49:0/991652939 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89340a9620 con 0x7f894415d3a0 2024-01-31T05:05:28.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.424+0000 7f8941600640 1 -- 172.21.15.49:0/991652939 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89340a9780 con 0x7f894415d3a0 2024-01-31T05:05:28.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.424+0000 7f8941600640 1 -- 172.21.15.49:0/991652939 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89340a9b10 con 0x7f894415d3a0 2024-01-31T05:05:28.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.424+0000 7f8949e00640 1 -- 172.21.15.49:0/991652939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f894415d3a0 msgr2=0x7f894406e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:28.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.424+0000 7f8949e00640 1 --2- 172.21.15.49:0/991652939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f894415d3a0 0x7f894406e910 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8934009870 tx=0x7f893401c540 comp rx=0 tx=0).stop 2024-01-31T05:05:28.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.424+0000 7f8949e00640 1 -- 172.21.15.49:0/991652939 shutdown_connections 2024-01-31T05:05:28.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.424+0000 7f8949e00640 1 --2- 172.21.15.49:0/991652939 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f89440cce30 0x7f894406f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.424+0000 7f8949e00640 1 --2- 172.21.15.49:0/991652939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f894415d3a0 0x7f894406e910 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.424+0000 7f8949e00640 1 -- 172.21.15.49:0/991652939 >> 172.21.15.49:0/991652939 conn(0x7f89440d0e50 msgr2=0x7f89440d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:28.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.424+0000 7f8949e00640 1 -- 172.21.15.49:0/991652939 shutdown_connections 2024-01-31T05:05:28.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.424+0000 7f8949e00640 1 -- 172.21.15.49:0/991652939 wait complete. 2024-01-31T05:05:28.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.428+0000 7f8949e00640 1 Processor -- start 2024-01-31T05:05:28.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.428+0000 7f8949e00640 1 -- start start 2024-01-31T05:05:28.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.428+0000 7f8949e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f894406ee50 0x7f894414c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:28.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.428+0000 7f8949e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89440cce30 0x7f89440b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:28.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.428+0000 7f8949e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f894415d3a0 0x7f89440b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:28.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.428+0000 7f8949e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894414c8b0 con 0x7f89440cce30 2024-01-31T05:05:28.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.428+0000 7f8949e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894415b880 con 0x7f894415d3a0 2024-01-31T05:05:28.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.428+0000 7f8949e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894415bb60 con 0x7f894406ee50 2024-01-31T05:05:28.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.428+0000 7f8942000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89440cce30 0x7f89440b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:28.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.428+0000 7f8942a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f894406ee50 0x7f894414c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:28.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.428+0000 7f8942a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f894406ee50 0x7f894414c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:56992/0 (socket says 172.21.15.49:56992) 2024-01-31T05:05:28.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.428+0000 7f8942a00640 1 -- 172.21.15.49:0/3604119083 learned_addr learned my addr 172.21.15.49:0/3604119083 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:28.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.428+0000 7f8942000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89440cce30 0x7f89440b5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45604/0 (socket says 172.21.15.49:45604) 2024-01-31T05:05:28.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.428+0000 7f8943400640 1 --2- 172.21.15.49:0/3604119083 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f894415d3a0 0x7f89440b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:28.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.428+0000 7f8942000640 1 -- 172.21.15.49:0/3604119083 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f894406ee50 msgr2=0x7f894414c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:28.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.428+0000 7f8942000640 1 --2- 172.21.15.49:0/3604119083 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f894406ee50 0x7f894414c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.428+0000 7f8942000640 1 -- 172.21.15.49:0/3604119083 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f894415d3a0 msgr2=0x7f89440b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:28.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.428+0000 7f8942000640 1 --2- 172.21.15.49:0/3604119083 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f894415d3a0 0x7f89440b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.428+0000 7f8942000640 1 -- 172.21.15.49:0/3604119083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89340094d0 con 0x7f89440cce30 2024-01-31T05:05:28.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.432+0000 7f8942000640 1 --2- 172.21.15.49:0/3604119083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89440cce30 0x7f89440b5280 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f892c00c340 tx=0x7f892c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:28.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.432+0000 7f893b400640 1 -- 172.21.15.49:0/3604119083 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c0052d0 con 0x7f89440cce30 2024-01-31T05:05:28.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.432+0000 7f893b400640 1 -- 172.21.15.49:0/3604119083 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c005450 con 0x7f89440cce30 2024-01-31T05:05:28.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.432+0000 7f893b400640 1 -- 172.21.15.49:0/3604119083 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c003840 con 0x7f89440cce30 2024-01-31T05:05:28.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.432+0000 7f8949e00640 1 -- 172.21.15.49:0/3604119083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894415be40 con 0x7f89440cce30 2024-01-31T05:05:28.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.432+0000 7f8949e00640 1 -- 172.21.15.49:0/3604119083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f894415c400 con 0x7f89440cce30 2024-01-31T05:05:28.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.432+0000 7f8949e00640 1 -- 172.21.15.49:0/3604119083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894406fdb0 con 0x7f89440cce30 2024-01-31T05:05:28.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.432+0000 7f893b400640 1 -- 172.21.15.49:0/3604119083 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f892c0039a0 con 0x7f89440cce30 2024-01-31T05:05:28.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.432+0000 7f893b400640 1 --2- 172.21.15.49:0/3604119083 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f891c066500 0x7f891c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:28.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.432+0000 7f893b400640 1 -- 172.21.15.49:0/3604119083 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f892c083760 con 0x7f89440cce30 2024-01-31T05:05:28.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.432+0000 7f8942a00640 1 --2- 172.21.15.49:0/3604119083 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f891c066500 0x7f891c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:28.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.436+0000 7f8942a00640 1 --2- 172.21.15.49:0/3604119083 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f891c066500 0x7f891c0689c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8934009870 tx=0x7f89340b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:28.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.436+0000 7f893b400640 1 -- 172.21.15.49:0/3604119083 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f892c050650 con 0x7f89440cce30 2024-01-31T05:05:28.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.596+0000 7f8949e00640 1 -- 172.21.15.49:0/3604119083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8944074860 con 0x7f89440cce30 2024-01-31T05:05:28.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.596+0000 7f893b400640 1 -- 172.21.15.49:0/3604119083 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f892c053c70 con 0x7f89440cce30 2024-01-31T05:05:28.599 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-31T05:05:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.600+0000 7f8949e00640 1 -- 172.21.15.49:0/3604119083 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f891c066500 msgr2=0x7f891c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.600+0000 7f8949e00640 1 --2- 172.21.15.49:0/3604119083 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f891c066500 0x7f891c0689c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8934009870 tx=0x7f89340b3040 comp rx=0 tx=0).stop 2024-01-31T05:05:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.600+0000 7f8949e00640 1 -- 172.21.15.49:0/3604119083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89440cce30 msgr2=0x7f89440b5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.600+0000 7f8949e00640 1 --2- 172.21.15.49:0/3604119083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89440cce30 0x7f89440b5280 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f892c00c340 tx=0x7f892c001e80 comp rx=0 tx=0).stop 2024-01-31T05:05:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.600+0000 7f8949e00640 1 -- 172.21.15.49:0/3604119083 shutdown_connections 2024-01-31T05:05:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.600+0000 7f8949e00640 1 --2- 172.21.15.49:0/3604119083 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f891c066500 0x7f891c0689c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.600+0000 7f8949e00640 1 --2- 172.21.15.49:0/3604119083 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f894415d3a0 0x7f89440b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.600+0000 7f8949e00640 1 --2- 172.21.15.49:0/3604119083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89440cce30 0x7f89440b5280 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.600+0000 7f8949e00640 1 --2- 172.21.15.49:0/3604119083 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f894406ee50 0x7f894414c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.600+0000 7f8949e00640 1 -- 172.21.15.49:0/3604119083 >> 172.21.15.49:0/3604119083 conn(0x7f89440d0e50 msgr2=0x7f89440b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.600+0000 7f8949e00640 1 -- 172.21.15.49:0/3604119083 shutdown_connections 2024-01-31T05:05:28.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.600+0000 7f8949e00640 1 -- 172.21.15.49:0/3604119083 wait complete. 2024-01-31T05:05:28.621 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-31T05:05:28.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.764+0000 7f2f67c00640 1 Processor -- start 2024-01-31T05:05:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.764+0000 7f2f67c00640 1 -- start start 2024-01-31T05:05:28.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.764+0000 7f2f67c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2f6015d510 0x7f2f60072050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:28.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.764+0000 7f2f67c00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f6006daf0 0x7f2f60160f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:28.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.764+0000 7f2f67c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f60072590 con 0x7f2f600b4b20 2024-01-31T05:05:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.764+0000 7f2f67c00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6006f010 con 0x7f2f6006daf0 2024-01-31T05:05:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.764+0000 7f2f67c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6006df20 con 0x7f2f6015d510 2024-01-31T05:05:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.768+0000 7f2f65c00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f6006daf0 0x7f2f60160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.768+0000 7f2f65c00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2f6006daf0 0x7f2f60160f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45616/0 (socket says 172.21.15.49:45616) 2024-01-31T05:05:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.768+0000 7f2f65c00640 1 -- 172.21.15.49:0/2182014243 learned_addr learned my addr 172.21.15.49:0/2182014243 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.768+0000 7f2f65200640 1 --2- 172.21.15.49:0/2182014243 >> v2:172.21.15.195:3300/0 conn(0x7f2f6015d510 0x7f2f60072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.768+0000 7f2f65c00640 1 -- 172.21.15.49:0/2182014243 >> v2:172.21.15.195:3300/0 conn(0x7f2f6015d510 msgr2=0x7f2f60072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.768+0000 7f2f65c00640 1 --2- 172.21.15.49:0/2182014243 >> v2:172.21.15.195:3300/0 conn(0x7f2f6015d510 0x7f2f60072050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.768+0000 7f2f65c00640 1 -- 172.21.15.49:0/2182014243 >> v1:172.21.15.195:6789/0 conn(0x7f2f600b4b20 legacy=0x7f2f6006d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.768+0000 7f2f65c00640 1 -- 172.21.15.49:0/2182014243 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f60071570 con 0x7f2f6006daf0 2024-01-31T05:05:28.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.768+0000 7f2f65c00640 1 --2- 172.21.15.49:0/2182014243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6006daf0 0x7f2f60160f10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2f600d0d90 tx=0x7f2f5801c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2426dc4855f52d31 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:28.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.768+0000 7f2f5f400640 1 -- 172.21.15.49:0/2182014243 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f580a5510 con 0x7f2f6006daf0 2024-01-31T05:05:28.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.768+0000 7f2f5f400640 1 -- 172.21.15.49:0/2182014243 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f580a5670 con 0x7f2f6006daf0 2024-01-31T05:05:28.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.768+0000 7f2f5f400640 1 -- 172.21.15.49:0/2182014243 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f580a5a00 con 0x7f2f6006daf0 2024-01-31T05:05:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.772+0000 7f2f67c00640 1 -- 172.21.15.49:0/2182014243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6006daf0 msgr2=0x7f2f60160f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.772+0000 7f2f67c00640 1 --2- 172.21.15.49:0/2182014243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6006daf0 0x7f2f60160f10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2f600d0d90 tx=0x7f2f5801c650 comp rx=0 tx=0).stop 2024-01-31T05:05:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.772+0000 7f2f67c00640 1 -- 172.21.15.49:0/2182014243 shutdown_connections 2024-01-31T05:05:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.772+0000 7f2f67c00640 1 --2- 172.21.15.49:0/2182014243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6006daf0 0x7f2f60160f10 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.772+0000 7f2f67c00640 1 --2- 172.21.15.49:0/2182014243 >> v2:172.21.15.195:3300/0 conn(0x7f2f6015d510 0x7f2f60072050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.772+0000 7f2f67c00640 1 -- 172.21.15.49:0/2182014243 >> 172.21.15.49:0/2182014243 conn(0x7f2f600b1ab0 msgr2=0x7f2f600b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.772+0000 7f2f67c00640 1 -- 172.21.15.49:0/2182014243 shutdown_connections 2024-01-31T05:05:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.772+0000 7f2f67c00640 1 -- 172.21.15.49:0/2182014243 wait complete. 2024-01-31T05:05:28.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.772+0000 7f2f67c00640 1 Processor -- start 2024-01-31T05:05:28.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.772+0000 7f2f67c00640 1 -- start start 2024-01-31T05:05:28.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.772+0000 7f2f67c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f6006daf0 0x7f2f60153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:28.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.772+0000 7f2f67c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f600b4b20 0x7f2f60152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:28.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.772+0000 7f2f67c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6015d510 0x7f2f6014b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:28.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.772+0000 7f2f67c00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f60153a40 con 0x7f2f6015d510 2024-01-31T05:05:28.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.772+0000 7f2f67c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f60159220 con 0x7f2f6006daf0 2024-01-31T05:05:28.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.772+0000 7f2f67c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f60159500 con 0x7f2f600b4b20 2024-01-31T05:05:28.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.772+0000 7f2f65c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6015d510 0x7f2f6014b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:28.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.772+0000 7f2f65c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6015d510 0x7f2f6014b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45630/0 (socket says 172.21.15.49:45630) 2024-01-31T05:05:28.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.772+0000 7f2f65c00640 1 -- 172.21.15.49:0/3446616524 learned_addr learned my addr 172.21.15.49:0/3446616524 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:28.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.776+0000 7f2f65200640 1 --2- 172.21.15.49:0/3446616524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f6006daf0 0x7f2f60153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:28.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.776+0000 7f2f5fe00640 1 --2- 172.21.15.49:0/3446616524 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f600b4b20 0x7f2f60152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:28.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.776+0000 7f2f65c00640 1 -- 172.21.15.49:0/3446616524 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f600b4b20 msgr2=0x7f2f60152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:28.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.776+0000 7f2f65c00640 1 --2- 172.21.15.49:0/3446616524 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f600b4b20 0x7f2f60152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.776+0000 7f2f65c00640 1 -- 172.21.15.49:0/3446616524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f6006daf0 msgr2=0x7f2f60153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:28.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.776+0000 7f2f65c00640 1 --2- 172.21.15.49:0/3446616524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f6006daf0 0x7f2f60153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.776+0000 7f2f65c00640 1 -- 172.21.15.49:0/3446616524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f58009b30 con 0x7f2f6015d510 2024-01-31T05:05:28.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.776+0000 7f2f65c00640 1 --2- 172.21.15.49:0/3446616524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6015d510 0x7f2f6014b650 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2f580af040 tx=0x7f2f580193f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.776+0000 7f2f5cc00640 1 -- 172.21.15.49:0/3446616524 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f580a5510 con 0x7f2f6015d510 2024-01-31T05:05:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.776+0000 7f2f5cc00640 1 -- 172.21.15.49:0/3446616524 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f580b8690 con 0x7f2f6015d510 2024-01-31T05:05:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.776+0000 7f2f67c00640 1 -- 172.21.15.49:0/3446616524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f601597e0 con 0x7f2f6015d510 2024-01-31T05:05:28.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.776+0000 7f2f5cc00640 1 -- 172.21.15.49:0/3446616524 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f580b8a40 con 0x7f2f6015d510 2024-01-31T05:05:28.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.776+0000 7f2f67c00640 1 -- 172.21.15.49:0/3446616524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6015e650 con 0x7f2f6015d510 2024-01-31T05:05:28.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.776+0000 7f2f67c00640 1 -- 172.21.15.49:0/3446616524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6015e900 con 0x7f2f6015d510 2024-01-31T05:05:28.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.776+0000 7f2f5cc00640 1 -- 172.21.15.49:0/3446616524 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f2f580b8ba0 con 0x7f2f6015d510 2024-01-31T05:05:28.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.780+0000 7f2f5cc00640 1 --2- 172.21.15.49:0/3446616524 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2f38066530 0x7f2f380689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:28.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.780+0000 7f2f5cc00640 1 -- 172.21.15.49:0/3446616524 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2f5811f3e0 con 0x7f2f6015d510 2024-01-31T05:05:28.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.780+0000 7f2f65200640 1 --2- 172.21.15.49:0/3446616524 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2f38066530 0x7f2f380689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:28.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.780+0000 7f2f65200640 1 --2- 172.21.15.49:0/3446616524 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2f38066530 0x7f2f380689f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009ac0 tx=0x7f2f50009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:28.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.784+0000 7f2f5cc00640 1 -- 172.21.15.49:0/3446616524 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f2f6015e900 con 0x7f2f6015d510 2024-01-31T05:05:28.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.944+0000 7f2f67c00640 1 -- 172.21.15.49:0/3446616524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2f6015e900 con 0x7f2f6015d510 2024-01-31T05:05:28.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.944+0000 7f2f5cc00640 1 -- 172.21.15.49:0/3446616524 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2f6015e900 con 0x7f2f6015d510 2024-01-31T05:05:28.945 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:28.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.944+0000 7f2f67c00640 1 -- 172.21.15.49:0/3446616524 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2f38066530 msgr2=0x7f2f380689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:28.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.944+0000 7f2f67c00640 1 --2- 172.21.15.49:0/3446616524 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2f38066530 0x7f2f380689f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009ac0 tx=0x7f2f50009190 comp rx=0 tx=0).stop 2024-01-31T05:05:28.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.944+0000 7f2f67c00640 1 -- 172.21.15.49:0/3446616524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6015d510 msgr2=0x7f2f6014b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:28.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.944+0000 7f2f67c00640 1 --2- 172.21.15.49:0/3446616524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6015d510 0x7f2f6014b650 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2f580af040 tx=0x7f2f580193f0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.944+0000 7f2f67c00640 1 -- 172.21.15.49:0/3446616524 shutdown_connections 2024-01-31T05:05:28.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.944+0000 7f2f67c00640 1 --2- 172.21.15.49:0/3446616524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6015d510 0x7f2f6014b650 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.944+0000 7f2f67c00640 1 --2- 172.21.15.49:0/3446616524 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f600b4b20 0x7f2f60152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.944+0000 7f2f67c00640 1 --2- 172.21.15.49:0/3446616524 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2f38066530 0x7f2f380689f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.944+0000 7f2f67c00640 1 --2- 172.21.15.49:0/3446616524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f6006daf0 0x7f2f60153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:28.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.944+0000 7f2f67c00640 1 -- 172.21.15.49:0/3446616524 >> 172.21.15.49:0/3446616524 conn(0x7f2f600b1ab0 msgr2=0x7f2f600afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:28.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.944+0000 7f2f67c00640 1 -- 172.21.15.49:0/3446616524 shutdown_connections 2024-01-31T05:05:28.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:28.944+0000 7f2f67c00640 1 -- 172.21.15.49:0/3446616524 wait complete. 2024-01-31T05:05:28.968 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-31T05:05:29.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.108+0000 7f0dada00640 1 Processor -- start 2024-01-31T05:05:29.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.108+0000 7f0dada00640 1 -- start start 2024-01-31T05:05:29.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.108+0000 7f0dada00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0da815a000 0x7f0da80cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:29.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.108+0000 7f0dada00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0da806c2d0 0x7f0da8070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:29.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.108+0000 7f0dada00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0da8071410 0x7f0da80b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:29.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.108+0000 7f0dada00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da80b3760 con 0x7f0da815a000 2024-01-31T05:05:29.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.108+0000 7f0dada00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da806c750 con 0x7f0da806c2d0 2024-01-31T05:05:29.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.108+0000 7f0dada00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da8071880 con 0x7f0da8071410 2024-01-31T05:05:29.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.112+0000 7f0da6a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0da815a000 0x7f0da80cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:29.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.112+0000 7f0da6a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0da815a000 0x7f0da80cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45634/0 (socket says 172.21.15.49:45634) 2024-01-31T05:05:29.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.112+0000 7f0da6a00640 1 -- 172.21.15.49:0/1755013783 learned_addr learned my addr 172.21.15.49:0/1755013783 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:29.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.112+0000 7f0da6000640 1 --2- 172.21.15.49:0/1755013783 >> v2:172.21.15.195:3300/0 conn(0x7f0da806c2d0 0x7f0da8070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:29.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.112+0000 7f0da7400640 1 --2- 172.21.15.49:0/1755013783 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0da8071410 0x7f0da80b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:29.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.112+0000 7f0da6a00640 1 -- 172.21.15.49:0/1755013783 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0da8071410 msgr2=0x7f0da80b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:29.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.112+0000 7f0da6a00640 1 --2- 172.21.15.49:0/1755013783 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0da8071410 0x7f0da80b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.112+0000 7f0da6a00640 1 -- 172.21.15.49:0/1755013783 >> v2:172.21.15.195:3300/0 conn(0x7f0da806c2d0 msgr2=0x7f0da8070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:29.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.112+0000 7f0da6a00640 1 --2- 172.21.15.49:0/1755013783 >> v2:172.21.15.195:3300/0 conn(0x7f0da806c2d0 0x7f0da8070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.112+0000 7f0da6a00640 1 -- 172.21.15.49:0/1755013783 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da8071e40 con 0x7f0da815a000 2024-01-31T05:05:29.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.112+0000 7f0da6000640 1 --2- 172.21.15.49:0/1755013783 >> v2:172.21.15.195:3300/0 conn(0x7f0da806c2d0 0x7f0da8070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:29.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.112+0000 7f0da6a00640 1 --2- 172.21.15.49:0/1755013783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da815a000 0x7f0da80cb040 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0da8072e80 tx=0x7f0d9801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699e3333fbf01d9d server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:29.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.112+0000 7f0da5600640 1 -- 172.21.15.49:0/1755013783 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d980ac410 con 0x7f0da815a000 2024-01-31T05:05:29.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.112+0000 7f0da5600640 1 -- 172.21.15.49:0/1755013783 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d980ac570 con 0x7f0da815a000 2024-01-31T05:05:29.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.112+0000 7f0da5600640 1 -- 172.21.15.49:0/1755013783 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d980ac900 con 0x7f0da815a000 2024-01-31T05:05:29.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0dada00640 1 -- 172.21.15.49:0/1755013783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da815a000 msgr2=0x7f0da80cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:29.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0dada00640 1 --2- 172.21.15.49:0/1755013783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da815a000 0x7f0da80cb040 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0da8072e80 tx=0x7f0d9801c500 comp rx=0 tx=0).stop 2024-01-31T05:05:29.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0dada00640 1 -- 172.21.15.49:0/1755013783 shutdown_connections 2024-01-31T05:05:29.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0dada00640 1 --2- 172.21.15.49:0/1755013783 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0da8071410 0x7f0da80b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0dada00640 1 --2- 172.21.15.49:0/1755013783 >> v2:172.21.15.195:3300/0 conn(0x7f0da806c2d0 0x7f0da8070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0dada00640 1 --2- 172.21.15.49:0/1755013783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da815a000 0x7f0da80cb040 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0dada00640 1 -- 172.21.15.49:0/1755013783 >> 172.21.15.49:0/1755013783 conn(0x7f0da80b09a0 msgr2=0x7f0da80b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:29.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0dada00640 1 -- 172.21.15.49:0/1755013783 shutdown_connections 2024-01-31T05:05:29.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0dada00640 1 -- 172.21.15.49:0/1755013783 wait complete. 2024-01-31T05:05:29.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0dada00640 1 Processor -- start 2024-01-31T05:05:29.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0dada00640 1 -- start start 2024-01-31T05:05:29.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0dada00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0da806c2d0 0x7f0da8163a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:29.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0dada00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8071410 0x7f0da8154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0dada00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0da815a000 0x7f0da80ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0dada00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da81553f0 con 0x7f0da8071410 2024-01-31T05:05:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0dada00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da8162a20 con 0x7f0da806c2d0 2024-01-31T05:05:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0dada00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da8162cc0 con 0x7f0da815a000 2024-01-31T05:05:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0da6000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8071410 0x7f0da8154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:29.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0da6000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8071410 0x7f0da8154eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45652/0 (socket says 172.21.15.49:45652) 2024-01-31T05:05:29.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.116+0000 7f0da6000640 1 -- 172.21.15.49:0/964710828 learned_addr learned my addr 172.21.15.49:0/964710828 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:29.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.120+0000 7f0da6a00640 1 --2- 172.21.15.49:0/964710828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0da806c2d0 0x7f0da8163a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:29.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.120+0000 7f0da7400640 1 --2- 172.21.15.49:0/964710828 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0da815a000 0x7f0da80ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:29.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.120+0000 7f0da6000640 1 -- 172.21.15.49:0/964710828 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0da815a000 msgr2=0x7f0da80ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:29.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.120+0000 7f0da6000640 1 --2- 172.21.15.49:0/964710828 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0da815a000 0x7f0da80ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.120+0000 7f0da6000640 1 -- 172.21.15.49:0/964710828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0da806c2d0 msgr2=0x7f0da8163a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:29.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.120+0000 7f0da6000640 1 --2- 172.21.15.49:0/964710828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0da806c2d0 0x7f0da8163a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.120+0000 7f0da6000640 1 -- 172.21.15.49:0/964710828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d980094d0 con 0x7f0da8071410 2024-01-31T05:05:29.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.120+0000 7f0da6000640 1 --2- 172.21.15.49:0/964710828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8071410 0x7f0da8154eb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000e810 tx=0x7f0d9000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:29.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.120+0000 7f0d9ea00640 1 -- 172.21.15.49:0/964710828 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90004030 con 0x7f0da8071410 2024-01-31T05:05:29.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.120+0000 7f0d9ea00640 1 -- 172.21.15.49:0/964710828 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d90004190 con 0x7f0da8071410 2024-01-31T05:05:29.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.120+0000 7f0d9ea00640 1 -- 172.21.15.49:0/964710828 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90004520 con 0x7f0da8071410 2024-01-31T05:05:29.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.120+0000 7f0dada00640 1 -- 172.21.15.49:0/964710828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da8162fa0 con 0x7f0da8071410 2024-01-31T05:05:29.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.120+0000 7f0dada00640 1 -- 172.21.15.49:0/964710828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da8163560 con 0x7f0da8071410 2024-01-31T05:05:29.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.120+0000 7f0dada00640 1 -- 172.21.15.49:0/964710828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da80ac3b0 con 0x7f0da8071410 2024-01-31T05:05:29.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.120+0000 7f0d9ea00640 1 -- 172.21.15.49:0/964710828 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f0d9000c6d0 con 0x7f0da8071410 2024-01-31T05:05:29.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.120+0000 7f0d9ea00640 1 --2- 172.21.15.49:0/964710828 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0d80066500 0x7f0d800689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:29.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.120+0000 7f0d9ea00640 1 -- 172.21.15.49:0/964710828 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0d90083e70 con 0x7f0da8071410 2024-01-31T05:05:29.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.124+0000 7f0da6a00640 1 --2- 172.21.15.49:0/964710828 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0d80066500 0x7f0d800689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:29.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.124+0000 7f0da6a00640 1 --2- 172.21.15.49:0/964710828 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0d80066500 0x7f0d800689c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0d980ae000 tx=0x7f0d98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:29.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.124+0000 7f0d9ea00640 1 -- 172.21.15.49:0/964710828 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f0d90050d60 con 0x7f0da8071410 2024-01-31T05:05:29.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.292+0000 7f0dada00640 1 -- 172.21.15.49:0/964710828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0da8074860 con 0x7f0da8071410 2024-01-31T05:05:29.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.296+0000 7f0d9ea00640 1 -- 172.21.15.49:0/964710828 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0d90020080 con 0x7f0da8071410 2024-01-31T05:05:29.296 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2024-01-31T05:05:29.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.296+0000 7f0dada00640 1 -- 172.21.15.49:0/964710828 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0d80066500 msgr2=0x7f0d800689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:29.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.296+0000 7f0dada00640 1 --2- 172.21.15.49:0/964710828 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0d80066500 0x7f0d800689c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0d980ae000 tx=0x7f0d98008040 comp rx=0 tx=0).stop 2024-01-31T05:05:29.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.296+0000 7f0dada00640 1 -- 172.21.15.49:0/964710828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8071410 msgr2=0x7f0da8154eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:29.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.296+0000 7f0dada00640 1 --2- 172.21.15.49:0/964710828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8071410 0x7f0da8154eb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000e810 tx=0x7f0d9000ecd0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.296+0000 7f0dada00640 1 -- 172.21.15.49:0/964710828 shutdown_connections 2024-01-31T05:05:29.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.296+0000 7f0dada00640 1 --2- 172.21.15.49:0/964710828 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0da815a000 0x7f0da80ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.296+0000 7f0dada00640 1 --2- 172.21.15.49:0/964710828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0da8071410 0x7f0da8154eb0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.296+0000 7f0dada00640 1 --2- 172.21.15.49:0/964710828 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0d80066500 0x7f0d800689c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.296+0000 7f0dada00640 1 --2- 172.21.15.49:0/964710828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0da806c2d0 0x7f0da8163a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.296+0000 7f0dada00640 1 -- 172.21.15.49:0/964710828 >> 172.21.15.49:0/964710828 conn(0x7f0da80b09a0 msgr2=0x7f0da80cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:29.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.296+0000 7f0dada00640 1 -- 172.21.15.49:0/964710828 shutdown_connections 2024-01-31T05:05:29.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.296+0000 7f0dada00640 1 -- 172.21.15.49:0/964710828 wait complete. 2024-01-31T05:05:29.318 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi195.front.sepia.ceph.com... 2024-01-31T05:05:29.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:29.319 DEBUG:teuthology.orchestra.run.smithi195:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-01-31T05:05:29.342 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T05:05:29.343 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-01-31T05:05:29.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:29.343 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-01-31T05:05:29.393 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-31T05:05:29.393 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:05:29.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.532+0000 7f306a200640 1 Processor -- start 2024-01-31T05:05:29.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.532+0000 7f306a200640 1 -- start start 2024-01-31T05:05:29.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.536+0000 7f306a200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30640715e0 0x7f30640cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:29.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.536+0000 7f306a200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f306406c2d0 0x7f30640ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:29.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.536+0000 7f306a200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306406c740 con 0x7f306415a000 2024-01-31T05:05:29.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.536+0000 7f306a200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30640b3760 con 0x7f306406c2d0 2024-01-31T05:05:29.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.536+0000 7f306a200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3064071e40 con 0x7f30640715e0 2024-01-31T05:05:29.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.536+0000 7f3063e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f306406c2d0 0x7f30640ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.536+0000 7f3063e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f306406c2d0 0x7f30640ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45656/0 (socket says 172.21.15.49:45656) 2024-01-31T05:05:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.536+0000 7f3063e00640 1 -- 172.21.15.49:0/2133007723 learned_addr learned my addr 172.21.15.49:0/2133007723 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.536+0000 7f3062a00640 1 --2- 172.21.15.49:0/2133007723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30640715e0 0x7f30640cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.536+0000 7f3063e00640 1 -- 172.21.15.49:0/2133007723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30640715e0 msgr2=0x7f30640cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.536+0000 7f3063e00640 1 --2- 172.21.15.49:0/2133007723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30640715e0 0x7f30640cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.536+0000 7f3063e00640 1 -- 172.21.15.49:0/2133007723 >> v1:172.21.15.195:6789/0 conn(0x7f306415a000 legacy=0x7f3064070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:29.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.536+0000 7f3063e00640 1 -- 172.21.15.49:0/2133007723 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306406c990 con 0x7f306406c2d0 2024-01-31T05:05:29.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.540+0000 7f3063e00640 1 --2- 172.21.15.49:0/2133007723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306406c2d0 0x7f30640ac8d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f305c00d150 tx=0x7f305c01ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c682a8c842d73 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:29.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.540+0000 7f3062000640 1 -- 172.21.15.49:0/2133007723 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0a7d00 con 0x7f306406c2d0 2024-01-31T05:05:29.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.540+0000 7f3062000640 1 -- 172.21.15.49:0/2133007723 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c0a7e60 con 0x7f306406c2d0 2024-01-31T05:05:29.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.540+0000 7f3062000640 1 -- 172.21.15.49:0/2133007723 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c00b2f0 con 0x7f306406c2d0 2024-01-31T05:05:29.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.540+0000 7f306a200640 1 -- 172.21.15.49:0/2133007723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306406c2d0 msgr2=0x7f30640ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:29.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.540+0000 7f306a200640 1 --2- 172.21.15.49:0/2133007723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306406c2d0 0x7f30640ac8d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f305c00d150 tx=0x7f305c01ec10 comp rx=0 tx=0).stop 2024-01-31T05:05:29.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.540+0000 7f306a200640 1 -- 172.21.15.49:0/2133007723 shutdown_connections 2024-01-31T05:05:29.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.540+0000 7f306a200640 1 --2- 172.21.15.49:0/2133007723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306406c2d0 0x7f30640ac8d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.540+0000 7f306a200640 1 --2- 172.21.15.49:0/2133007723 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f30640715e0 0x7f30640cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.540+0000 7f306a200640 1 -- 172.21.15.49:0/2133007723 >> 172.21.15.49:0/2133007723 conn(0x7f30640b09a0 msgr2=0x7f30640b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:29.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.540+0000 7f306a200640 1 -- 172.21.15.49:0/2133007723 shutdown_connections 2024-01-31T05:05:29.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.540+0000 7f306a200640 1 -- 172.21.15.49:0/2133007723 wait complete. 2024-01-31T05:05:29.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.540+0000 7f306a200640 1 Processor -- start 2024-01-31T05:05:29.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.540+0000 7f306a200640 1 -- start start 2024-01-31T05:05:29.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f306a200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f306406c2d0 0x7f3064153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:29.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f306a200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30640715e0 0x7f306415c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:29.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f306a200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306415a000 0x7f30641474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:29.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f306a200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306409b350 con 0x7f306415a000 2024-01-31T05:05:29.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f306a200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306409a740 con 0x7f30640715e0 2024-01-31T05:05:29.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f306a200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306409aa20 con 0x7f306406c2d0 2024-01-31T05:05:29.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f3063e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306415a000 0x7f30641474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:29.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f3063e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306415a000 0x7f30641474a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45664/0 (socket says 172.21.15.49:45664) 2024-01-31T05:05:29.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f3063e00640 1 -- 172.21.15.49:0/2680654995 learned_addr learned my addr 172.21.15.49:0/2680654995 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:29.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f3063400640 1 --2- 172.21.15.49:0/2680654995 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f306406c2d0 0x7f3064153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:29.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f3062a00640 1 --2- 172.21.15.49:0/2680654995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30640715e0 0x7f306415c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:29.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f3063e00640 1 -- 172.21.15.49:0/2680654995 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f306406c2d0 msgr2=0x7f3064153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:29.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f3063e00640 1 --2- 172.21.15.49:0/2680654995 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f306406c2d0 0x7f3064153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f3063e00640 1 -- 172.21.15.49:0/2680654995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30640715e0 msgr2=0x7f306415c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:29.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f3063e00640 1 --2- 172.21.15.49:0/2680654995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30640715e0 0x7f306415c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f3063e00640 1 -- 172.21.15.49:0/2680654995 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c00bd40 con 0x7f306415a000 2024-01-31T05:05:29.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f3063e00640 1 --2- 172.21.15.49:0/2680654995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306415a000 0x7f30641474a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f305c01d2c0 tx=0x7f305c01b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:29.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f305b400640 1 -- 172.21.15.49:0/2680654995 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c009dc0 con 0x7f306415a000 2024-01-31T05:05:29.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f305b400640 1 -- 172.21.15.49:0/2680654995 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c0ba440 con 0x7f306415a000 2024-01-31T05:05:29.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f306a200640 1 -- 172.21.15.49:0/2680654995 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306409ad00 con 0x7f306415a000 2024-01-31T05:05:29.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f305b400640 1 -- 172.21.15.49:0/2680654995 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0ba7f0 con 0x7f306415a000 2024-01-31T05:05:29.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f306a200640 1 -- 172.21.15.49:0/2680654995 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306409a410 con 0x7f306415a000 2024-01-31T05:05:29.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.544+0000 7f306a200640 1 -- 172.21.15.49:0/2680654995 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306409b4c0 con 0x7f306415a000 2024-01-31T05:05:29.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.548+0000 7f305b400640 1 -- 172.21.15.49:0/2680654995 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f305c0ba950 con 0x7f306415a000 2024-01-31T05:05:29.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.548+0000 7f305b400640 1 --2- 172.21.15.49:0/2680654995 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f303c066500 0x7f303c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:29.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.548+0000 7f305b400640 1 -- 172.21.15.49:0/2680654995 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f305c1216e0 con 0x7f306415a000 2024-01-31T05:05:29.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.548+0000 7f3063400640 1 --2- 172.21.15.49:0/2680654995 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f303c066500 0x7f303c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:29.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.548+0000 7f3063400640 1 --2- 172.21.15.49:0/2680654995 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f303c066500 0x7f303c0689c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3054001770 tx=0x7f3054009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:29.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.552+0000 7f305b400640 1 -- 172.21.15.49:0/2680654995 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f305c0ee5e0 con 0x7f306415a000 2024-01-31T05:05:29.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.748+0000 7f306a200640 1 -- 172.21.15.49:0/2680654995 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f306409ab60 con 0x7f306415a000 2024-01-31T05:05:29.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.752+0000 7f305b400640 1 -- 172.21.15.49:0/2680654995 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7f306409ab60 con 0x7f306415a000 2024-01-31T05:05:29.753 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:29.753 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2308601440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2308601440},{"type":"v1","addr":"172.21.15.49:6835","nonce":2308601440}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2920530340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":2920530340},{"type":"v1","addr":"172.21.15.195:6836","nonce":2920530340}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3114317228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3114317228},{"type":"v1","addr":"172.21.15.195:6837","nonce":3114317228}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-31T05:04:16.248649+0000","modified":"2024-01-31T05:04:39.667986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/4254852793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4254852793},{"type":"v1","addr":"172.21.15.49:6834","nonce":4254852793}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:05:29.753 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2024-01-31T05:05:29.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.752+0000 7f306a200640 1 -- 172.21.15.49:0/2680654995 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f303c066500 msgr2=0x7f303c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:29.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.752+0000 7f306a200640 1 --2- 172.21.15.49:0/2680654995 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f303c066500 0x7f303c0689c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3054001770 tx=0x7f3054009040 comp rx=0 tx=0).stop 2024-01-31T05:05:29.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.752+0000 7f306a200640 1 -- 172.21.15.49:0/2680654995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306415a000 msgr2=0x7f30641474a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:29.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.752+0000 7f306a200640 1 --2- 172.21.15.49:0/2680654995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306415a000 0x7f30641474a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f305c01d2c0 tx=0x7f305c01b9b0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.752+0000 7f306a200640 1 -- 172.21.15.49:0/2680654995 shutdown_connections 2024-01-31T05:05:29.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.752+0000 7f306a200640 1 --2- 172.21.15.49:0/2680654995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f306415a000 0x7f30641474a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.752+0000 7f306a200640 1 --2- 172.21.15.49:0/2680654995 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f303c066500 0x7f303c0689c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.752+0000 7f306a200640 1 --2- 172.21.15.49:0/2680654995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30640715e0 0x7f306415c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.752+0000 7f306a200640 1 --2- 172.21.15.49:0/2680654995 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f306406c2d0 0x7f3064153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.752+0000 7f306a200640 1 -- 172.21.15.49:0/2680654995 >> 172.21.15.49:0/2680654995 conn(0x7f30640b09a0 msgr2=0x7f30640aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:29.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.752+0000 7f306a200640 1 -- 172.21.15.49:0/2680654995 shutdown_connections 2024-01-31T05:05:29.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.752+0000 7f306a200640 1 -- 172.21.15.49:0/2680654995 wait complete. 2024-01-31T05:05:29.776 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:29.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.916+0000 7f2d94200640 1 Processor -- start 2024-01-31T05:05:29.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.916+0000 7f2d94200640 1 -- start start 2024-01-31T05:05:29.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.916+0000 7f2d94200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d8c15b110 0x7f2d8c06c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:29.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.916+0000 7f2d94200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d8c0714e0 0x7f2d8c0ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:29.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.916+0000 7f2d94200640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d8c15b4f0 con 0x7f2d8c0cdf10 2024-01-31T05:05:29.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.916+0000 7f2d94200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d8c0ce460 con 0x7f2d8c0714e0 2024-01-31T05:05:29.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.916+0000 7f2d94200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c0abf20 con 0x7f2d8c15b110 2024-01-31T05:05:29.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.916+0000 7f2d92200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d8c0714e0 0x7f2d8c0ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:29.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.916+0000 7f2d92200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f2d8c0714e0 0x7f2d8c0ad800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45678/0 (socket says 172.21.15.49:45678) 2024-01-31T05:05:29.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.916+0000 7f2d90e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2d8c0cdf10 0x7f2d8c070dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55858/0 (socket says 172.21.15.49:55858) 2024-01-31T05:05:29.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.916+0000 7f2d92200640 1 -- 172.21.15.49:0/2442058097 learned_addr learned my addr 172.21.15.49:0/2442058097 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:29.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.916+0000 7f2d91800640 1 --2- 172.21.15.49:0/2442058097 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d8c15b110 0x7f2d8c06c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:29.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.916+0000 7f2d92200640 1 -- 172.21.15.49:0/2442058097 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d8c15b110 msgr2=0x7f2d8c06c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:29.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.916+0000 7f2d92200640 1 --2- 172.21.15.49:0/2442058097 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d8c15b110 0x7f2d8c06c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.916+0000 7f2d92200640 1 -- 172.21.15.49:0/2442058097 >> v1:172.21.15.49:6789/0 conn(0x7f2d8c0cdf10 legacy=0x7f2d8c070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:29.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.916+0000 7f2d92200640 1 -- 172.21.15.49:0/2442058097 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c0ac200 con 0x7f2d8c0714e0 2024-01-31T05:05:29.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.916+0000 7f2d91800640 1 --2- 172.21.15.49:0/2442058097 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d8c15b110 0x7f2d8c06c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:29.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.920+0000 7f2d92200640 1 --2- 172.21.15.49:0/2442058097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d8c0714e0 0x7f2d8c0ad800 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2d84009e50 tx=0x7f2d8401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823154a160932aa0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:29.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.920+0000 7f2d8be00640 1 -- 172.21.15.49:0/2442058097 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d840a58d0 con 0x7f2d8c0714e0 2024-01-31T05:05:29.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.920+0000 7f2d8be00640 1 -- 172.21.15.49:0/2442058097 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d840a5a30 con 0x7f2d8c0714e0 2024-01-31T05:05:29.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.920+0000 7f2d8be00640 1 -- 172.21.15.49:0/2442058097 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d840a5dc0 con 0x7f2d8c0714e0 2024-01-31T05:05:29.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.920+0000 7f2d94200640 1 -- 172.21.15.49:0/2442058097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d8c0714e0 msgr2=0x7f2d8c0ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:29.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.920+0000 7f2d94200640 1 --2- 172.21.15.49:0/2442058097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d8c0714e0 0x7f2d8c0ad800 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2d84009e50 tx=0x7f2d8401c9e0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.920+0000 7f2d94200640 1 -- 172.21.15.49:0/2442058097 shutdown_connections 2024-01-31T05:05:29.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.920+0000 7f2d94200640 1 --2- 172.21.15.49:0/2442058097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d8c0714e0 0x7f2d8c0ad800 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.920+0000 7f2d94200640 1 --2- 172.21.15.49:0/2442058097 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d8c15b110 0x7f2d8c06c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.920+0000 7f2d94200640 1 -- 172.21.15.49:0/2442058097 >> 172.21.15.49:0/2442058097 conn(0x7f2d8c0b09a0 msgr2=0x7f2d8c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:29.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.920+0000 7f2d94200640 1 -- 172.21.15.49:0/2442058097 shutdown_connections 2024-01-31T05:05:29.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.920+0000 7f2d94200640 1 -- 172.21.15.49:0/2442058097 wait complete. 2024-01-31T05:05:29.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d94200640 1 Processor -- start 2024-01-31T05:05:29.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d94200640 1 -- start start 2024-01-31T05:05:29.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d94200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d8c0714e0 0x7f2d8c1515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:29.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d94200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d8c0cdf10 0x7f2d8c13c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:29.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d94200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d8c15b110 0x7f2d8c150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:29.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d94200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c13d4b0 con 0x7f2d8c0714e0 2024-01-31T05:05:29.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d94200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c13ca20 con 0x7f2d8c15b110 2024-01-31T05:05:29.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d94200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c13cc10 con 0x7f2d8c0cdf10 2024-01-31T05:05:29.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d91800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d8c0714e0 0x7f2d8c1515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:29.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d91800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d8c0714e0 0x7f2d8c1515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45680/0 (socket says 172.21.15.49:45680) 2024-01-31T05:05:29.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d91800640 1 -- 172.21.15.49:0/4109075649 learned_addr learned my addr 172.21.15.49:0/4109075649 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:29.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d90e00640 1 --2- 172.21.15.49:0/4109075649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d8c0cdf10 0x7f2d8c13c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:29.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d92200640 1 --2- 172.21.15.49:0/4109075649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d8c15b110 0x7f2d8c150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:29.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d91800640 1 -- 172.21.15.49:0/4109075649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d8c0cdf10 msgr2=0x7f2d8c13c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:29.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d91800640 1 --2- 172.21.15.49:0/4109075649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d8c0cdf10 0x7f2d8c13c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d91800640 1 -- 172.21.15.49:0/4109075649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d8c15b110 msgr2=0x7f2d8c150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:29.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d91800640 1 --2- 172.21.15.49:0/4109075649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d8c15b110 0x7f2d8c150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:29.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d91800640 1 -- 172.21.15.49:0/4109075649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d84009b30 con 0x7f2d8c0714e0 2024-01-31T05:05:29.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d92200640 1 --2- 172.21.15.49:0/4109075649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d8c15b110 0x7f2d8c150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:29.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d91800640 1 --2- 172.21.15.49:0/4109075649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d8c0714e0 0x7f2d8c1515b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c00e810 tx=0x7f2d7c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:29.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d89600640 1 -- 172.21.15.49:0/4109075649 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c00c8d0 con 0x7f2d8c0714e0 2024-01-31T05:05:29.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d89600640 1 -- 172.21.15.49:0/4109075649 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7c00ca30 con 0x7f2d8c0714e0 2024-01-31T05:05:29.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d89600640 1 -- 172.21.15.49:0/4109075649 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c00cdc0 con 0x7f2d8c0714e0 2024-01-31T05:05:29.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d94200640 1 -- 172.21.15.49:0/4109075649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8c13cef0 con 0x7f2d8c0714e0 2024-01-31T05:05:29.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.924+0000 7f2d94200640 1 -- 172.21.15.49:0/4109075649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8c13a620 con 0x7f2d8c0714e0 2024-01-31T05:05:29.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.928+0000 7f2d94200640 1 -- 172.21.15.49:0/4109075649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8c13a480 con 0x7f2d8c0714e0 2024-01-31T05:05:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.928+0000 7f2d89600640 1 -- 172.21.15.49:0/4109075649 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f2d7c013410 con 0x7f2d8c0714e0 2024-01-31T05:05:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.928+0000 7f2d89600640 1 --2- 172.21.15.49:0/4109075649 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2d64066500 0x7f2d640689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.928+0000 7f2d89600640 1 -- 172.21.15.49:0/4109075649 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2d7c083ff0 con 0x7f2d8c0714e0 2024-01-31T05:05:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.928+0000 7f2d90e00640 1 --2- 172.21.15.49:0/4109075649 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2d64066500 0x7f2d640689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.928+0000 7f2d90e00640 1 --2- 172.21.15.49:0/4109075649 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2d64066500 0x7f2d640689c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0ad940 tx=0x7f2d74007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:29.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:29.932+0000 7f2d89600640 1 -- 172.21.15.49:0/4109075649 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f2d7c0b5590 con 0x7f2d8c0714e0 2024-01-31T05:05:30.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.092+0000 7f2d94200640 1 -- 172.21.15.49:0/4109075649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d8c074860 con 0x7f2d8c0714e0 2024-01-31T05:05:30.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.092+0000 7f2d89600640 1 -- 172.21.15.49:0/4109075649 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7f2d8c13a480 con 0x7f2d8c0714e0 2024-01-31T05:05:30.096 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:30.096 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:58.277568+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:30.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.096+0000 7f2d94200640 1 -- 172.21.15.49:0/4109075649 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2d64066500 msgr2=0x7f2d640689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:30.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.096+0000 7f2d94200640 1 --2- 172.21.15.49:0/4109075649 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2d64066500 0x7f2d640689c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0ad940 tx=0x7f2d74007e90 comp rx=0 tx=0).stop 2024-01-31T05:05:30.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.096+0000 7f2d94200640 1 -- 172.21.15.49:0/4109075649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d8c0714e0 msgr2=0x7f2d8c1515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:30.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.096+0000 7f2d94200640 1 --2- 172.21.15.49:0/4109075649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d8c0714e0 0x7f2d8c1515b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c00e810 tx=0x7f2d7c00ecd0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.096+0000 7f2d94200640 1 -- 172.21.15.49:0/4109075649 shutdown_connections 2024-01-31T05:05:30.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.096+0000 7f2d94200640 1 --2- 172.21.15.49:0/4109075649 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f2d64066500 0x7f2d640689c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.096+0000 7f2d94200640 1 --2- 172.21.15.49:0/4109075649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d8c15b110 0x7f2d8c150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.096+0000 7f2d94200640 1 --2- 172.21.15.49:0/4109075649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2d8c0cdf10 0x7f2d8c13c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.096+0000 7f2d94200640 1 --2- 172.21.15.49:0/4109075649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d8c0714e0 0x7f2d8c1515b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.096+0000 7f2d94200640 1 -- 172.21.15.49:0/4109075649 >> 172.21.15.49:0/4109075649 conn(0x7f2d8c0b09a0 msgr2=0x7f2d8c157700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:30.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.096+0000 7f2d94200640 1 -- 172.21.15.49:0/4109075649 shutdown_connections 2024-01-31T05:05:30.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.096+0000 7f2d94200640 1 -- 172.21.15.49:0/4109075649 wait complete. 2024-01-31T05:05:30.117 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:04:14.566345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:04:15.231265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-31T05:04:18.316756+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-31T05:05:30.118 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:05:30.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.260+0000 7f46fe200640 1 Processor -- start 2024-01-31T05:05:30.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.260+0000 7f46fe200640 1 -- start start 2024-01-31T05:05:30.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.260+0000 7f46fe200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46f806f020 0x7f46f80cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:30.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.260+0000 7f46fe200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46f806f4b0 0x7f46f80cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:30.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.260+0000 7f46fe200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f80cb990 con 0x7f46f815d3a0 2024-01-31T05:05:30.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.260+0000 7f46fe200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f80d1c20 con 0x7f46f806f020 2024-01-31T05:05:30.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.260+0000 7f46fe200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f80cfed0 con 0x7f46f806f4b0 2024-01-31T05:05:30.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.260+0000 7f46f6a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46f806f020 0x7f46f80cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:30.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.260+0000 7f46f6a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46f806f020 0x7f46f80cbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45690/0 (socket says 172.21.15.49:45690) 2024-01-31T05:05:30.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.260+0000 7f46f6a00640 1 -- 172.21.15.49:0/3550055565 learned_addr learned my addr 172.21.15.49:0/3550055565 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:30.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.260+0000 7f46f7e00640 1 --2- 172.21.15.49:0/3550055565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46f806f4b0 0x7f46f80cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:30.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.260+0000 7f46f6a00640 1 -- 172.21.15.49:0/3550055565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46f806f4b0 msgr2=0x7f46f80cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:30.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.260+0000 7f46f6a00640 1 --2- 172.21.15.49:0/3550055565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46f806f4b0 0x7f46f80cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.260+0000 7f46f6a00640 1 -- 172.21.15.49:0/3550055565 >> v1:172.21.15.195:6789/0 conn(0x7f46f815d3a0 legacy=0x7f46f806e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:30.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.260+0000 7f46f6a00640 1 -- 172.21.15.49:0/3550055565 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f80d01b0 con 0x7f46f806f020 2024-01-31T05:05:30.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.260+0000 7f46f7e00640 1 --2- 172.21.15.49:0/3550055565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46f806f4b0 0x7f46f80cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:30.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.264+0000 7f46f6a00640 1 --2- 172.21.15.49:0/3550055565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f806f020 0x7f46f80cbe20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009870 tx=0x7f46e001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20740f62c56c7e8f server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:30.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.264+0000 7f46f6000640 1 -- 172.21.15.49:0/3550055565 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e00ab650 con 0x7f46f806f020 2024-01-31T05:05:30.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.264+0000 7f46f6000640 1 -- 172.21.15.49:0/3550055565 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e00ab7b0 con 0x7f46f806f020 2024-01-31T05:05:30.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.264+0000 7f46f6000640 1 -- 172.21.15.49:0/3550055565 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e00abb40 con 0x7f46f806f020 2024-01-31T05:05:30.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.264+0000 7f46fe200640 1 -- 172.21.15.49:0/3550055565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f806f020 msgr2=0x7f46f80cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:30.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.264+0000 7f46fe200640 1 --2- 172.21.15.49:0/3550055565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f806f020 0x7f46f80cbe20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009870 tx=0x7f46e001c500 comp rx=0 tx=0).stop 2024-01-31T05:05:30.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.264+0000 7f46fe200640 1 -- 172.21.15.49:0/3550055565 shutdown_connections 2024-01-31T05:05:30.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.264+0000 7f46fe200640 1 --2- 172.21.15.49:0/3550055565 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46f806f4b0 0x7f46f80cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.264+0000 7f46fe200640 1 --2- 172.21.15.49:0/3550055565 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f806f020 0x7f46f80cbe20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.264+0000 7f46fe200640 1 -- 172.21.15.49:0/3550055565 >> 172.21.15.49:0/3550055565 conn(0x7f46f80d0e50 msgr2=0x7f46f80d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:30.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.264+0000 7f46fe200640 1 -- 172.21.15.49:0/3550055565 shutdown_connections 2024-01-31T05:05:30.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.264+0000 7f46fe200640 1 -- 172.21.15.49:0/3550055565 wait complete. 2024-01-31T05:05:30.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46fe200640 1 Processor -- start 2024-01-31T05:05:30.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46fe200640 1 -- start start 2024-01-31T05:05:30.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46fe200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46f806f020 0x7f46f81544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46fe200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46f806f4b0 0x7f46f80af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46fe200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f815d3a0 0x7f46f80afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46fe200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f81574c0 con 0x7f46f815d3a0 2024-01-31T05:05:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46fe200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f814c3e0 con 0x7f46f806f4b0 2024-01-31T05:05:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46fe200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f8154a20 con 0x7f46f806f020 2024-01-31T05:05:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46f7e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f815d3a0 0x7f46f80afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46f7e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f815d3a0 0x7f46f80afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45694/0 (socket says 172.21.15.49:45694) 2024-01-31T05:05:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46f7e00640 1 -- 172.21.15.49:0/3582036862 learned_addr learned my addr 172.21.15.49:0/3582036862 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46f6a00640 1 --2- 172.21.15.49:0/3582036862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46f806f4b0 0x7f46f80af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46f7400640 1 --2- 172.21.15.49:0/3582036862 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46f806f020 0x7f46f81544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46f7e00640 1 -- 172.21.15.49:0/3582036862 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46f806f020 msgr2=0x7f46f81544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46f7e00640 1 --2- 172.21.15.49:0/3582036862 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46f806f020 0x7f46f81544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46f7e00640 1 -- 172.21.15.49:0/3582036862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46f806f4b0 msgr2=0x7f46f80af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:30.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46f7e00640 1 --2- 172.21.15.49:0/3582036862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46f806f4b0 0x7f46f80af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46f7e00640 1 -- 172.21.15.49:0/3582036862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e00094d0 con 0x7f46f815d3a0 2024-01-31T05:05:30.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46f7400640 1 --2- 172.21.15.49:0/3582036862 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46f806f020 0x7f46f81544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:30.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46f7e00640 1 --2- 172.21.15.49:0/3582036862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f815d3a0 0x7f46f80afa50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f46f000cf20 tx=0x7f46f000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:30.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46ef400640 1 -- 172.21.15.49:0/3582036862 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f000d840 con 0x7f46f815d3a0 2024-01-31T05:05:30.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46ef400640 1 -- 172.21.15.49:0/3582036862 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f000d9a0 con 0x7f46f815d3a0 2024-01-31T05:05:30.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46fe200640 1 -- 172.21.15.49:0/3582036862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f8157cf0 con 0x7f46f815d3a0 2024-01-31T05:05:30.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46ef400640 1 -- 172.21.15.49:0/3582036862 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f000dd50 con 0x7f46f815d3a0 2024-01-31T05:05:30.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.268+0000 7f46fe200640 1 -- 172.21.15.49:0/3582036862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f81576a0 con 0x7f46f815d3a0 2024-01-31T05:05:30.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.272+0000 7f46fe200640 1 -- 172.21.15.49:0/3582036862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f806fdb0 con 0x7f46f815d3a0 2024-01-31T05:05:30.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.272+0000 7f46ef400640 1 -- 172.21.15.49:0/3582036862 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f46f001e3b0 con 0x7f46f815d3a0 2024-01-31T05:05:30.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.272+0000 7f46ef400640 1 --2- 172.21.15.49:0/3582036862 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f46d0066500 0x7f46d00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:30.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.272+0000 7f46ef400640 1 -- 172.21.15.49:0/3582036862 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f46f0084ca0 con 0x7f46f815d3a0 2024-01-31T05:05:30.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.272+0000 7f46f7400640 1 --2- 172.21.15.49:0/3582036862 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f46d0066500 0x7f46d00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:30.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.272+0000 7f46f7400640 1 --2- 172.21.15.49:0/3582036862 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f46d0066500 0x7f46d00689c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f46e80098b0 tx=0x7f46e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:30.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.276+0000 7f46ef400640 1 -- 172.21.15.49:0/3582036862 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f46f0051c20 con 0x7f46f815d3a0 2024-01-31T05:05:30.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.440+0000 7f46fe200640 1 -- 172.21.15.49:0/3582036862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f46f8157e80 con 0x7f46f815d3a0 2024-01-31T05:05:30.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.440+0000 7f46ef400640 1 -- 172.21.15.49:0/3582036862 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f46f001a020 con 0x7f46f815d3a0 2024-01-31T05:05:30.442 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:05:30.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.440+0000 7f46fe200640 1 -- 172.21.15.49:0/3582036862 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f46d0066500 msgr2=0x7f46d00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:30.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.440+0000 7f46fe200640 1 --2- 172.21.15.49:0/3582036862 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f46d0066500 0x7f46d00689c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f46e80098b0 tx=0x7f46e8008040 comp rx=0 tx=0).stop 2024-01-31T05:05:30.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.440+0000 7f46fe200640 1 -- 172.21.15.49:0/3582036862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f815d3a0 msgr2=0x7f46f80afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:30.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.440+0000 7f46fe200640 1 --2- 172.21.15.49:0/3582036862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f815d3a0 0x7f46f80afa50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f46f000cf20 tx=0x7f46f000a7d0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.440+0000 7f46fe200640 1 -- 172.21.15.49:0/3582036862 shutdown_connections 2024-01-31T05:05:30.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.440+0000 7f46fe200640 1 --2- 172.21.15.49:0/3582036862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46f815d3a0 0x7f46f80afa50 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.440+0000 7f46fe200640 1 --2- 172.21.15.49:0/3582036862 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f46d0066500 0x7f46d00689c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.440+0000 7f46fe200640 1 --2- 172.21.15.49:0/3582036862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46f806f4b0 0x7f46f80af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.440+0000 7f46fe200640 1 --2- 172.21.15.49:0/3582036862 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46f806f020 0x7f46f81544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.440+0000 7f46fe200640 1 -- 172.21.15.49:0/3582036862 >> 172.21.15.49:0/3582036862 conn(0x7f46f80d0e50 msgr2=0x7f46f814ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:30.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.440+0000 7f46fe200640 1 -- 172.21.15.49:0/3582036862 shutdown_connections 2024-01-31T05:05:30.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.440+0000 7f46fe200640 1 -- 172.21.15.49:0/3582036862 wait complete. 2024-01-31T05:05:30.463 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:05:30.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.604+0000 7fa67ec00640 1 Processor -- start 2024-01-31T05:05:30.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.604+0000 7fa67ec00640 1 -- start start 2024-01-31T05:05:30.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.608+0000 7fa67ec00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6780cff70 0x7fa6780cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:30.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.608+0000 7fa67ec00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa6780cb9f0 0x7fa6780cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:30.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.608+0000 7fa67ec00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6780cef80 con 0x7fa67815d540 2024-01-31T05:05:30.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.608+0000 7fa67ec00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6780d03d0 con 0x7fa6780cb9f0 2024-01-31T05:05:30.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.608+0000 7fa67ec00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67806cae0 con 0x7fa6780cff70 2024-01-31T05:05:30.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.608+0000 7fa677e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fa67815d540 0x7fa67806c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55874/0 (socket says 172.21.15.49:55874) 2024-01-31T05:05:30.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.608+0000 7fa677e00640 1 -- 172.21.15.49:0/1142342588 learned_addr learned my addr 172.21.15.49:0/1142342588 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:30.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.608+0000 7fa67cc00640 1 --2- 172.21.15.49:0/1142342588 >> v2:172.21.15.49:3300/0 conn(0x7fa6780cb9f0 0x7fa6780cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:30.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.608+0000 7fa677400640 1 --2- 172.21.15.49:0/1142342588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6780cff70 0x7fa6780cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:30.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.608+0000 7fa676a00640 1 -- 172.21.15.49:0/1142342588 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4004412739 0 0) 0x7fa6780cef80 con 0x7fa67815d540 2024-01-31T05:05:30.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.608+0000 7fa676a00640 1 -- 172.21.15.49:0/1142342588 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa658003530 con 0x7fa67815d540 2024-01-31T05:05:30.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.608+0000 7fa67cc00640 1 -- 172.21.15.49:0/1142342588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6780cff70 msgr2=0x7fa6780cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:30.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.608+0000 7fa67cc00640 1 --2- 172.21.15.49:0/1142342588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6780cff70 0x7fa6780cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.608+0000 7fa67cc00640 1 -- 172.21.15.49:0/1142342588 >> v1:172.21.15.49:6789/0 conn(0x7fa67815d540 legacy=0x7fa67806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:30.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.608+0000 7fa67cc00640 1 -- 172.21.15.49:0/1142342588 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6780cf1b0 con 0x7fa6780cb9f0 2024-01-31T05:05:30.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.608+0000 7fa67cc00640 1 --2- 172.21.15.49:0/1142342588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6780cb9f0 0x7fa6780cbe80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa670009d90 tx=0x7fa67001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1544062df5008b4 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:30.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.612+0000 7fa676a00640 1 -- 172.21.15.49:0/1142342588 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6700a59e0 con 0x7fa6780cb9f0 2024-01-31T05:05:30.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.612+0000 7fa676a00640 1 -- 172.21.15.49:0/1142342588 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6700a5b40 con 0x7fa6780cb9f0 2024-01-31T05:05:30.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.612+0000 7fa676a00640 1 -- 172.21.15.49:0/1142342588 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6700ad440 con 0x7fa6780cb9f0 2024-01-31T05:05:30.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.612+0000 7fa67ec00640 1 -- 172.21.15.49:0/1142342588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6780cb9f0 msgr2=0x7fa6780cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:30.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.612+0000 7fa67ec00640 1 --2- 172.21.15.49:0/1142342588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6780cb9f0 0x7fa6780cbe80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa670009d90 tx=0x7fa67001c920 comp rx=0 tx=0).stop 2024-01-31T05:05:30.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.612+0000 7fa67ec00640 1 -- 172.21.15.49:0/1142342588 shutdown_connections 2024-01-31T05:05:30.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.612+0000 7fa67ec00640 1 --2- 172.21.15.49:0/1142342588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6780cb9f0 0x7fa6780cbe80 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.612+0000 7fa67ec00640 1 --2- 172.21.15.49:0/1142342588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa6780cff70 0x7fa6780cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.612+0000 7fa67ec00640 1 -- 172.21.15.49:0/1142342588 >> 172.21.15.49:0/1142342588 conn(0x7fa6780d0e60 msgr2=0x7fa6780d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:30.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.612+0000 7fa67ec00640 1 -- 172.21.15.49:0/1142342588 shutdown_connections 2024-01-31T05:05:30.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.612+0000 7fa67ec00640 1 -- 172.21.15.49:0/1142342588 wait complete. 2024-01-31T05:05:30.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.612+0000 7fa67ec00640 1 Processor -- start 2024-01-31T05:05:30.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.612+0000 7fa67ec00640 1 -- start start 2024-01-31T05:05:30.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.612+0000 7fa67ec00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6780cb9f0 0x7fa6780b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:30.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.612+0000 7fa67ec00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6780cff70 0x7fa6781575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:30.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.612+0000 7fa67ec00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa67815d540 0x7fa6780c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:30.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.612+0000 7fa67ec00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa678158580 con 0x7fa6780cb9f0 2024-01-31T05:05:30.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.612+0000 7fa67ec00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67809eb20 con 0x7fa6780cff70 2024-01-31T05:05:30.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.612+0000 7fa67ec00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa678157fc0 con 0x7fa67815d540 2024-01-31T05:05:30.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.616+0000 7fa677e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6780cb9f0 0x7fa6780b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:30.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.616+0000 7fa677e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6780cb9f0 0x7fa6780b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45708/0 (socket says 172.21.15.49:45708) 2024-01-31T05:05:30.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.616+0000 7fa677e00640 1 -- 172.21.15.49:0/4141998318 learned_addr learned my addr 172.21.15.49:0/4141998318 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:30.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.616+0000 7fa677400640 1 --2- 172.21.15.49:0/4141998318 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6780cff70 0x7fa6781575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:30.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.616+0000 7fa67cc00640 1 --2- 172.21.15.49:0/4141998318 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa67815d540 0x7fa6780c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:30.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.616+0000 7fa677e00640 1 -- 172.21.15.49:0/4141998318 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa67815d540 msgr2=0x7fa6780c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:30.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.616+0000 7fa677e00640 1 --2- 172.21.15.49:0/4141998318 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa67815d540 0x7fa6780c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.616+0000 7fa677e00640 1 -- 172.21.15.49:0/4141998318 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6780cff70 msgr2=0x7fa6781575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:30.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.616+0000 7fa677e00640 1 --2- 172.21.15.49:0/4141998318 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6780cff70 0x7fa6781575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.616+0000 7fa677e00640 1 -- 172.21.15.49:0/4141998318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa670009a70 con 0x7fa6780cb9f0 2024-01-31T05:05:30.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.616+0000 7fa677e00640 1 --2- 172.21.15.49:0/4141998318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6780cb9f0 0x7fa6780b4a20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa66800c3c0 tx=0x7fa66800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:30.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.616+0000 7fa66fe00640 1 -- 172.21.15.49:0/4141998318 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa668005cf0 con 0x7fa6780cb9f0 2024-01-31T05:05:30.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.616+0000 7fa66fe00640 1 -- 172.21.15.49:0/4141998318 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa668005e50 con 0x7fa6780cb9f0 2024-01-31T05:05:30.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.616+0000 7fa66fe00640 1 -- 172.21.15.49:0/4141998318 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6680072f0 con 0x7fa6780cb9f0 2024-01-31T05:05:30.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.616+0000 7fa67ec00640 1 -- 172.21.15.49:0/4141998318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6781582a0 con 0x7fa6780cb9f0 2024-01-31T05:05:30.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.616+0000 7fa67ec00640 1 -- 172.21.15.49:0/4141998318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa678157b20 con 0x7fa6780cb9f0 2024-01-31T05:05:30.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.616+0000 7fa67ec00640 1 -- 172.21.15.49:0/4141998318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6780ce880 con 0x7fa6780cb9f0 2024-01-31T05:05:30.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.616+0000 7fa66fe00640 1 -- 172.21.15.49:0/4141998318 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa668007450 con 0x7fa6780cb9f0 2024-01-31T05:05:30.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.620+0000 7fa66fe00640 1 --2- 172.21.15.49:0/4141998318 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa650066500 0x7fa6500689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:30.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.620+0000 7fa66fe00640 1 -- 172.21.15.49:0/4141998318 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa668083740 con 0x7fa6780cb9f0 2024-01-31T05:05:30.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.620+0000 7fa677400640 1 --2- 172.21.15.49:0/4141998318 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa650066500 0x7fa6500689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:30.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.620+0000 7fa677400640 1 --2- 172.21.15.49:0/4141998318 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa650066500 0x7fa6500689c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa678067ab0 tx=0x7fa660008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:30.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.624+0000 7fa66fe00640 1 -- 172.21.15.49:0/4141998318 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa668050760 con 0x7fa6780cb9f0 2024-01-31T05:05:30.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.784+0000 7fa67ec00640 1 -- 172.21.15.49:0/4141998318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa678157e20 con 0x7fa6780cb9f0 2024-01-31T05:05:30.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.784+0000 7fa66fe00640 1 -- 172.21.15.49:0/4141998318 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa668017020 con 0x7fa6780cb9f0 2024-01-31T05:05:30.786 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:30.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.784+0000 7fa67ec00640 1 -- 172.21.15.49:0/4141998318 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa650066500 msgr2=0x7fa6500689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:30.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.784+0000 7fa67ec00640 1 --2- 172.21.15.49:0/4141998318 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa650066500 0x7fa6500689c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa678067ab0 tx=0x7fa660008040 comp rx=0 tx=0).stop 2024-01-31T05:05:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.784+0000 7fa67ec00640 1 -- 172.21.15.49:0/4141998318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6780cb9f0 msgr2=0x7fa6780b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.784+0000 7fa67ec00640 1 --2- 172.21.15.49:0/4141998318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6780cb9f0 0x7fa6780b4a20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa66800c3c0 tx=0x7fa66800c880 comp rx=0 tx=0).stop 2024-01-31T05:05:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.788+0000 7fa67ec00640 1 -- 172.21.15.49:0/4141998318 shutdown_connections 2024-01-31T05:05:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.788+0000 7fa67ec00640 1 --2- 172.21.15.49:0/4141998318 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa67815d540 0x7fa6780c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.788+0000 7fa67ec00640 1 --2- 172.21.15.49:0/4141998318 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa650066500 0x7fa6500689c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.788+0000 7fa67ec00640 1 --2- 172.21.15.49:0/4141998318 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6780cff70 0x7fa6781575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.788+0000 7fa67ec00640 1 --2- 172.21.15.49:0/4141998318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6780cb9f0 0x7fa6780b4a20 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.788+0000 7fa67ec00640 1 -- 172.21.15.49:0/4141998318 >> 172.21.15.49:0/4141998318 conn(0x7fa6780d0e60 msgr2=0x7fa67806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.788+0000 7fa67ec00640 1 -- 172.21.15.49:0/4141998318 shutdown_connections 2024-01-31T05:05:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.788+0000 7fa67ec00640 1 -- 172.21.15.49:0/4141998318 wait complete. 2024-01-31T05:05:30.807 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:05:30.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.948+0000 7f9245000640 1 Processor -- start 2024-01-31T05:05:30.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.948+0000 7f9245000640 1 -- start start 2024-01-31T05:05:30.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.952+0000 7f9245000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9240072050 0x7f924006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:30.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.952+0000 7f9245000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f924006d920 0x7f9240160f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:30.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.952+0000 7f9245000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f924006f010 con 0x7f924015d510 2024-01-31T05:05:30.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.952+0000 7f9245000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9240071570 con 0x7f9240072050 2024-01-31T05:05:30.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.952+0000 7f9245000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9240071850 con 0x7f924006d920 2024-01-31T05:05:30.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.952+0000 7f923e800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f924006d920 0x7f9240160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:30.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.952+0000 7f923d400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9240072050 0x7f924006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:30.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.952+0000 7f923e800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f924006d920 0x7f9240160f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:57084/0 (socket says 172.21.15.49:57084) 2024-01-31T05:05:30.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.952+0000 7f923de00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f924015d510 0x7f92400b4b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:45104/0 (socket says 172.21.15.49:45104) 2024-01-31T05:05:30.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.952+0000 7f923e800640 1 -- 172.21.15.49:0/3520227418 learned_addr learned my addr 172.21.15.49:0/3520227418 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:30.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.952+0000 7f923d400640 1 -- 172.21.15.49:0/3520227418 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f924006d920 msgr2=0x7f9240160f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:30.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.952+0000 7f923d400640 1 --2- 172.21.15.49:0/3520227418 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f924006d920 0x7f9240160f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.952+0000 7f923d400640 1 -- 172.21.15.49:0/3520227418 >> v1:172.21.15.195:6789/0 conn(0x7f924015d510 legacy=0x7f92400b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:30.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.952+0000 7f923d400640 1 -- 172.21.15.49:0/3520227418 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9240071b30 con 0x7f9240072050 2024-01-31T05:05:30.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.956+0000 7f923d400640 1 --2- 172.21.15.49:0/3520227418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9240072050 0x7f924006d3e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f92280097c0 tx=0x7f922801c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e0f44c8a09d2e00 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:30.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.956+0000 7f923ca00640 1 -- 172.21.15.49:0/3520227418 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92280ac410 con 0x7f9240072050 2024-01-31T05:05:30.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.956+0000 7f923ca00640 1 -- 172.21.15.49:0/3520227418 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92280ac570 con 0x7f9240072050 2024-01-31T05:05:30.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.956+0000 7f923ca00640 1 -- 172.21.15.49:0/3520227418 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92280ac900 con 0x7f9240072050 2024-01-31T05:05:30.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.956+0000 7f9245000640 1 -- 172.21.15.49:0/3520227418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9240072050 msgr2=0x7f924006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:30.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.956+0000 7f9245000640 1 --2- 172.21.15.49:0/3520227418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9240072050 0x7f924006d3e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f92280097c0 tx=0x7f922801c390 comp rx=0 tx=0).stop 2024-01-31T05:05:30.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.956+0000 7f9245000640 1 -- 172.21.15.49:0/3520227418 shutdown_connections 2024-01-31T05:05:30.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.956+0000 7f9245000640 1 --2- 172.21.15.49:0/3520227418 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f924006d920 0x7f9240160f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.956+0000 7f9245000640 1 --2- 172.21.15.49:0/3520227418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9240072050 0x7f924006d3e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.956+0000 7f9245000640 1 -- 172.21.15.49:0/3520227418 >> 172.21.15.49:0/3520227418 conn(0x7f92400b1ab0 msgr2=0x7f92400b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:30.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.956+0000 7f9245000640 1 -- 172.21.15.49:0/3520227418 shutdown_connections 2024-01-31T05:05:30.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.956+0000 7f9245000640 1 -- 172.21.15.49:0/3520227418 wait complete. 2024-01-31T05:05:30.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.956+0000 7f9245000640 1 Processor -- start 2024-01-31T05:05:30.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.956+0000 7f9245000640 1 -- start start 2024-01-31T05:05:30.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f9245000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f924006d920 0x7f9240158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:30.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f9245000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9240072050 0x7f924015c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:30.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f9245000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f924015d510 0x7f924015cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:30.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f9245000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92400ce2e0 con 0x7f924015d510 2024-01-31T05:05:30.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f9245000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92400ce5c0 con 0x7f924006d920 2024-01-31T05:05:30.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f9245000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92400ce8a0 con 0x7f9240072050 2024-01-31T05:05:30.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f923e800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f924015d510 0x7f924015cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:30.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f923e800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f924015d510 0x7f924015cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45710/0 (socket says 172.21.15.49:45710) 2024-01-31T05:05:30.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f923e800640 1 -- 172.21.15.49:0/2385562166 learned_addr learned my addr 172.21.15.49:0/2385562166 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:30.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f923d400640 1 --2- 172.21.15.49:0/2385562166 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9240072050 0x7f924015c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:30.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f923de00640 1 --2- 172.21.15.49:0/2385562166 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f924006d920 0x7f9240158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:30.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f923e800640 1 -- 172.21.15.49:0/2385562166 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9240072050 msgr2=0x7f924015c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:30.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f923e800640 1 --2- 172.21.15.49:0/2385562166 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9240072050 0x7f924015c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f923e800640 1 -- 172.21.15.49:0/2385562166 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f924006d920 msgr2=0x7f9240158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:30.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f923e800640 1 --2- 172.21.15.49:0/2385562166 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f924006d920 0x7f9240158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:30.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f923e800640 1 -- 172.21.15.49:0/2385562166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9228009420 con 0x7f924015d510 2024-01-31T05:05:30.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f923e800640 1 --2- 172.21.15.49:0/2385562166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f924015d510 0x7f924015cb40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f923800efc0 tx=0x7f923800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:30.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f9236000640 1 -- 172.21.15.49:0/2385562166 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9238009b60 con 0x7f924015d510 2024-01-31T05:05:30.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f9236000640 1 -- 172.21.15.49:0/2385562166 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923800f040 con 0x7f924015d510 2024-01-31T05:05:30.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f9245000640 1 -- 172.21.15.49:0/2385562166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92400ceb80 con 0x7f924015d510 2024-01-31T05:05:30.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f9236000640 1 -- 172.21.15.49:0/2385562166 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92380039a0 con 0x7f924015d510 2024-01-31T05:05:30.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f9245000640 1 -- 172.21.15.49:0/2385562166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92400cdeb0 con 0x7f924015d510 2024-01-31T05:05:30.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f9245000640 1 -- 172.21.15.49:0/2385562166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924006c770 con 0x7f924015d510 2024-01-31T05:05:30.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.960+0000 7f9236000640 1 -- 172.21.15.49:0/2385562166 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f9238003b00 con 0x7f924015d510 2024-01-31T05:05:30.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.964+0000 7f9236000640 1 --2- 172.21.15.49:0/2385562166 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9218066530 0x7f92180689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:30.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.964+0000 7f9236000640 1 -- 172.21.15.49:0/2385562166 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9238084750 con 0x7f924015d510 2024-01-31T05:05:30.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.964+0000 7f923de00640 1 --2- 172.21.15.49:0/2385562166 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9218066530 0x7f92180689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:30.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.964+0000 7f923de00640 1 --2- 172.21.15.49:0/2385562166 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9218066530 0x7f92180689f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9230000f70 tx=0x7f9230007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:30.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:30.968+0000 7f9236000640 1 -- 172.21.15.49:0/2385562166 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9238051640 con 0x7f924015d510 2024-01-31T05:05:31.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.128+0000 7f9245000640 1 -- 172.21.15.49:0/2385562166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9240074860 con 0x7f924015d510 2024-01-31T05:05:31.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.128+0000 7f9236000640 1 -- 172.21.15.49:0/2385562166 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9238054c60 con 0x7f924015d510 2024-01-31T05:05:31.130 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-31T05:05:31.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.128+0000 7f9245000640 1 -- 172.21.15.49:0/2385562166 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9218066530 msgr2=0x7f92180689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:31.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.128+0000 7f9245000640 1 --2- 172.21.15.49:0/2385562166 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9218066530 0x7f92180689f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9230000f70 tx=0x7f9230007e90 comp rx=0 tx=0).stop 2024-01-31T05:05:31.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.128+0000 7f9245000640 1 -- 172.21.15.49:0/2385562166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f924015d510 msgr2=0x7f924015cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:31.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.128+0000 7f9245000640 1 --2- 172.21.15.49:0/2385562166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f924015d510 0x7f924015cb40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f923800efc0 tx=0x7f923800c490 comp rx=0 tx=0).stop 2024-01-31T05:05:31.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.132+0000 7f9245000640 1 -- 172.21.15.49:0/2385562166 shutdown_connections 2024-01-31T05:05:31.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.132+0000 7f9245000640 1 --2- 172.21.15.49:0/2385562166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f924015d510 0x7f924015cb40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.132+0000 7f9245000640 1 --2- 172.21.15.49:0/2385562166 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9240072050 0x7f924015c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.132+0000 7f9245000640 1 --2- 172.21.15.49:0/2385562166 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9218066530 0x7f92180689f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.132+0000 7f9245000640 1 --2- 172.21.15.49:0/2385562166 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f924006d920 0x7f9240158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.132+0000 7f9245000640 1 -- 172.21.15.49:0/2385562166 >> 172.21.15.49:0/2385562166 conn(0x7f92400b1ab0 msgr2=0x7f9240073bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:31.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.132+0000 7f9245000640 1 -- 172.21.15.49:0/2385562166 shutdown_connections 2024-01-31T05:05:31.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.132+0000 7f9245000640 1 -- 172.21.15.49:0/2385562166 wait complete. 2024-01-31T05:05:31.152 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-31T05:05:31.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.292+0000 7f463f000640 1 Processor -- start 2024-01-31T05:05:31.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.292+0000 7f463f000640 1 -- start start 2024-01-31T05:05:31.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.296+0000 7f463f000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f463815b0e0 0x7f463815f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:31.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.296+0000 7f463f000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f463815b4c0 0x7f463815b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:31.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.296+0000 7f463f000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f463815ee00 con 0x7f46380720a0 2024-01-31T05:05:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.296+0000 7f463f000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463815f1c0 con 0x7f463815b0e0 2024-01-31T05:05:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.296+0000 7f463f000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463815c150 con 0x7f463815b4c0 2024-01-31T05:05:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.296+0000 7f4637e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f463815b0e0 0x7f463815f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.296+0000 7f4637e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f463815b0e0 0x7f463815f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45722/0 (socket says 172.21.15.49:45722) 2024-01-31T05:05:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.296+0000 7f4637e00640 1 -- 172.21.15.49:0/2814410160 learned_addr learned my addr 172.21.15.49:0/2814410160 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.296+0000 7f4637400640 1 --2- 172.21.15.49:0/2814410160 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f463815b4c0 0x7f463815b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.296+0000 7f4637e00640 1 -- 172.21.15.49:0/2814410160 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f463815b4c0 msgr2=0x7f463815b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.296+0000 7f4637e00640 1 --2- 172.21.15.49:0/2814410160 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f463815b4c0 0x7f463815b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.296+0000 7f4637e00640 1 -- 172.21.15.49:0/2814410160 >> v1:172.21.15.195:6789/0 conn(0x7f46380720a0 legacy=0x7f4638072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.296+0000 7f4637e00640 1 -- 172.21.15.49:0/2814410160 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463815c430 con 0x7f463815b0e0 2024-01-31T05:05:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.296+0000 7f4637400640 1 --2- 172.21.15.49:0/2814410160 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f463815b4c0 0x7f463815b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:31.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.300+0000 7f4637e00640 1 --2- 172.21.15.49:0/2814410160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f463815b0e0 0x7f463815f5e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4628009870 tx=0x7f462801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b5861878190870 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:31.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.300+0000 7f4636a00640 1 -- 172.21.15.49:0/2814410160 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46280aa430 con 0x7f463815b0e0 2024-01-31T05:05:31.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.300+0000 7f4636a00640 1 -- 172.21.15.49:0/2814410160 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46280aa590 con 0x7f463815b0e0 2024-01-31T05:05:31.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.300+0000 7f4636a00640 1 -- 172.21.15.49:0/2814410160 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46280aa920 con 0x7f463815b0e0 2024-01-31T05:05:31.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.300+0000 7f463f000640 1 -- 172.21.15.49:0/2814410160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f463815b0e0 msgr2=0x7f463815f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:31.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.300+0000 7f463f000640 1 --2- 172.21.15.49:0/2814410160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f463815b0e0 0x7f463815f5e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4628009870 tx=0x7f462801c4b0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.300+0000 7f463f000640 1 -- 172.21.15.49:0/2814410160 shutdown_connections 2024-01-31T05:05:31.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.300+0000 7f463f000640 1 --2- 172.21.15.49:0/2814410160 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f463815b4c0 0x7f463815b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.300+0000 7f463f000640 1 --2- 172.21.15.49:0/2814410160 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f463815b0e0 0x7f463815f5e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.300+0000 7f463f000640 1 -- 172.21.15.49:0/2814410160 >> 172.21.15.49:0/2814410160 conn(0x7f463806a770 msgr2=0x7f463806ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:31.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.300+0000 7f463f000640 1 -- 172.21.15.49:0/2814410160 shutdown_connections 2024-01-31T05:05:31.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.300+0000 7f463f000640 1 -- 172.21.15.49:0/2814410160 wait complete. 2024-01-31T05:05:31.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.300+0000 7f463f000640 1 Processor -- start 2024-01-31T05:05:31.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.300+0000 7f463f000640 1 -- start start 2024-01-31T05:05:31.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f463f000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46380720a0 0x7f4638156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:31.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f463f000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f463815b0e0 0x7f4638099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:31.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f463f000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f463815b4c0 0x7f4638164ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:31.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f463f000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4638157ed0 con 0x7f463815b4c0 2024-01-31T05:05:31.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f463f000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4638157500 con 0x7f463815b0e0 2024-01-31T05:05:31.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f463f000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4638158cb0 con 0x7f46380720a0 2024-01-31T05:05:31.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f463d000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f463815b4c0 0x7f4638164ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:31.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f463d000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f463815b4c0 0x7f4638164ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45732/0 (socket says 172.21.15.49:45732) 2024-01-31T05:05:31.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f463d000640 1 -- 172.21.15.49:0/3106416189 learned_addr learned my addr 172.21.15.49:0/3106416189 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:31.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f4637e00640 1 --2- 172.21.15.49:0/3106416189 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46380720a0 0x7f4638156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:31.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f4637400640 1 --2- 172.21.15.49:0/3106416189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f463815b0e0 0x7f4638099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:31.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f463d000640 1 -- 172.21.15.49:0/3106416189 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46380720a0 msgr2=0x7f4638156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:31.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f463d000640 1 --2- 172.21.15.49:0/3106416189 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46380720a0 0x7f4638156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f463d000640 1 -- 172.21.15.49:0/3106416189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f463815b0e0 msgr2=0x7f4638099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:31.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f463d000640 1 --2- 172.21.15.49:0/3106416189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f463815b0e0 0x7f4638099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f463d000640 1 -- 172.21.15.49:0/3106416189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46280094d0 con 0x7f463815b4c0 2024-01-31T05:05:31.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f463d000640 1 --2- 172.21.15.49:0/3106416189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f463815b4c0 0x7f4638164ba0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f463000c730 tx=0x7f463000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:31.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f462fe00640 1 -- 172.21.15.49:0/3106416189 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4630003b80 con 0x7f463815b4c0 2024-01-31T05:05:31.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f462fe00640 1 -- 172.21.15.49:0/3106416189 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4630003ce0 con 0x7f463815b4c0 2024-01-31T05:05:31.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f462fe00640 1 -- 172.21.15.49:0/3106416189 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463000aa30 con 0x7f463815b4c0 2024-01-31T05:05:31.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f463f000640 1 -- 172.21.15.49:0/3106416189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4638156fb0 con 0x7f463815b4c0 2024-01-31T05:05:31.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f463f000640 1 -- 172.21.15.49:0/3106416189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46381589d0 con 0x7f463815b4c0 2024-01-31T05:05:31.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.304+0000 7f463f000640 1 -- 172.21.15.49:0/3106416189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4638074860 con 0x7f463815b4c0 2024-01-31T05:05:31.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.308+0000 7f462fe00640 1 -- 172.21.15.49:0/3106416189 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f463000ab90 con 0x7f463815b4c0 2024-01-31T05:05:31.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.308+0000 7f462fe00640 1 --2- 172.21.15.49:0/3106416189 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4610066500 0x7f46100689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:31.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.308+0000 7f462fe00640 1 -- 172.21.15.49:0/3106416189 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4630083e30 con 0x7f463815b4c0 2024-01-31T05:05:31.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.308+0000 7f4637e00640 1 --2- 172.21.15.49:0/3106416189 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4610066500 0x7f46100689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:31.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.308+0000 7f4637e00640 1 --2- 172.21.15.49:0/3106416189 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4610066500 0x7f46100689c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f46280ae000 tx=0x7f46280b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:31.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.312+0000 7f462fe00640 1 -- 172.21.15.49:0/3106416189 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f4630050e50 con 0x7f463815b4c0 2024-01-31T05:05:31.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.472+0000 7f463f000640 1 -- 172.21.15.49:0/3106416189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f46380cca20 con 0x7f463815b4c0 2024-01-31T05:05:31.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.472+0000 7f462fe00640 1 -- 172.21.15.49:0/3106416189 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4630054470 con 0x7f463815b4c0 2024-01-31T05:05:31.473 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T05:05:31.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.472+0000 7f463f000640 1 -- 172.21.15.49:0/3106416189 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4610066500 msgr2=0x7f46100689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:31.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.472+0000 7f463f000640 1 --2- 172.21.15.49:0/3106416189 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4610066500 0x7f46100689c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f46280ae000 tx=0x7f46280b5040 comp rx=0 tx=0).stop 2024-01-31T05:05:31.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.472+0000 7f463f000640 1 -- 172.21.15.49:0/3106416189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f463815b4c0 msgr2=0x7f4638164ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.472+0000 7f463f000640 1 --2- 172.21.15.49:0/3106416189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f463815b4c0 0x7f4638164ba0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f463000c730 tx=0x7f463000cbf0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.472+0000 7f463f000640 1 -- 172.21.15.49:0/3106416189 shutdown_connections 2024-01-31T05:05:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.472+0000 7f463f000640 1 --2- 172.21.15.49:0/3106416189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f463815b4c0 0x7f4638164ba0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.472+0000 7f463f000640 1 --2- 172.21.15.49:0/3106416189 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4610066500 0x7f46100689c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.472+0000 7f463f000640 1 --2- 172.21.15.49:0/3106416189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f463815b0e0 0x7f4638099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.472+0000 7f463f000640 1 --2- 172.21.15.49:0/3106416189 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46380720a0 0x7f4638156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.472+0000 7f463f000640 1 -- 172.21.15.49:0/3106416189 >> 172.21.15.49:0/3106416189 conn(0x7f463806a770 msgr2=0x7f463815d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.472+0000 7f463f000640 1 -- 172.21.15.49:0/3106416189 shutdown_connections 2024-01-31T05:05:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.472+0000 7f463f000640 1 -- 172.21.15.49:0/3106416189 wait complete. 2024-01-31T05:05:31.496 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:05:31.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.636+0000 7f1006600640 1 Processor -- start 2024-01-31T05:05:31.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.636+0000 7f1006600640 1 -- start start 2024-01-31T05:05:31.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.636+0000 7f1006600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f100015d0e0 0x7f10000b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:31.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.636+0000 7f1006600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f10000d0690 0x7f10000721f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:31.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.636+0000 7f1006600640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f10000aeb50 0x7f10000aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:31.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.636+0000 7f1006600640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10000b5000 con 0x7f10000aeb50 2024-01-31T05:05:31.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.636+0000 7f1006600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10000af500 con 0x7f10000d0690 2024-01-31T05:05:31.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.636+0000 7f1006600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10000d0200 con 0x7f100015d0e0 2024-01-31T05:05:31.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.636+0000 7f0fffe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f10000aeb50 0x7f10000aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:31.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.636+0000 7f0fffe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f10000aeb50 0x7f10000aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45736/0 (socket says 172.21.15.49:45736) 2024-01-31T05:05:31.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.636+0000 7f0fffe00640 1 -- 172.21.15.49:0/3615276510 learned_addr learned my addr 172.21.15.49:0/3615276510 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:31.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.636+0000 7f0ffea00640 1 --2- 172.21.15.49:0/3615276510 >> v2:172.21.15.195:3300/0 conn(0x7f10000d0690 0x7f10000721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:31.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.636+0000 7f0fff400640 1 --2- 172.21.15.49:0/3615276510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f100015d0e0 0x7f10000b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:31.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.636+0000 7f0fffe00640 1 -- 172.21.15.49:0/3615276510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f100015d0e0 msgr2=0x7f10000b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:31.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.636+0000 7f0fffe00640 1 --2- 172.21.15.49:0/3615276510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f100015d0e0 0x7f10000b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.636+0000 7f0fffe00640 1 -- 172.21.15.49:0/3615276510 >> v2:172.21.15.195:3300/0 conn(0x7f10000d0690 msgr2=0x7f10000721f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:31.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.636+0000 7f0fffe00640 1 --2- 172.21.15.49:0/3615276510 >> v2:172.21.15.195:3300/0 conn(0x7f10000d0690 0x7f10000721f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.636+0000 7f0fffe00640 1 -- 172.21.15.49:0/3615276510 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10000d0af0 con 0x7f10000aeb50 2024-01-31T05:05:31.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.640+0000 7f0fffe00640 1 --2- 172.21.15.49:0/3615276510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10000aeb50 0x7f10000aefc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f10000d0de0 tx=0x7f0ff801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38bae7be8a9e360e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:31.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.640+0000 7f0ffe000640 1 -- 172.21.15.49:0/3615276510 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff80a5740 con 0x7f10000aeb50 2024-01-31T05:05:31.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.640+0000 7f0ffe000640 1 -- 172.21.15.49:0/3615276510 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff80a58a0 con 0x7f10000aeb50 2024-01-31T05:05:31.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.640+0000 7f0ffe000640 1 -- 172.21.15.49:0/3615276510 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff80a5c30 con 0x7f10000aeb50 2024-01-31T05:05:31.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.640+0000 7f1006600640 1 -- 172.21.15.49:0/3615276510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10000aeb50 msgr2=0x7f10000aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:31.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.640+0000 7f1006600640 1 --2- 172.21.15.49:0/3615276510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10000aeb50 0x7f10000aefc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f10000d0de0 tx=0x7f0ff801c9d0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.640+0000 7f1006600640 1 -- 172.21.15.49:0/3615276510 shutdown_connections 2024-01-31T05:05:31.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.640+0000 7f1006600640 1 --2- 172.21.15.49:0/3615276510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10000aeb50 0x7f10000aefc0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.640+0000 7f1006600640 1 --2- 172.21.15.49:0/3615276510 >> v2:172.21.15.195:3300/0 conn(0x7f10000d0690 0x7f10000721f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.640+0000 7f1006600640 1 --2- 172.21.15.49:0/3615276510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f100015d0e0 0x7f10000b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.640+0000 7f1006600640 1 -- 172.21.15.49:0/3615276510 >> 172.21.15.49:0/3615276510 conn(0x7f10000b1940 msgr2=0x7f10000b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:31.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.640+0000 7f1006600640 1 -- 172.21.15.49:0/3615276510 shutdown_connections 2024-01-31T05:05:31.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.640+0000 7f1006600640 1 -- 172.21.15.49:0/3615276510 wait complete. 2024-01-31T05:05:31.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f1006600640 1 Processor -- start 2024-01-31T05:05:31.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f1006600640 1 -- start start 2024-01-31T05:05:31.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f1006600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10000aeb50 0x7f1000156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:31.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f1006600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10000d0690 0x7f100014e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:31.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f1006600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f100015d0e0 0x7f10001498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:31.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f1006600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100014d7c0 con 0x7f10000aeb50 2024-01-31T05:05:31.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f1006600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100014ecd0 con 0x7f10000d0690 2024-01-31T05:05:31.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f1006600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100014e300 con 0x7f100015d0e0 2024-01-31T05:05:31.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f0fff400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10000aeb50 0x7f1000156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:31.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f0fff400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10000aeb50 0x7f1000156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45740/0 (socket says 172.21.15.49:45740) 2024-01-31T05:05:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f0fff400640 1 -- 172.21.15.49:0/2304250195 learned_addr learned my addr 172.21.15.49:0/2304250195 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f0fffe00640 1 --2- 172.21.15.49:0/2304250195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f100015d0e0 0x7f10001498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f0ffea00640 1 --2- 172.21.15.49:0/2304250195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10000d0690 0x7f100014e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f0fff400640 1 -- 172.21.15.49:0/2304250195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f100015d0e0 msgr2=0x7f10001498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f0fff400640 1 --2- 172.21.15.49:0/2304250195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f100015d0e0 0x7f10001498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f0fff400640 1 -- 172.21.15.49:0/2304250195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10000d0690 msgr2=0x7f100014e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f0fff400640 1 --2- 172.21.15.49:0/2304250195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10000d0690 0x7f100014e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f0fff400640 1 -- 172.21.15.49:0/2304250195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff8009b30 con 0x7f10000aeb50 2024-01-31T05:05:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f0fff400640 1 --2- 172.21.15.49:0/2304250195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10000aeb50 0x7f1000156290 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000e8a0 tx=0x7f0ff000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f0ff7400640 1 -- 172.21.15.49:0/2304250195 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0009530 con 0x7f10000aeb50 2024-01-31T05:05:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f0ff7400640 1 -- 172.21.15.49:0/2304250195 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff000c940 con 0x7f10000aeb50 2024-01-31T05:05:31.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f0ff7400640 1 -- 172.21.15.49:0/2304250195 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff000ccd0 con 0x7f10000aeb50 2024-01-31T05:05:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f1006600640 1 -- 172.21.15.49:0/2304250195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100014d9d0 con 0x7f10000aeb50 2024-01-31T05:05:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.644+0000 7f1006600640 1 -- 172.21.15.49:0/2304250195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100014df90 con 0x7f10000aeb50 2024-01-31T05:05:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.648+0000 7f1006600640 1 -- 172.21.15.49:0/2304250195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1000074860 con 0x7f10000aeb50 2024-01-31T05:05:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.648+0000 7f0ff7400640 1 -- 172.21.15.49:0/2304250195 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f0ff0013470 con 0x7f10000aeb50 2024-01-31T05:05:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.648+0000 7f0ff7400640 1 --2- 172.21.15.49:0/2304250195 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0fd8066530 0x7f0fd80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.648+0000 7f0ff7400640 1 -- 172.21.15.49:0/2304250195 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0ff00843a0 con 0x7f10000aeb50 2024-01-31T05:05:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.648+0000 7f0ffea00640 1 --2- 172.21.15.49:0/2304250195 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0fd8066530 0x7f0fd80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:31.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.648+0000 7f0ffea00640 1 --2- 172.21.15.49:0/2304250195 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0fd8066530 0x7f0fd80689f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f100015cac0 tx=0x7f0fe8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.652+0000 7f0ff7400640 1 -- 172.21.15.49:0/2304250195 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f0ff00511f0 con 0x7f10000aeb50 2024-01-31T05:05:31.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.844+0000 7f1006600640 1 -- 172.21.15.49:0/2304250195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1000071ac0 con 0x7f10000aeb50 2024-01-31T05:05:31.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.844+0000 7f0ff7400640 1 -- 172.21.15.49:0/2304250195 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7f0ff0054810 con 0x7f10000aeb50 2024-01-31T05:05:31.847 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:31.847 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2308601440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2308601440},{"type":"v1","addr":"172.21.15.49:6835","nonce":2308601440}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2920530340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":2920530340},{"type":"v1","addr":"172.21.15.195:6836","nonce":2920530340}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3114317228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3114317228},{"type":"v1","addr":"172.21.15.195:6837","nonce":3114317228}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-31T05:04:16.248649+0000","modified":"2024-01-31T05:04:39.667986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/4254852793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4254852793},{"type":"v1","addr":"172.21.15.49:6834","nonce":4254852793}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:05:31.847 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2024-01-31T05:05:31.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.848+0000 7f1006600640 1 -- 172.21.15.49:0/2304250195 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0fd8066530 msgr2=0x7f0fd80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:31.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.848+0000 7f1006600640 1 --2- 172.21.15.49:0/2304250195 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0fd8066530 0x7f0fd80689f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f100015cac0 tx=0x7f0fe8008040 comp rx=0 tx=0).stop 2024-01-31T05:05:31.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.848+0000 7f1006600640 1 -- 172.21.15.49:0/2304250195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10000aeb50 msgr2=0x7f1000156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:31.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.848+0000 7f1006600640 1 --2- 172.21.15.49:0/2304250195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10000aeb50 0x7f1000156290 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000e8a0 tx=0x7f0ff000ed60 comp rx=0 tx=0).stop 2024-01-31T05:05:31.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.848+0000 7f1006600640 1 -- 172.21.15.49:0/2304250195 shutdown_connections 2024-01-31T05:05:31.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.848+0000 7f1006600640 1 --2- 172.21.15.49:0/2304250195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f100015d0e0 0x7f10001498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.848+0000 7f1006600640 1 --2- 172.21.15.49:0/2304250195 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0fd8066530 0x7f0fd80689f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.848+0000 7f1006600640 1 --2- 172.21.15.49:0/2304250195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10000d0690 0x7f100014e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.848+0000 7f1006600640 1 --2- 172.21.15.49:0/2304250195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10000aeb50 0x7f1000156290 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:31.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.848+0000 7f1006600640 1 -- 172.21.15.49:0/2304250195 >> 172.21.15.49:0/2304250195 conn(0x7f10000b1940 msgr2=0x7f10000b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:31.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.848+0000 7f1006600640 1 -- 172.21.15.49:0/2304250195 shutdown_connections 2024-01-31T05:05:31.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:31.848+0000 7f1006600640 1 -- 172.21.15.49:0/2304250195 wait complete. 2024-01-31T05:05:31.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:32.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.008+0000 7ff2c2000640 1 Processor -- start 2024-01-31T05:05:32.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.008+0000 7ff2c2000640 1 -- start start 2024-01-31T05:05:32.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.008+0000 7ff2c2000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff2bc0cf670 0x7ff2bc0b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:32.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.008+0000 7ff2c2000640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2bc0c6800 con 0x7ff2bc15e7e0 2024-01-31T05:05:32.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.008+0000 7ff2c2000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2bc0c6ab0 con 0x7ff2bc0c63d0 2024-01-31T05:05:32.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.008+0000 7ff2c2000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2bc0d1d40 con 0x7ff2bc0cf670 2024-01-31T05:05:32.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.008+0000 7ff2bb400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ff2bc15e7e0 0x7ff2bc0cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55890/0 (socket says 172.21.15.49:55890) 2024-01-31T05:05:32.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.008+0000 7ff2bb400640 1 -- 172.21.15.49:0/601589361 learned_addr learned my addr 172.21.15.49:0/601589361 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:32.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.008+0000 7ff2baa00640 1 --2- 172.21.15.49:0/601589361 >> v2:172.21.15.195:3300/0 conn(0x7ff2bc0cf670 0x7ff2bc0b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:32.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.008+0000 7ff2ba000640 1 -- 172.21.15.49:0/601589361 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678264319 0 0) 0x7ff2bc0c6800 con 0x7ff2bc15e7e0 2024-01-31T05:05:32.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.008+0000 7ff2ba000640 1 -- 172.21.15.49:0/601589361 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff29c003530 con 0x7ff2bc15e7e0 2024-01-31T05:05:32.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.012+0000 7ff2baa00640 1 -- 172.21.15.49:0/601589361 >> v1:172.21.15.195:6789/0 conn(0x7ff2bc0c63d0 legacy=0x7ff2bc0cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:32.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.012+0000 7ff2baa00640 1 -- 172.21.15.49:0/601589361 >> v1:172.21.15.49:6789/0 conn(0x7ff2bc15e7e0 legacy=0x7ff2bc0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:32.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.012+0000 7ff2baa00640 1 -- 172.21.15.49:0/601589361 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2bc0c6d90 con 0x7ff2bc0cf670 2024-01-31T05:05:32.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.012+0000 7ff2baa00640 1 --2- 172.21.15.49:0/601589361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2bc0cf670 0x7ff2bc0b2370 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40097c0 tx=0x7ff2a401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31c90bfbc5402136 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:32.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.012+0000 7ff2ba000640 1 -- 172.21.15.49:0/601589361 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a40a8970 con 0x7ff2bc0cf670 2024-01-31T05:05:32.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.012+0000 7ff2ba000640 1 -- 172.21.15.49:0/601589361 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a40a8ad0 con 0x7ff2bc0cf670 2024-01-31T05:05:32.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.012+0000 7ff2ba000640 1 -- 172.21.15.49:0/601589361 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a40a8e60 con 0x7ff2bc0cf670 2024-01-31T05:05:32.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.016+0000 7ff2c2000640 1 -- 172.21.15.49:0/601589361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2bc0cf670 msgr2=0x7ff2bc0b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:32.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.016+0000 7ff2c2000640 1 --2- 172.21.15.49:0/601589361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2bc0cf670 0x7ff2bc0b2370 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40097c0 tx=0x7ff2a401ec70 comp rx=0 tx=0).stop 2024-01-31T05:05:32.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.016+0000 7ff2c2000640 1 -- 172.21.15.49:0/601589361 shutdown_connections 2024-01-31T05:05:32.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.016+0000 7ff2c2000640 1 --2- 172.21.15.49:0/601589361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2bc0cf670 0x7ff2bc0b2370 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.016+0000 7ff2c2000640 1 -- 172.21.15.49:0/601589361 >> 172.21.15.49:0/601589361 conn(0x7ff2bc0d0e60 msgr2=0x7ff2bc0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:32.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.016+0000 7ff2c2000640 1 -- 172.21.15.49:0/601589361 shutdown_connections 2024-01-31T05:05:32.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.016+0000 7ff2c2000640 1 -- 172.21.15.49:0/601589361 wait complete. 2024-01-31T05:05:32.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.016+0000 7ff2c2000640 1 Processor -- start 2024-01-31T05:05:32.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.016+0000 7ff2c2000640 1 -- start start 2024-01-31T05:05:32.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.016+0000 7ff2c2000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2bc0c63d0 0x7ff2bc1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:32.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.016+0000 7ff2c2000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2bc0cf670 0x7ff2bc0c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:32.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.016+0000 7ff2c2000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2bc15e7e0 0x7ff2bc0c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:32.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.016+0000 7ff2c2000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc0cd1f0 con 0x7ff2bc0c63d0 2024-01-31T05:05:32.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.016+0000 7ff2c2000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc0cc5e0 con 0x7ff2bc15e7e0 2024-01-31T05:05:32.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.016+0000 7ff2c2000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc0cc8c0 con 0x7ff2bc0cf670 2024-01-31T05:05:32.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.016+0000 7ff2bb400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2bc0c63d0 0x7ff2bc1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:32.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.016+0000 7ff2bb400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2bc0c63d0 0x7ff2bc1520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45750/0 (socket says 172.21.15.49:45750) 2024-01-31T05:05:32.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.016+0000 7ff2bb400640 1 -- 172.21.15.49:0/1461777504 learned_addr learned my addr 172.21.15.49:0/1461777504 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:32.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.016+0000 7ff2bbe00640 1 --2- 172.21.15.49:0/1461777504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2bc15e7e0 0x7ff2bc0c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:32.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.020+0000 7ff2baa00640 1 --2- 172.21.15.49:0/1461777504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2bc0cf670 0x7ff2bc0c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:32.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.020+0000 7ff2bb400640 1 -- 172.21.15.49:0/1461777504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2bc0cf670 msgr2=0x7ff2bc0c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:32.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.020+0000 7ff2bb400640 1 --2- 172.21.15.49:0/1461777504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2bc0cf670 0x7ff2bc0c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.020+0000 7ff2bb400640 1 -- 172.21.15.49:0/1461777504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2bc15e7e0 msgr2=0x7ff2bc0c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:32.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.020+0000 7ff2bb400640 1 --2- 172.21.15.49:0/1461777504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2bc15e7e0 0x7ff2bc0c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.020+0000 7ff2bb400640 1 -- 172.21.15.49:0/1461777504 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a4009420 con 0x7ff2bc0c63d0 2024-01-31T05:05:32.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.020+0000 7ff2bb400640 1 --2- 172.21.15.49:0/1461777504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2bc0c63d0 0x7ff2bc1520d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00c4d0 tx=0x7ff2ac00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:32.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.020+0000 7ff2b3400640 1 -- 172.21.15.49:0/1461777504 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac005cf0 con 0x7ff2bc0c63d0 2024-01-31T05:05:32.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.020+0000 7ff2b3400640 1 -- 172.21.15.49:0/1461777504 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac005e50 con 0x7ff2bc0c63d0 2024-01-31T05:05:32.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.020+0000 7ff2c2000640 1 -- 172.21.15.49:0/1461777504 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc0ccba0 con 0x7ff2bc0c63d0 2024-01-31T05:05:32.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.020+0000 7ff2b3400640 1 -- 172.21.15.49:0/1461777504 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac007270 con 0x7ff2bc0c63d0 2024-01-31T05:05:32.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.020+0000 7ff2c2000640 1 -- 172.21.15.49:0/1461777504 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2bc152610 con 0x7ff2bc0c63d0 2024-01-31T05:05:32.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.020+0000 7ff2c2000640 1 -- 172.21.15.49:0/1461777504 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2bc074860 con 0x7ff2bc0c63d0 2024-01-31T05:05:32.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.020+0000 7ff2b3400640 1 -- 172.21.15.49:0/1461777504 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff2ac0073d0 con 0x7ff2bc0c63d0 2024-01-31T05:05:32.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.020+0000 7ff2b3400640 1 --2- 172.21.15.49:0/1461777504 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff294066500 0x7ff2940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:32.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.024+0000 7ff2b3400640 1 -- 172.21.15.49:0/1461777504 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff2ac083860 con 0x7ff2bc0c63d0 2024-01-31T05:05:32.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.024+0000 7ff2baa00640 1 --2- 172.21.15.49:0/1461777504 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff294066500 0x7ff2940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:32.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.024+0000 7ff2baa00640 1 --2- 172.21.15.49:0/1461777504 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff294066500 0x7ff2940689c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40b2000 tx=0x7ff2a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:32.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.024+0000 7ff2b3400640 1 -- 172.21.15.49:0/1461777504 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff2ac050750 con 0x7ff2bc0c63d0 2024-01-31T05:05:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.184+0000 7ff2c2000640 1 -- 172.21.15.49:0/1461777504 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2bc15cdf0 con 0x7ff2bc0c63d0 2024-01-31T05:05:32.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.188+0000 7ff2b3400640 1 -- 172.21.15.49:0/1461777504 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7ff2ac053d70 con 0x7ff2bc0c63d0 2024-01-31T05:05:32.189 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:32.189 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:58.277568+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:32.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.188+0000 7ff2c2000640 1 -- 172.21.15.49:0/1461777504 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff294066500 msgr2=0x7ff2940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:32.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.188+0000 7ff2c2000640 1 --2- 172.21.15.49:0/1461777504 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff294066500 0x7ff2940689c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40b2000 tx=0x7ff2a4008040 comp rx=0 tx=0).stop 2024-01-31T05:05:32.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.188+0000 7ff2c2000640 1 -- 172.21.15.49:0/1461777504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2bc0c63d0 msgr2=0x7ff2bc1520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:32.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.188+0000 7ff2c2000640 1 --2- 172.21.15.49:0/1461777504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2bc0c63d0 0x7ff2bc1520d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00c4d0 tx=0x7ff2ac00c990 comp rx=0 tx=0).stop 2024-01-31T05:05:32.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.188+0000 7ff2c2000640 1 -- 172.21.15.49:0/1461777504 shutdown_connections 2024-01-31T05:05:32.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.188+0000 7ff2c2000640 1 --2- 172.21.15.49:0/1461777504 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff294066500 0x7ff2940689c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.188+0000 7ff2c2000640 1 --2- 172.21.15.49:0/1461777504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2bc15e7e0 0x7ff2bc0c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.188+0000 7ff2c2000640 1 --2- 172.21.15.49:0/1461777504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2bc0cf670 0x7ff2bc0c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.188+0000 7ff2c2000640 1 --2- 172.21.15.49:0/1461777504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2bc0c63d0 0x7ff2bc1520d0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.188+0000 7ff2c2000640 1 -- 172.21.15.49:0/1461777504 >> 172.21.15.49:0/1461777504 conn(0x7ff2bc0d0e60 msgr2=0x7ff2bc0cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:32.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.188+0000 7ff2c2000640 1 -- 172.21.15.49:0/1461777504 shutdown_connections 2024-01-31T05:05:32.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.188+0000 7ff2c2000640 1 -- 172.21.15.49:0/1461777504 wait complete. 2024-01-31T05:05:32.212 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-31T05:05:32.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:05:32.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.352+0000 7f5a0e200640 1 Processor -- start 2024-01-31T05:05:32.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.352+0000 7f5a0e200640 1 -- start start 2024-01-31T05:05:32.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.352+0000 7f5a0e200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5a0806f020 0x7f5a080cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:32.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.352+0000 7f5a0e200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5a0806f4b0 0x7f5a080cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:32.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.352+0000 7f5a0e200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a080cb990 con 0x7f5a0815d3a0 2024-01-31T05:05:32.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.352+0000 7f5a0e200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a080d1c20 con 0x7f5a0806f4b0 2024-01-31T05:05:32.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.352+0000 7f5a0e200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a080cfed0 con 0x7f5a0806f020 2024-01-31T05:05:32.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.352+0000 7f5a07e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5a0806f4b0 0x7f5a080cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:32.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.352+0000 7f5a07e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5a0806f4b0 0x7f5a080cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45764/0 (socket says 172.21.15.49:45764) 2024-01-31T05:05:32.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.352+0000 7f5a07e00640 1 -- 172.21.15.49:0/3845536348 learned_addr learned my addr 172.21.15.49:0/3845536348 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:32.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.352+0000 7f5a06a00640 1 --2- 172.21.15.49:0/3845536348 >> v2:172.21.15.195:3300/0 conn(0x7f5a0806f020 0x7f5a080cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:32.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.352+0000 7f5a07e00640 1 -- 172.21.15.49:0/3845536348 >> v2:172.21.15.195:3300/0 conn(0x7f5a0806f020 msgr2=0x7f5a080cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:32.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.356+0000 7f5a07e00640 1 --2- 172.21.15.49:0/3845536348 >> v2:172.21.15.195:3300/0 conn(0x7f5a0806f020 0x7f5a080cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.356+0000 7f5a07e00640 1 -- 172.21.15.49:0/3845536348 >> v1:172.21.15.195:6789/0 conn(0x7f5a0815d3a0 legacy=0x7f5a0806e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:32.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.356+0000 7f5a07e00640 1 -- 172.21.15.49:0/3845536348 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a080d01b0 con 0x7f5a0806f4b0 2024-01-31T05:05:32.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.356+0000 7f5a07e00640 1 --2- 172.21.15.49:0/3845536348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a0806f4b0 0x7f5a080cc360 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5a08070730 tx=0x7f5a0001c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b70c18281a1dd6 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:32.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.356+0000 7f5a06000640 1 -- 172.21.15.49:0/3845536348 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a000a57e0 con 0x7f5a0806f4b0 2024-01-31T05:05:32.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.356+0000 7f5a06000640 1 -- 172.21.15.49:0/3845536348 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a000a5940 con 0x7f5a0806f4b0 2024-01-31T05:05:32.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.356+0000 7f5a06000640 1 -- 172.21.15.49:0/3845536348 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a000a5cd0 con 0x7f5a0806f4b0 2024-01-31T05:05:32.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.356+0000 7f5a0e200640 1 -- 172.21.15.49:0/3845536348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a0806f4b0 msgr2=0x7f5a080cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:32.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.356+0000 7f5a0e200640 1 --2- 172.21.15.49:0/3845536348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a0806f4b0 0x7f5a080cc360 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5a08070730 tx=0x7f5a0001c990 comp rx=0 tx=0).stop 2024-01-31T05:05:32.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a0e200640 1 -- 172.21.15.49:0/3845536348 shutdown_connections 2024-01-31T05:05:32.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a0e200640 1 --2- 172.21.15.49:0/3845536348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a0806f4b0 0x7f5a080cc360 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a0e200640 1 --2- 172.21.15.49:0/3845536348 >> v2:172.21.15.195:3300/0 conn(0x7f5a0806f020 0x7f5a080cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a0e200640 1 -- 172.21.15.49:0/3845536348 >> 172.21.15.49:0/3845536348 conn(0x7f5a080d0e50 msgr2=0x7f5a080d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:32.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a0e200640 1 -- 172.21.15.49:0/3845536348 shutdown_connections 2024-01-31T05:05:32.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a0e200640 1 -- 172.21.15.49:0/3845536348 wait complete. 2024-01-31T05:05:32.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a0e200640 1 Processor -- start 2024-01-31T05:05:32.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a0e200640 1 -- start start 2024-01-31T05:05:32.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a0e200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a0806f020 0x7f5a0815b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:32.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a0e200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a0806f4b0 0x7f5a081576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:32.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a0e200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a0815d3a0 0x7f5a08157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:32.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a0e200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0815c820 con 0x7f5a0815d3a0 2024-01-31T05:05:32.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a0e200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0815bc10 con 0x7f5a0806f020 2024-01-31T05:05:32.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a0e200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0815bef0 con 0x7f5a0806f4b0 2024-01-31T05:05:32.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a07e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a0815d3a0 0x7f5a08157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:32.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a07e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a0815d3a0 0x7f5a08157c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45772/0 (socket says 172.21.15.49:45772) 2024-01-31T05:05:32.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a07e00640 1 -- 172.21.15.49:0/2573563403 learned_addr learned my addr 172.21.15.49:0/2573563403 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:32.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a07400640 1 --2- 172.21.15.49:0/2573563403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a0806f020 0x7f5a0815b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:32.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a06a00640 1 --2- 172.21.15.49:0/2573563403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a0806f4b0 0x7f5a081576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:32.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a07e00640 1 -- 172.21.15.49:0/2573563403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a0806f4b0 msgr2=0x7f5a081576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:32.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a07e00640 1 --2- 172.21.15.49:0/2573563403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a0806f4b0 0x7f5a081576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a07e00640 1 -- 172.21.15.49:0/2573563403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a0806f020 msgr2=0x7f5a0815b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:32.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a07e00640 1 --2- 172.21.15.49:0/2573563403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a0806f020 0x7f5a0815b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a07e00640 1 -- 172.21.15.49:0/2573563403 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a00009b30 con 0x7f5a0815d3a0 2024-01-31T05:05:32.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.360+0000 7f5a07e00640 1 --2- 172.21.15.49:0/2573563403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a0815d3a0 0x7f5a08157c30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5a0001a5c0 tx=0x7f5a00019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:32.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.364+0000 7f59ff400640 1 -- 172.21.15.49:0/2573563403 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a000b8670 con 0x7f5a0815d3a0 2024-01-31T05:05:32.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.364+0000 7f59ff400640 1 -- 172.21.15.49:0/2573563403 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a000b87d0 con 0x7f5a0815d3a0 2024-01-31T05:05:32.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.364+0000 7f59ff400640 1 -- 172.21.15.49:0/2573563403 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a000b8b80 con 0x7f5a0815d3a0 2024-01-31T05:05:32.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.364+0000 7f5a0e200640 1 -- 172.21.15.49:0/2573563403 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0815c1d0 con 0x7f5a0815d3a0 2024-01-31T05:05:32.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.364+0000 7f5a0e200640 1 -- 172.21.15.49:0/2573563403 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0815b850 con 0x7f5a0815d3a0 2024-01-31T05:05:32.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.364+0000 7f5a0e200640 1 -- 172.21.15.49:0/2573563403 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0806fdb0 con 0x7f5a0815d3a0 2024-01-31T05:05:32.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.364+0000 7f59ff400640 1 -- 172.21.15.49:0/2573563403 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f5a000b8ce0 con 0x7f5a0815d3a0 2024-01-31T05:05:32.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.364+0000 7f59ff400640 1 --2- 172.21.15.49:0/2573563403 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f59e0066530 0x7f59e00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:32.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.364+0000 7f59ff400640 1 -- 172.21.15.49:0/2573563403 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5a0011f2c0 con 0x7f5a0815d3a0 2024-01-31T05:05:32.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.364+0000 7f5a07400640 1 --2- 172.21.15.49:0/2573563403 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f59e0066530 0x7f59e00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:32.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.368+0000 7f5a07400640 1 --2- 172.21.15.49:0/2573563403 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f59e0066530 0x7f59e00689f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f59f8007fd0 tx=0x7f59f8007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:32.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.368+0000 7f59ff400640 1 -- 172.21.15.49:0/2573563403 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f5a000ec1b0 con 0x7f5a0815d3a0 2024-01-31T05:05:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.564+0000 7f5a0e200640 1 -- 172.21.15.49:0/2573563403 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a0806fdb0 con 0x7f5a0815d3a0 2024-01-31T05:05:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.564+0000 7f59ff400640 1 -- 172.21.15.49:0/2573563403 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7f5a000ef7d0 con 0x7f5a0815d3a0 2024-01-31T05:05:32.567 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:32.567 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2308601440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2308601440},{"type":"v1","addr":"172.21.15.49:6835","nonce":2308601440}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2920530340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":2920530340},{"type":"v1","addr":"172.21.15.195:6836","nonce":2920530340}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3114317228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3114317228},{"type":"v1","addr":"172.21.15.195:6837","nonce":3114317228}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-31T05:04:16.248649+0000","modified":"2024-01-31T05:04:39.667986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/4254852793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4254852793},{"type":"v1","addr":"172.21.15.49:6834","nonce":4254852793}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:05:32.568 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2024-01-31T05:05:32.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.568+0000 7f5a0e200640 1 -- 172.21.15.49:0/2573563403 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f59e0066530 msgr2=0x7f59e00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:32.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.568+0000 7f5a0e200640 1 --2- 172.21.15.49:0/2573563403 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f59e0066530 0x7f59e00689f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f59f8007fd0 tx=0x7f59f8007e40 comp rx=0 tx=0).stop 2024-01-31T05:05:32.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.568+0000 7f5a0e200640 1 -- 172.21.15.49:0/2573563403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a0815d3a0 msgr2=0x7f5a08157c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:32.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.568+0000 7f5a0e200640 1 --2- 172.21.15.49:0/2573563403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a0815d3a0 0x7f5a08157c30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5a0001a5c0 tx=0x7f5a00019730 comp rx=0 tx=0).stop 2024-01-31T05:05:32.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.568+0000 7f5a0e200640 1 -- 172.21.15.49:0/2573563403 shutdown_connections 2024-01-31T05:05:32.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.568+0000 7f5a0e200640 1 --2- 172.21.15.49:0/2573563403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a0815d3a0 0x7f5a08157c30 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.568+0000 7f5a0e200640 1 --2- 172.21.15.49:0/2573563403 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5a0806f4b0 0x7f5a081576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.568+0000 7f5a0e200640 1 --2- 172.21.15.49:0/2573563403 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f59e0066530 0x7f59e00689f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.568+0000 7f5a0e200640 1 --2- 172.21.15.49:0/2573563403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a0806f020 0x7f5a0815b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.568+0000 7f5a0e200640 1 -- 172.21.15.49:0/2573563403 >> 172.21.15.49:0/2573563403 conn(0x7f5a080d0e50 msgr2=0x7f5a08156990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:32.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.568+0000 7f5a0e200640 1 -- 172.21.15.49:0/2573563403 shutdown_connections 2024-01-31T05:05:32.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.568+0000 7f5a0e200640 1 -- 172.21.15.49:0/2573563403 wait complete. 2024-01-31T05:05:32.592 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:05:32.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.732+0000 7f9e5aa00640 1 Processor -- start 2024-01-31T05:05:32.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.732+0000 7f9e5aa00640 1 -- start start 2024-01-31T05:05:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.732+0000 7f9e5aa00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9e540cf670 0x7f9e540b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.732+0000 7f9e5aa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e540c63d0 0x7f9e540cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.732+0000 7f9e5aa00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e540c6840 con 0x7f9e5415e7e0 2024-01-31T05:05:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.732+0000 7f9e5aa00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e540d1d40 con 0x7f9e540cf670 2024-01-31T05:05:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.732+0000 7f9e5aa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e540c6ab0 con 0x7f9e540c63d0 2024-01-31T05:05:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.732+0000 7f9e58a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e540c63d0 0x7f9e540cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.732+0000 7f9e53400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9e540cf670 0x7f9e540b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.732+0000 7f9e53400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9e540cf670 0x7f9e540b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:51400/0 (socket says 172.21.15.49:51400) 2024-01-31T05:05:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.732+0000 7f9e53400640 1 -- 172.21.15.49:0/3593545114 learned_addr learned my addr 172.21.15.49:0/3593545114 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.732+0000 7f9e53e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f9e5415e7e0 0x7f9e540cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:45142/0 (socket says 172.21.15.49:45142) 2024-01-31T05:05:32.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.732+0000 7f9e58a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e540c63d0 0x7f9e540cbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:57172/0 (socket says 172.21.15.49:57172) 2024-01-31T05:05:32.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.732+0000 7f9e58a00640 1 -- 172.21.15.49:0/3593545114 >> v2:172.21.15.195:3300/0 conn(0x7f9e540cf670 msgr2=0x7f9e540b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:32.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.732+0000 7f9e58a00640 1 --2- 172.21.15.49:0/3593545114 >> v2:172.21.15.195:3300/0 conn(0x7f9e540cf670 0x7f9e540b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.732+0000 7f9e58a00640 1 -- 172.21.15.49:0/3593545114 >> v1:172.21.15.195:6789/0 conn(0x7f9e5415e7e0 legacy=0x7f9e540cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:32.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.732+0000 7f9e58a00640 1 -- 172.21.15.49:0/3593545114 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e540c6d90 con 0x7f9e540c63d0 2024-01-31T05:05:32.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.732+0000 7f9e52a00640 1 -- 172.21.15.49:0/3593545114 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2068978500 0 0) 0x7f9e540c6840 con 0x7f9e5415e7e0 2024-01-31T05:05:32.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.732+0000 7f9e53400640 1 --2- 172.21.15.49:0/3593545114 >> v2:172.21.15.195:3300/0 conn(0x7f9e540cf670 0x7f9e540b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:32.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.736+0000 7f9e58a00640 1 --2- 172.21.15.49:0/3593545114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e540c63d0 0x7f9e540cbab0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009d90 tx=0x7f9e4c01f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cbd314fbeeca0ab server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.736+0000 7f9e52a00640 1 -- 172.21.15.49:0/3593545114 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c0af600 con 0x7f9e540c63d0 2024-01-31T05:05:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.736+0000 7f9e52a00640 1 -- 172.21.15.49:0/3593545114 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c0ab050 con 0x7f9e540c63d0 2024-01-31T05:05:32.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.736+0000 7f9e52a00640 1 -- 172.21.15.49:0/3593545114 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c0af980 con 0x7f9e540c63d0 2024-01-31T05:05:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.736+0000 7f9e5aa00640 1 -- 172.21.15.49:0/3593545114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e540c63d0 msgr2=0x7f9e540cbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.736+0000 7f9e5aa00640 1 --2- 172.21.15.49:0/3593545114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e540c63d0 0x7f9e540cbab0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009d90 tx=0x7f9e4c01f130 comp rx=0 tx=0).stop 2024-01-31T05:05:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.736+0000 7f9e5aa00640 1 -- 172.21.15.49:0/3593545114 shutdown_connections 2024-01-31T05:05:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.736+0000 7f9e5aa00640 1 --2- 172.21.15.49:0/3593545114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e540c63d0 0x7f9e540cbab0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.736+0000 7f9e5aa00640 1 --2- 172.21.15.49:0/3593545114 >> v2:172.21.15.195:3300/0 conn(0x7f9e540cf670 0x7f9e540b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.736+0000 7f9e5aa00640 1 -- 172.21.15.49:0/3593545114 >> 172.21.15.49:0/3593545114 conn(0x7f9e540d0e60 msgr2=0x7f9e540d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:32.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.736+0000 7f9e5aa00640 1 -- 172.21.15.49:0/3593545114 shutdown_connections 2024-01-31T05:05:32.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.736+0000 7f9e5aa00640 1 -- 172.21.15.49:0/3593545114 wait complete. 2024-01-31T05:05:32.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e5aa00640 1 Processor -- start 2024-01-31T05:05:32.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e5aa00640 1 -- start start 2024-01-31T05:05:32.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e5aa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540c63d0 0x7f9e541f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e5aa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e540cf670 0x7f9e540cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e5aa00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e5415e7e0 0x7f9e540c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e5aa00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5414edb0 con 0x7f9e540c63d0 2024-01-31T05:05:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e5aa00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e541586d0 con 0x7f9e5415e7e0 2024-01-31T05:05:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e5aa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e540cd8d0 con 0x7f9e540cf670 2024-01-31T05:05:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e53e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540c63d0 0x7f9e541f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e53e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540c63d0 0x7f9e541f2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45778/0 (socket says 172.21.15.49:45778) 2024-01-31T05:05:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e53e00640 1 -- 172.21.15.49:0/3802570254 learned_addr learned my addr 172.21.15.49:0/3802570254 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e53400640 1 --2- 172.21.15.49:0/3802570254 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e540cf670 0x7f9e540cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e58a00640 1 --2- 172.21.15.49:0/3802570254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e5415e7e0 0x7f9e540c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e53e00640 1 -- 172.21.15.49:0/3802570254 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e540cf670 msgr2=0x7f9e540cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e53e00640 1 --2- 172.21.15.49:0/3802570254 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e540cf670 0x7f9e540cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e53e00640 1 -- 172.21.15.49:0/3802570254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e5415e7e0 msgr2=0x7f9e540c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:32.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e53e00640 1 --2- 172.21.15.49:0/3802570254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e5415e7e0 0x7f9e540c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e53e00640 1 -- 172.21.15.49:0/3802570254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c0094d0 con 0x7f9e540c63d0 2024-01-31T05:05:32.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e53e00640 1 --2- 172.21.15.49:0/3802570254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540c63d0 0x7f9e541f2670 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400c4d0 tx=0x7f9e4400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:32.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e4be00640 1 -- 172.21.15.49:0/3802570254 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e440074e0 con 0x7f9e540c63d0 2024-01-31T05:05:32.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e4be00640 1 -- 172.21.15.49:0/3802570254 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e44007640 con 0x7f9e540c63d0 2024-01-31T05:05:32.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e4be00640 1 -- 172.21.15.49:0/3802570254 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e44004a30 con 0x7f9e540c63d0 2024-01-31T05:05:32.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e5aa00640 1 -- 172.21.15.49:0/3802570254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e4c009a70 con 0x7f9e540c63d0 2024-01-31T05:05:32.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.740+0000 7f9e5aa00640 1 -- 172.21.15.49:0/3802570254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e541f6780 con 0x7f9e540c63d0 2024-01-31T05:05:32.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.744+0000 7f9e5aa00640 1 -- 172.21.15.49:0/3802570254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e54074860 con 0x7f9e540c63d0 2024-01-31T05:05:32.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.744+0000 7f9e4be00640 1 -- 172.21.15.49:0/3802570254 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f9e44004b90 con 0x7f9e540c63d0 2024-01-31T05:05:32.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.744+0000 7f9e4be00640 1 --2- 172.21.15.49:0/3802570254 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9e2c066530 0x7f9e2c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:32.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.744+0000 7f9e4be00640 1 -- 172.21.15.49:0/3802570254 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9e440832c0 con 0x7f9e540c63d0 2024-01-31T05:05:32.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.744+0000 7f9e53400640 1 --2- 172.21.15.49:0/3802570254 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9e2c066530 0x7f9e2c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:32.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.744+0000 7f9e53400640 1 --2- 172.21.15.49:0/3802570254 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9e2c066530 0x7f9e2c0689f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9e540ccec0 tx=0x7f9e3c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.748+0000 7f9e4be00640 1 -- 172.21.15.49:0/3802570254 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9e44050250 con 0x7f9e540c63d0 2024-01-31T05:05:32.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.940+0000 7f9e5aa00640 1 -- 172.21.15.49:0/3802570254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e540c42f0 con 0x7f9e540c63d0 2024-01-31T05:05:32.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.940+0000 7f9e4be00640 1 -- 172.21.15.49:0/3802570254 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7f9e44053870 con 0x7f9e540c63d0 2024-01-31T05:05:32.945 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:32.945 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2308601440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":2308601440},{"type":"v1","addr":"172.21.15.49:6835","nonce":2308601440}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2920530340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":2920530340},{"type":"v1","addr":"172.21.15.195:6836","nonce":2920530340}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3114317228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3114317228},{"type":"v1","addr":"172.21.15.195:6837","nonce":3114317228}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-31T05:04:16.248649+0000","modified":"2024-01-31T05:04:39.667986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6834/4254852793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4254852793},{"type":"v1","addr":"172.21.15.49:6834","nonce":4254852793}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:05:32.945 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2024-01-31T05:05:32.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.944+0000 7f9e5aa00640 1 -- 172.21.15.49:0/3802570254 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9e2c066530 msgr2=0x7f9e2c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:32.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.944+0000 7f9e5aa00640 1 --2- 172.21.15.49:0/3802570254 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9e2c066530 0x7f9e2c0689f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9e540ccec0 tx=0x7f9e3c009240 comp rx=0 tx=0).stop 2024-01-31T05:05:32.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.944+0000 7f9e5aa00640 1 -- 172.21.15.49:0/3802570254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540c63d0 msgr2=0x7f9e541f2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:32.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.944+0000 7f9e5aa00640 1 --2- 172.21.15.49:0/3802570254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540c63d0 0x7f9e541f2670 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400c4d0 tx=0x7f9e4400c990 comp rx=0 tx=0).stop 2024-01-31T05:05:32.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.944+0000 7f9e5aa00640 1 -- 172.21.15.49:0/3802570254 shutdown_connections 2024-01-31T05:05:32.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.944+0000 7f9e5aa00640 1 --2- 172.21.15.49:0/3802570254 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9e2c066530 0x7f9e2c0689f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.944+0000 7f9e5aa00640 1 --2- 172.21.15.49:0/3802570254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e5415e7e0 0x7f9e540c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.944+0000 7f9e5aa00640 1 --2- 172.21.15.49:0/3802570254 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9e540cf670 0x7f9e540cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.944+0000 7f9e5aa00640 1 --2- 172.21.15.49:0/3802570254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540c63d0 0x7f9e541f2670 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:32.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.944+0000 7f9e5aa00640 1 -- 172.21.15.49:0/3802570254 >> 172.21.15.49:0/3802570254 conn(0x7f9e540d0e60 msgr2=0x7f9e5415d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:32.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.944+0000 7f9e5aa00640 1 -- 172.21.15.49:0/3802570254 shutdown_connections 2024-01-31T05:05:32.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:32.944+0000 7f9e5aa00640 1 -- 172.21.15.49:0/3802570254 wait complete. 2024-01-31T05:05:32.966 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:33.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.104+0000 7f512d400640 1 Processor -- start 2024-01-31T05:05:33.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.104+0000 7f512d400640 1 -- start start 2024-01-31T05:05:33.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f512d400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f51280cb040 0x7f512806c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f512d400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5128071e40 con 0x7f512815a000 2024-01-31T05:05:33.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f512d400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51280cb440 con 0x7f51280715e0 2024-01-31T05:05:33.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f512d400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51280b3760 con 0x7f51280cb040 2024-01-31T05:05:33.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5126800640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f512815a000 0x7f5128070ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55902/0 (socket says 172.21.15.49:55902) 2024-01-31T05:05:33.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5126800640 1 -- 172.21.15.49:0/4192294792 learned_addr learned my addr 172.21.15.49:0/4192294792 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:33.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5127200640 1 --2- 172.21.15.49:0/4192294792 >> v2:172.21.15.195:3300/0 conn(0x7f51280cb040 0x7f512806c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125400640 1 -- 172.21.15.49:0/4192294792 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341403875 0 0) 0x7f5128071e40 con 0x7f512815a000 2024-01-31T05:05:33.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125400640 1 -- 172.21.15.49:0/4192294792 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5108003530 con 0x7f512815a000 2024-01-31T05:05:33.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125400640 1 -- 172.21.15.49:0/4192294792 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306001552 0 0) 0x7f51280cb440 con 0x7f51280715e0 2024-01-31T05:05:33.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125400640 1 -- 172.21.15.49:0/4192294792 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5128071e40 con 0x7f51280715e0 2024-01-31T05:05:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125400640 1 -- 172.21.15.49:0/4192294792 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3572752024 0 0) 0x7f5108003530 con 0x7f512815a000 2024-01-31T05:05:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125400640 1 -- 172.21.15.49:0/4192294792 >> v2:172.21.15.195:3300/0 conn(0x7f51280cb040 msgr2=0x7f512806c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125400640 1 --2- 172.21.15.49:0/4192294792 >> v2:172.21.15.195:3300/0 conn(0x7f51280cb040 0x7f512806c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125400640 1 -- 172.21.15.49:0/4192294792 >> v1:172.21.15.195:6789/0 conn(0x7f51280715e0 legacy=0x7f51280ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125400640 1 -- 172.21.15.49:0/4192294792 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512806c990 con 0x7f512815a000 2024-01-31T05:05:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125400640 1 -- 172.21.15.49:0/4192294792 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7f5118001680 con 0x7f512815a000 2024-01-31T05:05:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125400640 1 -- 172.21.15.49:0/4192294792 >> v1:172.21.15.49:6789/0 conn(0x7f512815a000 legacy=0x7f5128070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125400640 1 --2- 172.21.15.49:0/4192294792 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5108003b10 0x7f5108003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125400640 1 --2- 172.21.15.49:0/4192294792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51080047d0 0x7f5108004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125400640 1 --2- 172.21.15.49:0/4192294792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5108005190 0x7f510800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125400640 1 -- 172.21.15.49:0/4192294792 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51280b3760 con 0x7f51080047d0 2024-01-31T05:05:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125400640 1 -- 172.21.15.49:0/4192294792 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510800c010 con 0x7f5108005190 2024-01-31T05:05:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125400640 1 -- 172.21.15.49:0/4192294792 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510800c1d0 con 0x7f5108003b10 2024-01-31T05:05:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5127200640 1 --2- 172.21.15.49:0/4192294792 >> v2:172.21.15.195:3300/0 conn(0x7f51280cb040 0x7f512806c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:33.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125e00640 1 --2- 172.21.15.49:0/4192294792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51080047d0 0x7f5108004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5126800640 1 --2- 172.21.15.49:0/4192294792 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5108003b10 0x7f5108003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5127200640 1 --2- 172.21.15.49:0/4192294792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5108005190 0x7f510800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125e00640 1 -- 172.21.15.49:0/4192294792 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5108003b10 msgr2=0x7f5108003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:33.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125e00640 1 --2- 172.21.15.49:0/4192294792 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5108003b10 0x7f5108003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125e00640 1 -- 172.21.15.49:0/4192294792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5108005190 msgr2=0x7f510800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:33.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125e00640 1 --2- 172.21.15.49:0/4192294792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5108005190 0x7f510800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5125e00640 1 -- 172.21.15.49:0/4192294792 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5108003530 con 0x7f51080047d0 2024-01-31T05:05:33.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5127200640 1 --2- 172.21.15.49:0/4192294792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5108005190 0x7f510800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:33.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.108+0000 7f5127200640 1 -- 172.21.15.49:0/4192294792 reap_dead start 2024-01-31T05:05:33.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.112+0000 7f5125e00640 1 --2- 172.21.15.49:0/4192294792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51080047d0 0x7f5108004c50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f51280cb5d0 tx=0x7f511001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0264c7b2438623 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:33.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.112+0000 7f5125400640 1 -- 172.21.15.49:0/4192294792 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51100052d0 con 0x7f51080047d0 2024-01-31T05:05:33.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.112+0000 7f5125400640 1 -- 172.21.15.49:0/4192294792 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5110005430 con 0x7f51080047d0 2024-01-31T05:05:33.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.112+0000 7f5125400640 1 -- 172.21.15.49:0/4192294792 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51100a8870 con 0x7f51080047d0 2024-01-31T05:05:33.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.112+0000 7f512d400640 1 -- 172.21.15.49:0/4192294792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51080047d0 msgr2=0x7f5108004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:33.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.112+0000 7f512d400640 1 --2- 172.21.15.49:0/4192294792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51080047d0 0x7f5108004c50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f51280cb5d0 tx=0x7f511001ec50 comp rx=0 tx=0).stop 2024-01-31T05:05:33.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.112+0000 7f512d400640 1 -- 172.21.15.49:0/4192294792 shutdown_connections 2024-01-31T05:05:33.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.112+0000 7f512d400640 1 --2- 172.21.15.49:0/4192294792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51080047d0 0x7f5108004c50 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.112+0000 7f512d400640 1 -- 172.21.15.49:0/4192294792 >> 172.21.15.49:0/4192294792 conn(0x7f51280b09a0 msgr2=0x7f51280b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:33.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.112+0000 7f512d400640 1 -- 172.21.15.49:0/4192294792 shutdown_connections 2024-01-31T05:05:33.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.112+0000 7f512d400640 1 -- 172.21.15.49:0/4192294792 wait complete. 2024-01-31T05:05:33.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f512d400640 1 Processor -- start 2024-01-31T05:05:33.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f512d400640 1 -- start start 2024-01-31T05:05:33.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f512d400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51080047d0 0x7f512814b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f512d400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51280cb680 0x7f51280ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f512d400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51280cab30 0x7f5128153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f512d400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51280ca1d0 con 0x7f51280cb680 2024-01-31T05:05:33.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f512d400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512814bd80 con 0x7f51080047d0 2024-01-31T05:05:33.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f512d400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51280c9550 con 0x7f51280cab30 2024-01-31T05:05:33.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f5125e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51280cb680 0x7f51280ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f5125e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51280cb680 0x7f51280ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45786/0 (socket says 172.21.15.49:45786) 2024-01-31T05:05:33.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f5125e00640 1 -- 172.21.15.49:0/1672683270 learned_addr learned my addr 172.21.15.49:0/1672683270 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:33.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f5127200640 1 --2- 172.21.15.49:0/1672683270 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51280cab30 0x7f5128153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f5126800640 1 --2- 172.21.15.49:0/1672683270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51080047d0 0x7f512814b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f5125e00640 1 -- 172.21.15.49:0/1672683270 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51280cab30 msgr2=0x7f5128153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:33.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f5125e00640 1 --2- 172.21.15.49:0/1672683270 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51280cab30 0x7f5128153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f5125e00640 1 -- 172.21.15.49:0/1672683270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51080047d0 msgr2=0x7f512814b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:33.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f5125e00640 1 --2- 172.21.15.49:0/1672683270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51080047d0 0x7f512814b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f5125e00640 1 -- 172.21.15.49:0/1672683270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51280c9830 con 0x7f51280cb680 2024-01-31T05:05:33.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f5125e00640 1 --2- 172.21.15.49:0/1672683270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51280cb680 0x7f51280ca5f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5110005040 tx=0x7f5108005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:33.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f511ea00640 1 -- 172.21.15.49:0/1672683270 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110007a60 con 0x7f51280cb680 2024-01-31T05:05:33.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f511ea00640 1 -- 172.21.15.49:0/1672683270 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51100050d0 con 0x7f51280cb680 2024-01-31T05:05:33.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f511ea00640 1 -- 172.21.15.49:0/1672683270 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110007260 con 0x7f51280cb680 2024-01-31T05:05:33.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f512d400640 1 -- 172.21.15.49:0/1672683270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51280c9b10 con 0x7f51280cb680 2024-01-31T05:05:33.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.116+0000 7f512d400640 1 -- 172.21.15.49:0/1672683270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5128151bc0 con 0x7f51280cb680 2024-01-31T05:05:33.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.120+0000 7f512d400640 1 -- 172.21.15.49:0/1672683270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5128074860 con 0x7f51280cb680 2024-01-31T05:05:33.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.120+0000 7f511ea00640 1 -- 172.21.15.49:0/1672683270 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f51100073c0 con 0x7f51280cb680 2024-01-31T05:05:33.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.120+0000 7f511ea00640 1 --2- 172.21.15.49:0/1672683270 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5100066500 0x7f51000689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.120+0000 7f511ea00640 1 -- 172.21.15.49:0/1672683270 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5110120dd0 con 0x7f51280cb680 2024-01-31T05:05:33.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.120+0000 7f5126800640 1 --2- 172.21.15.49:0/1672683270 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5100066500 0x7f51000689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.120+0000 7f5126800640 1 --2- 172.21.15.49:0/1672683270 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5100066500 0x7f51000689c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5118000c10 tx=0x7f5118007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:33.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.124+0000 7f511ea00640 1 -- 172.21.15.49:0/1672683270 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f51100edcc0 con 0x7f51280cb680 2024-01-31T05:05:33.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.288+0000 7f512d400640 1 -- 172.21.15.49:0/1672683270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5128074860 con 0x7f51280cb680 2024-01-31T05:05:33.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.288+0000 7f511ea00640 1 -- 172.21.15.49:0/1672683270 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18709 (secure 0 0 0) 0x7f51100f12e0 con 0x7f51280cb680 2024-01-31T05:05:33.291 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:33.291 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:04:58.277568+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:04:14.566345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:04:15.231265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-31T05:04:18.316756+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:33.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.292+0000 7f512d400640 1 -- 172.21.15.49:0/1672683270 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5100066500 msgr2=0x7f51000689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:33.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.292+0000 7f512d400640 1 --2- 172.21.15.49:0/1672683270 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5100066500 0x7f51000689c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5118000c10 tx=0x7f5118007040 comp rx=0 tx=0).stop 2024-01-31T05:05:33.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.292+0000 7f512d400640 1 -- 172.21.15.49:0/1672683270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51280cb680 msgr2=0x7f51280ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:33.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.292+0000 7f512d400640 1 --2- 172.21.15.49:0/1672683270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51280cb680 0x7f51280ca5f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5110005040 tx=0x7f5108005800 comp rx=0 tx=0).stop 2024-01-31T05:05:33.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.292+0000 7f512d400640 1 -- 172.21.15.49:0/1672683270 shutdown_connections 2024-01-31T05:05:33.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.292+0000 7f512d400640 1 --2- 172.21.15.49:0/1672683270 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f51280cab30 0x7f5128153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.292+0000 7f512d400640 1 --2- 172.21.15.49:0/1672683270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51280cb680 0x7f51280ca5f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.292+0000 7f512d400640 1 --2- 172.21.15.49:0/1672683270 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5100066500 0x7f51000689c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.292+0000 7f512d400640 1 --2- 172.21.15.49:0/1672683270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51080047d0 0x7f512814b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.292+0000 7f512d400640 1 -- 172.21.15.49:0/1672683270 >> 172.21.15.49:0/1672683270 conn(0x7f51280b09a0 msgr2=0x7f5128158f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:33.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.292+0000 7f512d400640 1 -- 172.21.15.49:0/1672683270 shutdown_connections 2024-01-31T05:05:33.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.292+0000 7f512d400640 1 -- 172.21.15.49:0/1672683270 wait complete. 2024-01-31T05:05:33.313 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-31T05:05:33.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.456+0000 7ffbd6e00640 1 Processor -- start 2024-01-31T05:05:33.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.456+0000 7ffbd6e00640 1 -- start start 2024-01-31T05:05:33.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.456+0000 7ffbd6e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffbd015b110 0x7ffbd006c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.456+0000 7ffbd6e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbd00714e0 0x7ffbd00ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.456+0000 7ffbd6e00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd015b4f0 con 0x7ffbd00cdf10 2024-01-31T05:05:33.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.456+0000 7ffbd6e00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd00ce460 con 0x7ffbd015b110 2024-01-31T05:05:33.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.456+0000 7ffbd6e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd00abf20 con 0x7ffbd00714e0 2024-01-31T05:05:33.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.456+0000 7ffbcfe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffbd015b110 0x7ffbd006c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.456+0000 7ffbcf400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7ffbd00cdf10 0x7ffbd0070dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55904/0 (socket says 172.21.15.49:55904) 2024-01-31T05:05:33.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.456+0000 7ffbcf400640 1 -- 172.21.15.49:0/3551041171 learned_addr learned my addr 172.21.15.49:0/3551041171 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:33.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.456+0000 7ffbcfe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ffbd015b110 0x7ffbd006c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45798/0 (socket says 172.21.15.49:45798) 2024-01-31T05:05:33.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.456+0000 7ffbcfe00640 1 -- 172.21.15.49:0/3551041171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbd00714e0 msgr2=0x7ffbd00ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:33.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.456+0000 7ffbd4e00640 1 --2- 172.21.15.49:0/3551041171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbd00714e0 0x7ffbd00ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.456+0000 7ffbcfe00640 1 --2- 172.21.15.49:0/3551041171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbd00714e0 0x7ffbd00ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.456+0000 7ffbcfe00640 1 -- 172.21.15.49:0/3551041171 >> v1:172.21.15.49:6789/0 conn(0x7ffbd00cdf10 legacy=0x7ffbd0070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:33.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.456+0000 7ffbcfe00640 1 -- 172.21.15.49:0/3551041171 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd00ac200 con 0x7ffbd015b110 2024-01-31T05:05:33.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.456+0000 7ffbcea00640 1 -- 172.21.15.49:0/3551041171 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378703739 0 0) 0x7ffbb8001120 con 0x7ffbd00cdf10 2024-01-31T05:05:33.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.456+0000 7ffbd4e00640 1 --2- 172.21.15.49:0/3551041171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbd00714e0 0x7ffbd00ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:33.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.460+0000 7ffbcfe00640 1 --2- 172.21.15.49:0/3551041171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbd015b110 0x7ffbd006c2d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00097c0 tx=0x7ffbc001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20c187d2809cef4 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:33.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.460+0000 7ffbcea00640 1 -- 172.21.15.49:0/3551041171 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc00ab670 con 0x7ffbd015b110 2024-01-31T05:05:33.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.460+0000 7ffbcea00640 1 -- 172.21.15.49:0/3551041171 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc00ab7d0 con 0x7ffbd015b110 2024-01-31T05:05:33.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.460+0000 7ffbcea00640 1 -- 172.21.15.49:0/3551041171 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc00abb60 con 0x7ffbd015b110 2024-01-31T05:05:33.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.460+0000 7ffbd6e00640 1 -- 172.21.15.49:0/3551041171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbd015b110 msgr2=0x7ffbd006c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:33.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.460+0000 7ffbd6e00640 1 --2- 172.21.15.49:0/3551041171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbd015b110 0x7ffbd006c2d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00097c0 tx=0x7ffbc001c450 comp rx=0 tx=0).stop 2024-01-31T05:05:33.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.460+0000 7ffbd6e00640 1 -- 172.21.15.49:0/3551041171 shutdown_connections 2024-01-31T05:05:33.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.460+0000 7ffbd6e00640 1 --2- 172.21.15.49:0/3551041171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbd00714e0 0x7ffbd00ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.460+0000 7ffbd6e00640 1 --2- 172.21.15.49:0/3551041171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbd015b110 0x7ffbd006c2d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.460+0000 7ffbd6e00640 1 -- 172.21.15.49:0/3551041171 >> 172.21.15.49:0/3551041171 conn(0x7ffbd00b09a0 msgr2=0x7ffbd00b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:33.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.460+0000 7ffbd6e00640 1 -- 172.21.15.49:0/3551041171 shutdown_connections 2024-01-31T05:05:33.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.460+0000 7ffbd6e00640 1 -- 172.21.15.49:0/3551041171 wait complete. 2024-01-31T05:05:33.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbd6e00640 1 Processor -- start 2024-01-31T05:05:33.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbd6e00640 1 -- start start 2024-01-31T05:05:33.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbd6e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbd00714e0 0x7ffbd0164150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbd6e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbd00cdf10 0x7ffbd01f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbd6e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbd015b110 0x7ffbd01f9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbd6e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd0164b30 con 0x7ffbd00714e0 2024-01-31T05:05:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbd6e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd0164e10 con 0x7ffbd00cdf10 2024-01-31T05:05:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbd6e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd01650f0 con 0x7ffbd015b110 2024-01-31T05:05:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbcfe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbd00714e0 0x7ffbd0164150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbcfe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbd00714e0 0x7ffbd0164150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45808/0 (socket says 172.21.15.49:45808) 2024-01-31T05:05:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbcfe00640 1 -- 172.21.15.49:0/1029665696 learned_addr learned my addr 172.21.15.49:0/1029665696 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbd4e00640 1 --2- 172.21.15.49:0/1029665696 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbd015b110 0x7ffbd01f9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbcfe00640 1 -- 172.21.15.49:0/1029665696 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbd015b110 msgr2=0x7ffbd01f9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbcfe00640 1 --2- 172.21.15.49:0/1029665696 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbd015b110 0x7ffbd01f9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbcf400640 1 --2- 172.21.15.49:0/1029665696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbd00cdf10 0x7ffbd01f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbcfe00640 1 -- 172.21.15.49:0/1029665696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbd00cdf10 msgr2=0x7ffbd01f97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbcfe00640 1 --2- 172.21.15.49:0/1029665696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbd00cdf10 0x7ffbd01f97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbcfe00640 1 -- 172.21.15.49:0/1029665696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc0009420 con 0x7ffbd00714e0 2024-01-31T05:05:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbd4e00640 1 --2- 172.21.15.49:0/1029665696 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbd015b110 0x7ffbd01f9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbcf400640 1 --2- 172.21.15.49:0/1029665696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbd00cdf10 0x7ffbd01f97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbcfe00640 1 --2- 172.21.15.49:0/1029665696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbd00714e0 0x7ffbd0164150 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00ad040 tx=0x7ffbc001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbc7e00640 1 -- 172.21.15.49:0/1029665696 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc00b5810 con 0x7ffbd00714e0 2024-01-31T05:05:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbc7e00640 1 -- 172.21.15.49:0/1029665696 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc00b5990 con 0x7ffbd00714e0 2024-01-31T05:05:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbc7e00640 1 -- 172.21.15.49:0/1029665696 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc00b5d40 con 0x7ffbd00714e0 2024-01-31T05:05:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbd6e00640 1 -- 172.21.15.49:0/1029665696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd01653d0 con 0x7ffbd00714e0 2024-01-31T05:05:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.464+0000 7ffbd6e00640 1 -- 172.21.15.49:0/1029665696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd0150650 con 0x7ffbd00714e0 2024-01-31T05:05:33.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.468+0000 7ffbd6e00640 1 -- 172.21.15.49:0/1029665696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd0074860 con 0x7ffbd00714e0 2024-01-31T05:05:33.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.468+0000 7ffbc7e00640 1 -- 172.21.15.49:0/1029665696 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ffbc00bf410 con 0x7ffbd00714e0 2024-01-31T05:05:33.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.468+0000 7ffbc7e00640 1 --2- 172.21.15.49:0/1029665696 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ffba8066500 0x7ffba80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.468+0000 7ffbc7e00640 1 -- 172.21.15.49:0/1029665696 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffbc011ed60 con 0x7ffbd00714e0 2024-01-31T05:05:33.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.468+0000 7ffbcf400640 1 --2- 172.21.15.49:0/1029665696 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ffba8066500 0x7ffba80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.468+0000 7ffbcf400640 1 --2- 172.21.15.49:0/1029665696 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ffba8066500 0x7ffba80689c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8007fd0 tx=0x7ffbb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:33.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.472+0000 7ffbc7e00640 1 -- 172.21.15.49:0/1029665696 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ffbc00ebc20 con 0x7ffbd00714e0 2024-01-31T05:05:33.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.668+0000 7ffbd6e00640 1 -- 172.21.15.49:0/1029665696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ffbd0165230 con 0x7ffbd00714e0 2024-01-31T05:05:33.670 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-01-31T05:05:33.668+0000 7f297d000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-31T05:05:33.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.672+0000 7ffbc7e00640 1 -- 172.21.15.49:0/1029665696 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7ffbd0165230 con 0x7ffbd00714e0 2024-01-31T05:05:33.672 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-31T05:05:33.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.672+0000 7ffbd6e00640 1 -- 172.21.15.49:0/1029665696 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ffba8066500 msgr2=0x7ffba80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:33.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.672+0000 7ffbd6e00640 1 --2- 172.21.15.49:0/1029665696 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ffba8066500 0x7ffba80689c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8007fd0 tx=0x7ffbb8009040 comp rx=0 tx=0).stop 2024-01-31T05:05:33.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.672+0000 7ffbd6e00640 1 -- 172.21.15.49:0/1029665696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbd00714e0 msgr2=0x7ffbd0164150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:33.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.672+0000 7ffbd6e00640 1 --2- 172.21.15.49:0/1029665696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbd00714e0 0x7ffbd0164150 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00ad040 tx=0x7ffbc001ac90 comp rx=0 tx=0).stop 2024-01-31T05:05:33.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.672+0000 7ffbd6e00640 1 -- 172.21.15.49:0/1029665696 shutdown_connections 2024-01-31T05:05:33.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.672+0000 7ffbd6e00640 1 --2- 172.21.15.49:0/1029665696 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffbd015b110 0x7ffbd01f9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.672+0000 7ffbd6e00640 1 --2- 172.21.15.49:0/1029665696 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ffba8066500 0x7ffba80689c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.672+0000 7ffbd6e00640 1 --2- 172.21.15.49:0/1029665696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbd00cdf10 0x7ffbd01f97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.672+0000 7ffbd6e00640 1 --2- 172.21.15.49:0/1029665696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbd00714e0 0x7ffbd0164150 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.672+0000 7ffbd6e00640 1 -- 172.21.15.49:0/1029665696 >> 172.21.15.49:0/1029665696 conn(0x7ffbd00b09a0 msgr2=0x7ffbd014e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:33.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.676+0000 7ffbd6e00640 1 -- 172.21.15.49:0/1029665696 shutdown_connections 2024-01-31T05:05:33.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.676+0000 7ffbd6e00640 1 -- 172.21.15.49:0/1029665696 wait complete. 2024-01-31T05:05:33.685 INFO:tasks.ceph.mds.c.smithi049.stderr: -4625> 2024-01-31T05:04:19.812+0000 7f7e3d200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-31T05:05:33.700 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-31T05:05:33.735 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-31T05:05:33.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.844+0000 7feb0f000640 1 Processor -- start 2024-01-31T05:05:33.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.844+0000 7feb0f000640 1 -- start start 2024-01-31T05:05:33.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.844+0000 7feb0f000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb08071110 0x7feb08161710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.844+0000 7feb0f000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feb080b2cc0 0x7feb080b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.844+0000 7feb0f000640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb080b3690 con 0x7feb080714f0 2024-01-31T05:05:33.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.844+0000 7feb0f000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb08161c50 con 0x7feb080b2cc0 2024-01-31T05:05:33.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.844+0000 7feb0f000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb080b27e0 con 0x7feb08071110 2024-01-31T05:05:33.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.844+0000 7feb0d000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feb080b2cc0 0x7feb080b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.844+0000 7feb07400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7feb080714f0 0x7feb0806daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55918/0 (socket says 172.21.15.49:55918) 2024-01-31T05:05:33.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.844+0000 7feb07400640 1 -- 172.21.15.49:0/353964067 learned_addr learned my addr 172.21.15.49:0/353964067 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:33.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.844+0000 7feb0d000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7feb080b2cc0 0x7feb080b3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45822/0 (socket says 172.21.15.49:45822) 2024-01-31T05:05:33.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.844+0000 7feb07e00640 1 --2- 172.21.15.49:0/353964067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb08071110 0x7feb08161710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.844+0000 7feb0d000640 1 -- 172.21.15.49:0/353964067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb08071110 msgr2=0x7feb08161710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:33.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.844+0000 7feb0d000640 1 --2- 172.21.15.49:0/353964067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb08071110 0x7feb08161710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.844+0000 7feb0d000640 1 -- 172.21.15.49:0/353964067 >> v1:172.21.15.49:6789/0 conn(0x7feb080714f0 legacy=0x7feb0806daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:33.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.844+0000 7feb0d000640 1 -- 172.21.15.49:0/353964067 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb080ade60 con 0x7feb080b2cc0 2024-01-31T05:05:33.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.844+0000 7feb07e00640 1 --2- 172.21.15.49:0/353964067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb08071110 0x7feb08161710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:33.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.848+0000 7feb0d000640 1 --2- 172.21.15.49:0/353964067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb080b2cc0 0x7feb080b3150 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7feb00009d90 tx=0x7feb0001c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5be10a14bae223 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:33.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.848+0000 7feb06a00640 1 -- 172.21.15.49:0/353964067 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb000a57d0 con 0x7feb080b2cc0 2024-01-31T05:05:33.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.848+0000 7feb06a00640 1 -- 172.21.15.49:0/353964067 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb000a5930 con 0x7feb080b2cc0 2024-01-31T05:05:33.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.848+0000 7feb06a00640 1 -- 172.21.15.49:0/353964067 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb000a5cc0 con 0x7feb080b2cc0 2024-01-31T05:05:33.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.848+0000 7feb0f000640 1 -- 172.21.15.49:0/353964067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb080b2cc0 msgr2=0x7feb080b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:33.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.848+0000 7feb0f000640 1 --2- 172.21.15.49:0/353964067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb080b2cc0 0x7feb080b3150 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7feb00009d90 tx=0x7feb0001c800 comp rx=0 tx=0).stop 2024-01-31T05:05:33.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.848+0000 7feb0f000640 1 -- 172.21.15.49:0/353964067 shutdown_connections 2024-01-31T05:05:33.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.848+0000 7feb0f000640 1 --2- 172.21.15.49:0/353964067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb080b2cc0 0x7feb080b3150 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.848+0000 7feb0f000640 1 --2- 172.21.15.49:0/353964067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb08071110 0x7feb08161710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.848+0000 7feb0f000640 1 -- 172.21.15.49:0/353964067 >> 172.21.15.49:0/353964067 conn(0x7feb0806a940 msgr2=0x7feb0806ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:33.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.848+0000 7feb0f000640 1 -- 172.21.15.49:0/353964067 shutdown_connections 2024-01-31T05:05:33.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.848+0000 7feb0f000640 1 -- 172.21.15.49:0/353964067 wait complete. 2024-01-31T05:05:33.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb0f000640 1 Processor -- start 2024-01-31T05:05:33.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb0f000640 1 -- start start 2024-01-31T05:05:33.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb0f000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb08071110 0x7feb08154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb0f000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb080714f0 0x7feb08153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb0f000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb080b2cc0 0x7feb0814c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb0f000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb081555b0 con 0x7feb08071110 2024-01-31T05:05:33.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb0f000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb08155890 con 0x7feb080b2cc0 2024-01-31T05:05:33.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb0f000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb08155b70 con 0x7feb080714f0 2024-01-31T05:05:33.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb07e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb08071110 0x7feb08154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb07e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb08071110 0x7feb08154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45836/0 (socket says 172.21.15.49:45836) 2024-01-31T05:05:33.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb07e00640 1 -- 172.21.15.49:0/146308366 learned_addr learned my addr 172.21.15.49:0/146308366 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:33.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb07400640 1 --2- 172.21.15.49:0/146308366 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb080714f0 0x7feb08153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb0d000640 1 --2- 172.21.15.49:0/146308366 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb080b2cc0 0x7feb0814c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb07e00640 1 -- 172.21.15.49:0/146308366 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb080714f0 msgr2=0x7feb08153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:33.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb07e00640 1 --2- 172.21.15.49:0/146308366 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb080714f0 0x7feb08153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb07e00640 1 -- 172.21.15.49:0/146308366 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb080b2cc0 msgr2=0x7feb0814c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:33.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb07e00640 1 --2- 172.21.15.49:0/146308366 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb080b2cc0 0x7feb0814c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb07e00640 1 -- 172.21.15.49:0/146308366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb00009a70 con 0x7feb08071110 2024-01-31T05:05:33.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb0d000640 1 --2- 172.21.15.49:0/146308366 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb080b2cc0 0x7feb0814c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:33.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb07e00640 1 --2- 172.21.15.49:0/146308366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb08071110 0x7feb08154ca0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7feaf800d800 tx=0x7feaf800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:33.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feaffe00640 1 -- 172.21.15.49:0/146308366 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf800b6c0 con 0x7feb08071110 2024-01-31T05:05:33.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feaffe00640 1 -- 172.21.15.49:0/146308366 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf800b820 con 0x7feb08071110 2024-01-31T05:05:33.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feaffe00640 1 -- 172.21.15.49:0/146308366 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf800bbd0 con 0x7feb08071110 2024-01-31T05:05:33.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb0f000640 1 -- 172.21.15.49:0/146308366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb08155e50 con 0x7feb08071110 2024-01-31T05:05:33.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb0f000640 1 -- 172.21.15.49:0/146308366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb08153e50 con 0x7feb08071110 2024-01-31T05:05:33.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.852+0000 7feb0f000640 1 -- 172.21.15.49:0/146308366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb08074860 con 0x7feb08071110 2024-01-31T05:05:33.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.856+0000 7feaffe00640 1 -- 172.21.15.49:0/146308366 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7feaf800bd30 con 0x7feb08071110 2024-01-31T05:05:33.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.856+0000 7feaffe00640 1 --2- 172.21.15.49:0/146308366 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7feae0066500 0x7feae00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:33.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.856+0000 7feaffe00640 1 -- 172.21.15.49:0/146308366 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7feaf80847a0 con 0x7feb08071110 2024-01-31T05:05:33.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.856+0000 7feb07400640 1 --2- 172.21.15.49:0/146308366 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7feae0066500 0x7feae00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:33.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.856+0000 7feb07400640 1 --2- 172.21.15.49:0/146308366 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7feae0066500 0x7feae00689c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feb0814ccd0 tx=0x7feaf0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:33.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:33.860+0000 7feaffe00640 1 -- 172.21.15.49:0/146308366 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7feaf8051620 con 0x7feb08071110 2024-01-31T05:05:34.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.052+0000 7feb0f000640 1 -- 172.21.15.49:0/146308366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7feb0814cdf0 con 0x7feb08071110 2024-01-31T05:05:34.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.672+0000 7feaffe00640 1 -- 172.21.15.49:0/146308366 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7feaf805b020 con 0x7feb08071110 2024-01-31T05:05:34.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.676+0000 7feb0f000640 1 -- 172.21.15.49:0/146308366 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7feae0066500 msgr2=0x7feae00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:34.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.676+0000 7feb0f000640 1 --2- 172.21.15.49:0/146308366 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7feae0066500 0x7feae00689c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feb0814ccd0 tx=0x7feaf0009040 comp rx=0 tx=0).stop 2024-01-31T05:05:34.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.676+0000 7feb0f000640 1 -- 172.21.15.49:0/146308366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb08071110 msgr2=0x7feb08154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:34.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.676+0000 7feb0f000640 1 --2- 172.21.15.49:0/146308366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb08071110 0x7feb08154ca0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7feaf800d800 tx=0x7feaf800dcc0 comp rx=0 tx=0).stop 2024-01-31T05:05:34.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.676+0000 7feb0f000640 1 -- 172.21.15.49:0/146308366 shutdown_connections 2024-01-31T05:05:34.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.676+0000 7feb0f000640 1 --2- 172.21.15.49:0/146308366 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7feae0066500 0x7feae00689c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:34.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.676+0000 7feb0f000640 1 --2- 172.21.15.49:0/146308366 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb080b2cc0 0x7feb0814c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:34.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.676+0000 7feb0f000640 1 --2- 172.21.15.49:0/146308366 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb080714f0 0x7feb08153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:34.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.676+0000 7feb0f000640 1 --2- 172.21.15.49:0/146308366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb08071110 0x7feb08154ca0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:34.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.676+0000 7feb0f000640 1 -- 172.21.15.49:0/146308366 >> 172.21.15.49:0/146308366 conn(0x7feb0806a940 msgr2=0x7feb080730a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:34.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.676+0000 7feb0f000640 1 -- 172.21.15.49:0/146308366 shutdown_connections 2024-01-31T05:05:34.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.676+0000 7feb0f000640 1 -- 172.21.15.49:0/146308366 wait complete. 2024-01-31T05:05:34.702 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-31T05:05:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.892+0000 7f1560e00640 1 Processor -- start 2024-01-31T05:05:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.892+0000 7f1560e00640 1 -- start start 2024-01-31T05:05:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.892+0000 7f1560e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f155c0cdf10 0x7f155c070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.892+0000 7f1560e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f155c0ce610 0x7f155c071310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.892+0000 7f1560e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c15b4f0 con 0x7f155c15b110 2024-01-31T05:05:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.892+0000 7f1560e00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155c0ce460 con 0x7f155c0cdf10 2024-01-31T05:05:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.892+0000 7f1560e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155c071850 con 0x7f155c0ce610 2024-01-31T05:05:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.892+0000 7f1559400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f155c0cdf10 0x7f155c070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.892+0000 7f1559400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f155c0cdf10 0x7f155c070dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45846/0 (socket says 172.21.15.49:45846) 2024-01-31T05:05:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.892+0000 7f1559400640 1 -- 172.21.15.49:0/2581528143 learned_addr learned my addr 172.21.15.49:0/2581528143 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.892+0000 7f155a800640 1 --2- 172.21.15.49:0/2581528143 >> v2:172.21.15.195:3300/0 conn(0x7f155c0ce610 0x7f155c071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.892+0000 7f1559400640 1 -- 172.21.15.49:0/2581528143 >> v2:172.21.15.195:3300/0 conn(0x7f155c0ce610 msgr2=0x7f155c071310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:34.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.892+0000 7f1559400640 1 --2- 172.21.15.49:0/2581528143 >> v2:172.21.15.195:3300/0 conn(0x7f155c0ce610 0x7f155c071310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:34.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.892+0000 7f1559400640 1 -- 172.21.15.49:0/2581528143 >> v1:172.21.15.195:6789/0 conn(0x7f155c15b110 legacy=0x7f155c06c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:34.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.892+0000 7f1559400640 1 -- 172.21.15.49:0/2581528143 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c0abf20 con 0x7f155c0cdf10 2024-01-31T05:05:34.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.896+0000 7f1559400640 1 --2- 172.21.15.49:0/2581528143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f155c0cdf10 0x7f155c070dd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f155c072f80 tx=0x7f154401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3766a4e78a3ab77 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:34.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.896+0000 7f1558a00640 1 -- 172.21.15.49:0/2581528143 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15440aa650 con 0x7f155c0cdf10 2024-01-31T05:05:34.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.896+0000 7f1558a00640 1 -- 172.21.15.49:0/2581528143 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15440aa7b0 con 0x7f155c0cdf10 2024-01-31T05:05:34.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.896+0000 7f1558a00640 1 -- 172.21.15.49:0/2581528143 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15440aab40 con 0x7f155c0cdf10 2024-01-31T05:05:34.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.896+0000 7f1560e00640 1 -- 172.21.15.49:0/2581528143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f155c0cdf10 msgr2=0x7f155c070dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.896+0000 7f1560e00640 1 --2- 172.21.15.49:0/2581528143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f155c0cdf10 0x7f155c070dd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f155c072f80 tx=0x7f154401c4d0 comp rx=0 tx=0).stop 2024-01-31T05:05:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.896+0000 7f1560e00640 1 -- 172.21.15.49:0/2581528143 shutdown_connections 2024-01-31T05:05:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.896+0000 7f1560e00640 1 --2- 172.21.15.49:0/2581528143 >> v2:172.21.15.195:3300/0 conn(0x7f155c0ce610 0x7f155c071310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.896+0000 7f1560e00640 1 --2- 172.21.15.49:0/2581528143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f155c0cdf10 0x7f155c070dd0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.896+0000 7f1560e00640 1 -- 172.21.15.49:0/2581528143 >> 172.21.15.49:0/2581528143 conn(0x7f155c0b09a0 msgr2=0x7f155c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.896+0000 7f1560e00640 1 -- 172.21.15.49:0/2581528143 shutdown_connections 2024-01-31T05:05:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.896+0000 7f1560e00640 1 -- 172.21.15.49:0/2581528143 wait complete. 2024-01-31T05:05:34.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1560e00640 1 Processor -- start 2024-01-31T05:05:34.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1560e00640 1 -- start start 2024-01-31T05:05:34.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1560e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f155c0cdf10 0x7f155c144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:34.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1560e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f155c0ce610 0x7f155c0ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:34.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1560e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f155c15b110 0x7f155c0aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:34.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1560e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c144ff0 con 0x7f155c0ce610 2024-01-31T05:05:34.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1560e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c14a5a0 con 0x7f155c0cdf10 2024-01-31T05:05:34.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1560e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155c149d00 con 0x7f155c15b110 2024-01-31T05:05:34.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1559400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f155c0ce610 0x7f155c0ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:34.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1559e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f155c0cdf10 0x7f155c144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:34.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1559400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f155c0ce610 0x7f155c0ae810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45848/0 (socket says 172.21.15.49:45848) 2024-01-31T05:05:34.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1559400640 1 -- 172.21.15.49:0/4108095375 learned_addr learned my addr 172.21.15.49:0/4108095375 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:34.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f155a800640 1 --2- 172.21.15.49:0/4108095375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f155c15b110 0x7f155c0aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:34.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1559400640 1 -- 172.21.15.49:0/4108095375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f155c15b110 msgr2=0x7f155c0aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:34.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1559400640 1 --2- 172.21.15.49:0/4108095375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f155c15b110 0x7f155c0aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:34.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1559400640 1 -- 172.21.15.49:0/4108095375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f155c0cdf10 msgr2=0x7f155c144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:34.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1559400640 1 --2- 172.21.15.49:0/4108095375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f155c0cdf10 0x7f155c144740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:34.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1559400640 1 -- 172.21.15.49:0/4108095375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15440094d0 con 0x7f155c0ce610 2024-01-31T05:05:34.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1559400640 1 --2- 172.21.15.49:0/4108095375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f155c0ce610 0x7f155c0ae810 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f15440ac040 tx=0x7f154401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:34.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1552000640 1 -- 172.21.15.49:0/4108095375 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15440b3800 con 0x7f155c0ce610 2024-01-31T05:05:34.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1552000640 1 -- 172.21.15.49:0/4108095375 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15440b3980 con 0x7f155c0ce610 2024-01-31T05:05:34.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1552000640 1 -- 172.21.15.49:0/4108095375 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15440b3d30 con 0x7f155c0ce610 2024-01-31T05:05:34.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1560e00640 1 -- 172.21.15.49:0/4108095375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155c149fe0 con 0x7f155c0ce610 2024-01-31T05:05:34.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.900+0000 7f1560e00640 1 -- 172.21.15.49:0/4108095375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155c14ba10 con 0x7f155c0ce610 2024-01-31T05:05:34.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.904+0000 7f1560e00640 1 -- 172.21.15.49:0/4108095375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155c074860 con 0x7f155c0ce610 2024-01-31T05:05:34.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.904+0000 7f1552000640 1 -- 172.21.15.49:0/4108095375 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f15440b2380 con 0x7f155c0ce610 2024-01-31T05:05:34.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.904+0000 7f1552000640 1 --2- 172.21.15.49:0/4108095375 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1534066500 0x7f15340689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:34.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.904+0000 7f1552000640 1 -- 172.21.15.49:0/4108095375 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f154411e2d0 con 0x7f155c0ce610 2024-01-31T05:05:34.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.904+0000 7f1559e00640 1 --2- 172.21.15.49:0/4108095375 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1534066500 0x7f15340689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:34.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.908+0000 7f1559e00640 1 --2- 172.21.15.49:0/4108095375 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1534066500 0x7f15340689c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f154c001770 tx=0x7f154c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:34.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:34.908+0000 7f1552000640 1 -- 172.21.15.49:0/4108095375 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f15440eb290 con 0x7f155c0ce610 2024-01-31T05:05:35.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.072+0000 7f1560e00640 1 -- 172.21.15.49:0/4108095375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f155c0b17d0 con 0x7f155c0ce610 2024-01-31T05:05:35.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.672+0000 7f1552000640 1 -- 172.21.15.49:0/4108095375 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f15440ee8b0 con 0x7f155c0ce610 2024-01-31T05:05:35.676 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-01-31T05:05:35.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.676+0000 7f1560e00640 1 -- 172.21.15.49:0/4108095375 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1534066500 msgr2=0x7f15340689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:35.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.676+0000 7f1560e00640 1 --2- 172.21.15.49:0/4108095375 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1534066500 0x7f15340689c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f154c001770 tx=0x7f154c009040 comp rx=0 tx=0).stop 2024-01-31T05:05:35.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.676+0000 7f1560e00640 1 -- 172.21.15.49:0/4108095375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f155c0ce610 msgr2=0x7f155c0ae810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:35.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.676+0000 7f1560e00640 1 --2- 172.21.15.49:0/4108095375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f155c0ce610 0x7f155c0ae810 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f15440ac040 tx=0x7f154401ad10 comp rx=0 tx=0).stop 2024-01-31T05:05:35.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.680+0000 7f1560e00640 1 -- 172.21.15.49:0/4108095375 shutdown_connections 2024-01-31T05:05:35.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.680+0000 7f1560e00640 1 --2- 172.21.15.49:0/4108095375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f155c15b110 0x7f155c0aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:35.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.680+0000 7f1560e00640 1 --2- 172.21.15.49:0/4108095375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f155c0ce610 0x7f155c0ae810 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:35.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.680+0000 7f1560e00640 1 --2- 172.21.15.49:0/4108095375 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1534066500 0x7f15340689c0 secure :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f154c001770 tx=0x7f154c009040 comp rx=0 tx=0).stop 2024-01-31T05:05:35.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.680+0000 7f1560e00640 1 --2- 172.21.15.49:0/4108095375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f155c0cdf10 0x7f155c144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:35.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.680+0000 7f1560e00640 1 -- 172.21.15.49:0/4108095375 >> 172.21.15.49:0/4108095375 conn(0x7f155c0b09a0 msgr2=0x7f155c0710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:35.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.680+0000 7f1560e00640 1 -- 172.21.15.49:0/4108095375 shutdown_connections 2024-01-31T05:05:35.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.680+0000 7f1560e00640 1 -- 172.21.15.49:0/4108095375 wait complete. 2024-01-31T05:05:35.707 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-31T05:05:35.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.852+0000 7f85a9400640 1 Processor -- start 2024-01-31T05:05:35.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.852+0000 7f85a9400640 1 -- start start 2024-01-31T05:05:35.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.852+0000 7f85a9400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85a40cdf10 0x7f85a4070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:35.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.856+0000 7f85a9400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a415b4f0 con 0x7f85a40ce610 2024-01-31T05:05:35.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.856+0000 7f85a9400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a40abf20 con 0x7f85a415b110 2024-01-31T05:05:35.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.856+0000 7f85a9400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a40ce460 con 0x7f85a40cdf10 2024-01-31T05:05:35.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.856+0000 7f85a3200640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f85a40ce610 0x7f85a40ad800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:55934/0 (socket says 172.21.15.49:55934) 2024-01-31T05:05:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.856+0000 7f85a3200640 1 -- 172.21.15.49:0/3119381591 learned_addr learned my addr 172.21.15.49:0/3119381591 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.856+0000 7f85a1e00640 1 --2- 172.21.15.49:0/3119381591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85a40cdf10 0x7f85a4070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.856+0000 7f85a1400640 1 -- 172.21.15.49:0/3119381591 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709929363 0 0) 0x7f859c0014a0 con 0x7f85a40ce610 2024-01-31T05:05:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.856+0000 7f85a1400640 1 -- 172.21.15.49:0/3119381591 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8584003530 con 0x7f85a40ce610 2024-01-31T05:05:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.856+0000 7f85a1400640 1 -- 172.21.15.49:0/3119381591 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675609118 0 0) 0x7f85a40abf20 con 0x7f85a415b110 2024-01-31T05:05:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.856+0000 7f85a1400640 1 -- 172.21.15.49:0/3119381591 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f859c0014a0 con 0x7f85a415b110 2024-01-31T05:05:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.856+0000 7f85a1e00640 1 -- 172.21.15.49:0/3119381591 >> v1:172.21.15.195:6789/0 conn(0x7f85a415b110 legacy=0x7f85a406c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.856+0000 7f85a1e00640 1 -- 172.21.15.49:0/3119381591 >> v1:172.21.15.49:6789/0 conn(0x7f85a40ce610 legacy=0x7f85a40ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.856+0000 7f85a1e00640 1 -- 172.21.15.49:0/3119381591 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a40ac200 con 0x7f85a40cdf10 2024-01-31T05:05:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.860+0000 7f85a1e00640 1 --2- 172.21.15.49:0/3119381591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85a40cdf10 0x7f85a4070dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f858c0097f0 tx=0x7f858c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bce4ffb9c937e35 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.860+0000 7f85a1400640 1 -- 172.21.15.49:0/3119381591 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c0ac600 con 0x7f85a40cdf10 2024-01-31T05:05:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.860+0000 7f85a1400640 1 -- 172.21.15.49:0/3119381591 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858c0a8050 con 0x7f85a40cdf10 2024-01-31T05:05:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.860+0000 7f85a1400640 1 -- 172.21.15.49:0/3119381591 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c0ac980 con 0x7f85a40cdf10 2024-01-31T05:05:35.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.860+0000 7f85a9400640 1 -- 172.21.15.49:0/3119381591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85a40cdf10 msgr2=0x7f85a4070dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:35.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.860+0000 7f85a9400640 1 --2- 172.21.15.49:0/3119381591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85a40cdf10 0x7f85a4070dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f858c0097f0 tx=0x7f858c01c490 comp rx=0 tx=0).stop 2024-01-31T05:05:35.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.860+0000 7f85a9400640 1 -- 172.21.15.49:0/3119381591 shutdown_connections 2024-01-31T05:05:35.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.860+0000 7f85a9400640 1 --2- 172.21.15.49:0/3119381591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85a40cdf10 0x7f85a4070dd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:35.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.860+0000 7f85a9400640 1 -- 172.21.15.49:0/3119381591 >> 172.21.15.49:0/3119381591 conn(0x7f85a40b09a0 msgr2=0x7f85a40b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:35.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.860+0000 7f85a9400640 1 -- 172.21.15.49:0/3119381591 shutdown_connections 2024-01-31T05:05:35.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.860+0000 7f85a9400640 1 -- 172.21.15.49:0/3119381591 wait complete. 2024-01-31T05:05:35.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.860+0000 7f85a9400640 1 Processor -- start 2024-01-31T05:05:35.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.860+0000 7f85a9400640 1 -- start start 2024-01-31T05:05:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a9400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85a40cdf10 0x7f85a414d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a9400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85a40ce610 0x7f85a414ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a9400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85a415b110 0x7f85a409bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a9400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a40b2bd0 con 0x7f85a415b110 2024-01-31T05:05:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a9400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a40b2e20 con 0x7f85a40cdf10 2024-01-31T05:05:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a9400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a409b550 con 0x7f85a40ce610 2024-01-31T05:05:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a3200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85a415b110 0x7f85a409bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a3200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85a415b110 0x7f85a409bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45858/0 (socket says 172.21.15.49:45858) 2024-01-31T05:05:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a3200640 1 -- 172.21.15.49:0/1825349063 learned_addr learned my addr 172.21.15.49:0/1825349063 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a1e00640 1 --2- 172.21.15.49:0/1825349063 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85a40ce610 0x7f85a414ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a2800640 1 --2- 172.21.15.49:0/1825349063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85a40cdf10 0x7f85a414d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a3200640 1 -- 172.21.15.49:0/1825349063 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85a40ce610 msgr2=0x7f85a414ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a3200640 1 --2- 172.21.15.49:0/1825349063 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85a40ce610 0x7f85a414ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a3200640 1 -- 172.21.15.49:0/1825349063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85a40cdf10 msgr2=0x7f85a414d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a3200640 1 --2- 172.21.15.49:0/1825349063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85a40cdf10 0x7f85a414d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a3200640 1 -- 172.21.15.49:0/1825349063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c009420 con 0x7f85a415b110 2024-01-31T05:05:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a3200640 1 --2- 172.21.15.49:0/1825349063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85a415b110 0x7f85a409bd50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f859c001f60 tx=0x7f859c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f859aa00640 1 -- 172.21.15.49:0/1825349063 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c012400 con 0x7f85a415b110 2024-01-31T05:05:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f859aa00640 1 -- 172.21.15.49:0/1825349063 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859c012560 con 0x7f85a415b110 2024-01-31T05:05:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a9400640 1 -- 172.21.15.49:0/1825349063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a409b830 con 0x7f85a415b110 2024-01-31T05:05:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f859aa00640 1 -- 172.21.15.49:0/1825349063 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c0128d0 con 0x7f85a415b110 2024-01-31T05:05:35.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a9400640 1 -- 172.21.15.49:0/1825349063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a414d010 con 0x7f85a415b110 2024-01-31T05:05:35.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.864+0000 7f85a9400640 1 -- 172.21.15.49:0/1825349063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a414d260 con 0x7f85a415b110 2024-01-31T05:05:35.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.868+0000 7f859aa00640 1 -- 172.21.15.49:0/1825349063 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f859c007070 con 0x7f85a415b110 2024-01-31T05:05:35.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.868+0000 7f859aa00640 1 --2- 172.21.15.49:0/1825349063 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f857c066500 0x7f857c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:35.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.868+0000 7f859aa00640 1 -- 172.21.15.49:0/1825349063 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f859c084000 con 0x7f85a415b110 2024-01-31T05:05:35.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.868+0000 7f85a2800640 1 --2- 172.21.15.49:0/1825349063 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f857c066500 0x7f857c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:35.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.868+0000 7f85a2800640 1 --2- 172.21.15.49:0/1825349063 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f857c066500 0x7f857c0689c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f85940011f0 tx=0x7f8594009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:35.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:35.872+0000 7f859aa00640 1 -- 172.21.15.49:0/1825349063 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f85a414d260 con 0x7f85a415b110 2024-01-31T05:05:36.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.032+0000 7f85a9400640 1 -- 172.21.15.49:0/1825349063 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f85a415b4f0 con 0x7f85a415b110 2024-01-31T05:05:36.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.680+0000 7f859aa00640 1 -- 172.21.15.49:0/1825349063 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f85a415b4f0 con 0x7f85a415b110 2024-01-31T05:05:36.683 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-01-31T05:05:36.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.684+0000 7f85a9400640 1 -- 172.21.15.49:0/1825349063 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f857c066500 msgr2=0x7f857c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:36.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.684+0000 7f85a9400640 1 --2- 172.21.15.49:0/1825349063 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f857c066500 0x7f857c0689c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f85940011f0 tx=0x7f8594009040 comp rx=0 tx=0).stop 2024-01-31T05:05:36.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.684+0000 7f85a9400640 1 -- 172.21.15.49:0/1825349063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85a415b110 msgr2=0x7f85a409bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:36.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.684+0000 7f85a9400640 1 --2- 172.21.15.49:0/1825349063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85a415b110 0x7f85a409bd50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f859c001f60 tx=0x7f859c00a430 comp rx=0 tx=0).stop 2024-01-31T05:05:36.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.684+0000 7f85a9400640 1 -- 172.21.15.49:0/1825349063 shutdown_connections 2024-01-31T05:05:36.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.684+0000 7f85a9400640 1 --2- 172.21.15.49:0/1825349063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85a415b110 0x7f85a409bd50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:36.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.684+0000 7f85a9400640 1 --2- 172.21.15.49:0/1825349063 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85a40ce610 0x7f85a414ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:36.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.684+0000 7f85a9400640 1 --2- 172.21.15.49:0/1825349063 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f857c066500 0x7f857c0689c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:36.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.684+0000 7f85a9400640 1 --2- 172.21.15.49:0/1825349063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85a40cdf10 0x7f85a414d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:36.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.684+0000 7f85a9400640 1 -- 172.21.15.49:0/1825349063 >> 172.21.15.49:0/1825349063 conn(0x7f85a40b09a0 msgr2=0x7f85a4157720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:36.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.688+0000 7f85a9400640 1 -- 172.21.15.49:0/1825349063 shutdown_connections 2024-01-31T05:05:36.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.688+0000 7f85a9400640 1 -- 172.21.15.49:0/1825349063 wait complete. 2024-01-31T05:05:36.715 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-01-31T05:05:36.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.856+0000 7f09f6400640 1 Processor -- start 2024-01-31T05:05:36.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.856+0000 7f09f6400640 1 -- start start 2024-01-31T05:05:36.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.860+0000 7f09f6400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09f0071110 0x7f09f0161710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:36.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.860+0000 7f09f6400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f09f00b2cc0 0x7f09f00b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.860+0000 7f09f6400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f00b3690 con 0x7f09f00714f0 2024-01-31T05:05:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.860+0000 7f09f6400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f0161c50 con 0x7f09f00b2cc0 2024-01-31T05:05:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.860+0000 7f09f6400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f00b27e0 con 0x7f09f0071110 2024-01-31T05:05:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.860+0000 7f09efe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f09f00b2cc0 0x7f09f00b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.860+0000 7f09efe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f09f00b2cc0 0x7f09f00b3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45872/0 (socket says 172.21.15.49:45872) 2024-01-31T05:05:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.860+0000 7f09efe00640 1 -- 172.21.15.49:0/1232842018 learned_addr learned my addr 172.21.15.49:0/1232842018 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.860+0000 7f09ef400640 1 --2- 172.21.15.49:0/1232842018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09f0071110 0x7f09f0161710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.860+0000 7f09efe00640 1 -- 172.21.15.49:0/1232842018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09f0071110 msgr2=0x7f09f0161710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.860+0000 7f09efe00640 1 --2- 172.21.15.49:0/1232842018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09f0071110 0x7f09f0161710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.860+0000 7f09efe00640 1 -- 172.21.15.49:0/1232842018 >> v1:172.21.15.195:6789/0 conn(0x7f09f00714f0 legacy=0x7f09f006daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:36.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.860+0000 7f09efe00640 1 -- 172.21.15.49:0/1232842018 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f00ade60 con 0x7f09f00b2cc0 2024-01-31T05:05:36.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.864+0000 7f09efe00640 1 --2- 172.21.15.49:0/1232842018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09f00b2cc0 0x7f09f00b3150 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009e50 tx=0x7f09e801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f66c7382ba8e84a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:36.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.864+0000 7f09ee000640 1 -- 172.21.15.49:0/1232842018 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e80a5690 con 0x7f09f00b2cc0 2024-01-31T05:05:36.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.864+0000 7f09ee000640 1 -- 172.21.15.49:0/1232842018 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e80a57f0 con 0x7f09f00b2cc0 2024-01-31T05:05:36.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.864+0000 7f09ee000640 1 -- 172.21.15.49:0/1232842018 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e80a5b80 con 0x7f09f00b2cc0 2024-01-31T05:05:36.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.864+0000 7f09f6400640 1 -- 172.21.15.49:0/1232842018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09f00b2cc0 msgr2=0x7f09f00b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:36.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.864+0000 7f09f6400640 1 --2- 172.21.15.49:0/1232842018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09f00b2cc0 0x7f09f00b3150 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009e50 tx=0x7f09e801c8c0 comp rx=0 tx=0).stop 2024-01-31T05:05:36.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.864+0000 7f09f6400640 1 -- 172.21.15.49:0/1232842018 shutdown_connections 2024-01-31T05:05:36.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.864+0000 7f09f6400640 1 --2- 172.21.15.49:0/1232842018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09f00b2cc0 0x7f09f00b3150 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:36.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.864+0000 7f09f6400640 1 --2- 172.21.15.49:0/1232842018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09f0071110 0x7f09f0161710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:36.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.864+0000 7f09f6400640 1 -- 172.21.15.49:0/1232842018 >> 172.21.15.49:0/1232842018 conn(0x7f09f006a940 msgr2=0x7f09f006ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:36.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.864+0000 7f09f6400640 1 -- 172.21.15.49:0/1232842018 shutdown_connections 2024-01-31T05:05:36.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.864+0000 7f09f6400640 1 -- 172.21.15.49:0/1232842018 wait complete. 2024-01-31T05:05:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.864+0000 7f09f6400640 1 Processor -- start 2024-01-31T05:05:36.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.864+0000 7f09f6400640 1 -- start start 2024-01-31T05:05:36.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09f6400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09f0071110 0x7f09f015d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:36.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09f6400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09f00714f0 0x7f09f015ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:36.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09f6400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09f00b2cc0 0x7f09f014e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:36.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09f6400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f015de60 con 0x7f09f00b2cc0 2024-01-31T05:05:36.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09f6400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f015e140 con 0x7f09f0071110 2024-01-31T05:05:36.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09f6400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f015e420 con 0x7f09f00714f0 2024-01-31T05:05:36.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09efe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09f00b2cc0 0x7f09f014e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:36.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09efe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09f00b2cc0 0x7f09f014e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45874/0 (socket says 172.21.15.49:45874) 2024-01-31T05:05:36.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09efe00640 1 -- 172.21.15.49:0/1916382463 learned_addr learned my addr 172.21.15.49:0/1916382463 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:36.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09ef400640 1 --2- 172.21.15.49:0/1916382463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09f0071110 0x7f09f015d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:36.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09eea00640 1 --2- 172.21.15.49:0/1916382463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09f00714f0 0x7f09f015ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:36.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09efe00640 1 -- 172.21.15.49:0/1916382463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09f00714f0 msgr2=0x7f09f015ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:36.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09efe00640 1 --2- 172.21.15.49:0/1916382463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09f00714f0 0x7f09f015ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:36.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09efe00640 1 -- 172.21.15.49:0/1916382463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09f0071110 msgr2=0x7f09f015d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:36.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09efe00640 1 --2- 172.21.15.49:0/1916382463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09f0071110 0x7f09f015d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:36.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09efe00640 1 -- 172.21.15.49:0/1916382463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e8009b30 con 0x7f09f00b2cc0 2024-01-31T05:05:36.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09efe00640 1 --2- 172.21.15.49:0/1916382463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09f00b2cc0 0x7f09f014e410 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f09e801a4f0 tx=0x7f09e8019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:36.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09e7400640 1 -- 172.21.15.49:0/1916382463 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e80b8670 con 0x7f09f00b2cc0 2024-01-31T05:05:36.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09e7400640 1 -- 172.21.15.49:0/1916382463 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e80b87d0 con 0x7f09f00b2cc0 2024-01-31T05:05:36.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09e7400640 1 -- 172.21.15.49:0/1916382463 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e80b8b60 con 0x7f09f00b2cc0 2024-01-31T05:05:36.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09f6400640 1 -- 172.21.15.49:0/1916382463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f015e700 con 0x7f09f00b2cc0 2024-01-31T05:05:36.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09f6400640 1 -- 172.21.15.49:0/1916382463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f015f440 con 0x7f09f00b2cc0 2024-01-31T05:05:36.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09f6400640 1 -- 172.21.15.49:0/1916382463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f015e560 con 0x7f09f00b2cc0 2024-01-31T05:05:36.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.868+0000 7f09e7400640 1 -- 172.21.15.49:0/1916382463 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f09e80b8cc0 con 0x7f09f00b2cc0 2024-01-31T05:05:36.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.872+0000 7f09e7400640 1 --2- 172.21.15.49:0/1916382463 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f09c8066500 0x7f09c80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:36.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.872+0000 7f09e7400640 1 -- 172.21.15.49:0/1916382463 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f09e811f2d0 con 0x7f09f00b2cc0 2024-01-31T05:05:36.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.872+0000 7f09ef400640 1 --2- 172.21.15.49:0/1916382463 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f09c8066500 0x7f09c80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:36.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.872+0000 7f09ef400640 1 --2- 172.21.15.49:0/1916382463 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f09c8066500 0x7f09c80689c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f09e00079c0 tx=0x7f09e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:36.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:36.876+0000 7f09e7400640 1 -- 172.21.15.49:0/1916382463 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f09f015e560 con 0x7f09f00b2cc0 2024-01-31T05:05:37.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:37.040+0000 7f09f6400640 1 -- 172.21.15.49:0/1916382463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f09f015e560 con 0x7f09f00b2cc0 2024-01-31T05:05:37.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:37.684+0000 7f09e7400640 1 -- 172.21.15.49:0/1916382463 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f09f015e560 con 0x7f09f00b2cc0 2024-01-31T05:05:37.685 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data_ec' removed 2024-01-31T05:05:37.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:37.688+0000 7f09f6400640 1 -- 172.21.15.49:0/1916382463 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f09c8066500 msgr2=0x7f09c80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:37.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:37.688+0000 7f09f6400640 1 --2- 172.21.15.49:0/1916382463 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f09c8066500 0x7f09c80689c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f09e00079c0 tx=0x7f09e0008040 comp rx=0 tx=0).stop 2024-01-31T05:05:37.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:37.688+0000 7f09f6400640 1 -- 172.21.15.49:0/1916382463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09f00b2cc0 msgr2=0x7f09f014e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:37.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:37.688+0000 7f09f6400640 1 --2- 172.21.15.49:0/1916382463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09f00b2cc0 0x7f09f014e410 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f09e801a4f0 tx=0x7f09e8019660 comp rx=0 tx=0).stop 2024-01-31T05:05:37.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:37.688+0000 7f09f6400640 1 -- 172.21.15.49:0/1916382463 shutdown_connections 2024-01-31T05:05:37.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:37.688+0000 7f09f6400640 1 --2- 172.21.15.49:0/1916382463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09f00b2cc0 0x7f09f014e410 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:37.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:37.688+0000 7f09f6400640 1 --2- 172.21.15.49:0/1916382463 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09f00714f0 0x7f09f015ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:37.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:37.688+0000 7f09f6400640 1 --2- 172.21.15.49:0/1916382463 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f09c8066500 0x7f09c80689c0 secure :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f09e00079c0 tx=0x7f09e0008040 comp rx=0 tx=0).stop 2024-01-31T05:05:37.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:37.688+0000 7f09f6400640 1 --2- 172.21.15.49:0/1916382463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09f0071110 0x7f09f015d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:37.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:37.688+0000 7f09f6400640 1 -- 172.21.15.49:0/1916382463 >> 172.21.15.49:0/1916382463 conn(0x7f09f006a940 msgr2=0x7f09f00af220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:37.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:37.688+0000 7f09f6400640 1 -- 172.21.15.49:0/1916382463 shutdown_connections 2024-01-31T05:05:37.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:37.692+0000 7f09f6400640 1 -- 172.21.15.49:0/1916382463 wait complete. 2024-01-31T05:05:37.723 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-31T05:05:37.723 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-31T05:05:37.723 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-31T05:05:37.723 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T05:05:37.723 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-31T05:05:37.723 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-31T05:05:37.724 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-31T05:05:37.724 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T05:05:37.724 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-31T05:05:37.724 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-31T05:05:37.724 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-31T05:05:37.724 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T05:05:37.724 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-31T05:05:37.725 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-31T05:05:37.725 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-31T05:05:37.725 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T05:05:37.740 INFO:tasks.ceph.mds.c:Stopped 2024-01-31T05:05:37.741 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-31T05:05:37.742 INFO:tasks.ceph.mds.b:Stopped 2024-01-31T05:05:37.742 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-31T05:05:37.743 INFO:tasks.ceph.mds.d:Stopped 2024-01-31T05:05:37.743 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-31T05:05:37.787 INFO:tasks.ceph.mds.c:Started 2024-01-31T05:05:37.787 DEBUG:teuthology.parallel:result is None 2024-01-31T05:05:37.791 INFO:tasks.ceph.mds.b:Started 2024-01-31T05:05:37.791 DEBUG:teuthology.parallel:result is None 2024-01-31T05:05:37.792 INFO:tasks.ceph.mds.d:Started 2024-01-31T05:05:37.793 DEBUG:teuthology.parallel:result is None 2024-01-31T05:05:37.872 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-01-31T05:05:37.878 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2024-01-31T05:05:37.879 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2024-01-31T05:05:43.740 INFO:tasks.ceph.mds.a:Stopped 2024-01-31T05:05:43.741 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-31T05:05:43.745 INFO:tasks.ceph.mds.a:Started 2024-01-31T05:05:43.745 DEBUG:teuthology.parallel:result is None 2024-01-31T05:05:43.745 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-31T05:05:43.841 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-31T05:05:43.854 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-01-31T05:05:43.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.896+0000 7fdff0e00640 1 Processor -- start 2024-01-31T05:05:43.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.896+0000 7fdff0e00640 1 -- start start 2024-01-31T05:05:43.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.900+0000 7fdff0e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfec15e7f0 0x7fdfec06ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.900+0000 7fdff0e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdfec06d200 0x7fdfec0b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.900+0000 7fdff0e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfec06f260 con 0x7fdfec15e410 2024-01-31T05:05:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.900+0000 7fdff0e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfec0b24f0 con 0x7fdfec06d200 2024-01-31T05:05:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.900+0000 7fdff0e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec0b2d00 con 0x7fdfec15e7f0 2024-01-31T05:05:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.900+0000 7fdfe9400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfec15e7f0 0x7fdfec06ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.900+0000 7fdfe9400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfec15e7f0 0x7fdfec06ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:59768/0 (socket says 172.21.15.49:59768) 2024-01-31T05:05:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.900+0000 7fdfe9400640 1 -- 172.21.15.49:0/3777972248 learned_addr learned my addr 172.21.15.49:0/3777972248 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.900+0000 7fdfe9e00640 1 --1- 172.21.15.49:0/3777972248 >> v1:172.21.15.195:6789/0 conn(0x7fdfec15e410 0x7fdfec071970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:49146/0 (socket says 172.21.15.49:49146) 2024-01-31T05:05:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.900+0000 7fdfea800640 1 --2- 172.21.15.49:0/3777972248 >> v2:172.21.15.195:3300/0 conn(0x7fdfec06d200 0x7fdfec0b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.900+0000 7fdfe9400640 1 -- 172.21.15.49:0/3777972248 >> v2:172.21.15.195:3300/0 conn(0x7fdfec06d200 msgr2=0x7fdfec0b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:43.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.900+0000 7fdfe9400640 1 --2- 172.21.15.49:0/3777972248 >> v2:172.21.15.195:3300/0 conn(0x7fdfec06d200 0x7fdfec0b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:43.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.900+0000 7fdfe9400640 1 -- 172.21.15.49:0/3777972248 >> v1:172.21.15.195:6789/0 conn(0x7fdfec15e410 legacy=0x7fdfec071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:43.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.900+0000 7fdfe9400640 1 -- 172.21.15.49:0/3777972248 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfec06f4b0 con 0x7fdfec15e7f0 2024-01-31T05:05:43.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.900+0000 7fdfe8a00640 1 -- 172.21.15.49:0/3777972248 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270411175 0 0) 0x7fdfec06f260 con 0x7fdfec15e410 2024-01-31T05:05:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.904+0000 7fdfe9400640 1 --2- 172.21.15.49:0/3777972248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfec15e7f0 0x7fdfec06ccc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009870 tx=0x7fdfd401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dec0fd56256ff37c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.904+0000 7fdfe8a00640 1 -- 172.21.15.49:0/3777972248 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40ab600 con 0x7fdfec15e7f0 2024-01-31T05:05:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.904+0000 7fdfe8a00640 1 -- 172.21.15.49:0/3777972248 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd40a7050 con 0x7fdfec15e7f0 2024-01-31T05:05:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.904+0000 7fdfe8a00640 1 -- 172.21.15.49:0/3777972248 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40ab980 con 0x7fdfec15e7f0 2024-01-31T05:05:43.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.904+0000 7fdff0e00640 1 -- 172.21.15.49:0/3777972248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfec15e7f0 msgr2=0x7fdfec06ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:43.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.904+0000 7fdff0e00640 1 --2- 172.21.15.49:0/3777972248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfec15e7f0 0x7fdfec06ccc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009870 tx=0x7fdfd401c420 comp rx=0 tx=0).stop 2024-01-31T05:05:43.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.904+0000 7fdff0e00640 1 -- 172.21.15.49:0/3777972248 shutdown_connections 2024-01-31T05:05:43.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.904+0000 7fdff0e00640 1 --2- 172.21.15.49:0/3777972248 >> v2:172.21.15.195:3300/0 conn(0x7fdfec06d200 0x7fdfec0b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:43.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.904+0000 7fdff0e00640 1 --2- 172.21.15.49:0/3777972248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfec15e7f0 0x7fdfec06ccc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:43.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.904+0000 7fdff0e00640 1 -- 172.21.15.49:0/3777972248 >> 172.21.15.49:0/3777972248 conn(0x7fdfec0b11f0 msgr2=0x7fdfec0b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:43.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.904+0000 7fdff0e00640 1 -- 172.21.15.49:0/3777972248 shutdown_connections 2024-01-31T05:05:43.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.904+0000 7fdff0e00640 1 -- 172.21.15.49:0/3777972248 wait complete. 2024-01-31T05:05:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.904+0000 7fdff0e00640 1 Processor -- start 2024-01-31T05:05:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdff0e00640 1 -- start start 2024-01-31T05:05:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdff0e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfec06d200 0x7fdfec156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdff0e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfec15e410 0x7fdfec148020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:43.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdff0e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfec15e7f0 0x7fdfec0b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:43.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdff0e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec14bb90 con 0x7fdfec06d200 2024-01-31T05:05:43.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdff0e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec14be70 con 0x7fdfec15e7f0 2024-01-31T05:05:43.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdff0e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec14c150 con 0x7fdfec15e410 2024-01-31T05:05:43.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdfe9e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfec06d200 0x7fdfec156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:43.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdfe9e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfec06d200 0x7fdfec156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40504/0 (socket says 172.21.15.49:40504) 2024-01-31T05:05:43.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdfe9e00640 1 -- 172.21.15.49:0/772780889 learned_addr learned my addr 172.21.15.49:0/772780889 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:43.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdfea800640 1 --2- 172.21.15.49:0/772780889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfec15e7f0 0x7fdfec0b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:43.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdfe9400640 1 --2- 172.21.15.49:0/772780889 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfec15e410 0x7fdfec148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:43.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdfe9e00640 1 -- 172.21.15.49:0/772780889 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfec15e410 msgr2=0x7fdfec148020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:43.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdfe9e00640 1 --2- 172.21.15.49:0/772780889 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfec15e410 0x7fdfec148020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:43.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdfe9e00640 1 -- 172.21.15.49:0/772780889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfec15e7f0 msgr2=0x7fdfec0b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdfe9e00640 1 --2- 172.21.15.49:0/772780889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfec15e7f0 0x7fdfec0b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdfe9e00640 1 -- 172.21.15.49:0/772780889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd40094d0 con 0x7fdfec06d200 2024-01-31T05:05:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdfe9400640 1 --2- 172.21.15.49:0/772780889 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfec15e410 0x7fdfec148020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdfe9e00640 1 --2- 172.21.15.49:0/772780889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfec06d200 0x7fdfec156760 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0011f0 tx=0x7fdfdc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdfe2000640 1 -- 172.21.15.49:0/772780889 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc0074e0 con 0x7fdfec06d200 2024-01-31T05:05:43.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdfe2000640 1 -- 172.21.15.49:0/772780889 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfdc007640 con 0x7fdfec06d200 2024-01-31T05:05:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdff0e00640 1 -- 172.21.15.49:0/772780889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfec14c430 con 0x7fdfec06d200 2024-01-31T05:05:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdfe2000640 1 -- 172.21.15.49:0/772780889 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc004a10 con 0x7fdfec06d200 2024-01-31T05:05:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdff0e00640 1 -- 172.21.15.49:0/772780889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfec148730 con 0x7fdfec06d200 2024-01-31T05:05:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.908+0000 7fdff0e00640 1 -- 172.21.15.49:0/772780889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfec074860 con 0x7fdfec06d200 2024-01-31T05:05:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.912+0000 7fdfe2000640 1 -- 172.21.15.49:0/772780889 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fdfdc004b70 con 0x7fdfec06d200 2024-01-31T05:05:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.912+0000 7fdfe2000640 1 --2- 172.21.15.49:0/772780889 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdfc4066500 0x7fdfc40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:43.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.912+0000 7fdfe2000640 1 -- 172.21.15.49:0/772780889 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fdfdc082fc0 con 0x7fdfec06d200 2024-01-31T05:05:43.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.912+0000 7fdfe9400640 1 --2- 172.21.15.49:0/772780889 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdfc4066500 0x7fdfc40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:43.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.912+0000 7fdfe9400640 1 --2- 172.21.15.49:0/772780889 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdfc4066500 0x7fdfc40689c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40ad000 tx=0x7fdfd40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:43.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:43.916+0000 7fdfe2000640 1 -- 172.21.15.49:0/772780889 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fdfdc0b4590 con 0x7fdfec06d200 2024-01-31T05:05:44.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:44.088+0000 7fdff0e00640 1 -- 172.21.15.49:0/772780889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fdfec073d70 con 0x7fdfec06d200 2024-01-31T05:05:45.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.496+0000 7fdfe2000640 1 -- 172.21.15.49:0/772780889 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdfdc018080 con 0x7fdfec06d200 2024-01-31T05:05:45.500 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-01-31T05:05:45.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.500+0000 7fdff0e00640 1 -- 172.21.15.49:0/772780889 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdfc4066500 msgr2=0x7fdfc40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:45.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.500+0000 7fdff0e00640 1 --2- 172.21.15.49:0/772780889 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdfc4066500 0x7fdfc40689c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40ad000 tx=0x7fdfd40a6000 comp rx=0 tx=0).stop 2024-01-31T05:05:45.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.500+0000 7fdff0e00640 1 -- 172.21.15.49:0/772780889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfec06d200 msgr2=0x7fdfec156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:45.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.500+0000 7fdff0e00640 1 --2- 172.21.15.49:0/772780889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfec06d200 0x7fdfec156760 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0011f0 tx=0x7fdfdc00c9b0 comp rx=0 tx=0).stop 2024-01-31T05:05:45.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.500+0000 7fdff0e00640 1 -- 172.21.15.49:0/772780889 shutdown_connections 2024-01-31T05:05:45.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.500+0000 7fdff0e00640 1 --2- 172.21.15.49:0/772780889 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fdfc4066500 0x7fdfc40689c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:45.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.500+0000 7fdff0e00640 1 --2- 172.21.15.49:0/772780889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfec15e7f0 0x7fdfec0b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:45.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.500+0000 7fdff0e00640 1 --2- 172.21.15.49:0/772780889 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfec15e410 0x7fdfec148020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:45.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.500+0000 7fdff0e00640 1 --2- 172.21.15.49:0/772780889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfec06d200 0x7fdfec156760 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:45.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.500+0000 7fdff0e00640 1 -- 172.21.15.49:0/772780889 >> 172.21.15.49:0/772780889 conn(0x7fdfec0b11f0 msgr2=0x7fdfec0aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:45.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.500+0000 7fdff0e00640 1 -- 172.21.15.49:0/772780889 shutdown_connections 2024-01-31T05:05:45.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.500+0000 7fdff0e00640 1 -- 172.21.15.49:0/772780889 wait complete. 2024-01-31T05:05:45.527 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-31T05:05:45.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.672+0000 7fc1d0e00640 1 Processor -- start 2024-01-31T05:05:45.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.672+0000 7fc1d0e00640 1 -- start start 2024-01-31T05:05:45.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.672+0000 7fc1d0e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc1cc0b30e0 0x7fc1cc15e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:45.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.672+0000 7fc1d0e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1cc0b34c0 0x7fc1cc0720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:45.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.672+0000 7fc1d0e00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1cc0703c0 con 0x7fc1cc06c2d0 2024-01-31T05:05:45.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.672+0000 7fc1d0e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1cc0b1dd0 con 0x7fc1cc0b30e0 2024-01-31T05:05:45.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.672+0000 7fc1d0e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc070610 con 0x7fc1cc0b34c0 2024-01-31T05:05:45.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.672+0000 7fc1ca800640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc1cc06c2d0 0x7fc1cc0b22b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46292/0 (socket says 172.21.15.49:46292) 2024-01-31T05:05:45.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.672+0000 7fc1ca800640 1 -- 172.21.15.49:0/4016476907 learned_addr learned my addr 172.21.15.49:0/4016476907 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:45.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.672+0000 7fc1c9400640 1 --2- 172.21.15.49:0/4016476907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1cc0b34c0 0x7fc1cc0720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:45.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.672+0000 7fc1c9e00640 1 --2- 172.21.15.49:0/4016476907 >> v2:172.21.15.195:3300/0 conn(0x7fc1cc0b30e0 0x7fc1cc15e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:45.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.672+0000 7fc1c8a00640 1 -- 172.21.15.49:0/4016476907 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011153627 0 0) 0x7fc1cc0703c0 con 0x7fc1cc06c2d0 2024-01-31T05:05:45.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.672+0000 7fc1c8a00640 1 -- 172.21.15.49:0/4016476907 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1ac003530 con 0x7fc1cc06c2d0 2024-01-31T05:05:45.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.672+0000 7fc1c9400640 1 -- 172.21.15.49:0/4016476907 >> v2:172.21.15.195:3300/0 conn(0x7fc1cc0b30e0 msgr2=0x7fc1cc15e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:45.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.672+0000 7fc1c9400640 1 --2- 172.21.15.49:0/4016476907 >> v2:172.21.15.195:3300/0 conn(0x7fc1cc0b30e0 0x7fc1cc15e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:45.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.672+0000 7fc1c9400640 1 -- 172.21.15.49:0/4016476907 >> v1:172.21.15.49:6789/0 conn(0x7fc1cc06c2d0 legacy=0x7fc1cc0b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:45.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.672+0000 7fc1c9400640 1 -- 172.21.15.49:0/4016476907 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc0708f0 con 0x7fc1cc0b34c0 2024-01-31T05:05:45.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.672+0000 7fc1c9e00640 1 --2- 172.21.15.49:0/4016476907 >> v2:172.21.15.195:3300/0 conn(0x7fc1cc0b30e0 0x7fc1cc15e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:45.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.676+0000 7fc1c9400640 1 --2- 172.21.15.49:0/4016476907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1cc0b34c0 0x7fc1cc0720e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40097c0 tx=0x7fc1b401c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e83f4f1487c819ca server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:45.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.676+0000 7fc1c8a00640 1 -- 172.21.15.49:0/4016476907 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b40ab600 con 0x7fc1cc0b34c0 2024-01-31T05:05:45.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.676+0000 7fc1c8a00640 1 -- 172.21.15.49:0/4016476907 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b40a7050 con 0x7fc1cc0b34c0 2024-01-31T05:05:45.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.676+0000 7fc1c8a00640 1 -- 172.21.15.49:0/4016476907 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b40ab980 con 0x7fc1cc0b34c0 2024-01-31T05:05:45.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.676+0000 7fc1d0e00640 1 -- 172.21.15.49:0/4016476907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1cc0b34c0 msgr2=0x7fc1cc0720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:45.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.676+0000 7fc1d0e00640 1 --2- 172.21.15.49:0/4016476907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1cc0b34c0 0x7fc1cc0720e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40097c0 tx=0x7fc1b401c360 comp rx=0 tx=0).stop 2024-01-31T05:05:45.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1d0e00640 1 -- 172.21.15.49:0/4016476907 shutdown_connections 2024-01-31T05:05:45.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1d0e00640 1 --2- 172.21.15.49:0/4016476907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1cc0b34c0 0x7fc1cc0720e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:45.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1d0e00640 1 --2- 172.21.15.49:0/4016476907 >> v2:172.21.15.195:3300/0 conn(0x7fc1cc0b30e0 0x7fc1cc15e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:45.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1d0e00640 1 -- 172.21.15.49:0/4016476907 >> 172.21.15.49:0/4016476907 conn(0x7fc1cc0b09a0 msgr2=0x7fc1cc0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:45.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1d0e00640 1 -- 172.21.15.49:0/4016476907 shutdown_connections 2024-01-31T05:05:45.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1d0e00640 1 -- 172.21.15.49:0/4016476907 wait complete. 2024-01-31T05:05:45.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1d0e00640 1 Processor -- start 2024-01-31T05:05:45.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1d0e00640 1 -- start start 2024-01-31T05:05:45.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1d0e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1cc06c2d0 0x7fc1cc15d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:45.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1d0e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1cc0b30e0 0x7fc1cc151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:45.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1d0e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1cc0b34c0 0x7fc1cc151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:45.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1d0e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc15d650 con 0x7fc1cc06c2d0 2024-01-31T05:05:45.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1d0e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc152a00 con 0x7fc1cc0b34c0 2024-01-31T05:05:45.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1d0e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc152ce0 con 0x7fc1cc0b30e0 2024-01-31T05:05:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1c9e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1cc06c2d0 0x7fc1cc15d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1c9e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1cc06c2d0 0x7fc1cc15d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40514/0 (socket says 172.21.15.49:40514) 2024-01-31T05:05:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1c9e00640 1 -- 172.21.15.49:0/2735598681 learned_addr learned my addr 172.21.15.49:0/2735598681 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1c9e00640 1 -- 172.21.15.49:0/2735598681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1cc0b30e0 msgr2=0x7fc1cc151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1c9400640 1 --2- 172.21.15.49:0/2735598681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1cc0b30e0 0x7fc1cc151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1c9e00640 1 --2- 172.21.15.49:0/2735598681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1cc0b30e0 0x7fc1cc151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1c9e00640 1 -- 172.21.15.49:0/2735598681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1cc0b34c0 msgr2=0x7fc1cc151b50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-31T05:05:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1c9e00640 1 --2- 172.21.15.49:0/2735598681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1cc0b34c0 0x7fc1cc151b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1c9e00640 1 -- 172.21.15.49:0/2735598681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc009420 con 0x7fc1cc06c2d0 2024-01-31T05:05:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.680+0000 7fc1c9400640 1 --2- 172.21.15.49:0/2735598681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1cc0b30e0 0x7fc1cc151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:45.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.684+0000 7fc1c9e00640 1 --2- 172.21.15.49:0/2735598681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1cc06c2d0 0x7fc1cc15d110 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00e980 tx=0x7fc1bc00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.684+0000 7fc1c2000640 1 -- 172.21.15.49:0/2735598681 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc00ca00 con 0x7fc1cc06c2d0 2024-01-31T05:05:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.684+0000 7fc1c2000640 1 -- 172.21.15.49:0/2735598681 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc00cb60 con 0x7fc1cc06c2d0 2024-01-31T05:05:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.684+0000 7fc1c2000640 1 -- 172.21.15.49:0/2735598681 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc013470 con 0x7fc1cc06c2d0 2024-01-31T05:05:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.684+0000 7fc1d0e00640 1 -- 172.21.15.49:0/2735598681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b4009420 con 0x7fc1cc06c2d0 2024-01-31T05:05:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.684+0000 7fc1d0e00640 1 -- 172.21.15.49:0/2735598681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1cc1458c0 con 0x7fc1cc06c2d0 2024-01-31T05:05:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.684+0000 7fc1d0e00640 1 -- 172.21.15.49:0/2735598681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1cc074860 con 0x7fc1cc06c2d0 2024-01-31T05:05:45.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.684+0000 7fc1c2000640 1 -- 172.21.15.49:0/2735598681 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fc1bc0135d0 con 0x7fc1cc06c2d0 2024-01-31T05:05:45.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.684+0000 7fc1c2000640 1 --2- 172.21.15.49:0/2735598681 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc1a4066500 0x7fc1a40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:45.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.684+0000 7fc1c2000640 1 -- 172.21.15.49:0/2735598681 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc1bc083fa0 con 0x7fc1cc06c2d0 2024-01-31T05:05:45.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.684+0000 7fc1c9400640 1 --2- 172.21.15.49:0/2735598681 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc1a4066500 0x7fc1a40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:45.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.688+0000 7fc1c9400640 1 --2- 172.21.15.49:0/2735598681 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc1a4066500 0x7fc1a40689c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40ad000 tx=0x7fc1b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:45.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.688+0000 7fc1c2000640 1 -- 172.21.15.49:0/2735598681 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fc1bc0513b0 con 0x7fc1cc06c2d0 2024-01-31T05:05:45.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.904+0000 7fc1d0e00640 1 -- 172.21.15.49:0/2735598681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc1cc06d7e0 con 0x7fc1cc06c2d0 2024-01-31T05:05:45.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.904+0000 7fc1c2000640 1 -- 172.21.15.49:0/2735598681 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fc1bc0549d0 con 0x7fc1cc06c2d0 2024-01-31T05:05:45.907 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:45.907 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-31T05:05:45.907 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-01-31T05:05:45.907 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.907 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-01-31T05:05:45.907 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQCY1LllRgvnMBAA3BYWBC0/fl5Gvll899MD7g==", 2024-01-31T05:05:45.907 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.907 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-31T05:05:45.907 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-31T05:05:45.907 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-31T05:05:45.908 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-31T05:05:45.908 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.908 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.908 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.908 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-01-31T05:05:45.911 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQCZ1Lll23dwARAAkG3+e6MVVJF8LxeTyNwB0A==", 2024-01-31T05:05:45.911 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.911 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-31T05:05:45.911 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-31T05:05:45.911 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-31T05:05:45.912 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-31T05:05:45.912 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.912 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.912 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.912 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-01-31T05:05:45.912 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQCY1LllJZAcOBAAwMq+vcaQl51OdBxerAztrw==", 2024-01-31T05:05:45.912 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.912 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-31T05:05:45.912 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-31T05:05:45.912 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-31T05:05:45.913 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-31T05:05:45.913 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.913 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.913 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.913 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-01-31T05:05:45.913 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQCZ1LlljVHWCBAAAVFPnilNINqpiIXsukKEww==", 2024-01-31T05:05:45.913 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.913 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-31T05:05:45.913 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-31T05:05:45.913 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-31T05:05:45.913 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-31T05:05:45.913 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.913 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.914 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.914 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-01-31T05:05:45.914 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQCa1LllZHqtKRAACPOUV8UQ0O2ckzyKxtvbuA==", 2024-01-31T05:05:45.914 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.914 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-31T05:05:45.914 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-31T05:05:45.914 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-31T05:05:45.914 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.914 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.914 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.914 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-01-31T05:05:45.914 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQCd1Lll87olLxAAxTUbY3RQ3f3Ad3RBKSskWw==", 2024-01-31T05:05:45.914 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.914 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-31T05:05:45.915 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-31T05:05:45.915 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-31T05:05:45.915 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.915 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.915 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.915 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-01-31T05:05:45.915 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQCg1LllsbmTNRAA5FXB5wozClzv8BDzzj3QQA==", 2024-01-31T05:05:45.915 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.915 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-31T05:05:45.915 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-31T05:05:45.915 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-31T05:05:45.915 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.915 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.915 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.916 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.3", 2024-01-31T05:05:45.916 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQCj1Lllh70gOhAA+ug2f/03UDSwOrz+8wQDtA==", 2024-01-31T05:05:45.916 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.916 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-31T05:05:45.916 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-31T05:05:45.916 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-31T05:05:45.916 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.916 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.916 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.916 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.4", 2024-01-31T05:05:45.916 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQCo1Lll/xTaDxAAIwRUvkJ+eKmVrkoTDAzsPw==", 2024-01-31T05:05:45.916 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.916 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-31T05:05:45.916 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-31T05:05:45.917 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-31T05:05:45.917 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.917 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.917 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.917 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.5", 2024-01-31T05:05:45.917 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQCr1Lll/28nFRAAuSRVwgj9fiyojsjOXHsfKQ==", 2024-01-31T05:05:45.917 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.917 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-31T05:05:45.917 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-31T05:05:45.917 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-31T05:05:45.918 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.918 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.918 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.918 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.6", 2024-01-31T05:05:45.918 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQCu1Lll7HS9GhAA9bHLgNVDAWqfnX/PQRJyZg==", 2024-01-31T05:05:45.918 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.918 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-31T05:05:45.918 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-31T05:05:45.918 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-31T05:05:45.918 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.918 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.919 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.919 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.7", 2024-01-31T05:05:45.919 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQCx1LlliWHJHhAAZC9SvJsq4VwFmuwwkfWy1g==", 2024-01-31T05:05:45.919 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.919 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-01-31T05:05:45.919 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-01-31T05:05:45.919 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-31T05:05:45.919 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.919 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.919 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.919 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-01-31T05:05:45.919 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQCZ1LllVFD5DBAAC6IpXFam5AMJ6kFP7OS6Wg==", 2024-01-31T05:05:45.919 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.920 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-31T05:05:45.920 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-31T05:05:45.920 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-31T05:05:45.920 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-31T05:05:45.920 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.921 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.921 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.921 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-01-31T05:05:45.921 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQCZ1LllpR6ZFhAA1+zpPPhNi9ueSvfdXPBx9A==", 2024-01-31T05:05:45.921 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.921 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-31T05:05:45.922 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-31T05:05:45.922 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-31T05:05:45.922 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-31T05:05:45.922 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.922 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.922 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.922 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.2", 2024-01-31T05:05:45.923 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQCZ1Llla+AgExAA8SBK+4ozSAndiZJJDqMTSQ==", 2024-01-31T05:05:45.923 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.923 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-31T05:05:45.923 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-31T05:05:45.923 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-31T05:05:45.923 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-31T05:05:45.923 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.924 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.924 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.924 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.3", 2024-01-31T05:05:45.924 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQCZ1LllY9OEHBAAXZhj3vXeFuhEOpqWNMZf0A==", 2024-01-31T05:05:45.924 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.924 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-01-31T05:05:45.925 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-01-31T05:05:45.925 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-01-31T05:05:45.925 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-01-31T05:05:45.925 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.925 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.925 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.925 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-01-31T05:05:45.925 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQCY1LllP08sFBAANqRvo9ilM5SbD46dJU12xQ==", 2024-01-31T05:05:45.925 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.925 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-31T05:05:45.925 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-01-31T05:05:45.925 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-01-31T05:05:45.925 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-31T05:05:45.925 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.925 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.926 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.926 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-mds", 2024-01-31T05:05:45.926 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQC31LllKclRHBAALI7accVW1mMfJkO56Hl7Ww==", 2024-01-31T05:05:45.926 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.926 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-mds" 2024-01-31T05:05:45.926 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.926 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.926 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.926 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-mgr", 2024-01-31T05:05:45.926 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQC31LllDNNRHBAANiydlK0LMQlUchhY7nPGeg==", 2024-01-31T05:05:45.926 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.926 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-mgr" 2024-01-31T05:05:45.926 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.926 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.926 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.927 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-osd", 2024-01-31T05:05:45.927 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQC31LllVdtRHBAAhT1gP3jsbxIAkIinzvV/sw==", 2024-01-31T05:05:45.927 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.927 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-osd" 2024-01-31T05:05:45.927 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.927 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.927 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.927 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-rbd", 2024-01-31T05:05:45.927 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQC31LllpONRHBAA0oc3ockaAG1s4mz2eCPnjQ==", 2024-01-31T05:05:45.927 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.927 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-rbd" 2024-01-31T05:05:45.927 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.927 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.927 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.927 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-01-31T05:05:45.928 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQC31Lll6etRHBAANSXagBiLd5ab9aOaj38ArQ==", 2024-01-31T05:05:45.928 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.928 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-01-31T05:05:45.928 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.928 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.928 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.928 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-rgw", 2024-01-31T05:05:45.928 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQC31Lllg/RRHBAAWOQQwQ0R4UdONo8JatASkA==", 2024-01-31T05:05:45.928 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.928 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-rgw" 2024-01-31T05:05:45.928 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.928 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.928 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.929 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-01-31T05:05:45.929 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQCY1LllXivLKxAAk40AEztys39yvVrD50oDPw==", 2024-01-31T05:05:45.929 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.929 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-31T05:05:45.929 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-31T05:05:45.929 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-31T05:05:45.929 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.929 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:45.929 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:45.929 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.y", 2024-01-31T05:05:45.929 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQCY1LllNLwKKBAAGbZbP+wNmgFEpzAlJnGsqA==", 2024-01-31T05:05:45.929 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-01-31T05:05:45.929 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-01-31T05:05:45.929 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-01-31T05:05:45.929 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-01-31T05:05:45.929 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.930 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:45.930 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-01-31T05:05:45.930 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-31T05:05:45.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.904+0000 7fc1d0e00640 1 -- 172.21.15.49:0/2735598681 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc1a4066500 msgr2=0x7fc1a40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:45.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.904+0000 7fc1d0e00640 1 --2- 172.21.15.49:0/2735598681 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc1a4066500 0x7fc1a40689c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40ad000 tx=0x7fc1b4008040 comp rx=0 tx=0).stop 2024-01-31T05:05:45.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.904+0000 7fc1d0e00640 1 -- 172.21.15.49:0/2735598681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1cc06c2d0 msgr2=0x7fc1cc15d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:45.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.904+0000 7fc1d0e00640 1 --2- 172.21.15.49:0/2735598681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1cc06c2d0 0x7fc1cc15d110 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00e980 tx=0x7fc1bc00ee40 comp rx=0 tx=0).stop 2024-01-31T05:05:45.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.908+0000 7fc1d0e00640 1 -- 172.21.15.49:0/2735598681 shutdown_connections 2024-01-31T05:05:45.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.908+0000 7fc1d0e00640 1 --2- 172.21.15.49:0/2735598681 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc1a4066500 0x7fc1a40689c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:45.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.908+0000 7fc1d0e00640 1 --2- 172.21.15.49:0/2735598681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1cc0b34c0 0x7fc1cc151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:45.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.908+0000 7fc1d0e00640 1 --2- 172.21.15.49:0/2735598681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc1cc0b30e0 0x7fc1cc151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:45.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.908+0000 7fc1d0e00640 1 --2- 172.21.15.49:0/2735598681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1cc06c2d0 0x7fc1cc15d110 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:45.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.908+0000 7fc1d0e00640 1 -- 172.21.15.49:0/2735598681 >> 172.21.15.49:0/2735598681 conn(0x7fc1cc0b09a0 msgr2=0x7fc1cc0b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:45.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.908+0000 7fc1d0e00640 1 -- 172.21.15.49:0/2735598681 shutdown_connections 2024-01-31T05:05:45.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:45.908+0000 7fc1d0e00640 1 -- 172.21.15.49:0/2735598681 wait complete. 2024-01-31T05:05:45.933 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-01-31T05:05:46.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.072+0000 7f58efa00640 1 Processor -- start 2024-01-31T05:05:46.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.072+0000 7f58efa00640 1 -- start start 2024-01-31T05:05:46.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.072+0000 7f58efa00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f58e806f020 0x7f58e80cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:46.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.072+0000 7f58efa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58e806f4b0 0x7f58e80cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:46.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.072+0000 7f58efa00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e80cb990 con 0x7f58e815d3a0 2024-01-31T05:05:46.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.072+0000 7f58efa00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e80d1c20 con 0x7f58e806f020 2024-01-31T05:05:46.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.072+0000 7f58efa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e80cfed0 con 0x7f58e806f4b0 2024-01-31T05:05:46.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.072+0000 7f58ed000640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f58e815d3a0 0x7f58e806e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46302/0 (socket says 172.21.15.49:46302) 2024-01-31T05:05:46.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.072+0000 7f58e7e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f58e806f020 0x7f58e80cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:46.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.072+0000 7f58ed000640 1 -- 172.21.15.49:0/2189089656 learned_addr learned my addr 172.21.15.49:0/2189089656 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:46.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.076+0000 7f58eda00640 1 --2- 172.21.15.49:0/2189089656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58e806f4b0 0x7f58e80cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:46.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.076+0000 7f58e7e00640 1 -- 172.21.15.49:0/2189089656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58e806f4b0 msgr2=0x7f58e80cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:46.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.076+0000 7f58e7e00640 1 --2- 172.21.15.49:0/2189089656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58e806f4b0 0x7f58e80cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.076+0000 7f58e7e00640 1 -- 172.21.15.49:0/2189089656 >> v1:172.21.15.49:6789/0 conn(0x7f58e815d3a0 legacy=0x7f58e806e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:46.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.076+0000 7f58e7e00640 1 -- 172.21.15.49:0/2189089656 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e80d01b0 con 0x7f58e806f020 2024-01-31T05:05:46.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.076+0000 7f58e7400640 1 -- 172.21.15.49:0/2189089656 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285827039 0 0) 0x7f58e80cb990 con 0x7f58e815d3a0 2024-01-31T05:05:46.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.076+0000 7f58e7e00640 1 --2- 172.21.15.49:0/2189089656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e806f020 0x7f58e80cbe20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f58d00097c0 tx=0x7f58d001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf43ca66fa3098b server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:46.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.076+0000 7f58e7400640 1 -- 172.21.15.49:0/2189089656 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d00ab610 con 0x7f58e806f020 2024-01-31T05:05:46.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.076+0000 7f58e7400640 1 -- 172.21.15.49:0/2189089656 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d00ab770 con 0x7f58e806f020 2024-01-31T05:05:46.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.076+0000 7f58e7400640 1 -- 172.21.15.49:0/2189089656 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d00abb00 con 0x7f58e806f020 2024-01-31T05:05:46.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.080+0000 7f58efa00640 1 -- 172.21.15.49:0/2189089656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e806f020 msgr2=0x7f58e80cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:46.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.080+0000 7f58efa00640 1 --2- 172.21.15.49:0/2189089656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e806f020 0x7f58e80cbe20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f58d00097c0 tx=0x7f58d001c480 comp rx=0 tx=0).stop 2024-01-31T05:05:46.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.080+0000 7f58efa00640 1 -- 172.21.15.49:0/2189089656 shutdown_connections 2024-01-31T05:05:46.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.080+0000 7f58efa00640 1 --2- 172.21.15.49:0/2189089656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58e806f4b0 0x7f58e80cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.080+0000 7f58efa00640 1 --2- 172.21.15.49:0/2189089656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e806f020 0x7f58e80cbe20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.080+0000 7f58efa00640 1 -- 172.21.15.49:0/2189089656 >> 172.21.15.49:0/2189089656 conn(0x7f58e80d0e50 msgr2=0x7f58e80d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:46.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.080+0000 7f58efa00640 1 -- 172.21.15.49:0/2189089656 shutdown_connections 2024-01-31T05:05:46.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.080+0000 7f58efa00640 1 -- 172.21.15.49:0/2189089656 wait complete. 2024-01-31T05:05:46.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.080+0000 7f58efa00640 1 Processor -- start 2024-01-31T05:05:46.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.080+0000 7f58efa00640 1 -- start start 2024-01-31T05:05:46.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.080+0000 7f58efa00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58e806f020 0x7f58e80b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:46.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.080+0000 7f58efa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58e806f4b0 0x7f58e806caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:46.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.080+0000 7f58efa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e815d3a0 0x7f58e814be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:46.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.080+0000 7f58efa00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e80af3c0 con 0x7f58e815d3a0 2024-01-31T05:05:46.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.080+0000 7f58efa00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e80ae9f0 con 0x7f58e806f020 2024-01-31T05:05:46.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.080+0000 7f58efa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e80af610 con 0x7f58e806f4b0 2024-01-31T05:05:46.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.080+0000 7f58eda00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e815d3a0 0x7f58e814be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:46.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.080+0000 7f58eda00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e815d3a0 0x7f58e814be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40530/0 (socket says 172.21.15.49:40530) 2024-01-31T05:05:46.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.084+0000 7f58eda00640 1 -- 172.21.15.49:0/3369140907 learned_addr learned my addr 172.21.15.49:0/3369140907 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:46.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.084+0000 7f58ed000640 1 --2- 172.21.15.49:0/3369140907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58e806f020 0x7f58e80b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:46.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.084+0000 7f58e7e00640 1 --2- 172.21.15.49:0/3369140907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58e806f4b0 0x7f58e806caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:46.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.084+0000 7f58eda00640 1 -- 172.21.15.49:0/3369140907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58e806f4b0 msgr2=0x7f58e806caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:46.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.084+0000 7f58eda00640 1 --2- 172.21.15.49:0/3369140907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58e806f4b0 0x7f58e806caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.084+0000 7f58eda00640 1 -- 172.21.15.49:0/3369140907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58e806f020 msgr2=0x7f58e80b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:46.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.084+0000 7f58eda00640 1 --2- 172.21.15.49:0/3369140907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58e806f020 0x7f58e80b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.084+0000 7f58eda00640 1 -- 172.21.15.49:0/3369140907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d0009420 con 0x7f58e815d3a0 2024-01-31T05:05:46.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.084+0000 7f58eda00640 1 --2- 172.21.15.49:0/3369140907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e815d3a0 0x7f58e814be90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f58e000efc0 tx=0x7f58e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:46.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.084+0000 7f58e4c00640 1 -- 172.21.15.49:0/3369140907 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0014480 con 0x7f58e815d3a0 2024-01-31T05:05:46.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.084+0000 7f58e4c00640 1 -- 172.21.15.49:0/3369140907 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e000f040 con 0x7f58e815d3a0 2024-01-31T05:05:46.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.084+0000 7f58e4c00640 1 -- 172.21.15.49:0/3369140907 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0014820 con 0x7f58e815d3a0 2024-01-31T05:05:46.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.084+0000 7f58efa00640 1 -- 172.21.15.49:0/3369140907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e80af8f0 con 0x7f58e815d3a0 2024-01-31T05:05:46.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.084+0000 7f58efa00640 1 -- 172.21.15.49:0/3369140907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e806d030 con 0x7f58e815d3a0 2024-01-31T05:05:46.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.084+0000 7f58efa00640 1 -- 172.21.15.49:0/3369140907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e806fdb0 con 0x7f58e815d3a0 2024-01-31T05:05:46.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.084+0000 7f58e4c00640 1 -- 172.21.15.49:0/3369140907 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f58e0014980 con 0x7f58e815d3a0 2024-01-31T05:05:46.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.088+0000 7f58e4c00640 1 --2- 172.21.15.49:0/3369140907 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f58c0066500 0x7f58c00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:46.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.088+0000 7f58e4c00640 1 -- 172.21.15.49:0/3369140907 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f58e0084720 con 0x7f58e815d3a0 2024-01-31T05:05:46.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.088+0000 7f58ed000640 1 --2- 172.21.15.49:0/3369140907 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f58c0066500 0x7f58c00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:46.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.088+0000 7f58ed000640 1 --2- 172.21.15.49:0/3369140907 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f58c0066500 0x7f58c00689c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f58d8000f70 tx=0x7f58d8007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:46.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.088+0000 7f58e4c00640 1 -- 172.21.15.49:0/3369140907 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f58e0051c70 con 0x7f58e815d3a0 2024-01-31T05:05:46.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.304+0000 7f58efa00640 1 -- 172.21.15.49:0/3369140907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f58e806d280 con 0x7f58e815d3a0 2024-01-31T05:05:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.304+0000 7f58e4c00640 1 -- 172.21.15.49:0/3369140907 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f58e806d280 con 0x7f58e815d3a0 2024-01-31T05:05:46.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.308+0000 7f58efa00640 1 -- 172.21.15.49:0/3369140907 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f58c0066500 msgr2=0x7f58c00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:46.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.308+0000 7f58efa00640 1 --2- 172.21.15.49:0/3369140907 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f58c0066500 0x7f58c00689c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f58d8000f70 tx=0x7f58d8007df0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.308+0000 7f58efa00640 1 -- 172.21.15.49:0/3369140907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e815d3a0 msgr2=0x7f58e814be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:46.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.308+0000 7f58efa00640 1 --2- 172.21.15.49:0/3369140907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e815d3a0 0x7f58e814be90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f58e000efc0 tx=0x7f58e000c490 comp rx=0 tx=0).stop 2024-01-31T05:05:46.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.308+0000 7f58efa00640 1 -- 172.21.15.49:0/3369140907 shutdown_connections 2024-01-31T05:05:46.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.308+0000 7f58efa00640 1 --2- 172.21.15.49:0/3369140907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58e815d3a0 0x7f58e814be90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.308+0000 7f58efa00640 1 --2- 172.21.15.49:0/3369140907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f58e806f4b0 0x7f58e806caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.308+0000 7f58efa00640 1 --2- 172.21.15.49:0/3369140907 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f58c0066500 0x7f58c00689c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.308+0000 7f58efa00640 1 --2- 172.21.15.49:0/3369140907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58e806f020 0x7f58e80b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.308+0000 7f58efa00640 1 -- 172.21.15.49:0/3369140907 >> 172.21.15.49:0/3369140907 conn(0x7f58e80d0e50 msgr2=0x7f58e806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:46.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.308+0000 7f58efa00640 1 -- 172.21.15.49:0/3369140907 shutdown_connections 2024-01-31T05:05:46.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.308+0000 7f58efa00640 1 -- 172.21.15.49:0/3369140907 wait complete. 2024-01-31T05:05:46.330 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-01-31T05:05:46.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.468+0000 7f458ba00640 1 Processor -- start 2024-01-31T05:05:46.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.468+0000 7f458ba00640 1 -- start start 2024-01-31T05:05:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.472+0000 7f458ba00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4584159790 0x7f45840b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.472+0000 7f458ba00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4584070d70 0x7f45840ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.472+0000 7f458ba00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4584159b70 con 0x7f45840b3d00 2024-01-31T05:05:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.472+0000 7f458ba00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45840b2750 con 0x7f4584159790 2024-01-31T05:05:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.472+0000 7f458ba00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45840b2a30 con 0x7f4584070d70 2024-01-31T05:05:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.472+0000 7f4589000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4584159790 0x7f45840b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.472+0000 7f4589000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4584159790 0x7f45840b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40532/0 (socket says 172.21.15.49:40532) 2024-01-31T05:05:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.472+0000 7f4589000640 1 -- 172.21.15.49:0/2859822100 learned_addr learned my addr 172.21.15.49:0/2859822100 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:46.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.472+0000 7f4589a00640 1 --2- 172.21.15.49:0/2859822100 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4584070d70 0x7f45840ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:46.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.472+0000 7f4589000640 1 -- 172.21.15.49:0/2859822100 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4584070d70 msgr2=0x7f45840ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:46.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.472+0000 7f4589000640 1 --2- 172.21.15.49:0/2859822100 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4584070d70 0x7f45840ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.472+0000 7f4589000640 1 -- 172.21.15.49:0/2859822100 >> v1:172.21.15.195:6789/0 conn(0x7f45840b3d00 legacy=0x7f4584070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:46.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.472+0000 7f4589000640 1 -- 172.21.15.49:0/2859822100 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45840b2d10 con 0x7f4584159790 2024-01-31T05:05:46.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.472+0000 7f4589a00640 1 --2- 172.21.15.49:0/2859822100 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4584070d70 0x7f45840ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:05:46.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.476+0000 7f4589000640 1 --2- 172.21.15.49:0/2859822100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4584159790 0x7f45840b37c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f458406b770 tx=0x7f457401eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e098407cd520bd7 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:46.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.476+0000 7f4583400640 1 -- 172.21.15.49:0/2859822100 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45740a7b70 con 0x7f4584159790 2024-01-31T05:05:46.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.476+0000 7f4583400640 1 -- 172.21.15.49:0/2859822100 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45740a7cd0 con 0x7f4584159790 2024-01-31T05:05:46.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.476+0000 7f4583400640 1 -- 172.21.15.49:0/2859822100 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45740af660 con 0x7f4584159790 2024-01-31T05:05:46.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.476+0000 7f458ba00640 1 -- 172.21.15.49:0/2859822100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4584159790 msgr2=0x7f45840b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:46.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.476+0000 7f458ba00640 1 --2- 172.21.15.49:0/2859822100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4584159790 0x7f45840b37c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f458406b770 tx=0x7f457401eb60 comp rx=0 tx=0).stop 2024-01-31T05:05:46.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.476+0000 7f458ba00640 1 -- 172.21.15.49:0/2859822100 shutdown_connections 2024-01-31T05:05:46.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.476+0000 7f458ba00640 1 --2- 172.21.15.49:0/2859822100 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4584070d70 0x7f45840ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.476+0000 7f458ba00640 1 --2- 172.21.15.49:0/2859822100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4584159790 0x7f45840b37c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.476+0000 7f458ba00640 1 -- 172.21.15.49:0/2859822100 >> 172.21.15.49:0/2859822100 conn(0x7f45840b09a0 msgr2=0x7f45840b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:46.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.476+0000 7f458ba00640 1 -- 172.21.15.49:0/2859822100 shutdown_connections 2024-01-31T05:05:46.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.476+0000 7f458ba00640 1 -- 172.21.15.49:0/2859822100 wait complete. 2024-01-31T05:05:46.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.476+0000 7f458ba00640 1 Processor -- start 2024-01-31T05:05:46.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.476+0000 7f458ba00640 1 -- start start 2024-01-31T05:05:46.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f458ba00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4584070d70 0x7f458413e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:46.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f458ba00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45840b3d00 0x7f45840cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:46.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f458ba00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4584159790 0x7f458414dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:46.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f458ba00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458413ea90 con 0x7f4584159790 2024-01-31T05:05:46.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f458ba00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45840cc910 con 0x7f4584070d70 2024-01-31T05:05:46.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f458ba00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45840ccbf0 con 0x7f45840b3d00 2024-01-31T05:05:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f4589a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4584159790 0x7f458414dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f4589a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4584159790 0x7f458414dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40538/0 (socket says 172.21.15.49:40538) 2024-01-31T05:05:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f4589a00640 1 -- 172.21.15.49:0/576717997 learned_addr learned my addr 172.21.15.49:0/576717997 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f4589000640 1 --2- 172.21.15.49:0/576717997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4584070d70 0x7f458413e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f4583e00640 1 --2- 172.21.15.49:0/576717997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45840b3d00 0x7f45840cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f4589a00640 1 -- 172.21.15.49:0/576717997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45840b3d00 msgr2=0x7f45840cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f4589a00640 1 --2- 172.21.15.49:0/576717997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45840b3d00 0x7f45840cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f4589a00640 1 -- 172.21.15.49:0/576717997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4584070d70 msgr2=0x7f458413e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f4589a00640 1 --2- 172.21.15.49:0/576717997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4584070d70 0x7f458413e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f4589a00640 1 -- 172.21.15.49:0/576717997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457400b770 con 0x7f4584159790 2024-01-31T05:05:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f4583e00640 1 --2- 172.21.15.49:0/576717997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45840b3d00 0x7f45840cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f4589a00640 1 --2- 172.21.15.49:0/576717997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4584159790 0x7f458414dfb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f457c00cef0 tx=0x7f457c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f4580c00640 1 -- 172.21.15.49:0/576717997 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c00d840 con 0x7f4584159790 2024-01-31T05:05:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f4580c00640 1 -- 172.21.15.49:0/576717997 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457c00d9c0 con 0x7f4584159790 2024-01-31T05:05:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f458ba00640 1 -- 172.21.15.49:0/576717997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45840cced0 con 0x7f4584159790 2024-01-31T05:05:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f4580c00640 1 -- 172.21.15.49:0/576717997 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c00dd70 con 0x7f4584159790 2024-01-31T05:05:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f458ba00640 1 -- 172.21.15.49:0/576717997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45840cd490 con 0x7f4584159790 2024-01-31T05:05:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.480+0000 7f458ba00640 1 -- 172.21.15.49:0/576717997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45840cd680 con 0x7f4584159790 2024-01-31T05:05:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.484+0000 7f4580c00640 1 -- 172.21.15.49:0/576717997 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f457c01e3b0 con 0x7f4584159790 2024-01-31T05:05:46.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.484+0000 7f4580c00640 1 --2- 172.21.15.49:0/576717997 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f455c066500 0x7f455c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:46.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.484+0000 7f4580c00640 1 -- 172.21.15.49:0/576717997 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f457c084740 con 0x7f4584159790 2024-01-31T05:05:46.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.484+0000 7f4589000640 1 --2- 172.21.15.49:0/576717997 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f455c066500 0x7f455c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:46.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.484+0000 7f4589000640 1 --2- 172.21.15.49:0/576717997 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f455c066500 0x7f455c0689c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f45740b1000 tx=0x7f45740a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:46.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.488+0000 7f4580c00640 1 -- 172.21.15.49:0/576717997 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f457c051cc0 con 0x7f4584159790 2024-01-31T05:05:46.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.704+0000 7f458ba00640 1 -- 172.21.15.49:0/576717997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f4584074860 con 0x7f4584159790 2024-01-31T05:05:46.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.708+0000 7f4580c00640 1 -- 172.21.15.49:0/576717997 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f457c01a0a0 con 0x7f4584159790 2024-01-31T05:05:46.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.708+0000 7f458ba00640 1 -- 172.21.15.49:0/576717997 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f455c066500 msgr2=0x7f455c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.708+0000 7f458ba00640 1 --2- 172.21.15.49:0/576717997 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f455c066500 0x7f455c0689c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f45740b1000 tx=0x7f45740a9070 comp rx=0 tx=0).stop 2024-01-31T05:05:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.708+0000 7f458ba00640 1 -- 172.21.15.49:0/576717997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4584159790 msgr2=0x7f458414dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.708+0000 7f458ba00640 1 --2- 172.21.15.49:0/576717997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4584159790 0x7f458414dfb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f457c00cef0 tx=0x7f457c00a710 comp rx=0 tx=0).stop 2024-01-31T05:05:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.712+0000 7f458ba00640 1 -- 172.21.15.49:0/576717997 shutdown_connections 2024-01-31T05:05:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.712+0000 7f458ba00640 1 --2- 172.21.15.49:0/576717997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4584159790 0x7f458414dfb0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.712+0000 7f458ba00640 1 --2- 172.21.15.49:0/576717997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45840b3d00 0x7f45840cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.712+0000 7f458ba00640 1 --2- 172.21.15.49:0/576717997 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f455c066500 0x7f455c0689c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.712+0000 7f458ba00640 1 --2- 172.21.15.49:0/576717997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4584070d70 0x7f458413e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.712+0000 7f458ba00640 1 -- 172.21.15.49:0/576717997 >> 172.21.15.49:0/576717997 conn(0x7f45840b09a0 msgr2=0x7f45840b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.712+0000 7f458ba00640 1 -- 172.21.15.49:0/576717997 shutdown_connections 2024-01-31T05:05:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.712+0000 7f458ba00640 1 -- 172.21.15.49:0/576717997 wait complete. 2024-01-31T05:05:46.733 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-01-31T05:05:46.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.872+0000 7f5f12200640 1 Processor -- start 2024-01-31T05:05:46.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.872+0000 7f5f12200640 1 -- start start 2024-01-31T05:05:46.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.876+0000 7f5f12200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5f0c15b110 0x7f5f0c06c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:46.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.876+0000 7f5f12200640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0c15b4f0 con 0x7f5f0c0714e0 2024-01-31T05:05:46.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.876+0000 7f5f12200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0c0abf20 con 0x7f5f0c0cdf10 2024-01-31T05:05:46.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.876+0000 7f5f12200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0c0ce460 con 0x7f5f0c15b110 2024-01-31T05:05:46.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.876+0000 7f5f0be00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5f0c0714e0 0x7f5f0c0ad800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46310/0 (socket says 172.21.15.49:46310) 2024-01-31T05:05:46.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.876+0000 7f5f0be00640 1 -- 172.21.15.49:0/4105658456 learned_addr learned my addr 172.21.15.49:0/4105658456 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:46.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.876+0000 7f5f0b400640 1 --2- 172.21.15.49:0/4105658456 >> v2:172.21.15.195:3300/0 conn(0x7f5f0c15b110 0x7f5f0c06c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:46.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.876+0000 7f5f0a000640 1 -- 172.21.15.49:0/4105658456 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675293100 0 0) 0x7f5f040014a0 con 0x7f5f0c0714e0 2024-01-31T05:05:46.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.876+0000 7f5f0a000640 1 -- 172.21.15.49:0/4105658456 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eec003530 con 0x7f5f0c0714e0 2024-01-31T05:05:46.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.876+0000 7f5f0a000640 1 -- 172.21.15.49:0/4105658456 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751411142 0 0) 0x7f5f0c0abf20 con 0x7f5f0c0cdf10 2024-01-31T05:05:46.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.876+0000 7f5f0a000640 1 -- 172.21.15.49:0/4105658456 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f040014a0 con 0x7f5f0c0cdf10 2024-01-31T05:05:46.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.876+0000 7f5f0a000640 1 -- 172.21.15.49:0/4105658456 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 118550158 0 0) 0x7f5eec003530 con 0x7f5f0c0714e0 2024-01-31T05:05:46.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.876+0000 7f5f0b400640 1 -- 172.21.15.49:0/4105658456 >> v1:172.21.15.195:6789/0 conn(0x7f5f0c0cdf10 legacy=0x7f5f0c070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:46.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.876+0000 7f5f0b400640 1 -- 172.21.15.49:0/4105658456 >> v1:172.21.15.49:6789/0 conn(0x7f5f0c0714e0 legacy=0x7f5f0c0ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:46.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.876+0000 7f5f0b400640 1 -- 172.21.15.49:0/4105658456 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c0ac200 con 0x7f5f0c15b110 2024-01-31T05:05:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.880+0000 7f5f0b400640 1 --2- 172.21.15.49:0/4105658456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f0c15b110 0x7f5f0c06c2d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0097c0 tx=0x7f5efc01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ea115b248ad0b5b server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.880+0000 7f5f0a000640 1 -- 172.21.15.49:0/4105658456 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04001b10 con 0x7f5f0c15b110 2024-01-31T05:05:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.880+0000 7f5f0a000640 1 -- 172.21.15.49:0/4105658456 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5efc0a7050 con 0x7f5f0c15b110 2024-01-31T05:05:46.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.880+0000 7f5f0a000640 1 -- 172.21.15.49:0/4105658456 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc0ab620 con 0x7f5f0c15b110 2024-01-31T05:05:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.880+0000 7f5f12200640 1 -- 172.21.15.49:0/4105658456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f0c15b110 msgr2=0x7f5f0c06c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.880+0000 7f5f12200640 1 --2- 172.21.15.49:0/4105658456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f0c15b110 0x7f5f0c06c2d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0097c0 tx=0x7f5efc01c370 comp rx=0 tx=0).stop 2024-01-31T05:05:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.880+0000 7f5f12200640 1 -- 172.21.15.49:0/4105658456 shutdown_connections 2024-01-31T05:05:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.880+0000 7f5f12200640 1 --2- 172.21.15.49:0/4105658456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f0c15b110 0x7f5f0c06c2d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.880+0000 7f5f12200640 1 -- 172.21.15.49:0/4105658456 >> 172.21.15.49:0/4105658456 conn(0x7f5f0c0b09a0 msgr2=0x7f5f0c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:46.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.880+0000 7f5f12200640 1 -- 172.21.15.49:0/4105658456 shutdown_connections 2024-01-31T05:05:46.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.880+0000 7f5f12200640 1 -- 172.21.15.49:0/4105658456 wait complete. 2024-01-31T05:05:46.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.880+0000 7f5f12200640 1 Processor -- start 2024-01-31T05:05:46.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f12200640 1 -- start start 2024-01-31T05:05:46.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f12200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f0c0714e0 0x7f5f0c14a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:46.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f12200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f0c0cdf10 0x7f5f0c09a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:46.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f12200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f0c15b110 0x7f5f0c1374d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:46.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f12200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c145870 con 0x7f5f0c0cdf10 2024-01-31T05:05:46.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f12200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c09aef0 con 0x7f5f0c15b110 2024-01-31T05:05:46.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f12200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c099bf0 con 0x7f5f0c0714e0 2024-01-31T05:05:46.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f0aa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f0c0cdf10 0x7f5f0c09a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:46.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f0aa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f0c0cdf10 0x7f5f0c09a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40552/0 (socket says 172.21.15.49:40552) 2024-01-31T05:05:46.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f0aa00640 1 -- 172.21.15.49:0/2580903157 learned_addr learned my addr 172.21.15.49:0/2580903157 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:46.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f0be00640 1 --2- 172.21.15.49:0/2580903157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f0c15b110 0x7f5f0c1374d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:46.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f0b400640 1 --2- 172.21.15.49:0/2580903157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f0c0714e0 0x7f5f0c14a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:46.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f0aa00640 1 -- 172.21.15.49:0/2580903157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f0c0714e0 msgr2=0x7f5f0c14a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:46.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f0aa00640 1 --2- 172.21.15.49:0/2580903157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f0c0714e0 0x7f5f0c14a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f0aa00640 1 -- 172.21.15.49:0/2580903157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f0c15b110 msgr2=0x7f5f0c1374d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:46.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f0aa00640 1 --2- 172.21.15.49:0/2580903157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f0c15b110 0x7f5f0c1374d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:46.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f0aa00640 1 -- 172.21.15.49:0/2580903157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc009420 con 0x7f5f0c0cdf10 2024-01-31T05:05:46.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f0aa00640 1 --2- 172.21.15.49:0/2580903157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f0c0cdf10 0x7f5f0c09a9b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400c4d0 tx=0x7f5ef400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:46.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f03400640 1 -- 172.21.15.49:0/2580903157 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef40052d0 con 0x7f5f0c0cdf10 2024-01-31T05:05:46.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f03400640 1 -- 172.21.15.49:0/2580903157 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef4005430 con 0x7f5f0c0cdf10 2024-01-31T05:05:46.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f03400640 1 -- 172.21.15.49:0/2580903157 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4012870 con 0x7f5f0c0cdf10 2024-01-31T05:05:46.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f12200640 1 -- 172.21.15.49:0/2580903157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f0c099ed0 con 0x7f5f0c0cdf10 2024-01-31T05:05:46.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f12200640 1 -- 172.21.15.49:0/2580903157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f0c09a490 con 0x7f5f0c0cdf10 2024-01-31T05:05:46.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.884+0000 7f5f12200640 1 -- 172.21.15.49:0/2580903157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f0c09a6b0 con 0x7f5f0c0cdf10 2024-01-31T05:05:46.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.888+0000 7f5f03400640 1 -- 172.21.15.49:0/2580903157 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f5ef40129d0 con 0x7f5f0c0cdf10 2024-01-31T05:05:46.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.888+0000 7f5f03400640 1 --2- 172.21.15.49:0/2580903157 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5ee4066530 0x7f5ee40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:46.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.888+0000 7f5f03400640 1 -- 172.21.15.49:0/2580903157 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5ef4083950 con 0x7f5f0c0cdf10 2024-01-31T05:05:46.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.888+0000 7f5f0b400640 1 --2- 172.21.15.49:0/2580903157 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5ee4066530 0x7f5ee40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:46.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.888+0000 7f5f0b400640 1 --2- 172.21.15.49:0/2580903157 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5ee4066530 0x7f5ee40689f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0ad000 tx=0x7f5efc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:46.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:46.892+0000 7f5f03400640 1 -- 172.21.15.49:0/2580903157 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f5ef4050d60 con 0x7f5f0c0cdf10 2024-01-31T05:05:47.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.104+0000 7f5f12200640 1 -- 172.21.15.49:0/2580903157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f5f0c074860 con 0x7f5f0c0cdf10 2024-01-31T05:05:47.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.108+0000 7f5f03400640 1 -- 172.21.15.49:0/2580903157 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5ef4054380 con 0x7f5f0c0cdf10 2024-01-31T05:05:47.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.112+0000 7f5f12200640 1 -- 172.21.15.49:0/2580903157 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5ee4066530 msgr2=0x7f5ee40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:47.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.112+0000 7f5f12200640 1 --2- 172.21.15.49:0/2580903157 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5ee4066530 0x7f5ee40689f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0ad000 tx=0x7f5efc0a6000 comp rx=0 tx=0).stop 2024-01-31T05:05:47.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.112+0000 7f5f12200640 1 -- 172.21.15.49:0/2580903157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f0c0cdf10 msgr2=0x7f5f0c09a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:47.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.112+0000 7f5f12200640 1 --2- 172.21.15.49:0/2580903157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f0c0cdf10 0x7f5f0c09a9b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400c4d0 tx=0x7f5ef400c990 comp rx=0 tx=0).stop 2024-01-31T05:05:47.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.112+0000 7f5f12200640 1 -- 172.21.15.49:0/2580903157 shutdown_connections 2024-01-31T05:05:47.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.112+0000 7f5f12200640 1 --2- 172.21.15.49:0/2580903157 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5ee4066530 0x7f5ee40689f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.112+0000 7f5f12200640 1 --2- 172.21.15.49:0/2580903157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f0c15b110 0x7f5f0c1374d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.112+0000 7f5f12200640 1 --2- 172.21.15.49:0/2580903157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f0c0cdf10 0x7f5f0c09a9b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.112+0000 7f5f12200640 1 --2- 172.21.15.49:0/2580903157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5f0c0714e0 0x7f5f0c14a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.112+0000 7f5f12200640 1 -- 172.21.15.49:0/2580903157 >> 172.21.15.49:0/2580903157 conn(0x7f5f0c0b09a0 msgr2=0x7f5f0c0cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:47.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.112+0000 7f5f12200640 1 -- 172.21.15.49:0/2580903157 shutdown_connections 2024-01-31T05:05:47.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.112+0000 7f5f12200640 1 -- 172.21.15.49:0/2580903157 wait complete. 2024-01-31T05:05:47.133 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-01-31T05:05:47.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.276+0000 7f7098800640 1 Processor -- start 2024-01-31T05:05:47.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.276+0000 7f7098800640 1 -- start start 2024-01-31T05:05:47.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.276+0000 7f7098800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709015a000 0x7f70900cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:47.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.276+0000 7f7098800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f709006c2d0 0x7f7090070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:47.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.276+0000 7f7098800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709006c750 con 0x7f7090071410 2024-01-31T05:05:47.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.276+0000 7f7098800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70900b3760 con 0x7f709006c2d0 2024-01-31T05:05:47.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.276+0000 7f7098800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70900718a0 con 0x7f709015a000 2024-01-31T05:05:47.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.276+0000 7f7095e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709015a000 0x7f70900cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:47.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.276+0000 7f7096800640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f7090071410 0x7f70900b1ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:49164/0 (socket says 172.21.15.49:49164) 2024-01-31T05:05:47.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.276+0000 7f7096800640 1 -- 172.21.15.49:0/616676793 learned_addr learned my addr 172.21.15.49:0/616676793 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:47.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.276+0000 7f7095400640 1 --2- 172.21.15.49:0/616676793 >> v2:172.21.15.195:3300/0 conn(0x7f709006c2d0 0x7f7090070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:47.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.276+0000 7f7095e00640 1 -- 172.21.15.49:0/616676793 >> v2:172.21.15.195:3300/0 conn(0x7f709006c2d0 msgr2=0x7f7090070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:47.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.276+0000 7f7095e00640 1 --2- 172.21.15.49:0/616676793 >> v2:172.21.15.195:3300/0 conn(0x7f709006c2d0 0x7f7090070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.276+0000 7f7095e00640 1 -- 172.21.15.49:0/616676793 >> v1:172.21.15.195:6789/0 conn(0x7f7090071410 legacy=0x7f70900b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:47.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.276+0000 7f7095e00640 1 -- 172.21.15.49:0/616676793 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7090071e40 con 0x7f709015a000 2024-01-31T05:05:47.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.276+0000 7f7095400640 1 --2- 172.21.15.49:0/616676793 >> v2:172.21.15.195:3300/0 conn(0x7f709006c2d0 0x7f7090070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:47.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.280+0000 7f7095e00640 1 --2- 172.21.15.49:0/616676793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709015a000 0x7f70900cb040 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70800097c0 tx=0x7f708001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38cfa1f1abe46387 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:47.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.280+0000 7f7094a00640 1 -- 172.21.15.49:0/616676793 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70900b2bc0 con 0x7f709015a000 2024-01-31T05:05:47.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.280+0000 7f7094a00640 1 -- 172.21.15.49:0/616676793 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70800a7050 con 0x7f709015a000 2024-01-31T05:05:47.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.280+0000 7f7094a00640 1 -- 172.21.15.49:0/616676793 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70800ab820 con 0x7f709015a000 2024-01-31T05:05:47.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.280+0000 7f7098800640 1 -- 172.21.15.49:0/616676793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709015a000 msgr2=0x7f70900cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:47.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.280+0000 7f7098800640 1 --2- 172.21.15.49:0/616676793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709015a000 0x7f70900cb040 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70800097c0 tx=0x7f708001c480 comp rx=0 tx=0).stop 2024-01-31T05:05:47.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.280+0000 7f7098800640 1 -- 172.21.15.49:0/616676793 shutdown_connections 2024-01-31T05:05:47.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.280+0000 7f7098800640 1 --2- 172.21.15.49:0/616676793 >> v2:172.21.15.195:3300/0 conn(0x7f709006c2d0 0x7f7090070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.280+0000 7f7098800640 1 --2- 172.21.15.49:0/616676793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709015a000 0x7f70900cb040 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.280+0000 7f7098800640 1 -- 172.21.15.49:0/616676793 >> 172.21.15.49:0/616676793 conn(0x7f70900b09a0 msgr2=0x7f70900b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:47.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.280+0000 7f7098800640 1 -- 172.21.15.49:0/616676793 shutdown_connections 2024-01-31T05:05:47.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.280+0000 7f7098800640 1 -- 172.21.15.49:0/616676793 wait complete. 2024-01-31T05:05:47.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7098800640 1 Processor -- start 2024-01-31T05:05:47.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7098800640 1 -- start start 2024-01-31T05:05:47.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7098800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709006c2d0 0x7f7090140690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:47.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7098800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090071410 0x7f7090151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:47.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7098800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709015a000 0x7f7090151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:47.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7098800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7090140bd0 con 0x7f7090071410 2024-01-31T05:05:47.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7098800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709015be60 con 0x7f709015a000 2024-01-31T05:05:47.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7098800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709015c140 con 0x7f709006c2d0 2024-01-31T05:05:47.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7095400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090071410 0x7f7090151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:47.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7095400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090071410 0x7f7090151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40564/0 (socket says 172.21.15.49:40564) 2024-01-31T05:05:47.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7095400640 1 -- 172.21.15.49:0/759681297 learned_addr learned my addr 172.21.15.49:0/759681297 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:47.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7095e00640 1 --2- 172.21.15.49:0/759681297 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709006c2d0 0x7f7090140690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:47.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7096800640 1 --2- 172.21.15.49:0/759681297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709015a000 0x7f7090151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:47.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7095400640 1 -- 172.21.15.49:0/759681297 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709006c2d0 msgr2=0x7f7090140690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:47.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7095400640 1 --2- 172.21.15.49:0/759681297 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709006c2d0 0x7f7090140690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7095400640 1 -- 172.21.15.49:0/759681297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709015a000 msgr2=0x7f7090151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:47.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7095400640 1 --2- 172.21.15.49:0/759681297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709015a000 0x7f7090151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7095400640 1 -- 172.21.15.49:0/759681297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7078009420 con 0x7f7090071410 2024-01-31T05:05:47.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7095400640 1 --2- 172.21.15.49:0/759681297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090071410 0x7f7090151770 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f707800ebe0 tx=0x7f707800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:47.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f708e000640 1 -- 172.21.15.49:0/759681297 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707800eee0 con 0x7f7090071410 2024-01-31T05:05:47.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f708e000640 1 -- 172.21.15.49:0/759681297 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707800cc30 con 0x7f7090071410 2024-01-31T05:05:47.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f708e000640 1 -- 172.21.15.49:0/759681297 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078013470 con 0x7f7090071410 2024-01-31T05:05:47.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7098800640 1 -- 172.21.15.49:0/759681297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7080009420 con 0x7f7090071410 2024-01-31T05:05:47.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.284+0000 7f7098800640 1 -- 172.21.15.49:0/759681297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709015c700 con 0x7f7090071410 2024-01-31T05:05:47.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.288+0000 7f7098800640 1 -- 172.21.15.49:0/759681297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7090074860 con 0x7f7090071410 2024-01-31T05:05:47.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.288+0000 7f708e000640 1 -- 172.21.15.49:0/759681297 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f70780135d0 con 0x7f7090071410 2024-01-31T05:05:47.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.288+0000 7f708e000640 1 --2- 172.21.15.49:0/759681297 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7068066530 0x7f70680689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:47.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.288+0000 7f708e000640 1 -- 172.21.15.49:0/759681297 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7078083e90 con 0x7f7090071410 2024-01-31T05:05:47.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.288+0000 7f7095e00640 1 --2- 172.21.15.49:0/759681297 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7068066530 0x7f70680689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:47.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.288+0000 7f7095e00640 1 --2- 172.21.15.49:0/759681297 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7068066530 0x7f70680689f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f70800097c0 tx=0x7f70800a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:47.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.292+0000 7f708e000640 1 -- 172.21.15.49:0/759681297 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f70780513f0 con 0x7f7090071410 2024-01-31T05:05:47.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.512+0000 7f7098800640 1 -- 172.21.15.49:0/759681297 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f7090070a00 con 0x7f7090071410 2024-01-31T05:05:47.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.516+0000 7f708e000640 1 -- 172.21.15.49:0/759681297 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7078054a10 con 0x7f7090071410 2024-01-31T05:05:47.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.520+0000 7f7098800640 1 -- 172.21.15.49:0/759681297 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7068066530 msgr2=0x7f70680689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:47.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.520+0000 7f7098800640 1 --2- 172.21.15.49:0/759681297 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7068066530 0x7f70680689f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f70800097c0 tx=0x7f70800a6000 comp rx=0 tx=0).stop 2024-01-31T05:05:47.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.520+0000 7f7098800640 1 -- 172.21.15.49:0/759681297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090071410 msgr2=0x7f7090151770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:47.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.520+0000 7f7098800640 1 --2- 172.21.15.49:0/759681297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090071410 0x7f7090151770 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f707800ebe0 tx=0x7f707800c520 comp rx=0 tx=0).stop 2024-01-31T05:05:47.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.520+0000 7f7098800640 1 -- 172.21.15.49:0/759681297 shutdown_connections 2024-01-31T05:05:47.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.520+0000 7f7098800640 1 --2- 172.21.15.49:0/759681297 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7068066530 0x7f70680689f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.520+0000 7f7098800640 1 --2- 172.21.15.49:0/759681297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709015a000 0x7f7090151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.520+0000 7f7098800640 1 --2- 172.21.15.49:0/759681297 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7090071410 0x7f7090151770 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.520+0000 7f7098800640 1 --2- 172.21.15.49:0/759681297 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709006c2d0 0x7f7090140690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.520+0000 7f7098800640 1 -- 172.21.15.49:0/759681297 >> 172.21.15.49:0/759681297 conn(0x7f70900b09a0 msgr2=0x7f70900adcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:47.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.520+0000 7f7098800640 1 -- 172.21.15.49:0/759681297 shutdown_connections 2024-01-31T05:05:47.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.520+0000 7f7098800640 1 -- 172.21.15.49:0/759681297 wait complete. 2024-01-31T05:05:47.540 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-01-31T05:05:47.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f0426600640 1 Processor -- start 2024-01-31T05:05:47.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f0426600640 1 -- start start 2024-01-31T05:05:47.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f0426600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f042015d540 0x7f04200cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:47.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f0426600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04200cbbc0 0x7f042015d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:47.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f0426600640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04200cef80 con 0x7f042006c290 2024-01-31T05:05:47.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f0426600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042006cae0 con 0x7f042015d540 2024-01-31T05:05:47.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f0426600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04200cf1b0 con 0x7f04200cbbc0 2024-01-31T05:05:47.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f041ea00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f042006c290 0x7f04200cb4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46320/0 (socket says 172.21.15.49:46320) 2024-01-31T05:05:47.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f041ea00640 1 -- 172.21.15.49:0/3613876248 learned_addr learned my addr 172.21.15.49:0/3613876248 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:47.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f041e000640 1 -- 172.21.15.49:0/3613876248 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654496524 0 0) 0x7f04200cef80 con 0x7f042006c290 2024-01-31T05:05:47.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f041e000640 1 -- 172.21.15.49:0/3613876248 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0400003530 con 0x7f042006c290 2024-01-31T05:05:47.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f041e000640 1 -- 172.21.15.49:0/3613876248 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 765216416 0 0) 0x7f0400003530 con 0x7f042006c290 2024-01-31T05:05:47.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f041e000640 1 -- 172.21.15.49:0/3613876248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04200cbbc0 msgr2=0x7f042015d920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-31T05:05:47.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f041e000640 1 --2- 172.21.15.49:0/3613876248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04200cbbc0 0x7f042015d920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f041e000640 1 -- 172.21.15.49:0/3613876248 >> v2:172.21.15.195:3300/0 conn(0x7f042015d540 msgr2=0x7f04200cff70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-31T05:05:47.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f041e000640 1 --2- 172.21.15.49:0/3613876248 >> v2:172.21.15.195:3300/0 conn(0x7f042015d540 0x7f04200cff70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f041e000640 1 -- 172.21.15.49:0/3613876248 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04200cf490 con 0x7f042006c290 2024-01-31T05:05:47.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f041e000640 1 -- 172.21.15.49:0/3613876248 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7f0408001680 con 0x7f042006c290 2024-01-31T05:05:47.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f041e000640 1 -- 172.21.15.49:0/3613876248 >> v1:172.21.15.49:6789/0 conn(0x7f042006c290 legacy=0x7f04200cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:47.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.680+0000 7f041e000640 1 --2- 172.21.15.49:0/3613876248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0400003980 0x7f0400003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:47.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.684+0000 7f041e000640 1 --2- 172.21.15.49:0/3613876248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04200cbbc0 0x7f04000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:47.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.684+0000 7f041e000640 1 --2- 172.21.15.49:0/3613876248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0400004d80 0x7f0400005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:47.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.684+0000 7f041e000640 1 -- 172.21.15.49:0/3613876248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042006cae0 con 0x7f0400003980 2024-01-31T05:05:47.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.684+0000 7f041e000640 1 -- 172.21.15.49:0/3613876248 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04200cf1b0 con 0x7f0400004d80 2024-01-31T05:05:47.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.684+0000 7f041e000640 1 -- 172.21.15.49:0/3613876248 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040000bc50 con 0x7f04200cbbc0 2024-01-31T05:05:47.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.684+0000 7f041f400640 1 --2- 172.21.15.49:0/3613876248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0400003980 0x7f0400003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:47.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.684+0000 7f041ea00640 1 --2- 172.21.15.49:0/3613876248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04200cbbc0 0x7f04000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:47.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.684+0000 7f041fe00640 1 --2- 172.21.15.49:0/3613876248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0400004d80 0x7f0400005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:47.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.684+0000 7f041f400640 1 -- 172.21.15.49:0/3613876248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04200cbbc0 msgr2=0x7f04000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:47.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.684+0000 7f041f400640 1 --2- 172.21.15.49:0/3613876248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04200cbbc0 0x7f04000047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.684+0000 7f041f400640 1 -- 172.21.15.49:0/3613876248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0400004d80 msgr2=0x7f0400005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:47.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.684+0000 7f041f400640 1 --2- 172.21.15.49:0/3613876248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0400004d80 0x7f0400005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.684+0000 7f041f400640 1 -- 172.21.15.49:0/3613876248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0400003530 con 0x7f0400003980 2024-01-31T05:05:47.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.684+0000 7f041fe00640 1 --2- 172.21.15.49:0/3613876248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0400004d80 0x7f0400005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:47.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.684+0000 7f041f400640 1 --2- 172.21.15.49:0/3613876248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0400003980 0x7f0400003da0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f04100097b0 tx=0x7f041001c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858bd690293a0a27 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:47.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.684+0000 7f041e000640 1 -- 172.21.15.49:0/3613876248 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04100ab600 con 0x7f0400003980 2024-01-31T05:05:47.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.684+0000 7f041e000640 1 -- 172.21.15.49:0/3613876248 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04100a7050 con 0x7f0400003980 2024-01-31T05:05:47.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.688+0000 7f041e000640 1 -- 172.21.15.49:0/3613876248 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04100ab9c0 con 0x7f0400003980 2024-01-31T05:05:47.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.688+0000 7f0426600640 1 -- 172.21.15.49:0/3613876248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0400003980 msgr2=0x7f0400003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:47.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.688+0000 7f0426600640 1 --2- 172.21.15.49:0/3613876248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0400003980 0x7f0400003da0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f04100097b0 tx=0x7f041001c290 comp rx=0 tx=0).stop 2024-01-31T05:05:47.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.688+0000 7f041fe00640 1 -- 172.21.15.49:0/3613876248 reap_dead start 2024-01-31T05:05:47.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.688+0000 7f0426600640 1 -- 172.21.15.49:0/3613876248 shutdown_connections 2024-01-31T05:05:47.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.688+0000 7f0426600640 1 -- 172.21.15.49:0/3613876248 >> 172.21.15.49:0/3613876248 conn(0x7f04200d0e60 msgr2=0x7f04200d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:47.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.688+0000 7f0426600640 1 -- 172.21.15.49:0/3613876248 shutdown_connections 2024-01-31T05:05:47.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.688+0000 7f0426600640 1 -- 172.21.15.49:0/3613876248 wait complete. 2024-01-31T05:05:47.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.688+0000 7f0426600640 1 Processor -- start 2024-01-31T05:05:47.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.688+0000 7f0426600640 1 -- start start 2024-01-31T05:05:47.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.688+0000 7f0426600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0400003980 0x7f04200ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:47.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.688+0000 7f0426600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0420153a30 0x7f042014dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:47.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.688+0000 7f0426600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0420156b20 0x7f0420156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:47.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.688+0000 7f0426600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04201574e0 con 0x7f0420156b20 2024-01-31T05:05:47.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.688+0000 7f0426600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0420154b20 con 0x7f0420153a30 2024-01-31T05:05:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.688+0000 7f0426600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042014e200 con 0x7f0400003980 2024-01-31T05:05:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.692+0000 7f041fe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0420156b20 0x7f0420156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.692+0000 7f041fe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0420156b20 0x7f0420156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40584/0 (socket says 172.21.15.49:40584) 2024-01-31T05:05:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.692+0000 7f041fe00640 1 -- 172.21.15.49:0/3646803530 learned_addr learned my addr 172.21.15.49:0/3646803530 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.692+0000 7f041ea00640 1 --2- 172.21.15.49:0/3646803530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0420153a30 0x7f042014dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.692+0000 7f041fe00640 1 -- 172.21.15.49:0/3646803530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0400003980 msgr2=0x7f04200ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.692+0000 7f041fe00640 1 --2- 172.21.15.49:0/3646803530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0400003980 0x7f04200ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.692+0000 7f041fe00640 1 -- 172.21.15.49:0/3646803530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0420153a30 msgr2=0x7f042014dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.692+0000 7f041fe00640 1 --2- 172.21.15.49:0/3646803530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0420153a30 0x7f042014dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.692+0000 7f041fe00640 1 -- 172.21.15.49:0/3646803530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0420153fa0 con 0x7f0420156b20 2024-01-31T05:05:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.692+0000 7f041fe00640 1 --2- 172.21.15.49:0/3646803530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0420156b20 0x7f0420156fa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0420068110 tx=0x7f0418009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.692+0000 7f0417400640 1 -- 172.21.15.49:0/3646803530 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041800ccc0 con 0x7f0420156b20 2024-01-31T05:05:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.692+0000 7f0417400640 1 -- 172.21.15.49:0/3646803530 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041800ce20 con 0x7f0420156b20 2024-01-31T05:05:47.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.692+0000 7f0417400640 1 -- 172.21.15.49:0/3646803530 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0418016450 con 0x7f0420156b20 2024-01-31T05:05:47.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.692+0000 7f0426600640 1 -- 172.21.15.49:0/3646803530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0420154280 con 0x7f0420156b20 2024-01-31T05:05:47.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.692+0000 7f0426600640 1 -- 172.21.15.49:0/3646803530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0420154840 con 0x7f0420156b20 2024-01-31T05:05:47.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.692+0000 7f0426600640 1 -- 172.21.15.49:0/3646803530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04200ce880 con 0x7f0420156b20 2024-01-31T05:05:47.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.692+0000 7f0417400640 1 -- 172.21.15.49:0/3646803530 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f041800b390 con 0x7f0420156b20 2024-01-31T05:05:47.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.696+0000 7f0417400640 1 --2- 172.21.15.49:0/3646803530 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f03f8066530 0x7f03f80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:47.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.696+0000 7f0417400640 1 -- 172.21.15.49:0/3646803530 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f04180839c0 con 0x7f0420156b20 2024-01-31T05:05:47.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.696+0000 7f041f400640 1 --2- 172.21.15.49:0/3646803530 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f03f8066530 0x7f03f80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:47.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.696+0000 7f041f400640 1 --2- 172.21.15.49:0/3646803530 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f03f8066530 0x7f03f80689f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f04100ad000 tx=0x7f0410004710 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:47.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.700+0000 7f0417400640 1 -- 172.21.15.49:0/3646803530 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f0418050dd0 con 0x7f0420156b20 2024-01-31T05:05:47.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.912+0000 7f0426600640 1 -- 172.21.15.49:0/3646803530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f0420074860 con 0x7f0420156b20 2024-01-31T05:05:47.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.912+0000 7f0417400640 1 -- 172.21.15.49:0/3646803530 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f041801b020 con 0x7f0420156b20 2024-01-31T05:05:47.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.916+0000 7f0426600640 1 -- 172.21.15.49:0/3646803530 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f03f8066530 msgr2=0x7f03f80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:47.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.916+0000 7f0426600640 1 --2- 172.21.15.49:0/3646803530 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f03f8066530 0x7f03f80689f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f04100ad000 tx=0x7f0410004710 comp rx=0 tx=0).stop 2024-01-31T05:05:47.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.916+0000 7f0426600640 1 -- 172.21.15.49:0/3646803530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0420156b20 msgr2=0x7f0420156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:47.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.916+0000 7f0426600640 1 --2- 172.21.15.49:0/3646803530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0420156b20 0x7f0420156fa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0420068110 tx=0x7f0418009f90 comp rx=0 tx=0).stop 2024-01-31T05:05:47.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.916+0000 7f0426600640 1 -- 172.21.15.49:0/3646803530 shutdown_connections 2024-01-31T05:05:47.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.916+0000 7f0426600640 1 --2- 172.21.15.49:0/3646803530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0420156b20 0x7f0420156fa0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.916+0000 7f0426600640 1 --2- 172.21.15.49:0/3646803530 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f03f8066530 0x7f03f80689f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.916+0000 7f0426600640 1 --2- 172.21.15.49:0/3646803530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0420153a30 0x7f042014dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.916+0000 7f0426600640 1 --2- 172.21.15.49:0/3646803530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0400003980 0x7f04200ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:47.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.916+0000 7f0426600640 1 -- 172.21.15.49:0/3646803530 >> 172.21.15.49:0/3646803530 conn(0x7f04200d0e60 msgr2=0x7f0420157f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:47.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.916+0000 7f0426600640 1 -- 172.21.15.49:0/3646803530 shutdown_connections 2024-01-31T05:05:47.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:47.916+0000 7f0426600640 1 -- 172.21.15.49:0/3646803530 wait complete. 2024-01-31T05:05:47.938 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-01-31T05:05:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.076+0000 7f7741c00640 1 Processor -- start 2024-01-31T05:05:48.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.076+0000 7f7741c00640 1 -- start start 2024-01-31T05:05:48.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.080+0000 7f7741c00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f773c15a000 0x7f773c0cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:48.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.080+0000 7f7741c00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773c06c750 con 0x7f773c06c2d0 2024-01-31T05:05:48.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.080+0000 7f7741c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773c071e40 con 0x7f773c0715e0 2024-01-31T05:05:48.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.080+0000 7f7741c00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773c0b3760 con 0x7f773c15a000 2024-01-31T05:05:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.080+0000 7f773aa00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f773c15a000 0x7f773c0cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.080+0000 7f773a000640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f773c06c2d0 0x7f773c070ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:46328/0 (socket says 172.21.15.49:46328) 2024-01-31T05:05:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.080+0000 7f773a000640 1 -- 172.21.15.49:0/1521681783 learned_addr learned my addr 172.21.15.49:0/1521681783 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.080+0000 7f773aa00640 1 -- 172.21.15.49:0/1521681783 >> v1:172.21.15.195:6789/0 conn(0x7f773c0715e0 legacy=0x7f773c0ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.080+0000 7f773aa00640 1 -- 172.21.15.49:0/1521681783 >> v1:172.21.15.49:6789/0 conn(0x7f773c06c2d0 legacy=0x7f773c070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:48.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.080+0000 7f773aa00640 1 -- 172.21.15.49:0/1521681783 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c06c990 con 0x7f773c15a000 2024-01-31T05:05:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.084+0000 7f773aa00640 1 --2- 172.21.15.49:0/1521681783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f773c15a000 0x7f773c0cb040 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f772c0097c0 tx=0x7f772c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff0973658f21cb server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.084+0000 7f7739600640 1 -- 172.21.15.49:0/1521681783 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c0ab640 con 0x7f773c15a000 2024-01-31T05:05:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.084+0000 7f7739600640 1 -- 172.21.15.49:0/1521681783 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772c0a7070 con 0x7f773c15a000 2024-01-31T05:05:48.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.084+0000 7f7739600640 1 -- 172.21.15.49:0/1521681783 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c0ab9c0 con 0x7f773c15a000 2024-01-31T05:05:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.084+0000 7f7741c00640 1 -- 172.21.15.49:0/1521681783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f773c15a000 msgr2=0x7f773c0cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.084+0000 7f7741c00640 1 --2- 172.21.15.49:0/1521681783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f773c15a000 0x7f773c0cb040 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f772c0097c0 tx=0x7f772c01c440 comp rx=0 tx=0).stop 2024-01-31T05:05:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.084+0000 7f7741c00640 1 -- 172.21.15.49:0/1521681783 shutdown_connections 2024-01-31T05:05:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.084+0000 7f7741c00640 1 --2- 172.21.15.49:0/1521681783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f773c15a000 0x7f773c0cb040 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.084+0000 7f7741c00640 1 -- 172.21.15.49:0/1521681783 >> 172.21.15.49:0/1521681783 conn(0x7f773c0b09a0 msgr2=0x7f773c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.084+0000 7f7741c00640 1 -- 172.21.15.49:0/1521681783 shutdown_connections 2024-01-31T05:05:48.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.084+0000 7f7741c00640 1 -- 172.21.15.49:0/1521681783 wait complete. 2024-01-31T05:05:48.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.084+0000 7f7741c00640 1 Processor -- start 2024-01-31T05:05:48.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.084+0000 7f7741c00640 1 -- start start 2024-01-31T05:05:48.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f7741c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f773c06c2d0 0x7f773c15c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:48.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f7741c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f773c0715e0 0x7f773c148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:48.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f7741c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f773c15a000 0x7f773c151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:48.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f7741c00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c158f70 con 0x7f773c06c2d0 2024-01-31T05:05:48.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f7741c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c157ed0 con 0x7f773c0715e0 2024-01-31T05:05:48.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f7741c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c1581b0 con 0x7f773c15a000 2024-01-31T05:05:48.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f773aa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f773c06c2d0 0x7f773c15c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:48.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f773a000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f773c0715e0 0x7f773c148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:48.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f773aa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f773c06c2d0 0x7f773c15c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40592/0 (socket says 172.21.15.49:40592) 2024-01-31T05:05:48.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f773aa00640 1 -- 172.21.15.49:0/2456723494 learned_addr learned my addr 172.21.15.49:0/2456723494 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:48.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f773b400640 1 --2- 172.21.15.49:0/2456723494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f773c15a000 0x7f773c151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:48.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f773aa00640 1 -- 172.21.15.49:0/2456723494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f773c15a000 msgr2=0x7f773c151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:48.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f773aa00640 1 --2- 172.21.15.49:0/2456723494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f773c15a000 0x7f773c151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f773aa00640 1 -- 172.21.15.49:0/2456723494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f773c0715e0 msgr2=0x7f773c148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:48.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f773aa00640 1 --2- 172.21.15.49:0/2456723494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f773c0715e0 0x7f773c148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f773aa00640 1 -- 172.21.15.49:0/2456723494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c009420 con 0x7f773c06c2d0 2024-01-31T05:05:48.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f773aa00640 1 --2- 172.21.15.49:0/2456723494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f773c06c2d0 0x7f773c15c2a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f772c0ad040 tx=0x7f772c01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:48.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f7732a00640 1 -- 172.21.15.49:0/2456723494 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c0bf610 con 0x7f773c06c2d0 2024-01-31T05:05:48.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f7732a00640 1 -- 172.21.15.49:0/2456723494 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772c0bf790 con 0x7f773c06c2d0 2024-01-31T05:05:48.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f7741c00640 1 -- 172.21.15.49:0/2456723494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773c158490 con 0x7f773c06c2d0 2024-01-31T05:05:48.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f7732a00640 1 -- 172.21.15.49:0/2456723494 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c0bfb40 con 0x7f773c06c2d0 2024-01-31T05:05:48.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f7741c00640 1 -- 172.21.15.49:0/2456723494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773c158a50 con 0x7f773c06c2d0 2024-01-31T05:05:48.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.088+0000 7f7741c00640 1 -- 172.21.15.49:0/2456723494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f773c074860 con 0x7f773c06c2d0 2024-01-31T05:05:48.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.092+0000 7f7732a00640 1 -- 172.21.15.49:0/2456723494 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f772c0b5400 con 0x7f773c06c2d0 2024-01-31T05:05:48.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.092+0000 7f7732a00640 1 --2- 172.21.15.49:0/2456723494 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7714066500 0x7f77140689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:48.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.092+0000 7f7732a00640 1 -- 172.21.15.49:0/2456723494 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f772c11f120 con 0x7f773c06c2d0 2024-01-31T05:05:48.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.092+0000 7f773a000640 1 --2- 172.21.15.49:0/2456723494 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7714066500 0x7f77140689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:48.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.092+0000 7f773a000640 1 --2- 172.21.15.49:0/2456723494 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7714066500 0x7f77140689c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f773c15c7e0 tx=0x7f7724007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:48.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.092+0000 7f7732a00640 1 -- 172.21.15.49:0/2456723494 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f772c0ec810 con 0x7f773c06c2d0 2024-01-31T05:05:48.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.316+0000 7f7741c00640 1 -- 172.21.15.49:0/2456723494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f773c152e60 con 0x7f773c06c2d0 2024-01-31T05:05:48.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.320+0000 7f7732a00640 1 -- 172.21.15.49:0/2456723494 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f772c0efe30 con 0x7f773c06c2d0 2024-01-31T05:05:48.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.320+0000 7f7741c00640 1 -- 172.21.15.49:0/2456723494 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7714066500 msgr2=0x7f77140689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:48.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.320+0000 7f7741c00640 1 --2- 172.21.15.49:0/2456723494 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7714066500 0x7f77140689c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f773c15c7e0 tx=0x7f7724007e90 comp rx=0 tx=0).stop 2024-01-31T05:05:48.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.320+0000 7f7741c00640 1 -- 172.21.15.49:0/2456723494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f773c06c2d0 msgr2=0x7f773c15c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.320+0000 7f7741c00640 1 --2- 172.21.15.49:0/2456723494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f773c06c2d0 0x7f773c15c2a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f772c0ad040 tx=0x7f772c01ac80 comp rx=0 tx=0).stop 2024-01-31T05:05:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.320+0000 7f7741c00640 1 -- 172.21.15.49:0/2456723494 shutdown_connections 2024-01-31T05:05:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.320+0000 7f7741c00640 1 --2- 172.21.15.49:0/2456723494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f773c15a000 0x7f773c151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.320+0000 7f7741c00640 1 --2- 172.21.15.49:0/2456723494 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7714066500 0x7f77140689c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.320+0000 7f7741c00640 1 --2- 172.21.15.49:0/2456723494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f773c0715e0 0x7f773c148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.320+0000 7f7741c00640 1 --2- 172.21.15.49:0/2456723494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f773c06c2d0 0x7f773c15c2a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.320+0000 7f7741c00640 1 -- 172.21.15.49:0/2456723494 >> 172.21.15.49:0/2456723494 conn(0x7f773c0b09a0 msgr2=0x7f773c155ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.320+0000 7f7741c00640 1 -- 172.21.15.49:0/2456723494 shutdown_connections 2024-01-31T05:05:48.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.320+0000 7f7741c00640 1 -- 172.21.15.49:0/2456723494 wait complete. 2024-01-31T05:05:48.343 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:48.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.484+0000 7f9604c00640 1 Processor -- start 2024-01-31T05:05:48.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.484+0000 7f9604c00640 1 -- start start 2024-01-31T05:05:48.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.484+0000 7f9604c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96000cff70 0x7f96000cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:48.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.484+0000 7f9604c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f96000cb9f0 0x7f96000cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:48.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.484+0000 7f9604c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96000cef80 con 0x7f960015d540 2024-01-31T05:05:48.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.484+0000 7f9604c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96000d03d0 con 0x7f96000cb9f0 2024-01-31T05:05:48.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.484+0000 7f9604c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960006cae0 con 0x7f96000cff70 2024-01-31T05:05:48.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.484+0000 7f95fde00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f960015d540 0x7f960006c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:33170/0 (socket says 172.21.15.49:33170) 2024-01-31T05:05:48.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.484+0000 7f95fd400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96000cff70 0x7f96000cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:48.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.484+0000 7f95fde00640 1 -- 172.21.15.49:0/3227184249 learned_addr learned my addr 172.21.15.49:0/3227184249 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:48.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.484+0000 7f95fe800640 1 --2- 172.21.15.49:0/3227184249 >> v2:172.21.15.195:3300/0 conn(0x7f96000cb9f0 0x7f96000cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:48.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.488+0000 7f95fca00640 1 -- 172.21.15.49:0/3227184249 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681305553 0 0) 0x7f96000cef80 con 0x7f960015d540 2024-01-31T05:05:48.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.488+0000 7f95fca00640 1 -- 172.21.15.49:0/3227184249 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95e0003530 con 0x7f960015d540 2024-01-31T05:05:48.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.488+0000 7f95fe800640 1 -- 172.21.15.49:0/3227184249 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96000cff70 msgr2=0x7f96000cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:48.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.488+0000 7f95fe800640 1 --2- 172.21.15.49:0/3227184249 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96000cff70 0x7f96000cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.488+0000 7f95fe800640 1 -- 172.21.15.49:0/3227184249 >> v1:172.21.15.195:6789/0 conn(0x7f960015d540 legacy=0x7f960006c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:48.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.488+0000 7f95fe800640 1 -- 172.21.15.49:0/3227184249 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96000cf1b0 con 0x7f96000cb9f0 2024-01-31T05:05:48.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.488+0000 7f95fd400640 1 --2- 172.21.15.49:0/3227184249 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96000cff70 0x7f96000cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:48.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.488+0000 7f95fe800640 1 --2- 172.21.15.49:0/3227184249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96000cb9f0 0x7f96000cbe80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009d90 tx=0x7f95f801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d0cbb25e972ea6f server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:48.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.488+0000 7f95fca00640 1 -- 172.21.15.49:0/3227184249 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f80a59e0 con 0x7f96000cb9f0 2024-01-31T05:05:48.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.488+0000 7f95fca00640 1 -- 172.21.15.49:0/3227184249 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f80a5b40 con 0x7f96000cb9f0 2024-01-31T05:05:48.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.488+0000 7f95fca00640 1 -- 172.21.15.49:0/3227184249 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f80ad440 con 0x7f96000cb9f0 2024-01-31T05:05:48.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.492+0000 7f9604c00640 1 -- 172.21.15.49:0/3227184249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96000cb9f0 msgr2=0x7f96000cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:48.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.492+0000 7f9604c00640 1 --2- 172.21.15.49:0/3227184249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96000cb9f0 0x7f96000cbe80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009d90 tx=0x7f95f801c920 comp rx=0 tx=0).stop 2024-01-31T05:05:48.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.492+0000 7f9604c00640 1 -- 172.21.15.49:0/3227184249 shutdown_connections 2024-01-31T05:05:48.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.492+0000 7f9604c00640 1 --2- 172.21.15.49:0/3227184249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96000cb9f0 0x7f96000cbe80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.492+0000 7f9604c00640 1 --2- 172.21.15.49:0/3227184249 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96000cff70 0x7f96000cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.492+0000 7f9604c00640 1 -- 172.21.15.49:0/3227184249 >> 172.21.15.49:0/3227184249 conn(0x7f96000d0e60 msgr2=0x7f96000d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:48.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.492+0000 7f9604c00640 1 -- 172.21.15.49:0/3227184249 shutdown_connections 2024-01-31T05:05:48.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.492+0000 7f9604c00640 1 -- 172.21.15.49:0/3227184249 wait complete. 2024-01-31T05:05:48.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.492+0000 7f9604c00640 1 Processor -- start 2024-01-31T05:05:48.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.492+0000 7f9604c00640 1 -- start start 2024-01-31T05:05:48.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.492+0000 7f9604c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96000cb9f0 0x7f96000b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:48.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.492+0000 7f9604c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96000cff70 0x7f960014d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:48.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.492+0000 7f9604c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f960015d540 0x7f9600154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.492+0000 7f9604c00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960014e990 con 0x7f96000cb9f0 2024-01-31T05:05:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.492+0000 7f9604c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960014daa0 con 0x7f960015d540 2024-01-31T05:05:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.492+0000 7f9604c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960014dd80 con 0x7f96000cff70 2024-01-31T05:05:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.492+0000 7f95fde00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96000cb9f0 0x7f96000b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.492+0000 7f95fde00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96000cb9f0 0x7f96000b6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33448/0 (socket says 172.21.15.49:33448) 2024-01-31T05:05:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.492+0000 7f95fde00640 1 -- 172.21.15.49:0/1583062018 learned_addr learned my addr 172.21.15.49:0/1583062018 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.496+0000 7f95fd400640 1 --2- 172.21.15.49:0/1583062018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96000cff70 0x7f960014d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.496+0000 7f95fe800640 1 --2- 172.21.15.49:0/1583062018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f960015d540 0x7f9600154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.496+0000 7f95fde00640 1 -- 172.21.15.49:0/1583062018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96000cff70 msgr2=0x7f960014d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.496+0000 7f95fde00640 1 --2- 172.21.15.49:0/1583062018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96000cff70 0x7f960014d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.496+0000 7f95fde00640 1 -- 172.21.15.49:0/1583062018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f960015d540 msgr2=0x7f9600154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.496+0000 7f95fde00640 1 --2- 172.21.15.49:0/1583062018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f960015d540 0x7f9600154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.496+0000 7f95fde00640 1 -- 172.21.15.49:0/1583062018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e8009420 con 0x7f96000cb9f0 2024-01-31T05:05:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.496+0000 7f95fde00640 1 --2- 172.21.15.49:0/1583062018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96000cb9f0 0x7f96000b6560 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f95f000c3c0 tx=0x7f95f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:48.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.496+0000 7f95f6000640 1 -- 172.21.15.49:0/1583062018 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0005cf0 con 0x7f96000cb9f0 2024-01-31T05:05:48.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.496+0000 7f95f6000640 1 -- 172.21.15.49:0/1583062018 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f0005e50 con 0x7f96000cb9f0 2024-01-31T05:05:48.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.496+0000 7f9604c00640 1 -- 172.21.15.49:0/1583062018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f8009a70 con 0x7f96000cb9f0 2024-01-31T05:05:48.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.496+0000 7f95f6000640 1 -- 172.21.15.49:0/1583062018 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f00072f0 con 0x7f96000cb9f0 2024-01-31T05:05:48.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.496+0000 7f9604c00640 1 -- 172.21.15.49:0/1583062018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960014e340 con 0x7f96000cb9f0 2024-01-31T05:05:48.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.496+0000 7f9604c00640 1 -- 172.21.15.49:0/1583062018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96000ce880 con 0x7f96000cb9f0 2024-01-31T05:05:48.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.496+0000 7f95f6000640 1 -- 172.21.15.49:0/1583062018 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f95f0007450 con 0x7f96000cb9f0 2024-01-31T05:05:48.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.500+0000 7f95f6000640 1 --2- 172.21.15.49:0/1583062018 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f95d8066500 0x7f95d80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:48.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.500+0000 7f95f6000640 1 -- 172.21.15.49:0/1583062018 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f95f0083370 con 0x7f96000cb9f0 2024-01-31T05:05:48.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.500+0000 7f95fd400640 1 --2- 172.21.15.49:0/1583062018 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f95d8066500 0x7f95d80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:48.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.500+0000 7f95fd400640 1 --2- 172.21.15.49:0/1583062018 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f95d8066500 0x7f95d80689c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f960006d200 tx=0x7f95e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:48.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.504+0000 7f95f6000640 1 -- 172.21.15.49:0/1583062018 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f95f0050700 con 0x7f96000cb9f0 2024-01-31T05:05:48.661 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:05:48.664 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:05:48.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.664+0000 7f9604c00640 1 -- 172.21.15.49:0/1583062018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9600074860 con 0x7f96000cb9f0 2024-01-31T05:05:48.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.668+0000 7f95f6000640 1 -- 172.21.15.49:0/1583062018 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13039 (secure 0 0 0) 0x7f9600074860 con 0x7f96000cb9f0 2024-01-31T05:05:48.669 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:48.669 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":35,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:05:45.497542+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:48.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.668+0000 7f9604c00640 1 -- 172.21.15.49:0/1583062018 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f95d8066500 msgr2=0x7f95d80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:48.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.668+0000 7f9604c00640 1 --2- 172.21.15.49:0/1583062018 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f95d8066500 0x7f95d80689c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f960006d200 tx=0x7f95e8008040 comp rx=0 tx=0).stop 2024-01-31T05:05:48.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.668+0000 7f9604c00640 1 -- 172.21.15.49:0/1583062018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96000cb9f0 msgr2=0x7f96000b6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:48.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.668+0000 7f9604c00640 1 --2- 172.21.15.49:0/1583062018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96000cb9f0 0x7f96000b6560 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f95f000c3c0 tx=0x7f95f000c880 comp rx=0 tx=0).stop 2024-01-31T05:05:48.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.668+0000 7f9604c00640 1 -- 172.21.15.49:0/1583062018 shutdown_connections 2024-01-31T05:05:48.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.668+0000 7f9604c00640 1 --2- 172.21.15.49:0/1583062018 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f95d8066500 0x7f95d80689c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.668+0000 7f9604c00640 1 --2- 172.21.15.49:0/1583062018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f960015d540 0x7f9600154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.668+0000 7f9604c00640 1 --2- 172.21.15.49:0/1583062018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96000cff70 0x7f960014d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.668+0000 7f9604c00640 1 --2- 172.21.15.49:0/1583062018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96000cb9f0 0x7f96000b6560 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.668+0000 7f9604c00640 1 -- 172.21.15.49:0/1583062018 >> 172.21.15.49:0/1583062018 conn(0x7f96000d0e60 msgr2=0x7f960015c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:48.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.668+0000 7f9604c00640 1 -- 172.21.15.49:0/1583062018 shutdown_connections 2024-01-31T05:05:48.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.668+0000 7f9604c00640 1 -- 172.21.15.49:0/1583062018 wait complete. 2024-01-31T05:05:48.692 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-31T05:05:48.692 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:05:48.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.900+0000 7f0a16c00640 1 Processor -- start 2024-01-31T05:05:48.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.900+0000 7f0a16c00640 1 -- start start 2024-01-31T05:05:48.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.904+0000 7f0a16c00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0a1015a000 0x7f0a100cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.904+0000 7f0a16c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0a1006c2d0 0x7f0a10070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.904+0000 7f0a16c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a10071410 0x7f0a100b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.904+0000 7f0a16c00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a100b3760 con 0x7f0a1015a000 2024-01-31T05:05:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.904+0000 7f0a16c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1006c750 con 0x7f0a1006c2d0 2024-01-31T05:05:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.904+0000 7f0a16c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a10071880 con 0x7f0a10071410 2024-01-31T05:05:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.904+0000 7f0a0fe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0a1015a000 0x7f0a100cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.904+0000 7f0a0fe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0a1015a000 0x7f0a100cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33456/0 (socket says 172.21.15.49:33456) 2024-01-31T05:05:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.904+0000 7f0a0fe00640 1 -- 172.21.15.49:0/251022508 learned_addr learned my addr 172.21.15.49:0/251022508 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.904+0000 7f0a14c00640 1 --2- 172.21.15.49:0/251022508 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a10071410 0x7f0a100b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.904+0000 7f0a0f400640 1 --2- 172.21.15.49:0/251022508 >> v2:172.21.15.195:3300/0 conn(0x7f0a1006c2d0 0x7f0a10070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.904+0000 7f0a0fe00640 1 -- 172.21.15.49:0/251022508 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a10071410 msgr2=0x7f0a100b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.904+0000 7f0a0fe00640 1 --2- 172.21.15.49:0/251022508 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a10071410 0x7f0a100b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.904+0000 7f0a0fe00640 1 -- 172.21.15.49:0/251022508 >> v2:172.21.15.195:3300/0 conn(0x7f0a1006c2d0 msgr2=0x7f0a10070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.904+0000 7f0a0fe00640 1 --2- 172.21.15.49:0/251022508 >> v2:172.21.15.195:3300/0 conn(0x7f0a1006c2d0 0x7f0a10070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.904+0000 7f0a0fe00640 1 -- 172.21.15.49:0/251022508 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a10071e40 con 0x7f0a1015a000 2024-01-31T05:05:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.904+0000 7f0a14c00640 1 --2- 172.21.15.49:0/251022508 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a10071410 0x7f0a100b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.908+0000 7f0a0fe00640 1 --2- 172.21.15.49:0/251022508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a1015a000 0x7f0a100cb040 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0a10072e80 tx=0x7f0a0001ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3d4bf7d19b511d server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.908+0000 7f0a0ea00640 1 -- 172.21.15.49:0/251022508 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a000a7c60 con 0x7f0a1015a000 2024-01-31T05:05:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.908+0000 7f0a0ea00640 1 -- 172.21.15.49:0/251022508 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a000a7dc0 con 0x7f0a1015a000 2024-01-31T05:05:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.908+0000 7f0a0ea00640 1 -- 172.21.15.49:0/251022508 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a000af660 con 0x7f0a1015a000 2024-01-31T05:05:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.908+0000 7f0a16c00640 1 -- 172.21.15.49:0/251022508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a1015a000 msgr2=0x7f0a100cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.908+0000 7f0a16c00640 1 --2- 172.21.15.49:0/251022508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a1015a000 0x7f0a100cb040 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0a10072e80 tx=0x7f0a0001ebd0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.908+0000 7f0a16c00640 1 -- 172.21.15.49:0/251022508 shutdown_connections 2024-01-31T05:05:48.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.908+0000 7f0a16c00640 1 --2- 172.21.15.49:0/251022508 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a10071410 0x7f0a100b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.908+0000 7f0a16c00640 1 --2- 172.21.15.49:0/251022508 >> v2:172.21.15.195:3300/0 conn(0x7f0a1006c2d0 0x7f0a10070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.908+0000 7f0a16c00640 1 --2- 172.21.15.49:0/251022508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a1015a000 0x7f0a100cb040 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.908+0000 7f0a16c00640 1 -- 172.21.15.49:0/251022508 >> 172.21.15.49:0/251022508 conn(0x7f0a100b09a0 msgr2=0x7f0a100b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:48.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.908+0000 7f0a16c00640 1 -- 172.21.15.49:0/251022508 shutdown_connections 2024-01-31T05:05:48.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.908+0000 7f0a16c00640 1 -- 172.21.15.49:0/251022508 wait complete. 2024-01-31T05:05:48.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.908+0000 7f0a16c00640 1 Processor -- start 2024-01-31T05:05:48.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.908+0000 7f0a16c00640 1 -- start start 2024-01-31T05:05:48.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a16c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a1006c2d0 0x7f0a100ce360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:48.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a16c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a10071410 0x7f0a10155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:48.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a16c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a1015a000 0x7f0a10156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:48.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a16c00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100cd210 con 0x7f0a1006c2d0 2024-01-31T05:05:48.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a16c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100cc590 con 0x7f0a1015a000 2024-01-31T05:05:48.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a16c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100cc870 con 0x7f0a10071410 2024-01-31T05:05:48.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a0fe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a1006c2d0 0x7f0a100ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:48.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a0fe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a1006c2d0 0x7f0a100ce360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33468/0 (socket says 172.21.15.49:33468) 2024-01-31T05:05:48.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a0fe00640 1 -- 172.21.15.49:0/2700500835 learned_addr learned my addr 172.21.15.49:0/2700500835 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:48.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a0f400640 1 --2- 172.21.15.49:0/2700500835 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a10071410 0x7f0a10155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:48.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a14c00640 1 --2- 172.21.15.49:0/2700500835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a1015a000 0x7f0a10156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:48.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a0fe00640 1 -- 172.21.15.49:0/2700500835 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a10071410 msgr2=0x7f0a10155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:48.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a0fe00640 1 --2- 172.21.15.49:0/2700500835 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a10071410 0x7f0a10155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a0fe00640 1 -- 172.21.15.49:0/2700500835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a1015a000 msgr2=0x7f0a10156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:48.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a0fe00640 1 --2- 172.21.15.49:0/2700500835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a1015a000 0x7f0a10156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:48.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a0fe00640 1 -- 172.21.15.49:0/2700500835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0000b770 con 0x7f0a1006c2d0 2024-01-31T05:05:48.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a0fe00640 1 --2- 172.21.15.49:0/2700500835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a1006c2d0 0x7f0a100ce360 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0a0001c800 tx=0x7f0a0001b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:48.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a07e00640 1 -- 172.21.15.49:0/2700500835 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a000a7c60 con 0x7f0a1006c2d0 2024-01-31T05:05:48.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a07e00640 1 -- 172.21.15.49:0/2700500835 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a000b9410 con 0x7f0a1006c2d0 2024-01-31T05:05:48.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a07e00640 1 -- 172.21.15.49:0/2700500835 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a000b97a0 con 0x7f0a1006c2d0 2024-01-31T05:05:48.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a16c00640 1 -- 172.21.15.49:0/2700500835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a100ccb50 con 0x7f0a1006c2d0 2024-01-31T05:05:48.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a16c00640 1 -- 172.21.15.49:0/2700500835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a100ce8a0 con 0x7f0a1006c2d0 2024-01-31T05:05:48.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.912+0000 7f0a16c00640 1 -- 172.21.15.49:0/2700500835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a100cea30 con 0x7f0a1006c2d0 2024-01-31T05:05:48.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.916+0000 7f0a07e00640 1 -- 172.21.15.49:0/2700500835 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f0a000b6050 con 0x7f0a1006c2d0 2024-01-31T05:05:48.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.916+0000 7f0a07e00640 1 --2- 172.21.15.49:0/2700500835 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f09e8066500 0x7f09e80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:48.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.916+0000 7f0a07e00640 1 -- 172.21.15.49:0/2700500835 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0a001211f0 con 0x7f0a1006c2d0 2024-01-31T05:05:48.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.916+0000 7f0a0f400640 1 --2- 172.21.15.49:0/2700500835 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f09e8066500 0x7f09e80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:48.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.916+0000 7f0a0f400640 1 --2- 172.21.15.49:0/2700500835 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f09e8066500 0x7f09e80689c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0a1015d590 tx=0x7f09f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:48.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:48.920+0000 7f0a07e00640 1 -- 172.21.15.49:0/2700500835 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f0a000ee740 con 0x7f0a1006c2d0 2024-01-31T05:05:49.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.080+0000 7f0a16c00640 1 -- 172.21.15.49:0/2700500835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0a10074860 con 0x7f0a1006c2d0 2024-01-31T05:05:49.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.080+0000 7f0a07e00640 1 -- 172.21.15.49:0/2700500835 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0a000b40a0 con 0x7f0a1006c2d0 2024-01-31T05:05:49.083 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T05:05:49.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.084+0000 7f0a16c00640 1 -- 172.21.15.49:0/2700500835 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f09e8066500 msgr2=0x7f09e80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:49.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.084+0000 7f0a16c00640 1 --2- 172.21.15.49:0/2700500835 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f09e8066500 0x7f09e80689c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0a1015d590 tx=0x7f09f8008040 comp rx=0 tx=0).stop 2024-01-31T05:05:49.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.084+0000 7f0a16c00640 1 -- 172.21.15.49:0/2700500835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a1006c2d0 msgr2=0x7f0a100ce360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:49.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.084+0000 7f0a16c00640 1 --2- 172.21.15.49:0/2700500835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a1006c2d0 0x7f0a100ce360 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0a0001c800 tx=0x7f0a0001b970 comp rx=0 tx=0).stop 2024-01-31T05:05:49.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.084+0000 7f0a16c00640 1 -- 172.21.15.49:0/2700500835 shutdown_connections 2024-01-31T05:05:49.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.084+0000 7f0a16c00640 1 --2- 172.21.15.49:0/2700500835 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f09e8066500 0x7f09e80689c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.084+0000 7f0a16c00640 1 --2- 172.21.15.49:0/2700500835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a1015a000 0x7f0a10156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.084+0000 7f0a16c00640 1 --2- 172.21.15.49:0/2700500835 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a10071410 0x7f0a10155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.084+0000 7f0a16c00640 1 --2- 172.21.15.49:0/2700500835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a1006c2d0 0x7f0a100ce360 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.084+0000 7f0a16c00640 1 -- 172.21.15.49:0/2700500835 >> 172.21.15.49:0/2700500835 conn(0x7f0a100b09a0 msgr2=0x7f0a100af470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:49.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.084+0000 7f0a16c00640 1 -- 172.21.15.49:0/2700500835 shutdown_connections 2024-01-31T05:05:49.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.084+0000 7f0a16c00640 1 -- 172.21.15.49:0/2700500835 wait complete. 2024-01-31T05:05:49.106 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-31T05:05:49.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.244+0000 7fc0b0800640 1 Processor -- start 2024-01-31T05:05:49.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.244+0000 7fc0b0800640 1 -- start start 2024-01-31T05:05:49.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.244+0000 7fc0b0800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc0a8159790 0x7fc0a80b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:49.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.244+0000 7fc0b0800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0a80b3d00 0x7fc0a8070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:49.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.244+0000 7fc0b0800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a8159b70 con 0x7fc0a8070ba0 2024-01-31T05:05:49.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.244+0000 7fc0b0800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a8071030 con 0x7fc0a8159790 2024-01-31T05:05:49.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.244+0000 7fc0b0800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a80b2750 con 0x7fc0a80b3d00 2024-01-31T05:05:49.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.248+0000 7fc0ad400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0a80b3d00 0x7fc0a8070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:49.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.248+0000 7fc0ad400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0a80b3d00 0x7fc0a8070660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:55078/0 (socket says 172.21.15.49:55078) 2024-01-31T05:05:49.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.248+0000 7fc0ad400640 1 -- 172.21.15.49:0/33092613 learned_addr learned my addr 172.21.15.49:0/33092613 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:49.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.248+0000 7fc0ade00640 1 --2- 172.21.15.49:0/33092613 >> v2:172.21.15.195:3300/0 conn(0x7fc0a8159790 0x7fc0a80b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:49.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.248+0000 7fc0ae800640 1 --1- 172.21.15.49:0/33092613 >> v1:172.21.15.195:6789/0 conn(0x7fc0a8070ba0 0x7fc0a806cb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:33176/0 (socket says 172.21.15.49:33176) 2024-01-31T05:05:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.248+0000 7fc0ad400640 1 -- 172.21.15.49:0/33092613 >> v2:172.21.15.195:3300/0 conn(0x7fc0a8159790 msgr2=0x7fc0a80b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.248+0000 7fc0ad400640 1 --2- 172.21.15.49:0/33092613 >> v2:172.21.15.195:3300/0 conn(0x7fc0a8159790 0x7fc0a80b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.248+0000 7fc0ad400640 1 -- 172.21.15.49:0/33092613 >> v1:172.21.15.195:6789/0 conn(0x7fc0a8070ba0 legacy=0x7fc0a806cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.248+0000 7fc0aca00640 1 -- 172.21.15.49:0/33092613 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034643599 0 0) 0x7fc0a8159b70 con 0x7fc0a8070ba0 2024-01-31T05:05:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.248+0000 7fc0ad400640 1 -- 172.21.15.49:0/33092613 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a80b2a30 con 0x7fc0a80b3d00 2024-01-31T05:05:49.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.248+0000 7fc0ad400640 1 --2- 172.21.15.49:0/33092613 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0a80b3d00 0x7fc0a8070660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc090009870 tx=0x7fc09001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7107accb19a58fdd server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:49.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.252+0000 7fc0aca00640 1 -- 172.21.15.49:0/33092613 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0900aa670 con 0x7fc0a80b3d00 2024-01-31T05:05:49.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.252+0000 7fc0aca00640 1 -- 172.21.15.49:0/33092613 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0900aa7d0 con 0x7fc0a80b3d00 2024-01-31T05:05:49.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.252+0000 7fc0aca00640 1 -- 172.21.15.49:0/33092613 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0900aab60 con 0x7fc0a80b3d00 2024-01-31T05:05:49.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.252+0000 7fc0b0800640 1 -- 172.21.15.49:0/33092613 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0a80b3d00 msgr2=0x7fc0a8070660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:49.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.252+0000 7fc0b0800640 1 --2- 172.21.15.49:0/33092613 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0a80b3d00 0x7fc0a8070660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc090009870 tx=0x7fc09001c510 comp rx=0 tx=0).stop 2024-01-31T05:05:49.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.252+0000 7fc0b0800640 1 -- 172.21.15.49:0/33092613 shutdown_connections 2024-01-31T05:05:49.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.252+0000 7fc0b0800640 1 --2- 172.21.15.49:0/33092613 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0a80b3d00 0x7fc0a8070660 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.252+0000 7fc0b0800640 1 --2- 172.21.15.49:0/33092613 >> v2:172.21.15.195:3300/0 conn(0x7fc0a8159790 0x7fc0a80b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.252+0000 7fc0b0800640 1 -- 172.21.15.49:0/33092613 >> 172.21.15.49:0/33092613 conn(0x7fc0a80b09a0 msgr2=0x7fc0a80b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:49.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.252+0000 7fc0b0800640 1 -- 172.21.15.49:0/33092613 shutdown_connections 2024-01-31T05:05:49.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.252+0000 7fc0b0800640 1 -- 172.21.15.49:0/33092613 wait complete. 2024-01-31T05:05:49.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.252+0000 7fc0b0800640 1 Processor -- start 2024-01-31T05:05:49.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.252+0000 7fc0b0800640 1 -- start start 2024-01-31T05:05:49.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.252+0000 7fc0b0800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0a8070ba0 0x7fc0a814d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:49.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.252+0000 7fc0b0800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0a80b3d00 0x7fc0a80ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:49.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.252+0000 7fc0b0800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0a8159790 0x7fc0a80ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:49.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.252+0000 7fc0b0800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a8099a50 con 0x7fc0a8070ba0 2024-01-31T05:05:49.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.252+0000 7fc0b0800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a814e810 con 0x7fc0a8159790 2024-01-31T05:05:49.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.252+0000 7fc0b0800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a814eaf0 con 0x7fc0a80b3d00 2024-01-31T05:05:49.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.256+0000 7fc0ade00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0a8070ba0 0x7fc0a814d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:49.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.256+0000 7fc0ade00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0a8070ba0 0x7fc0a814d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33482/0 (socket says 172.21.15.49:33482) 2024-01-31T05:05:49.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.256+0000 7fc0ade00640 1 -- 172.21.15.49:0/1996442621 learned_addr learned my addr 172.21.15.49:0/1996442621 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:49.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.256+0000 7fc0ad400640 1 --2- 172.21.15.49:0/1996442621 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0a80b3d00 0x7fc0a80ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:49.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.256+0000 7fc0ae800640 1 --2- 172.21.15.49:0/1996442621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0a8159790 0x7fc0a80ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:49.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.256+0000 7fc0ade00640 1 -- 172.21.15.49:0/1996442621 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0a80b3d00 msgr2=0x7fc0a80ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:49.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.256+0000 7fc0ade00640 1 --2- 172.21.15.49:0/1996442621 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0a80b3d00 0x7fc0a80ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.256+0000 7fc0ade00640 1 -- 172.21.15.49:0/1996442621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0a8159790 msgr2=0x7fc0a80ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:49.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.256+0000 7fc0ade00640 1 --2- 172.21.15.49:0/1996442621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0a8159790 0x7fc0a80ca570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.256+0000 7fc0ade00640 1 -- 172.21.15.49:0/1996442621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0900094d0 con 0x7fc0a8070ba0 2024-01-31T05:05:49.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.256+0000 7fc0ade00640 1 --2- 172.21.15.49:0/1996442621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0a8070ba0 0x7fc0a814d0e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc09800e870 tx=0x7fc09800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:49.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.256+0000 7fc0a6000640 1 -- 172.21.15.49:0/1996442621 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098009510 con 0x7fc0a8070ba0 2024-01-31T05:05:49.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.256+0000 7fc0a6000640 1 -- 172.21.15.49:0/1996442621 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09800eec0 con 0x7fc0a8070ba0 2024-01-31T05:05:49.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.256+0000 7fc0b0800640 1 -- 172.21.15.49:0/1996442621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a8099ca0 con 0x7fc0a8070ba0 2024-01-31T05:05:49.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.256+0000 7fc0a6000640 1 -- 172.21.15.49:0/1996442621 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09800cb40 con 0x7fc0a8070ba0 2024-01-31T05:05:49.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.256+0000 7fc0b0800640 1 -- 172.21.15.49:0/1996442621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a80cb7c0 con 0x7fc0a8070ba0 2024-01-31T05:05:49.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.256+0000 7fc0b0800640 1 -- 172.21.15.49:0/1996442621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a80caab0 con 0x7fc0a8070ba0 2024-01-31T05:05:49.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.256+0000 7fc0a6000640 1 -- 172.21.15.49:0/1996442621 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fc09800cca0 con 0x7fc0a8070ba0 2024-01-31T05:05:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.260+0000 7fc0a6000640 1 --2- 172.21.15.49:0/1996442621 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc080066500 0x7fc0800689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.260+0000 7fc0a6000640 1 -- 172.21.15.49:0/1996442621 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc098083e40 con 0x7fc0a8070ba0 2024-01-31T05:05:49.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.260+0000 7fc0ad400640 1 --2- 172.21.15.49:0/1996442621 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc080066500 0x7fc0800689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:49.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.260+0000 7fc0ad400640 1 --2- 172.21.15.49:0/1996442621 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc080066500 0x7fc0800689c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc0900ae000 tx=0x7fc0900a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.264+0000 7fc0a6000640 1 -- 172.21.15.49:0/1996442621 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fc098051260 con 0x7fc0a8070ba0 2024-01-31T05:05:49.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.424+0000 7fc0b0800640 1 -- 172.21.15.49:0/1996442621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc0a8074860 con 0x7fc0a8070ba0 2024-01-31T05:05:49.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.428+0000 7fc0a6000640 1 -- 172.21.15.49:0/1996442621 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc098054880 con 0x7fc0a8070ba0 2024-01-31T05:05:49.428 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:49.429 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-01-31T05:05:49.429 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-01-31T05:05:49.429 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-01-31T05:05:49.429 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-01-31T05:05:49.429 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:49.429 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-01-31T05:05:49.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.428+0000 7fc0b0800640 1 -- 172.21.15.49:0/1996442621 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc080066500 msgr2=0x7fc0800689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:49.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.428+0000 7fc0b0800640 1 --2- 172.21.15.49:0/1996442621 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc080066500 0x7fc0800689c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc0900ae000 tx=0x7fc0900a7000 comp rx=0 tx=0).stop 2024-01-31T05:05:49.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.428+0000 7fc0b0800640 1 -- 172.21.15.49:0/1996442621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0a8070ba0 msgr2=0x7fc0a814d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:49.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.428+0000 7fc0b0800640 1 --2- 172.21.15.49:0/1996442621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0a8070ba0 0x7fc0a814d0e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc09800e870 tx=0x7fc09800ec70 comp rx=0 tx=0).stop 2024-01-31T05:05:49.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.428+0000 7fc0b0800640 1 -- 172.21.15.49:0/1996442621 shutdown_connections 2024-01-31T05:05:49.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.428+0000 7fc0b0800640 1 --2- 172.21.15.49:0/1996442621 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc080066500 0x7fc0800689c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.428+0000 7fc0b0800640 1 --2- 172.21.15.49:0/1996442621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0a8159790 0x7fc0a80ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.428+0000 7fc0b0800640 1 --2- 172.21.15.49:0/1996442621 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc0a80b3d00 0x7fc0a80ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.428+0000 7fc0b0800640 1 --2- 172.21.15.49:0/1996442621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0a8070ba0 0x7fc0a814d0e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.428+0000 7fc0b0800640 1 -- 172.21.15.49:0/1996442621 >> 172.21.15.49:0/1996442621 conn(0x7fc0a80b09a0 msgr2=0x7fc0a8150850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:49.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.428+0000 7fc0b0800640 1 -- 172.21.15.49:0/1996442621 shutdown_connections 2024-01-31T05:05:49.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.428+0000 7fc0b0800640 1 -- 172.21.15.49:0/1996442621 wait complete. 2024-01-31T05:05:49.450 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-31T05:05:49.450 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-31T05:05:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.592+0000 7f5e46a00640 1 Processor -- start 2024-01-31T05:05:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.592+0000 7f5e46a00640 1 -- start start 2024-01-31T05:05:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e46a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5e40070ac0 0x7f5e400ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e46a00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e40159b70 con 0x7f5e40070660 2024-01-31T05:05:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e46a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e400b2750 con 0x7f5e40159790 2024-01-31T05:05:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e46a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e400b2a30 con 0x7f5e40070ac0 2024-01-31T05:05:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3f400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5e40070660 0x7f5e400ac050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49736/0 (socket says 172.21.15.49:49736) 2024-01-31T05:05:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3f400640 1 -- 172.21.15.49:0/516151987 learned_addr learned my addr 172.21.15.49:0/516151987 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e44a00640 1 --2- 172.21.15.49:0/516151987 >> v2:172.21.15.195:3300/0 conn(0x7f5e40070ac0 0x7f5e400ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3ea00640 1 -- 172.21.15.49:0/516151987 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536710350 0 0) 0x7f5e40159b70 con 0x7f5e40070660 2024-01-31T05:05:49.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3ea00640 1 -- 172.21.15.49:0/516151987 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e20003530 con 0x7f5e40070660 2024-01-31T05:05:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3ea00640 1 -- 172.21.15.49:0/516151987 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472586639 0 0) 0x7f5e400b2750 con 0x7f5e40159790 2024-01-31T05:05:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3ea00640 1 -- 172.21.15.49:0/516151987 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e40159b70 con 0x7f5e40159790 2024-01-31T05:05:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3ea00640 1 -- 172.21.15.49:0/516151987 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3245319897 0 0) 0x7f5e20003530 con 0x7f5e40070660 2024-01-31T05:05:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3ea00640 1 -- 172.21.15.49:0/516151987 >> v2:172.21.15.195:3300/0 conn(0x7f5e40070ac0 msgr2=0x7f5e400ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3ea00640 1 --2- 172.21.15.49:0/516151987 >> v2:172.21.15.195:3300/0 conn(0x7f5e40070ac0 0x7f5e400ac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3ea00640 1 -- 172.21.15.49:0/516151987 >> v1:172.21.15.195:6789/0 conn(0x7f5e40159790 legacy=0x7f5e400b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3ea00640 1 -- 172.21.15.49:0/516151987 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e400b2d10 con 0x7f5e40070660 2024-01-31T05:05:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3ea00640 1 -- 172.21.15.49:0/516151987 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7f5e28001680 con 0x7f5e40070660 2024-01-31T05:05:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3ea00640 1 -- 172.21.15.49:0/516151987 >> v1:172.21.15.49:6789/0 conn(0x7f5e40070660 legacy=0x7f5e400ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3ea00640 1 --2- 172.21.15.49:0/516151987 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e20003b60 0x7f5e20003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3ea00640 1 --2- 172.21.15.49:0/516151987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e200047d0 0x7f5e20004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3ea00640 1 --2- 172.21.15.49:0/516151987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e20005190 0x7f5e2000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3ea00640 1 -- 172.21.15.49:0/516151987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400b2a30 con 0x7f5e20005190 2024-01-31T05:05:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3ea00640 1 -- 172.21.15.49:0/516151987 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2000e270 con 0x7f5e200047d0 2024-01-31T05:05:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3ea00640 1 -- 172.21.15.49:0/516151987 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2000e430 con 0x7f5e20003b60 2024-01-31T05:05:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e44a00640 1 --2- 172.21.15.49:0/516151987 >> v2:172.21.15.195:3300/0 conn(0x7f5e40070ac0 0x7f5e400ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3f400640 1 --2- 172.21.15.49:0/516151987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e200047d0 0x7f5e20004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e44a00640 1 --2- 172.21.15.49:0/516151987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e20005190 0x7f5e2000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e3fe00640 1 --2- 172.21.15.49:0/516151987 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e20003b60 0x7f5e20003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e44a00640 1 -- 172.21.15.49:0/516151987 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e20003b60 msgr2=0x7f5e20003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e44a00640 1 --2- 172.21.15.49:0/516151987 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e20003b60 0x7f5e20003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e44a00640 1 -- 172.21.15.49:0/516151987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e200047d0 msgr2=0x7f5e20004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e44a00640 1 --2- 172.21.15.49:0/516151987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e200047d0 0x7f5e20004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.596+0000 7f5e44a00640 1 -- 172.21.15.49:0/516151987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e20003530 con 0x7f5e20005190 2024-01-31T05:05:49.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.600+0000 7f5e44a00640 1 -- 172.21.15.49:0/516151987 reap_dead start 2024-01-31T05:05:49.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.600+0000 7f5e44a00640 1 --2- 172.21.15.49:0/516151987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e20005190 0x7f5e2000dba0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800a3f0 tx=0x7f5e3801cff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d5a876b2f7a8ac server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:49.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.600+0000 7f5e3ea00640 1 -- 172.21.15.49:0/516151987 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e380a5df0 con 0x7f5e20005190 2024-01-31T05:05:49.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.600+0000 7f5e3ea00640 1 -- 172.21.15.49:0/516151987 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e380af400 con 0x7f5e20005190 2024-01-31T05:05:49.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.600+0000 7f5e3ea00640 1 -- 172.21.15.49:0/516151987 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e380af7b0 con 0x7f5e20005190 2024-01-31T05:05:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.600+0000 7f5e46a00640 1 -- 172.21.15.49:0/516151987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e20005190 msgr2=0x7f5e2000dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.600+0000 7f5e46a00640 1 --2- 172.21.15.49:0/516151987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e20005190 0x7f5e2000dba0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800a3f0 tx=0x7f5e3801cff0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.600+0000 7f5e46a00640 1 -- 172.21.15.49:0/516151987 shutdown_connections 2024-01-31T05:05:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.600+0000 7f5e46a00640 1 --2- 172.21.15.49:0/516151987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e20005190 0x7f5e2000dba0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.600+0000 7f5e46a00640 1 -- 172.21.15.49:0/516151987 >> 172.21.15.49:0/516151987 conn(0x7f5e400b09a0 msgr2=0x7f5e400b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.600+0000 7f5e46a00640 1 -- 172.21.15.49:0/516151987 shutdown_connections 2024-01-31T05:05:49.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.600+0000 7f5e46a00640 1 -- 172.21.15.49:0/516151987 wait complete. 2024-01-31T05:05:49.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e46a00640 1 Processor -- start 2024-01-31T05:05:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e46a00640 1 -- start start 2024-01-31T05:05:49.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e46a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e20005190 0x7f5e4014c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:49.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e46a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e401f2b60 0x7f5e400cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:49.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e46a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e401f2fc0 0x7f5e400ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:49.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e46a00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4009a330 con 0x7f5e401f2b60 2024-01-31T05:05:49.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e46a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4009ae70 con 0x7f5e401f2fc0 2024-01-31T05:05:49.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e46a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400cb940 con 0x7f5e20005190 2024-01-31T05:05:49.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e3f400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e401f2b60 0x7f5e400cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:49.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e3f400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e401f2b60 0x7f5e400cc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33504/0 (socket says 172.21.15.49:33504) 2024-01-31T05:05:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e3f400640 1 -- 172.21.15.49:0/1322575943 learned_addr learned my addr 172.21.15.49:0/1322575943 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e3fe00640 1 --2- 172.21.15.49:0/1322575943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e20005190 0x7f5e4014c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e44a00640 1 --2- 172.21.15.49:0/1322575943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e401f2fc0 0x7f5e400ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e3f400640 1 -- 172.21.15.49:0/1322575943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e20005190 msgr2=0x7f5e4014c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e3f400640 1 --2- 172.21.15.49:0/1322575943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e20005190 0x7f5e4014c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e3f400640 1 -- 172.21.15.49:0/1322575943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e401f2fc0 msgr2=0x7f5e400ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e3f400640 1 --2- 172.21.15.49:0/1322575943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e401f2fc0 0x7f5e400ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e3f400640 1 -- 172.21.15.49:0/1322575943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4009a540 con 0x7f5e401f2b60 2024-01-31T05:05:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e3f400640 1 --2- 172.21.15.49:0/1322575943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e401f2b60 0x7f5e400cc5a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5e28000c10 tx=0x7f5e28012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e37e00640 1 -- 172.21.15.49:0/1322575943 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e28014750 con 0x7f5e401f2b60 2024-01-31T05:05:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e37e00640 1 -- 172.21.15.49:0/1322575943 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e280148d0 con 0x7f5e401f2b60 2024-01-31T05:05:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e37e00640 1 -- 172.21.15.49:0/1322575943 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e28014c80 con 0x7f5e401f2b60 2024-01-31T05:05:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e46a00640 1 -- 172.21.15.49:0/1322575943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4009a820 con 0x7f5e401f2b60 2024-01-31T05:05:49.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.604+0000 7f5e46a00640 1 -- 172.21.15.49:0/1322575943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4014cd00 con 0x7f5e401f2b60 2024-01-31T05:05:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.608+0000 7f5e46a00640 1 -- 172.21.15.49:0/1322575943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4009b020 con 0x7f5e401f2b60 2024-01-31T05:05:49.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.608+0000 7f5e37e00640 1 -- 172.21.15.49:0/1322575943 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f5e280153e0 con 0x7f5e401f2b60 2024-01-31T05:05:49.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.608+0000 7f5e37e00640 1 --2- 172.21.15.49:0/1322575943 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5e18066530 0x7f5e180689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:49.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.608+0000 7f5e37e00640 1 -- 172.21.15.49:0/1322575943 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5e280868c0 con 0x7f5e401f2b60 2024-01-31T05:05:49.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.608+0000 7f5e3fe00640 1 --2- 172.21.15.49:0/1322575943 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5e18066530 0x7f5e180689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:49.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.612+0000 7f5e3fe00640 1 --2- 172.21.15.49:0/1322575943 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5e18066530 0x7f5e180689f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5e30000c10 tx=0x7f5e30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:49.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.612+0000 7f5e37e00640 1 -- 172.21.15.49:0/1322575943 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f5e4009b020 con 0x7f5e401f2b60 2024-01-31T05:05:49.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:49.772+0000 7f5e46a00640 1 -- 172.21.15.49:0/1322575943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5e4009afe0 con 0x7f5e401f2b60 2024-01-31T05:05:50.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.512+0000 7f5e37e00640 1 -- 172.21.15.49:0/1322575943 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5e2801c070 con 0x7f5e401f2b60 2024-01-31T05:05:50.515 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-01-31T05:05:50.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.516+0000 7f5e46a00640 1 -- 172.21.15.49:0/1322575943 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5e18066530 msgr2=0x7f5e180689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:50.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.516+0000 7f5e46a00640 1 --2- 172.21.15.49:0/1322575943 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5e18066530 0x7f5e180689f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5e30000c10 tx=0x7f5e30009040 comp rx=0 tx=0).stop 2024-01-31T05:05:50.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.516+0000 7f5e46a00640 1 -- 172.21.15.49:0/1322575943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e401f2b60 msgr2=0x7f5e400cc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:50.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.516+0000 7f5e46a00640 1 --2- 172.21.15.49:0/1322575943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e401f2b60 0x7f5e400cc5a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5e28000c10 tx=0x7f5e28012920 comp rx=0 tx=0).stop 2024-01-31T05:05:50.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.516+0000 7f5e46a00640 1 -- 172.21.15.49:0/1322575943 shutdown_connections 2024-01-31T05:05:50.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.516+0000 7f5e46a00640 1 --2- 172.21.15.49:0/1322575943 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5e18066530 0x7f5e180689f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.516+0000 7f5e46a00640 1 --2- 172.21.15.49:0/1322575943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e401f2fc0 0x7f5e400ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.516+0000 7f5e46a00640 1 --2- 172.21.15.49:0/1322575943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e401f2b60 0x7f5e400cc5a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.516+0000 7f5e46a00640 1 --2- 172.21.15.49:0/1322575943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e20005190 0x7f5e4014c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.516+0000 7f5e46a00640 1 -- 172.21.15.49:0/1322575943 >> 172.21.15.49:0/1322575943 conn(0x7f5e400b09a0 msgr2=0x7f5e400b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.520+0000 7f5e46a00640 1 -- 172.21.15.49:0/1322575943 shutdown_connections 2024-01-31T05:05:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.520+0000 7f5e46a00640 1 -- 172.21.15.49:0/1322575943 wait complete. 2024-01-31T05:05:50.546 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-31T05:05:50.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-01-31T05:05:50.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.692+0000 7fcc7ca00640 1 Processor -- start 2024-01-31T05:05:50.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc7ca00640 1 -- start start 2024-01-31T05:05:50.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc7ca00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcc74070660 0x7fcc74070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:50.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc7ca00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc74071000 con 0x7fcc74159790 2024-01-31T05:05:50.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc7ca00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc74159b70 con 0x7fcc740ac050 2024-01-31T05:05:50.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc7ca00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc740b2750 con 0x7fcc74070660 2024-01-31T05:05:50.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc7a000640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcc74159790 0x7fcc740b37c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49752/0 (socket says 172.21.15.49:49752) 2024-01-31T05:05:50.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc7a000640 1 -- 172.21.15.49:0/3735048467 learned_addr learned my addr 172.21.15.49:0/3735048467 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:50.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc79600640 1 --2- 172.21.15.49:0/3735048467 >> v2:172.21.15.195:3300/0 conn(0x7fcc74070660 0x7fcc74070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:50.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc78c00640 1 -- 172.21.15.49:0/3735048467 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221280309 0 0) 0x7fcc74071000 con 0x7fcc74159790 2024-01-31T05:05:50.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc78c00640 1 -- 172.21.15.49:0/3735048467 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc54003530 con 0x7fcc74159790 2024-01-31T05:05:50.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc78c00640 1 -- 172.21.15.49:0/3735048467 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2556325403 0 0) 0x7fcc54003530 con 0x7fcc74159790 2024-01-31T05:05:50.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc78c00640 1 -- 172.21.15.49:0/3735048467 >> v2:172.21.15.195:3300/0 conn(0x7fcc74070660 msgr2=0x7fcc74070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:50.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc78c00640 1 --2- 172.21.15.49:0/3735048467 >> v2:172.21.15.195:3300/0 conn(0x7fcc74070660 0x7fcc74070ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:50.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc78c00640 1 -- 172.21.15.49:0/3735048467 >> v1:172.21.15.195:6789/0 conn(0x7fcc740ac050 legacy=0x7fcc740ac4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:50.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc78c00640 1 -- 172.21.15.49:0/3735048467 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc740b2a30 con 0x7fcc74159790 2024-01-31T05:05:50.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc78c00640 1 -- 172.21.15.49:0/3735048467 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7fcc64001680 con 0x7fcc74159790 2024-01-31T05:05:50.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc78c00640 1 -- 172.21.15.49:0/3735048467 >> v1:172.21.15.49:6789/0 conn(0x7fcc74159790 legacy=0x7fcc740b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc78c00640 1 --2- 172.21.15.49:0/3735048467 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc54003980 0x7fcc54003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc78c00640 1 --2- 172.21.15.49:0/3735048467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc540047d0 0x7fcc54004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc78c00640 1 --2- 172.21.15.49:0/3735048467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc54005190 0x7fcc5400caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc78c00640 1 -- 172.21.15.49:0/3735048467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc740b2750 con 0x7fcc54005190 2024-01-31T05:05:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc78c00640 1 -- 172.21.15.49:0/3735048467 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5400d140 con 0x7fcc540047d0 2024-01-31T05:05:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc78c00640 1 -- 172.21.15.49:0/3735048467 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5400d300 con 0x7fcc54003980 2024-01-31T05:05:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc7a000640 1 --2- 172.21.15.49:0/3735048467 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc54003980 0x7fcc54003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc79600640 1 --2- 172.21.15.49:0/3735048467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc540047d0 0x7fcc54004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc7aa00640 1 --2- 172.21.15.49:0/3735048467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc54005190 0x7fcc5400caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc7a000640 1 -- 172.21.15.49:0/3735048467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc540047d0 msgr2=0x7fcc54004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc7a000640 1 --2- 172.21.15.49:0/3735048467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc540047d0 0x7fcc54004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc7a000640 1 -- 172.21.15.49:0/3735048467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc54005190 msgr2=0x7fcc5400caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc7a000640 1 --2- 172.21.15.49:0/3735048467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc54005190 0x7fcc5400caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc7a000640 1 -- 172.21.15.49:0/3735048467 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc54003530 con 0x7fcc54003980 2024-01-31T05:05:50.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.696+0000 7fcc7aa00640 1 -- 172.21.15.49:0/3735048467 reap_dead start 2024-01-31T05:05:50.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.700+0000 7fcc7a000640 1 --2- 172.21.15.49:0/3735048467 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc54003980 0x7fcc54003da0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400c240 tx=0x7fcc6401ccd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=914aa2e530f0a5c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:50.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.700+0000 7fcc78c00640 1 -- 172.21.15.49:0/3735048467 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc64005ae0 con 0x7fcc54003980 2024-01-31T05:05:50.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.700+0000 7fcc78c00640 1 -- 172.21.15.49:0/3735048467 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc64005c40 con 0x7fcc54003980 2024-01-31T05:05:50.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.700+0000 7fcc78c00640 1 -- 172.21.15.49:0/3735048467 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc640a6a50 con 0x7fcc54003980 2024-01-31T05:05:50.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.700+0000 7fcc7ca00640 1 -- 172.21.15.49:0/3735048467 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc54003980 msgr2=0x7fcc54003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:50.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.700+0000 7fcc7ca00640 1 --2- 172.21.15.49:0/3735048467 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc54003980 0x7fcc54003da0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400c240 tx=0x7fcc6401ccd0 comp rx=0 tx=0).stop 2024-01-31T05:05:50.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.700+0000 7fcc7ca00640 1 -- 172.21.15.49:0/3735048467 shutdown_connections 2024-01-31T05:05:50.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.700+0000 7fcc7ca00640 1 --2- 172.21.15.49:0/3735048467 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc54003980 0x7fcc54003da0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:50.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.700+0000 7fcc7ca00640 1 -- 172.21.15.49:0/3735048467 >> 172.21.15.49:0/3735048467 conn(0x7fcc740b09a0 msgr2=0x7fcc740b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:50.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.700+0000 7fcc7ca00640 1 -- 172.21.15.49:0/3735048467 shutdown_connections 2024-01-31T05:05:50.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.700+0000 7fcc7ca00640 1 -- 172.21.15.49:0/3735048467 wait complete. 2024-01-31T05:05:50.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc7ca00640 1 Processor -- start 2024-01-31T05:05:50.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc7ca00640 1 -- start start 2024-01-31T05:05:50.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc7ca00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc54003980 0x7fcc741f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:50.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc7ca00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc7409b8c0 0x7fcc74099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:50.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc7ca00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc74099f90 0x7fcc7415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:50.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc7ca00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7409a410 con 0x7fcc54003980 2024-01-31T05:05:50.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc7ca00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc74139bd0 con 0x7fcc7409b8c0 2024-01-31T05:05:50.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc7ca00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc741f6fa0 con 0x7fcc74099f90 2024-01-31T05:05:50.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc7a000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc54003980 0x7fcc741f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:50.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc7a000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc54003980 0x7fcc741f6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33518/0 (socket says 172.21.15.49:33518) 2024-01-31T05:05:50.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc7a000640 1 -- 172.21.15.49:0/2947720102 learned_addr learned my addr 172.21.15.49:0/2947720102 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:50.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc7aa00640 1 --2- 172.21.15.49:0/2947720102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc74099f90 0x7fcc7415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:50.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc79600640 1 --2- 172.21.15.49:0/2947720102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc7409b8c0 0x7fcc74099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:50.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc7a000640 1 -- 172.21.15.49:0/2947720102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc74099f90 msgr2=0x7fcc7415c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:50.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc7a000640 1 --2- 172.21.15.49:0/2947720102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc74099f90 0x7fcc7415c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:50.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc7a000640 1 -- 172.21.15.49:0/2947720102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc7409b8c0 msgr2=0x7fcc74099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:50.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc7a000640 1 --2- 172.21.15.49:0/2947720102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc7409b8c0 0x7fcc74099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:50.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc7a000640 1 -- 172.21.15.49:0/2947720102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc74139050 con 0x7fcc54003980 2024-01-31T05:05:50.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc7a000640 1 --2- 172.21.15.49:0/2947720102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc54003980 0x7fcc741f6a60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcc6401c740 tx=0x7fcc54005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:50.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc72000640 1 -- 172.21.15.49:0/2947720102 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc640b5070 con 0x7fcc54003980 2024-01-31T05:05:50.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc72000640 1 -- 172.21.15.49:0/2947720102 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc64001650 con 0x7fcc54003980 2024-01-31T05:05:50.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc72000640 1 -- 172.21.15.49:0/2947720102 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc640a6a30 con 0x7fcc54003980 2024-01-31T05:05:50.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.704+0000 7fcc7ca00640 1 -- 172.21.15.49:0/2947720102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc74139330 con 0x7fcc54003980 2024-01-31T05:05:50.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.708+0000 7fcc7ca00640 1 -- 172.21.15.49:0/2947720102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc741398f0 con 0x7fcc54003980 2024-01-31T05:05:50.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.708+0000 7fcc7ca00640 1 -- 172.21.15.49:0/2947720102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc741f2a60 con 0x7fcc54003980 2024-01-31T05:05:50.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.708+0000 7fcc72000640 1 -- 172.21.15.49:0/2947720102 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fcc640a6b90 con 0x7fcc54003980 2024-01-31T05:05:50.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.708+0000 7fcc72000640 1 --2- 172.21.15.49:0/2947720102 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcc4c066530 0x7fcc4c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:50.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.708+0000 7fcc72000640 1 -- 172.21.15.49:0/2947720102 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5547+0+0 (secure 0 0 0) 0x7fcc6411ec50 con 0x7fcc54003980 2024-01-31T05:05:50.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.712+0000 7fcc79600640 1 --2- 172.21.15.49:0/2947720102 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcc4c066530 0x7fcc4c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:50.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.712+0000 7fcc79600640 1 --2- 172.21.15.49:0/2947720102 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcc4c066530 0x7fcc4c0689f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcc7414e6a0 tx=0x7fcc5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:50.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.712+0000 7fcc72000640 1 -- 172.21.15.49:0/2947720102 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fcc640ebf70 con 0x7fcc54003980 2024-01-31T05:05:50.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:50.876+0000 7fcc7ca00640 1 -- 172.21.15.49:0/2947720102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fcc74074860 con 0x7fcc54003980 2024-01-31T05:05:51.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.516+0000 7fcc72000640 1 -- 172.21.15.49:0/2947720102 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7fcc640ef590 con 0x7fcc54003980 2024-01-31T05:05:51.518 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-01-31T05:05:51.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.520+0000 7fcc7ca00640 1 -- 172.21.15.49:0/2947720102 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcc4c066530 msgr2=0x7fcc4c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:51.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.520+0000 7fcc7ca00640 1 --2- 172.21.15.49:0/2947720102 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcc4c066530 0x7fcc4c0689f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcc7414e6a0 tx=0x7fcc5c008040 comp rx=0 tx=0).stop 2024-01-31T05:05:51.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.520+0000 7fcc7ca00640 1 -- 172.21.15.49:0/2947720102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc54003980 msgr2=0x7fcc741f6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:51.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.520+0000 7fcc7ca00640 1 --2- 172.21.15.49:0/2947720102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc54003980 0x7fcc741f6a60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcc6401c740 tx=0x7fcc54005800 comp rx=0 tx=0).stop 2024-01-31T05:05:51.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.520+0000 7fcc7ca00640 1 -- 172.21.15.49:0/2947720102 shutdown_connections 2024-01-31T05:05:51.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.520+0000 7fcc7ca00640 1 --2- 172.21.15.49:0/2947720102 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc74099f90 0x7fcc7415c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:51.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.520+0000 7fcc7ca00640 1 --2- 172.21.15.49:0/2947720102 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcc4c066530 0x7fcc4c0689f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:51.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.520+0000 7fcc7ca00640 1 --2- 172.21.15.49:0/2947720102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc7409b8c0 0x7fcc74099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:51.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.520+0000 7fcc7ca00640 1 --2- 172.21.15.49:0/2947720102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc54003980 0x7fcc741f6a60 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:51.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.520+0000 7fcc7ca00640 1 -- 172.21.15.49:0/2947720102 >> 172.21.15.49:0/2947720102 conn(0x7fcc740b09a0 msgr2=0x7fcc74157560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:51.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.520+0000 7fcc7ca00640 1 -- 172.21.15.49:0/2947720102 shutdown_connections 2024-01-31T05:05:51.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.524+0000 7fcc7ca00640 1 -- 172.21.15.49:0/2947720102 wait complete. 2024-01-31T05:05:51.560 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-31T05:05:51.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.704+0000 7f78aa600640 1 Processor -- start 2024-01-31T05:05:51.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.704+0000 7f78aa600640 1 -- start start 2024-01-31T05:05:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.704+0000 7f78aa600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78a415d540 0x7f78a40cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.704+0000 7f78aa600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f78a40cbbc0 0x7f78a415d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:51.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.704+0000 7f78aa600640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a40cef80 con 0x7f78a406c290 2024-01-31T05:05:51.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.704+0000 7f78aa600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a406cae0 con 0x7f78a40cbbc0 2024-01-31T05:05:51.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.704+0000 7f78aa600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a40cf1b0 con 0x7f78a415d540 2024-01-31T05:05:51.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.704+0000 7f78a2a00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f78a406c290 0x7f78a40cb4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49762/0 (socket says 172.21.15.49:49762) 2024-01-31T05:05:51.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.704+0000 7f78a2a00640 1 -- 172.21.15.49:0/1432803606 learned_addr learned my addr 172.21.15.49:0/1432803606 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:51.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.704+0000 7f78a3e00640 1 --2- 172.21.15.49:0/1432803606 >> v2:172.21.15.195:3300/0 conn(0x7f78a40cbbc0 0x7f78a415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:51.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.704+0000 7f78a3400640 1 --2- 172.21.15.49:0/1432803606 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78a415d540 0x7f78a40cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:51.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.704+0000 7f78a2000640 1 -- 172.21.15.49:0/1432803606 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372364965 0 0) 0x7f78a40cef80 con 0x7f78a406c290 2024-01-31T05:05:51.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.704+0000 7f78a2000640 1 -- 172.21.15.49:0/1432803606 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7884003530 con 0x7f78a406c290 2024-01-31T05:05:51.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.704+0000 7f78a3400640 1 -- 172.21.15.49:0/1432803606 >> v2:172.21.15.195:3300/0 conn(0x7f78a40cbbc0 msgr2=0x7f78a415d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:51.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.704+0000 7f78a3400640 1 --2- 172.21.15.49:0/1432803606 >> v2:172.21.15.195:3300/0 conn(0x7f78a40cbbc0 0x7f78a415d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:51.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.704+0000 7f78a3400640 1 -- 172.21.15.49:0/1432803606 >> v1:172.21.15.49:6789/0 conn(0x7f78a406c290 legacy=0x7f78a40cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:51.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.704+0000 7f78a3400640 1 -- 172.21.15.49:0/1432803606 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a40cf490 con 0x7f78a415d540 2024-01-31T05:05:51.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.704+0000 7f78a3e00640 1 --2- 172.21.15.49:0/1432803606 >> v2:172.21.15.195:3300/0 conn(0x7f78a40cbbc0 0x7f78a415d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.708+0000 7f78a3400640 1 --2- 172.21.15.49:0/1432803606 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78a415d540 0x7f78a40cff70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f78940097c0 tx=0x7f789401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d73aaa8d3c481c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.708+0000 7f78a2000640 1 -- 172.21.15.49:0/1432803606 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78940ab650 con 0x7f78a415d540 2024-01-31T05:05:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.708+0000 7f78a2000640 1 -- 172.21.15.49:0/1432803606 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78940ab7b0 con 0x7f78a415d540 2024-01-31T05:05:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.708+0000 7f78a2000640 1 -- 172.21.15.49:0/1432803606 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78940abb20 con 0x7f78a415d540 2024-01-31T05:05:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78aa600640 1 -- 172.21.15.49:0/1432803606 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78a415d540 msgr2=0x7f78a40cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78aa600640 1 --2- 172.21.15.49:0/1432803606 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78a415d540 0x7f78a40cff70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f78940097c0 tx=0x7f789401c450 comp rx=0 tx=0).stop 2024-01-31T05:05:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78aa600640 1 -- 172.21.15.49:0/1432803606 shutdown_connections 2024-01-31T05:05:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78aa600640 1 --2- 172.21.15.49:0/1432803606 >> v2:172.21.15.195:3300/0 conn(0x7f78a40cbbc0 0x7f78a415d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78aa600640 1 --2- 172.21.15.49:0/1432803606 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78a415d540 0x7f78a40cff70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78aa600640 1 -- 172.21.15.49:0/1432803606 >> 172.21.15.49:0/1432803606 conn(0x7f78a40d0e60 msgr2=0x7f78a40d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78aa600640 1 -- 172.21.15.49:0/1432803606 shutdown_connections 2024-01-31T05:05:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78aa600640 1 -- 172.21.15.49:0/1432803606 wait complete. 2024-01-31T05:05:51.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78aa600640 1 Processor -- start 2024-01-31T05:05:51.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78aa600640 1 -- start start 2024-01-31T05:05:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78aa600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78a406c290 0x7f78a4149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78aa600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a40cbbc0 0x7f78a40b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78aa600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78a415d540 0x7f78a41530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78aa600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a41524c0 con 0x7f78a40cbbc0 2024-01-31T05:05:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78aa600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a41526a0 con 0x7f78a406c290 2024-01-31T05:05:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78aa600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a41560f0 con 0x7f78a415d540 2024-01-31T05:05:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78a2a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a40cbbc0 0x7f78a40b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78a2a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a40cbbc0 0x7f78a40b39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33534/0 (socket says 172.21.15.49:33534) 2024-01-31T05:05:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78a2a00640 1 -- 172.21.15.49:0/3287725000 learned_addr learned my addr 172.21.15.49:0/3287725000 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78a3400640 1 --2- 172.21.15.49:0/3287725000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78a406c290 0x7f78a4149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.712+0000 7f78a3e00640 1 --2- 172.21.15.49:0/3287725000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78a415d540 0x7f78a41530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.716+0000 7f78a2a00640 1 -- 172.21.15.49:0/3287725000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78a415d540 msgr2=0x7f78a41530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.716+0000 7f78a2a00640 1 --2- 172.21.15.49:0/3287725000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78a415d540 0x7f78a41530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.716+0000 7f78a2a00640 1 -- 172.21.15.49:0/3287725000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78a406c290 msgr2=0x7f78a4149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.716+0000 7f78a2a00640 1 --2- 172.21.15.49:0/3287725000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78a406c290 0x7f78a4149830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.716+0000 7f78a2a00640 1 -- 172.21.15.49:0/3287725000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c009a70 con 0x7f78a40cbbc0 2024-01-31T05:05:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.716+0000 7f78a3400640 1 --2- 172.21.15.49:0/3287725000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78a406c290 0x7f78a4149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.716+0000 7f78a2a00640 1 --2- 172.21.15.49:0/3287725000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a40cbbc0 0x7f78a40b39d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f788c00c480 tx=0x7f788c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.716+0000 7f789b400640 1 -- 172.21.15.49:0/3287725000 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c005cf0 con 0x7f78a40cbbc0 2024-01-31T05:05:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.716+0000 7f789b400640 1 -- 172.21.15.49:0/3287725000 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c005e50 con 0x7f78a40cbbc0 2024-01-31T05:05:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.716+0000 7f78aa600640 1 -- 172.21.15.49:0/3287725000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7894009420 con 0x7f78a40cbbc0 2024-01-31T05:05:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.716+0000 7f789b400640 1 -- 172.21.15.49:0/3287725000 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c007290 con 0x7f78a40cbbc0 2024-01-31T05:05:51.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.716+0000 7f78aa600640 1 -- 172.21.15.49:0/3287725000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a4152c20 con 0x7f78a40cbbc0 2024-01-31T05:05:51.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.716+0000 7f78aa600640 1 -- 172.21.15.49:0/3287725000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a40ce880 con 0x7f78a40cbbc0 2024-01-31T05:05:51.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.720+0000 7f789b400640 1 -- 172.21.15.49:0/3287725000 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f788c0073f0 con 0x7f78a40cbbc0 2024-01-31T05:05:51.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.720+0000 7f789b400640 1 --2- 172.21.15.49:0/3287725000 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f787c066500 0x7f787c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:51.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.720+0000 7f789b400640 1 -- 172.21.15.49:0/3287725000 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f788c0839a0 con 0x7f78a40cbbc0 2024-01-31T05:05:51.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.720+0000 7f78a3400640 1 --2- 172.21.15.49:0/3287725000 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f787c066500 0x7f787c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:51.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.720+0000 7f78a3400640 1 --2- 172.21.15.49:0/3287725000 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f787c066500 0x7f787c0689c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f78940af000 tx=0x7f78940a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:51.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.724+0000 7f789b400640 1 -- 172.21.15.49:0/3287725000 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f788c050bd0 con 0x7f78a40cbbc0 2024-01-31T05:05:51.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:51.916+0000 7f78aa600640 1 -- 172.21.15.49:0/3287725000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f78a4152db0 con 0x7f78a40cbbc0 2024-01-31T05:05:52.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.524+0000 7f789b400640 1 -- 172.21.15.49:0/3287725000 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v15) v1 ==== 172+0+0 (secure 0 0 0) 0x7f788c0541f0 con 0x7f78a40cbbc0 2024-01-31T05:05:52.526 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 5 and data pool 6 2024-01-31T05:05:52.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.528+0000 7f78aa600640 1 -- 172.21.15.49:0/3287725000 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f787c066500 msgr2=0x7f787c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:52.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.528+0000 7f78aa600640 1 --2- 172.21.15.49:0/3287725000 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f787c066500 0x7f787c0689c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f78940af000 tx=0x7f78940a7000 comp rx=0 tx=0).stop 2024-01-31T05:05:52.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.528+0000 7f78aa600640 1 -- 172.21.15.49:0/3287725000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a40cbbc0 msgr2=0x7f78a40b39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:52.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.528+0000 7f78aa600640 1 --2- 172.21.15.49:0/3287725000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a40cbbc0 0x7f78a40b39d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f788c00c480 tx=0x7f788c00c940 comp rx=0 tx=0).stop 2024-01-31T05:05:52.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.532+0000 7f78aa600640 1 -- 172.21.15.49:0/3287725000 shutdown_connections 2024-01-31T05:05:52.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.532+0000 7f78aa600640 1 --2- 172.21.15.49:0/3287725000 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78a415d540 0x7f78a41530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:52.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.532+0000 7f78aa600640 1 --2- 172.21.15.49:0/3287725000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a40cbbc0 0x7f78a40b39d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:52.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.532+0000 7f78aa600640 1 --2- 172.21.15.49:0/3287725000 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f787c066500 0x7f787c0689c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:52.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.532+0000 7f78aa600640 1 --2- 172.21.15.49:0/3287725000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78a406c290 0x7f78a4149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:52.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.532+0000 7f78aa600640 1 -- 172.21.15.49:0/3287725000 >> 172.21.15.49:0/3287725000 conn(0x7f78a40d0e60 msgr2=0x7f78a406ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:52.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.532+0000 7f78aa600640 1 -- 172.21.15.49:0/3287725000 shutdown_connections 2024-01-31T05:05:52.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.536+0000 7f78aa600640 1 -- 172.21.15.49:0/3287725000 wait complete. 2024-01-31T05:05:52.585 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:52.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.724+0000 7fbf3fe00640 1 Processor -- start 2024-01-31T05:05:52.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.724+0000 7fbf3fe00640 1 -- start start 2024-01-31T05:05:52.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.728+0000 7fbf3fe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf3815d3a0 0x7fbf3806e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:52.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.728+0000 7fbf3fe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbf3806ee50 0x7fbf3806f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:52.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.728+0000 7fbf3fe00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf380cb990 con 0x7fbf380cd6d0 2024-01-31T05:05:52.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.728+0000 7fbf3fe00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf380d1c20 con 0x7fbf3806ee50 2024-01-31T05:05:52.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.728+0000 7fbf3fe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf380cfed0 con 0x7fbf3815d3a0 2024-01-31T05:05:52.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.728+0000 7fbf3ca00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fbf3806ee50 0x7fbf3806f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:52.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.728+0000 7fbf3de00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fbf380cd6d0 0x7fbf380cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49764/0 (socket says 172.21.15.49:49764) 2024-01-31T05:05:52.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.728+0000 7fbf3de00640 1 -- 172.21.15.49:0/3281944091 learned_addr learned my addr 172.21.15.49:0/3281944091 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:52.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.728+0000 7fbf3d400640 1 --2- 172.21.15.49:0/3281944091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf3815d3a0 0x7fbf3806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:52.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.728+0000 7fbf3ca00640 1 -- 172.21.15.49:0/3281944091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf3815d3a0 msgr2=0x7fbf3806e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:52.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.728+0000 7fbf3ca00640 1 --2- 172.21.15.49:0/3281944091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf3815d3a0 0x7fbf3806e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:52.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.728+0000 7fbf3ca00640 1 -- 172.21.15.49:0/3281944091 >> v1:172.21.15.49:6789/0 conn(0x7fbf380cd6d0 legacy=0x7fbf380cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:52.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.728+0000 7fbf3ca00640 1 -- 172.21.15.49:0/3281944091 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf380d01b0 con 0x7fbf3806ee50 2024-01-31T05:05:52.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.732+0000 7fbf3ca00640 1 --2- 172.21.15.49:0/3281944091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf3806ee50 0x7fbf3806f2b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbf200097c0 tx=0x7fbf2001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5e69b4b765b251 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:52.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.732+0000 7fbf37e00640 1 -- 172.21.15.49:0/3281944091 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf200ad640 con 0x7fbf3806ee50 2024-01-31T05:05:52.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.732+0000 7fbf37e00640 1 -- 172.21.15.49:0/3281944091 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf200ad7a0 con 0x7fbf3806ee50 2024-01-31T05:05:52.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.732+0000 7fbf37e00640 1 -- 172.21.15.49:0/3281944091 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf200adb30 con 0x7fbf3806ee50 2024-01-31T05:05:52.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.732+0000 7fbf3fe00640 1 -- 172.21.15.49:0/3281944091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf3806ee50 msgr2=0x7fbf3806f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:52.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.732+0000 7fbf3fe00640 1 --2- 172.21.15.49:0/3281944091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf3806ee50 0x7fbf3806f2b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbf200097c0 tx=0x7fbf2001c480 comp rx=0 tx=0).stop 2024-01-31T05:05:52.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.732+0000 7fbf3fe00640 1 -- 172.21.15.49:0/3281944091 shutdown_connections 2024-01-31T05:05:52.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.732+0000 7fbf3fe00640 1 --2- 172.21.15.49:0/3281944091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf3806ee50 0x7fbf3806f2b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:52.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.732+0000 7fbf3fe00640 1 --2- 172.21.15.49:0/3281944091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf3815d3a0 0x7fbf3806e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:52.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.732+0000 7fbf3fe00640 1 -- 172.21.15.49:0/3281944091 >> 172.21.15.49:0/3281944091 conn(0x7fbf380d0e50 msgr2=0x7fbf380d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:52.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.732+0000 7fbf3fe00640 1 -- 172.21.15.49:0/3281944091 shutdown_connections 2024-01-31T05:05:52.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.732+0000 7fbf3fe00640 1 -- 172.21.15.49:0/3281944091 wait complete. 2024-01-31T05:05:52.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.732+0000 7fbf3fe00640 1 Processor -- start 2024-01-31T05:05:52.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.732+0000 7fbf3fe00640 1 -- start start 2024-01-31T05:05:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3fe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf3806ee50 0x7fbf3814a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3fe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf380cd6d0 0x7fbf3814add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3fe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf3815d3a0 0x7fbf380b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3fe00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3814b800 con 0x7fbf3815d3a0 2024-01-31T05:05:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3fe00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3814bae0 con 0x7fbf3806ee50 2024-01-31T05:05:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3fe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3814bdc0 con 0x7fbf380cd6d0 2024-01-31T05:05:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3de00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf3815d3a0 0x7fbf380b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3de00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf3815d3a0 0x7fbf380b08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33544/0 (socket says 172.21.15.49:33544) 2024-01-31T05:05:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3de00640 1 -- 172.21.15.49:0/2371694470 learned_addr learned my addr 172.21.15.49:0/2371694470 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3d400640 1 --2- 172.21.15.49:0/2371694470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf3806ee50 0x7fbf3814a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3ca00640 1 --2- 172.21.15.49:0/2371694470 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf380cd6d0 0x7fbf3814add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3de00640 1 -- 172.21.15.49:0/2371694470 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf380cd6d0 msgr2=0x7fbf3814add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3de00640 1 --2- 172.21.15.49:0/2371694470 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf380cd6d0 0x7fbf3814add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3de00640 1 -- 172.21.15.49:0/2371694470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf3806ee50 msgr2=0x7fbf3814a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3de00640 1 --2- 172.21.15.49:0/2371694470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf3806ee50 0x7fbf3814a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:52.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3de00640 1 -- 172.21.15.49:0/2371694470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf20009420 con 0x7fbf3815d3a0 2024-01-31T05:05:52.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3de00640 1 --2- 172.21.15.49:0/2371694470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf3815d3a0 0x7fbf380b08b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000cbc0 tx=0x7fbf3000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:52.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf35600640 1 -- 172.21.15.49:0/2371694470 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3000ad40 con 0x7fbf3815d3a0 2024-01-31T05:05:52.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf35600640 1 -- 172.21.15.49:0/2371694470 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf30012400 con 0x7fbf3815d3a0 2024-01-31T05:05:52.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf35600640 1 -- 172.21.15.49:0/2371694470 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3000aea0 con 0x7fbf3815d3a0 2024-01-31T05:05:52.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3fe00640 1 -- 172.21.15.49:0/2371694470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf3814c0a0 con 0x7fbf3815d3a0 2024-01-31T05:05:52.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3fe00640 1 -- 172.21.15.49:0/2371694470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf3814ab20 con 0x7fbf3815d3a0 2024-01-31T05:05:52.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.736+0000 7fbf3fe00640 1 -- 172.21.15.49:0/2371694470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf3806fdb0 con 0x7fbf3815d3a0 2024-01-31T05:05:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.740+0000 7fbf35600640 1 -- 172.21.15.49:0/2371694470 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fbf30007070 con 0x7fbf3815d3a0 2024-01-31T05:05:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.740+0000 7fbf35600640 1 --2- 172.21.15.49:0/2371694470 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbf10066500 0x7fbf100689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.740+0000 7fbf35600640 1 -- 172.21.15.49:0/2371694470 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbf30083ec0 con 0x7fbf3815d3a0 2024-01-31T05:05:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.740+0000 7fbf3d400640 1 --2- 172.21.15.49:0/2371694470 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbf10066500 0x7fbf100689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:52.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.740+0000 7fbf3d400640 1 --2- 172.21.15.49:0/2371694470 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbf10066500 0x7fbf100689c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbf280079c0 tx=0x7fbf28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.744+0000 7fbf35600640 1 -- 172.21.15.49:0/2371694470 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fbf300510c0 con 0x7fbf3815d3a0 2024-01-31T05:05:52.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.904+0000 7fbf3fe00640 1 -- 172.21.15.49:0/2371694470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf380ae470 con 0x7fbf3815d3a0 2024-01-31T05:05:52.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.904+0000 7fbf35600640 1 -- 172.21.15.49:0/2371694470 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16764 (secure 0 0 0) 0x7fbf380ae470 con 0x7fbf3815d3a0 2024-01-31T05:05:52.907 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:52.907 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":38,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:05:51.919381+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:05:49.820131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-31T05:05:50.922571+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:52.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.904+0000 7fbf3fe00640 1 -- 172.21.15.49:0/2371694470 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbf10066500 msgr2=0x7fbf100689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:52.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.904+0000 7fbf3fe00640 1 --2- 172.21.15.49:0/2371694470 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbf10066500 0x7fbf100689c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbf280079c0 tx=0x7fbf28008040 comp rx=0 tx=0).stop 2024-01-31T05:05:52.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.904+0000 7fbf3fe00640 1 -- 172.21.15.49:0/2371694470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf3815d3a0 msgr2=0x7fbf380b08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:52.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.904+0000 7fbf3fe00640 1 --2- 172.21.15.49:0/2371694470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf3815d3a0 0x7fbf380b08b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000cbc0 tx=0x7fbf3000a430 comp rx=0 tx=0).stop 2024-01-31T05:05:52.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.904+0000 7fbf3fe00640 1 -- 172.21.15.49:0/2371694470 shutdown_connections 2024-01-31T05:05:52.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.904+0000 7fbf3fe00640 1 --2- 172.21.15.49:0/2371694470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf3815d3a0 0x7fbf380b08b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:52.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.904+0000 7fbf3fe00640 1 --2- 172.21.15.49:0/2371694470 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf380cd6d0 0x7fbf3814add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:52.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.904+0000 7fbf3fe00640 1 --2- 172.21.15.49:0/2371694470 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbf10066500 0x7fbf100689c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:52.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.904+0000 7fbf3fe00640 1 --2- 172.21.15.49:0/2371694470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf3806ee50 0x7fbf3814a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:52.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.904+0000 7fbf3fe00640 1 -- 172.21.15.49:0/2371694470 >> 172.21.15.49:0/2371694470 conn(0x7fbf380d0e50 msgr2=0x7fbf3806cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:52.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.904+0000 7fbf3fe00640 1 -- 172.21.15.49:0/2371694470 shutdown_connections 2024-01-31T05:05:52.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:52.904+0000 7fbf3fe00640 1 -- 172.21.15.49:0/2371694470 wait complete. 2024-01-31T05:05:52.928 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:53.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.068+0000 7f002ca00640 1 Processor -- start 2024-01-31T05:05:53.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.068+0000 7f002ca00640 1 -- start start 2024-01-31T05:05:53.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.068+0000 7f002ca00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f00240cdf10 0x7f0024070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:53.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.068+0000 7f002ca00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f00240ce610 0x7f0024071310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:53.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.068+0000 7f002ca00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f002415b4f0 con 0x7f002415b110 2024-01-31T05:05:53.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.068+0000 7f002ca00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00240ce460 con 0x7f00240cdf10 2024-01-31T05:05:53.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.068+0000 7f002ca00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0024071850 con 0x7f00240ce610 2024-01-31T05:05:53.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.068+0000 7f0029600640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f00240cdf10 0x7f0024070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:53.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.068+0000 7f0029600640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f00240cdf10 0x7f0024070dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33554/0 (socket says 172.21.15.49:33554) 2024-01-31T05:05:53.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.068+0000 7f0029600640 1 -- 172.21.15.49:0/154589425 learned_addr learned my addr 172.21.15.49:0/154589425 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:53.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.068+0000 7f002aa00640 1 --2- 172.21.15.49:0/154589425 >> v2:172.21.15.195:3300/0 conn(0x7f00240ce610 0x7f0024071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:53.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.068+0000 7f0029600640 1 -- 172.21.15.49:0/154589425 >> v2:172.21.15.195:3300/0 conn(0x7f00240ce610 msgr2=0x7f0024071310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:53.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.068+0000 7f0029600640 1 --2- 172.21.15.49:0/154589425 >> v2:172.21.15.195:3300/0 conn(0x7f00240ce610 0x7f0024071310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:53.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.068+0000 7f0029600640 1 -- 172.21.15.49:0/154589425 >> v1:172.21.15.195:6789/0 conn(0x7f002415b110 legacy=0x7f002406c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:53.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.068+0000 7f0029600640 1 -- 172.21.15.49:0/154589425 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00240abf20 con 0x7f00240cdf10 2024-01-31T05:05:53.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.072+0000 7f0029600640 1 --2- 172.21.15.49:0/154589425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00240cdf10 0x7f0024070dd0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0024072f80 tx=0x7f000c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385df78e60d837cf server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:53.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.072+0000 7f0028c00640 1 -- 172.21.15.49:0/154589425 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c0aa650 con 0x7f00240cdf10 2024-01-31T05:05:53.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.072+0000 7f0028c00640 1 -- 172.21.15.49:0/154589425 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000c0aa7b0 con 0x7f00240cdf10 2024-01-31T05:05:53.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.072+0000 7f0028c00640 1 -- 172.21.15.49:0/154589425 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c0aab40 con 0x7f00240cdf10 2024-01-31T05:05:53.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.072+0000 7f002ca00640 1 -- 172.21.15.49:0/154589425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00240cdf10 msgr2=0x7f0024070dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:53.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.072+0000 7f002ca00640 1 --2- 172.21.15.49:0/154589425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00240cdf10 0x7f0024070dd0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0024072f80 tx=0x7f000c01c4d0 comp rx=0 tx=0).stop 2024-01-31T05:05:53.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.072+0000 7f002ca00640 1 -- 172.21.15.49:0/154589425 shutdown_connections 2024-01-31T05:05:53.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.072+0000 7f002ca00640 1 --2- 172.21.15.49:0/154589425 >> v2:172.21.15.195:3300/0 conn(0x7f00240ce610 0x7f0024071310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:53.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.072+0000 7f002ca00640 1 --2- 172.21.15.49:0/154589425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00240cdf10 0x7f0024070dd0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:53.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.072+0000 7f002ca00640 1 -- 172.21.15.49:0/154589425 >> 172.21.15.49:0/154589425 conn(0x7f00240b09a0 msgr2=0x7f00240b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:53.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.072+0000 7f002ca00640 1 -- 172.21.15.49:0/154589425 shutdown_connections 2024-01-31T05:05:53.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.072+0000 7f002ca00640 1 -- 172.21.15.49:0/154589425 wait complete. 2024-01-31T05:05:53.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002ca00640 1 Processor -- start 2024-01-31T05:05:53.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002ca00640 1 -- start start 2024-01-31T05:05:53.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002ca00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00240cdf10 0x7f002409c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:53.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002ca00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00240ce610 0x7f0024158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:53.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002ca00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f002415b110 0x7f0024156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:53.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002ca00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002409b430 con 0x7f002415b110 2024-01-31T05:05:53.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002ca00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002409b710 con 0x7f00240ce610 2024-01-31T05:05:53.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002ca00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002409b9f0 con 0x7f00240cdf10 2024-01-31T05:05:53.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002aa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f002415b110 0x7f0024156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:53.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002aa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f002415b110 0x7f0024156280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33556/0 (socket says 172.21.15.49:33556) 2024-01-31T05:05:53.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002aa00640 1 -- 172.21.15.49:0/1613700812 learned_addr learned my addr 172.21.15.49:0/1613700812 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:53.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002a000640 1 --2- 172.21.15.49:0/1613700812 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00240cdf10 0x7f002409c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:53.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f0029600640 1 --2- 172.21.15.49:0/1613700812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00240ce610 0x7f0024158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:53.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002aa00640 1 -- 172.21.15.49:0/1613700812 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00240cdf10 msgr2=0x7f002409c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:53.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002aa00640 1 --2- 172.21.15.49:0/1613700812 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00240cdf10 0x7f002409c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:53.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002aa00640 1 -- 172.21.15.49:0/1613700812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00240ce610 msgr2=0x7f0024158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:53.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002aa00640 1 --2- 172.21.15.49:0/1613700812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00240ce610 0x7f0024158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:53.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002aa00640 1 -- 172.21.15.49:0/1613700812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c0094d0 con 0x7f002415b110 2024-01-31T05:05:53.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002aa00640 1 --2- 172.21.15.49:0/1613700812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f002415b110 0x7f0024156280 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f001c00efc0 tx=0x7f001c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:53.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f0022000640 1 -- 172.21.15.49:0/1613700812 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c014480 con 0x7f002415b110 2024-01-31T05:05:53.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f0022000640 1 -- 172.21.15.49:0/1613700812 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001c00f040 con 0x7f002415b110 2024-01-31T05:05:53.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f0022000640 1 -- 172.21.15.49:0/1613700812 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c014820 con 0x7f002415b110 2024-01-31T05:05:53.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002ca00640 1 -- 172.21.15.49:0/1613700812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f002409bcd0 con 0x7f002415b110 2024-01-31T05:05:53.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002ca00640 1 -- 172.21.15.49:0/1613700812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0024158ca0 con 0x7f002415b110 2024-01-31T05:05:53.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.076+0000 7f002ca00640 1 -- 172.21.15.49:0/1613700812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f002406d870 con 0x7f002415b110 2024-01-31T05:05:53.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.080+0000 7f0022000640 1 -- 172.21.15.49:0/1613700812 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f001c014980 con 0x7f002415b110 2024-01-31T05:05:53.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.080+0000 7f0022000640 1 --2- 172.21.15.49:0/1613700812 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7efffc066530 0x7efffc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:53.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.080+0000 7f0022000640 1 -- 172.21.15.49:0/1613700812 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f001c084cd0 con 0x7f002415b110 2024-01-31T05:05:53.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.080+0000 7f002a000640 1 --2- 172.21.15.49:0/1613700812 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7efffc066530 0x7efffc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:53.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.080+0000 7f002a000640 1 --2- 172.21.15.49:0/1613700812 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7efffc066530 0x7efffc0689f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f00140015b0 tx=0x7f0014009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:53.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.084+0000 7f0022000640 1 -- 172.21.15.49:0/1613700812 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f001c051d00 con 0x7f002415b110 2024-01-31T05:05:53.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.240+0000 7f002ca00640 1 -- 172.21.15.49:0/1613700812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0024074860 con 0x7f002415b110 2024-01-31T05:05:53.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.244+0000 7f0022000640 1 -- 172.21.15.49:0/1613700812 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16764 (secure 0 0 0) 0x7f001c018070 con 0x7f002415b110 2024-01-31T05:05:53.245 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:53.245 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":38,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:05:51.919381+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:05:49.820131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-31T05:05:50.922571+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:53.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.244+0000 7f002ca00640 1 -- 172.21.15.49:0/1613700812 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7efffc066530 msgr2=0x7efffc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:53.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.244+0000 7f002ca00640 1 --2- 172.21.15.49:0/1613700812 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7efffc066530 0x7efffc0689f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f00140015b0 tx=0x7f0014009040 comp rx=0 tx=0).stop 2024-01-31T05:05:53.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.244+0000 7f002ca00640 1 -- 172.21.15.49:0/1613700812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f002415b110 msgr2=0x7f0024156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:53.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.244+0000 7f002ca00640 1 --2- 172.21.15.49:0/1613700812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f002415b110 0x7f0024156280 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f001c00efc0 tx=0x7f001c00c490 comp rx=0 tx=0).stop 2024-01-31T05:05:53.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.244+0000 7f002ca00640 1 -- 172.21.15.49:0/1613700812 shutdown_connections 2024-01-31T05:05:53.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.244+0000 7f002ca00640 1 --2- 172.21.15.49:0/1613700812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f002415b110 0x7f0024156280 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:53.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.244+0000 7f002ca00640 1 --2- 172.21.15.49:0/1613700812 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7efffc066530 0x7efffc0689f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:53.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.244+0000 7f002ca00640 1 --2- 172.21.15.49:0/1613700812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00240ce610 0x7f0024158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:53.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.244+0000 7f002ca00640 1 --2- 172.21.15.49:0/1613700812 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f00240cdf10 0x7f002409c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:53.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.244+0000 7f002ca00640 1 -- 172.21.15.49:0/1613700812 >> 172.21.15.49:0/1613700812 conn(0x7f00240b09a0 msgr2=0x7f00240b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:53.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.244+0000 7f002ca00640 1 -- 172.21.15.49:0/1613700812 shutdown_connections 2024-01-31T05:05:53.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.244+0000 7f002ca00640 1 -- 172.21.15.49:0/1613700812 wait complete. 2024-01-31T05:05:53.268 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-31T05:05:53.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.408+0000 7f4dc2400640 1 Processor -- start 2024-01-31T05:05:53.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.412+0000 7f4dc2400640 1 -- start start 2024-01-31T05:05:53.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.412+0000 7f4dc2400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dbc072050 0x7f4dbc06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:53.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.412+0000 7f4dc2400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4dbc06d920 0x7f4dbc160f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:53.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.412+0000 7f4dc2400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dbc06f010 con 0x7f4dbc15d510 2024-01-31T05:05:53.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.412+0000 7f4dc2400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dbc071570 con 0x7f4dbc06d920 2024-01-31T05:05:53.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.412+0000 7f4dc2400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc071850 con 0x7f4dbc072050 2024-01-31T05:05:53.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.412+0000 7f4dbbe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4dbc06d920 0x7f4dbc160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:53.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.412+0000 7f4dbb400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f4dbc15d510 0x7f4dbc0b4b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49776/0 (socket says 172.21.15.49:49776) 2024-01-31T05:05:53.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.412+0000 7f4dbb400640 1 -- 172.21.15.49:0/4020825700 learned_addr learned my addr 172.21.15.49:0/4020825700 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:53.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.412+0000 7f4dbaa00640 1 --2- 172.21.15.49:0/4020825700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dbc072050 0x7f4dbc06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:53.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.412+0000 7f4dbbe00640 1 -- 172.21.15.49:0/4020825700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dbc072050 msgr2=0x7f4dbc06d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:53.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.412+0000 7f4dbbe00640 1 --2- 172.21.15.49:0/4020825700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dbc072050 0x7f4dbc06d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:53.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.412+0000 7f4dbbe00640 1 -- 172.21.15.49:0/4020825700 >> v1:172.21.15.49:6789/0 conn(0x7f4dbc15d510 legacy=0x7f4dbc0b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:53.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.412+0000 7f4dbbe00640 1 -- 172.21.15.49:0/4020825700 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc071b30 con 0x7f4dbc06d920 2024-01-31T05:05:53.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.416+0000 7f4dbbe00640 1 --2- 172.21.15.49:0/4020825700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dbc06d920 0x7f4dbc160f10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009d90 tx=0x7f4db401c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5851a73f5031380c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:53.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.416+0000 7f4dba000640 1 -- 172.21.15.49:0/4020825700 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db40a6660 con 0x7f4dbc06d920 2024-01-31T05:05:53.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.416+0000 7f4dba000640 1 -- 172.21.15.49:0/4020825700 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db40a67c0 con 0x7f4dbc06d920 2024-01-31T05:05:53.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.416+0000 7f4dba000640 1 -- 172.21.15.49:0/4020825700 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db40a6b50 con 0x7f4dbc06d920 2024-01-31T05:05:53.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.416+0000 7f4dc2400640 1 -- 172.21.15.49:0/4020825700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dbc06d920 msgr2=0x7f4dbc160f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:53.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.416+0000 7f4dc2400640 1 --2- 172.21.15.49:0/4020825700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dbc06d920 0x7f4dbc160f10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009d90 tx=0x7f4db401c570 comp rx=0 tx=0).stop 2024-01-31T05:05:53.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.416+0000 7f4dc2400640 1 -- 172.21.15.49:0/4020825700 shutdown_connections 2024-01-31T05:05:53.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.416+0000 7f4dc2400640 1 --2- 172.21.15.49:0/4020825700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dbc06d920 0x7f4dbc160f10 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:53.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.416+0000 7f4dc2400640 1 --2- 172.21.15.49:0/4020825700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dbc072050 0x7f4dbc06d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:53.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.416+0000 7f4dc2400640 1 -- 172.21.15.49:0/4020825700 >> 172.21.15.49:0/4020825700 conn(0x7f4dbc0b1ab0 msgr2=0x7f4dbc0b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:53.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.416+0000 7f4dc2400640 1 -- 172.21.15.49:0/4020825700 shutdown_connections 2024-01-31T05:05:53.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.416+0000 7f4dc2400640 1 -- 172.21.15.49:0/4020825700 wait complete. 2024-01-31T05:05:53.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dc2400640 1 Processor -- start 2024-01-31T05:05:53.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dc2400640 1 -- start start 2024-01-31T05:05:53.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dc2400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dbc06d920 0x7f4dbc150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:53.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dc2400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4dbc072050 0x7f4dbc156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:53.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dc2400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dbc15d510 0x7f4dbc0b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:53.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dc2400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc151180 con 0x7f4dbc06d920 2024-01-31T05:05:53.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dc2400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc151460 con 0x7f4dbc072050 2024-01-31T05:05:53.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dc2400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc151740 con 0x7f4dbc15d510 2024-01-31T05:05:53.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dbb400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dbc06d920 0x7f4dbc150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:53.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dbb400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dbc06d920 0x7f4dbc150870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33564/0 (socket says 172.21.15.49:33564) 2024-01-31T05:05:53.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dbb400640 1 -- 172.21.15.49:0/373195187 learned_addr learned my addr 172.21.15.49:0/373195187 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:53.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dbbe00640 1 --2- 172.21.15.49:0/373195187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dbc15d510 0x7f4dbc0b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:53.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dbaa00640 1 --2- 172.21.15.49:0/373195187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4dbc072050 0x7f4dbc156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:53.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dbb400640 1 -- 172.21.15.49:0/373195187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dbc15d510 msgr2=0x7f4dbc0b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:53.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dbb400640 1 --2- 172.21.15.49:0/373195187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dbc15d510 0x7f4dbc0b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:53.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dbb400640 1 -- 172.21.15.49:0/373195187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4dbc072050 msgr2=0x7f4dbc156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:53.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dbb400640 1 --2- 172.21.15.49:0/373195187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4dbc072050 0x7f4dbc156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:53.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dbb400640 1 -- 172.21.15.49:0/373195187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4009a70 con 0x7f4dbc06d920 2024-01-31T05:05:53.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dbb400640 1 --2- 172.21.15.49:0/373195187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dbc06d920 0x7f4dbc150870 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00c370 tx=0x7f4dac00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:53.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4db3400640 1 -- 172.21.15.49:0/373195187 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac005cf0 con 0x7f4dbc06d920 2024-01-31T05:05:53.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4db3400640 1 -- 172.21.15.49:0/373195187 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac005e50 con 0x7f4dbc06d920 2024-01-31T05:05:53.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4db3400640 1 -- 172.21.15.49:0/373195187 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac0072f0 con 0x7f4dbc06d920 2024-01-31T05:05:53.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dc2400640 1 -- 172.21.15.49:0/373195187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc151a20 con 0x7f4dbc06d920 2024-01-31T05:05:53.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dc2400640 1 -- 172.21.15.49:0/373195187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc150db0 con 0x7f4dbc06d920 2024-01-31T05:05:53.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.420+0000 7f4dc2400640 1 -- 172.21.15.49:0/373195187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dbc06c770 con 0x7f4dbc06d920 2024-01-31T05:05:53.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.424+0000 7f4db3400640 1 -- 172.21.15.49:0/373195187 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f4dac007450 con 0x7f4dbc06d920 2024-01-31T05:05:53.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.424+0000 7f4db3400640 1 --2- 172.21.15.49:0/373195187 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4d94066500 0x7f4d940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:53.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.424+0000 7f4db3400640 1 -- 172.21.15.49:0/373195187 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4dac083580 con 0x7f4dbc06d920 2024-01-31T05:05:53.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.424+0000 7f4dbaa00640 1 --2- 172.21.15.49:0/373195187 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4d94066500 0x7f4d940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:53.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.424+0000 7f4dbaa00640 1 --2- 172.21.15.49:0/373195187 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4d94066500 0x7f4d940689c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0b1a00 tx=0x7f4da4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:53.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.428+0000 7f4db3400640 1 -- 172.21.15.49:0/373195187 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f4dac0506d0 con 0x7f4dbc06d920 2024-01-31T05:05:53.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:53.628+0000 7f4dc2400640 1 -- 172.21.15.49:0/373195187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4dbc074860 con 0x7f4dbc06d920 2024-01-31T05:05:54.507 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-31T05:05:54.504+0000 7fab92400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-31T05:05:54.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.544+0000 7f4db3400640 1 -- 172.21.15.49:0/373195187 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4dac053cf0 con 0x7f4dbc06d920 2024-01-31T05:05:54.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.548+0000 7f4dc2400640 1 -- 172.21.15.49:0/373195187 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4d94066500 msgr2=0x7f4d940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:54.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.548+0000 7f4dc2400640 1 --2- 172.21.15.49:0/373195187 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4d94066500 0x7f4d940689c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0b1a00 tx=0x7f4da4008040 comp rx=0 tx=0).stop 2024-01-31T05:05:54.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.548+0000 7f4dc2400640 1 -- 172.21.15.49:0/373195187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dbc06d920 msgr2=0x7f4dbc150870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:54.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.548+0000 7f4dc2400640 1 --2- 172.21.15.49:0/373195187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dbc06d920 0x7f4dbc150870 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00c370 tx=0x7f4dac00c830 comp rx=0 tx=0).stop 2024-01-31T05:05:54.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.548+0000 7f4dc2400640 1 -- 172.21.15.49:0/373195187 shutdown_connections 2024-01-31T05:05:54.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.548+0000 7f4dc2400640 1 --2- 172.21.15.49:0/373195187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4dbc15d510 0x7f4dbc0b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:54.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.548+0000 7f4dc2400640 1 --2- 172.21.15.49:0/373195187 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f4d94066500 0x7f4d940689c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:54.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.548+0000 7f4dc2400640 1 --2- 172.21.15.49:0/373195187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4dbc072050 0x7f4dbc156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:54.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.548+0000 7f4dc2400640 1 --2- 172.21.15.49:0/373195187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4dbc06d920 0x7f4dbc150870 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:54.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.548+0000 7f4dc2400640 1 -- 172.21.15.49:0/373195187 >> 172.21.15.49:0/373195187 conn(0x7f4dbc0b1ab0 msgr2=0x7f4dbc0afb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:54.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.548+0000 7f4dc2400640 1 -- 172.21.15.49:0/373195187 shutdown_connections 2024-01-31T05:05:54.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.548+0000 7f4dc2400640 1 -- 172.21.15.49:0/373195187 wait complete. 2024-01-31T05:05:54.576 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-31T05:05:54.577 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-31T05:05:54.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.724+0000 7f5df5000640 1 Processor -- start 2024-01-31T05:05:54.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.724+0000 7f5df5000640 1 -- start start 2024-01-31T05:05:54.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.724+0000 7f5df5000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5df015b110 0x7f5df006c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:54.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.724+0000 7f5df5000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5df00714e0 0x7f5df00ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:54.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.724+0000 7f5df5000640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df015b4f0 con 0x7f5df00cdf10 2024-01-31T05:05:54.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.724+0000 7f5df5000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df00ce460 con 0x7f5df00714e0 2024-01-31T05:05:54.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.724+0000 7f5df5000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00abf20 con 0x7f5df015b110 2024-01-31T05:05:54.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.724+0000 7f5dee800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5df00714e0 0x7f5df00ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:54.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.724+0000 7f5ded400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f5df00cdf10 0x7f5df0070dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49780/0 (socket says 172.21.15.49:49780) 2024-01-31T05:05:54.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.724+0000 7f5ded400640 1 -- 172.21.15.49:0/1982674104 learned_addr learned my addr 172.21.15.49:0/1982674104 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:54.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.724+0000 7f5dede00640 1 --2- 172.21.15.49:0/1982674104 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5df015b110 0x7f5df006c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:54.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.724+0000 7f5dee800640 1 -- 172.21.15.49:0/1982674104 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5df015b110 msgr2=0x7f5df006c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:54.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.724+0000 7f5dee800640 1 --2- 172.21.15.49:0/1982674104 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5df015b110 0x7f5df006c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:54.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.724+0000 7f5dee800640 1 -- 172.21.15.49:0/1982674104 >> v1:172.21.15.49:6789/0 conn(0x7f5df00cdf10 legacy=0x7f5df0070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:54.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.724+0000 7f5dee800640 1 -- 172.21.15.49:0/1982674104 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df00ac200 con 0x7f5df00714e0 2024-01-31T05:05:54.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.724+0000 7f5deca00640 1 -- 172.21.15.49:0/1982674104 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889100404 0 0) 0x7f5dd8001120 con 0x7f5df00cdf10 2024-01-31T05:05:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.728+0000 7f5dee800640 1 --2- 172.21.15.49:0/1982674104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5df00714e0 0x7f5df00ad800 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009d90 tx=0x7f5de801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6051713b86bc46 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.728+0000 7f5deca00640 1 -- 172.21.15.49:0/1982674104 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de80a5a00 con 0x7f5df00714e0 2024-01-31T05:05:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.728+0000 7f5deca00640 1 -- 172.21.15.49:0/1982674104 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de80a5b60 con 0x7f5df00714e0 2024-01-31T05:05:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.728+0000 7f5deca00640 1 -- 172.21.15.49:0/1982674104 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de80ad440 con 0x7f5df00714e0 2024-01-31T05:05:54.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.728+0000 7f5df5000640 1 -- 172.21.15.49:0/1982674104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5df00714e0 msgr2=0x7f5df00ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:54.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.728+0000 7f5df5000640 1 --2- 172.21.15.49:0/1982674104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5df00714e0 0x7f5df00ad800 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009d90 tx=0x7f5de801c920 comp rx=0 tx=0).stop 2024-01-31T05:05:54.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.728+0000 7f5df5000640 1 -- 172.21.15.49:0/1982674104 shutdown_connections 2024-01-31T05:05:54.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.728+0000 7f5df5000640 1 --2- 172.21.15.49:0/1982674104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5df00714e0 0x7f5df00ad800 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:54.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.728+0000 7f5df5000640 1 --2- 172.21.15.49:0/1982674104 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5df015b110 0x7f5df006c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:54.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.728+0000 7f5df5000640 1 -- 172.21.15.49:0/1982674104 >> 172.21.15.49:0/1982674104 conn(0x7f5df00b09a0 msgr2=0x7f5df00b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:54.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.728+0000 7f5df5000640 1 -- 172.21.15.49:0/1982674104 shutdown_connections 2024-01-31T05:05:54.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.728+0000 7f5df5000640 1 -- 172.21.15.49:0/1982674104 wait complete. 2024-01-31T05:05:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5df5000640 1 Processor -- start 2024-01-31T05:05:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5df5000640 1 -- start start 2024-01-31T05:05:54.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5df5000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5df00714e0 0x7f5df0158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5df5000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5df00cdf10 0x7f5df01477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5df5000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5df015b110 0x7f5df014c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5df5000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df0148210 con 0x7f5df00cdf10 2024-01-31T05:05:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5df5000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df009bf40 con 0x7f5df00714e0 2024-01-31T05:05:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5df5000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df009b6a0 con 0x7f5df015b110 2024-01-31T05:05:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5ded400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5df00cdf10 0x7f5df01477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5ded400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5df00cdf10 0x7f5df01477e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33592/0 (socket says 172.21.15.49:33592) 2024-01-31T05:05:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5ded400640 1 -- 172.21.15.49:0/1346551460 learned_addr learned my addr 172.21.15.49:0/1346551460 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5dede00640 1 --2- 172.21.15.49:0/1346551460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5df00714e0 0x7f5df0158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5dee800640 1 --2- 172.21.15.49:0/1346551460 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5df015b110 0x7f5df014c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:54.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5ded400640 1 -- 172.21.15.49:0/1346551460 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5df015b110 msgr2=0x7f5df014c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:54.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5ded400640 1 --2- 172.21.15.49:0/1346551460 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5df015b110 0x7f5df014c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:54.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5ded400640 1 -- 172.21.15.49:0/1346551460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5df00714e0 msgr2=0x7f5df0158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:54.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5ded400640 1 --2- 172.21.15.49:0/1346551460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5df00714e0 0x7f5df0158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:54.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5ded400640 1 -- 172.21.15.49:0/1346551460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de8009a70 con 0x7f5df00cdf10 2024-01-31T05:05:54.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5ded400640 1 --2- 172.21.15.49:0/1346551460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5df00cdf10 0x7f5df01477e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800c780 tx=0x7f5dd800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:54.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5de6000640 1 -- 172.21.15.49:0/1346551460 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd80072d0 con 0x7f5df00cdf10 2024-01-31T05:05:54.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5de6000640 1 -- 172.21.15.49:0/1346551460 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd8007450 con 0x7f5df00cdf10 2024-01-31T05:05:54.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5de6000640 1 -- 172.21.15.49:0/1346551460 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd80047f0 con 0x7f5df00cdf10 2024-01-31T05:05:54.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5df5000640 1 -- 172.21.15.49:0/1346551460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df009b980 con 0x7f5df00cdf10 2024-01-31T05:05:54.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.732+0000 7f5df5000640 1 -- 172.21.15.49:0/1346551460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df0158c50 con 0x7f5df00cdf10 2024-01-31T05:05:54.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.736+0000 7f5df5000640 1 -- 172.21.15.49:0/1346551460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df0074860 con 0x7f5df00cdf10 2024-01-31T05:05:54.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.736+0000 7f5de6000640 1 -- 172.21.15.49:0/1346551460 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f5dd8004950 con 0x7f5df00cdf10 2024-01-31T05:05:54.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.736+0000 7f5de6000640 1 --2- 172.21.15.49:0/1346551460 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5dc8066530 0x7f5dc80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:54.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.736+0000 7f5de6000640 1 -- 172.21.15.49:0/1346551460 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5dd8082fa0 con 0x7f5df00cdf10 2024-01-31T05:05:54.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.736+0000 7f5dede00640 1 --2- 172.21.15.49:0/1346551460 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5dc8066530 0x7f5dc80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:54.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.740+0000 7f5dede00640 1 --2- 172.21.15.49:0/1346551460 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5dc8066530 0x7f5dc80689f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5de0007a60 tx=0x7f5de0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:54.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.740+0000 7f5de6000640 1 -- 172.21.15.49:0/1346551460 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f5dd80501a0 con 0x7f5df00cdf10 2024-01-31T05:05:54.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:54.936+0000 7f5df5000640 1 -- 172.21.15.49:0/1346551460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5df015b4f0 con 0x7f5df00cdf10 2024-01-31T05:05:55.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.556+0000 7f5de6000640 1 -- 172.21.15.49:0/1346551460 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v19) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5df015b4f0 con 0x7f5df00cdf10 2024-01-31T05:05:55.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.560+0000 7f5df5000640 1 -- 172.21.15.49:0/1346551460 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5dc8066530 msgr2=0x7f5dc80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:55.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.560+0000 7f5df5000640 1 --2- 172.21.15.49:0/1346551460 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5dc8066530 0x7f5dc80689f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5de0007a60 tx=0x7f5de0008040 comp rx=0 tx=0).stop 2024-01-31T05:05:55.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.560+0000 7f5df5000640 1 -- 172.21.15.49:0/1346551460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5df00cdf10 msgr2=0x7f5df01477e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:55.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.560+0000 7f5df5000640 1 --2- 172.21.15.49:0/1346551460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5df00cdf10 0x7f5df01477e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800c780 tx=0x7f5dd800cc40 comp rx=0 tx=0).stop 2024-01-31T05:05:55.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.560+0000 7f5df5000640 1 -- 172.21.15.49:0/1346551460 shutdown_connections 2024-01-31T05:05:55.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.560+0000 7f5df5000640 1 --2- 172.21.15.49:0/1346551460 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5df015b110 0x7f5df014c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:55.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.560+0000 7f5df5000640 1 --2- 172.21.15.49:0/1346551460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5df00cdf10 0x7f5df01477e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:55.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.560+0000 7f5df5000640 1 --2- 172.21.15.49:0/1346551460 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5dc8066530 0x7f5dc80689f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:55.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.560+0000 7f5df5000640 1 --2- 172.21.15.49:0/1346551460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5df00714e0 0x7f5df0158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:55.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.560+0000 7f5df5000640 1 -- 172.21.15.49:0/1346551460 >> 172.21.15.49:0/1346551460 conn(0x7f5df00b09a0 msgr2=0x7f5df00b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:55.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.560+0000 7f5df5000640 1 -- 172.21.15.49:0/1346551460 shutdown_connections 2024-01-31T05:05:55.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.560+0000 7f5df5000640 1 -- 172.21.15.49:0/1346551460 wait complete. 2024-01-31T05:05:55.586 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-31T05:05:55.586 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:05:55.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabe3000640 1 Processor -- start 2024-01-31T05:05:55.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabe3000640 1 -- start start 2024-01-31T05:05:55.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabe3000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fabdc15d540 0x7fabdc0cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:55.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabe3000640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabdc0cef80 con 0x7fabdc06c290 2024-01-31T05:05:55.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabe3000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabdc06cae0 con 0x7fabdc0cbbc0 2024-01-31T05:05:55.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabe3000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabdc0cf1b0 con 0x7fabdc15d540 2024-01-31T05:05:55.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdb400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fabdc06c290 0x7fabdc0cb4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49788/0 (socket says 172.21.15.49:49788) 2024-01-31T05:05:55.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdb400640 1 -- 172.21.15.49:0/1675711593 learned_addr learned my addr 172.21.15.49:0/1675711593 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:55.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdbe00640 1 --2- 172.21.15.49:0/1675711593 >> v2:172.21.15.195:3300/0 conn(0x7fabdc15d540 0x7fabdc0cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:55.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdaa00640 1 -- 172.21.15.49:0/1675711593 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773962096 0 0) 0x7fabdc0cef80 con 0x7fabdc06c290 2024-01-31T05:05:55.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdaa00640 1 -- 172.21.15.49:0/1675711593 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabbc003530 con 0x7fabdc06c290 2024-01-31T05:05:55.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdaa00640 1 -- 172.21.15.49:0/1675711593 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2290046644 0 0) 0x7fabbc003530 con 0x7fabdc06c290 2024-01-31T05:05:55.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdaa00640 1 -- 172.21.15.49:0/1675711593 >> v2:172.21.15.195:3300/0 conn(0x7fabdc15d540 msgr2=0x7fabdc0cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:55.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdaa00640 1 --2- 172.21.15.49:0/1675711593 >> v2:172.21.15.195:3300/0 conn(0x7fabdc15d540 0x7fabdc0cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:55.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdaa00640 1 -- 172.21.15.49:0/1675711593 >> v1:172.21.15.195:6789/0 conn(0x7fabdc0cbbc0 legacy=0x7fabdc15d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:55.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdaa00640 1 -- 172.21.15.49:0/1675711593 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabdc0cf490 con 0x7fabdc06c290 2024-01-31T05:05:55.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdaa00640 1 -- 172.21.15.49:0/1675711593 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7fabc4001680 con 0x7fabdc06c290 2024-01-31T05:05:55.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdaa00640 1 -- 172.21.15.49:0/1675711593 >> v1:172.21.15.49:6789/0 conn(0x7fabdc06c290 legacy=0x7fabdc0cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:55.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdaa00640 1 --2- 172.21.15.49:0/1675711593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabbc003980 0x7fabbc003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:55.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdaa00640 1 --2- 172.21.15.49:0/1675711593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabbc004380 0x7fabbc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:55.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdaa00640 1 --2- 172.21.15.49:0/1675711593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabbc005050 0x7fabbc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:55.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdaa00640 1 -- 172.21.15.49:0/1675711593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc0cf1b0 con 0x7fabbc003980 2024-01-31T05:05:55.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdaa00640 1 -- 172.21.15.49:0/1675711593 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc00bfb0 con 0x7fabbc005050 2024-01-31T05:05:55.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdaa00640 1 -- 172.21.15.49:0/1675711593 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc00c170 con 0x7fabbc004380 2024-01-31T05:05:55.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdbe00640 1 --2- 172.21.15.49:0/1675711593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabbc003980 0x7fabbc003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:55.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdb400640 1 --2- 172.21.15.49:0/1675711593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabbc004380 0x7fabbc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:55.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabe1000640 1 --2- 172.21.15.49:0/1675711593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabbc005050 0x7fabbc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:55.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdbe00640 1 -- 172.21.15.49:0/1675711593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabbc004380 msgr2=0x7fabbc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:55.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdbe00640 1 --2- 172.21.15.49:0/1675711593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabbc004380 0x7fabbc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:55.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdbe00640 1 -- 172.21.15.49:0/1675711593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabbc005050 msgr2=0x7fabbc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:55.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdbe00640 1 --2- 172.21.15.49:0/1675711593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabbc005050 0x7fabbc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:55.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabdbe00640 1 -- 172.21.15.49:0/1675711593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc003530 con 0x7fabbc003980 2024-01-31T05:05:55.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.732+0000 7fabe1000640 1 -- 172.21.15.49:0/1675711593 reap_dead start 2024-01-31T05:05:55.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.736+0000 7fabdbe00640 1 --2- 172.21.15.49:0/1675711593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabbc003980 0x7fabbc003d60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fabcc009ae0 tx=0x7fabcc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febd342bf4677027 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:55.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.736+0000 7fabdaa00640 1 -- 172.21.15.49:0/1675711593 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc0a5530 con 0x7fabbc003980 2024-01-31T05:05:55.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.736+0000 7fabdaa00640 1 -- 172.21.15.49:0/1675711593 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabcc0a5690 con 0x7fabbc003980 2024-01-31T05:05:55.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.736+0000 7fabdaa00640 1 -- 172.21.15.49:0/1675711593 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc0a5a40 con 0x7fabbc003980 2024-01-31T05:05:55.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.736+0000 7fabe3000640 1 -- 172.21.15.49:0/1675711593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabbc003980 msgr2=0x7fabbc003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:55.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.736+0000 7fabe3000640 1 --2- 172.21.15.49:0/1675711593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabbc003980 0x7fabbc003d60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fabcc009ae0 tx=0x7fabcc01ca50 comp rx=0 tx=0).stop 2024-01-31T05:05:55.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.736+0000 7fabe3000640 1 -- 172.21.15.49:0/1675711593 shutdown_connections 2024-01-31T05:05:55.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.736+0000 7fabe3000640 1 --2- 172.21.15.49:0/1675711593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabbc003980 0x7fabbc003d60 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:55.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.736+0000 7fabe3000640 1 -- 172.21.15.49:0/1675711593 >> 172.21.15.49:0/1675711593 conn(0x7fabdc0d0e60 msgr2=0x7fabdc0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:55.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabe3000640 1 -- 172.21.15.49:0/1675711593 shutdown_connections 2024-01-31T05:05:55.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabe3000640 1 -- 172.21.15.49:0/1675711593 wait complete. 2024-01-31T05:05:55.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabe3000640 1 Processor -- start 2024-01-31T05:05:55.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabe3000640 1 -- start start 2024-01-31T05:05:55.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabe3000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabbc003980 0x7fabdc1f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabe3000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabdc156320 0x7fabdc0caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabe3000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabdc153f90 0x7fabdc154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabe3000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc154980 con 0x7fabbc003980 2024-01-31T05:05:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabe3000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc1f78b0 con 0x7fabdc153f90 2024-01-31T05:05:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabe3000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc1574f0 con 0x7fabdc156320 2024-01-31T05:05:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabdbe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabbc003980 0x7fabdc1f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabdbe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabbc003980 0x7fabdc1f7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33610/0 (socket says 172.21.15.49:33610) 2024-01-31T05:05:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabdbe00640 1 -- 172.21.15.49:0/2865321908 learned_addr learned my addr 172.21.15.49:0/2865321908 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabe1000640 1 --2- 172.21.15.49:0/2865321908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabdc153f90 0x7fabdc154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabdb400640 1 --2- 172.21.15.49:0/2865321908 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabdc156320 0x7fabdc0caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:55.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabdbe00640 1 -- 172.21.15.49:0/2865321908 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabdc156320 msgr2=0x7fabdc0caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:55.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabdbe00640 1 --2- 172.21.15.49:0/2865321908 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabdc156320 0x7fabdc0caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:55.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabdbe00640 1 -- 172.21.15.49:0/2865321908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabdc153f90 msgr2=0x7fabdc154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:55.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabdbe00640 1 --2- 172.21.15.49:0/2865321908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabdc153f90 0x7fabdc154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:55.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.740+0000 7fabdbe00640 1 -- 172.21.15.49:0/2865321908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabdc157980 con 0x7fabbc003980 2024-01-31T05:05:55.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.744+0000 7fabdbe00640 1 --2- 172.21.15.49:0/2865321908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabbc003980 0x7fabdc1f7370 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0b0040 tx=0x7fabcc0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:55.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.744+0000 7fabd3e00640 1 -- 172.21.15.49:0/2865321908 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc004220 con 0x7fabbc003980 2024-01-31T05:05:55.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.744+0000 7fabd3e00640 1 -- 172.21.15.49:0/2865321908 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabcc0043c0 con 0x7fabbc003980 2024-01-31T05:05:55.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.744+0000 7fabd3e00640 1 -- 172.21.15.49:0/2865321908 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc003860 con 0x7fabbc003980 2024-01-31T05:05:55.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.744+0000 7fabe3000640 1 -- 172.21.15.49:0/2865321908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabdc1568e0 con 0x7fabbc003980 2024-01-31T05:05:55.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.744+0000 7fabe3000640 1 -- 172.21.15.49:0/2865321908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabdc156ea0 con 0x7fabbc003980 2024-01-31T05:05:55.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.744+0000 7fabe3000640 1 -- 172.21.15.49:0/2865321908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabdc0ce880 con 0x7fabbc003980 2024-01-31T05:05:55.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.744+0000 7fabd3e00640 1 -- 172.21.15.49:0/2865321908 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fabcc0b4070 con 0x7fabbc003980 2024-01-31T05:05:55.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.744+0000 7fabd3e00640 1 --2- 172.21.15.49:0/2865321908 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fabb4066530 0x7fabb40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:55.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.744+0000 7fabd3e00640 1 -- 172.21.15.49:0/2865321908 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fabcc11dd90 con 0x7fabbc003980 2024-01-31T05:05:55.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.748+0000 7fabdb400640 1 --2- 172.21.15.49:0/2865321908 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fabb4066530 0x7fabb40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:55.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.748+0000 7fabdb400640 1 --2- 172.21.15.49:0/2865321908 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fabb4066530 0x7fabb40689f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fabdc15b820 tx=0x7fabc40014e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.748+0000 7fabd3e00640 1 -- 172.21.15.49:0/2865321908 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fabcc0eaf90 con 0x7fabbc003980 2024-01-31T05:05:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.940+0000 7fabe3000640 1 -- 172.21.15.49:0/2865321908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabdc0c9090 con 0x7fabbc003980 2024-01-31T05:05:55.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.940+0000 7fabd3e00640 1 -- 172.21.15.49:0/2865321908 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fabcc0b2020 con 0x7fabbc003980 2024-01-31T05:05:55.944 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:55.944 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5078,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3747440713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3747440713},{"type":"v1","addr":"172.21.15.195:6837","nonce":3747440713}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2835620509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2835620509},{"type":"v1","addr":"172.21.15.195:6836","nonce":2835620509}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2080191803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2080191803},{"type":"v1","addr":"172.21.15.49:6833","nonce":2080191803}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-31T05:05:51.919747+0000","modified":"2024-01-31T05:05:54.941384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5493":{"gid":5493,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6835/4235056900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4235056900},{"type":"v1","addr":"172.21.15.49:6835","nonce":4235056900}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-31T05:05:55.945 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 19 2024-01-31T05:05:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.944+0000 7fabe3000640 1 -- 172.21.15.49:0/2865321908 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fabb4066530 msgr2=0x7fabb40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.944+0000 7fabe3000640 1 --2- 172.21.15.49:0/2865321908 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fabb4066530 0x7fabb40689f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fabdc15b820 tx=0x7fabc40014e0 comp rx=0 tx=0).stop 2024-01-31T05:05:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.944+0000 7fabe3000640 1 -- 172.21.15.49:0/2865321908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabbc003980 msgr2=0x7fabdc1f7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.944+0000 7fabe3000640 1 --2- 172.21.15.49:0/2865321908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabbc003980 0x7fabdc1f7370 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0b0040 tx=0x7fabcc0197f0 comp rx=0 tx=0).stop 2024-01-31T05:05:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.944+0000 7fabe3000640 1 -- 172.21.15.49:0/2865321908 shutdown_connections 2024-01-31T05:05:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.944+0000 7fabe3000640 1 --2- 172.21.15.49:0/2865321908 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fabb4066530 0x7fabb40689f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.944+0000 7fabe3000640 1 --2- 172.21.15.49:0/2865321908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabdc153f90 0x7fabdc154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.944+0000 7fabe3000640 1 --2- 172.21.15.49:0/2865321908 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fabdc156320 0x7fabdc0caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.944+0000 7fabe3000640 1 --2- 172.21.15.49:0/2865321908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabbc003980 0x7fabdc1f7370 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.944+0000 7fabe3000640 1 -- 172.21.15.49:0/2865321908 >> 172.21.15.49:0/2865321908 conn(0x7fabdc0d0e60 msgr2=0x7fabdc0cc050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.944+0000 7fabe3000640 1 -- 172.21.15.49:0/2865321908 shutdown_connections 2024-01-31T05:05:55.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:55.944+0000 7fabe3000640 1 -- 172.21.15.49:0/2865321908 wait complete. 2024-01-31T05:05:55.967 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:05:56.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.104+0000 7f258b600640 1 Processor -- start 2024-01-31T05:05:56.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.108+0000 7f258b600640 1 -- start start 2024-01-31T05:05:56.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.108+0000 7f258b600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f258415b110 0x7f258406c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:56.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.108+0000 7f258b600640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258415b4f0 con 0x7f25840714e0 2024-01-31T05:05:56.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.108+0000 7f258b600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25840abf20 con 0x7f25840cdf10 2024-01-31T05:05:56.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.108+0000 7f258b600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25840ce460 con 0x7f258415b110 2024-01-31T05:05:56.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.108+0000 7f2589600640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f25840714e0 0x7f25840ad800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49790/0 (socket says 172.21.15.49:49790) 2024-01-31T05:05:56.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.108+0000 7f2589600640 1 -- 172.21.15.49:0/2642837973 learned_addr learned my addr 172.21.15.49:0/2642837973 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:56.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.108+0000 7f2588c00640 1 --2- 172.21.15.49:0/2642837973 >> v2:172.21.15.195:3300/0 conn(0x7f258415b110 0x7f258406c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:56.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.108+0000 7f2583400640 1 -- 172.21.15.49:0/2642837973 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901750847 0 0) 0x7f257c0014a0 con 0x7f25840714e0 2024-01-31T05:05:56.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.108+0000 7f2583400640 1 -- 172.21.15.49:0/2642837973 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2564003530 con 0x7f25840714e0 2024-01-31T05:05:56.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.108+0000 7f2588c00640 1 -- 172.21.15.49:0/2642837973 >> v1:172.21.15.195:6789/0 conn(0x7f25840cdf10 legacy=0x7f2584070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:56.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.108+0000 7f2588c00640 1 -- 172.21.15.49:0/2642837973 >> v1:172.21.15.49:6789/0 conn(0x7f25840714e0 legacy=0x7f25840ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:56.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.108+0000 7f2588c00640 1 -- 172.21.15.49:0/2642837973 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25840ac200 con 0x7f258415b110 2024-01-31T05:05:56.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.112+0000 7f2588c00640 1 --2- 172.21.15.49:0/2642837973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f258415b110 0x7f258406c2d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f25740097c0 tx=0x7f257401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9ffabd718d9bec6 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:56.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.112+0000 7f2583400640 1 -- 172.21.15.49:0/2642837973 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25740ad660 con 0x7f258415b110 2024-01-31T05:05:56.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.112+0000 7f2583400640 1 -- 172.21.15.49:0/2642837973 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25740ad7c0 con 0x7f258415b110 2024-01-31T05:05:56.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.112+0000 7f2583400640 1 -- 172.21.15.49:0/2642837973 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25740adb50 con 0x7f258415b110 2024-01-31T05:05:56.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.112+0000 7f258b600640 1 -- 172.21.15.49:0/2642837973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f258415b110 msgr2=0x7f258406c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:56.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.112+0000 7f258b600640 1 --2- 172.21.15.49:0/2642837973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f258415b110 0x7f258406c2d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f25740097c0 tx=0x7f257401c450 comp rx=0 tx=0).stop 2024-01-31T05:05:56.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.112+0000 7f258b600640 1 -- 172.21.15.49:0/2642837973 shutdown_connections 2024-01-31T05:05:56.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.112+0000 7f258b600640 1 --2- 172.21.15.49:0/2642837973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f258415b110 0x7f258406c2d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.112+0000 7f258b600640 1 -- 172.21.15.49:0/2642837973 >> 172.21.15.49:0/2642837973 conn(0x7f25840b09a0 msgr2=0x7f25840b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:56.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.112+0000 7f258b600640 1 -- 172.21.15.49:0/2642837973 shutdown_connections 2024-01-31T05:05:56.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.112+0000 7f258b600640 1 -- 172.21.15.49:0/2642837973 wait complete. 2024-01-31T05:05:56.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f258b600640 1 Processor -- start 2024-01-31T05:05:56.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f258b600640 1 -- start start 2024-01-31T05:05:56.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f258b600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25840714e0 0x7f2584143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:56.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f258b600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25840cdf10 0x7f2584146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:56.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f258b600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f258415b110 0x7f25841498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:56.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f258b600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2584143d70 con 0x7f25840714e0 2024-01-31T05:05:56.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f258b600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258414e3d0 con 0x7f25840cdf10 2024-01-31T05:05:56.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f258b600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2584146990 con 0x7f258415b110 2024-01-31T05:05:56.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f2588c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25840714e0 0x7f2584143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:56.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f2588c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25840714e0 0x7f2584143830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33624/0 (socket says 172.21.15.49:33624) 2024-01-31T05:05:56.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f2588c00640 1 -- 172.21.15.49:0/3450112118 learned_addr learned my addr 172.21.15.49:0/3450112118 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:56.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f2583e00640 1 --2- 172.21.15.49:0/3450112118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25840cdf10 0x7f2584146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:56.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f2589600640 1 --2- 172.21.15.49:0/3450112118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f258415b110 0x7f25841498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:56.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f2588c00640 1 -- 172.21.15.49:0/3450112118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f258415b110 msgr2=0x7f25841498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:56.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f2588c00640 1 --2- 172.21.15.49:0/3450112118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f258415b110 0x7f25841498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f2588c00640 1 -- 172.21.15.49:0/3450112118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25840cdf10 msgr2=0x7f2584146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:56.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f2588c00640 1 --2- 172.21.15.49:0/3450112118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25840cdf10 0x7f2584146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f2588c00640 1 -- 172.21.15.49:0/3450112118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2574009420 con 0x7f25840714e0 2024-01-31T05:05:56.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f2589600640 1 --2- 172.21.15.49:0/3450112118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f258415b110 0x7f25841498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:56.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f2588c00640 1 --2- 172.21.15.49:0/3450112118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25840714e0 0x7f2584143830 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f25740b0040 tx=0x7f257401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:56.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f2580c00640 1 -- 172.21.15.49:0/3450112118 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25740b9650 con 0x7f25840714e0 2024-01-31T05:05:56.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f2580c00640 1 -- 172.21.15.49:0/3450112118 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25740b97f0 con 0x7f25840714e0 2024-01-31T05:05:56.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f2580c00640 1 -- 172.21.15.49:0/3450112118 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25740b9ba0 con 0x7f25840714e0 2024-01-31T05:05:56.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f258b600640 1 -- 172.21.15.49:0/3450112118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2584146c70 con 0x7f25840714e0 2024-01-31T05:05:56.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.116+0000 7f258b600640 1 -- 172.21.15.49:0/3450112118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25841465a0 con 0x7f25840714e0 2024-01-31T05:05:56.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.120+0000 7f258b600640 1 -- 172.21.15.49:0/3450112118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2584146730 con 0x7f25840714e0 2024-01-31T05:05:56.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.120+0000 7f2580c00640 1 -- 172.21.15.49:0/3450112118 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f25740b9d00 con 0x7f25840714e0 2024-01-31T05:05:56.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.120+0000 7f2580c00640 1 --2- 172.21.15.49:0/3450112118 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f255c066530 0x7f255c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:56.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.120+0000 7f2580c00640 1 -- 172.21.15.49:0/3450112118 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f257411ec50 con 0x7f25840714e0 2024-01-31T05:05:56.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.120+0000 7f2583e00640 1 --2- 172.21.15.49:0/3450112118 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f255c066530 0x7f255c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:56.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.120+0000 7f2583e00640 1 --2- 172.21.15.49:0/3450112118 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f255c066530 0x7f255c0689f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2584144e00 tx=0x7f256c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:56.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.124+0000 7f2580c00640 1 -- 172.21.15.49:0/3450112118 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f25740ebec0 con 0x7f25840714e0 2024-01-31T05:05:56.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.288+0000 7f258b600640 1 -- 172.21.15.49:0/3450112118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2584074860 con 0x7f25840714e0 2024-01-31T05:05:56.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.288+0000 7f2580c00640 1 -- 172.21.15.49:0/3450112118 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16751 (secure 0 0 0) 0x7f25740b2090 con 0x7f25840714e0 2024-01-31T05:05:56.289 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:56.290 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":39,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:05:53.527780+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:05:49.820131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-31T05:05:50.922571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:05:56.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.288+0000 7f258b600640 1 -- 172.21.15.49:0/3450112118 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f255c066530 msgr2=0x7f255c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:56.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.288+0000 7f258b600640 1 --2- 172.21.15.49:0/3450112118 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f255c066530 0x7f255c0689f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2584144e00 tx=0x7f256c009040 comp rx=0 tx=0).stop 2024-01-31T05:05:56.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.288+0000 7f258b600640 1 -- 172.21.15.49:0/3450112118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25840714e0 msgr2=0x7f2584143830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:56.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.288+0000 7f258b600640 1 --2- 172.21.15.49:0/3450112118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25840714e0 0x7f2584143830 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f25740b0040 tx=0x7f257401ac90 comp rx=0 tx=0).stop 2024-01-31T05:05:56.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.288+0000 7f258b600640 1 -- 172.21.15.49:0/3450112118 shutdown_connections 2024-01-31T05:05:56.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.288+0000 7f258b600640 1 --2- 172.21.15.49:0/3450112118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f258415b110 0x7f25841498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.288+0000 7f258b600640 1 --2- 172.21.15.49:0/3450112118 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f255c066530 0x7f255c0689f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.288+0000 7f258b600640 1 --2- 172.21.15.49:0/3450112118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25840cdf10 0x7f2584146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.288+0000 7f258b600640 1 --2- 172.21.15.49:0/3450112118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25840714e0 0x7f2584143830 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.288+0000 7f258b600640 1 -- 172.21.15.49:0/3450112118 >> 172.21.15.49:0/3450112118 conn(0x7f25840b09a0 msgr2=0x7f25840afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:56.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.288+0000 7f258b600640 1 -- 172.21.15.49:0/3450112118 shutdown_connections 2024-01-31T05:05:56.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.288+0000 7f258b600640 1 -- 172.21.15.49:0/3450112118 wait complete. 2024-01-31T05:05:56.312 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-31T05:05:56.312 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-31T05:05:56.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a08e00640 1 Processor -- start 2024-01-31T05:05:56.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a08e00640 1 -- start start 2024-01-31T05:05:56.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a08e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a040cdf10 0x7f2a04070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:56.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a08e00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a0415b4f0 con 0x7f2a0415b110 2024-01-31T05:05:56.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a08e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a040abf20 con 0x7f2a040ce610 2024-01-31T05:05:56.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a08e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a040ce460 con 0x7f2a040cdf10 2024-01-31T05:05:56.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a01e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f2a0415b110 0x7f2a0406c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49806/0 (socket says 172.21.15.49:49806) 2024-01-31T05:05:56.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a01e00640 1 -- 172.21.15.49:0/1276542597 learned_addr learned my addr 172.21.15.49:0/1276542597 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:56.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a01400640 1 --2- 172.21.15.49:0/1276542597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a040cdf10 0x7f2a04070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:56.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a00a00640 1 -- 172.21.15.49:0/1276542597 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424987666 0 0) 0x7f29f4001120 con 0x7f2a0415b110 2024-01-31T05:05:56.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a00a00640 1 -- 172.21.15.49:0/1276542597 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29e4003530 con 0x7f2a0415b110 2024-01-31T05:05:56.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a00a00640 1 -- 172.21.15.49:0/1276542597 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133358592 0 0) 0x7f2a040abf20 con 0x7f2a040ce610 2024-01-31T05:05:56.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a00a00640 1 -- 172.21.15.49:0/1276542597 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29f4001120 con 0x7f2a040ce610 2024-01-31T05:05:56.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a00a00640 1 -- 172.21.15.49:0/1276542597 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 113993196 0 0) 0x7f29e4003530 con 0x7f2a0415b110 2024-01-31T05:05:56.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a00a00640 1 -- 172.21.15.49:0/1276542597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a040cdf10 msgr2=0x7f2a04070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:56.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a00a00640 1 --2- 172.21.15.49:0/1276542597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a040cdf10 0x7f2a04070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a00a00640 1 -- 172.21.15.49:0/1276542597 >> v1:172.21.15.195:6789/0 conn(0x7f2a040ce610 legacy=0x7f2a040ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:56.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a00a00640 1 -- 172.21.15.49:0/1276542597 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a040ac200 con 0x7f2a0415b110 2024-01-31T05:05:56.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a00a00640 1 -- 172.21.15.49:0/1276542597 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7f29f4001810 con 0x7f2a0415b110 2024-01-31T05:05:56.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a01400640 1 --2- 172.21.15.49:0/1276542597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a040cdf10 0x7f2a04070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:56.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a00a00640 1 -- 172.21.15.49:0/1276542597 >> v1:172.21.15.49:6789/0 conn(0x7f2a0415b110 legacy=0x7f2a0406c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:56.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a00a00640 1 --2- 172.21.15.49:0/1276542597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29e4003b40 0x7f29e4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:56.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a00a00640 1 --2- 172.21.15.49:0/1276542597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a040cdf10 0x7f29e40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:56.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a00a00640 1 --2- 172.21.15.49:0/1276542597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29e4004d10 0x7f29e4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:56.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a00a00640 1 -- 172.21.15.49:0/1276542597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a040ce460 con 0x7f29e4003b40 2024-01-31T05:05:56.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a00a00640 1 -- 172.21.15.49:0/1276542597 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e400ba40 con 0x7f29e4004d10 2024-01-31T05:05:56.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.452+0000 7f2a00a00640 1 -- 172.21.15.49:0/1276542597 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e400bb80 con 0x7f2a040cdf10 2024-01-31T05:05:56.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.456+0000 7f2a01e00640 1 --2- 172.21.15.49:0/1276542597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29e4003b40 0x7f29e4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:56.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.456+0000 7f2a01400640 1 --2- 172.21.15.49:0/1276542597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a040cdf10 0x7f29e40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:56.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.456+0000 7f2a02800640 1 --2- 172.21.15.49:0/1276542597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29e4004d10 0x7f29e4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:56.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.456+0000 7f2a01e00640 1 -- 172.21.15.49:0/1276542597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a040cdf10 msgr2=0x7f29e40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:56.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.456+0000 7f2a01e00640 1 --2- 172.21.15.49:0/1276542597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2a040cdf10 0x7f29e40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.456+0000 7f2a01e00640 1 -- 172.21.15.49:0/1276542597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29e4004d10 msgr2=0x7f29e4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:56.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.456+0000 7f2a01e00640 1 --2- 172.21.15.49:0/1276542597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29e4004d10 0x7f29e4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.456+0000 7f2a01e00640 1 -- 172.21.15.49:0/1276542597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec009420 con 0x7f29e4003b40 2024-01-31T05:05:56.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.456+0000 7f2a02800640 1 --2- 172.21.15.49:0/1276542597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29e4004d10 0x7f29e4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:56.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.456+0000 7f2a01e00640 1 --2- 172.21.15.49:0/1276542597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29e4003b40 0x7f29e4003f40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f29f400c160 tx=0x7f29f401cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fbd678db8be0bab server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:56.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.456+0000 7f2a00a00640 1 -- 172.21.15.49:0/1276542597 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f40058e0 con 0x7f29e4003b40 2024-01-31T05:05:56.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.456+0000 7f2a00a00640 1 -- 172.21.15.49:0/1276542597 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f4005a60 con 0x7f29e4003b40 2024-01-31T05:05:56.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.456+0000 7f2a00a00640 1 -- 172.21.15.49:0/1276542597 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f4005e10 con 0x7f29e4003b40 2024-01-31T05:05:56.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a08e00640 1 -- 172.21.15.49:0/1276542597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29e4003b40 msgr2=0x7f29e4003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:56.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a08e00640 1 --2- 172.21.15.49:0/1276542597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29e4003b40 0x7f29e4003f40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f29f400c160 tx=0x7f29f401cb70 comp rx=0 tx=0).stop 2024-01-31T05:05:56.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a02800640 1 -- 172.21.15.49:0/1276542597 reap_dead start 2024-01-31T05:05:56.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a08e00640 1 -- 172.21.15.49:0/1276542597 shutdown_connections 2024-01-31T05:05:56.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a08e00640 1 -- 172.21.15.49:0/1276542597 >> 172.21.15.49:0/1276542597 conn(0x7f2a040b09a0 msgr2=0x7f2a040b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:56.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a08e00640 1 -- 172.21.15.49:0/1276542597 shutdown_connections 2024-01-31T05:05:56.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a08e00640 1 -- 172.21.15.49:0/1276542597 wait complete. 2024-01-31T05:05:56.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a08e00640 1 Processor -- start 2024-01-31T05:05:56.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a08e00640 1 -- start start 2024-01-31T05:05:56.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a08e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29e4003b40 0x7f2a0414dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:56.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a08e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a0414fe90 0x7f2a040aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:56.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a08e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a04150310 0x7f2a040af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:56.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a08e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0414daa0 con 0x7f2a04150310 2024-01-31T05:05:56.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a08e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a040afb00 con 0x7f2a0414fe90 2024-01-31T05:05:56.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a08e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a040af820 con 0x7f29e4003b40 2024-01-31T05:05:56.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a02800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a04150310 0x7f2a040af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:56.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a02800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a04150310 0x7f2a040af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33646/0 (socket says 172.21.15.49:33646) 2024-01-31T05:05:56.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a02800640 1 -- 172.21.15.49:0/1387365990 learned_addr learned my addr 172.21.15.49:0/1387365990 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:56.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a01e00640 1 --2- 172.21.15.49:0/1387365990 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29e4003b40 0x7f2a0414dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:56.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.460+0000 7f2a01400640 1 --2- 172.21.15.49:0/1387365990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a0414fe90 0x7f2a040aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:56.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.464+0000 7f2a02800640 1 -- 172.21.15.49:0/1387365990 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29e4003b40 msgr2=0x7f2a0414dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:56.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.464+0000 7f2a02800640 1 --2- 172.21.15.49:0/1387365990 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29e4003b40 0x7f2a0414dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.464+0000 7f2a02800640 1 -- 172.21.15.49:0/1387365990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a0414fe90 msgr2=0x7f2a040aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:56.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.464+0000 7f2a02800640 1 --2- 172.21.15.49:0/1387365990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a0414fe90 0x7f2a040aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.464+0000 7f2a02800640 1 -- 172.21.15.49:0/1387365990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0414d3e0 con 0x7f2a04150310 2024-01-31T05:05:56.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.464+0000 7f2a02800640 1 --2- 172.21.15.49:0/1387365990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a04150310 0x7f2a040af1f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f29fc007e70 tx=0x7f29fc00ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:56.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.464+0000 7f29fa000640 1 -- 172.21.15.49:0/1387365990 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc006b60 con 0x7f2a04150310 2024-01-31T05:05:56.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.464+0000 7f29fa000640 1 -- 172.21.15.49:0/1387365990 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc006cc0 con 0x7f2a04150310 2024-01-31T05:05:56.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.464+0000 7f29fa000640 1 -- 172.21.15.49:0/1387365990 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc003bc0 con 0x7f2a04150310 2024-01-31T05:05:56.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.464+0000 7f2a08e00640 1 -- 172.21.15.49:0/1387365990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a0414d6c0 con 0x7f2a04150310 2024-01-31T05:05:56.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.464+0000 7f2a08e00640 1 -- 172.21.15.49:0/1387365990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a0413f2f0 con 0x7f2a04150310 2024-01-31T05:05:56.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.464+0000 7f2a08e00640 1 -- 172.21.15.49:0/1387365990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a0414d240 con 0x7f2a04150310 2024-01-31T05:05:56.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.464+0000 7f29fa000640 1 -- 172.21.15.49:0/1387365990 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f29fc003d20 con 0x7f2a04150310 2024-01-31T05:05:56.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.464+0000 7f29fa000640 1 --2- 172.21.15.49:0/1387365990 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f29dc066530 0x7f29dc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:56.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.464+0000 7f29fa000640 1 -- 172.21.15.49:0/1387365990 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f29fc083420 con 0x7f2a04150310 2024-01-31T05:05:56.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.464+0000 7f2a01e00640 1 --2- 172.21.15.49:0/1387365990 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f29dc066530 0x7f29dc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:56.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.468+0000 7f2a01e00640 1 --2- 172.21.15.49:0/1387365990 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f29dc066530 0x7f29dc0689f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f29f40aa000 tx=0x7f29f4001b90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:56.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.472+0000 7f29fa000640 1 -- 172.21.15.49:0/1387365990 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f2a0414d240 con 0x7f2a04150310 2024-01-31T05:05:56.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.628+0000 7f2a08e00640 1 -- 172.21.15.49:0/1387365990 --> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a0414dbe0 con 0x7f29dc066530 2024-01-31T05:05:56.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.636+0000 7f29fa000640 1 -- 172.21.15.49:0/1387365990 <== mgr.4100 v2:172.21.15.195:6832/3035808172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288999 (secure 0 0 0) 0x7f2a0414dbe0 con 0x7f29dc066530 2024-01-31T05:05:56.643 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:56.645 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-31T05:05:56.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.640+0000 7f2a08e00640 1 -- 172.21.15.49:0/1387365990 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f29dc066530 msgr2=0x7f29dc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:56.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.640+0000 7f2a08e00640 1 --2- 172.21.15.49:0/1387365990 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f29dc066530 0x7f29dc0689f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f29f40aa000 tx=0x7f29f4001b90 comp rx=0 tx=0).stop 2024-01-31T05:05:56.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.640+0000 7f2a08e00640 1 -- 172.21.15.49:0/1387365990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a04150310 msgr2=0x7f2a040af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:56.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.640+0000 7f2a08e00640 1 --2- 172.21.15.49:0/1387365990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a04150310 0x7f2a040af1f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f29fc007e70 tx=0x7f29fc00ebe0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.640+0000 7f2a08e00640 1 -- 172.21.15.49:0/1387365990 shutdown_connections 2024-01-31T05:05:56.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.640+0000 7f2a08e00640 1 --2- 172.21.15.49:0/1387365990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a04150310 0x7f2a040af1f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.640+0000 7f2a08e00640 1 --2- 172.21.15.49:0/1387365990 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f29dc066530 0x7f29dc0689f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.640+0000 7f2a08e00640 1 --2- 172.21.15.49:0/1387365990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a0414fe90 0x7f2a040aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.640+0000 7f2a08e00640 1 --2- 172.21.15.49:0/1387365990 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29e4003b40 0x7f2a0414dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.640+0000 7f2a08e00640 1 -- 172.21.15.49:0/1387365990 >> 172.21.15.49:0/1387365990 conn(0x7f2a040b09a0 msgr2=0x7f2a040703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:56.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.640+0000 7f2a08e00640 1 -- 172.21.15.49:0/1387365990 shutdown_connections 2024-01-31T05:05:56.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.640+0000 7f2a08e00640 1 -- 172.21.15.49:0/1387365990 wait complete. 2024-01-31T05:05:56.663 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-01-31T05:05:56.443121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254120,"kb_used_data":4648,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720600,"statfs":{"total":773094113280,"available":772833894400,"internally_reserved":0,"allocated":4759552,"data_stored":2685612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.925807"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.570575+0000","last_change":"2024-01-31T05:05:52.562389+0000","last_active":"2024-01-31T05:05:52.570575+0000","last_peered":"2024-01-31T05:05:52.570575+0000","last_clean":"2024-01-31T05:05:52.570575+0000","last_became_active":"2024-01-31T05:05:52.561022+0000","last_became_peered":"2024-01-31T05:05:52.561022+0000","last_unstale":"2024-01-31T05:05:52.570575+0000","last_undegraded":"2024-01-31T05:05:52.570575+0000","last_fullsized":"2024-01-31T05:05:52.570575+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:10:10.336827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.559710+0000","last_change":"2024-01-31T05:05:52.548780+0000","last_active":"2024-01-31T05:05:52.559710+0000","last_peered":"2024-01-31T05:05:52.559710+0000","last_clean":"2024-01-31T05:05:52.559710+0000","last_became_active":"2024-01-31T05:05:52.548449+0000","last_became_peered":"2024-01-31T05:05:52.548449+0000","last_unstale":"2024-01-31T05:05:52.559710+0000","last_undegraded":"2024-01-31T05:05:52.559710+0000","last_fullsized":"2024-01-31T05:05:52.559710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:44:01.953261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.573601+0000","last_change":"2024-01-31T05:05:52.563914+0000","last_active":"2024-01-31T05:05:52.573601+0000","last_peered":"2024-01-31T05:05:52.573601+0000","last_clean":"2024-01-31T05:05:52.573601+0000","last_became_active":"2024-01-31T05:05:52.562764+0000","last_became_peered":"2024-01-31T05:05:52.562764+0000","last_unstale":"2024-01-31T05:05:52.573601+0000","last_undegraded":"2024-01-31T05:05:52.573601+0000","last_fullsized":"2024-01-31T05:05:52.573601+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:10:40.038041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.557954+0000","last_change":"2024-01-31T05:05:52.551949+0000","last_active":"2024-01-31T05:05:52.557954+0000","last_peered":"2024-01-31T05:05:52.557954+0000","last_clean":"2024-01-31T05:05:52.557954+0000","last_became_active":"2024-01-31T05:05:52.551445+0000","last_became_peered":"2024-01-31T05:05:52.551445+0000","last_unstale":"2024-01-31T05:05:52.557954+0000","last_undegraded":"2024-01-31T05:05:52.557954+0000","last_fullsized":"2024-01-31T05:05:52.557954+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:43:53.487953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.555481+0000","last_change":"2024-01-31T05:05:52.552844+0000","last_active":"2024-01-31T05:05:52.555481+0000","last_peered":"2024-01-31T05:05:52.555481+0000","last_clean":"2024-01-31T05:05:52.555481+0000","last_became_active":"2024-01-31T05:05:52.552554+0000","last_became_peered":"2024-01-31T05:05:52.552554+0000","last_unstale":"2024-01-31T05:05:52.555481+0000","last_undegraded":"2024-01-31T05:05:52.555481+0000","last_fullsized":"2024-01-31T05:05:52.555481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:01:34.537402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.563784+0000","last_change":"2024-01-31T05:05:52.559893+0000","last_active":"2024-01-31T05:05:52.563784+0000","last_peered":"2024-01-31T05:05:52.563784+0000","last_clean":"2024-01-31T05:05:52.563784+0000","last_became_active":"2024-01-31T05:05:52.559609+0000","last_became_peered":"2024-01-31T05:05:52.559609+0000","last_unstale":"2024-01-31T05:05:52.563784+0000","last_undegraded":"2024-01-31T05:05:52.563784+0000","last_fullsized":"2024-01-31T05:05:52.563784+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:10:40.038041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.570020+0000","last_change":"2024-01-31T05:05:52.559701+0000","last_active":"2024-01-31T05:05:52.570020+0000","last_peered":"2024-01-31T05:05:52.570020+0000","last_clean":"2024-01-31T05:05:52.570020+0000","last_became_active":"2024-01-31T05:05:52.558557+0000","last_became_peered":"2024-01-31T05:05:52.558557+0000","last_unstale":"2024-01-31T05:05:52.570020+0000","last_undegraded":"2024-01-31T05:05:52.570020+0000","last_fullsized":"2024-01-31T05:05:52.570020+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:14:13.434484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.562571+0000","last_change":"2024-01-31T05:05:52.555793+0000","last_active":"2024-01-31T05:05:52.562571+0000","last_peered":"2024-01-31T05:05:52.562571+0000","last_clean":"2024-01-31T05:05:52.562571+0000","last_became_active":"2024-01-31T05:05:52.555510+0000","last_became_peered":"2024-01-31T05:05:52.555510+0000","last_unstale":"2024-01-31T05:05:52.562571+0000","last_undegraded":"2024-01-31T05:05:52.562571+0000","last_fullsized":"2024-01-31T05:05:52.562571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:23:51.862676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.574434+0000","last_change":"2024-01-31T05:05:52.572072+0000","last_active":"2024-01-31T05:05:52.574434+0000","last_peered":"2024-01-31T05:05:52.574434+0000","last_clean":"2024-01-31T05:05:52.574434+0000","last_became_active":"2024-01-31T05:05:52.571794+0000","last_became_peered":"2024-01-31T05:05:52.571794+0000","last_unstale":"2024-01-31T05:05:52.574434+0000","last_undegraded":"2024-01-31T05:05:52.574434+0000","last_fullsized":"2024-01-31T05:05:52.574434+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:44:01.953261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.556732+0000","last_change":"2024-01-31T05:05:52.551874+0000","last_active":"2024-01-31T05:05:52.556732+0000","last_peered":"2024-01-31T05:05:52.556732+0000","last_clean":"2024-01-31T05:05:52.556732+0000","last_became_active":"2024-01-31T05:05:52.551557+0000","last_became_peered":"2024-01-31T05:05:52.551557+0000","last_unstale":"2024-01-31T05:05:52.556732+0000","last_undegraded":"2024-01-31T05:05:52.556732+0000","last_fullsized":"2024-01-31T05:05:52.556732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:44:01.953261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.568184+0000","last_change":"2024-01-31T05:05:52.558617+0000","last_active":"2024-01-31T05:05:52.568184+0000","last_peered":"2024-01-31T05:05:52.568184+0000","last_clean":"2024-01-31T05:05:52.568184+0000","last_became_active":"2024-01-31T05:05:52.553767+0000","last_became_peered":"2024-01-31T05:05:52.553767+0000","last_unstale":"2024-01-31T05:05:52.568184+0000","last_undegraded":"2024-01-31T05:05:52.568184+0000","last_fullsized":"2024-01-31T05:05:52.568184+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:17:34.057258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.565988+0000","last_change":"2024-01-31T05:05:52.558015+0000","last_active":"2024-01-31T05:05:52.565988+0000","last_peered":"2024-01-31T05:05:52.565988+0000","last_clean":"2024-01-31T05:05:52.565988+0000","last_became_active":"2024-01-31T05:05:52.557736+0000","last_became_peered":"2024-01-31T05:05:52.557736+0000","last_unstale":"2024-01-31T05:05:52.565988+0000","last_undegraded":"2024-01-31T05:05:52.565988+0000","last_fullsized":"2024-01-31T05:05:52.565988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:48:59.722958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.574077+0000","last_change":"2024-01-31T05:05:52.571625+0000","last_active":"2024-01-31T05:05:52.574077+0000","last_peered":"2024-01-31T05:05:52.574077+0000","last_clean":"2024-01-31T05:05:52.574077+0000","last_became_active":"2024-01-31T05:05:52.571378+0000","last_became_peered":"2024-01-31T05:05:52.571378+0000","last_unstale":"2024-01-31T05:05:52.574077+0000","last_undegraded":"2024-01-31T05:05:52.574077+0000","last_fullsized":"2024-01-31T05:05:52.574077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:26:49.120234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.561557+0000","last_change":"2024-01-31T05:05:52.557731+0000","last_active":"2024-01-31T05:05:52.561557+0000","last_peered":"2024-01-31T05:05:52.561557+0000","last_clean":"2024-01-31T05:05:52.561557+0000","last_became_active":"2024-01-31T05:05:52.557465+0000","last_became_peered":"2024-01-31T05:05:52.557465+0000","last_unstale":"2024-01-31T05:05:52.561557+0000","last_undegraded":"2024-01-31T05:05:52.561557+0000","last_fullsized":"2024-01-31T05:05:52.561557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:42:19.034105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.570061+0000","last_change":"2024-01-31T05:05:52.562421+0000","last_active":"2024-01-31T05:05:52.570061+0000","last_peered":"2024-01-31T05:05:52.570061+0000","last_clean":"2024-01-31T05:05:52.570061+0000","last_became_active":"2024-01-31T05:05:52.560021+0000","last_became_peered":"2024-01-31T05:05:52.560021+0000","last_unstale":"2024-01-31T05:05:52.570061+0000","last_undegraded":"2024-01-31T05:05:52.570061+0000","last_fullsized":"2024-01-31T05:05:52.570061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:23:51.862676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.567448+0000","last_change":"2024-01-31T05:05:52.565675+0000","last_active":"2024-01-31T05:05:52.567448+0000","last_peered":"2024-01-31T05:05:52.567448+0000","last_clean":"2024-01-31T05:05:52.567448+0000","last_became_active":"2024-01-31T05:05:52.565433+0000","last_became_peered":"2024-01-31T05:05:52.565433+0000","last_unstale":"2024-01-31T05:05:52.567448+0000","last_undegraded":"2024-01-31T05:05:52.567448+0000","last_fullsized":"2024-01-31T05:05:52.567448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:14:13.434484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.567928+0000","last_change":"2024-01-31T05:05:52.566840+0000","last_active":"2024-01-31T05:05:52.567928+0000","last_peered":"2024-01-31T05:05:52.567928+0000","last_clean":"2024-01-31T05:05:52.567928+0000","last_became_active":"2024-01-31T05:05:52.566032+0000","last_became_peered":"2024-01-31T05:05:52.566032+0000","last_unstale":"2024-01-31T05:05:52.567928+0000","last_undegraded":"2024-01-31T05:05:52.567928+0000","last_fullsized":"2024-01-31T05:05:52.567928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:18:30.383860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.551266+0000","last_change":"2024-01-31T05:05:52.545509+0000","last_active":"2024-01-31T05:05:52.551266+0000","last_peered":"2024-01-31T05:05:52.551266+0000","last_clean":"2024-01-31T05:05:52.551266+0000","last_became_active":"2024-01-31T05:05:52.545059+0000","last_became_peered":"2024-01-31T05:05:52.545059+0000","last_unstale":"2024-01-31T05:05:52.551266+0000","last_undegraded":"2024-01-31T05:05:52.551266+0000","last_fullsized":"2024-01-31T05:05:52.551266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:47:54.618475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.563832+0000","last_change":"2024-01-31T05:05:52.561990+0000","last_active":"2024-01-31T05:05:52.563832+0000","last_peered":"2024-01-31T05:05:52.563832+0000","last_clean":"2024-01-31T05:05:52.563832+0000","last_became_active":"2024-01-31T05:05:52.561351+0000","last_became_peered":"2024-01-31T05:05:52.561351+0000","last_unstale":"2024-01-31T05:05:52.563832+0000","last_undegraded":"2024-01-31T05:05:52.563832+0000","last_fullsized":"2024-01-31T05:05:52.563832+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:26:10.263977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.552092+0000","last_change":"2024-01-31T05:05:52.545159+0000","last_active":"2024-01-31T05:05:52.552092+0000","last_peered":"2024-01-31T05:05:52.552092+0000","last_clean":"2024-01-31T05:05:52.552092+0000","last_became_active":"2024-01-31T05:05:52.544840+0000","last_became_peered":"2024-01-31T05:05:52.544840+0000","last_unstale":"2024-01-31T05:05:52.552092+0000","last_undegraded":"2024-01-31T05:05:52.552092+0000","last_fullsized":"2024-01-31T05:05:52.552092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:21:48.625977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.571147+0000","last_change":"2024-01-31T05:05:52.563342+0000","last_active":"2024-01-31T05:05:52.571147+0000","last_peered":"2024-01-31T05:05:52.571147+0000","last_clean":"2024-01-31T05:05:52.571147+0000","last_became_active":"2024-01-31T05:05:52.563052+0000","last_became_peered":"2024-01-31T05:05:52.563052+0000","last_unstale":"2024-01-31T05:05:52.571147+0000","last_undegraded":"2024-01-31T05:05:52.571147+0000","last_fullsized":"2024-01-31T05:05:52.571147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:10:29.643921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.561538+0000","last_change":"2024-01-31T05:05:52.554114+0000","last_active":"2024-01-31T05:05:52.561538+0000","last_peered":"2024-01-31T05:05:52.561538+0000","last_clean":"2024-01-31T05:05:52.561538+0000","last_became_active":"2024-01-31T05:05:52.553626+0000","last_became_peered":"2024-01-31T05:05:52.553626+0000","last_unstale":"2024-01-31T05:05:52.561538+0000","last_undegraded":"2024-01-31T05:05:52.561538+0000","last_fullsized":"2024-01-31T05:05:52.561538+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:47:04.541569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.566170+0000","last_change":"2024-01-31T05:05:52.562872+0000","last_active":"2024-01-31T05:05:52.566170+0000","last_peered":"2024-01-31T05:05:52.566170+0000","last_clean":"2024-01-31T05:05:52.566170+0000","last_became_active":"2024-01-31T05:05:52.562626+0000","last_became_peered":"2024-01-31T05:05:52.562626+0000","last_unstale":"2024-01-31T05:05:52.566170+0000","last_undegraded":"2024-01-31T05:05:52.566170+0000","last_fullsized":"2024-01-31T05:05:52.566170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:44:01.953261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.552374+0000","last_change":"2024-01-31T05:05:52.547687+0000","last_active":"2024-01-31T05:05:52.552374+0000","last_peered":"2024-01-31T05:05:52.552374+0000","last_clean":"2024-01-31T05:05:52.552374+0000","last_became_active":"2024-01-31T05:05:52.547416+0000","last_became_peered":"2024-01-31T05:05:52.547416+0000","last_unstale":"2024-01-31T05:05:52.552374+0000","last_undegraded":"2024-01-31T05:05:52.552374+0000","last_fullsized":"2024-01-31T05:05:52.552374+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:29:28.284780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.565206+0000","last_change":"2024-01-31T05:05:52.560297+0000","last_active":"2024-01-31T05:05:52.565206+0000","last_peered":"2024-01-31T05:05:52.565206+0000","last_clean":"2024-01-31T05:05:52.565206+0000","last_became_active":"2024-01-31T05:05:52.560040+0000","last_became_peered":"2024-01-31T05:05:52.560040+0000","last_unstale":"2024-01-31T05:05:52.565206+0000","last_undegraded":"2024-01-31T05:05:52.565206+0000","last_fullsized":"2024-01-31T05:05:52.565206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:13:09.889939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.567955+0000","last_change":"2024-01-31T05:05:52.560063+0000","last_active":"2024-01-31T05:05:52.567955+0000","last_peered":"2024-01-31T05:05:52.567955+0000","last_clean":"2024-01-31T05:05:52.567955+0000","last_became_active":"2024-01-31T05:05:52.559768+0000","last_became_peered":"2024-01-31T05:05:52.559768+0000","last_unstale":"2024-01-31T05:05:52.567955+0000","last_undegraded":"2024-01-31T05:05:52.567955+0000","last_fullsized":"2024-01-31T05:05:52.567955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:23:38.818374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.552806+0000","last_change":"2024-01-31T05:05:52.545649+0000","last_active":"2024-01-31T05:05:52.552806+0000","last_peered":"2024-01-31T05:05:52.552806+0000","last_clean":"2024-01-31T05:05:52.552806+0000","last_became_active":"2024-01-31T05:05:52.545332+0000","last_became_peered":"2024-01-31T05:05:52.545332+0000","last_unstale":"2024-01-31T05:05:52.552806+0000","last_undegraded":"2024-01-31T05:05:52.552806+0000","last_fullsized":"2024-01-31T05:05:52.552806+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:40:06.401580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.570952+0000","last_change":"2024-01-31T05:05:52.567823+0000","last_active":"2024-01-31T05:05:52.570952+0000","last_peered":"2024-01-31T05:05:52.570952+0000","last_clean":"2024-01-31T05:05:52.570952+0000","last_became_active":"2024-01-31T05:05:52.567541+0000","last_became_peered":"2024-01-31T05:05:52.567541+0000","last_unstale":"2024-01-31T05:05:52.570952+0000","last_undegraded":"2024-01-31T05:05:52.570952+0000","last_fullsized":"2024-01-31T05:05:52.570952+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:20:50.460982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.565374+0000","last_change":"2024-01-31T05:05:52.561277+0000","last_active":"2024-01-31T05:05:52.565374+0000","last_peered":"2024-01-31T05:05:52.565374+0000","last_clean":"2024-01-31T05:05:52.565374+0000","last_became_active":"2024-01-31T05:05:52.559801+0000","last_became_peered":"2024-01-31T05:05:52.559801+0000","last_unstale":"2024-01-31T05:05:52.565374+0000","last_undegraded":"2024-01-31T05:05:52.565374+0000","last_fullsized":"2024-01-31T05:05:52.565374+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:30.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.557010+0000","last_change":"2024-01-31T05:05:52.547660+0000","last_active":"2024-01-31T05:05:52.557010+0000","last_peered":"2024-01-31T05:05:52.557010+0000","last_clean":"2024-01-31T05:05:52.557010+0000","last_became_active":"2024-01-31T05:05:52.546767+0000","last_became_peered":"2024-01-31T05:05:52.546767+0000","last_unstale":"2024-01-31T05:05:52.557010+0000","last_undegraded":"2024-01-31T05:05:52.557010+0000","last_fullsized":"2024-01-31T05:05:52.557010+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:07:55.928453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.566413+0000","last_change":"2024-01-31T05:05:52.564540+0000","last_active":"2024-01-31T05:05:52.566413+0000","last_peered":"2024-01-31T05:05:52.566413+0000","last_clean":"2024-01-31T05:05:52.566413+0000","last_became_active":"2024-01-31T05:05:52.564242+0000","last_became_peered":"2024-01-31T05:05:52.564242+0000","last_unstale":"2024-01-31T05:05:52.566413+0000","last_undegraded":"2024-01-31T05:05:52.566413+0000","last_fullsized":"2024-01-31T05:05:52.566413+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:17:34.057258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.556734+0000","last_change":"2024-01-31T05:05:52.553526+0000","last_active":"2024-01-31T05:05:52.556734+0000","last_peered":"2024-01-31T05:05:52.556734+0000","last_clean":"2024-01-31T05:05:52.556734+0000","last_became_active":"2024-01-31T05:05:52.553324+0000","last_became_peered":"2024-01-31T05:05:52.553324+0000","last_unstale":"2024-01-31T05:05:52.556734+0000","last_undegraded":"2024-01-31T05:05:52.556734+0000","last_fullsized":"2024-01-31T05:05:52.556734+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:17:35.807352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.566345+0000","last_change":"2024-01-31T05:05:52.563602+0000","last_active":"2024-01-31T05:05:52.566345+0000","last_peered":"2024-01-31T05:05:52.566345+0000","last_clean":"2024-01-31T05:05:52.566345+0000","last_became_active":"2024-01-31T05:05:52.563342+0000","last_became_peered":"2024-01-31T05:05:52.563342+0000","last_unstale":"2024-01-31T05:05:52.566345+0000","last_undegraded":"2024-01-31T05:05:52.566345+0000","last_fullsized":"2024-01-31T05:05:52.566345+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:43:57.088926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.566588+0000","last_change":"2024-01-31T05:05:51.545174+0000","last_active":"2024-01-31T05:05:52.566588+0000","last_peered":"2024-01-31T05:05:52.566588+0000","last_clean":"2024-01-31T05:05:52.566588+0000","last_became_active":"2024-01-31T05:05:51.544909+0000","last_became_peered":"2024-01-31T05:05:51.544909+0000","last_unstale":"2024-01-31T05:05:52.566588+0000","last_undegraded":"2024-01-31T05:05:52.566588+0000","last_fullsized":"2024-01-31T05:05:52.566588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:45:59.996998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.568320+0000","last_change":"2024-01-31T05:05:52.560872+0000","last_active":"2024-01-31T05:05:52.568320+0000","last_peered":"2024-01-31T05:05:52.568320+0000","last_clean":"2024-01-31T05:05:52.568320+0000","last_became_active":"2024-01-31T05:05:52.560422+0000","last_became_peered":"2024-01-31T05:05:52.560422+0000","last_unstale":"2024-01-31T05:05:52.568320+0000","last_undegraded":"2024-01-31T05:05:52.568320+0000","last_fullsized":"2024-01-31T05:05:52.568320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:44:01.953261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.571573+0000","last_change":"2024-01-31T05:05:51.543042+0000","last_active":"2024-01-31T05:05:52.571573+0000","last_peered":"2024-01-31T05:05:52.571573+0000","last_clean":"2024-01-31T05:05:52.571573+0000","last_became_active":"2024-01-31T05:05:51.542795+0000","last_became_peered":"2024-01-31T05:05:51.542795+0000","last_unstale":"2024-01-31T05:05:52.571573+0000","last_undegraded":"2024-01-31T05:05:52.571573+0000","last_fullsized":"2024-01-31T05:05:52.571573+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:29.957757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.556534+0000","last_change":"2024-01-31T05:05:52.553174+0000","last_active":"2024-01-31T05:05:52.556534+0000","last_peered":"2024-01-31T05:05:52.556534+0000","last_clean":"2024-01-31T05:05:52.556534+0000","last_became_active":"2024-01-31T05:05:52.552889+0000","last_became_peered":"2024-01-31T05:05:52.552889+0000","last_unstale":"2024-01-31T05:05:52.556534+0000","last_undegraded":"2024-01-31T05:05:52.556534+0000","last_fullsized":"2024-01-31T05:05:52.556534+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:50:36.699719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.562648+0000","last_change":"2024-01-31T05:05:51.545410+0000","last_active":"2024-01-31T05:05:52.562648+0000","last_peered":"2024-01-31T05:05:52.562648+0000","last_clean":"2024-01-31T05:05:52.562648+0000","last_became_active":"2024-01-31T05:05:51.543715+0000","last_became_peered":"2024-01-31T05:05:51.543715+0000","last_unstale":"2024-01-31T05:05:52.562648+0000","last_undegraded":"2024-01-31T05:05:52.562648+0000","last_fullsized":"2024-01-31T05:05:52.562648+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:50:35.694344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.562271+0000","last_change":"2024-01-31T05:05:52.553150+0000","last_active":"2024-01-31T05:05:52.562271+0000","last_peered":"2024-01-31T05:05:52.562271+0000","last_clean":"2024-01-31T05:05:52.562271+0000","last_became_active":"2024-01-31T05:05:52.552900+0000","last_became_peered":"2024-01-31T05:05:52.552900+0000","last_unstale":"2024-01-31T05:05:52.562271+0000","last_undegraded":"2024-01-31T05:05:52.562271+0000","last_fullsized":"2024-01-31T05:05:52.562271+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:18:30.383860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.567450+0000","last_change":"2024-01-31T05:05:51.534012+0000","last_active":"2024-01-31T05:05:52.567450+0000","last_peered":"2024-01-31T05:05:52.567450+0000","last_clean":"2024-01-31T05:05:52.567450+0000","last_became_active":"2024-01-31T05:05:51.533675+0000","last_became_peered":"2024-01-31T05:05:51.533675+0000","last_unstale":"2024-01-31T05:05:52.567450+0000","last_undegraded":"2024-01-31T05:05:52.567450+0000","last_fullsized":"2024-01-31T05:05:52.567450+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:40:05.396206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.572343+0000","last_change":"2024-01-31T05:05:52.562159+0000","last_active":"2024-01-31T05:05:52.572343+0000","last_peered":"2024-01-31T05:05:52.572343+0000","last_clean":"2024-01-31T05:05:52.572343+0000","last_became_active":"2024-01-31T05:05:52.561543+0000","last_became_peered":"2024-01-31T05:05:52.561543+0000","last_unstale":"2024-01-31T05:05:52.572343+0000","last_undegraded":"2024-01-31T05:05:52.572343+0000","last_fullsized":"2024-01-31T05:05:52.572343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:50:36.699719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.574072+0000","last_change":"2024-01-31T05:05:51.545648+0000","last_active":"2024-01-31T05:05:52.574072+0000","last_peered":"2024-01-31T05:05:52.574072+0000","last_clean":"2024-01-31T05:05:52.574072+0000","last_became_active":"2024-01-31T05:05:51.545383+0000","last_became_peered":"2024-01-31T05:05:51.545383+0000","last_unstale":"2024-01-31T05:05:52.574072+0000","last_undegraded":"2024-01-31T05:05:52.574072+0000","last_fullsized":"2024-01-31T05:05:52.574072+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:17:34.801978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.570041+0000","last_change":"2024-01-31T05:05:52.562220+0000","last_active":"2024-01-31T05:05:52.570041+0000","last_peered":"2024-01-31T05:05:52.570041+0000","last_clean":"2024-01-31T05:05:52.570041+0000","last_became_active":"2024-01-31T05:05:52.560339+0000","last_became_peered":"2024-01-31T05:05:52.560339+0000","last_unstale":"2024-01-31T05:05:52.570041+0000","last_undegraded":"2024-01-31T05:05:52.570041+0000","last_fullsized":"2024-01-31T05:05:52.570041+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:18:30.383860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.568215+0000","last_change":"2024-01-31T05:05:51.545752+0000","last_active":"2024-01-31T05:05:52.568215+0000","last_peered":"2024-01-31T05:05:52.568215+0000","last_clean":"2024-01-31T05:05:52.568215+0000","last_became_active":"2024-01-31T05:05:51.545509+0000","last_became_peered":"2024-01-31T05:05:51.545509+0000","last_unstale":"2024-01-31T05:05:52.568215+0000","last_undegraded":"2024-01-31T05:05:52.568215+0000","last_fullsized":"2024-01-31T05:05:52.568215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:29.957757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.556548+0000","last_change":"2024-01-31T05:05:52.553904+0000","last_active":"2024-01-31T05:05:52.556548+0000","last_peered":"2024-01-31T05:05:52.556548+0000","last_clean":"2024-01-31T05:05:52.556548+0000","last_became_active":"2024-01-31T05:05:52.553285+0000","last_became_peered":"2024-01-31T05:05:52.553285+0000","last_unstale":"2024-01-31T05:05:52.556548+0000","last_undegraded":"2024-01-31T05:05:52.556548+0000","last_fullsized":"2024-01-31T05:05:52.556548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:17:35.807352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.541695+0000","last_change":"2024-01-31T05:05:51.543708+0000","last_active":"2024-01-31T05:05:52.541695+0000","last_peered":"2024-01-31T05:05:52.541695+0000","last_clean":"2024-01-31T05:05:52.541695+0000","last_became_active":"2024-01-31T05:05:51.543389+0000","last_became_peered":"2024-01-31T05:05:51.543389+0000","last_unstale":"2024-01-31T05:05:52.541695+0000","last_undegraded":"2024-01-31T05:05:52.541695+0000","last_fullsized":"2024-01-31T05:05:52.541695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:13:08.884565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.565734+0000","last_change":"2024-01-31T05:05:52.549165+0000","last_active":"2024-01-31T05:05:52.565734+0000","last_peered":"2024-01-31T05:05:52.565734+0000","last_clean":"2024-01-31T05:05:52.565734+0000","last_became_active":"2024-01-31T05:05:52.548644+0000","last_became_peered":"2024-01-31T05:05:52.548644+0000","last_unstale":"2024-01-31T05:05:52.565734+0000","last_undegraded":"2024-01-31T05:05:52.565734+0000","last_fullsized":"2024-01-31T05:05:52.565734+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:17:34.057258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.536701+0000","last_change":"2024-01-31T05:05:51.542192+0000","last_active":"2024-01-31T05:05:52.536701+0000","last_peered":"2024-01-31T05:05:52.536701+0000","last_clean":"2024-01-31T05:05:52.536701+0000","last_became_active":"2024-01-31T05:05:51.541907+0000","last_became_peered":"2024-01-31T05:05:51.541907+0000","last_unstale":"2024-01-31T05:05:52.536701+0000","last_undegraded":"2024-01-31T05:05:52.536701+0000","last_fullsized":"2024-01-31T05:05:52.536701+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:07:54.923079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.556333+0000","last_change":"2024-01-31T05:05:52.551766+0000","last_active":"2024-01-31T05:05:52.556333+0000","last_peered":"2024-01-31T05:05:52.556333+0000","last_clean":"2024-01-31T05:05:52.556333+0000","last_became_active":"2024-01-31T05:05:52.551115+0000","last_became_peered":"2024-01-31T05:05:52.551115+0000","last_unstale":"2024-01-31T05:05:52.556333+0000","last_undegraded":"2024-01-31T05:05:52.556333+0000","last_fullsized":"2024-01-31T05:05:52.556333+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:38:25.209495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.534191+0000","last_change":"2024-01-31T05:05:51.540984+0000","last_active":"2024-01-31T05:05:52.534191+0000","last_peered":"2024-01-31T05:05:52.534191+0000","last_clean":"2024-01-31T05:05:52.534191+0000","last_became_active":"2024-01-31T05:05:51.540649+0000","last_became_peered":"2024-01-31T05:05:51.540649+0000","last_unstale":"2024-01-31T05:05:52.534191+0000","last_undegraded":"2024-01-31T05:05:52.534191+0000","last_fullsized":"2024-01-31T05:05:52.534191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:10:39.032667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.565974+0000","last_change":"2024-01-31T05:05:52.562217+0000","last_active":"2024-01-31T05:05:52.565974+0000","last_peered":"2024-01-31T05:05:52.565974+0000","last_clean":"2024-01-31T05:05:52.565974+0000","last_became_active":"2024-01-31T05:05:52.561309+0000","last_became_peered":"2024-01-31T05:05:52.561309+0000","last_unstale":"2024-01-31T05:05:52.565974+0000","last_undegraded":"2024-01-31T05:05:52.565974+0000","last_fullsized":"2024-01-31T05:05:52.565974+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:10:40.038041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.546357+0000","last_change":"2024-01-31T05:05:51.548525+0000","last_active":"2024-01-31T05:05:52.546357+0000","last_peered":"2024-01-31T05:05:52.546357+0000","last_clean":"2024-01-31T05:05:52.546357+0000","last_became_active":"2024-01-31T05:05:51.547898+0000","last_became_peered":"2024-01-31T05:05:51.547898+0000","last_unstale":"2024-01-31T05:05:52.546357+0000","last_undegraded":"2024-01-31T05:05:52.546357+0000","last_fullsized":"2024-01-31T05:05:52.546357+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:42:18.028731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.572953+0000","last_change":"2024-01-31T05:05:52.563673+0000","last_active":"2024-01-31T05:05:52.572953+0000","last_peered":"2024-01-31T05:05:52.572953+0000","last_clean":"2024-01-31T05:05:52.572953+0000","last_became_active":"2024-01-31T05:05:52.563373+0000","last_became_peered":"2024-01-31T05:05:52.563373+0000","last_unstale":"2024-01-31T05:05:52.572953+0000","last_undegraded":"2024-01-31T05:05:52.572953+0000","last_fullsized":"2024-01-31T05:05:52.572953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:47:04.541569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.575896+0000","last_change":"2024-01-31T05:05:51.547453+0000","last_active":"2024-01-31T05:05:52.575896+0000","last_peered":"2024-01-31T05:05:52.575896+0000","last_clean":"2024-01-31T05:05:52.575896+0000","last_became_active":"2024-01-31T05:05:51.547208+0000","last_became_peered":"2024-01-31T05:05:51.547208+0000","last_unstale":"2024-01-31T05:05:52.575896+0000","last_undegraded":"2024-01-31T05:05:52.575896+0000","last_fullsized":"2024-01-31T05:05:52.575896+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:47:03.536195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.556441+0000","last_change":"2024-01-31T05:05:52.551949+0000","last_active":"2024-01-31T05:05:52.556441+0000","last_peered":"2024-01-31T05:05:52.556441+0000","last_clean":"2024-01-31T05:05:52.556441+0000","last_became_active":"2024-01-31T05:05:52.550845+0000","last_became_peered":"2024-01-31T05:05:52.550845+0000","last_unstale":"2024-01-31T05:05:52.556441+0000","last_undegraded":"2024-01-31T05:05:52.556441+0000","last_fullsized":"2024-01-31T05:05:52.556441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:48:59.722958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.576413+0000","last_change":"2024-01-31T05:05:51.539521+0000","last_active":"2024-01-31T05:05:52.576413+0000","last_peered":"2024-01-31T05:05:52.576413+0000","last_clean":"2024-01-31T05:05:52.576413+0000","last_became_active":"2024-01-31T05:05:51.539251+0000","last_became_peered":"2024-01-31T05:05:51.539251+0000","last_unstale":"2024-01-31T05:05:52.576413+0000","last_undegraded":"2024-01-31T05:05:52.576413+0000","last_fullsized":"2024-01-31T05:05:52.576413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:42:18.028731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.572363+0000","last_change":"2024-01-31T05:05:52.562388+0000","last_active":"2024-01-31T05:05:52.572363+0000","last_peered":"2024-01-31T05:05:52.572363+0000","last_clean":"2024-01-31T05:05:52.572363+0000","last_became_active":"2024-01-31T05:05:52.561906+0000","last_became_peered":"2024-01-31T05:05:52.561906+0000","last_unstale":"2024-01-31T05:05:52.572363+0000","last_undegraded":"2024-01-31T05:05:52.572363+0000","last_fullsized":"2024-01-31T05:05:52.572363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:17:35.807352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.572550+0000","last_change":"2024-01-31T05:05:51.542880+0000","last_active":"2024-01-31T05:05:52.572550+0000","last_peered":"2024-01-31T05:05:52.572550+0000","last_clean":"2024-01-31T05:05:52.572550+0000","last_became_active":"2024-01-31T05:05:51.542495+0000","last_became_peered":"2024-01-31T05:05:51.542495+0000","last_unstale":"2024-01-31T05:05:52.572550+0000","last_undegraded":"2024-01-31T05:05:52.572550+0000","last_fullsized":"2024-01-31T05:05:52.572550+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:47:03.536195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.569102+0000","last_change":"2024-01-31T05:05:52.561017+0000","last_active":"2024-01-31T05:05:52.569102+0000","last_peered":"2024-01-31T05:05:52.569102+0000","last_clean":"2024-01-31T05:05:52.569102+0000","last_became_active":"2024-01-31T05:05:52.560714+0000","last_became_peered":"2024-01-31T05:05:52.560714+0000","last_unstale":"2024-01-31T05:05:52.569102+0000","last_undegraded":"2024-01-31T05:05:52.569102+0000","last_fullsized":"2024-01-31T05:05:52.569102+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:10:29.643921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.542582+0000","last_change":"2024-01-31T05:05:51.548598+0000","last_active":"2024-01-31T05:05:52.542582+0000","last_peered":"2024-01-31T05:05:52.542582+0000","last_clean":"2024-01-31T05:05:52.542582+0000","last_became_active":"2024-01-31T05:05:51.548279+0000","last_became_peered":"2024-01-31T05:05:51.548279+0000","last_unstale":"2024-01-31T05:05:52.542582+0000","last_undegraded":"2024-01-31T05:05:52.542582+0000","last_fullsized":"2024-01-31T05:05:52.542582+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:29.957757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.560982+0000","last_change":"2024-01-31T05:05:52.556796+0000","last_active":"2024-01-31T05:05:52.560982+0000","last_peered":"2024-01-31T05:05:52.560982+0000","last_clean":"2024-01-31T05:05:52.560982+0000","last_became_active":"2024-01-31T05:05:52.556548+0000","last_became_peered":"2024-01-31T05:05:52.556548+0000","last_unstale":"2024-01-31T05:05:52.560982+0000","last_undegraded":"2024-01-31T05:05:52.560982+0000","last_fullsized":"2024-01-31T05:05:52.560982+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:42:19.034105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.532255+0000","last_change":"2024-01-31T05:05:51.543348+0000","last_active":"2024-01-31T05:05:52.532255+0000","last_peered":"2024-01-31T05:05:52.532255+0000","last_clean":"2024-01-31T05:05:52.532255+0000","last_became_active":"2024-01-31T05:05:51.543102+0000","last_became_peered":"2024-01-31T05:05:51.543102+0000","last_unstale":"2024-01-31T05:05:52.532255+0000","last_undegraded":"2024-01-31T05:05:52.532255+0000","last_fullsized":"2024-01-31T05:05:52.532255+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:26:09.258603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.570331+0000","last_change":"2024-01-31T05:05:52.565862+0000","last_active":"2024-01-31T05:05:52.570331+0000","last_peered":"2024-01-31T05:05:52.570331+0000","last_clean":"2024-01-31T05:05:52.570331+0000","last_became_active":"2024-01-31T05:05:52.565507+0000","last_became_peered":"2024-01-31T05:05:52.565507+0000","last_unstale":"2024-01-31T05:05:52.570331+0000","last_undegraded":"2024-01-31T05:05:52.570331+0000","last_fullsized":"2024-01-31T05:05:52.570331+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:25:11.335020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.573638+0000","last_change":"2024-01-31T05:05:51.546452+0000","last_active":"2024-01-31T05:05:52.573638+0000","last_peered":"2024-01-31T05:05:52.573638+0000","last_clean":"2024-01-31T05:05:52.573638+0000","last_became_active":"2024-01-31T05:05:51.546184+0000","last_became_peered":"2024-01-31T05:05:51.546184+0000","last_unstale":"2024-01-31T05:05:52.573638+0000","last_undegraded":"2024-01-31T05:05:52.573638+0000","last_fullsized":"2024-01-31T05:05:52.573638+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:13:08.884565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.540010+0000","last_change":"2024-01-31T05:05:52.536384+0000","last_active":"2024-01-31T05:05:52.540010+0000","last_peered":"2024-01-31T05:05:52.540010+0000","last_clean":"2024-01-31T05:05:52.540010+0000","last_became_active":"2024-01-31T05:05:52.536061+0000","last_became_peered":"2024-01-31T05:05:52.536061+0000","last_unstale":"2024-01-31T05:05:52.540010+0000","last_undegraded":"2024-01-31T05:05:52.540010+0000","last_fullsized":"2024-01-31T05:05:52.540010+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:23:38.818374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.574150+0000","last_change":"2024-01-31T05:05:51.543477+0000","last_active":"2024-01-31T05:05:52.574150+0000","last_peered":"2024-01-31T05:05:52.574150+0000","last_clean":"2024-01-31T05:05:52.574150+0000","last_became_active":"2024-01-31T05:05:51.542322+0000","last_became_peered":"2024-01-31T05:05:51.542322+0000","last_unstale":"2024-01-31T05:05:52.574150+0000","last_undegraded":"2024-01-31T05:05:52.574150+0000","last_fullsized":"2024-01-31T05:05:52.574150+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:10:39.032667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.571559+0000","last_change":"2024-01-31T05:05:52.564303+0000","last_active":"2024-01-31T05:05:52.571559+0000","last_peered":"2024-01-31T05:05:52.571559+0000","last_clean":"2024-01-31T05:05:52.571559+0000","last_became_active":"2024-01-31T05:05:52.563928+0000","last_became_peered":"2024-01-31T05:05:52.563928+0000","last_unstale":"2024-01-31T05:05:52.571559+0000","last_undegraded":"2024-01-31T05:05:52.571559+0000","last_fullsized":"2024-01-31T05:05:52.571559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:10:10.336827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.571028+0000","last_change":"2024-01-31T05:05:51.543419+0000","last_active":"2024-01-31T05:05:52.571028+0000","last_peered":"2024-01-31T05:05:52.571028+0000","last_clean":"2024-01-31T05:05:52.571028+0000","last_became_active":"2024-01-31T05:05:51.542281+0000","last_became_peered":"2024-01-31T05:05:51.542281+0000","last_unstale":"2024-01-31T05:05:52.571028+0000","last_undegraded":"2024-01-31T05:05:52.571028+0000","last_fullsized":"2024-01-31T05:05:52.571028+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:13:08.884565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.556507+0000","last_change":"2024-01-31T05:05:52.551707+0000","last_active":"2024-01-31T05:05:52.556507+0000","last_peered":"2024-01-31T05:05:52.556507+0000","last_clean":"2024-01-31T05:05:52.556507+0000","last_became_active":"2024-01-31T05:05:52.551202+0000","last_became_peered":"2024-01-31T05:05:52.551202+0000","last_unstale":"2024-01-31T05:05:52.556507+0000","last_undegraded":"2024-01-31T05:05:52.556507+0000","last_fullsized":"2024-01-31T05:05:52.556507+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:30.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.564926+0000","last_change":"2024-01-31T05:05:51.537473+0000","last_active":"2024-01-31T05:05:52.564926+0000","last_peered":"2024-01-31T05:05:52.564926+0000","last_clean":"2024-01-31T05:05:52.564926+0000","last_became_active":"2024-01-31T05:05:51.537163+0000","last_became_peered":"2024-01-31T05:05:51.537163+0000","last_unstale":"2024-01-31T05:05:52.564926+0000","last_undegraded":"2024-01-31T05:05:52.564926+0000","last_fullsized":"2024-01-31T05:05:52.564926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:22:29.294442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.551692+0000","last_change":"2024-01-31T05:05:52.544398+0000","last_active":"2024-01-31T05:05:52.551692+0000","last_peered":"2024-01-31T05:05:52.551692+0000","last_clean":"2024-01-31T05:05:52.551692+0000","last_became_active":"2024-01-31T05:05:52.543376+0000","last_became_peered":"2024-01-31T05:05:52.543376+0000","last_unstale":"2024-01-31T05:05:52.551692+0000","last_undegraded":"2024-01-31T05:05:52.551692+0000","last_fullsized":"2024-01-31T05:05:52.551692+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:13:02.588265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.543399+0000","last_change":"2024-01-31T05:05:51.546897+0000","last_active":"2024-01-31T05:05:52.543399+0000","last_peered":"2024-01-31T05:05:52.543399+0000","last_clean":"2024-01-31T05:05:52.543399+0000","last_became_active":"2024-01-31T05:05:51.543189+0000","last_became_peered":"2024-01-31T05:05:51.543189+0000","last_unstale":"2024-01-31T05:05:52.543399+0000","last_undegraded":"2024-01-31T05:05:52.543399+0000","last_fullsized":"2024-01-31T05:05:52.543399+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:48:58.717584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.554251+0000","last_change":"2024-01-31T05:05:52.548026+0000","last_active":"2024-01-31T05:05:52.554251+0000","last_peered":"2024-01-31T05:05:52.554251+0000","last_clean":"2024-01-31T05:05:52.554251+0000","last_became_active":"2024-01-31T05:05:52.547699+0000","last_became_peered":"2024-01-31T05:05:52.547699+0000","last_unstale":"2024-01-31T05:05:52.554251+0000","last_undegraded":"2024-01-31T05:05:52.554251+0000","last_fullsized":"2024-01-31T05:05:52.554251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:17:35.807352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.569578+0000","last_change":"2024-01-31T05:05:51.538636+0000","last_active":"2024-01-31T05:05:52.569578+0000","last_peered":"2024-01-31T05:05:52.569578+0000","last_clean":"2024-01-31T05:05:52.569578+0000","last_became_active":"2024-01-31T05:05:51.538370+0000","last_became_peered":"2024-01-31T05:05:51.538370+0000","last_unstale":"2024-01-31T05:05:52.569578+0000","last_undegraded":"2024-01-31T05:05:52.569578+0000","last_fullsized":"2024-01-31T05:05:52.569578+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:57:30.464022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.572923+0000","last_change":"2024-01-31T05:05:52.563819+0000","last_active":"2024-01-31T05:05:52.572923+0000","last_peered":"2024-01-31T05:05:52.572923+0000","last_clean":"2024-01-31T05:05:52.572923+0000","last_became_active":"2024-01-31T05:05:52.563560+0000","last_became_peered":"2024-01-31T05:05:52.563560+0000","last_unstale":"2024-01-31T05:05:52.572923+0000","last_undegraded":"2024-01-31T05:05:52.572923+0000","last_fullsized":"2024-01-31T05:05:52.572923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:42:19.034105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.536919+0000","last_change":"2024-01-31T05:05:51.541692+0000","last_active":"2024-01-31T05:05:52.536919+0000","last_peered":"2024-01-31T05:05:52.536919+0000","last_clean":"2024-01-31T05:05:52.536919+0000","last_became_active":"2024-01-31T05:05:51.541169+0000","last_became_peered":"2024-01-31T05:05:51.541169+0000","last_unstale":"2024-01-31T05:05:52.536919+0000","last_undegraded":"2024-01-31T05:05:52.536919+0000","last_fullsized":"2024-01-31T05:05:52.536919+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:02:06.720451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.566796+0000","last_change":"2024-01-31T05:05:52.557814+0000","last_active":"2024-01-31T05:05:52.566796+0000","last_peered":"2024-01-31T05:05:52.566796+0000","last_clean":"2024-01-31T05:05:52.566796+0000","last_became_active":"2024-01-31T05:05:52.557563+0000","last_became_peered":"2024-01-31T05:05:52.557563+0000","last_unstale":"2024-01-31T05:05:52.566796+0000","last_undegraded":"2024-01-31T05:05:52.566796+0000","last_fullsized":"2024-01-31T05:05:52.566796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:43:57.088926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.538011+0000","last_change":"2024-01-31T05:05:51.546972+0000","last_active":"2024-01-31T05:05:52.538011+0000","last_peered":"2024-01-31T05:05:52.538011+0000","last_clean":"2024-01-31T05:05:52.538011+0000","last_became_active":"2024-01-31T05:05:51.546744+0000","last_became_peered":"2024-01-31T05:05:51.546744+0000","last_unstale":"2024-01-31T05:05:52.538011+0000","last_undegraded":"2024-01-31T05:05:52.538011+0000","last_fullsized":"2024-01-31T05:05:52.538011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:48:58.717584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.559714+0000","last_change":"2024-01-31T05:05:52.548921+0000","last_active":"2024-01-31T05:05:52.559714+0000","last_peered":"2024-01-31T05:05:52.559714+0000","last_clean":"2024-01-31T05:05:52.559714+0000","last_became_active":"2024-01-31T05:05:52.548300+0000","last_became_peered":"2024-01-31T05:05:52.548300+0000","last_unstale":"2024-01-31T05:05:52.559714+0000","last_undegraded":"2024-01-31T05:05:52.559714+0000","last_fullsized":"2024-01-31T05:05:52.559714+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:43:57.088926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.537445+0000","last_change":"2024-01-31T05:05:51.533426+0000","last_active":"2024-01-31T05:05:52.537445+0000","last_peered":"2024-01-31T05:05:52.537445+0000","last_clean":"2024-01-31T05:05:52.537445+0000","last_became_active":"2024-01-31T05:05:51.533147+0000","last_became_peered":"2024-01-31T05:05:51.533147+0000","last_unstale":"2024-01-31T05:05:52.537445+0000","last_undegraded":"2024-01-31T05:05:52.537445+0000","last_fullsized":"2024-01-31T05:05:52.537445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:07:09.983380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.561227+0000","last_change":"2024-01-31T05:05:52.557196+0000","last_active":"2024-01-31T05:05:52.561227+0000","last_peered":"2024-01-31T05:05:52.561227+0000","last_clean":"2024-01-31T05:05:52.561227+0000","last_became_active":"2024-01-31T05:05:52.556877+0000","last_became_peered":"2024-01-31T05:05:52.556877+0000","last_unstale":"2024-01-31T05:05:52.561227+0000","last_undegraded":"2024-01-31T05:05:52.561227+0000","last_fullsized":"2024-01-31T05:05:52.561227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:42:19.034105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.575887+0000","last_change":"2024-01-31T05:05:51.539850+0000","last_active":"2024-01-31T05:05:52.575887+0000","last_peered":"2024-01-31T05:05:52.575887+0000","last_clean":"2024-01-31T05:05:52.575887+0000","last_became_active":"2024-01-31T05:05:51.539574+0000","last_became_peered":"2024-01-31T05:05:51.539574+0000","last_unstale":"2024-01-31T05:05:52.575887+0000","last_undegraded":"2024-01-31T05:05:52.575887+0000","last_fullsized":"2024-01-31T05:05:52.575887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:23:37.813000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.565991+0000","last_change":"2024-01-31T05:05:52.562557+0000","last_active":"2024-01-31T05:05:52.565991+0000","last_peered":"2024-01-31T05:05:52.565991+0000","last_clean":"2024-01-31T05:05:52.565991+0000","last_became_active":"2024-01-31T05:05:52.562271+0000","last_became_peered":"2024-01-31T05:05:52.562271+0000","last_unstale":"2024-01-31T05:05:52.565991+0000","last_undegraded":"2024-01-31T05:05:52.565991+0000","last_fullsized":"2024-01-31T05:05:52.565991+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:23:38.818374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.538416+0000","last_change":"2024-01-31T05:05:51.542520+0000","last_active":"2024-01-31T05:05:52.538416+0000","last_peered":"2024-01-31T05:05:52.538416+0000","last_clean":"2024-01-31T05:05:52.538416+0000","last_became_active":"2024-01-31T05:05:51.542283+0000","last_became_peered":"2024-01-31T05:05:51.542283+0000","last_unstale":"2024-01-31T05:05:52.538416+0000","last_undegraded":"2024-01-31T05:05:52.538416+0000","last_fullsized":"2024-01-31T05:05:52.538416+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:16:11.328117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.560446+0000","last_change":"2024-01-31T05:05:52.550797+0000","last_active":"2024-01-31T05:05:52.560446+0000","last_peered":"2024-01-31T05:05:52.560446+0000","last_clean":"2024-01-31T05:05:52.560446+0000","last_became_active":"2024-01-31T05:05:52.550514+0000","last_became_peered":"2024-01-31T05:05:52.550514+0000","last_unstale":"2024-01-31T05:05:52.560446+0000","last_undegraded":"2024-01-31T05:05:52.560446+0000","last_fullsized":"2024-01-31T05:05:52.560446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:14:13.434484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.547328+0000","last_change":"2024-01-31T05:05:51.546917+0000","last_active":"2024-01-31T05:05:52.547328+0000","last_peered":"2024-01-31T05:05:52.547328+0000","last_clean":"2024-01-31T05:05:52.547328+0000","last_became_active":"2024-01-31T05:05:51.544374+0000","last_became_peered":"2024-01-31T05:05:51.544374+0000","last_unstale":"2024-01-31T05:05:52.547328+0000","last_undegraded":"2024-01-31T05:05:52.547328+0000","last_fullsized":"2024-01-31T05:05:52.547328+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:13:08.884565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.573644+0000","last_change":"2024-01-31T05:05:52.567345+0000","last_active":"2024-01-31T05:05:52.573644+0000","last_peered":"2024-01-31T05:05:52.573644+0000","last_clean":"2024-01-31T05:05:52.573644+0000","last_became_active":"2024-01-31T05:05:52.567093+0000","last_became_peered":"2024-01-31T05:05:52.567093+0000","last_unstale":"2024-01-31T05:05:52.573644+0000","last_undegraded":"2024-01-31T05:05:52.573644+0000","last_fullsized":"2024-01-31T05:05:52.573644+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:23:38.818374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.544763+0000","last_change":"2024-01-31T05:05:51.544009+0000","last_active":"2024-01-31T05:05:52.544763+0000","last_peered":"2024-01-31T05:05:52.544763+0000","last_clean":"2024-01-31T05:05:52.544763+0000","last_became_active":"2024-01-31T05:05:51.543761+0000","last_became_peered":"2024-01-31T05:05:51.543761+0000","last_unstale":"2024-01-31T05:05:52.544763+0000","last_undegraded":"2024-01-31T05:05:52.544763+0000","last_fullsized":"2024-01-31T05:05:52.544763+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:07:54.923079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.558042+0000","last_change":"2024-01-31T05:05:52.556888+0000","last_active":"2024-01-31T05:05:52.558042+0000","last_peered":"2024-01-31T05:05:52.558042+0000","last_clean":"2024-01-31T05:05:52.558042+0000","last_became_active":"2024-01-31T05:05:52.555676+0000","last_became_peered":"2024-01-31T05:05:52.555676+0000","last_unstale":"2024-01-31T05:05:52.558042+0000","last_undegraded":"2024-01-31T05:05:52.558042+0000","last_fullsized":"2024-01-31T05:05:52.558042+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:47:04.541569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.532149+0000","last_change":"2024-01-31T05:05:51.542060+0000","last_active":"2024-01-31T05:05:52.532149+0000","last_peered":"2024-01-31T05:05:52.532149+0000","last_clean":"2024-01-31T05:05:52.532149+0000","last_became_active":"2024-01-31T05:05:51.541786+0000","last_became_peered":"2024-01-31T05:05:51.541786+0000","last_unstale":"2024-01-31T05:05:52.532149+0000","last_undegraded":"2024-01-31T05:05:52.532149+0000","last_fullsized":"2024-01-31T05:05:52.532149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:43:52.482579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.562672+0000","last_change":"2024-01-31T05:05:52.560908+0000","last_active":"2024-01-31T05:05:52.562672+0000","last_peered":"2024-01-31T05:05:52.562672+0000","last_clean":"2024-01-31T05:05:52.562672+0000","last_became_active":"2024-01-31T05:05:52.560626+0000","last_became_peered":"2024-01-31T05:05:52.560626+0000","last_unstale":"2024-01-31T05:05:52.562672+0000","last_undegraded":"2024-01-31T05:05:52.562672+0000","last_fullsized":"2024-01-31T05:05:52.562672+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:10:40.038041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.536160+0000","last_change":"2024-01-31T05:05:51.535294+0000","last_active":"2024-01-31T05:05:52.536160+0000","last_peered":"2024-01-31T05:05:52.536160+0000","last_clean":"2024-01-31T05:05:52.536160+0000","last_became_active":"2024-01-31T05:05:51.533361+0000","last_became_peered":"2024-01-31T05:05:51.533361+0000","last_unstale":"2024-01-31T05:05:52.536160+0000","last_undegraded":"2024-01-31T05:05:52.536160+0000","last_fullsized":"2024-01-31T05:05:52.536160+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:47:53.613101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.554493+0000","last_change":"2024-01-31T05:05:52.553291+0000","last_active":"2024-01-31T05:05:52.554493+0000","last_peered":"2024-01-31T05:05:52.554493+0000","last_clean":"2024-01-31T05:05:52.554493+0000","last_became_active":"2024-01-31T05:05:52.553036+0000","last_became_peered":"2024-01-31T05:05:52.553036+0000","last_unstale":"2024-01-31T05:05:52.554493+0000","last_undegraded":"2024-01-31T05:05:52.554493+0000","last_fullsized":"2024-01-31T05:05:52.554493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:47:04.541569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.530892+0000","last_change":"2024-01-31T05:05:51.533572+0000","last_active":"2024-01-31T05:05:52.530892+0000","last_peered":"2024-01-31T05:05:52.530892+0000","last_clean":"2024-01-31T05:05:52.530892+0000","last_became_active":"2024-01-31T05:05:51.533321+0000","last_became_peered":"2024-01-31T05:05:51.533321+0000","last_unstale":"2024-01-31T05:05:52.530892+0000","last_undegraded":"2024-01-31T05:05:52.530892+0000","last_fullsized":"2024-01-31T05:05:52.530892+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:17:34.801978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.572089+0000","last_change":"2024-01-31T05:05:52.566281+0000","last_active":"2024-01-31T05:05:52.572089+0000","last_peered":"2024-01-31T05:05:52.572089+0000","last_clean":"2024-01-31T05:05:52.572089+0000","last_became_active":"2024-01-31T05:05:52.564253+0000","last_became_peered":"2024-01-31T05:05:52.564253+0000","last_unstale":"2024-01-31T05:05:52.572089+0000","last_undegraded":"2024-01-31T05:05:52.572089+0000","last_fullsized":"2024-01-31T05:05:52.572089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:25:11.335020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.541692+0000","last_change":"2024-01-31T05:05:51.545052+0000","last_active":"2024-01-31T05:05:52.541692+0000","last_peered":"2024-01-31T05:05:52.541692+0000","last_clean":"2024-01-31T05:05:52.541692+0000","last_became_active":"2024-01-31T05:05:51.542982+0000","last_became_peered":"2024-01-31T05:05:51.542982+0000","last_unstale":"2024-01-31T05:05:52.541692+0000","last_undegraded":"2024-01-31T05:05:52.541692+0000","last_fullsized":"2024-01-31T05:05:52.541692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:50:35.694344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":204,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.537146+0000","last_change":"2024-01-31T05:04:05.699222+0000","last_active":"2024-01-31T05:05:52.537146+0000","last_peered":"2024-01-31T05:05:52.537146+0000","last_clean":"2024-01-31T05:05:52.537146+0000","last_became_active":"2024-01-31T05:04:05.698239+0000","last_became_peered":"2024-01-31T05:04:05.698239+0000","last_unstale":"2024-01-31T05:05:52.537146+0000","last_undegraded":"2024-01-31T05:05:52.537146+0000","last_fullsized":"2024-01-31T05:05:52.537146+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_clean_scrub_stamp":"2024-01-31T05:04:04.484734+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:05:13.736598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1048576,"data_stored":779557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.877}]},{"osd":1,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.67300000000000004}]},{"osd":2,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.82299999999999995}]},{"osd":3,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.71199999999999997}]},{"osd":4,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.90800000000000003}]},{"osd":5,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.89300000000000002}]},{"osd":6,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.77500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":442368,"data_stored":188089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.64500000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.67900000000000005}]},{"osd":2,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.69699999999999995}]},{"osd":3,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.61399999999999999}]},{"osd":4,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.54900000000000004}]},{"osd":5,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.63100000000000001}]},{"osd":7,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.66800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":446464,"data_stored":187619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.72099999999999997}]},{"osd":1,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.78400000000000003}]},{"osd":2,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.63600000000000001}]},{"osd":3,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.74099999999999999}]},{"osd":4,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60499999999999998}]},{"osd":6,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.52400000000000002}]},{"osd":7,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.69899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":446464,"data_stored":188111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.76100000000000001}]},{"osd":1,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":2.0059999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.85699999999999998}]},{"osd":2,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.80200000000000005}]},{"osd":3,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":0.78100000000000003}]},{"osd":5,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.38300000000000001}]},{"osd":6,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.59399999999999997}]},{"osd":7,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.434},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":0.56399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":189153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.40999999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.318},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.46600000000000003}]},{"osd":2,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.498}]},{"osd":4,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.753},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.67300000000000004}]},{"osd":6,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.78800000000000003}]},{"osd":7,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.79800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":442368,"data_stored":187577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:05:07 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.46000000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:05:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Wed Jan 31 05:05:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.376},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.52900000000000003}]},{"osd":4,"last update":"Wed Jan 31 05:05:07 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.747},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.76200000000000001}]},{"osd":5,"last update":"Wed Jan 31 05:05:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.72499999999999998}]},{"osd":6,"last update":"Wed Jan 31 05:05:07 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.70899999999999996}]},{"osd":7,"last update":"Wed Jan 31 05:05:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.68700000000000006}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":442368,"data_stored":187597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":4.556,"5min":4.556,"15min":4.556},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.34599999999999997}]},{"osd":2,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":6.3129999999999997,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":4.2619999999999996,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.497}]},{"osd":3,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.351,"5min":3.351,"15min":3.351},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":5.9139999999999997,"5min":5.9139999999999997,"15min":5.9139999999999997},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":5.5599999999999996,"5min":5.5599999999999996,"15min":5.5599999999999996},"last":0.59199999999999997}]},{"osd":5,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":6.0190000000000001,"5min":6.0190000000000001,"15min":6.0190000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":4.0510000000000002,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.65600000000000003}]},{"osd":6,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":5.3620000000000001,"5min":5.3620000000000001,"15min":5.3620000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":3.7509999999999999,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.69599999999999995}]},{"osd":7,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":5.8109999999999999,"5min":5.8109999999999999,"15min":5.8109999999999999},"last":0.57799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1036288,"data_stored":777909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.307},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.47599999999999998}]},{"osd":2,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.33100000000000002}]},{"osd":3,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.497}]},{"osd":4,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.73799999999999999}]},{"osd":5,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.71799999999999997}]},{"osd":6,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.69699999999999995}]},{"osd":7,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.70899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-31T05:05:56.668 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-31T05:05:56.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.844+0000 7f4a16400640 1 Processor -- start 2024-01-31T05:05:56.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.844+0000 7f4a16400640 1 -- start start 2024-01-31T05:05:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.844+0000 7f4a16400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4a1015e7e0 0x7f4a100b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.844+0000 7f4a16400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4a100c63d0 0x7f4a100cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.844+0000 7f4a16400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a100cf8d0 con 0x7f4a100cf4a0 2024-01-31T05:05:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.844+0000 7f4a16400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a100d1d40 con 0x7f4a100c63d0 2024-01-31T05:05:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.844+0000 7f4a16400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a100c67f0 con 0x7f4a1015e7e0 2024-01-31T05:05:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.844+0000 7f4a0ea00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4a100c63d0 0x7f4a100cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:56.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.844+0000 7f4a0ea00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f4a100c63d0 0x7f4a100cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33652/0 (socket says 172.21.15.49:33652) 2024-01-31T05:05:56.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.844+0000 7f4a0ea00640 1 -- 172.21.15.49:0/611778250 learned_addr learned my addr 172.21.15.49:0/611778250 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:56.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.844+0000 7f4a0f400640 1 --2- 172.21.15.49:0/611778250 >> v2:172.21.15.195:3300/0 conn(0x7f4a1015e7e0 0x7f4a100b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:56.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.844+0000 7f4a0ea00640 1 -- 172.21.15.49:0/611778250 >> v2:172.21.15.195:3300/0 conn(0x7f4a1015e7e0 msgr2=0x7f4a100b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:56.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.844+0000 7f4a0ea00640 1 --2- 172.21.15.49:0/611778250 >> v2:172.21.15.195:3300/0 conn(0x7f4a1015e7e0 0x7f4a100b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.844+0000 7f4a0ea00640 1 -- 172.21.15.49:0/611778250 >> v1:172.21.15.195:6789/0 conn(0x7f4a100cf4a0 legacy=0x7f4a100c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:56.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.844+0000 7f4a0ea00640 1 -- 172.21.15.49:0/611778250 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a100c6ab0 con 0x7f4a100c63d0 2024-01-31T05:05:56.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.848+0000 7f4a0ea00640 1 --2- 172.21.15.49:0/611778250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a100c63d0 0x7f4a100cef60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4a10066fb0 tx=0x7f49f801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f475713fc2ea4964 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:56.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.848+0000 7f4a0e000640 1 -- 172.21.15.49:0/611778250 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f80a89f0 con 0x7f4a100c63d0 2024-01-31T05:05:56.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.848+0000 7f4a0e000640 1 -- 172.21.15.49:0/611778250 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f80a8b50 con 0x7f4a100c63d0 2024-01-31T05:05:56.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.848+0000 7f4a0e000640 1 -- 172.21.15.49:0/611778250 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f80b0440 con 0x7f4a100c63d0 2024-01-31T05:05:56.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.848+0000 7f4a16400640 1 -- 172.21.15.49:0/611778250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a100c63d0 msgr2=0x7f4a100cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:56.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.848+0000 7f4a16400640 1 --2- 172.21.15.49:0/611778250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a100c63d0 0x7f4a100cef60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4a10066fb0 tx=0x7f49f801ecf0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.848+0000 7f4a16400640 1 -- 172.21.15.49:0/611778250 shutdown_connections 2024-01-31T05:05:56.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.848+0000 7f4a16400640 1 --2- 172.21.15.49:0/611778250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a100c63d0 0x7f4a100cef60 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.848+0000 7f4a16400640 1 --2- 172.21.15.49:0/611778250 >> v2:172.21.15.195:3300/0 conn(0x7f4a1015e7e0 0x7f4a100b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.848+0000 7f4a16400640 1 -- 172.21.15.49:0/611778250 >> 172.21.15.49:0/611778250 conn(0x7f4a100d0e60 msgr2=0x7f4a100d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:56.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.848+0000 7f4a16400640 1 -- 172.21.15.49:0/611778250 shutdown_connections 2024-01-31T05:05:56.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.848+0000 7f4a16400640 1 -- 172.21.15.49:0/611778250 wait complete. 2024-01-31T05:05:56.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a16400640 1 Processor -- start 2024-01-31T05:05:56.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a16400640 1 -- start start 2024-01-31T05:05:56.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a16400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a100c63d0 0x7f4a1015a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:56.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a16400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a100cf4a0 0x7f4a101f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:56.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a16400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a1015e7e0 0x7f4a10154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:56.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a16400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a100c7fd0 con 0x7f4a1015e7e0 2024-01-31T05:05:56.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a16400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a101f70d0 con 0x7f4a100cf4a0 2024-01-31T05:05:56.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a16400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a100c8270 con 0x7f4a100c63d0 2024-01-31T05:05:56.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a0fe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a1015e7e0 0x7f4a10154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:56.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a0fe00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a1015e7e0 0x7f4a10154390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33654/0 (socket says 172.21.15.49:33654) 2024-01-31T05:05:56.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a0fe00640 1 -- 172.21.15.49:0/2559699454 learned_addr learned my addr 172.21.15.49:0/2559699454 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:56.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a0f400640 1 --2- 172.21.15.49:0/2559699454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a100c63d0 0x7f4a1015a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:56.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a0ea00640 1 --2- 172.21.15.49:0/2559699454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a100cf4a0 0x7f4a101f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:56.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a0fe00640 1 -- 172.21.15.49:0/2559699454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a100c63d0 msgr2=0x7f4a1015a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:56.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a0fe00640 1 --2- 172.21.15.49:0/2559699454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a100c63d0 0x7f4a1015a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a0fe00640 1 -- 172.21.15.49:0/2559699454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a100cf4a0 msgr2=0x7f4a101f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:56.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a0fe00640 1 --2- 172.21.15.49:0/2559699454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a100cf4a0 0x7f4a101f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:56.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a0fe00640 1 -- 172.21.15.49:0/2559699454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f80094d0 con 0x7f4a1015e7e0 2024-01-31T05:05:56.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a0fe00640 1 --2- 172.21.15.49:0/2559699454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a1015e7e0 0x7f4a10154390 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800c770 tx=0x7f4a0800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:56.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a07400640 1 -- 172.21.15.49:0/2559699454 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a08003b80 con 0x7f4a1015e7e0 2024-01-31T05:05:56.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a07400640 1 -- 172.21.15.49:0/2559699454 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a08003ce0 con 0x7f4a1015e7e0 2024-01-31T05:05:56.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a07400640 1 -- 172.21.15.49:0/2559699454 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0800aa90 con 0x7f4a1015e7e0 2024-01-31T05:05:56.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a16400640 1 -- 172.21.15.49:0/2559699454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a100c8550 con 0x7f4a1015e7e0 2024-01-31T05:05:56.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.852+0000 7f4a16400640 1 -- 172.21.15.49:0/2559699454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a100c8b10 con 0x7f4a1015e7e0 2024-01-31T05:05:56.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.856+0000 7f4a16400640 1 -- 172.21.15.49:0/2559699454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a10067c80 con 0x7f4a1015e7e0 2024-01-31T05:05:56.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.856+0000 7f4a07400640 1 -- 172.21.15.49:0/2559699454 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f4a0800abf0 con 0x7f4a1015e7e0 2024-01-31T05:05:56.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.856+0000 7f4a07400640 1 --2- 172.21.15.49:0/2559699454 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f49e8066530 0x7f49e80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:56.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.856+0000 7f4a07400640 1 -- 172.21.15.49:0/2559699454 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4a08083cd0 con 0x7f4a1015e7e0 2024-01-31T05:05:56.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.856+0000 7f4a0f400640 1 --2- 172.21.15.49:0/2559699454 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f49e8066530 0x7f49e80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:56.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.856+0000 7f4a0f400640 1 --2- 172.21.15.49:0/2559699454 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f49e8066530 0x7f49e80689f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4a00006aa0 tx=0x7f4a00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:56.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:56.860+0000 7f4a07400640 1 -- 172.21.15.49:0/2559699454 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f4a08050ed0 con 0x7f4a1015e7e0 2024-01-31T05:05:57.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.016+0000 7f4a16400640 1 -- 172.21.15.49:0/2559699454 --> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4a100c7070 con 0x7f49e8066530 2024-01-31T05:05:57.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.024+0000 7f4a07400640 1 -- 172.21.15.49:0/2559699454 <== mgr.4100 v2:172.21.15.195:6832/3035808172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288999 (secure 0 0 0) 0x7f4a00004030 con 0x7f49e8066530 2024-01-31T05:05:57.029 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:57.031 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-31T05:05:57.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.028+0000 7f4a16400640 1 -- 172.21.15.49:0/2559699454 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f49e8066530 msgr2=0x7f49e80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:57.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.028+0000 7f4a16400640 1 --2- 172.21.15.49:0/2559699454 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f49e8066530 0x7f49e80689f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4a00006aa0 tx=0x7f4a00008040 comp rx=0 tx=0).stop 2024-01-31T05:05:57.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.028+0000 7f4a16400640 1 -- 172.21.15.49:0/2559699454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a1015e7e0 msgr2=0x7f4a10154390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:57.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.028+0000 7f4a16400640 1 --2- 172.21.15.49:0/2559699454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a1015e7e0 0x7f4a10154390 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800c770 tx=0x7f4a0800cc30 comp rx=0 tx=0).stop 2024-01-31T05:05:57.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.028+0000 7f4a16400640 1 -- 172.21.15.49:0/2559699454 shutdown_connections 2024-01-31T05:05:57.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.028+0000 7f4a16400640 1 --2- 172.21.15.49:0/2559699454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a1015e7e0 0x7f4a10154390 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.028+0000 7f4a16400640 1 --2- 172.21.15.49:0/2559699454 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f49e8066530 0x7f49e80689f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.028+0000 7f4a16400640 1 --2- 172.21.15.49:0/2559699454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a100cf4a0 0x7f4a101f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.028+0000 7f4a16400640 1 --2- 172.21.15.49:0/2559699454 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a100c63d0 0x7f4a1015a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.028+0000 7f4a16400640 1 -- 172.21.15.49:0/2559699454 >> 172.21.15.49:0/2559699454 conn(0x7f4a100d0e60 msgr2=0x7f4a100cec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:57.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.028+0000 7f4a16400640 1 -- 172.21.15.49:0/2559699454 shutdown_connections 2024-01-31T05:05:57.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.028+0000 7f4a16400640 1 -- 172.21.15.49:0/2559699454 wait complete. 2024-01-31T05:05:57.049 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-01-31T05:05:56.443121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254120,"kb_used_data":4648,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720600,"statfs":{"total":773094113280,"available":772833894400,"internally_reserved":0,"allocated":4759552,"data_stored":2685612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.925807"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.570575+0000","last_change":"2024-01-31T05:05:52.562389+0000","last_active":"2024-01-31T05:05:52.570575+0000","last_peered":"2024-01-31T05:05:52.570575+0000","last_clean":"2024-01-31T05:05:52.570575+0000","last_became_active":"2024-01-31T05:05:52.561022+0000","last_became_peered":"2024-01-31T05:05:52.561022+0000","last_unstale":"2024-01-31T05:05:52.570575+0000","last_undegraded":"2024-01-31T05:05:52.570575+0000","last_fullsized":"2024-01-31T05:05:52.570575+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:10:10.336827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.559710+0000","last_change":"2024-01-31T05:05:52.548780+0000","last_active":"2024-01-31T05:05:52.559710+0000","last_peered":"2024-01-31T05:05:52.559710+0000","last_clean":"2024-01-31T05:05:52.559710+0000","last_became_active":"2024-01-31T05:05:52.548449+0000","last_became_peered":"2024-01-31T05:05:52.548449+0000","last_unstale":"2024-01-31T05:05:52.559710+0000","last_undegraded":"2024-01-31T05:05:52.559710+0000","last_fullsized":"2024-01-31T05:05:52.559710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:44:01.953261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.573601+0000","last_change":"2024-01-31T05:05:52.563914+0000","last_active":"2024-01-31T05:05:52.573601+0000","last_peered":"2024-01-31T05:05:52.573601+0000","last_clean":"2024-01-31T05:05:52.573601+0000","last_became_active":"2024-01-31T05:05:52.562764+0000","last_became_peered":"2024-01-31T05:05:52.562764+0000","last_unstale":"2024-01-31T05:05:52.573601+0000","last_undegraded":"2024-01-31T05:05:52.573601+0000","last_fullsized":"2024-01-31T05:05:52.573601+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:10:40.038041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.557954+0000","last_change":"2024-01-31T05:05:52.551949+0000","last_active":"2024-01-31T05:05:52.557954+0000","last_peered":"2024-01-31T05:05:52.557954+0000","last_clean":"2024-01-31T05:05:52.557954+0000","last_became_active":"2024-01-31T05:05:52.551445+0000","last_became_peered":"2024-01-31T05:05:52.551445+0000","last_unstale":"2024-01-31T05:05:52.557954+0000","last_undegraded":"2024-01-31T05:05:52.557954+0000","last_fullsized":"2024-01-31T05:05:52.557954+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:43:53.487953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.555481+0000","last_change":"2024-01-31T05:05:52.552844+0000","last_active":"2024-01-31T05:05:52.555481+0000","last_peered":"2024-01-31T05:05:52.555481+0000","last_clean":"2024-01-31T05:05:52.555481+0000","last_became_active":"2024-01-31T05:05:52.552554+0000","last_became_peered":"2024-01-31T05:05:52.552554+0000","last_unstale":"2024-01-31T05:05:52.555481+0000","last_undegraded":"2024-01-31T05:05:52.555481+0000","last_fullsized":"2024-01-31T05:05:52.555481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:01:34.537402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.563784+0000","last_change":"2024-01-31T05:05:52.559893+0000","last_active":"2024-01-31T05:05:52.563784+0000","last_peered":"2024-01-31T05:05:52.563784+0000","last_clean":"2024-01-31T05:05:52.563784+0000","last_became_active":"2024-01-31T05:05:52.559609+0000","last_became_peered":"2024-01-31T05:05:52.559609+0000","last_unstale":"2024-01-31T05:05:52.563784+0000","last_undegraded":"2024-01-31T05:05:52.563784+0000","last_fullsized":"2024-01-31T05:05:52.563784+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:10:40.038041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.570020+0000","last_change":"2024-01-31T05:05:52.559701+0000","last_active":"2024-01-31T05:05:52.570020+0000","last_peered":"2024-01-31T05:05:52.570020+0000","last_clean":"2024-01-31T05:05:52.570020+0000","last_became_active":"2024-01-31T05:05:52.558557+0000","last_became_peered":"2024-01-31T05:05:52.558557+0000","last_unstale":"2024-01-31T05:05:52.570020+0000","last_undegraded":"2024-01-31T05:05:52.570020+0000","last_fullsized":"2024-01-31T05:05:52.570020+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:14:13.434484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.562571+0000","last_change":"2024-01-31T05:05:52.555793+0000","last_active":"2024-01-31T05:05:52.562571+0000","last_peered":"2024-01-31T05:05:52.562571+0000","last_clean":"2024-01-31T05:05:52.562571+0000","last_became_active":"2024-01-31T05:05:52.555510+0000","last_became_peered":"2024-01-31T05:05:52.555510+0000","last_unstale":"2024-01-31T05:05:52.562571+0000","last_undegraded":"2024-01-31T05:05:52.562571+0000","last_fullsized":"2024-01-31T05:05:52.562571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:23:51.862676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.574434+0000","last_change":"2024-01-31T05:05:52.572072+0000","last_active":"2024-01-31T05:05:52.574434+0000","last_peered":"2024-01-31T05:05:52.574434+0000","last_clean":"2024-01-31T05:05:52.574434+0000","last_became_active":"2024-01-31T05:05:52.571794+0000","last_became_peered":"2024-01-31T05:05:52.571794+0000","last_unstale":"2024-01-31T05:05:52.574434+0000","last_undegraded":"2024-01-31T05:05:52.574434+0000","last_fullsized":"2024-01-31T05:05:52.574434+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:44:01.953261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.556732+0000","last_change":"2024-01-31T05:05:52.551874+0000","last_active":"2024-01-31T05:05:52.556732+0000","last_peered":"2024-01-31T05:05:52.556732+0000","last_clean":"2024-01-31T05:05:52.556732+0000","last_became_active":"2024-01-31T05:05:52.551557+0000","last_became_peered":"2024-01-31T05:05:52.551557+0000","last_unstale":"2024-01-31T05:05:52.556732+0000","last_undegraded":"2024-01-31T05:05:52.556732+0000","last_fullsized":"2024-01-31T05:05:52.556732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:44:01.953261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.568184+0000","last_change":"2024-01-31T05:05:52.558617+0000","last_active":"2024-01-31T05:05:52.568184+0000","last_peered":"2024-01-31T05:05:52.568184+0000","last_clean":"2024-01-31T05:05:52.568184+0000","last_became_active":"2024-01-31T05:05:52.553767+0000","last_became_peered":"2024-01-31T05:05:52.553767+0000","last_unstale":"2024-01-31T05:05:52.568184+0000","last_undegraded":"2024-01-31T05:05:52.568184+0000","last_fullsized":"2024-01-31T05:05:52.568184+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:17:34.057258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.565988+0000","last_change":"2024-01-31T05:05:52.558015+0000","last_active":"2024-01-31T05:05:52.565988+0000","last_peered":"2024-01-31T05:05:52.565988+0000","last_clean":"2024-01-31T05:05:52.565988+0000","last_became_active":"2024-01-31T05:05:52.557736+0000","last_became_peered":"2024-01-31T05:05:52.557736+0000","last_unstale":"2024-01-31T05:05:52.565988+0000","last_undegraded":"2024-01-31T05:05:52.565988+0000","last_fullsized":"2024-01-31T05:05:52.565988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:48:59.722958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.574077+0000","last_change":"2024-01-31T05:05:52.571625+0000","last_active":"2024-01-31T05:05:52.574077+0000","last_peered":"2024-01-31T05:05:52.574077+0000","last_clean":"2024-01-31T05:05:52.574077+0000","last_became_active":"2024-01-31T05:05:52.571378+0000","last_became_peered":"2024-01-31T05:05:52.571378+0000","last_unstale":"2024-01-31T05:05:52.574077+0000","last_undegraded":"2024-01-31T05:05:52.574077+0000","last_fullsized":"2024-01-31T05:05:52.574077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:26:49.120234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.561557+0000","last_change":"2024-01-31T05:05:52.557731+0000","last_active":"2024-01-31T05:05:52.561557+0000","last_peered":"2024-01-31T05:05:52.561557+0000","last_clean":"2024-01-31T05:05:52.561557+0000","last_became_active":"2024-01-31T05:05:52.557465+0000","last_became_peered":"2024-01-31T05:05:52.557465+0000","last_unstale":"2024-01-31T05:05:52.561557+0000","last_undegraded":"2024-01-31T05:05:52.561557+0000","last_fullsized":"2024-01-31T05:05:52.561557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:42:19.034105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.570061+0000","last_change":"2024-01-31T05:05:52.562421+0000","last_active":"2024-01-31T05:05:52.570061+0000","last_peered":"2024-01-31T05:05:52.570061+0000","last_clean":"2024-01-31T05:05:52.570061+0000","last_became_active":"2024-01-31T05:05:52.560021+0000","last_became_peered":"2024-01-31T05:05:52.560021+0000","last_unstale":"2024-01-31T05:05:52.570061+0000","last_undegraded":"2024-01-31T05:05:52.570061+0000","last_fullsized":"2024-01-31T05:05:52.570061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:23:51.862676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.567448+0000","last_change":"2024-01-31T05:05:52.565675+0000","last_active":"2024-01-31T05:05:52.567448+0000","last_peered":"2024-01-31T05:05:52.567448+0000","last_clean":"2024-01-31T05:05:52.567448+0000","last_became_active":"2024-01-31T05:05:52.565433+0000","last_became_peered":"2024-01-31T05:05:52.565433+0000","last_unstale":"2024-01-31T05:05:52.567448+0000","last_undegraded":"2024-01-31T05:05:52.567448+0000","last_fullsized":"2024-01-31T05:05:52.567448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:14:13.434484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.567928+0000","last_change":"2024-01-31T05:05:52.566840+0000","last_active":"2024-01-31T05:05:52.567928+0000","last_peered":"2024-01-31T05:05:52.567928+0000","last_clean":"2024-01-31T05:05:52.567928+0000","last_became_active":"2024-01-31T05:05:52.566032+0000","last_became_peered":"2024-01-31T05:05:52.566032+0000","last_unstale":"2024-01-31T05:05:52.567928+0000","last_undegraded":"2024-01-31T05:05:52.567928+0000","last_fullsized":"2024-01-31T05:05:52.567928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:18:30.383860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.551266+0000","last_change":"2024-01-31T05:05:52.545509+0000","last_active":"2024-01-31T05:05:52.551266+0000","last_peered":"2024-01-31T05:05:52.551266+0000","last_clean":"2024-01-31T05:05:52.551266+0000","last_became_active":"2024-01-31T05:05:52.545059+0000","last_became_peered":"2024-01-31T05:05:52.545059+0000","last_unstale":"2024-01-31T05:05:52.551266+0000","last_undegraded":"2024-01-31T05:05:52.551266+0000","last_fullsized":"2024-01-31T05:05:52.551266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:47:54.618475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.563832+0000","last_change":"2024-01-31T05:05:52.561990+0000","last_active":"2024-01-31T05:05:52.563832+0000","last_peered":"2024-01-31T05:05:52.563832+0000","last_clean":"2024-01-31T05:05:52.563832+0000","last_became_active":"2024-01-31T05:05:52.561351+0000","last_became_peered":"2024-01-31T05:05:52.561351+0000","last_unstale":"2024-01-31T05:05:52.563832+0000","last_undegraded":"2024-01-31T05:05:52.563832+0000","last_fullsized":"2024-01-31T05:05:52.563832+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:26:10.263977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.552092+0000","last_change":"2024-01-31T05:05:52.545159+0000","last_active":"2024-01-31T05:05:52.552092+0000","last_peered":"2024-01-31T05:05:52.552092+0000","last_clean":"2024-01-31T05:05:52.552092+0000","last_became_active":"2024-01-31T05:05:52.544840+0000","last_became_peered":"2024-01-31T05:05:52.544840+0000","last_unstale":"2024-01-31T05:05:52.552092+0000","last_undegraded":"2024-01-31T05:05:52.552092+0000","last_fullsized":"2024-01-31T05:05:52.552092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:21:48.625977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.571147+0000","last_change":"2024-01-31T05:05:52.563342+0000","last_active":"2024-01-31T05:05:52.571147+0000","last_peered":"2024-01-31T05:05:52.571147+0000","last_clean":"2024-01-31T05:05:52.571147+0000","last_became_active":"2024-01-31T05:05:52.563052+0000","last_became_peered":"2024-01-31T05:05:52.563052+0000","last_unstale":"2024-01-31T05:05:52.571147+0000","last_undegraded":"2024-01-31T05:05:52.571147+0000","last_fullsized":"2024-01-31T05:05:52.571147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:10:29.643921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.561538+0000","last_change":"2024-01-31T05:05:52.554114+0000","last_active":"2024-01-31T05:05:52.561538+0000","last_peered":"2024-01-31T05:05:52.561538+0000","last_clean":"2024-01-31T05:05:52.561538+0000","last_became_active":"2024-01-31T05:05:52.553626+0000","last_became_peered":"2024-01-31T05:05:52.553626+0000","last_unstale":"2024-01-31T05:05:52.561538+0000","last_undegraded":"2024-01-31T05:05:52.561538+0000","last_fullsized":"2024-01-31T05:05:52.561538+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:47:04.541569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.566170+0000","last_change":"2024-01-31T05:05:52.562872+0000","last_active":"2024-01-31T05:05:52.566170+0000","last_peered":"2024-01-31T05:05:52.566170+0000","last_clean":"2024-01-31T05:05:52.566170+0000","last_became_active":"2024-01-31T05:05:52.562626+0000","last_became_peered":"2024-01-31T05:05:52.562626+0000","last_unstale":"2024-01-31T05:05:52.566170+0000","last_undegraded":"2024-01-31T05:05:52.566170+0000","last_fullsized":"2024-01-31T05:05:52.566170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:44:01.953261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.552374+0000","last_change":"2024-01-31T05:05:52.547687+0000","last_active":"2024-01-31T05:05:52.552374+0000","last_peered":"2024-01-31T05:05:52.552374+0000","last_clean":"2024-01-31T05:05:52.552374+0000","last_became_active":"2024-01-31T05:05:52.547416+0000","last_became_peered":"2024-01-31T05:05:52.547416+0000","last_unstale":"2024-01-31T05:05:52.552374+0000","last_undegraded":"2024-01-31T05:05:52.552374+0000","last_fullsized":"2024-01-31T05:05:52.552374+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:29:28.284780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.565206+0000","last_change":"2024-01-31T05:05:52.560297+0000","last_active":"2024-01-31T05:05:52.565206+0000","last_peered":"2024-01-31T05:05:52.565206+0000","last_clean":"2024-01-31T05:05:52.565206+0000","last_became_active":"2024-01-31T05:05:52.560040+0000","last_became_peered":"2024-01-31T05:05:52.560040+0000","last_unstale":"2024-01-31T05:05:52.565206+0000","last_undegraded":"2024-01-31T05:05:52.565206+0000","last_fullsized":"2024-01-31T05:05:52.565206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:13:09.889939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.567955+0000","last_change":"2024-01-31T05:05:52.560063+0000","last_active":"2024-01-31T05:05:52.567955+0000","last_peered":"2024-01-31T05:05:52.567955+0000","last_clean":"2024-01-31T05:05:52.567955+0000","last_became_active":"2024-01-31T05:05:52.559768+0000","last_became_peered":"2024-01-31T05:05:52.559768+0000","last_unstale":"2024-01-31T05:05:52.567955+0000","last_undegraded":"2024-01-31T05:05:52.567955+0000","last_fullsized":"2024-01-31T05:05:52.567955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:23:38.818374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.552806+0000","last_change":"2024-01-31T05:05:52.545649+0000","last_active":"2024-01-31T05:05:52.552806+0000","last_peered":"2024-01-31T05:05:52.552806+0000","last_clean":"2024-01-31T05:05:52.552806+0000","last_became_active":"2024-01-31T05:05:52.545332+0000","last_became_peered":"2024-01-31T05:05:52.545332+0000","last_unstale":"2024-01-31T05:05:52.552806+0000","last_undegraded":"2024-01-31T05:05:52.552806+0000","last_fullsized":"2024-01-31T05:05:52.552806+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:40:06.401580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.570952+0000","last_change":"2024-01-31T05:05:52.567823+0000","last_active":"2024-01-31T05:05:52.570952+0000","last_peered":"2024-01-31T05:05:52.570952+0000","last_clean":"2024-01-31T05:05:52.570952+0000","last_became_active":"2024-01-31T05:05:52.567541+0000","last_became_peered":"2024-01-31T05:05:52.567541+0000","last_unstale":"2024-01-31T05:05:52.570952+0000","last_undegraded":"2024-01-31T05:05:52.570952+0000","last_fullsized":"2024-01-31T05:05:52.570952+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:20:50.460982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.565374+0000","last_change":"2024-01-31T05:05:52.561277+0000","last_active":"2024-01-31T05:05:52.565374+0000","last_peered":"2024-01-31T05:05:52.565374+0000","last_clean":"2024-01-31T05:05:52.565374+0000","last_became_active":"2024-01-31T05:05:52.559801+0000","last_became_peered":"2024-01-31T05:05:52.559801+0000","last_unstale":"2024-01-31T05:05:52.565374+0000","last_undegraded":"2024-01-31T05:05:52.565374+0000","last_fullsized":"2024-01-31T05:05:52.565374+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:30.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.557010+0000","last_change":"2024-01-31T05:05:52.547660+0000","last_active":"2024-01-31T05:05:52.557010+0000","last_peered":"2024-01-31T05:05:52.557010+0000","last_clean":"2024-01-31T05:05:52.557010+0000","last_became_active":"2024-01-31T05:05:52.546767+0000","last_became_peered":"2024-01-31T05:05:52.546767+0000","last_unstale":"2024-01-31T05:05:52.557010+0000","last_undegraded":"2024-01-31T05:05:52.557010+0000","last_fullsized":"2024-01-31T05:05:52.557010+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:07:55.928453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.566413+0000","last_change":"2024-01-31T05:05:52.564540+0000","last_active":"2024-01-31T05:05:52.566413+0000","last_peered":"2024-01-31T05:05:52.566413+0000","last_clean":"2024-01-31T05:05:52.566413+0000","last_became_active":"2024-01-31T05:05:52.564242+0000","last_became_peered":"2024-01-31T05:05:52.564242+0000","last_unstale":"2024-01-31T05:05:52.566413+0000","last_undegraded":"2024-01-31T05:05:52.566413+0000","last_fullsized":"2024-01-31T05:05:52.566413+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:17:34.057258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.556734+0000","last_change":"2024-01-31T05:05:52.553526+0000","last_active":"2024-01-31T05:05:52.556734+0000","last_peered":"2024-01-31T05:05:52.556734+0000","last_clean":"2024-01-31T05:05:52.556734+0000","last_became_active":"2024-01-31T05:05:52.553324+0000","last_became_peered":"2024-01-31T05:05:52.553324+0000","last_unstale":"2024-01-31T05:05:52.556734+0000","last_undegraded":"2024-01-31T05:05:52.556734+0000","last_fullsized":"2024-01-31T05:05:52.556734+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:17:35.807352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.566345+0000","last_change":"2024-01-31T05:05:52.563602+0000","last_active":"2024-01-31T05:05:52.566345+0000","last_peered":"2024-01-31T05:05:52.566345+0000","last_clean":"2024-01-31T05:05:52.566345+0000","last_became_active":"2024-01-31T05:05:52.563342+0000","last_became_peered":"2024-01-31T05:05:52.563342+0000","last_unstale":"2024-01-31T05:05:52.566345+0000","last_undegraded":"2024-01-31T05:05:52.566345+0000","last_fullsized":"2024-01-31T05:05:52.566345+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:43:57.088926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.566588+0000","last_change":"2024-01-31T05:05:51.545174+0000","last_active":"2024-01-31T05:05:52.566588+0000","last_peered":"2024-01-31T05:05:52.566588+0000","last_clean":"2024-01-31T05:05:52.566588+0000","last_became_active":"2024-01-31T05:05:51.544909+0000","last_became_peered":"2024-01-31T05:05:51.544909+0000","last_unstale":"2024-01-31T05:05:52.566588+0000","last_undegraded":"2024-01-31T05:05:52.566588+0000","last_fullsized":"2024-01-31T05:05:52.566588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:45:59.996998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.568320+0000","last_change":"2024-01-31T05:05:52.560872+0000","last_active":"2024-01-31T05:05:52.568320+0000","last_peered":"2024-01-31T05:05:52.568320+0000","last_clean":"2024-01-31T05:05:52.568320+0000","last_became_active":"2024-01-31T05:05:52.560422+0000","last_became_peered":"2024-01-31T05:05:52.560422+0000","last_unstale":"2024-01-31T05:05:52.568320+0000","last_undegraded":"2024-01-31T05:05:52.568320+0000","last_fullsized":"2024-01-31T05:05:52.568320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:44:01.953261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.571573+0000","last_change":"2024-01-31T05:05:51.543042+0000","last_active":"2024-01-31T05:05:52.571573+0000","last_peered":"2024-01-31T05:05:52.571573+0000","last_clean":"2024-01-31T05:05:52.571573+0000","last_became_active":"2024-01-31T05:05:51.542795+0000","last_became_peered":"2024-01-31T05:05:51.542795+0000","last_unstale":"2024-01-31T05:05:52.571573+0000","last_undegraded":"2024-01-31T05:05:52.571573+0000","last_fullsized":"2024-01-31T05:05:52.571573+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:29.957757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.556534+0000","last_change":"2024-01-31T05:05:52.553174+0000","last_active":"2024-01-31T05:05:52.556534+0000","last_peered":"2024-01-31T05:05:52.556534+0000","last_clean":"2024-01-31T05:05:52.556534+0000","last_became_active":"2024-01-31T05:05:52.552889+0000","last_became_peered":"2024-01-31T05:05:52.552889+0000","last_unstale":"2024-01-31T05:05:52.556534+0000","last_undegraded":"2024-01-31T05:05:52.556534+0000","last_fullsized":"2024-01-31T05:05:52.556534+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:50:36.699719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.562648+0000","last_change":"2024-01-31T05:05:51.545410+0000","last_active":"2024-01-31T05:05:52.562648+0000","last_peered":"2024-01-31T05:05:52.562648+0000","last_clean":"2024-01-31T05:05:52.562648+0000","last_became_active":"2024-01-31T05:05:51.543715+0000","last_became_peered":"2024-01-31T05:05:51.543715+0000","last_unstale":"2024-01-31T05:05:52.562648+0000","last_undegraded":"2024-01-31T05:05:52.562648+0000","last_fullsized":"2024-01-31T05:05:52.562648+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:50:35.694344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.562271+0000","last_change":"2024-01-31T05:05:52.553150+0000","last_active":"2024-01-31T05:05:52.562271+0000","last_peered":"2024-01-31T05:05:52.562271+0000","last_clean":"2024-01-31T05:05:52.562271+0000","last_became_active":"2024-01-31T05:05:52.552900+0000","last_became_peered":"2024-01-31T05:05:52.552900+0000","last_unstale":"2024-01-31T05:05:52.562271+0000","last_undegraded":"2024-01-31T05:05:52.562271+0000","last_fullsized":"2024-01-31T05:05:52.562271+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:18:30.383860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.567450+0000","last_change":"2024-01-31T05:05:51.534012+0000","last_active":"2024-01-31T05:05:52.567450+0000","last_peered":"2024-01-31T05:05:52.567450+0000","last_clean":"2024-01-31T05:05:52.567450+0000","last_became_active":"2024-01-31T05:05:51.533675+0000","last_became_peered":"2024-01-31T05:05:51.533675+0000","last_unstale":"2024-01-31T05:05:52.567450+0000","last_undegraded":"2024-01-31T05:05:52.567450+0000","last_fullsized":"2024-01-31T05:05:52.567450+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:40:05.396206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.572343+0000","last_change":"2024-01-31T05:05:52.562159+0000","last_active":"2024-01-31T05:05:52.572343+0000","last_peered":"2024-01-31T05:05:52.572343+0000","last_clean":"2024-01-31T05:05:52.572343+0000","last_became_active":"2024-01-31T05:05:52.561543+0000","last_became_peered":"2024-01-31T05:05:52.561543+0000","last_unstale":"2024-01-31T05:05:52.572343+0000","last_undegraded":"2024-01-31T05:05:52.572343+0000","last_fullsized":"2024-01-31T05:05:52.572343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:50:36.699719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.574072+0000","last_change":"2024-01-31T05:05:51.545648+0000","last_active":"2024-01-31T05:05:52.574072+0000","last_peered":"2024-01-31T05:05:52.574072+0000","last_clean":"2024-01-31T05:05:52.574072+0000","last_became_active":"2024-01-31T05:05:51.545383+0000","last_became_peered":"2024-01-31T05:05:51.545383+0000","last_unstale":"2024-01-31T05:05:52.574072+0000","last_undegraded":"2024-01-31T05:05:52.574072+0000","last_fullsized":"2024-01-31T05:05:52.574072+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:17:34.801978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.570041+0000","last_change":"2024-01-31T05:05:52.562220+0000","last_active":"2024-01-31T05:05:52.570041+0000","last_peered":"2024-01-31T05:05:52.570041+0000","last_clean":"2024-01-31T05:05:52.570041+0000","last_became_active":"2024-01-31T05:05:52.560339+0000","last_became_peered":"2024-01-31T05:05:52.560339+0000","last_unstale":"2024-01-31T05:05:52.570041+0000","last_undegraded":"2024-01-31T05:05:52.570041+0000","last_fullsized":"2024-01-31T05:05:52.570041+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:18:30.383860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.568215+0000","last_change":"2024-01-31T05:05:51.545752+0000","last_active":"2024-01-31T05:05:52.568215+0000","last_peered":"2024-01-31T05:05:52.568215+0000","last_clean":"2024-01-31T05:05:52.568215+0000","last_became_active":"2024-01-31T05:05:51.545509+0000","last_became_peered":"2024-01-31T05:05:51.545509+0000","last_unstale":"2024-01-31T05:05:52.568215+0000","last_undegraded":"2024-01-31T05:05:52.568215+0000","last_fullsized":"2024-01-31T05:05:52.568215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:29.957757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.556548+0000","last_change":"2024-01-31T05:05:52.553904+0000","last_active":"2024-01-31T05:05:52.556548+0000","last_peered":"2024-01-31T05:05:52.556548+0000","last_clean":"2024-01-31T05:05:52.556548+0000","last_became_active":"2024-01-31T05:05:52.553285+0000","last_became_peered":"2024-01-31T05:05:52.553285+0000","last_unstale":"2024-01-31T05:05:52.556548+0000","last_undegraded":"2024-01-31T05:05:52.556548+0000","last_fullsized":"2024-01-31T05:05:52.556548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:17:35.807352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.541695+0000","last_change":"2024-01-31T05:05:51.543708+0000","last_active":"2024-01-31T05:05:52.541695+0000","last_peered":"2024-01-31T05:05:52.541695+0000","last_clean":"2024-01-31T05:05:52.541695+0000","last_became_active":"2024-01-31T05:05:51.543389+0000","last_became_peered":"2024-01-31T05:05:51.543389+0000","last_unstale":"2024-01-31T05:05:52.541695+0000","last_undegraded":"2024-01-31T05:05:52.541695+0000","last_fullsized":"2024-01-31T05:05:52.541695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:13:08.884565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.565734+0000","last_change":"2024-01-31T05:05:52.549165+0000","last_active":"2024-01-31T05:05:52.565734+0000","last_peered":"2024-01-31T05:05:52.565734+0000","last_clean":"2024-01-31T05:05:52.565734+0000","last_became_active":"2024-01-31T05:05:52.548644+0000","last_became_peered":"2024-01-31T05:05:52.548644+0000","last_unstale":"2024-01-31T05:05:52.565734+0000","last_undegraded":"2024-01-31T05:05:52.565734+0000","last_fullsized":"2024-01-31T05:05:52.565734+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:17:34.057258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.536701+0000","last_change":"2024-01-31T05:05:51.542192+0000","last_active":"2024-01-31T05:05:52.536701+0000","last_peered":"2024-01-31T05:05:52.536701+0000","last_clean":"2024-01-31T05:05:52.536701+0000","last_became_active":"2024-01-31T05:05:51.541907+0000","last_became_peered":"2024-01-31T05:05:51.541907+0000","last_unstale":"2024-01-31T05:05:52.536701+0000","last_undegraded":"2024-01-31T05:05:52.536701+0000","last_fullsized":"2024-01-31T05:05:52.536701+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:07:54.923079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.556333+0000","last_change":"2024-01-31T05:05:52.551766+0000","last_active":"2024-01-31T05:05:52.556333+0000","last_peered":"2024-01-31T05:05:52.556333+0000","last_clean":"2024-01-31T05:05:52.556333+0000","last_became_active":"2024-01-31T05:05:52.551115+0000","last_became_peered":"2024-01-31T05:05:52.551115+0000","last_unstale":"2024-01-31T05:05:52.556333+0000","last_undegraded":"2024-01-31T05:05:52.556333+0000","last_fullsized":"2024-01-31T05:05:52.556333+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:38:25.209495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.534191+0000","last_change":"2024-01-31T05:05:51.540984+0000","last_active":"2024-01-31T05:05:52.534191+0000","last_peered":"2024-01-31T05:05:52.534191+0000","last_clean":"2024-01-31T05:05:52.534191+0000","last_became_active":"2024-01-31T05:05:51.540649+0000","last_became_peered":"2024-01-31T05:05:51.540649+0000","last_unstale":"2024-01-31T05:05:52.534191+0000","last_undegraded":"2024-01-31T05:05:52.534191+0000","last_fullsized":"2024-01-31T05:05:52.534191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:10:39.032667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.565974+0000","last_change":"2024-01-31T05:05:52.562217+0000","last_active":"2024-01-31T05:05:52.565974+0000","last_peered":"2024-01-31T05:05:52.565974+0000","last_clean":"2024-01-31T05:05:52.565974+0000","last_became_active":"2024-01-31T05:05:52.561309+0000","last_became_peered":"2024-01-31T05:05:52.561309+0000","last_unstale":"2024-01-31T05:05:52.565974+0000","last_undegraded":"2024-01-31T05:05:52.565974+0000","last_fullsized":"2024-01-31T05:05:52.565974+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:10:40.038041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.546357+0000","last_change":"2024-01-31T05:05:51.548525+0000","last_active":"2024-01-31T05:05:52.546357+0000","last_peered":"2024-01-31T05:05:52.546357+0000","last_clean":"2024-01-31T05:05:52.546357+0000","last_became_active":"2024-01-31T05:05:51.547898+0000","last_became_peered":"2024-01-31T05:05:51.547898+0000","last_unstale":"2024-01-31T05:05:52.546357+0000","last_undegraded":"2024-01-31T05:05:52.546357+0000","last_fullsized":"2024-01-31T05:05:52.546357+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:42:18.028731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.572953+0000","last_change":"2024-01-31T05:05:52.563673+0000","last_active":"2024-01-31T05:05:52.572953+0000","last_peered":"2024-01-31T05:05:52.572953+0000","last_clean":"2024-01-31T05:05:52.572953+0000","last_became_active":"2024-01-31T05:05:52.563373+0000","last_became_peered":"2024-01-31T05:05:52.563373+0000","last_unstale":"2024-01-31T05:05:52.572953+0000","last_undegraded":"2024-01-31T05:05:52.572953+0000","last_fullsized":"2024-01-31T05:05:52.572953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:47:04.541569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.575896+0000","last_change":"2024-01-31T05:05:51.547453+0000","last_active":"2024-01-31T05:05:52.575896+0000","last_peered":"2024-01-31T05:05:52.575896+0000","last_clean":"2024-01-31T05:05:52.575896+0000","last_became_active":"2024-01-31T05:05:51.547208+0000","last_became_peered":"2024-01-31T05:05:51.547208+0000","last_unstale":"2024-01-31T05:05:52.575896+0000","last_undegraded":"2024-01-31T05:05:52.575896+0000","last_fullsized":"2024-01-31T05:05:52.575896+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:47:03.536195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.556441+0000","last_change":"2024-01-31T05:05:52.551949+0000","last_active":"2024-01-31T05:05:52.556441+0000","last_peered":"2024-01-31T05:05:52.556441+0000","last_clean":"2024-01-31T05:05:52.556441+0000","last_became_active":"2024-01-31T05:05:52.550845+0000","last_became_peered":"2024-01-31T05:05:52.550845+0000","last_unstale":"2024-01-31T05:05:52.556441+0000","last_undegraded":"2024-01-31T05:05:52.556441+0000","last_fullsized":"2024-01-31T05:05:52.556441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:48:59.722958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.576413+0000","last_change":"2024-01-31T05:05:51.539521+0000","last_active":"2024-01-31T05:05:52.576413+0000","last_peered":"2024-01-31T05:05:52.576413+0000","last_clean":"2024-01-31T05:05:52.576413+0000","last_became_active":"2024-01-31T05:05:51.539251+0000","last_became_peered":"2024-01-31T05:05:51.539251+0000","last_unstale":"2024-01-31T05:05:52.576413+0000","last_undegraded":"2024-01-31T05:05:52.576413+0000","last_fullsized":"2024-01-31T05:05:52.576413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:42:18.028731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.572363+0000","last_change":"2024-01-31T05:05:52.562388+0000","last_active":"2024-01-31T05:05:52.572363+0000","last_peered":"2024-01-31T05:05:52.572363+0000","last_clean":"2024-01-31T05:05:52.572363+0000","last_became_active":"2024-01-31T05:05:52.561906+0000","last_became_peered":"2024-01-31T05:05:52.561906+0000","last_unstale":"2024-01-31T05:05:52.572363+0000","last_undegraded":"2024-01-31T05:05:52.572363+0000","last_fullsized":"2024-01-31T05:05:52.572363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:17:35.807352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.572550+0000","last_change":"2024-01-31T05:05:51.542880+0000","last_active":"2024-01-31T05:05:52.572550+0000","last_peered":"2024-01-31T05:05:52.572550+0000","last_clean":"2024-01-31T05:05:52.572550+0000","last_became_active":"2024-01-31T05:05:51.542495+0000","last_became_peered":"2024-01-31T05:05:51.542495+0000","last_unstale":"2024-01-31T05:05:52.572550+0000","last_undegraded":"2024-01-31T05:05:52.572550+0000","last_fullsized":"2024-01-31T05:05:52.572550+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:47:03.536195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.569102+0000","last_change":"2024-01-31T05:05:52.561017+0000","last_active":"2024-01-31T05:05:52.569102+0000","last_peered":"2024-01-31T05:05:52.569102+0000","last_clean":"2024-01-31T05:05:52.569102+0000","last_became_active":"2024-01-31T05:05:52.560714+0000","last_became_peered":"2024-01-31T05:05:52.560714+0000","last_unstale":"2024-01-31T05:05:52.569102+0000","last_undegraded":"2024-01-31T05:05:52.569102+0000","last_fullsized":"2024-01-31T05:05:52.569102+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:10:29.643921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.542582+0000","last_change":"2024-01-31T05:05:51.548598+0000","last_active":"2024-01-31T05:05:52.542582+0000","last_peered":"2024-01-31T05:05:52.542582+0000","last_clean":"2024-01-31T05:05:52.542582+0000","last_became_active":"2024-01-31T05:05:51.548279+0000","last_became_peered":"2024-01-31T05:05:51.548279+0000","last_unstale":"2024-01-31T05:05:52.542582+0000","last_undegraded":"2024-01-31T05:05:52.542582+0000","last_fullsized":"2024-01-31T05:05:52.542582+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:29.957757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.560982+0000","last_change":"2024-01-31T05:05:52.556796+0000","last_active":"2024-01-31T05:05:52.560982+0000","last_peered":"2024-01-31T05:05:52.560982+0000","last_clean":"2024-01-31T05:05:52.560982+0000","last_became_active":"2024-01-31T05:05:52.556548+0000","last_became_peered":"2024-01-31T05:05:52.556548+0000","last_unstale":"2024-01-31T05:05:52.560982+0000","last_undegraded":"2024-01-31T05:05:52.560982+0000","last_fullsized":"2024-01-31T05:05:52.560982+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:42:19.034105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.532255+0000","last_change":"2024-01-31T05:05:51.543348+0000","last_active":"2024-01-31T05:05:52.532255+0000","last_peered":"2024-01-31T05:05:52.532255+0000","last_clean":"2024-01-31T05:05:52.532255+0000","last_became_active":"2024-01-31T05:05:51.543102+0000","last_became_peered":"2024-01-31T05:05:51.543102+0000","last_unstale":"2024-01-31T05:05:52.532255+0000","last_undegraded":"2024-01-31T05:05:52.532255+0000","last_fullsized":"2024-01-31T05:05:52.532255+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:26:09.258603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.570331+0000","last_change":"2024-01-31T05:05:52.565862+0000","last_active":"2024-01-31T05:05:52.570331+0000","last_peered":"2024-01-31T05:05:52.570331+0000","last_clean":"2024-01-31T05:05:52.570331+0000","last_became_active":"2024-01-31T05:05:52.565507+0000","last_became_peered":"2024-01-31T05:05:52.565507+0000","last_unstale":"2024-01-31T05:05:52.570331+0000","last_undegraded":"2024-01-31T05:05:52.570331+0000","last_fullsized":"2024-01-31T05:05:52.570331+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:25:11.335020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.573638+0000","last_change":"2024-01-31T05:05:51.546452+0000","last_active":"2024-01-31T05:05:52.573638+0000","last_peered":"2024-01-31T05:05:52.573638+0000","last_clean":"2024-01-31T05:05:52.573638+0000","last_became_active":"2024-01-31T05:05:51.546184+0000","last_became_peered":"2024-01-31T05:05:51.546184+0000","last_unstale":"2024-01-31T05:05:52.573638+0000","last_undegraded":"2024-01-31T05:05:52.573638+0000","last_fullsized":"2024-01-31T05:05:52.573638+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:13:08.884565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.540010+0000","last_change":"2024-01-31T05:05:52.536384+0000","last_active":"2024-01-31T05:05:52.540010+0000","last_peered":"2024-01-31T05:05:52.540010+0000","last_clean":"2024-01-31T05:05:52.540010+0000","last_became_active":"2024-01-31T05:05:52.536061+0000","last_became_peered":"2024-01-31T05:05:52.536061+0000","last_unstale":"2024-01-31T05:05:52.540010+0000","last_undegraded":"2024-01-31T05:05:52.540010+0000","last_fullsized":"2024-01-31T05:05:52.540010+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:23:38.818374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.574150+0000","last_change":"2024-01-31T05:05:51.543477+0000","last_active":"2024-01-31T05:05:52.574150+0000","last_peered":"2024-01-31T05:05:52.574150+0000","last_clean":"2024-01-31T05:05:52.574150+0000","last_became_active":"2024-01-31T05:05:51.542322+0000","last_became_peered":"2024-01-31T05:05:51.542322+0000","last_unstale":"2024-01-31T05:05:52.574150+0000","last_undegraded":"2024-01-31T05:05:52.574150+0000","last_fullsized":"2024-01-31T05:05:52.574150+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:10:39.032667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.571559+0000","last_change":"2024-01-31T05:05:52.564303+0000","last_active":"2024-01-31T05:05:52.571559+0000","last_peered":"2024-01-31T05:05:52.571559+0000","last_clean":"2024-01-31T05:05:52.571559+0000","last_became_active":"2024-01-31T05:05:52.563928+0000","last_became_peered":"2024-01-31T05:05:52.563928+0000","last_unstale":"2024-01-31T05:05:52.571559+0000","last_undegraded":"2024-01-31T05:05:52.571559+0000","last_fullsized":"2024-01-31T05:05:52.571559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:10:10.336827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.571028+0000","last_change":"2024-01-31T05:05:51.543419+0000","last_active":"2024-01-31T05:05:52.571028+0000","last_peered":"2024-01-31T05:05:52.571028+0000","last_clean":"2024-01-31T05:05:52.571028+0000","last_became_active":"2024-01-31T05:05:51.542281+0000","last_became_peered":"2024-01-31T05:05:51.542281+0000","last_unstale":"2024-01-31T05:05:52.571028+0000","last_undegraded":"2024-01-31T05:05:52.571028+0000","last_fullsized":"2024-01-31T05:05:52.571028+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:13:08.884565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.556507+0000","last_change":"2024-01-31T05:05:52.551707+0000","last_active":"2024-01-31T05:05:52.556507+0000","last_peered":"2024-01-31T05:05:52.556507+0000","last_clean":"2024-01-31T05:05:52.556507+0000","last_became_active":"2024-01-31T05:05:52.551202+0000","last_became_peered":"2024-01-31T05:05:52.551202+0000","last_unstale":"2024-01-31T05:05:52.556507+0000","last_undegraded":"2024-01-31T05:05:52.556507+0000","last_fullsized":"2024-01-31T05:05:52.556507+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:48:30.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.564926+0000","last_change":"2024-01-31T05:05:51.537473+0000","last_active":"2024-01-31T05:05:52.564926+0000","last_peered":"2024-01-31T05:05:52.564926+0000","last_clean":"2024-01-31T05:05:52.564926+0000","last_became_active":"2024-01-31T05:05:51.537163+0000","last_became_peered":"2024-01-31T05:05:51.537163+0000","last_unstale":"2024-01-31T05:05:52.564926+0000","last_undegraded":"2024-01-31T05:05:52.564926+0000","last_fullsized":"2024-01-31T05:05:52.564926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:22:29.294442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.551692+0000","last_change":"2024-01-31T05:05:52.544398+0000","last_active":"2024-01-31T05:05:52.551692+0000","last_peered":"2024-01-31T05:05:52.551692+0000","last_clean":"2024-01-31T05:05:52.551692+0000","last_became_active":"2024-01-31T05:05:52.543376+0000","last_became_peered":"2024-01-31T05:05:52.543376+0000","last_unstale":"2024-01-31T05:05:52.551692+0000","last_undegraded":"2024-01-31T05:05:52.551692+0000","last_fullsized":"2024-01-31T05:05:52.551692+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:13:02.588265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.543399+0000","last_change":"2024-01-31T05:05:51.546897+0000","last_active":"2024-01-31T05:05:52.543399+0000","last_peered":"2024-01-31T05:05:52.543399+0000","last_clean":"2024-01-31T05:05:52.543399+0000","last_became_active":"2024-01-31T05:05:51.543189+0000","last_became_peered":"2024-01-31T05:05:51.543189+0000","last_unstale":"2024-01-31T05:05:52.543399+0000","last_undegraded":"2024-01-31T05:05:52.543399+0000","last_fullsized":"2024-01-31T05:05:52.543399+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:48:58.717584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.554251+0000","last_change":"2024-01-31T05:05:52.548026+0000","last_active":"2024-01-31T05:05:52.554251+0000","last_peered":"2024-01-31T05:05:52.554251+0000","last_clean":"2024-01-31T05:05:52.554251+0000","last_became_active":"2024-01-31T05:05:52.547699+0000","last_became_peered":"2024-01-31T05:05:52.547699+0000","last_unstale":"2024-01-31T05:05:52.554251+0000","last_undegraded":"2024-01-31T05:05:52.554251+0000","last_fullsized":"2024-01-31T05:05:52.554251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:17:35.807352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.569578+0000","last_change":"2024-01-31T05:05:51.538636+0000","last_active":"2024-01-31T05:05:52.569578+0000","last_peered":"2024-01-31T05:05:52.569578+0000","last_clean":"2024-01-31T05:05:52.569578+0000","last_became_active":"2024-01-31T05:05:51.538370+0000","last_became_peered":"2024-01-31T05:05:51.538370+0000","last_unstale":"2024-01-31T05:05:52.569578+0000","last_undegraded":"2024-01-31T05:05:52.569578+0000","last_fullsized":"2024-01-31T05:05:52.569578+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:57:30.464022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.572923+0000","last_change":"2024-01-31T05:05:52.563819+0000","last_active":"2024-01-31T05:05:52.572923+0000","last_peered":"2024-01-31T05:05:52.572923+0000","last_clean":"2024-01-31T05:05:52.572923+0000","last_became_active":"2024-01-31T05:05:52.563560+0000","last_became_peered":"2024-01-31T05:05:52.563560+0000","last_unstale":"2024-01-31T05:05:52.572923+0000","last_undegraded":"2024-01-31T05:05:52.572923+0000","last_fullsized":"2024-01-31T05:05:52.572923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:42:19.034105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.536919+0000","last_change":"2024-01-31T05:05:51.541692+0000","last_active":"2024-01-31T05:05:52.536919+0000","last_peered":"2024-01-31T05:05:52.536919+0000","last_clean":"2024-01-31T05:05:52.536919+0000","last_became_active":"2024-01-31T05:05:51.541169+0000","last_became_peered":"2024-01-31T05:05:51.541169+0000","last_unstale":"2024-01-31T05:05:52.536919+0000","last_undegraded":"2024-01-31T05:05:52.536919+0000","last_fullsized":"2024-01-31T05:05:52.536919+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:02:06.720451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.566796+0000","last_change":"2024-01-31T05:05:52.557814+0000","last_active":"2024-01-31T05:05:52.566796+0000","last_peered":"2024-01-31T05:05:52.566796+0000","last_clean":"2024-01-31T05:05:52.566796+0000","last_became_active":"2024-01-31T05:05:52.557563+0000","last_became_peered":"2024-01-31T05:05:52.557563+0000","last_unstale":"2024-01-31T05:05:52.566796+0000","last_undegraded":"2024-01-31T05:05:52.566796+0000","last_fullsized":"2024-01-31T05:05:52.566796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:43:57.088926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.538011+0000","last_change":"2024-01-31T05:05:51.546972+0000","last_active":"2024-01-31T05:05:52.538011+0000","last_peered":"2024-01-31T05:05:52.538011+0000","last_clean":"2024-01-31T05:05:52.538011+0000","last_became_active":"2024-01-31T05:05:51.546744+0000","last_became_peered":"2024-01-31T05:05:51.546744+0000","last_unstale":"2024-01-31T05:05:52.538011+0000","last_undegraded":"2024-01-31T05:05:52.538011+0000","last_fullsized":"2024-01-31T05:05:52.538011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:48:58.717584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.559714+0000","last_change":"2024-01-31T05:05:52.548921+0000","last_active":"2024-01-31T05:05:52.559714+0000","last_peered":"2024-01-31T05:05:52.559714+0000","last_clean":"2024-01-31T05:05:52.559714+0000","last_became_active":"2024-01-31T05:05:52.548300+0000","last_became_peered":"2024-01-31T05:05:52.548300+0000","last_unstale":"2024-01-31T05:05:52.559714+0000","last_undegraded":"2024-01-31T05:05:52.559714+0000","last_fullsized":"2024-01-31T05:05:52.559714+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:43:57.088926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.537445+0000","last_change":"2024-01-31T05:05:51.533426+0000","last_active":"2024-01-31T05:05:52.537445+0000","last_peered":"2024-01-31T05:05:52.537445+0000","last_clean":"2024-01-31T05:05:52.537445+0000","last_became_active":"2024-01-31T05:05:51.533147+0000","last_became_peered":"2024-01-31T05:05:51.533147+0000","last_unstale":"2024-01-31T05:05:52.537445+0000","last_undegraded":"2024-01-31T05:05:52.537445+0000","last_fullsized":"2024-01-31T05:05:52.537445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:07:09.983380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.561227+0000","last_change":"2024-01-31T05:05:52.557196+0000","last_active":"2024-01-31T05:05:52.561227+0000","last_peered":"2024-01-31T05:05:52.561227+0000","last_clean":"2024-01-31T05:05:52.561227+0000","last_became_active":"2024-01-31T05:05:52.556877+0000","last_became_peered":"2024-01-31T05:05:52.556877+0000","last_unstale":"2024-01-31T05:05:52.561227+0000","last_undegraded":"2024-01-31T05:05:52.561227+0000","last_fullsized":"2024-01-31T05:05:52.561227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:42:19.034105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.575887+0000","last_change":"2024-01-31T05:05:51.539850+0000","last_active":"2024-01-31T05:05:52.575887+0000","last_peered":"2024-01-31T05:05:52.575887+0000","last_clean":"2024-01-31T05:05:52.575887+0000","last_became_active":"2024-01-31T05:05:51.539574+0000","last_became_peered":"2024-01-31T05:05:51.539574+0000","last_unstale":"2024-01-31T05:05:52.575887+0000","last_undegraded":"2024-01-31T05:05:52.575887+0000","last_fullsized":"2024-01-31T05:05:52.575887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:23:37.813000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.565991+0000","last_change":"2024-01-31T05:05:52.562557+0000","last_active":"2024-01-31T05:05:52.565991+0000","last_peered":"2024-01-31T05:05:52.565991+0000","last_clean":"2024-01-31T05:05:52.565991+0000","last_became_active":"2024-01-31T05:05:52.562271+0000","last_became_peered":"2024-01-31T05:05:52.562271+0000","last_unstale":"2024-01-31T05:05:52.565991+0000","last_undegraded":"2024-01-31T05:05:52.565991+0000","last_fullsized":"2024-01-31T05:05:52.565991+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:23:38.818374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.538416+0000","last_change":"2024-01-31T05:05:51.542520+0000","last_active":"2024-01-31T05:05:52.538416+0000","last_peered":"2024-01-31T05:05:52.538416+0000","last_clean":"2024-01-31T05:05:52.538416+0000","last_became_active":"2024-01-31T05:05:51.542283+0000","last_became_peered":"2024-01-31T05:05:51.542283+0000","last_unstale":"2024-01-31T05:05:52.538416+0000","last_undegraded":"2024-01-31T05:05:52.538416+0000","last_fullsized":"2024-01-31T05:05:52.538416+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:16:11.328117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.560446+0000","last_change":"2024-01-31T05:05:52.550797+0000","last_active":"2024-01-31T05:05:52.560446+0000","last_peered":"2024-01-31T05:05:52.560446+0000","last_clean":"2024-01-31T05:05:52.560446+0000","last_became_active":"2024-01-31T05:05:52.550514+0000","last_became_peered":"2024-01-31T05:05:52.550514+0000","last_unstale":"2024-01-31T05:05:52.560446+0000","last_undegraded":"2024-01-31T05:05:52.560446+0000","last_fullsized":"2024-01-31T05:05:52.560446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:14:13.434484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.547328+0000","last_change":"2024-01-31T05:05:51.546917+0000","last_active":"2024-01-31T05:05:52.547328+0000","last_peered":"2024-01-31T05:05:52.547328+0000","last_clean":"2024-01-31T05:05:52.547328+0000","last_became_active":"2024-01-31T05:05:51.544374+0000","last_became_peered":"2024-01-31T05:05:51.544374+0000","last_unstale":"2024-01-31T05:05:52.547328+0000","last_undegraded":"2024-01-31T05:05:52.547328+0000","last_fullsized":"2024-01-31T05:05:52.547328+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:13:08.884565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.573644+0000","last_change":"2024-01-31T05:05:52.567345+0000","last_active":"2024-01-31T05:05:52.573644+0000","last_peered":"2024-01-31T05:05:52.573644+0000","last_clean":"2024-01-31T05:05:52.573644+0000","last_became_active":"2024-01-31T05:05:52.567093+0000","last_became_peered":"2024-01-31T05:05:52.567093+0000","last_unstale":"2024-01-31T05:05:52.573644+0000","last_undegraded":"2024-01-31T05:05:52.573644+0000","last_fullsized":"2024-01-31T05:05:52.573644+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:23:38.818374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.544763+0000","last_change":"2024-01-31T05:05:51.544009+0000","last_active":"2024-01-31T05:05:52.544763+0000","last_peered":"2024-01-31T05:05:52.544763+0000","last_clean":"2024-01-31T05:05:52.544763+0000","last_became_active":"2024-01-31T05:05:51.543761+0000","last_became_peered":"2024-01-31T05:05:51.543761+0000","last_unstale":"2024-01-31T05:05:52.544763+0000","last_undegraded":"2024-01-31T05:05:52.544763+0000","last_fullsized":"2024-01-31T05:05:52.544763+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:07:54.923079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.558042+0000","last_change":"2024-01-31T05:05:52.556888+0000","last_active":"2024-01-31T05:05:52.558042+0000","last_peered":"2024-01-31T05:05:52.558042+0000","last_clean":"2024-01-31T05:05:52.558042+0000","last_became_active":"2024-01-31T05:05:52.555676+0000","last_became_peered":"2024-01-31T05:05:52.555676+0000","last_unstale":"2024-01-31T05:05:52.558042+0000","last_undegraded":"2024-01-31T05:05:52.558042+0000","last_fullsized":"2024-01-31T05:05:52.558042+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:47:04.541569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.532149+0000","last_change":"2024-01-31T05:05:51.542060+0000","last_active":"2024-01-31T05:05:52.532149+0000","last_peered":"2024-01-31T05:05:52.532149+0000","last_clean":"2024-01-31T05:05:52.532149+0000","last_became_active":"2024-01-31T05:05:51.541786+0000","last_became_peered":"2024-01-31T05:05:51.541786+0000","last_unstale":"2024-01-31T05:05:52.532149+0000","last_undegraded":"2024-01-31T05:05:52.532149+0000","last_fullsized":"2024-01-31T05:05:52.532149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:43:52.482579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.562672+0000","last_change":"2024-01-31T05:05:52.560908+0000","last_active":"2024-01-31T05:05:52.562672+0000","last_peered":"2024-01-31T05:05:52.562672+0000","last_clean":"2024-01-31T05:05:52.562672+0000","last_became_active":"2024-01-31T05:05:52.560626+0000","last_became_peered":"2024-01-31T05:05:52.560626+0000","last_unstale":"2024-01-31T05:05:52.562672+0000","last_undegraded":"2024-01-31T05:05:52.562672+0000","last_fullsized":"2024-01-31T05:05:52.562672+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:10:40.038041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.536160+0000","last_change":"2024-01-31T05:05:51.535294+0000","last_active":"2024-01-31T05:05:52.536160+0000","last_peered":"2024-01-31T05:05:52.536160+0000","last_clean":"2024-01-31T05:05:52.536160+0000","last_became_active":"2024-01-31T05:05:51.533361+0000","last_became_peered":"2024-01-31T05:05:51.533361+0000","last_unstale":"2024-01-31T05:05:52.536160+0000","last_undegraded":"2024-01-31T05:05:52.536160+0000","last_fullsized":"2024-01-31T05:05:52.536160+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:47:53.613101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.554493+0000","last_change":"2024-01-31T05:05:52.553291+0000","last_active":"2024-01-31T05:05:52.554493+0000","last_peered":"2024-01-31T05:05:52.554493+0000","last_clean":"2024-01-31T05:05:52.554493+0000","last_became_active":"2024-01-31T05:05:52.553036+0000","last_became_peered":"2024-01-31T05:05:52.553036+0000","last_unstale":"2024-01-31T05:05:52.554493+0000","last_undegraded":"2024-01-31T05:05:52.554493+0000","last_fullsized":"2024-01-31T05:05:52.554493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:47:04.541569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.530892+0000","last_change":"2024-01-31T05:05:51.533572+0000","last_active":"2024-01-31T05:05:52.530892+0000","last_peered":"2024-01-31T05:05:52.530892+0000","last_clean":"2024-01-31T05:05:52.530892+0000","last_became_active":"2024-01-31T05:05:51.533321+0000","last_became_peered":"2024-01-31T05:05:51.533321+0000","last_unstale":"2024-01-31T05:05:52.530892+0000","last_undegraded":"2024-01-31T05:05:52.530892+0000","last_fullsized":"2024-01-31T05:05:52.530892+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:17:34.801978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.572089+0000","last_change":"2024-01-31T05:05:52.566281+0000","last_active":"2024-01-31T05:05:52.572089+0000","last_peered":"2024-01-31T05:05:52.572089+0000","last_clean":"2024-01-31T05:05:52.572089+0000","last_became_active":"2024-01-31T05:05:52.564253+0000","last_became_peered":"2024-01-31T05:05:52.564253+0000","last_unstale":"2024-01-31T05:05:52.572089+0000","last_undegraded":"2024-01-31T05:05:52.572089+0000","last_fullsized":"2024-01-31T05:05:52.572089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:51.516409+0000","last_clean_scrub_stamp":"2024-01-31T05:05:51.516409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:25:11.335020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.541692+0000","last_change":"2024-01-31T05:05:51.545052+0000","last_active":"2024-01-31T05:05:52.541692+0000","last_peered":"2024-01-31T05:05:52.541692+0000","last_clean":"2024-01-31T05:05:52.541692+0000","last_became_active":"2024-01-31T05:05:51.542982+0000","last_became_peered":"2024-01-31T05:05:51.542982+0000","last_unstale":"2024-01-31T05:05:52.541692+0000","last_undegraded":"2024-01-31T05:05:52.541692+0000","last_fullsized":"2024-01-31T05:05:52.541692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:05:50.511035+0000","last_clean_scrub_stamp":"2024-01-31T05:05:50.511035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:50:35.694344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":204,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-01-31T05:05:52.537146+0000","last_change":"2024-01-31T05:04:05.699222+0000","last_active":"2024-01-31T05:05:52.537146+0000","last_peered":"2024-01-31T05:05:52.537146+0000","last_clean":"2024-01-31T05:05:52.537146+0000","last_became_active":"2024-01-31T05:04:05.698239+0000","last_became_peered":"2024-01-31T05:04:05.698239+0000","last_unstale":"2024-01-31T05:05:52.537146+0000","last_undegraded":"2024-01-31T05:05:52.537146+0000","last_fullsized":"2024-01-31T05:05:52.537146+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_clean_scrub_stamp":"2024-01-31T05:04:04.484734+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:05:13.736598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1048576,"data_stored":779557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.877}]},{"osd":1,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.67300000000000004}]},{"osd":2,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.82299999999999995}]},{"osd":3,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.71199999999999997}]},{"osd":4,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.90800000000000003}]},{"osd":5,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.89300000000000002}]},{"osd":6,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.77500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":442368,"data_stored":188089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.64500000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.67900000000000005}]},{"osd":2,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.69699999999999995}]},{"osd":3,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.61399999999999999}]},{"osd":4,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.54900000000000004}]},{"osd":5,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.63100000000000001}]},{"osd":7,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.66800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":446464,"data_stored":187619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.72099999999999997}]},{"osd":1,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.78400000000000003}]},{"osd":2,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.63600000000000001}]},{"osd":3,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.74099999999999999}]},{"osd":4,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60499999999999998}]},{"osd":6,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.52400000000000002}]},{"osd":7,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.69899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":446464,"data_stored":188111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.76100000000000001}]},{"osd":1,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":2.0059999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.85699999999999998}]},{"osd":2,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.80200000000000005}]},{"osd":3,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":0.78100000000000003}]},{"osd":5,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.38300000000000001}]},{"osd":6,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.59399999999999997}]},{"osd":7,"last update":"Wed Jan 31 05:05:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.434},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":0.56399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":189153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.40999999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.318},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.46600000000000003}]},{"osd":2,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.498}]},{"osd":4,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.753},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.67300000000000004}]},{"osd":6,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.78800000000000003}]},{"osd":7,"last update":"Wed Jan 31 05:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.79800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":442368,"data_stored":187577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:05:07 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.46000000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:05:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Wed Jan 31 05:05:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.376},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.52900000000000003}]},{"osd":4,"last update":"Wed Jan 31 05:05:07 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.747},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.76200000000000001}]},{"osd":5,"last update":"Wed Jan 31 05:05:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.72499999999999998}]},{"osd":6,"last update":"Wed Jan 31 05:05:07 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.70899999999999996}]},{"osd":7,"last update":"Wed Jan 31 05:05:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.68700000000000006}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":442368,"data_stored":187597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":4.556,"5min":4.556,"15min":4.556},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.34599999999999997}]},{"osd":2,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":6.3129999999999997,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":4.2619999999999996,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.497}]},{"osd":3,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.351,"5min":3.351,"15min":3.351},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":5.9139999999999997,"5min":5.9139999999999997,"15min":5.9139999999999997},"last":0.38600000000000001}]},{"osd":4,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":5.5599999999999996,"5min":5.5599999999999996,"15min":5.5599999999999996},"last":0.59199999999999997}]},{"osd":5,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":6.0190000000000001,"5min":6.0190000000000001,"15min":6.0190000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":4.0510000000000002,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.65600000000000003}]},{"osd":6,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":5.3620000000000001,"5min":5.3620000000000001,"15min":5.3620000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":3.7509999999999999,"5min":3.7509999999999999,"15min":3.7509999999999999},"last":0.69599999999999995}]},{"osd":7,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":5.8109999999999999,"5min":5.8109999999999999,"15min":5.8109999999999999},"last":0.57799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1036288,"data_stored":777909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.307},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.47599999999999998}]},{"osd":2,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.33100000000000002}]},{"osd":3,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.497}]},{"osd":4,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.73799999999999999}]},{"osd":5,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.71799999999999997}]},{"osd":6,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.69699999999999995}]},{"osd":7,"last update":"Wed Jan 31 05:05:04 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.70899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-31T05:05:57.054 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-31T05:05:57.054 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-31T05:05:57.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.236+0000 7f50e6400640 1 Processor -- start 2024-01-31T05:05:57.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.236+0000 7f50e6400640 1 -- start start 2024-01-31T05:05:57.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.236+0000 7f50e6400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e0159790 0x7f50e00b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:57.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.236+0000 7f50e6400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f50e0070d70 0x7f50e006d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:57.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.236+0000 7f50e6400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e00b2750 con 0x7f50e00b3d00 2024-01-31T05:05:57.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.236+0000 7f50e6400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e00b2a30 con 0x7f50e0070d70 2024-01-31T05:05:57.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.236+0000 7f50e6400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e00b2d10 con 0x7f50e0159790 2024-01-31T05:05:57.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.236+0000 7f50dfe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f50e0070d70 0x7f50e006d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:57.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.236+0000 7f50dfe00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f50e0070d70 0x7f50e006d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33658/0 (socket says 172.21.15.49:33658) 2024-01-31T05:05:57.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.236+0000 7f50dfe00640 1 -- 172.21.15.49:0/3674937012 learned_addr learned my addr 172.21.15.49:0/3674937012 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:57.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.240+0000 7f50df400640 1 --2- 172.21.15.49:0/3674937012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e0159790 0x7f50e00b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:57.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.240+0000 7f50dfe00640 1 -- 172.21.15.49:0/3674937012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e0159790 msgr2=0x7f50e00b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:57.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.240+0000 7f50dfe00640 1 --2- 172.21.15.49:0/3674937012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e0159790 0x7f50e00b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.240+0000 7f50dfe00640 1 -- 172.21.15.49:0/3674937012 >> v1:172.21.15.195:6789/0 conn(0x7f50e00b3d00 legacy=0x7f50e0070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:57.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.240+0000 7f50dfe00640 1 -- 172.21.15.49:0/3674937012 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e00b2ff0 con 0x7f50e0070d70 2024-01-31T05:05:57.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.240+0000 7f50df400640 1 --2- 172.21.15.49:0/3674937012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e0159790 0x7f50e00b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:57.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.240+0000 7f50dfe00640 1 --2- 172.21.15.49:0/3674937012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50e0070d70 0x7f50e006d2e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009e50 tx=0x7f50d801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0c15a100910787 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:57.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.240+0000 7f50de000640 1 -- 172.21.15.49:0/3674937012 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d80a58a0 con 0x7f50e0070d70 2024-01-31T05:05:57.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.240+0000 7f50de000640 1 -- 172.21.15.49:0/3674937012 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d80a5a00 con 0x7f50e0070d70 2024-01-31T05:05:57.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.240+0000 7f50de000640 1 -- 172.21.15.49:0/3674937012 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d80a5d90 con 0x7f50e0070d70 2024-01-31T05:05:57.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50e6400640 1 -- 172.21.15.49:0/3674937012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50e0070d70 msgr2=0x7f50e006d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:57.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50e6400640 1 --2- 172.21.15.49:0/3674937012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50e0070d70 0x7f50e006d2e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009e50 tx=0x7f50d801c9e0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50e6400640 1 -- 172.21.15.49:0/3674937012 shutdown_connections 2024-01-31T05:05:57.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50e6400640 1 --2- 172.21.15.49:0/3674937012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50e0070d70 0x7f50e006d2e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50e6400640 1 --2- 172.21.15.49:0/3674937012 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e0159790 0x7f50e00b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50e6400640 1 -- 172.21.15.49:0/3674937012 >> 172.21.15.49:0/3674937012 conn(0x7f50e00b09a0 msgr2=0x7f50e00b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:57.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50e6400640 1 -- 172.21.15.49:0/3674937012 shutdown_connections 2024-01-31T05:05:57.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50e6400640 1 -- 172.21.15.49:0/3674937012 wait complete. 2024-01-31T05:05:57.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50e6400640 1 Processor -- start 2024-01-31T05:05:57.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50e6400640 1 -- start start 2024-01-31T05:05:57.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50e6400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50e0070d70 0x7f50e0140010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:57.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50e6400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50e00b3d00 0x7f50e00ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:57.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50e6400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e0159790 0x7f50e01568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:57.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50e6400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e00ac050 con 0x7f50e00b3d00 2024-01-31T05:05:57.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50e6400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e00ccfc0 con 0x7f50e0070d70 2024-01-31T05:05:57.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50e6400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e00cd2a0 con 0x7f50e0159790 2024-01-31T05:05:57.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50dea00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50e00b3d00 0x7f50e00ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:57.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50df400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50e0070d70 0x7f50e0140010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:57.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50df400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50e0070d70 0x7f50e0140010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:56200/0 (socket says 172.21.15.49:56200) 2024-01-31T05:05:57.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50df400640 1 -- 172.21.15.49:0/4099605423 learned_addr learned my addr 172.21.15.49:0/4099605423 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:57.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.244+0000 7f50dfe00640 1 --2- 172.21.15.49:0/4099605423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e0159790 0x7f50e01568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:57.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.248+0000 7f50dea00640 1 -- 172.21.15.49:0/4099605423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e0159790 msgr2=0x7f50e01568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:57.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.248+0000 7f50dea00640 1 --2- 172.21.15.49:0/4099605423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e0159790 0x7f50e01568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.248+0000 7f50dea00640 1 -- 172.21.15.49:0/4099605423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50e0070d70 msgr2=0x7f50e0140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:57.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.248+0000 7f50dea00640 1 --2- 172.21.15.49:0/4099605423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50e0070d70 0x7f50e0140010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.248+0000 7f50dea00640 1 -- 172.21.15.49:0/4099605423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d8009b30 con 0x7f50e00b3d00 2024-01-31T05:05:57.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.248+0000 7f50dea00640 1 --2- 172.21.15.49:0/4099605423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50e00b3d00 0x7f50e00ac7c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f50c800c3c0 tx=0x7f50c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:57.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.248+0000 7f50d7400640 1 -- 172.21.15.49:0/4099605423 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c80052d0 con 0x7f50e00b3d00 2024-01-31T05:05:57.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.248+0000 7f50d7400640 1 -- 172.21.15.49:0/4099605423 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c8005430 con 0x7f50e00b3d00 2024-01-31T05:05:57.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.248+0000 7f50e6400640 1 -- 172.21.15.49:0/4099605423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e00cd580 con 0x7f50e00b3d00 2024-01-31T05:05:57.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.248+0000 7f50d7400640 1 -- 172.21.15.49:0/4099605423 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c8007260 con 0x7f50e00b3d00 2024-01-31T05:05:57.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.248+0000 7f50e6400640 1 -- 172.21.15.49:0/4099605423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e0140550 con 0x7f50e00b3d00 2024-01-31T05:05:57.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.248+0000 7f50e6400640 1 -- 172.21.15.49:0/4099605423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e0074860 con 0x7f50e00b3d00 2024-01-31T05:05:57.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.248+0000 7f50d7400640 1 -- 172.21.15.49:0/4099605423 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f50c80073c0 con 0x7f50e00b3d00 2024-01-31T05:05:57.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.252+0000 7f50d7400640 1 --2- 172.21.15.49:0/4099605423 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f50b8066500 0x7f50b80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:57.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.252+0000 7f50d7400640 1 -- 172.21.15.49:0/4099605423 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f50c80832e0 con 0x7f50e00b3d00 2024-01-31T05:05:57.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.252+0000 7f50df400640 1 --2- 172.21.15.49:0/4099605423 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f50b8066500 0x7f50b80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:57.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.252+0000 7f50df400640 1 --2- 172.21.15.49:0/4099605423 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f50b8066500 0x7f50b80689c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f50e01f6d00 tx=0x7f50d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:57.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.252+0000 7f50d7400640 1 -- 172.21.15.49:0/4099605423 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f50c8050450 con 0x7f50e00b3d00 2024-01-31T05:05:57.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.472+0000 7f50e6400640 1 -- 172.21.15.49:0/4099605423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f50e00cd770 con 0x7f50e00b3d00 2024-01-31T05:05:57.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.472+0000 7f50d7400640 1 -- 172.21.15.49:0/4099605423 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f50c8053a70 con 0x7f50e00b3d00 2024-01-31T05:05:57.476 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2024-01-31T05:05:57.476 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCZ1LllVFD5DBAAC6IpXFam5AMJ6kFP7OS6Wg== 2024-01-31T05:05:57.476 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow" 2024-01-31T05:05:57.476 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "allow r" 2024-01-31T05:05:57.476 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-01-31T05:05:57.477 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-01-31T05:05:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.476+0000 7f50e6400640 1 -- 172.21.15.49:0/4099605423 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f50b8066500 msgr2=0x7f50b80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.476+0000 7f50e6400640 1 --2- 172.21.15.49:0/4099605423 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f50b8066500 0x7f50b80689c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f50e01f6d00 tx=0x7f50d0008040 comp rx=0 tx=0).stop 2024-01-31T05:05:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.476+0000 7f50e6400640 1 -- 172.21.15.49:0/4099605423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50e00b3d00 msgr2=0x7f50e00ac7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.476+0000 7f50e6400640 1 --2- 172.21.15.49:0/4099605423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50e00b3d00 0x7f50e00ac7c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f50c800c3c0 tx=0x7f50c800c880 comp rx=0 tx=0).stop 2024-01-31T05:05:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.476+0000 7f50e6400640 1 -- 172.21.15.49:0/4099605423 shutdown_connections 2024-01-31T05:05:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.476+0000 7f50e6400640 1 --2- 172.21.15.49:0/4099605423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50e0159790 0x7f50e01568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.476+0000 7f50e6400640 1 --2- 172.21.15.49:0/4099605423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50e00b3d00 0x7f50e00ac7c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.476+0000 7f50e6400640 1 --2- 172.21.15.49:0/4099605423 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f50b8066500 0x7f50b80689c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.476+0000 7f50e6400640 1 --2- 172.21.15.49:0/4099605423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50e0070d70 0x7f50e0140010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.476+0000 7f50e6400640 1 -- 172.21.15.49:0/4099605423 >> 172.21.15.49:0/4099605423 conn(0x7f50e00b09a0 msgr2=0x7f50e014a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.476+0000 7f50e6400640 1 -- 172.21.15.49:0/4099605423 shutdown_connections 2024-01-31T05:05:57.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.476+0000 7f50e6400640 1 -- 172.21.15.49:0/4099605423 wait complete. 2024-01-31T05:05:57.498 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:05:57.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.636+0000 7f0701000640 1 Processor -- start 2024-01-31T05:05:57.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.636+0000 7f0701000640 1 -- start start 2024-01-31T05:05:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.640+0000 7f0701000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f06fc15b110 0x7f06fc06c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.640+0000 7f0701000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06fc0714e0 0x7f06fc0ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.640+0000 7f0701000640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06fc15b4f0 con 0x7f06fc0cdf10 2024-01-31T05:05:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.640+0000 7f0701000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06fc0ce460 con 0x7f06fc15b110 2024-01-31T05:05:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.640+0000 7f0701000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0abf20 con 0x7f06fc0714e0 2024-01-31T05:05:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.640+0000 7f06f9e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f06fc15b110 0x7f06fc06c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.640+0000 7f06f9400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f06fc0cdf10 0x7f06fc070dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:49822/0 (socket says 172.21.15.49:49822) 2024-01-31T05:05:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.640+0000 7f06f9400640 1 -- 172.21.15.49:0/674829837 learned_addr learned my addr 172.21.15.49:0/674829837 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:57.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.640+0000 7f06fa800640 1 --2- 172.21.15.49:0/674829837 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06fc0714e0 0x7f06fc0ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:57.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.640+0000 7f06f9e00640 1 -- 172.21.15.49:0/674829837 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06fc0714e0 msgr2=0x7f06fc0ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:57.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.640+0000 7f06f9e00640 1 --2- 172.21.15.49:0/674829837 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06fc0714e0 0x7f06fc0ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.640+0000 7f06f9e00640 1 -- 172.21.15.49:0/674829837 >> v1:172.21.15.49:6789/0 conn(0x7f06fc0cdf10 legacy=0x7f06fc070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:57.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.640+0000 7f06f9e00640 1 -- 172.21.15.49:0/674829837 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc0ac200 con 0x7f06fc15b110 2024-01-31T05:05:57.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.640+0000 7f06f8a00640 1 -- 172.21.15.49:0/674829837 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107594242 0 0) 0x7f06e4001120 con 0x7f06fc0cdf10 2024-01-31T05:05:57.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.644+0000 7f06f9e00640 1 --2- 172.21.15.49:0/674829837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06fc15b110 0x7f06fc06c2d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0097c0 tx=0x7f06ec01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6944db43aa1ca03c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:57.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.644+0000 7f06f8a00640 1 -- 172.21.15.49:0/674829837 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0ab670 con 0x7f06fc15b110 2024-01-31T05:05:57.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.644+0000 7f06f8a00640 1 -- 172.21.15.49:0/674829837 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec0ab7d0 con 0x7f06fc15b110 2024-01-31T05:05:57.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.644+0000 7f06f8a00640 1 -- 172.21.15.49:0/674829837 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0abb60 con 0x7f06fc15b110 2024-01-31T05:05:57.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.644+0000 7f0701000640 1 -- 172.21.15.49:0/674829837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06fc15b110 msgr2=0x7f06fc06c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:57.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.644+0000 7f0701000640 1 --2- 172.21.15.49:0/674829837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06fc15b110 0x7f06fc06c2d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0097c0 tx=0x7f06ec01c450 comp rx=0 tx=0).stop 2024-01-31T05:05:57.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.644+0000 7f0701000640 1 -- 172.21.15.49:0/674829837 shutdown_connections 2024-01-31T05:05:57.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.644+0000 7f0701000640 1 --2- 172.21.15.49:0/674829837 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06fc0714e0 0x7f06fc0ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.644+0000 7f0701000640 1 --2- 172.21.15.49:0/674829837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06fc15b110 0x7f06fc06c2d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.644+0000 7f0701000640 1 -- 172.21.15.49:0/674829837 >> 172.21.15.49:0/674829837 conn(0x7f06fc0b09a0 msgr2=0x7f06fc0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:57.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.644+0000 7f0701000640 1 -- 172.21.15.49:0/674829837 shutdown_connections 2024-01-31T05:05:57.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.644+0000 7f0701000640 1 -- 172.21.15.49:0/674829837 wait complete. 2024-01-31T05:05:57.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.644+0000 7f0701000640 1 Processor -- start 2024-01-31T05:05:57.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.644+0000 7f0701000640 1 -- start start 2024-01-31T05:05:57.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f0701000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06fc0714e0 0x7f06fc148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:57.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f0701000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06fc0cdf10 0x7f06fc1489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:57.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f0701000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06fc15b110 0x7f06fc09b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:57.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f0701000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc14a560 con 0x7f06fc0cdf10 2024-01-31T05:05:57.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f0701000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc1494c0 con 0x7f06fc0714e0 2024-01-31T05:05:57.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f0701000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc1497a0 con 0x7f06fc15b110 2024-01-31T05:05:57.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f06f9400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06fc0cdf10 0x7f06fc1489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:57.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f06f9400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06fc0cdf10 0x7f06fc1489e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33688/0 (socket says 172.21.15.49:33688) 2024-01-31T05:05:57.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f06f9400640 1 -- 172.21.15.49:0/4084505547 learned_addr learned my addr 172.21.15.49:0/4084505547 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:57.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f06fa800640 1 --2- 172.21.15.49:0/4084505547 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06fc15b110 0x7f06fc09b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:57.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f06f9e00640 1 --2- 172.21.15.49:0/4084505547 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06fc0714e0 0x7f06fc148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:57.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f06f9400640 1 -- 172.21.15.49:0/4084505547 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06fc15b110 msgr2=0x7f06fc09b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:57.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f06f9400640 1 --2- 172.21.15.49:0/4084505547 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06fc15b110 0x7f06fc09b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f06f9400640 1 -- 172.21.15.49:0/4084505547 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06fc0714e0 msgr2=0x7f06fc148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:57.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f06f9400640 1 --2- 172.21.15.49:0/4084505547 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06fc0714e0 0x7f06fc148210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f06f9400640 1 -- 172.21.15.49:0/4084505547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec009420 con 0x7f06fc0cdf10 2024-01-31T05:05:57.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f06f9400640 1 --2- 172.21.15.49:0/4084505547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06fc0cdf10 0x7f06fc1489e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f06e400c780 tx=0x7f06e400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:57.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f06f2000640 1 -- 172.21.15.49:0/4084505547 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e40072d0 con 0x7f06fc0cdf10 2024-01-31T05:05:57.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f06f2000640 1 -- 172.21.15.49:0/4084505547 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e4007450 con 0x7f06fc0cdf10 2024-01-31T05:05:57.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f06f2000640 1 -- 172.21.15.49:0/4084505547 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e40047f0 con 0x7f06fc0cdf10 2024-01-31T05:05:57.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f0701000640 1 -- 172.21.15.49:0/4084505547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06fc149a80 con 0x7f06fc0cdf10 2024-01-31T05:05:57.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f0701000640 1 -- 172.21.15.49:0/4084505547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06fc14a040 con 0x7f06fc0cdf10 2024-01-31T05:05:57.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f0701000640 1 -- 172.21.15.49:0/4084505547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06fc14a260 con 0x7f06fc0cdf10 2024-01-31T05:05:57.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.648+0000 7f06f2000640 1 -- 172.21.15.49:0/4084505547 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f06e4004950 con 0x7f06fc0cdf10 2024-01-31T05:05:57.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.652+0000 7f06f2000640 1 --2- 172.21.15.49:0/4084505547 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f06d4066500 0x7f06d40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:57.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.652+0000 7f06f2000640 1 -- 172.21.15.49:0/4084505547 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f06e40830b0 con 0x7f06fc0cdf10 2024-01-31T05:05:57.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.652+0000 7f06f9e00640 1 --2- 172.21.15.49:0/4084505547 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f06d4066500 0x7f06d40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:57.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.652+0000 7f06f9e00640 1 --2- 172.21.15.49:0/4084505547 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f06d4066500 0x7f06d40689c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0af000 tx=0x7f06ec0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:57.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.656+0000 7f06f2000640 1 -- 172.21.15.49:0/4084505547 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f06e40502b0 con 0x7f06fc0cdf10 2024-01-31T05:05:57.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.848+0000 7f0701000640 1 -- 172.21.15.49:0/4084505547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06fc074860 con 0x7f06fc0cdf10 2024-01-31T05:05:57.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.848+0000 7f06f2000640 1 -- 172.21.15.49:0/4084505547 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f06e4018090 con 0x7f06fc0cdf10 2024-01-31T05:05:57.850 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:05:57.850 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5078,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3747440713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3747440713},{"type":"v1","addr":"172.21.15.195:6837","nonce":3747440713}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2835620509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2835620509},{"type":"v1","addr":"172.21.15.195:6836","nonce":2835620509}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2080191803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2080191803},{"type":"v1","addr":"172.21.15.49:6833","nonce":2080191803}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-31T05:05:51.919747+0000","modified":"2024-01-31T05:05:54.941384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5493":{"gid":5493,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6835/4235056900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4235056900},{"type":"v1","addr":"172.21.15.49:6835","nonce":4235056900}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-31T05:05:57.850 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 19 2024-01-31T05:05:57.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.848+0000 7f0701000640 1 -- 172.21.15.49:0/4084505547 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f06d4066500 msgr2=0x7f06d40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:57.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.848+0000 7f0701000640 1 --2- 172.21.15.49:0/4084505547 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f06d4066500 0x7f06d40689c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0af000 tx=0x7f06ec0a7000 comp rx=0 tx=0).stop 2024-01-31T05:05:57.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.848+0000 7f0701000640 1 -- 172.21.15.49:0/4084505547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06fc0cdf10 msgr2=0x7f06fc1489e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:57.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.848+0000 7f0701000640 1 --2- 172.21.15.49:0/4084505547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06fc0cdf10 0x7f06fc1489e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f06e400c780 tx=0x7f06e400cc40 comp rx=0 tx=0).stop 2024-01-31T05:05:57.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.848+0000 7f0701000640 1 -- 172.21.15.49:0/4084505547 shutdown_connections 2024-01-31T05:05:57.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.848+0000 7f0701000640 1 --2- 172.21.15.49:0/4084505547 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f06fc15b110 0x7f06fc09b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.848+0000 7f0701000640 1 --2- 172.21.15.49:0/4084505547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06fc0cdf10 0x7f06fc1489e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.848+0000 7f0701000640 1 --2- 172.21.15.49:0/4084505547 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f06d4066500 0x7f06d40689c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.848+0000 7f0701000640 1 --2- 172.21.15.49:0/4084505547 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06fc0714e0 0x7f06fc148210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.848+0000 7f0701000640 1 -- 172.21.15.49:0/4084505547 >> 172.21.15.49:0/4084505547 conn(0x7f06fc0b09a0 msgr2=0x7f06fc0b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:57.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.848+0000 7f0701000640 1 -- 172.21.15.49:0/4084505547 shutdown_connections 2024-01-31T05:05:57.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:57.848+0000 7f0701000640 1 -- 172.21.15.49:0/4084505547 wait complete. 2024-01-31T05:05:58.274 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-31T05:05:51.919747+0000', 'modified': '2024-01-31T05:05:54.941384+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5493}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5493': {'gid': 5493, 'name': 'a', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.49:6835/4235056900', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6834', 'nonce': 4235056900}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 4235056900}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-31T05:05:58.274 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-31T05:05:58.274 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-31T05:05:58.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.424+0000 7fe84aa00640 1 Processor -- start 2024-01-31T05:05:58.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.424+0000 7fe84aa00640 1 -- start start 2024-01-31T05:05:58.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.424+0000 7fe84aa00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe84406f4b0 0x7fe8440cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.424+0000 7fe84aa00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8440cb990 con 0x7fe84415d3a0 2024-01-31T05:05:58.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.424+0000 7fe84aa00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8440d1c20 con 0x7fe84406f020 2024-01-31T05:05:58.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.424+0000 7fe84aa00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8440cfed0 con 0x7fe84406f4b0 2024-01-31T05:05:58.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.424+0000 7fe843e00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fe84415d3a0 0x7fe84406e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48562/0 (socket says 172.21.15.49:48562) 2024-01-31T05:05:58.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.424+0000 7fe843e00640 1 -- 172.21.15.49:0/13415873 learned_addr learned my addr 172.21.15.49:0/13415873 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:58.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.424+0000 7fe848a00640 1 --2- 172.21.15.49:0/13415873 >> v2:172.21.15.195:3300/0 conn(0x7fe84406f4b0 0x7fe8440cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.424+0000 7fe842a00640 1 -- 172.21.15.49:0/13415873 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549259434 0 0) 0x7fe8440cb990 con 0x7fe84415d3a0 2024-01-31T05:05:58.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.424+0000 7fe842a00640 1 -- 172.21.15.49:0/13415873 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe824003530 con 0x7fe84415d3a0 2024-01-31T05:05:58.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.424+0000 7fe842a00640 1 -- 172.21.15.49:0/13415873 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101930443 0 0) 0x7fe8440d1c20 con 0x7fe84406f020 2024-01-31T05:05:58.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.424+0000 7fe842a00640 1 -- 172.21.15.49:0/13415873 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8440cb990 con 0x7fe84406f020 2024-01-31T05:05:58.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.424+0000 7fe848a00640 1 -- 172.21.15.49:0/13415873 >> v1:172.21.15.195:6789/0 conn(0x7fe84406f020 legacy=0x7fe8440cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:58.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.424+0000 7fe848a00640 1 -- 172.21.15.49:0/13415873 >> v1:172.21.15.49:6789/0 conn(0x7fe84415d3a0 legacy=0x7fe84406e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:58.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.424+0000 7fe848a00640 1 -- 172.21.15.49:0/13415873 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8440d01b0 con 0x7fe84406f4b0 2024-01-31T05:05:58.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.428+0000 7fe848a00640 1 --2- 172.21.15.49:0/13415873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe84406f4b0 0x7fe8440cc530 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009d90 tx=0x7fe83c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=240266d923536df6 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:58.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.428+0000 7fe842a00640 1 -- 172.21.15.49:0/13415873 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c0a59a0 con 0x7fe84406f4b0 2024-01-31T05:05:58.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.428+0000 7fe842a00640 1 -- 172.21.15.49:0/13415873 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c0a5b00 con 0x7fe84406f4b0 2024-01-31T05:05:58.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.428+0000 7fe842a00640 1 -- 172.21.15.49:0/13415873 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c0a5e90 con 0x7fe84406f4b0 2024-01-31T05:05:58.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.428+0000 7fe84aa00640 1 -- 172.21.15.49:0/13415873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe84406f4b0 msgr2=0x7fe8440cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:58.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.428+0000 7fe84aa00640 1 --2- 172.21.15.49:0/13415873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe84406f4b0 0x7fe8440cc530 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009d90 tx=0x7fe83c01c950 comp rx=0 tx=0).stop 2024-01-31T05:05:58.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.428+0000 7fe84aa00640 1 -- 172.21.15.49:0/13415873 shutdown_connections 2024-01-31T05:05:58.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.428+0000 7fe84aa00640 1 --2- 172.21.15.49:0/13415873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe84406f4b0 0x7fe8440cc530 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.428+0000 7fe84aa00640 1 -- 172.21.15.49:0/13415873 >> 172.21.15.49:0/13415873 conn(0x7fe8440d0e50 msgr2=0x7fe8440d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:58.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.428+0000 7fe84aa00640 1 -- 172.21.15.49:0/13415873 shutdown_connections 2024-01-31T05:05:58.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.428+0000 7fe84aa00640 1 -- 172.21.15.49:0/13415873 wait complete. 2024-01-31T05:05:58.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe84aa00640 1 Processor -- start 2024-01-31T05:05:58.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe84aa00640 1 -- start start 2024-01-31T05:05:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe84aa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe84406f020 0x7fe8440c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe84aa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe84406f4b0 0x7fe8440cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe84aa00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe84415d3a0 0x7fe8440cda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe84aa00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe844152070 con 0x7fe84406f4b0 2024-01-31T05:05:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe84aa00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe844152c50 con 0x7fe84415d3a0 2024-01-31T05:05:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe84aa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440c7890 con 0x7fe84406f020 2024-01-31T05:05:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe843400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe84406f4b0 0x7fe8440cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe843400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe84406f4b0 0x7fe8440cd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57598/0 (socket says 172.21.15.49:57598) 2024-01-31T05:05:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe843400640 1 -- 172.21.15.49:0/3284537599 learned_addr learned my addr 172.21.15.49:0/3284537599 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:58.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe848a00640 1 --2- 172.21.15.49:0/3284537599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe84415d3a0 0x7fe8440cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe843e00640 1 --2- 172.21.15.49:0/3284537599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe84406f020 0x7fe8440c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe848a00640 1 -- 172.21.15.49:0/3284537599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe84406f020 msgr2=0x7fe8440c51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe848a00640 1 --2- 172.21.15.49:0/3284537599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe84406f020 0x7fe8440c51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe848a00640 1 -- 172.21.15.49:0/3284537599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe84406f4b0 msgr2=0x7fe8440cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe848a00640 1 --2- 172.21.15.49:0/3284537599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe84406f4b0 0x7fe8440cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe848a00640 1 -- 172.21.15.49:0/3284537599 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c009a70 con 0x7fe84415d3a0 2024-01-31T05:05:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe843400640 1 --2- 172.21.15.49:0/3284537599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe84406f4b0 0x7fe8440cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe848a00640 1 --2- 172.21.15.49:0/3284537599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe84415d3a0 0x7fe8440cda00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0ac000 tx=0x7fe8440cd280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe83be00640 1 -- 172.21.15.49:0/3284537599 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c0add20 con 0x7fe84415d3a0 2024-01-31T05:05:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe83be00640 1 -- 172.21.15.49:0/3284537599 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c0ade80 con 0x7fe84415d3a0 2024-01-31T05:05:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe83be00640 1 -- 172.21.15.49:0/3284537599 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c0b8640 con 0x7fe84415d3a0 2024-01-31T05:05:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe84aa00640 1 -- 172.21.15.49:0/3284537599 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe844152360 con 0x7fe84415d3a0 2024-01-31T05:05:58.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.432+0000 7fe84aa00640 1 -- 172.21.15.49:0/3284537599 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8441528e0 con 0x7fe84415d3a0 2024-01-31T05:05:58.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.436+0000 7fe83be00640 1 -- 172.21.15.49:0/3284537599 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fe83c0b4040 con 0x7fe84415d3a0 2024-01-31T05:05:58.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.436+0000 7fe83be00640 1 --2- 172.21.15.49:0/3284537599 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe81c066500 0x7fe81c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.436+0000 7fe83be00640 1 -- 172.21.15.49:0/3284537599 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe83c11ed90 con 0x7fe84415d3a0 2024-01-31T05:05:58.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.436+0000 7fe84df2d000 1 Processor -- start 2024-01-31T05:05:58.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.436+0000 7fe843e00640 1 --2- 172.21.15.49:0/3284537599 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe81c066500 0x7fe81c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.436+0000 7fe84df2d000 1 -- start start 2024-01-31T05:05:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe84df2d000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 0x5602d2945b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe843e00640 1 --2- 172.21.15.49:0/3284537599 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe81c066500 0x7fe81c0689c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe834000f70 tx=0x7fe834007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe84df2d000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d2946090 0x5602d28fb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe84df2d000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d28fbc10 0x5602d28fbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe84df2d000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d2765720 con 0x5602d2945770 2024-01-31T05:05:58.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe84df2d000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d2753d70 con 0x5602d28fbc10 2024-01-31T05:05:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe84df2d000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602d27512a0 con 0x5602d2946090 2024-01-31T05:05:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe843e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 0x5602d2945b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe848a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d28fbc10 0x5602d28fbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe843400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d2946090 0x5602d28fb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe848a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d28fbc10 0x5602d28fbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:58352/0 (socket says 172.21.15.49:58352) 2024-01-31T05:05:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe843e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 0x5602d2945b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57610/0 (socket says 172.21.15.49:57610) 2024-01-31T05:05:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe848a00640 1 -- 172.21.15.49:0/2406026474 learned_addr learned my addr 172.21.15.49:0/2406026474 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe843e00640 1 -- 172.21.15.49:0/2406026474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d2946090 msgr2=0x5602d28fb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe843e00640 1 --2- 172.21.15.49:0/2406026474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d2946090 0x5602d28fb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe843e00640 1 -- 172.21.15.49:0/2406026474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d28fbc10 msgr2=0x5602d28fbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe843e00640 1 --2- 172.21.15.49:0/2406026474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d28fbc10 0x5602d28fbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe843e00640 1 -- 172.21.15.49:0/2406026474 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602d2443890 con 0x5602d2945770 2024-01-31T05:05:58.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe848a00640 1 --2- 172.21.15.49:0/2406026474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d28fbc10 0x5602d28fbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe843e00640 1 --2- 172.21.15.49:0/2406026474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 0x5602d2945b50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe8340011f0 tx=0x7fe834012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b947f4e96123133d server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe838c00640 1 -- 172.21.15.49:0/2406026474 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8340014f0 con 0x5602d2945770 2024-01-31T05:05:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe838c00640 1 -- 172.21.15.49:0/2406026474 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe834001650 con 0x5602d2945770 2024-01-31T05:05:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe838c00640 1 -- 172.21.15.49:0/2406026474 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8340019c0 con 0x5602d2945770 2024-01-31T05:05:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe84df2d000 1 -- 172.21.15.49:0/2406026474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 msgr2=0x5602d2945b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe84df2d000 1 --2- 172.21.15.49:0/2406026474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 0x5602d2945b50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe8340011f0 tx=0x7fe834012000 comp rx=0 tx=0).stop 2024-01-31T05:05:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe84df2d000 1 -- 172.21.15.49:0/2406026474 shutdown_connections 2024-01-31T05:05:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe84df2d000 1 --2- 172.21.15.49:0/2406026474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d28fbc10 0x5602d28fbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe84df2d000 1 --2- 172.21.15.49:0/2406026474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d2946090 0x5602d28fb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe84df2d000 1 --2- 172.21.15.49:0/2406026474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 0x5602d2945b50 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe84df2d000 1 -- 172.21.15.49:0/2406026474 >> 172.21.15.49:0/2406026474 conn(0x5602d2901f80 msgr2=0x5602d28f9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:58.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe84df2d000 1 -- 172.21.15.49:0/2406026474 shutdown_connections 2024-01-31T05:05:58.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe84df2d000 1 -- 172.21.15.49:0/2406026474 wait complete. 2024-01-31T05:05:58.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe84df2d000 1 -- start start 2024-01-31T05:05:58.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.440+0000 7fe84df2d000 1 Processor -- start 2024-01-31T05:05:58.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe84df2d000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d28fbc10 0x5602d2906b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe84df2d000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d2945770 0x5602d2907060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe84df2d000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2946090 0x5602d29075a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe84df2d000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d274cb90 con 0x5602d2946090 2024-01-31T05:05:58.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe84df2d000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d27094c0 con 0x5602d2945770 2024-01-31T05:05:58.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe84df2d000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602d2707e10 con 0x5602d28fbc10 2024-01-31T05:05:58.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe84df2d000 10 client.0 _ll_register_callbacks cb 0x5602d2702be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:05:58.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe848a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2946090 0x5602d29075a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe843400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d2945770 0x5602d2907060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe843e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d28fbc10 0x5602d2906b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe848a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2946090 0x5602d29075a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57620/0 (socket says 172.21.15.49:57620) 2024-01-31T05:05:58.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe848a00640 1 -- 172.21.15.49:0/3833024658 learned_addr learned my addr 172.21.15.49:0/3833024658 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:58.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe848a00640 1 -- 172.21.15.49:0/3833024658 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d28fbc10 msgr2=0x5602d2906b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:58.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe848a00640 1 --2- 172.21.15.49:0/3833024658 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d28fbc10 0x5602d2906b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe848a00640 1 -- 172.21.15.49:0/3833024658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d2945770 msgr2=0x5602d2907060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:58.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe848a00640 1 --2- 172.21.15.49:0/3833024658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d2945770 0x5602d2907060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe848a00640 1 -- 172.21.15.49:0/3833024658 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8441528e0 con 0x5602d2946090 2024-01-31T05:05:58.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe848a00640 1 --2- 172.21.15.49:0/3833024658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2946090 0x5602d29075a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe83c01ce30 tx=0x7fe83c009450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd336eb04285c3e8 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:58.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe831600640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-31T05:05:58.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe831600640 1 -- 172.21.15.49:0/3833024658 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c0f0090 con 0x5602d2946090 2024-01-31T05:05:58.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe831600640 1 -- 172.21.15.49:0/3833024658 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe83c0f7e80 con 0x5602d2946090 2024-01-31T05:05:58.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe84df2d000 1 -- 172.21.15.49:0/3833024658 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5602d26d2e30 con 0x5602d2946090 2024-01-31T05:05:58.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe831600640 1 -- 172.21.15.49:0/3833024658 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe83c107100 con 0x5602d2946090 2024-01-31T05:05:58.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe84df2d000 10 client.5655 fetch_fsmap learned FSMap version 19 2024-01-31T05:05:58.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe84df2d000 1 -- 172.21.15.49:0/3833024658 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x7fe824003530 con 0x5602d2946090 2024-01-31T05:05:58.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe831600640 1 -- 172.21.15.49:0/3833024658 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c11b020 con 0x5602d2946090 2024-01-31T05:05:58.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe831600640 1 -- 172.21.15.49:0/3833024658 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 19) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe83c005d20 con 0x5602d2946090 2024-01-31T05:05:58.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe84df2d000 10 client.5655 fetch_fsmap finished waiting for FSMap version 19 2024-01-31T05:05:58.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe84df2d000 10 client.5655 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-31T05:05:58.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe84df2d000 20 client.5655 populate_metadata read hostname 'smithi049' 2024-01-31T05:05:58.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe84df2d000 1 --2- 172.21.15.49:0/3833024658 >> [v2:172.21.15.49:6834/4235056900,v1:172.21.15.49:6835/4235056900] conn(0x5602d2907e70 0x5602d2956ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe84df2d000 4 client.5655 mds_command: new command op to 5493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:05:58.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe84df2d000 1 -- 172.21.15.49:0/3833024658 --> [v2:172.21.15.49:6834/4235056900,v1:172.21.15.49:6835/4235056900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5602d2779bd0 con 0x5602d2907e70 2024-01-31T05:05:58.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe843e00640 1 --2- 172.21.15.49:0/3833024658 >> [v2:172.21.15.49:6834/4235056900,v1:172.21.15.49:6835/4235056900] conn(0x5602d2907e70 0x5602d2956ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe843e00640 1 --2- 172.21.15.49:0/3833024658 >> [v2:172.21.15.49:6834/4235056900,v1:172.21.15.49:6835/4235056900] conn(0x5602d2907e70 0x5602d2956ef0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6ec422aa6299832 server_cookie=bc27f5aed64af05 in_seq=0 out_seq=0 2024-01-31T05:05:58.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.444+0000 7fe831600640 10 client.5655 ms_handle_connect on v2:172.21.15.49:6834/4235056900 2024-01-31T05:05:58.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.448+0000 7fe831600640 1 -- 172.21.15.49:0/3833024658 <== mds.0 v2:172.21.15.49:6834/4235056900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5602d2779bd0 con 0x5602d2907e70 2024-01-31T05:05:58.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.448+0000 7fe831600640 10 client.5655 handle_command_reply: tid=0 2024-01-31T05:05:58.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.448+0000 7fe84df2d000 1 client.5655 shutdown 2024-01-31T05:05:58.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.448+0000 7fe84df2d000 1 -- 172.21.15.49:0/3833024658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2946090 msgr2=0x5602d29075a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:58.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.448+0000 7fe84df2d000 1 --2- 172.21.15.49:0/3833024658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2946090 0x5602d29075a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe83c01ce30 tx=0x7fe83c009450 comp rx=0 tx=0).stop 2024-01-31T05:05:58.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.448+0000 7fe84df2d000 1 -- 172.21.15.49:0/3833024658 shutdown_connections 2024-01-31T05:05:58.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.448+0000 7fe84df2d000 1 --2- 172.21.15.49:0/3833024658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2946090 0x5602d29075a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.448+0000 7fe84df2d000 1 --2- 172.21.15.49:0/3833024658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d2945770 0x5602d2907060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.448+0000 7fe84df2d000 1 --2- 172.21.15.49:0/3833024658 >> [v2:172.21.15.49:6834/4235056900,v1:172.21.15.49:6835/4235056900] conn(0x5602d2907e70 0x5602d2956ef0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.448+0000 7fe84df2d000 1 --2- 172.21.15.49:0/3833024658 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d28fbc10 0x5602d2906b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.448+0000 7fe84df2d000 1 -- 172.21.15.49:0/3833024658 >> 172.21.15.49:0/3833024658 conn(0x5602d2901f80 msgr2=0x5602d28fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:58.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.448+0000 7fe831600640 0 client.5655 ms_handle_reset on v2:172.21.15.49:6834/4235056900 2024-01-31T05:05:58.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.448+0000 7fe84df2d000 1 -- 172.21.15.49:0/3833024658 shutdown_connections 2024-01-31T05:05:58.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.448+0000 7fe84df2d000 1 -- 172.21.15.49:0/3833024658 wait complete. 2024-01-31T05:05:58.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.448+0000 7fe84df2d000 20 client.5655 trim_cache size 0 max 16384 2024-01-31T05:05:58.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe84df2d000 1 Processor -- start 2024-01-31T05:05:58.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe84df2d000 1 -- start start 2024-01-31T05:05:58.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe84df2d000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d28fbc10 0x5602d2955ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe84df2d000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 0x5602d2956430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe84df2d000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d2946090 0x5602d2956970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe84df2d000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d2404940 con 0x5602d2945770 2024-01-31T05:05:58.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe84df2d000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d28f4a40 con 0x5602d2946090 2024-01-31T05:05:58.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe84df2d000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602d2718070 con 0x5602d28fbc10 2024-01-31T05:05:58.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe843400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 0x5602d2956430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe843400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 0x5602d2956430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57624/0 (socket says 172.21.15.49:57624) 2024-01-31T05:05:58.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe843400640 1 -- 172.21.15.49:0/1336450327 learned_addr learned my addr 172.21.15.49:0/1336450327 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:58.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe843e00640 1 --2- 172.21.15.49:0/1336450327 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d28fbc10 0x5602d2955ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe848a00640 1 --2- 172.21.15.49:0/1336450327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d2946090 0x5602d2956970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe843400640 1 -- 172.21.15.49:0/1336450327 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d28fbc10 msgr2=0x5602d2955ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:58.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe843400640 1 --2- 172.21.15.49:0/1336450327 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d28fbc10 0x5602d2955ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe843400640 1 -- 172.21.15.49:0/1336450327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d2946090 msgr2=0x5602d2956970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:58.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe843400640 1 --2- 172.21.15.49:0/1336450327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d2946090 0x5602d2956970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe843400640 1 -- 172.21.15.49:0/1336450327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602d270cb80 con 0x5602d2945770 2024-01-31T05:05:58.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe843400640 1 --2- 172.21.15.49:0/1336450327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 0x5602d2956430 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe8441f9740 tx=0x7fe82c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fbb00a1dd617707 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:58.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe833e00640 1 -- 172.21.15.49:0/1336450327 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c015ec0 con 0x5602d2945770 2024-01-31T05:05:58.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe833e00640 1 -- 172.21.15.49:0/1336450327 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c0050d0 con 0x5602d2945770 2024-01-31T05:05:58.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe833e00640 1 -- 172.21.15.49:0/1336450327 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c005440 con 0x5602d2945770 2024-01-31T05:05:58.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe84df2d000 1 -- 172.21.15.49:0/1336450327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 msgr2=0x5602d2956430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:58.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe84df2d000 1 --2- 172.21.15.49:0/1336450327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 0x5602d2956430 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe8441f9740 tx=0x7fe82c007dd0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe84df2d000 1 -- 172.21.15.49:0/1336450327 shutdown_connections 2024-01-31T05:05:58.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe84df2d000 1 --2- 172.21.15.49:0/1336450327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d2946090 0x5602d2956970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe84df2d000 1 --2- 172.21.15.49:0/1336450327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 0x5602d2956430 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe84df2d000 1 --2- 172.21.15.49:0/1336450327 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d28fbc10 0x5602d2955ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe84df2d000 1 -- 172.21.15.49:0/1336450327 >> 172.21.15.49:0/1336450327 conn(0x5602d2901f80 msgr2=0x5602d2900630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:58.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe84df2d000 1 -- 172.21.15.49:0/1336450327 shutdown_connections 2024-01-31T05:05:58.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.464+0000 7fe84df2d000 1 -- 172.21.15.49:0/1336450327 wait complete. 2024-01-31T05:05:58.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe84df2d000 1 -- start start 2024-01-31T05:05:58.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe84df2d000 1 Processor -- start 2024-01-31T05:05:58.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe84df2d000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d28fbc10 0x5602d29a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe84df2d000 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 0x5602d29a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe84df2d000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d2946090 0x5602d2960970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe84df2d000 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d278dcf0 con 0x5602d2945770 2024-01-31T05:05:58.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe84df2d000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d2748500 con 0x5602d28fbc10 2024-01-31T05:05:58.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe84df2d000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602d28fea40 con 0x5602d2946090 2024-01-31T05:05:58.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe84df2d000 10 client.0 _ll_register_callbacks cb 0x5602d2746300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:05:58.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe843400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 0x5602d29a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe843400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 0x5602d29a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57640/0 (socket says 172.21.15.49:57640) 2024-01-31T05:05:58.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe843400640 1 -- 172.21.15.49:0/3572718196 learned_addr learned my addr 172.21.15.49:0/3572718196 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:58.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe848a00640 1 --2- 172.21.15.49:0/3572718196 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d2946090 0x5602d2960970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe843e00640 1 --2- 172.21.15.49:0/3572718196 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d28fbc10 0x5602d29a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe843400640 1 -- 172.21.15.49:0/3572718196 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d2946090 msgr2=0x5602d2960970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:58.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe843400640 1 --2- 172.21.15.49:0/3572718196 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d2946090 0x5602d2960970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe843400640 1 -- 172.21.15.49:0/3572718196 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d28fbc10 msgr2=0x5602d29a58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:58.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe843400640 1 --2- 172.21.15.49:0/3572718196 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d28fbc10 0x5602d29a58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe843400640 1 -- 172.21.15.49:0/3572718196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8440cb990 con 0x5602d2945770 2024-01-31T05:05:58.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe843400640 1 --2- 172.21.15.49:0/3572718196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 0x5602d29a5e30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x5602d27a23a0 tx=0x7fe82c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99647b12c208b561 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:58.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe831600640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-01-31T05:05:58.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe831600640 1 -- 172.21.15.49:0/3572718196 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c025070 con 0x5602d2945770 2024-01-31T05:05:58.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe831600640 1 -- 172.21.15.49:0/3572718196 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe82c003600 con 0x5602d2945770 2024-01-31T05:05:58.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe84df2d000 1 -- 172.21.15.49:0/3572718196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5602d2700640 con 0x5602d2945770 2024-01-31T05:05:58.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe831600640 1 -- 172.21.15.49:0/3572718196 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe82c015ec0 con 0x5602d2945770 2024-01-31T05:05:58.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe84df2d000 10 client.5661 fetch_fsmap learned FSMap version 19 2024-01-31T05:05:58.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe84df2d000 1 -- 172.21.15.49:0/3572718196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x5602d26f2bd0 con 0x5602d2945770 2024-01-31T05:05:58.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe831600640 1 -- 172.21.15.49:0/3572718196 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5602d2700640 con 0x5602d2945770 2024-01-31T05:05:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe831600640 1 -- 172.21.15.49:0/3572718196 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 19) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe82c012050 con 0x5602d2945770 2024-01-31T05:05:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe84df2d000 10 client.5661 fetch_fsmap finished waiting for FSMap version 19 2024-01-31T05:05:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe84df2d000 10 client.5661 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-31T05:05:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe84df2d000 20 client.5661 populate_metadata read hostname 'smithi049' 2024-01-31T05:05:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe84df2d000 1 --2- 172.21.15.49:0/3572718196 >> [v2:172.21.15.49:6834/4235056900,v1:172.21.15.49:6835/4235056900] conn(0x5602d29ac7c0 0x5602d2961390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe84df2d000 4 client.5661 mds_command: new command op to 5493 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-31T05:05:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe84df2d000 1 -- 172.21.15.49:0/3572718196 --> [v2:172.21.15.49:6834/4235056900,v1:172.21.15.49:6835/4235056900] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5602d2745a20 con 0x5602d29ac7c0 2024-01-31T05:05:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.468+0000 7fe843e00640 1 --2- 172.21.15.49:0/3572718196 >> [v2:172.21.15.49:6834/4235056900,v1:172.21.15.49:6835/4235056900] conn(0x5602d29ac7c0 0x5602d2961390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe843e00640 1 --2- 172.21.15.49:0/3572718196 >> [v2:172.21.15.49:6834/4235056900,v1:172.21.15.49:6835/4235056900] conn(0x5602d29ac7c0 0x5602d2961390 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a15d08af406280f server_cookie=48baae050d042da5 in_seq=0 out_seq=0 2024-01-31T05:05:58.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe831600640 10 client.5661 ms_handle_connect on v2:172.21.15.49:6834/4235056900 2024-01-31T05:05:58.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe831600640 1 -- 172.21.15.49:0/3572718196 <== mds.0 v2:172.21.15.49:6834/4235056900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5602d2745a20 con 0x5602d29ac7c0 2024-01-31T05:05:58.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe831600640 10 client.5661 handle_command_reply: tid=0 2024-01-31T05:05:58.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84df2d000 1 client.5661 shutdown 2024-01-31T05:05:58.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84df2d000 1 -- 172.21.15.49:0/3572718196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 msgr2=0x5602d29a5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:58.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84df2d000 1 --2- 172.21.15.49:0/3572718196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 0x5602d29a5e30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x5602d27a23a0 tx=0x7fe82c000bd0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84df2d000 1 -- 172.21.15.49:0/3572718196 shutdown_connections 2024-01-31T05:05:58.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84df2d000 1 --2- 172.21.15.49:0/3572718196 >> [v2:172.21.15.49:6834/4235056900,v1:172.21.15.49:6835/4235056900] conn(0x5602d29ac7c0 0x5602d2961390 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84df2d000 1 --2- 172.21.15.49:0/3572718196 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x5602d2946090 0x5602d2960970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84df2d000 1 --2- 172.21.15.49:0/3572718196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5602d2945770 0x5602d29a5e30 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe831600640 0 client.5661 ms_handle_reset on v2:172.21.15.49:6834/4235056900 2024-01-31T05:05:58.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84df2d000 1 --2- 172.21.15.49:0/3572718196 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5602d28fbc10 0x5602d29a58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84df2d000 1 -- 172.21.15.49:0/3572718196 >> 172.21.15.49:0/3572718196 conn(0x5602d2901f80 msgr2=0x5602d2900d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:58.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84df2d000 1 -- 172.21.15.49:0/3572718196 shutdown_connections 2024-01-31T05:05:58.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84df2d000 1 -- 172.21.15.49:0/3572718196 wait complete. 2024-01-31T05:05:58.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84df2d000 20 client.5661 trim_cache size 0 max 16384 2024-01-31T05:05:58.479 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-31T05:05:58.479 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "3d27a9c0-c28e-4304-958f-ef21a88f4ab5", 2024-01-31T05:05:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-01-31T05:05:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5493, 2024-01-31T05:05:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-01-31T05:05:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-01-31T05:05:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-01-31T05:05:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 5.9457865050000001, 2024-01-31T05:05:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 19, 2024-01-31T05:05:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 40, 2024-01-31T05:05:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 39, 2024-01-31T05:05:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 14.62889339 2024-01-31T05:05:58.480 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-31T05:05:58.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84aa00640 1 -- 172.21.15.49:0/3284537599 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe81c066500 msgr2=0x7fe81c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:58.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84aa00640 1 --2- 172.21.15.49:0/3284537599 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe81c066500 0x7fe81c0689c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe834000f70 tx=0x7fe834007d40 comp rx=0 tx=0).stop 2024-01-31T05:05:58.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84aa00640 1 -- 172.21.15.49:0/3284537599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe84415d3a0 msgr2=0x7fe8440cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:58.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84aa00640 1 --2- 172.21.15.49:0/3284537599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe84415d3a0 0x7fe8440cda00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0ac000 tx=0x7fe8440cd280 comp rx=0 tx=0).stop 2024-01-31T05:05:58.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84aa00640 1 -- 172.21.15.49:0/3284537599 shutdown_connections 2024-01-31T05:05:58.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84aa00640 1 --2- 172.21.15.49:0/3284537599 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe81c066500 0x7fe81c0689c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84aa00640 1 --2- 172.21.15.49:0/3284537599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe84415d3a0 0x7fe8440cda00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84aa00640 1 --2- 172.21.15.49:0/3284537599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe84406f4b0 0x7fe8440cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84aa00640 1 --2- 172.21.15.49:0/3284537599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe84406f020 0x7fe8440c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84aa00640 1 -- 172.21.15.49:0/3284537599 >> 172.21.15.49:0/3284537599 conn(0x7fe8440d0e50 msgr2=0x7fe8440cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:58.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84aa00640 1 -- 172.21.15.49:0/3284537599 shutdown_connections 2024-01-31T05:05:58.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.472+0000 7fe84aa00640 1 -- 172.21.15.49:0/3284537599 wait complete. 2024-01-31T05:05:58.495 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-31T05:05:58.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.631+0000 7f3cebc00640 1 Processor -- start 2024-01-31T05:05:58.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.631+0000 7f3cebc00640 1 -- start start 2024-01-31T05:05:58.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3cebc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ce4070ac0 0x7f3ce40ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3cebc00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce4159b70 con 0x7f3ce4159790 2024-01-31T05:05:58.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3cebc00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce40b2750 con 0x7f3ce4070660 2024-01-31T05:05:58.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3cebc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce40b2a30 con 0x7f3ce4070ac0 2024-01-31T05:05:58.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce9200640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f3ce4159790 0x7f3ce40b37c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48568/0 (socket says 172.21.15.49:48568) 2024-01-31T05:05:58.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce9200640 1 -- 172.21.15.49:0/4224898286 learned_addr learned my addr 172.21.15.49:0/4224898286 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:05:58.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce9c00640 1 --2- 172.21.15.49:0/4224898286 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ce4070ac0 0x7f3ce40ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce3400640 1 -- 172.21.15.49:0/4224898286 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608778914 0 0) 0x7f3ce4159b70 con 0x7f3ce4159790 2024-01-31T05:05:58.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce3400640 1 -- 172.21.15.49:0/4224898286 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cc4003530 con 0x7f3ce4159790 2024-01-31T05:05:58.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce3400640 1 -- 172.21.15.49:0/4224898286 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3383362277 0 0) 0x7f3ce40b2750 con 0x7f3ce4070660 2024-01-31T05:05:58.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce3400640 1 -- 172.21.15.49:0/4224898286 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ce4159b70 con 0x7f3ce4070660 2024-01-31T05:05:58.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce3400640 1 -- 172.21.15.49:0/4224898286 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2620615951 0 0) 0x7f3cc4003530 con 0x7f3ce4159790 2024-01-31T05:05:58.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce3400640 1 -- 172.21.15.49:0/4224898286 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ce4070ac0 msgr2=0x7f3ce40ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:58.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce3400640 1 --2- 172.21.15.49:0/4224898286 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ce4070ac0 0x7f3ce40ac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce3400640 1 -- 172.21.15.49:0/4224898286 >> v1:172.21.15.195:6789/0 conn(0x7f3ce4070660 legacy=0x7f3ce40ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:58.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce3400640 1 -- 172.21.15.49:0/4224898286 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce40b2d10 con 0x7f3ce4159790 2024-01-31T05:05:58.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce3400640 1 -- 172.21.15.49:0/4224898286 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7f3cd4001680 con 0x7f3ce4159790 2024-01-31T05:05:58.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce9c00640 1 --2- 172.21.15.49:0/4224898286 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ce4070ac0 0x7f3ce40ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:05:58.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce3400640 1 -- 172.21.15.49:0/4224898286 >> v1:172.21.15.49:6789/0 conn(0x7f3ce4159790 legacy=0x7f3ce40b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:58.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce3400640 1 --2- 172.21.15.49:0/4224898286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cc4003b40 0x7f3cc4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce3400640 1 --2- 172.21.15.49:0/4224898286 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ce4070ac0 0x7f3cc40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce3400640 1 --2- 172.21.15.49:0/4224898286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc4004d10 0x7f3cc4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce3400640 1 -- 172.21.15.49:0/4224898286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce40b2a30 con 0x7f3cc4004d10 2024-01-31T05:05:58.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce3400640 1 -- 172.21.15.49:0/4224898286 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc400ba40 con 0x7f3cc4003b40 2024-01-31T05:05:58.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce3400640 1 -- 172.21.15.49:0/4224898286 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc400bc00 con 0x7f3ce4070ac0 2024-01-31T05:05:58.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce9200640 1 --2- 172.21.15.49:0/4224898286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cc4003b40 0x7f3cc4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce3e00640 1 --2- 172.21.15.49:0/4224898286 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ce4070ac0 0x7f3cc40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce9c00640 1 --2- 172.21.15.49:0/4224898286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc4004d10 0x7f3cc4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce9200640 1 -- 172.21.15.49:0/4224898286 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ce4070ac0 msgr2=0x7f3cc40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:58.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce9200640 1 --2- 172.21.15.49:0/4224898286 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ce4070ac0 0x7f3cc40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce9200640 1 -- 172.21.15.49:0/4224898286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc4004d10 msgr2=0x7f3cc4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:05:58.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce9200640 1 --2- 172.21.15.49:0/4224898286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3cc4004d10 0x7f3cc4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.635+0000 7f3ce9200640 1 -- 172.21.15.49:0/4224898286 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc009a70 con 0x7f3cc4003b40 2024-01-31T05:05:58.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.639+0000 7f3ce9200640 1 --2- 172.21.15.49:0/4224898286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cc4003b40 0x7f3cc4003f40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4007fb0 tx=0x7f3cd401f270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2366c79cd3db7059 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:58.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.639+0000 7f3ce3400640 1 -- 172.21.15.49:0/4224898286 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd40a8e90 con 0x7f3cc4003b40 2024-01-31T05:05:58.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.639+0000 7f3ce3400640 1 -- 172.21.15.49:0/4224898286 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd40058e0 con 0x7f3cc4003b40 2024-01-31T05:05:58.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.639+0000 7f3ce3400640 1 -- 172.21.15.49:0/4224898286 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4005cd0 con 0x7f3cc4003b40 2024-01-31T05:05:58.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.639+0000 7f3cebc00640 1 -- 172.21.15.49:0/4224898286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cc4003b40 msgr2=0x7f3cc4003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:58.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.639+0000 7f3cebc00640 1 --2- 172.21.15.49:0/4224898286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cc4003b40 0x7f3cc4003f40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4007fb0 tx=0x7f3cd401f270 comp rx=0 tx=0).stop 2024-01-31T05:05:58.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.639+0000 7f3ce9c00640 1 -- 172.21.15.49:0/4224898286 reap_dead start 2024-01-31T05:05:58.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.639+0000 7f3cebc00640 1 -- 172.21.15.49:0/4224898286 shutdown_connections 2024-01-31T05:05:58.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.639+0000 7f3cebc00640 1 -- 172.21.15.49:0/4224898286 >> 172.21.15.49:0/4224898286 conn(0x7f3ce40b09a0 msgr2=0x7f3ce40b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:58.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.639+0000 7f3cebc00640 1 -- 172.21.15.49:0/4224898286 shutdown_connections 2024-01-31T05:05:58.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.639+0000 7f3cebc00640 1 -- 172.21.15.49:0/4224898286 wait complete. 2024-01-31T05:05:58.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3cebc00640 1 Processor -- start 2024-01-31T05:05:58.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3cebc00640 1 -- start start 2024-01-31T05:05:58.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3cebc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cc4003b40 0x7f3ce4145c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3cebc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ce4149970 0x7f3ce41f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3cebc00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ce415b9a0 0x7f3ce40cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3cebc00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce4159db0 con 0x7f3ce415b9a0 2024-01-31T05:05:58.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3cebc00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce4149ec0 con 0x7f3cc4003b40 2024-01-31T05:05:58.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3cebc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce414a1a0 con 0x7f3ce4149970 2024-01-31T05:05:58.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3ce9c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ce415b9a0 0x7f3ce40cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3ce9c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ce415b9a0 0x7f3ce40cd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57648/0 (socket says 172.21.15.49:57648) 2024-01-31T05:05:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3ce9c00640 1 -- 172.21.15.49:0/104281527 learned_addr learned my addr 172.21.15.49:0/104281527 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:05:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3ce9200640 1 --2- 172.21.15.49:0/104281527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cc4003b40 0x7f3ce4145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3ce3e00640 1 --2- 172.21.15.49:0/104281527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ce4149970 0x7f3ce41f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3ce9c00640 1 -- 172.21.15.49:0/104281527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ce4149970 msgr2=0x7f3ce41f2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3ce9c00640 1 --2- 172.21.15.49:0/104281527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ce4149970 0x7f3ce41f2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3ce9c00640 1 -- 172.21.15.49:0/104281527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cc4003b40 msgr2=0x7f3ce4145c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3ce9c00640 1 --2- 172.21.15.49:0/104281527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cc4003b40 0x7f3ce4145c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3ce9c00640 1 -- 172.21.15.49:0/104281527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce414a480 con 0x7f3ce415b9a0 2024-01-31T05:05:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3ce3e00640 1 --2- 172.21.15.49:0/104281527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ce4149970 0x7f3ce41f2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3ce9200640 1 --2- 172.21.15.49:0/104281527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cc4003b40 0x7f3ce4145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3ce9c00640 1 --2- 172.21.15.49:0/104281527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ce415b9a0 0x7f3ce40cd360 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4072c60 tx=0x7f3cdc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3ce0c00640 1 -- 172.21.15.49:0/104281527 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc01c070 con 0x7f3ce415b9a0 2024-01-31T05:05:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3ce0c00640 1 -- 172.21.15.49:0/104281527 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc00f040 con 0x7f3ce415b9a0 2024-01-31T05:05:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3ce0c00640 1 -- 172.21.15.49:0/104281527 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00e040 con 0x7f3ce415b9a0 2024-01-31T05:05:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3cebc00640 1 -- 172.21.15.49:0/104281527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce414a760 con 0x7f3ce415b9a0 2024-01-31T05:05:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.643+0000 7f3cebc00640 1 -- 172.21.15.49:0/104281527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce41f3350 con 0x7f3ce415b9a0 2024-01-31T05:05:58.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.647+0000 7f3cebc00640 1 -- 172.21.15.49:0/104281527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce4159f20 con 0x7f3ce415b9a0 2024-01-31T05:05:58.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.647+0000 7f3ce0c00640 1 -- 172.21.15.49:0/104281527 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f3cdc015430 con 0x7f3ce415b9a0 2024-01-31T05:05:58.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.647+0000 7f3ce0c00640 1 --2- 172.21.15.49:0/104281527 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3cbc066500 0x7f3cbc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.647+0000 7f3ce0c00640 1 -- 172.21.15.49:0/104281527 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3cdc084150 con 0x7f3ce415b9a0 2024-01-31T05:05:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.647+0000 7f3ce9200640 1 --2- 172.21.15.49:0/104281527 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3cbc066500 0x7f3cbc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.647+0000 7f3ce9200640 1 --2- 172.21.15.49:0/104281527 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3cbc066500 0x7f3cbc0689c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4007f80 tx=0x7f3cd40aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:58.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.651+0000 7f3ce0c00640 1 -- 172.21.15.49:0/104281527 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f3ce4159f20 con 0x7f3ce415b9a0 2024-01-31T05:05:58.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.847+0000 7f3cebc00640 1 -- 172.21.15.49:0/104281527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3ce414a8f0 con 0x7f3ce415b9a0 2024-01-31T05:05:58.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.847+0000 7f3ce0c00640 1 -- 172.21.15.49:0/104281527 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3cdc0511f0 con 0x7f3ce415b9a0 2024-01-31T05:05:58.850 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-31T05:05:58.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.847+0000 7f3cebc00640 1 -- 172.21.15.49:0/104281527 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3cbc066500 msgr2=0x7f3cbc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:58.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.847+0000 7f3cebc00640 1 --2- 172.21.15.49:0/104281527 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3cbc066500 0x7f3cbc0689c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4007f80 tx=0x7f3cd40aa070 comp rx=0 tx=0).stop 2024-01-31T05:05:58.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.847+0000 7f3cebc00640 1 -- 172.21.15.49:0/104281527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ce415b9a0 msgr2=0x7f3ce40cd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:58.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.847+0000 7f3cebc00640 1 --2- 172.21.15.49:0/104281527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ce415b9a0 0x7f3ce40cd360 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4072c60 tx=0x7f3cdc00f580 comp rx=0 tx=0).stop 2024-01-31T05:05:58.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.847+0000 7f3cebc00640 1 -- 172.21.15.49:0/104281527 shutdown_connections 2024-01-31T05:05:58.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.847+0000 7f3cebc00640 1 --2- 172.21.15.49:0/104281527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ce415b9a0 0x7f3ce40cd360 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.847+0000 7f3cebc00640 1 --2- 172.21.15.49:0/104281527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ce4149970 0x7f3ce41f2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.847+0000 7f3cebc00640 1 --2- 172.21.15.49:0/104281527 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f3cbc066500 0x7f3cbc0689c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.847+0000 7f3cebc00640 1 --2- 172.21.15.49:0/104281527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cc4003b40 0x7f3ce4145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:58.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.847+0000 7f3cebc00640 1 -- 172.21.15.49:0/104281527 >> 172.21.15.49:0/104281527 conn(0x7f3ce40b09a0 msgr2=0x7f3ce41509c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:58.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.851+0000 7f3cebc00640 1 -- 172.21.15.49:0/104281527 shutdown_connections 2024-01-31T05:05:58.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:58.851+0000 7f3cebc00640 1 -- 172.21.15.49:0/104281527 wait complete. 2024-01-31T05:05:58.873 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-31T05:05:58.873 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-31T05:05:58.873 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-01-31T05:05:58.873 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-31T05:05:58.873 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-31T05:05:58.873 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-31T05:05:58.873 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-31T05:05:58.873 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-31T05:05:58.873 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-31T05:05:58.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:58.874 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-01-31T05:05:58.883 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-31T05:05:58.883 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-31T05:05:58.883 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-01-31T05:05:58.884 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:05:58.884 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-01-31T05:05:58.884 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:05:58.884 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-31T05:05:58.884 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:05:58.884 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-01-31T05:05:58.884 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-31T05:05:58.884 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:05:58.884 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-01-31T05:05:58.884 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-31T05:05:58.884 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:05:58.884 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-01-31T05:05:58.884 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-31T05:05:58.884 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42401sec preferred_lft 42401sec 2024-01-31T05:05:58.884 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-01-31T05:05:58.885 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:05:58.885 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-31T05:05:58.885 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:05:58.885 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-01-31T05:05:58.885 INFO:teuthology.orchestra.run.smithi049.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-31T05:05:58.885 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 02:42:b9:ff:e5:3e brd ff:ff:ff:ff:ff:ff 2024-01-31T05:05:58.885 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-31T05:05:58.885 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:05:58.885 INFO:teuthology.orchestra.run.smithi049.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-31T05:05:58.885 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-31T05:05:58.885 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-31T05:05:58.885 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:05:58.886 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-31T05:05:58.886 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:05:58.886 INFO:teuthology.orchestra.run.smithi049.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-31T05:05:58.886 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-31T05:05:58.886 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-31T05:05:58.886 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:05:58.886 INFO:teuthology.orchestra.run.smithi049.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-31T05:05:58.886 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-31T05:05:58.887 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-01-31T05:05:58.887 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:05:58.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:58.887 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-31T05:05:58.941 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-01-31T05:05:58.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:58.944 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-01-31T05:05:58.997 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-01-31T05:05:58.998 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-31T05:05:58.998 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-31T05:05:58.998 INFO:teuthology.orchestra.run.smithi049.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-31T05:05:58.998 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-31T05:05:58.998 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-31T05:05:58.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:58.999 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-01-31T05:05:58.999 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-01-31T05:05:58.999 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-31T05:05:58.999 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-31T05:05:58.999 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-31T05:05:58.999 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-01-31T05:05:59.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:59.090 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-31T05:05:59.099 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-31T05:05:59.099 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-31T05:05:59.099 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-31T05:05:59.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:59.100 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-01-31T05:05:59.164 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-01-31T05:05:59.164 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-31T05:05:59.164 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-31T05:05:59.216 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-31T05:05:59.216 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-31T05:05:59.216 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-31T05:05:59.267 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-01-31T05:05:59.328 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-01-31T05:05:59.385 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-01-31T05:05:59.386 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-01-31T05:05:59.386 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-01-31T05:05:59.386 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-01-31T05:05:59.386 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-01-31T05:05:59.386 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-01-31T05:05:59.386 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-01-31T05:05:59.386 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-01-31T05:05:59.386 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2024-01-31T05:05:59.386 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-01-31T05:05:59.386 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-01-31T05:05:59.386 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-01-31T05:05:59.386 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-01-31T05:05:59.386 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-01-31T05:05:59.387 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-01-31T05:05:59.387 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-01-31T05:05:59.387 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-01-31T05:05:59.387 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2024-01-31T05:05:59.387 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-01-31T05:05:59.387 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-01-31T05:05:59.387 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2024-01-31T05:05:59.387 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2024-01-31T05:05:59.387 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-01-31T05:05:59.387 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-01-31T05:05:59.387 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-01-31T05:05:59.387 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-01-31T05:05:59.387 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-01-31T05:05:59.387 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2024-01-31T05:05:59.388 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-01-31T05:05:59.388 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-31T05:05:59.388 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-31T05:05:59.388 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-31T05:05:59.388 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-31T05:05:59.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:59.389 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-01-31T05:05:59.439 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-31T05:05:59.439 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-01-31T05:05:59.482 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-01-31T05:05:59.503 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-01-31T05:05:59.557 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-01-31T05:05:59.557 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-01-31T05:05:59.557 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-01-31T05:05:59.557 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-01-31T05:05:59.557 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-01-31T05:05:59.557 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-01-31T05:05:59.558 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-01-31T05:05:59.558 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-01-31T05:05:59.558 INFO:teuthology.orchestra.run.smithi049.stdout:/run/lock 2024-01-31T05:05:59.558 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-01-31T05:05:59.558 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-01-31T05:05:59.558 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-01-31T05:05:59.558 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-01-31T05:05:59.558 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-01-31T05:05:59.558 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-01-31T05:05:59.558 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-01-31T05:05:59.558 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-01-31T05:05:59.558 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/fs/nfsd 2024-01-31T05:05:59.558 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-01-31T05:05:59.558 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-01-31T05:05:59.559 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysusers.service 2024-01-31T05:05:59.559 INFO:teuthology.orchestra.run.smithi049.stdout:/run/rpc_pipefs 2024-01-31T05:05:59.559 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-01-31T05:05:59.559 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-01-31T05:05:59.559 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-01-31T05:05:59.559 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-01-31T05:05:59.559 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-01-31T05:05:59.559 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-3 2024-01-31T05:05:59.559 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-01-31T05:05:59.559 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-31T05:05:59.559 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-31T05:05:59.559 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-31T05:05:59.559 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-31T05:05:59.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:59.561 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-01-31T05:05:59.580 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2024-01-31T05:05:59.575+0000 7fd2d7c45580 -1 init, newargv = 0x55d823c5e100 newargc=15 2024-01-31T05:05:59.580 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[37318]: starting ceph client 2024-01-31T05:05:59.587 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[37318]: starting fuse 2024-01-31T05:05:59.589 INFO:teuthology.orchestra.run.smithi049.stdout:43 2024-01-31T05:05:59.589 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-31T05:05:59.589 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-01-31T05:05:59.589 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-01-31T05:05:59.589 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-01-31T05:05:59.590 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-01-31T05:05:59.590 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-01-31T05:05:59.590 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-31T05:05:59.590 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-01-31T05:05:59.590 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-31T05:05:59.590 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-01-31T05:05:59.590 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-31T05:05:59.590 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-31T05:05:59.590 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-01-31T05:05:59.590 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-01-31T05:05:59.590 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-01-31T05:05:59.590 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-01-31T05:05:59.590 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-31T05:05:59.590 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-01-31T05:05:59.590 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-31T05:05:59.590 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-31T05:05:59.590 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-31T05:05:59.591 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-01-31T05:05:59.591 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-01-31T05:05:59.591 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-01-31T05:05:59.591 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-31T05:05:59.591 DEBUG:teuthology.orchestra.run.smithi049:> 2024-01-31T05:05:59.591 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2024-01-31T05:05:59.591 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-01-31T05:05:59.715 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.37318.asok 2024-01-31T05:05:59.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:05:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-31T05:05:59.726 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37318.asok 2024-01-31T05:05:59.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:59.727 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37318.asok status 2024-01-31T05:05:59.900 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-31T05:05:59.900 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-01-31T05:05:59.900 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "661946e7044723130c03627323f6a879a9848cb5", 2024-01-31T05:05:59.900 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev)", 2024-01-31T05:05:59.901 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2024-01-31T05:05:59.901 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-01-31T05:05:59.901 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-31T05:05:59.901 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "37318", 2024-01-31T05:05:59.901 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-01-31T05:05:59.901 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:59.901 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-01-31T05:05:59.901 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-01-31T05:05:59.901 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5673, 2024-01-31T05:05:59.901 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-01-31T05:05:59.901 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-01-31T05:05:59.901 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-01-31T05:05:59.901 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 5673 2024-01-31T05:05:59.901 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:59.901 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-01-31T05:05:59.902 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-01-31T05:05:59.902 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-01-31T05:05:59.902 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 612912537 2024-01-31T05:05:59.902 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-01-31T05:05:59.902 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:59.902 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-01-31T05:05:59.902 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-01-31T05:05:59.902 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-01-31T05:05:59.902 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 612912537 2024-01-31T05:05:59.902 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-01-31T05:05:59.902 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.5673 192.168.0.1:0/612912537", 2024-01-31T05:05:59.902 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/612912537", 2024-01-31T05:05:59.902 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-01-31T05:05:59.902 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 19, 2024-01-31T05:05:59.902 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 41, 2024-01-31T05:05:59.903 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-01-31T05:05:59.903 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-01-31T05:05:59.903 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-01-31T05:05:59.903 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-31T05:05:59.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:59.915 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-01-31T05:05:59.915 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-31T05:05:59.925 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-01-31T05:05:59.925 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-31T05:05:59.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:05:59.925 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-31T05:05:59.988 DEBUG:teuthology.orchestra.run.smithi049:> mktemp -d --suffix=xfstests-dev 2024-01-31T05:06:00.044 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.MqKNGSMQ15xfstests-dev 2024-01-31T05:06:00.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:06:00.044 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.MqKNGSMQ15xfstests-dev) 2024-01-31T05:06:00.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:06:00.114 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.MqKNGSMQ15xfstests-dev) 2024-01-31T05:06:00.174 INFO:teuthology.orchestra.run.smithi049.stderr:Cloning into '/tmp/tmp.MqKNGSMQ15xfstests-dev'... 2024-01-31T05:06:01.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:06:01.072 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-01-31T05:06:01.133 DEBUG:teuthology.orchestra.run.smithi049:> mktemp -d --suffix=test 2024-01-31T05:06:01.184 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.ULOG6qSi2atest 2024-01-31T05:06:01.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:06:01.184 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-01-31T05:06:01.244 DEBUG:teuthology.orchestra.run.smithi049:> mktemp -d --suffix=scratch 2024-01-31T05:06:01.296 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.aEfp7YEfVIscratch 2024-01-31T05:06:01.296 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2024-01-31T05:06:01.296 DEBUG:teuthology.orchestra.run.smithi049:> sudo apt-get install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc git indent libacl1-dev libaio-dev libcap-dev libgdbm-dev libtool libtool-bin liburing-dev libuuid1 lvm2 make psmisc python3 quota sed uuid-dev uuid-runtime xfsprogs sqlite3 exfatprogs f2fs-tools ocfs2-tools udftools xfsdump xfslibs-dev 2024-01-31T05:06:01.415 INFO:teuthology.orchestra.run.smithi049.stdout:Reading package lists... 2024-01-31T05:06:01.588 INFO:teuthology.orchestra.run.smithi049.stdout:Building dependency tree... 2024-01-31T05:06:01.588 INFO:teuthology.orchestra.run.smithi049.stdout:Reading state information... 2024-01-31T05:06:01.752 INFO:teuthology.orchestra.run.smithi049.stdout:acl is already the newest version (2.3.1-1). 2024-01-31T05:06:01.752 INFO:teuthology.orchestra.run.smithi049.stdout:acl set to manually installed. 2024-01-31T05:06:01.752 INFO:teuthology.orchestra.run.smithi049.stdout:attr is already the newest version (1:2.5.1-1build1). 2024-01-31T05:06:01.752 INFO:teuthology.orchestra.run.smithi049.stdout:automake is already the newest version (1:1.16.5-1.3). 2024-01-31T05:06:01.752 INFO:teuthology.orchestra.run.smithi049.stdout:bc is already the newest version (1.07.1-3build1). 2024-01-31T05:06:01.753 INFO:teuthology.orchestra.run.smithi049.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2024-01-31T05:06:01.753 INFO:teuthology.orchestra.run.smithi049.stdout:gcc set to manually installed. 2024-01-31T05:06:01.753 INFO:teuthology.orchestra.run.smithi049.stdout:libacl1-dev is already the newest version (2.3.1-1). 2024-01-31T05:06:01.753 INFO:teuthology.orchestra.run.smithi049.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2024-01-31T05:06:01.753 INFO:teuthology.orchestra.run.smithi049.stdout:libtool is already the newest version (2.4.6-15build2). 2024-01-31T05:06:01.753 INFO:teuthology.orchestra.run.smithi049.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-31T05:06:01.753 INFO:teuthology.orchestra.run.smithi049.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3). 2024-01-31T05:06:01.753 INFO:teuthology.orchestra.run.smithi049.stdout:lvm2 is already the newest version (2.03.11-2.1ubuntu4). 2024-01-31T05:06:01.753 INFO:teuthology.orchestra.run.smithi049.stdout:make is already the newest version (4.3-4.1build1). 2024-01-31T05:06:01.753 INFO:teuthology.orchestra.run.smithi049.stdout:make set to manually installed. 2024-01-31T05:06:01.753 INFO:teuthology.orchestra.run.smithi049.stdout:psmisc is already the newest version (23.4-2build3). 2024-01-31T05:06:01.753 INFO:teuthology.orchestra.run.smithi049.stdout:quota is already the newest version (4.06-1build2). 2024-01-31T05:06:01.753 INFO:teuthology.orchestra.run.smithi049.stdout:sed is already the newest version (4.8-1ubuntu2). 2024-01-31T05:06:01.753 INFO:teuthology.orchestra.run.smithi049.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-31T05:06:01.753 INFO:teuthology.orchestra.run.smithi049.stdout:uuid-runtime is already the newest version (2.37.2-4ubuntu3). 2024-01-31T05:06:01.754 INFO:teuthology.orchestra.run.smithi049.stdout:xfsdump is already the newest version (3.1.9+0+nmu2). 2024-01-31T05:06:01.754 INFO:teuthology.orchestra.run.smithi049.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-31T05:06:01.754 INFO:teuthology.orchestra.run.smithi049.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2024-01-31T05:06:01.754 INFO:teuthology.orchestra.run.smithi049.stdout:dbench is already the newest version (4.0-2build1). 2024-01-31T05:06:01.754 INFO:teuthology.orchestra.run.smithi049.stdout:dump is already the newest version (0.4b47-3). 2024-01-31T05:06:01.754 INFO:teuthology.orchestra.run.smithi049.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2024-01-31T05:06:01.754 INFO:teuthology.orchestra.run.smithi049.stdout:git is already the newest version (1:2.34.1-1ubuntu1.10). 2024-01-31T05:06:01.754 INFO:teuthology.orchestra.run.smithi049.stdout:indent is already the newest version (2.2.12-1ubuntu0.22.04.1). 2024-01-31T05:06:01.754 INFO:teuthology.orchestra.run.smithi049.stdout:python3 is already the newest version (3.10.6-1~22.04). 2024-01-31T05:06:01.754 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages were automatically installed and are no longer required: 2024-01-31T05:06:01.754 INFO:teuthology.orchestra.run.smithi049.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2024-01-31T05:06:01.754 INFO:teuthology.orchestra.run.smithi049.stdout: libpython2-dev libpython2-stdlib libpython2.7 libpython2.7-dev 2024-01-31T05:06:01.754 INFO:teuthology.orchestra.run.smithi049.stdout: libpython2.7-minimal libpython2.7-stdlib linux-image-5.4.0-135-generic 2024-01-31T05:06:01.754 INFO:teuthology.orchestra.run.smithi049.stdout: linux-modules-5.4.0-135-generic python2 python2-dev python2-minimal 2024-01-31T05:06:01.755 INFO:teuthology.orchestra.run.smithi049.stdout: python2.7 python2.7-dev python2.7-minimal 2024-01-31T05:06:01.755 INFO:teuthology.orchestra.run.smithi049.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-31T05:06:01.755 INFO:teuthology.orchestra.run.smithi049.stdout:The following additional packages will be installed: 2024-01-31T05:06:01.755 INFO:teuthology.orchestra.run.smithi049.stdout: libcap2 libcmap4 libcorosync-common4 libdlm3 libpmemblk1 libqb100 2024-01-31T05:06:01.755 INFO:teuthology.orchestra.run.smithi049.stdout: libsqlite3-0 2024-01-31T05:06:01.756 INFO:teuthology.orchestra.run.smithi049.stdout:Suggested packages: 2024-01-31T05:06:01.756 INFO:teuthology.orchestra.run.smithi049.stdout: gnuplot gfio python-scipy gawk-doc sqlite3-doc dvd+rw-tools udfclient 2024-01-31T05:06:01.798 INFO:teuthology.orchestra.run.smithi049.stdout:The following NEW packages will be installed: 2024-01-31T05:06:01.798 INFO:teuthology.orchestra.run.smithi049.stdout: exfatprogs f2fs-tools fio libcap-dev libcmap4 libcorosync-common4 libdlm3 2024-01-31T05:06:01.798 INFO:teuthology.orchestra.run.smithi049.stdout: libgdbm-dev libpmemblk1 libqb100 liburing-dev ocfs2-tools sqlite3 udftools 2024-01-31T05:06:01.799 INFO:teuthology.orchestra.run.smithi049.stdout:The following packages will be upgraded: 2024-01-31T05:06:01.800 INFO:teuthology.orchestra.run.smithi049.stdout: gawk libcap2 libsqlite3-0 2024-01-31T05:06:01.983 INFO:teuthology.orchestra.run.smithi049.stdout:3 upgraded, 14 newly installed, 0 to remove and 267 not upgraded. 2024-01-31T05:06:01.983 INFO:teuthology.orchestra.run.smithi049.stdout:Need to get 7,282 kB of archives. 2024-01-31T05:06:01.983 INFO:teuthology.orchestra.run.smithi049.stdout:After this operation, 14.2 MB of additional disk space will be used. 2024-01-31T05:06:01.983 INFO:teuthology.orchestra.run.smithi049.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 gawk amd64 1:5.1.0-1ubuntu0.1 [447 kB] 2024-01-31T05:06:02.524 INFO:teuthology.orchestra.run.smithi049.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcorosync-common4 amd64 3.1.6-1ubuntu1 [7,322 B] 2024-01-31T05:06:02.524 INFO:teuthology.orchestra.run.smithi049.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqb100 amd64 2.0.4-1ubuntu0.2 [74.2 kB] 2024-01-31T05:06:02.534 INFO:teuthology.orchestra.run.smithi049.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcmap4 amd64 3.1.6-1ubuntu1 [10.4 kB] 2024-01-31T05:06:02.536 INFO:teuthology.orchestra.run.smithi049.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 libdlm3 amd64 4.1.1-1build1 [14.4 kB] 2024-01-31T05:06:02.537 INFO:teuthology.orchestra.run.smithi049.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 ocfs2-tools amd64 1.8.7-1build1 [646 kB] 2024-01-31T05:06:02.644 INFO:teuthology.orchestra.run.smithi049.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap2 amd64 1:2.44-1ubuntu0.22.04.1 [18.3 kB] 2024-01-31T05:06:02.645 INFO:teuthology.orchestra.run.smithi049.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsqlite3-0 amd64 3.37.2-2ubuntu0.3 [641 kB] 2024-01-31T05:06:02.705 INFO:teuthology.orchestra.run.smithi049.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 exfatprogs amd64 1.1.3-1 [40.3 kB] 2024-01-31T05:06:02.707 INFO:teuthology.orchestra.run.smithi049.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 f2fs-tools amd64 1.14.0-2build1 [169 kB] 2024-01-31T05:06:02.717 INFO:teuthology.orchestra.run.smithi049.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2024-01-31T05:06:02.884 INFO:teuthology.orchestra.run.smithi049.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2024-01-31T05:06:03.691 INFO:teuthology.orchestra.run.smithi049.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap-dev amd64 1:2.44-1ubuntu0.22.04.1 [39.4 kB] 2024-01-31T05:06:03.692 INFO:teuthology.orchestra.run.smithi049.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2024-01-31T05:06:03.693 INFO:teuthology.orchestra.run.smithi049.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liburing-dev amd64 2.1-2build1 [51.8 kB] 2024-01-31T05:06:03.694 INFO:teuthology.orchestra.run.smithi049.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.3 [768 kB] 2024-01-31T05:06:03.705 INFO:teuthology.orchestra.run.smithi049.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 udftools amd64 2.3-1 [125 kB] 2024-01-31T05:06:03.973 INFO:teuthology.orchestra.run.smithi049.stderr:debconf: unable to initialize frontend: Dialog 2024-01-31T05:06:03.973 INFO:teuthology.orchestra.run.smithi049.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-01-31T05:06:03.973 INFO:teuthology.orchestra.run.smithi049.stderr:debconf: falling back to frontend: Readline 2024-01-31T05:06:03.994 INFO:teuthology.orchestra.run.smithi049.stderr:debconf: unable to initialize frontend: Readline 2024-01-31T05:06:03.994 INFO:teuthology.orchestra.run.smithi049.stderr:debconf: (This frontend requires a controlling tty.) 2024-01-31T05:06:03.994 INFO:teuthology.orchestra.run.smithi049.stderr:debconf: falling back to frontend: Teletype 2024-01-31T05:06:04.001 INFO:teuthology.orchestra.run.smithi049.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-01-31T05:06:04.040 INFO:teuthology.orchestra.run.smithi049.stdout:Fetched 7,282 kB in 2s (3,833 kB/s) 2024-01-31T05:06:04.259 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143379 files and directories currently installed.) 2024-01-31T05:06:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../0-gawk_1%3a5.1.0-1ubuntu0.1_amd64.deb ... 2024-01-31T05:06:04.407 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking gawk (1:5.1.0-1ubuntu0.1) over (1:5.1.0-1build3) ... 2024-01-31T05:06:04.902 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libcorosync-common4:amd64. 2024-01-31T05:06:04.917 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../1-libcorosync-common4_3.1.6-1ubuntu1_amd64.deb ... 2024-01-31T05:06:05.086 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2024-01-31T05:06:05.457 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libqb100:amd64. 2024-01-31T05:06:05.473 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../2-libqb100_2.0.4-1ubuntu0.2_amd64.deb ... 2024-01-31T05:06:05.515 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2024-01-31T05:06:05.827 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libcmap4:amd64. 2024-01-31T05:06:05.844 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../3-libcmap4_3.1.6-1ubuntu1_amd64.deb ... 2024-01-31T05:06:05.885 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libcmap4:amd64 (3.1.6-1ubuntu1) ... 2024-01-31T05:06:06.197 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libdlm3:amd64. 2024-01-31T05:06:06.214 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../4-libdlm3_4.1.1-1build1_amd64.deb ... 2024-01-31T05:06:06.364 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libdlm3:amd64 (4.1.1-1build1) ... 2024-01-31T05:06:06.810 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package ocfs2-tools. 2024-01-31T05:06:06.826 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../5-ocfs2-tools_1.8.7-1build1_amd64.deb ... 2024-01-31T05:06:06.868 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking ocfs2-tools (1.8.7-1build1) ... 2024-01-31T05:06:07.383 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../6-libcap2_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2024-01-31T05:06:07.517 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) over (1:2.44-1build3) ... 2024-01-31T05:06:07.844 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2024-01-31T05:06:08.341 INFO:teuthology.orchestra.run.smithi049.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143453 files and directories currently installed.) 2024-01-31T05:06:08.345 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../0-libsqlite3-0_3.37.2-2ubuntu0.3_amd64.deb ... 2024-01-31T05:06:08.484 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) over (3.37.2-2ubuntu0.1) ... 2024-01-31T05:06:08.789 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package exfatprogs. 2024-01-31T05:06:08.805 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../1-exfatprogs_1.1.3-1_amd64.deb ... 2024-01-31T05:06:08.839 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking exfatprogs (1.1.3-1) ... 2024-01-31T05:06:09.118 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package f2fs-tools. 2024-01-31T05:06:09.134 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../2-f2fs-tools_1.14.0-2build1_amd64.deb ... 2024-01-31T05:06:09.226 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking f2fs-tools (1.14.0-2build1) ... 2024-01-31T05:06:09.583 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libpmemblk1:amd64. 2024-01-31T05:06:09.600 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../3-libpmemblk1_1.11.1-3build1_amd64.deb ... 2024-01-31T05:06:09.633 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2024-01-31T05:06:09.961 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package fio. 2024-01-31T05:06:09.978 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../4-fio_3.28-1_amd64.deb ... 2024-01-31T05:06:10.019 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking fio (3.28-1) ... 2024-01-31T05:06:10.457 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libcap-dev:amd64. 2024-01-31T05:06:10.473 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../5-libcap-dev_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2024-01-31T05:06:10.515 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2024-01-31T05:06:10.813 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2024-01-31T05:06:10.828 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../6-libgdbm-dev_1.23-1_amd64.deb ... 2024-01-31T05:06:10.871 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2024-01-31T05:06:11.166 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package liburing-dev:amd64. 2024-01-31T05:06:11.183 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../7-liburing-dev_2.1-2build1_amd64.deb ... 2024-01-31T05:06:11.224 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking liburing-dev:amd64 (2.1-2build1) ... 2024-01-31T05:06:11.495 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package sqlite3. 2024-01-31T05:06:11.511 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../8-sqlite3_3.37.2-2ubuntu0.3_amd64.deb ... 2024-01-31T05:06:11.553 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.3) ... 2024-01-31T05:06:11.965 INFO:teuthology.orchestra.run.smithi049.stdout:Selecting previously unselected package udftools. 2024-01-31T05:06:11.982 INFO:teuthology.orchestra.run.smithi049.stdout:Preparing to unpack .../9-udftools_2.3-1_amd64.deb ... 2024-01-31T05:06:12.037 INFO:teuthology.orchestra.run.smithi049.stdout:Unpacking udftools (2.3-1) ... 2024-01-31T05:06:12.334 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up exfatprogs (1.1.3-1) ... 2024-01-31T05:06:12.462 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up gawk (1:5.1.0-1ubuntu0.1) ... 2024-01-31T05:06:12.707 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up f2fs-tools (1.14.0-2build1) ... 2024-01-31T05:06:12.833 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) ... 2024-01-31T05:06:12.959 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2024-01-31T05:06:13.085 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2024-01-31T05:06:13.211 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2024-01-31T05:06:13.354 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up udftools (2.3-1) ... 2024-01-31T05:06:13.505 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libdlm3:amd64 (4.1.1-1build1) ... 2024-01-31T05:06:13.632 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2024-01-31T05:06:13.758 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2024-01-31T05:06:13.884 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.3) ... 2024-01-31T05:06:14.002 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up liburing-dev:amd64 (2.1-2build1) ... 2024-01-31T05:06:14.111 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up libcmap4:amd64 (3.1.6-1ubuntu1) ... 2024-01-31T05:06:14.229 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up fio (3.28-1) ... 2024-01-31T05:06:14.898 INFO:teuthology.orchestra.run.smithi049.stdout:Setting up ocfs2-tools (1.8.7-1build1) ... 2024-01-31T05:06:15.172 INFO:teuthology.orchestra.run.smithi049.stdout:debconf: unable to initialize frontend: Dialog 2024-01-31T05:06:15.172 INFO:teuthology.orchestra.run.smithi049.stdout:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-01-31T05:06:15.172 INFO:teuthology.orchestra.run.smithi049.stdout:debconf: falling back to frontend: Readline 2024-01-31T05:06:16.285 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for initramfs-tools (0.140ubuntu13.1) ... 2024-01-31T05:06:16.385 INFO:teuthology.orchestra.run.smithi049.stdout:update-initramfs: Generating /boot/initrd.img-6.7.0-gcd42140e6285 2024-01-31T05:06:18.716 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:06:18.720 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:06:31.231 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-31T05:06:31.383 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-31T05:06:32.902 INFO:teuthology.orchestra.run.smithi049.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-31T05:06:33.438 DEBUG:teuthology.orchestra.run.smithi049:> sudo useradd -m fsgqa 2024-01-31T05:06:33.457 INFO:teuthology.orchestra.run.smithi049.stderr:useradd: user 'fsgqa' already exists 2024-01-31T05:06:33.459 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-01-31T05:06:33.460 DEBUG:teuthology.orchestra.run.smithi049:> sudo groupadd fsgqa 2024-01-31T05:06:33.525 INFO:teuthology.orchestra.run.smithi049.stderr:groupadd: group 'fsgqa' already exists 2024-01-31T05:06:33.527 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-01-31T05:06:33.528 DEBUG:teuthology.orchestra.run.smithi049:> sudo useradd fsgqa2 2024-01-31T05:06:33.959 DEBUG:teuthology.orchestra.run.smithi049:> sudo useradd 123456-fsgqa 2024-01-31T05:06:34.338 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-01-31T05:06:34.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.479+0000 7f2979400640 1 Processor -- start 2024-01-31T05:06:34.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.479+0000 7f2979400640 1 -- start start 2024-01-31T05:06:34.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.479+0000 7f2979400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297415b110 0x7f297406c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:34.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.479+0000 7f2979400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297415b4f0 con 0x7f29740714e0 2024-01-31T05:06:34.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.479+0000 7f2979400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29740abf20 con 0x7f29740cdf10 2024-01-31T05:06:34.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.479+0000 7f2979400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29740ce460 con 0x7f297415b110 2024-01-31T05:06:34.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.479+0000 7f2973200640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f29740714e0 0x7f29740ad800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:34938/0 (socket says 172.21.15.49:34938) 2024-01-31T05:06:34.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.479+0000 7f2973200640 1 -- 172.21.15.49:0/1824112632 learned_addr learned my addr 172.21.15.49:0/1824112632 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T05:06:34.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.479+0000 7f2972800640 1 --2- 172.21.15.49:0/1824112632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297415b110 0x7f297406c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:34.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.479+0000 7f2971400640 1 -- 172.21.15.49:0/1824112632 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3685081572 0 0) 0x7f296c0014a0 con 0x7f29740714e0 2024-01-31T05:06:34.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.479+0000 7f2971400640 1 -- 172.21.15.49:0/1824112632 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2954003530 con 0x7f29740714e0 2024-01-31T05:06:34.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.479+0000 7f2971400640 1 -- 172.21.15.49:0/1824112632 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719576691 0 0) 0x7f29740abf20 con 0x7f29740cdf10 2024-01-31T05:06:34.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.479+0000 7f2971400640 1 -- 172.21.15.49:0/1824112632 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f296c0014a0 con 0x7f29740cdf10 2024-01-31T05:06:34.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.479+0000 7f2972800640 1 -- 172.21.15.49:0/1824112632 >> v1:172.21.15.195:6789/0 conn(0x7f29740cdf10 legacy=0x7f2974070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:34.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.479+0000 7f2971400640 1 -- 172.21.15.49:0/1824112632 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2597450502 0 0) 0x7f2954003530 con 0x7f29740714e0 2024-01-31T05:06:34.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.479+0000 7f2972800640 1 -- 172.21.15.49:0/1824112632 >> v1:172.21.15.49:6789/0 conn(0x7f29740714e0 legacy=0x7f29740ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:34.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.479+0000 7f2972800640 1 -- 172.21.15.49:0/1824112632 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29740ac200 con 0x7f297415b110 2024-01-31T05:06:34.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.483+0000 7f2972800640 1 --2- 172.21.15.49:0/1824112632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297415b110 0x7f297406c2d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f29640097f0 tx=0x7f296401c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=710a77bc084d8c8a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:06:34.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.483+0000 7f2971400640 1 -- 172.21.15.49:0/1824112632 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c001b90 con 0x7f297415b110 2024-01-31T05:06:34.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.483+0000 7f2971400640 1 -- 172.21.15.49:0/1824112632 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29640a7050 con 0x7f297415b110 2024-01-31T05:06:34.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.483+0000 7f2971400640 1 -- 172.21.15.49:0/1824112632 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29640ab620 con 0x7f297415b110 2024-01-31T05:06:34.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.483+0000 7f2979400640 1 -- 172.21.15.49:0/1824112632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297415b110 msgr2=0x7f297406c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:34.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.483+0000 7f2979400640 1 --2- 172.21.15.49:0/1824112632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297415b110 0x7f297406c2d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f29640097f0 tx=0x7f296401c3b0 comp rx=0 tx=0).stop 2024-01-31T05:06:34.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2979400640 1 -- 172.21.15.49:0/1824112632 shutdown_connections 2024-01-31T05:06:34.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2979400640 1 --2- 172.21.15.49:0/1824112632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297415b110 0x7f297406c2d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:34.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2979400640 1 -- 172.21.15.49:0/1824112632 >> 172.21.15.49:0/1824112632 conn(0x7f29740b09a0 msgr2=0x7f29740b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:06:34.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2979400640 1 -- 172.21.15.49:0/1824112632 shutdown_connections 2024-01-31T05:06:34.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2979400640 1 -- 172.21.15.49:0/1824112632 wait complete. 2024-01-31T05:06:34.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2979400640 1 Processor -- start 2024-01-31T05:06:34.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2979400640 1 -- start start 2024-01-31T05:06:34.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2979400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29740714e0 0x7f2974148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:34.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2979400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29740cdf10 0x7f297415b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:34.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2979400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f297415b110 0x7f297414d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:34.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2979400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297415bd90 con 0x7f297415b110 2024-01-31T05:06:34.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2979400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29741492a0 con 0x7f29740714e0 2024-01-31T05:06:34.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2979400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297415e3e0 con 0x7f29740cdf10 2024-01-31T05:06:34.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2973200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f297415b110 0x7f297414d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:34.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2973200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f297415b110 0x7f297414d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56176/0 (socket says 172.21.15.49:56176) 2024-01-31T05:06:34.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2973200640 1 -- 172.21.15.49:0/1478135003 learned_addr learned my addr 172.21.15.49:0/1478135003 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:06:34.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2971e00640 1 --2- 172.21.15.49:0/1478135003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29740cdf10 0x7f297415b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:34.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2972800640 1 --2- 172.21.15.49:0/1478135003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29740714e0 0x7f2974148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:34.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2973200640 1 -- 172.21.15.49:0/1478135003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29740cdf10 msgr2=0x7f297415b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:34.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2973200640 1 --2- 172.21.15.49:0/1478135003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29740cdf10 0x7f297415b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:34.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2973200640 1 -- 172.21.15.49:0/1478135003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29740714e0 msgr2=0x7f2974148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:34.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2973200640 1 --2- 172.21.15.49:0/1478135003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29740714e0 0x7f2974148970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:34.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2973200640 1 -- 172.21.15.49:0/1478135003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2964009420 con 0x7f297415b110 2024-01-31T05:06:34.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.487+0000 7f2972800640 1 --2- 172.21.15.49:0/1478135003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29740714e0 0x7f2974148970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:06:34.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.491+0000 7f2973200640 1 --2- 172.21.15.49:0/1478135003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f297415b110 0x7f297414d530 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f296c001b40 tx=0x7f296c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:06:34.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.491+0000 7f296aa00640 1 -- 172.21.15.49:0/1478135003 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c012400 con 0x7f297415b110 2024-01-31T05:06:34.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.491+0000 7f296aa00640 1 -- 172.21.15.49:0/1478135003 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296c012580 con 0x7f297415b110 2024-01-31T05:06:34.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.491+0000 7f296aa00640 1 -- 172.21.15.49:0/1478135003 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c012930 con 0x7f297415b110 2024-01-31T05:06:34.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.491+0000 7f2979400640 1 -- 172.21.15.49:0/1478135003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297415e6c0 con 0x7f297415b110 2024-01-31T05:06:34.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.491+0000 7f2979400640 1 -- 172.21.15.49:0/1478135003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297415ec80 con 0x7f297415b110 2024-01-31T05:06:34.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.491+0000 7f2979400640 1 -- 172.21.15.49:0/1478135003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29740cfc10 con 0x7f297415b110 2024-01-31T05:06:34.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.491+0000 7f296aa00640 1 -- 172.21.15.49:0/1478135003 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f296c012a90 con 0x7f297415b110 2024-01-31T05:06:34.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.491+0000 7f296aa00640 1 --2- 172.21.15.49:0/1478135003 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f294c066530 0x7f294c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:34.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.491+0000 7f296aa00640 1 -- 172.21.15.49:0/1478135003 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f296c0847a0 con 0x7f297415b110 2024-01-31T05:06:34.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.491+0000 7f2972800640 1 --2- 172.21.15.49:0/1478135003 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f294c066530 0x7f294c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:34.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.495+0000 7f2972800640 1 --2- 172.21.15.49:0/1478135003 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f294c066530 0x7f294c0689f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f29640ad000 tx=0x7f29640a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:06:34.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.495+0000 7f296aa00640 1 -- 172.21.15.49:0/1478135003 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f296c051840 con 0x7f297415b110 2024-01-31T05:06:34.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.715+0000 7f2979400640 1 -- 172.21.15.49:0/1478135003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f297415b4f0 con 0x7f297415b110 2024-01-31T05:06:34.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.715+0000 7f296aa00640 1 -- 172.21.15.49:0/1478135003 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1285 (secure 0 0 0) 0x7f297415b4f0 con 0x7f297415b110 2024-01-31T05:06:34.718 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:06:34.718 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":1,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","modified":"2024-01-31T05:03:20.124963Z","created":"2024-01-31T05:03:20.124963Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:3300","nonce":0},{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:3301","nonce":0},{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-01-31T05:06:34.718 INFO:teuthology.orchestra.run.smithi049.stderr:dumped monmap epoch 1 2024-01-31T05:06:34.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.719+0000 7f2979400640 1 -- 172.21.15.49:0/1478135003 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f294c066530 msgr2=0x7f294c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:34.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.719+0000 7f2979400640 1 --2- 172.21.15.49:0/1478135003 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f294c066530 0x7f294c0689f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f29640ad000 tx=0x7f29640a6000 comp rx=0 tx=0).stop 2024-01-31T05:06:34.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.719+0000 7f2979400640 1 -- 172.21.15.49:0/1478135003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f297415b110 msgr2=0x7f297414d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:34.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.719+0000 7f2979400640 1 --2- 172.21.15.49:0/1478135003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f297415b110 0x7f297414d530 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f296c001b40 tx=0x7f296c00a430 comp rx=0 tx=0).stop 2024-01-31T05:06:34.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.719+0000 7f2979400640 1 -- 172.21.15.49:0/1478135003 shutdown_connections 2024-01-31T05:06:34.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.719+0000 7f2979400640 1 --2- 172.21.15.49:0/1478135003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f297415b110 0x7f297414d530 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:34.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.719+0000 7f2979400640 1 --2- 172.21.15.49:0/1478135003 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f29740cdf10 0x7f297415b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:34.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.719+0000 7f2979400640 1 --2- 172.21.15.49:0/1478135003 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f294c066530 0x7f294c0689f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:34.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.719+0000 7f2979400640 1 --2- 172.21.15.49:0/1478135003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29740714e0 0x7f2974148970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:34.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.719+0000 7f2979400640 1 -- 172.21.15.49:0/1478135003 >> 172.21.15.49:0/1478135003 conn(0x7f29740b09a0 msgr2=0x7f2974099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:06:34.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.719+0000 7f2979400640 1 -- 172.21.15.49:0/1478135003 shutdown_connections 2024-01-31T05:06:34.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.719+0000 7f2979400640 1 -- 172.21.15.49:0/1478135003 wait complete. 2024-01-31T05:06:34.740 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2024-01-31T05:06:34.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.879+0000 7f883fa00640 1 Processor -- start 2024-01-31T05:06:34.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.879+0000 7f883fa00640 1 -- start start 2024-01-31T05:06:34.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.883+0000 7f883fa00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f883815b110 0x7f883806c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:34.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.883+0000 7f883fa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88380714e0 0x7f88380ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:34.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.883+0000 7f883fa00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883815b4f0 con 0x7f88380cdf10 2024-01-31T05:06:34.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.883+0000 7f883fa00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88380ce460 con 0x7f883815b110 2024-01-31T05:06:34.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.883+0000 7f883fa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88380abf20 con 0x7f88380714e0 2024-01-31T05:06:34.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.883+0000 7f883d000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f883815b110 0x7f883806c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:34.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.883+0000 7f883d000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f883815b110 0x7f883806c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56182/0 (socket says 172.21.15.49:56182) 2024-01-31T05:06:34.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.883+0000 7f883d000640 1 -- 172.21.15.49:0/1923838086 learned_addr learned my addr 172.21.15.49:0/1923838086 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:06:34.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.883+0000 7f883da00640 1 --2- 172.21.15.49:0/1923838086 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88380714e0 0x7f88380ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:34.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.883+0000 7f883d000640 1 -- 172.21.15.49:0/1923838086 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88380714e0 msgr2=0x7f88380ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:06:34.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.883+0000 7f883d000640 1 --2- 172.21.15.49:0/1923838086 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88380714e0 0x7f88380ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:34.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.883+0000 7f883d000640 1 -- 172.21.15.49:0/1923838086 >> v1:172.21.15.195:6789/0 conn(0x7f88380cdf10 legacy=0x7f8838070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:34.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.883+0000 7f883d000640 1 -- 172.21.15.49:0/1923838086 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88380ac200 con 0x7f883815b110 2024-01-31T05:06:34.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.887+0000 7f883d000640 1 --2- 172.21.15.49:0/1923838086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883815b110 0x7f883806c2d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8828009870 tx=0x7f882801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5844a4a6241a2cc5 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:06:34.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.887+0000 7f8837400640 1 -- 172.21.15.49:0/1923838086 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88280a95f0 con 0x7f883815b110 2024-01-31T05:06:34.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.887+0000 7f8837400640 1 -- 172.21.15.49:0/1923838086 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88280a9750 con 0x7f883815b110 2024-01-31T05:06:34.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.887+0000 7f8837400640 1 -- 172.21.15.49:0/1923838086 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88280a9ae0 con 0x7f883815b110 2024-01-31T05:06:34.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.887+0000 7f883fa00640 1 -- 172.21.15.49:0/1923838086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883815b110 msgr2=0x7f883806c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.887+0000 7f883fa00640 1 --2- 172.21.15.49:0/1923838086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883815b110 0x7f883806c2d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8828009870 tx=0x7f882801c510 comp rx=0 tx=0).stop 2024-01-31T05:06:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.887+0000 7f883fa00640 1 -- 172.21.15.49:0/1923838086 shutdown_connections 2024-01-31T05:06:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.887+0000 7f883fa00640 1 --2- 172.21.15.49:0/1923838086 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88380714e0 0x7f88380ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.887+0000 7f883fa00640 1 --2- 172.21.15.49:0/1923838086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883815b110 0x7f883806c2d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.887+0000 7f883fa00640 1 -- 172.21.15.49:0/1923838086 >> 172.21.15.49:0/1923838086 conn(0x7f88380b09a0 msgr2=0x7f88380b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:06:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.887+0000 7f883fa00640 1 -- 172.21.15.49:0/1923838086 shutdown_connections 2024-01-31T05:06:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.887+0000 7f883fa00640 1 -- 172.21.15.49:0/1923838086 wait complete. 2024-01-31T05:06:34.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.887+0000 7f883fa00640 1 Processor -- start 2024-01-31T05:06:34.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.887+0000 7f883fa00640 1 -- start start 2024-01-31T05:06:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f883fa00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88380714e0 0x7f883815df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f883fa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88380cdf10 0x7f88380af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f883fa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883815b110 0x7f88380afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f883fa00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883815e440 con 0x7f883815b110 2024-01-31T05:06:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f883fa00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8838148cf0 con 0x7f88380714e0 2024-01-31T05:06:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f883fa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8838159ff0 con 0x7f88380cdf10 2024-01-31T05:06:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f883da00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883815b110 0x7f88380afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f883da00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883815b110 0x7f88380afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56198/0 (socket says 172.21.15.49:56198) 2024-01-31T05:06:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f883da00640 1 -- 172.21.15.49:0/2720975215 learned_addr learned my addr 172.21.15.49:0/2720975215 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T05:06:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f883d000640 1 --2- 172.21.15.49:0/2720975215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88380714e0 0x7f883815df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f8837e00640 1 --2- 172.21.15.49:0/2720975215 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88380cdf10 0x7f88380af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:34.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f883da00640 1 -- 172.21.15.49:0/2720975215 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88380cdf10 msgr2=0x7f88380af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f883da00640 1 --2- 172.21.15.49:0/2720975215 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88380cdf10 0x7f88380af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f883da00640 1 -- 172.21.15.49:0/2720975215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88380714e0 msgr2=0x7f883815df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f883da00640 1 --2- 172.21.15.49:0/2720975215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88380714e0 0x7f883815df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f883da00640 1 -- 172.21.15.49:0/2720975215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88280094d0 con 0x7f883815b110 2024-01-31T05:06:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f883da00640 1 --2- 172.21.15.49:0/2720975215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883815b110 0x7f88380afac0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8830007e60 tx=0x7f883000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:06:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f8834c00640 1 -- 172.21.15.49:0/2720975215 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830014420 con 0x7f883815b110 2024-01-31T05:06:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f8834c00640 1 -- 172.21.15.49:0/2720975215 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88300145a0 con 0x7f883815b110 2024-01-31T05:06:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f8834c00640 1 -- 172.21.15.49:0/2720975215 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830014950 con 0x7f883815b110 2024-01-31T05:06:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f883fa00640 1 -- 172.21.15.49:0/2720975215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883815a2d0 con 0x7f883815b110 2024-01-31T05:06:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f883fa00640 1 -- 172.21.15.49:0/2720975215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883809a680 con 0x7f883815b110 2024-01-31T05:06:34.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.891+0000 7f883fa00640 1 -- 172.21.15.49:0/2720975215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8838074860 con 0x7f883815b110 2024-01-31T05:06:34.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.895+0000 7f8834c00640 1 -- 172.21.15.49:0/2720975215 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f8830014ab0 con 0x7f883815b110 2024-01-31T05:06:34.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.895+0000 7f8834c00640 1 --2- 172.21.15.49:0/2720975215 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8810066500 0x7f88100689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:34.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.895+0000 7f8834c00640 1 -- 172.21.15.49:0/2720975215 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f88300847d0 con 0x7f883815b110 2024-01-31T05:06:34.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.895+0000 7f883d000640 1 --2- 172.21.15.49:0/2720975215 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8810066500 0x7f88100689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:34.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.895+0000 7f883d000640 1 --2- 172.21.15.49:0/2720975215 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8810066500 0x7f88100689c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f88280ae000 tx=0x7f88280b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:06:34.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:34.899+0000 7f8834c00640 1 -- 172.21.15.49:0/2720975215 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f88300519b0 con 0x7f883815b110 2024-01-31T05:06:35.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:35.111+0000 7f883fa00640 1 -- 172.21.15.49:0/2720975215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f88380b17d0 con 0x7f883815b110 2024-01-31T05:06:35.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:35.115+0000 7f8834c00640 1 -- 172.21.15.49:0/2720975215 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v15) v1 ==== 82+0+151 (secure 0 0 0) 0x7f8830054fd0 con 0x7f883815b110 2024-01-31T05:06:35.116 INFO:teuthology.orchestra.run.smithi049.stdout:[client.admin] 2024-01-31T05:06:35.116 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQCY1LllP08sFBAANqRvo9ilM5SbD46dJU12xQ== 2024-01-31T05:06:35.116 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow *" 2024-01-31T05:06:35.116 INFO:teuthology.orchestra.run.smithi049.stdout: caps mgr = "allow *" 2024-01-31T05:06:35.116 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "allow *" 2024-01-31T05:06:35.116 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow *" 2024-01-31T05:06:35.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:35.115+0000 7f883fa00640 1 -- 172.21.15.49:0/2720975215 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8810066500 msgr2=0x7f88100689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:35.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:35.115+0000 7f883fa00640 1 --2- 172.21.15.49:0/2720975215 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8810066500 0x7f88100689c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f88280ae000 tx=0x7f88280b3040 comp rx=0 tx=0).stop 2024-01-31T05:06:35.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:35.115+0000 7f883fa00640 1 -- 172.21.15.49:0/2720975215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883815b110 msgr2=0x7f88380afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:35.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:35.115+0000 7f883fa00640 1 --2- 172.21.15.49:0/2720975215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883815b110 0x7f88380afac0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8830007e60 tx=0x7f883000e4b0 comp rx=0 tx=0).stop 2024-01-31T05:06:35.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:35.115+0000 7f883fa00640 1 -- 172.21.15.49:0/2720975215 shutdown_connections 2024-01-31T05:06:35.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:35.115+0000 7f883fa00640 1 --2- 172.21.15.49:0/2720975215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883815b110 0x7f88380afac0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:35.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:35.115+0000 7f883fa00640 1 --2- 172.21.15.49:0/2720975215 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f88380cdf10 0x7f88380af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:35.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:35.115+0000 7f883fa00640 1 --2- 172.21.15.49:0/2720975215 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8810066500 0x7f88100689c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:35.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:35.115+0000 7f883fa00640 1 --2- 172.21.15.49:0/2720975215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88380714e0 0x7f883815df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:35.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:35.115+0000 7f883fa00640 1 -- 172.21.15.49:0/2720975215 >> 172.21.15.49:0/2720975215 conn(0x7f88380b09a0 msgr2=0x7f8838156020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:06:35.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:35.115+0000 7f883fa00640 1 -- 172.21.15.49:0/2720975215 shutdown_connections 2024-01-31T05:06:35.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T05:06:35.115+0000 7f883fa00640 1 -- 172.21.15.49:0/2720975215 wait complete. 2024-01-31T05:06:35.137 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2024-01-31T05:06:35.146 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.lVMSbJcvyW 2024-01-31T05:06:35.146 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:06:35.146 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/tmp/tmp.lVMSbJcvyW 2024-01-31T05:06:35.199 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:06:35.200 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/tmp/tmp.MqKNGSMQ15xfstests-dev/local.config 2024-01-31T05:06:35.262 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.ULOG6qSi2atest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.aEfp7YEfVIscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.49:6789 -k /tmp/tmp.lVMSbJcvyW --client_mountpoint /test" 2024-01-31T05:06:35.263 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T05:06:35.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/tmp/tmp.MqKNGSMQ15xfstests-dev/ceph.exclude 2024-01-31T05:06:35.322 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo make) 2024-01-31T05:06:35.387 INFO:teuthology.orchestra.run.smithi049.stdout:libtoolize -cfi 2024-01-31T05:06:35.752 INFO:teuthology.orchestra.run.smithi049.stdout:libtoolize: putting auxiliary files in '.'. 2024-01-31T05:06:35.752 INFO:teuthology.orchestra.run.smithi049.stdout:libtoolize: copying file './config.guess' 2024-01-31T05:06:35.761 INFO:teuthology.orchestra.run.smithi049.stdout:libtoolize: copying file './config.sub' 2024-01-31T05:06:35.779 INFO:teuthology.orchestra.run.smithi049.stdout:libtoolize: copying file './install-sh' 2024-01-31T05:06:35.790 INFO:teuthology.orchestra.run.smithi049.stdout:libtoolize: copying file './ltmain.sh' 2024-01-31T05:06:35.831 INFO:teuthology.orchestra.run.smithi049.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-01-31T05:06:35.831 INFO:teuthology.orchestra.run.smithi049.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-01-31T05:06:35.845 INFO:teuthology.orchestra.run.smithi049.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-01-31T05:06:35.855 INFO:teuthology.orchestra.run.smithi049.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-01-31T05:06:35.867 INFO:teuthology.orchestra.run.smithi049.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-01-31T05:06:35.876 INFO:teuthology.orchestra.run.smithi049.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-01-31T05:06:35.885 INFO:teuthology.orchestra.run.smithi049.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-01-31T05:06:35.888 INFO:teuthology.orchestra.run.smithi049.stdout:cp include/install-sh . 2024-01-31T05:06:35.889 INFO:teuthology.orchestra.run.smithi049.stdout:aclocal -I m4 2024-01-31T05:06:36.949 INFO:teuthology.orchestra.run.smithi049.stdout:autoheader 2024-01-31T05:06:37.320 INFO:teuthology.orchestra.run.smithi049.stdout:autoconf 2024-01-31T05:06:37.739 INFO:teuthology.orchestra.run.smithi049.stdout:./configure \ 2024-01-31T05:06:37.739 INFO:teuthology.orchestra.run.smithi049.stdout: --libexecdir=/usr/lib \ 2024-01-31T05:06:37.739 INFO:teuthology.orchestra.run.smithi049.stdout: --exec_prefix=/var/lib 2024-01-31T05:06:38.266 INFO:teuthology.orchestra.run.smithi049.stdout:checking build system type... x86_64-pc-linux-gnu 2024-01-31T05:06:38.266 INFO:teuthology.orchestra.run.smithi049.stdout:checking host system type... x86_64-pc-linux-gnu 2024-01-31T05:06:38.303 INFO:teuthology.orchestra.run.smithi049.stdout:checking how to print strings... printf 2024-01-31T05:06:38.303 INFO:teuthology.orchestra.run.smithi049.stdout:checking for gcc... gcc 2024-01-31T05:06:38.527 INFO:teuthology.orchestra.run.smithi049.stdout:checking whether the C compiler works... yes 2024-01-31T05:06:38.527 INFO:teuthology.orchestra.run.smithi049.stdout:checking for C compiler default output file name... a.out 2024-01-31T05:06:38.570 INFO:teuthology.orchestra.run.smithi049.stdout:checking for suffix of executables... 2024-01-31T05:06:38.769 INFO:teuthology.orchestra.run.smithi049.stdout:checking whether we are cross compiling... no 2024-01-31T05:06:38.796 INFO:teuthology.orchestra.run.smithi049.stdout:checking for suffix of object files... o 2024-01-31T05:06:38.820 INFO:teuthology.orchestra.run.smithi049.stdout:checking whether the compiler supports GNU C... yes 2024-01-31T05:06:38.843 INFO:teuthology.orchestra.run.smithi049.stdout:checking whether gcc accepts -g... yes 2024-01-31T05:06:38.977 INFO:teuthology.orchestra.run.smithi049.stdout:checking for gcc option to enable C11 features... none needed 2024-01-31T05:06:38.983 INFO:teuthology.orchestra.run.smithi049.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-01-31T05:06:38.988 INFO:teuthology.orchestra.run.smithi049.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-01-31T05:06:38.990 INFO:teuthology.orchestra.run.smithi049.stdout:checking for egrep... /usr/bin/grep -E 2024-01-31T05:06:38.993 INFO:teuthology.orchestra.run.smithi049.stdout:checking for fgrep... /usr/bin/grep -F 2024-01-31T05:06:39.000 INFO:teuthology.orchestra.run.smithi049.stdout:checking for ld used by gcc... /usr/bin/ld 2024-01-31T05:06:39.004 INFO:teuthology.orchestra.run.smithi049.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-01-31T05:06:39.017 INFO:teuthology.orchestra.run.smithi049.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-01-31T05:06:39.048 INFO:teuthology.orchestra.run.smithi049.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-01-31T05:06:39.048 INFO:teuthology.orchestra.run.smithi049.stdout:checking whether ln -s works... yes 2024-01-31T05:06:39.076 INFO:teuthology.orchestra.run.smithi049.stdout:checking the maximum length of command line arguments... 1572864 2024-01-31T05:06:39.083 INFO:teuthology.orchestra.run.smithi049.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-01-31T05:06:39.083 INFO:teuthology.orchestra.run.smithi049.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-01-31T05:06:39.083 INFO:teuthology.orchestra.run.smithi049.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-01-31T05:06:39.083 INFO:teuthology.orchestra.run.smithi049.stdout:checking for objdump... objdump 2024-01-31T05:06:39.083 INFO:teuthology.orchestra.run.smithi049.stdout:checking how to recognize dependent libraries... pass_all 2024-01-31T05:06:39.084 INFO:teuthology.orchestra.run.smithi049.stdout:checking for dlltool... no 2024-01-31T05:06:39.084 INFO:teuthology.orchestra.run.smithi049.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-01-31T05:06:39.084 INFO:teuthology.orchestra.run.smithi049.stdout:checking for ar... ar 2024-01-31T05:06:39.135 INFO:teuthology.orchestra.run.smithi049.stdout:checking for archiver @FILE support... @ 2024-01-31T05:06:39.135 INFO:teuthology.orchestra.run.smithi049.stdout:checking for strip... strip 2024-01-31T05:06:39.135 INFO:teuthology.orchestra.run.smithi049.stdout:checking for ranlib... ranlib 2024-01-31T05:06:39.135 INFO:teuthology.orchestra.run.smithi049.stdout:checking for gawk... gawk 2024-01-31T05:06:39.224 INFO:teuthology.orchestra.run.smithi049.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-01-31T05:06:39.227 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sysroot... no 2024-01-31T05:06:39.234 INFO:teuthology.orchestra.run.smithi049.stdout:checking for a working dd... /usr/bin/dd 2024-01-31T05:06:39.241 INFO:teuthology.orchestra.run.smithi049.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-01-31T05:06:39.261 INFO:teuthology.orchestra.run.smithi049.stdout:checking for mt... mt 2024-01-31T05:06:39.276 INFO:teuthology.orchestra.run.smithi049.stdout:checking if mt is a manifest tool... no 2024-01-31T05:06:39.310 INFO:teuthology.orchestra.run.smithi049.stdout:checking for stdio.h... yes 2024-01-31T05:06:39.355 INFO:teuthology.orchestra.run.smithi049.stdout:checking for stdlib.h... yes 2024-01-31T05:06:39.388 INFO:teuthology.orchestra.run.smithi049.stdout:checking for string.h... yes 2024-01-31T05:06:39.439 INFO:teuthology.orchestra.run.smithi049.stdout:checking for inttypes.h... yes 2024-01-31T05:06:39.472 INFO:teuthology.orchestra.run.smithi049.stdout:checking for stdint.h... yes 2024-01-31T05:06:39.505 INFO:teuthology.orchestra.run.smithi049.stdout:checking for strings.h... yes 2024-01-31T05:06:39.540 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sys/stat.h... yes 2024-01-31T05:06:39.574 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sys/types.h... yes 2024-01-31T05:06:39.615 INFO:teuthology.orchestra.run.smithi049.stdout:checking for unistd.h... yes 2024-01-31T05:06:39.654 INFO:teuthology.orchestra.run.smithi049.stdout:checking for dlfcn.h... yes 2024-01-31T05:06:39.660 INFO:teuthology.orchestra.run.smithi049.stdout:checking for objdir... .libs 2024-01-31T05:06:39.782 INFO:teuthology.orchestra.run.smithi049.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-01-31T05:06:39.782 INFO:teuthology.orchestra.run.smithi049.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-01-31T05:06:39.809 INFO:teuthology.orchestra.run.smithi049.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-01-31T05:06:40.033 INFO:teuthology.orchestra.run.smithi049.stdout:checking if gcc static flag -static works... yes 2024-01-31T05:06:40.074 INFO:teuthology.orchestra.run.smithi049.stdout:checking if gcc supports -c -o file.o... yes 2024-01-31T05:06:40.074 INFO:teuthology.orchestra.run.smithi049.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-01-31T05:06:40.088 INFO:teuthology.orchestra.run.smithi049.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-01-31T05:06:40.124 INFO:teuthology.orchestra.run.smithi049.stdout:checking whether -lc should be explicitly linked in... no 2024-01-31T05:06:40.234 INFO:teuthology.orchestra.run.smithi049.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-01-31T05:06:40.234 INFO:teuthology.orchestra.run.smithi049.stdout:checking how to hardcode library paths into programs... immediate 2024-01-31T05:06:40.247 INFO:teuthology.orchestra.run.smithi049.stdout:checking whether stripping libraries is possible... yes 2024-01-31T05:06:40.247 INFO:teuthology.orchestra.run.smithi049.stdout:checking if libtool supports shared libraries... yes 2024-01-31T05:06:40.247 INFO:teuthology.orchestra.run.smithi049.stdout:checking whether to build shared libraries... yes 2024-01-31T05:06:40.247 INFO:teuthology.orchestra.run.smithi049.stdout:checking whether to build static libraries... yes 2024-01-31T05:06:40.262 INFO:teuthology.orchestra.run.smithi049.stdout:checking for gcc... (cached) gcc 2024-01-31T05:06:40.304 INFO:teuthology.orchestra.run.smithi049.stdout:checking whether the compiler supports GNU C... (cached) yes 2024-01-31T05:06:40.304 INFO:teuthology.orchestra.run.smithi049.stdout:checking whether gcc accepts -g... (cached) yes 2024-01-31T05:06:40.304 INFO:teuthology.orchestra.run.smithi049.stdout:checking for gcc option to enable C11 features... (cached) none needed 2024-01-31T05:06:40.305 INFO:teuthology.orchestra.run.smithi049.stdout:checking for gmake... /usr/bin/gmake 2024-01-31T05:06:40.305 INFO:teuthology.orchestra.run.smithi049.stderr:./configure: line 12754: test: $(SHELL): binary operator expected 2024-01-31T05:06:40.306 INFO:teuthology.orchestra.run.smithi049.stdout:checking for tar... /bin/tar 2024-01-31T05:06:40.306 INFO:teuthology.orchestra.run.smithi049.stdout:checking for gzip... /bin/gzip 2024-01-31T05:06:40.320 INFO:teuthology.orchestra.run.smithi049.stdout:checking whether gcc -MM is supported... yes 2024-01-31T05:06:40.322 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sort... /bin/sort 2024-01-31T05:06:40.322 INFO:teuthology.orchestra.run.smithi049.stdout:checking whether ln -s works... yes 2024-01-31T05:06:40.322 INFO:teuthology.orchestra.run.smithi049.stdout:checking for rpm... no 2024-01-31T05:06:40.364 INFO:teuthology.orchestra.run.smithi049.stdout:checking for assert.h... yes 2024-01-31T05:06:40.403 INFO:teuthology.orchestra.run.smithi049.stdout:checking for bstring.h... no 2024-01-31T05:06:40.441 INFO:teuthology.orchestra.run.smithi049.stdout:checking for libgen.h... yes 2024-01-31T05:06:40.505 INFO:teuthology.orchestra.run.smithi049.stdout:checking for dirent.h... yes 2024-01-31T05:06:40.586 INFO:teuthology.orchestra.run.smithi049.stdout:checking for errno.h... yes 2024-01-31T05:06:40.624 INFO:teuthology.orchestra.run.smithi049.stdout:checking for malloc.h... yes 2024-01-31T05:06:40.666 INFO:teuthology.orchestra.run.smithi049.stdout:checking for uuid.h... no 2024-01-31T05:06:40.715 INFO:teuthology.orchestra.run.smithi049.stdout:checking for uuid/uuid.h... yes 2024-01-31T05:06:40.757 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sys/uuid.h... no 2024-01-31T05:06:40.797 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sys/file.h... yes 2024-01-31T05:06:40.836 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sys/fcntl.h... yes 2024-01-31T05:06:40.877 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sys/syssgi.h... no 2024-01-31T05:06:40.942 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sys/param.h... yes 2024-01-31T05:06:40.942 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sys/stat.h... (cached) yes 2024-01-31T05:06:40.981 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sys/statvfs.h... yes 2024-01-31T05:06:41.020 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sys/time.h... yes 2024-01-31T05:06:41.070 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sys/ioctl.h... yes 2024-01-31T05:06:41.111 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sys/wait.h... yes 2024-01-31T05:06:41.112 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sys/types.h... (cached) yes 2024-01-31T05:06:41.112 INFO:teuthology.orchestra.run.smithi049.stdout:checking for strings.h... (cached) yes 2024-01-31T05:06:41.150 INFO:teuthology.orchestra.run.smithi049.stdout:checking for err.h... yes 2024-01-31T05:06:41.188 INFO:teuthology.orchestra.run.smithi049.stdout:checking for linux/falloc.h... yes 2024-01-31T05:06:41.230 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sys/fs/xfs_fsops.h... no 2024-01-31T05:06:41.272 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sys/fs/xfs_itable.h... no 2024-01-31T05:06:41.318 INFO:teuthology.orchestra.run.smithi049.stdout:checking for xfs/platform_defs.h... no 2024-01-31T05:06:41.359 INFO:teuthology.orchestra.run.smithi049.stdout:checking for btrfs/ioctl.h... no 2024-01-31T05:06:41.401 INFO:teuthology.orchestra.run.smithi049.stdout:checking for cifs/ioctl.h... no 2024-01-31T05:06:41.455 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sys/mman.h... yes 2024-01-31T05:06:41.478 INFO:teuthology.orchestra.run.smithi049.stdout:checking for xfs/xfs_log_format.h... no 2024-01-31T05:06:41.537 INFO:teuthology.orchestra.run.smithi049.stdout:checking for uuid_compare... no 2024-01-31T05:06:41.587 INFO:teuthology.orchestra.run.smithi049.stdout:checking for uuid_compare in -luuid... yes 2024-01-31T05:06:41.714 INFO:teuthology.orchestra.run.smithi049.stdout:checking for xfs/xfs.h... yes 2024-01-31T05:06:41.738 INFO:teuthology.orchestra.run.smithi049.stdout:checking for xfs/libxfs.h... no 2024-01-31T05:06:41.787 INFO:teuthology.orchestra.run.smithi049.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2024-01-31T05:06:41.819 INFO:teuthology.orchestra.run.smithi049.stdout:checking whether xlog_assign_lsn is declared... no 2024-01-31T05:06:41.866 INFO:teuthology.orchestra.run.smithi049.stdout:checking for xfs/xqm.h... yes 2024-01-31T05:06:41.941 INFO:teuthology.orchestra.run.smithi049.stdout:checking xfsctl from xfs/xfs.h... ok 2024-01-31T05:06:41.981 INFO:teuthology.orchestra.run.smithi049.stdout:checking for xfs/handle.h... yes 2024-01-31T05:06:42.031 INFO:teuthology.orchestra.run.smithi049.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-01-31T05:06:42.079 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sys/acl.h... yes 2024-01-31T05:06:42.121 INFO:teuthology.orchestra.run.smithi049.stdout:checking for acl/libacl.h... yes 2024-01-31T05:06:42.170 INFO:teuthology.orchestra.run.smithi049.stdout:checking for acl_init in -lacl... yes 2024-01-31T05:06:42.212 INFO:teuthology.orchestra.run.smithi049.stdout:checking for gdbm-ndbm.h... no 2024-01-31T05:06:42.253 INFO:teuthology.orchestra.run.smithi049.stdout:checking for gdbm/ndbm.h... no 2024-01-31T05:06:42.294 INFO:teuthology.orchestra.run.smithi049.stdout:checking for ndbm.h... no 2024-01-31T05:06:42.336 INFO:teuthology.orchestra.run.smithi049.stdout:checking for libaio.h... yes 2024-01-31T05:06:42.395 INFO:teuthology.orchestra.run.smithi049.stdout:checking for liburing.h... yes 2024-01-31T05:06:42.445 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sys/capability.h... yes 2024-01-31T05:06:42.485 INFO:teuthology.orchestra.run.smithi049.stdout:checking for linux/fiemap.h... yes 2024-01-31T05:06:42.536 INFO:teuthology.orchestra.run.smithi049.stdout:checking for fallocate... yes 2024-01-31T05:06:42.590 INFO:teuthology.orchestra.run.smithi049.stdout:checking for open_by_handle_at... yes 2024-01-31T05:06:42.632 INFO:teuthology.orchestra.run.smithi049.stdout:checking for sys/prctl.h... yes 2024-01-31T05:06:42.671 INFO:teuthology.orchestra.run.smithi049.stdout:checking for linux/fs.h... yes 2024-01-31T05:06:42.713 INFO:teuthology.orchestra.run.smithi049.stdout:checking for btrfsutil.h... no 2024-01-31T05:06:42.769 INFO:teuthology.orchestra.run.smithi049.stdout:checking for copy_file_range... yes 2024-01-31T05:06:42.827 INFO:teuthology.orchestra.run.smithi049.stdout:checking for SEEK_DATA... yes 2024-01-31T05:06:42.905 INFO:teuthology.orchestra.run.smithi049.stdout:checking for BMV_OF_SHARED... yes 2024-01-31T05:06:42.961 INFO:teuthology.orchestra.run.smithi049.stdout:checking for nftw... yes 2024-01-31T05:06:43.015 INFO:teuthology.orchestra.run.smithi049.stdout:checking for RLIMIT_NOFILE... yes 2024-01-31T05:06:43.069 INFO:teuthology.orchestra.run.smithi049.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-01-31T05:06:43.122 INFO:teuthology.orchestra.run.smithi049.stdout:checking for FICLONE... yes 2024-01-31T05:06:43.175 INFO:teuthology.orchestra.run.smithi049.stdout:checking for renameat2... yes 2024-01-31T05:06:43.228 INFO:teuthology.orchestra.run.smithi049.stdout:checking for reallocarray... yes 2024-01-31T05:06:43.278 INFO:teuthology.orchestra.run.smithi049.stdout:checking for struct mount_attr... yes 2024-01-31T05:06:43.335 INFO:teuthology.orchestra.run.smithi049.stdout:checking for struct btrfs_qgroup_limit... yes 2024-01-31T05:06:43.388 INFO:teuthology.orchestra.run.smithi049.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-01-31T05:06:43.442 INFO:teuthology.orchestra.run.smithi049.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-01-31T05:06:43.495 INFO:teuthology.orchestra.run.smithi049.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-01-31T05:06:43.550 INFO:teuthology.orchestra.run.smithi049.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-01-31T05:06:43.603 INFO:teuthology.orchestra.run.smithi049.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-01-31T05:06:43.657 INFO:teuthology.orchestra.run.smithi049.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-01-31T05:06:43.696 INFO:teuthology.orchestra.run.smithi049.stdout:checking for linux/btrfs.h... yes 2024-01-31T05:06:43.738 INFO:teuthology.orchestra.run.smithi049.stdout:checking for linux/btrfs_tree.h... yes 2024-01-31T05:06:43.766 INFO:teuthology.orchestra.run.smithi049.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-01-31T05:06:43.792 INFO:teuthology.orchestra.run.smithi049.stdout:configure: creating ./config.status 2024-01-31T05:06:44.602 INFO:teuthology.orchestra.run.smithi049.stdout:config.status: creating include/builddefs 2024-01-31T05:06:44.629 INFO:teuthology.orchestra.run.smithi049.stdout:config.status: creating include/config.h 2024-01-31T05:06:44.650 INFO:teuthology.orchestra.run.smithi049.stdout:config.status: executing libtool commands 2024-01-31T05:06:44.719 INFO:teuthology.orchestra.run.smithi049.stdout:Building include 2024-01-31T05:06:44.725 INFO:teuthology.orchestra.run.smithi049.stdout:Building lib 2024-01-31T05:06:44.731 INFO:teuthology.orchestra.run.smithi049.stdout: [LTDEP] 2024-01-31T05:06:44.935 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] dataascii.lo 2024-01-31T05:06:45.083 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] databin.lo 2024-01-31T05:06:45.272 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] datapid.lo 2024-01-31T05:06:45.412 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] file_lock.lo 2024-01-31T05:06:45.606 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] forker.lo 2024-01-31T05:06:45.787 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] pattern.lo 2024-01-31T05:06:45.933 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] open_flags.lo 2024-01-31T05:06:46.112 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] random_range.lo 2024-01-31T05:06:46.376 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] string_to_tokens.lo 2024-01-31T05:06:46.507 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] str_to_bytes.lo 2024-01-31T05:06:46.678 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] tlibio.lo 2024-01-31T05:06:46.970 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] write_log.lo 2024-01-31T05:06:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:write_log.c: In function 'wlog_record_write': 2024-01-31T05:06:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:06:47.057 INFO:teuthology.orchestra.run.smithi049.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2024-01-31T05:06:47.057 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:06:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:06:47.057 INFO:teuthology.orchestra.run.smithi049.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2024-01-31T05:06:47.057 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:06:47.259 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] random.lo 2024-01-31T05:06:47.389 INFO:teuthology.orchestra.run.smithi049.stdout: [LD] 2024-01-31T05:06:47.506 INFO:teuthology.orchestra.run.smithi049.stdout:Building ltp 2024-01-31T05:06:47.512 INFO:teuthology.orchestra.run.smithi049.stdout: [DEP] 2024-01-31T05:06:47.703 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] doio 2024-01-31T05:06:48.445 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] fsstress 2024-01-31T05:06:48.772 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:06:48.776 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:06:50.001 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] fsx 2024-01-31T05:06:50.833 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] growfiles 2024-01-31T05:06:51.424 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] iogen 2024-01-31T05:06:51.591 INFO:teuthology.orchestra.run.smithi049.stderr:iogen.c: In function 'main': 2024-01-31T05:06:51.591 INFO:teuthology.orchestra.run.smithi049.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:06:51.591 INFO:teuthology.orchestra.run.smithi049.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2024-01-31T05:06:51.591 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:06:51.593 INFO:teuthology.orchestra.run.smithi049.stderr:iogen.c: In function 'parse_cmdline': 2024-01-31T05:06:51.594 INFO:teuthology.orchestra.run.smithi049.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:06:51.594 INFO:teuthology.orchestra.run.smithi049.stderr: 1535 | getcwd(fptr->f_path, 2024-01-31T05:06:51.594 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:06:51.594 INFO:teuthology.orchestra.run.smithi049.stderr: 1536 | sizeof(fptr->f_path)-1); 2024-01-31T05:06:51.594 INFO:teuthology.orchestra.run.smithi049.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:06:51.878 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] aio-stress 2024-01-31T05:06:52.040 INFO:teuthology.orchestra.run.smithi049.stderr:aio-stress.c: In function 'setup_shared_mem': 2024-01-31T05:06:52.040 INFO:teuthology.orchestra.run.smithi049.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:06:52.040 INFO:teuthology.orchestra.run.smithi049.stderr: 1013 | ftruncate(fd, total_ram); 2024-01-31T05:06:52.040 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:06:52.369 INFO:teuthology.orchestra.run.smithi049.stdout:Building src 2024-01-31T05:06:52.377 INFO:teuthology.orchestra.run.smithi049.stdout: [DEP] 2024-01-31T05:06:54.811 INFO:teuthology.orchestra.run.smithi049.stdout: [DEP] 2024-01-31T05:06:54.858 INFO:teuthology.orchestra.run.smithi049.stdout: [DEP] 2024-01-31T05:06:54.872 INFO:teuthology.orchestra.run.smithi049.stdout: [DEP] 2024-01-31T05:06:55.203 INFO:teuthology.orchestra.run.smithi049.stdout: [DEP] 2024-01-31T05:06:55.239 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] dirstress 2024-01-31T05:06:55.536 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] fill 2024-01-31T05:06:55.732 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] fill2 2024-01-31T05:06:56.010 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] getpagesize 2024-01-31T05:06:56.186 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] holes 2024-01-31T05:06:56.430 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] lstat64 2024-01-31T05:06:56.664 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] nametest 2024-01-31T05:06:56.828 INFO:teuthology.orchestra.run.smithi049.stderr:nametest.c: In function 'main': 2024-01-31T05:06:56.828 INFO:teuthology.orchestra.run.smithi049.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:06:56.828 INFO:teuthology.orchestra.run.smithi049.stderr: 236 | write(1, "\n", 1); 2024-01-31T05:06:56.828 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-31T05:06:56.828 INFO:teuthology.orchestra.run.smithi049.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:06:56.828 INFO:teuthology.orchestra.run.smithi049.stderr: 238 | write(1, ".", 1); 2024-01-31T05:06:56.828 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-31T05:06:56.828 INFO:teuthology.orchestra.run.smithi049.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:06:56.828 INFO:teuthology.orchestra.run.smithi049.stderr: 288 | write(1, ".", 1); 2024-01-31T05:06:56.828 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-31T05:06:56.956 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] permname 2024-01-31T05:06:57.202 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] randholes 2024-01-31T05:06:57.503 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] runas 2024-01-31T05:06:57.725 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] truncfile 2024-01-31T05:06:57.950 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] usemem 2024-01-31T05:06:58.143 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] mmapcat 2024-01-31T05:06:58.290 INFO:teuthology.orchestra.run.smithi049.stderr:mmapcat.c: In function 'main': 2024-01-31T05:06:58.290 INFO:teuthology.orchestra.run.smithi049.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:06:58.290 INFO:teuthology.orchestra.run.smithi049.stderr: 29 | write(1,ptr2,ptr - ptr2); 2024-01-31T05:06:58.290 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:06:58.334 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] append_reader 2024-01-31T05:06:58.532 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] append_writer 2024-01-31T05:06:58.728 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] dirperf 2024-01-31T05:06:59.000 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] metaperf 2024-01-31T05:06:59.156 INFO:teuthology.orchestra.run.smithi049.stderr:metaperf.c: In function 'crfiles': 2024-01-31T05:06:59.157 INFO:teuthology.orchestra.run.smithi049.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:06:59.157 INFO:teuthology.orchestra.run.smithi049.stderr: 166 | write(fd, buf, fsize); 2024-01-31T05:06:59.157 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:06:59.157 INFO:teuthology.orchestra.run.smithi049.stderr:metaperf.c: In function 't_linkun': 2024-01-31T05:06:59.157 INFO:teuthology.orchestra.run.smithi049.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:06:59.157 INFO:teuthology.orchestra.run.smithi049.stderr: 454 | link("a", *fnp); 2024-01-31T05:06:59.157 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~ 2024-01-31T05:06:59.157 INFO:teuthology.orchestra.run.smithi049.stderr:metaperf.c: In function 't_chown': 2024-01-31T05:06:59.157 INFO:teuthology.orchestra.run.smithi049.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:06:59.157 INFO:teuthology.orchestra.run.smithi049.stderr: 404 | chown(*fnp, 2, -1); 2024-01-31T05:06:59.157 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-01-31T05:06:59.157 INFO:teuthology.orchestra.run.smithi049.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:06:59.157 INFO:teuthology.orchestra.run.smithi049.stderr: 406 | chown(*fnp, 1, -1); 2024-01-31T05:06:59.158 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-01-31T05:06:59.158 INFO:teuthology.orchestra.run.smithi049.stderr:metaperf.c: In function 'i_chown': 2024-01-31T05:06:59.158 INFO:teuthology.orchestra.run.smithi049.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:06:59.158 INFO:teuthology.orchestra.run.smithi049.stderr: 291 | chown(*fnp, 1, -1); 2024-01-31T05:06:59.158 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-01-31T05:06:59.158 INFO:teuthology.orchestra.run.smithi049.stderr:metaperf.c: In function 'main': 2024-01-31T05:06:59.158 INFO:teuthology.orchestra.run.smithi049.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:06:59.158 INFO:teuthology.orchestra.run.smithi049.stderr: 152 | chdir(".."); 2024-01-31T05:06:59.158 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~ 2024-01-31T05:06:59.329 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] devzero 2024-01-31T05:06:59.554 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] feature 2024-01-31T05:06:59.829 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] alloc 2024-01-31T05:06:59.993 INFO:teuthology.orchestra.run.smithi049.stderr:alloc.c: In function 'main': 2024-01-31T05:06:59.993 INFO:teuthology.orchestra.run.smithi049.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:06:59.993 INFO:teuthology.orchestra.run.smithi049.stderr: 247 | mkstemp(tmpfile); 2024-01-31T05:06:59.993 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-31T05:07:00.093 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] fault 2024-01-31T05:07:00.302 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] fstest 2024-01-31T05:07:00.596 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_access_root 2024-01-31T05:07:00.744 INFO:teuthology.orchestra.run.smithi049.stderr:t_access_root.c: In function 'main': 2024-01-31T05:07:00.744 INFO:teuthology.orchestra.run.smithi049.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:00.744 INFO:teuthology.orchestra.run.smithi049.stderr: 55 | system(cmd); 2024-01-31T05:07:00.744 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~ 2024-01-31T05:07:00.796 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] godown 2024-01-31T05:07:01.013 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] resvtest 2024-01-31T05:07:01.248 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] writemod 2024-01-31T05:07:01.437 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] writev_on_pagefault 2024-01-31T05:07:01.642 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] makeextents 2024-01-31T05:07:01.869 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] itrash 2024-01-31T05:07:02.064 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] rename 2024-01-31T05:07:02.243 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] multi_open_unlink 2024-01-31T05:07:02.454 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] unwritten_sync 2024-01-31T05:07:02.683 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] genhashnames 2024-01-31T05:07:02.915 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_holes 2024-01-31T05:07:03.106 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_mmap_writev 2024-01-31T05:07:03.299 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_truncate_cmtime 2024-01-31T05:07:03.502 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] dirhash_collide 2024-01-31T05:07:03.730 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_rename_overwrite 2024-01-31T05:07:03.911 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] holetest 2024-01-31T05:07:04.067 INFO:teuthology.orchestra.run.smithi049.stderr:holetest.c: In function 'pt_write_marker': 2024-01-31T05:07:04.067 INFO:teuthology.orchestra.run.smithi049.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:04.067 INFO:teuthology.orchestra.run.smithi049.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2024-01-31T05:07:04.067 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:04.187 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_truncate_self 2024-01-31T05:07:04.370 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] af_unix 2024-01-31T05:07:04.570 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_mmap_stale_pmd 2024-01-31T05:07:04.720 INFO:teuthology.orchestra.run.smithi049.stderr:t_mmap_stale_pmd.c: In function 'main': 2024-01-31T05:07:04.720 INFO:teuthology.orchestra.run.smithi049.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:04.720 INFO:teuthology.orchestra.run.smithi049.stderr: 42 | ftruncate(fd, 0); 2024-01-31T05:07:04.722 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-31T05:07:04.723 INFO:teuthology.orchestra.run.smithi049.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:04.723 INFO:teuthology.orchestra.run.smithi049.stderr: 43 | ftruncate(fd, MiB(4)); 2024-01-31T05:07:04.723 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:04.723 INFO:teuthology.orchestra.run.smithi049.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:04.723 INFO:teuthology.orchestra.run.smithi049.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2024-01-31T05:07:04.723 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:04.768 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_mmap_cow_race 2024-01-31T05:07:04.921 INFO:teuthology.orchestra.run.smithi049.stderr:t_mmap_cow_race.c: In function 'main': 2024-01-31T05:07:04.921 INFO:teuthology.orchestra.run.smithi049.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:04.921 INFO:teuthology.orchestra.run.smithi049.stderr: 61 | ftruncate(fd, 0); 2024-01-31T05:07:04.921 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-31T05:07:04.921 INFO:teuthology.orchestra.run.smithi049.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:04.921 INFO:teuthology.orchestra.run.smithi049.stderr: 62 | ftruncate(fd, MiB(2)); 2024-01-31T05:07:04.921 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:04.979 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_mmap_fallocate 2024-01-31T05:07:05.172 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] fsync-err 2024-01-31T05:07:05.406 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_mmap_write_ro 2024-01-31T05:07:05.604 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_ext4_dax_journal_corruption 2024-01-31T05:07:05.754 INFO:teuthology.orchestra.run.smithi049.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2024-01-31T05:07:05.755 INFO:teuthology.orchestra.run.smithi049.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:05.755 INFO:teuthology.orchestra.run.smithi049.stderr: 61 | ftruncate(fd, 0); 2024-01-31T05:07:05.755 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-31T05:07:05.809 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_ext4_dax_inline_corruption 2024-01-31T05:07:06.010 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_ofd_locks 2024-01-31T05:07:06.253 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_mmap_collision 2024-01-31T05:07:06.502 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] mmap-write-concurrent 2024-01-31T05:07:06.899 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_get_file_time 2024-01-31T05:07:07.092 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_create_short_dirs 2024-01-31T05:07:07.304 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_create_long_dirs 2024-01-31T05:07:07.513 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_enospc 2024-01-31T05:07:07.765 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_mmap_writev_overlap 2024-01-31T05:07:07.981 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] checkpoint_journal 2024-01-31T05:07:08.182 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] mmap-rw-fault 2024-01-31T05:07:08.413 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] allocstale 2024-01-31T05:07:08.632 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_mmap_cow_memory_failure 2024-01-31T05:07:08.849 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] fake-dump-rootino 2024-01-31T05:07:09.042 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] dio-buf-fault 2024-01-31T05:07:09.239 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] rewinddir-test 2024-01-31T05:07:09.456 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] readdir-while-renames 2024-01-31T05:07:09.666 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] xfsctl 2024-01-31T05:07:09.906 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] bstat 2024-01-31T05:07:10.165 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_mtab 2024-01-31T05:07:10.319 INFO:teuthology.orchestra.run.smithi049.stderr:t_mtab.c: In function 'update_mtab': 2024-01-31T05:07:10.319 INFO:teuthology.orchestra.run.smithi049.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:10.319 INFO:teuthology.orchestra.run.smithi049.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2024-01-31T05:07:10.319 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:10.401 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] getdevicesize 2024-01-31T05:07:10.587 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] preallo_rw_pattern_reader 2024-01-31T05:07:10.748 INFO:teuthology.orchestra.run.smithi049.stderr:In file included from preallo_rw_pattern_reader.c:2: 2024-01-31T05:07:10.748 INFO:teuthology.orchestra.run.smithi049.stderr:iopat.c: In function 'main': 2024-01-31T05:07:10.748 INFO:teuthology.orchestra.run.smithi049.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:10.748 INFO:teuthology.orchestra.run.smithi049.stderr: 38 | read(fd, &x, 1048576); 2024-01-31T05:07:10.748 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:10.793 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] preallo_rw_pattern_writer 2024-01-31T05:07:10.953 INFO:teuthology.orchestra.run.smithi049.stderr:In file included from preallo_rw_pattern_writer.c:2: 2024-01-31T05:07:10.954 INFO:teuthology.orchestra.run.smithi049.stderr:iopat.c: In function 'main': 2024-01-31T05:07:10.954 INFO:teuthology.orchestra.run.smithi049.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:10.954 INFO:teuthology.orchestra.run.smithi049.stderr: 34 | write(fd, &x, 1048576); 2024-01-31T05:07:10.954 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:10.997 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] ftrunc 2024-01-31T05:07:11.190 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] trunc 2024-01-31T05:07:11.401 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] fs_perms 2024-01-31T05:07:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:fs_perms.c: In function 'main': 2024-01-31T05:07:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:11.556 INFO:teuthology.orchestra.run.smithi049.stderr: 54 | system("rm -f test.file"); 2024-01-31T05:07:11.556 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:fs_perms.c: In function 'testsetup': 2024-01-31T05:07:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:11.556 INFO:teuthology.orchestra.run.smithi049.stderr: 67 | system("cp testx.file test.file"); 2024-01-31T05:07:11.556 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:11.557 INFO:teuthology.orchestra.run.smithi049.stderr: 69 | chown("test.file",cuserId,cgroupId); 2024-01-31T05:07:11.557 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:fs_perms.c: In function 'testfperm': 2024-01-31T05:07:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:11.557 INFO:teuthology.orchestra.run.smithi049.stderr: 123 | seteuid(0); 2024-01-31T05:07:11.557 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~ 2024-01-31T05:07:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:11.557 INFO:teuthology.orchestra.run.smithi049.stderr: 124 | setegid(0); 2024-01-31T05:07:11.557 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~ 2024-01-31T05:07:11.612 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] testx 2024-01-31T05:07:11.781 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] looptest 2024-01-31T05:07:12.024 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] locktest 2024-01-31T05:07:12.386 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] unwritten_mmap 2024-01-31T05:07:12.600 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] bulkstat_unlink_test 2024-01-31T05:07:12.760 INFO:teuthology.orchestra.run.smithi049.stderr:bulkstat_unlink_test.c: In function 'main': 2024-01-31T05:07:12.760 INFO:teuthology.orchestra.run.smithi049.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:12.760 INFO:teuthology.orchestra.run.smithi049.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2024-01-31T05:07:12.760 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:12.760 INFO:teuthology.orchestra.run.smithi049.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:12.760 INFO:teuthology.orchestra.run.smithi049.stderr: 178 | system(fname); 2024-01-31T05:07:12.760 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~ 2024-01-31T05:07:12.850 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] deduperace 2024-01-31T05:07:13.095 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] bulkstat_unlink_test_modified 2024-01-31T05:07:13.256 INFO:teuthology.orchestra.run.smithi049.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2024-01-31T05:07:13.256 INFO:teuthology.orchestra.run.smithi049.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.256 INFO:teuthology.orchestra.run.smithi049.stderr: 83 | write(fd, fname, sizeof(fname)); 2024-01-31T05:07:13.256 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.256 INFO:teuthology.orchestra.run.smithi049.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.256 INFO:teuthology.orchestra.run.smithi049.stderr: 139 | write(fd, fname, sizeof(fname)); 2024-01-31T05:07:13.256 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.256 INFO:teuthology.orchestra.run.smithi049.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.257 INFO:teuthology.orchestra.run.smithi049.stderr: 185 | system(fname); 2024-01-31T05:07:13.257 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~ 2024-01-31T05:07:13.342 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_dir_offset 2024-01-31T05:07:13.533 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_futimens 2024-01-31T05:07:13.715 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_immutable 2024-01-31T05:07:13.890 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c: In function 'create_test_area': 2024-01-31T05:07:13.890 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.890 INFO:teuthology.orchestra.run.smithi049.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2024-01-31T05:07:13.891 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.891 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.891 INFO:teuthology.orchestra.run.smithi049.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2024-01-31T05:07:13.891 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.893 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c: In function 'remove_test_area': 2024-01-31T05:07:13.893 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.893 INFO:teuthology.orchestra.run.smithi049.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2024-01-31T05:07:13.893 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.893 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.893 INFO:teuthology.orchestra.run.smithi049.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2024-01-31T05:07:13.893 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.893 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.893 INFO:teuthology.orchestra.run.smithi049.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2024-01-31T05:07:13.894 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.894 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.894 INFO:teuthology.orchestra.run.smithi049.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2024-01-31T05:07:13.894 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.894 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.894 INFO:teuthology.orchestra.run.smithi049.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2024-01-31T05:07:13.894 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.894 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.894 INFO:teuthology.orchestra.run.smithi049.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2024-01-31T05:07:13.894 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.894 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c: In function 'check_test_area': 2024-01-31T05:07:13.894 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.894 INFO:teuthology.orchestra.run.smithi049.stderr: 1788 | asprintf(&path, "%s/", dir); 2024-01-31T05:07:13.894 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.895 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.895 INFO:teuthology.orchestra.run.smithi049.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2024-01-31T05:07:13.895 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.895 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.895 INFO:teuthology.orchestra.run.smithi049.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2024-01-31T05:07:13.895 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.895 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.895 INFO:teuthology.orchestra.run.smithi049.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2024-01-31T05:07:13.895 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.895 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.895 INFO:teuthology.orchestra.run.smithi049.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2024-01-31T05:07:13.895 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.895 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.895 INFO:teuthology.orchestra.run.smithi049.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2024-01-31T05:07:13.896 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.896 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.896 INFO:teuthology.orchestra.run.smithi049.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2024-01-31T05:07:13.896 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.898 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.898 INFO:teuthology.orchestra.run.smithi049.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2024-01-31T05:07:13.898 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.898 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.899 INFO:teuthology.orchestra.run.smithi049.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2024-01-31T05:07:13.899 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.899 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c: In function 'test_immutable': 2024-01-31T05:07:13.899 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.899 INFO:teuthology.orchestra.run.smithi049.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2024-01-31T05:07:13.899 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.899 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.899 INFO:teuthology.orchestra.run.smithi049.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2024-01-31T05:07:13.899 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.899 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.899 INFO:teuthology.orchestra.run.smithi049.stderr: 408 | chown(path, 0, 0); 2024-01-31T05:07:13.900 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.900 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.900 INFO:teuthology.orchestra.run.smithi049.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2024-01-31T05:07:13.900 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.900 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.900 INFO:teuthology.orchestra.run.smithi049.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2024-01-31T05:07:13.900 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.900 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.900 INFO:teuthology.orchestra.run.smithi049.stderr: 553 | chown(path, 0, 0); 2024-01-31T05:07:13.900 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.900 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.901 INFO:teuthology.orchestra.run.smithi049.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2024-01-31T05:07:13.901 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.901 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.901 INFO:teuthology.orchestra.run.smithi049.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2024-01-31T05:07:13.901 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.901 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.901 INFO:teuthology.orchestra.run.smithi049.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2024-01-31T05:07:13.901 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.901 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.901 INFO:teuthology.orchestra.run.smithi049.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2024-01-31T05:07:13.901 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.901 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.901 INFO:teuthology.orchestra.run.smithi049.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2024-01-31T05:07:13.901 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.901 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.902 INFO:teuthology.orchestra.run.smithi049.stderr: 653 | chown(path, 0, 0); 2024-01-31T05:07:13.902 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.902 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.902 INFO:teuthology.orchestra.run.smithi049.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2024-01-31T05:07:13.902 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.902 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.902 INFO:teuthology.orchestra.run.smithi049.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2024-01-31T05:07:13.902 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.902 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.902 INFO:teuthology.orchestra.run.smithi049.stderr: 705 | chown(path, 0, 0); 2024-01-31T05:07:13.902 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.902 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.902 INFO:teuthology.orchestra.run.smithi049.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2024-01-31T05:07:13.902 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.905 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c: In function 'test_append': 2024-01-31T05:07:13.905 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.905 INFO:teuthology.orchestra.run.smithi049.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2024-01-31T05:07:13.905 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.905 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.905 INFO:teuthology.orchestra.run.smithi049.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2024-01-31T05:07:13.905 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.905 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.906 INFO:teuthology.orchestra.run.smithi049.stderr: 1051 | chown(path, 0, 0); 2024-01-31T05:07:13.906 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.906 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.906 INFO:teuthology.orchestra.run.smithi049.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2024-01-31T05:07:13.906 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.906 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.906 INFO:teuthology.orchestra.run.smithi049.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2024-01-31T05:07:13.906 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.906 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.906 INFO:teuthology.orchestra.run.smithi049.stderr: 1516 | chown(path, 0, 0); 2024-01-31T05:07:13.906 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.906 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.906 INFO:teuthology.orchestra.run.smithi049.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2024-01-31T05:07:13.906 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.906 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.907 INFO:teuthology.orchestra.run.smithi049.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2024-01-31T05:07:13.907 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.907 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.907 INFO:teuthology.orchestra.run.smithi049.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2024-01-31T05:07:13.907 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.907 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.907 INFO:teuthology.orchestra.run.smithi049.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2024-01-31T05:07:13.907 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.907 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.907 INFO:teuthology.orchestra.run.smithi049.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2024-01-31T05:07:13.907 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.907 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.907 INFO:teuthology.orchestra.run.smithi049.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2024-01-31T05:07:13.907 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.907 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.908 INFO:teuthology.orchestra.run.smithi049.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2024-01-31T05:07:13.908 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.908 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.908 INFO:teuthology.orchestra.run.smithi049.stderr: 1618 | chown(path, 0, 0); 2024-01-31T05:07:13.908 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.908 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.908 INFO:teuthology.orchestra.run.smithi049.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2024-01-31T05:07:13.908 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.908 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.908 INFO:teuthology.orchestra.run.smithi049.stderr: 1644 | chown(path, 0, 0); 2024-01-31T05:07:13.908 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.908 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.909 INFO:teuthology.orchestra.run.smithi049.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2024-01-31T05:07:13.909 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.909 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.909 INFO:teuthology.orchestra.run.smithi049.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2024-01-31T05:07:13.909 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.909 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.909 INFO:teuthology.orchestra.run.smithi049.stderr: 1692 | chown(path, 0, 0); 2024-01-31T05:07:13.909 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-31T05:07:13.909 INFO:teuthology.orchestra.run.smithi049.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:13.909 INFO:teuthology.orchestra.run.smithi049.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2024-01-31T05:07:13.909 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:14.464 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] stale_handle 2024-01-31T05:07:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:stale_handle.c: In function 'main': 2024-01-31T05:07:14.624 INFO:teuthology.orchestra.run.smithi049.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:14.624 INFO:teuthology.orchestra.run.smithi049.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2024-01-31T05:07:14.625 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:14.683 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] pwrite_mmap_blocked 2024-01-31T05:07:14.880 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_dir_offset2 2024-01-31T05:07:15.120 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] seek_sanity_test 2024-01-31T05:07:15.289 INFO:teuthology.orchestra.run.smithi049.stderr:seek_sanity_test.c: In function 'test18': 2024-01-31T05:07:15.289 INFO:teuthology.orchestra.run.smithi049.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:15.289 INFO:teuthology.orchestra.run.smithi049.stderr: 460 | ftruncate(fd, 0); 2024-01-31T05:07:15.289 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-31T05:07:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:seek_sanity_test.c: In function 'test_basic_support': 2024-01-31T05:07:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:15.291 INFO:teuthology.orchestra.run.smithi049.stderr: 1207 | ftruncate(fd, 0); 2024-01-31T05:07:15.291 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-31T05:07:15.291 INFO:teuthology.orchestra.run.smithi049.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:15.291 INFO:teuthology.orchestra.run.smithi049.stderr: 1256 | ftruncate(fd, 0); 2024-01-31T05:07:15.291 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-31T05:07:15.292 INFO:teuthology.orchestra.run.smithi049.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2024-01-31T05:07:15.292 INFO:teuthology.orchestra.run.smithi049.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:15.292 INFO:teuthology.orchestra.run.smithi049.stderr: 88 | ftruncate(fd, 0); 2024-01-31T05:07:15.292 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-31T05:07:15.292 INFO:teuthology.orchestra.run.smithi049.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:15.292 INFO:teuthology.orchestra.run.smithi049.stderr: 89 | pwrite(fd, "a", 1, offset); 2024-01-31T05:07:15.293 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:15.293 INFO:teuthology.orchestra.run.smithi049.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:15.293 INFO:teuthology.orchestra.run.smithi049.stderr: 98 | ftruncate(fd, 0); 2024-01-31T05:07:15.293 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-31T05:07:15.293 INFO:teuthology.orchestra.run.smithi049.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:15.293 INFO:teuthology.orchestra.run.smithi049.stderr: 99 | pwrite(fd, "a", 1, offset); 2024-01-31T05:07:15.293 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:15.618 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] seek_copy_test 2024-01-31T05:07:15.842 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_readdir_1 2024-01-31T05:07:15.992 INFO:teuthology.orchestra.run.smithi049.stderr:t_readdir_1.c: In function 'main': 2024-01-31T05:07:15.992 INFO:teuthology.orchestra.run.smithi049.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:15.992 INFO:teuthology.orchestra.run.smithi049.stderr: 30 | read(fd, buf, 100); 2024-01-31T05:07:15.992 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:16.035 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_readdir_2 2024-01-31T05:07:16.229 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] fsync-tester 2024-01-31T05:07:16.380 INFO:teuthology.orchestra.run.smithi049.stderr:fsync-tester.c: In function 'main': 2024-01-31T05:07:16.381 INFO:teuthology.orchestra.run.smithi049.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:16.381 INFO:teuthology.orchestra.run.smithi049.stderr: 391 | read(fd, &seed, sizeof(seed)); 2024-01-31T05:07:16.381 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:16.381 INFO:teuthology.orchestra.run.smithi049.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:16.381 INFO:teuthology.orchestra.run.smithi049.stderr: 541 | system("reboot -fn"); 2024-01-31T05:07:16.381 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:16.381 INFO:teuthology.orchestra.run.smithi049.stderr:fsync-tester.c: In function 'drop_all_caches': 2024-01-31T05:07:16.381 INFO:teuthology.orchestra.run.smithi049.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:16.381 INFO:teuthology.orchestra.run.smithi049.stderr: 90 | write(fd, value, sizeof(value)-1); 2024-01-31T05:07:16.381 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:16.535 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] nsexec 2024-01-31T05:07:16.763 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] cloner 2024-01-31T05:07:16.988 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] renameat2 2024-01-31T05:07:17.199 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_getcwd 2024-01-31T05:07:17.350 INFO:teuthology.orchestra.run.smithi049.stderr:t_getcwd.c: In function 'test_getcwd': 2024-01-31T05:07:17.350 INFO:teuthology.orchestra.run.smithi049.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:17.350 INFO:teuthology.orchestra.run.smithi049.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2024-01-31T05:07:17.350 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:17.406 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] e4compact 2024-01-31T05:07:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] test-nextquota 2024-01-31T05:07:17.879 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] punch-alternating 2024-01-31T05:07:18.098 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] attr-list-by-handle-cursor-test 2024-01-31T05:07:18.313 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] listxattr 2024-01-31T05:07:18.502 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] dio-interleaved 2024-01-31T05:07:18.711 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_dir_type 2024-01-31T05:07:18.827 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:07:18.831 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:07:18.912 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] dio-invalidate-cache 2024-01-31T05:07:19.062 INFO:teuthology.orchestra.run.smithi049.stderr:dio-invalidate-cache.c: In function 'main': 2024-01-31T05:07:19.062 INFO:teuthology.orchestra.run.smithi049.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:19.062 INFO:teuthology.orchestra.run.smithi049.stderr: 286 | write(fd, buf, blksz * nr_child); 2024-01-31T05:07:19.062 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:19.164 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] stat_test 2024-01-31T05:07:19.508 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_encrypted_d_revalidate 2024-01-31T05:07:19.721 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] attr_replace_test 2024-01-31T05:07:19.930 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] swapon 2024-01-31T05:07:20.141 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] mkswap 2024-01-31T05:07:20.338 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_attr_corruption 2024-01-31T05:07:20.533 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_open_tmpfiles 2024-01-31T05:07:20.763 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] fscrypt-crypt-util 2024-01-31T05:07:21.470 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] bulkstat_null_ocount 2024-01-31T05:07:21.674 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] splice-test 2024-01-31T05:07:21.904 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] chprojid_fail 2024-01-31T05:07:22.114 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] detached_mounts_propagation 2024-01-31T05:07:22.347 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] ext4_resize 2024-01-31T05:07:22.542 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_readdir_3 2024-01-31T05:07:22.785 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] splice2pipe 2024-01-31T05:07:22.934 INFO:teuthology.orchestra.run.smithi049.stderr:splice2pipe.c: In function 'prepare_pipe': 2024-01-31T05:07:22.934 INFO:teuthology.orchestra.run.smithi049.stderr:splice2pipe.c:57:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:22.934 INFO:teuthology.orchestra.run.smithi049.stderr: 57 | write(p[1], buffer, n); 2024-01-31T05:07:22.934 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:22.934 INFO:teuthology.orchestra.run.smithi049.stderr:splice2pipe.c:65:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:22.934 INFO:teuthology.orchestra.run.smithi049.stderr: 65 | read(p[0], buffer, n); 2024-01-31T05:07:22.934 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:22.993 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] uuid_ioctl 2024-01-31T05:07:23.196 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] fiemap-tester 2024-01-31T05:07:23.511 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_stripealign 2024-01-31T05:07:23.713 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] open_by_handle 2024-01-31T05:07:24.012 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_mmap_dio 2024-01-31T05:07:24.223 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] uring_read_fault 2024-01-31T05:07:24.454 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] xfsfind 2024-01-31T05:07:24.701 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] t_reflink_read_race 2024-01-31T05:07:24.945 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] fssum 2024-01-31T05:07:25.442 INFO:teuthology.orchestra.run.smithi049.stdout:Building log-writes 2024-01-31T05:07:25.451 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] replay-log 2024-01-31T05:07:25.842 INFO:teuthology.orchestra.run.smithi049.stdout:Building perf 2024-01-31T05:07:25.848 INFO:teuthology.orchestra.run.smithi049.stdout:Building aio-dio-regress 2024-01-31T05:07:25.858 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] aiocp 2024-01-31T05:07:26.143 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] aio-dio-append-write-fallocate-race 2024-01-31T05:07:26.365 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] aio-dio-append-write-read-race 2024-01-31T05:07:26.596 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] aio-dio-cow-race 2024-01-31T05:07:26.801 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] aio-dio-cycle-write 2024-01-31T05:07:26.949 INFO:teuthology.orchestra.run.smithi049.stderr:aio-dio-cycle-write.c: In function 'init_test': 2024-01-31T05:07:26.949 INFO:teuthology.orchestra.run.smithi049.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:26.949 INFO:teuthology.orchestra.run.smithi049.stderr: 83 | ftruncate(fd, buf_size); 2024-01-31T05:07:26.949 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:27.042 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] aio-dio-eof-race 2024-01-31T05:07:27.280 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] aio-dio-extend-stat 2024-01-31T05:07:27.496 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] aio-dio-fcntl-race 2024-01-31T05:07:27.712 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] aio-dio-hole-filling-race 2024-01-31T05:07:27.913 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] aio-dio-invalidate-failure 2024-01-31T05:07:28.125 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] aio-dio-invalidate-readahead 2024-01-31T05:07:28.343 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] aiodio_sparse2 2024-01-31T05:07:28.492 INFO:teuthology.orchestra.run.smithi049.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2024-01-31T05:07:28.492 INFO:teuthology.orchestra.run.smithi049.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:28.492 INFO:teuthology.orchestra.run.smithi049.stderr: 111 | ftruncate(fd, filesize); 2024-01-31T05:07:28.492 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:28.492 INFO:teuthology.orchestra.run.smithi049.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2024-01-31T05:07:28.492 INFO:teuthology.orchestra.run.smithi049.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-31T05:07:28.493 INFO:teuthology.orchestra.run.smithi049.stderr: 274 | ftruncate(fd, size); 2024-01-31T05:07:28.493 INFO:teuthology.orchestra.run.smithi049.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-01-31T05:07:28.621 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] aio-dio-subblock-eof-read 2024-01-31T05:07:28.817 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] aio-dio-write-verify 2024-01-31T05:07:29.071 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-01-31T05:07:29.253 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-01-31T05:07:29.436 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] aio-last-ref-held-by-io 2024-01-31T05:07:29.665 INFO:teuthology.orchestra.run.smithi049.stdout:Building vfs 2024-01-31T05:07:29.674 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] vfstest 2024-01-31T05:07:34.000 INFO:teuthology.orchestra.run.smithi049.stdout: [CC] mount-idmapped 2024-01-31T05:07:34.498 INFO:teuthology.orchestra.run.smithi049.stdout:Building m4 2024-01-31T05:07:34.504 INFO:teuthology.orchestra.run.smithi049.stdout:Building common 2024-01-31T05:07:34.510 INFO:teuthology.orchestra.run.smithi049.stdout:Building tests 2024-01-31T05:07:34.519 INFO:teuthology.orchestra.run.smithi049.stdout:Building btrfs 2024-01-31T05:07:34.529 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/btrfs/group.list 2024-01-31T05:07:34.660 INFO:teuthology.orchestra.run.smithi049.stdout:Building ceph 2024-01-31T05:07:34.669 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/ceph/group.list 2024-01-31T05:07:34.701 INFO:teuthology.orchestra.run.smithi049.stdout:Building cifs 2024-01-31T05:07:34.709 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/cifs/group.list 2024-01-31T05:07:34.737 INFO:teuthology.orchestra.run.smithi049.stdout:Building ext4 2024-01-31T05:07:34.746 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/ext4/group.list 2024-01-31T05:07:34.828 INFO:teuthology.orchestra.run.smithi049.stdout:Building f2fs 2024-01-31T05:07:34.837 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/f2fs/group.list 2024-01-31T05:07:34.875 INFO:teuthology.orchestra.run.smithi049.stdout:Building generic 2024-01-31T05:07:34.886 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/generic/group.list 2024-01-31T05:07:35.099 INFO:teuthology.orchestra.run.smithi049.stdout:Building nfs 2024-01-31T05:07:35.107 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/nfs/group.list 2024-01-31T05:07:35.139 INFO:teuthology.orchestra.run.smithi049.stdout:Building ocfs2 2024-01-31T05:07:35.148 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/ocfs2/group.list 2024-01-31T05:07:35.177 INFO:teuthology.orchestra.run.smithi049.stdout:Building overlay 2024-01-31T05:07:35.186 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/overlay/group.list 2024-01-31T05:07:35.275 INFO:teuthology.orchestra.run.smithi049.stdout:Building perf 2024-01-31T05:07:35.283 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/perf/group.list 2024-01-31T05:07:35.309 INFO:teuthology.orchestra.run.smithi049.stdout:Building selftest 2024-01-31T05:07:35.317 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/selftest/group.list 2024-01-31T05:07:35.345 INFO:teuthology.orchestra.run.smithi049.stdout:Building shared 2024-01-31T05:07:35.354 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/shared/group.list 2024-01-31T05:07:35.391 INFO:teuthology.orchestra.run.smithi049.stdout:Building tmpfs 2024-01-31T05:07:35.400 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/tmpfs/group.list 2024-01-31T05:07:35.430 INFO:teuthology.orchestra.run.smithi049.stdout:Building udf 2024-01-31T05:07:35.440 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/udf/group.list 2024-01-31T05:07:35.463 INFO:teuthology.orchestra.run.smithi049.stdout:Building xfs 2024-01-31T05:07:35.474 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/xfs/group.list 2024-01-31T05:07:35.694 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo make install) 2024-01-31T05:07:35.775 INFO:teuthology.orchestra.run.smithi049.stdout:Building include 2024-01-31T05:07:35.781 INFO:teuthology.orchestra.run.smithi049.stdout:Building lib 2024-01-31T05:07:35.788 INFO:teuthology.orchestra.run.smithi049.stdout:Building ltp 2024-01-31T05:07:35.795 INFO:teuthology.orchestra.run.smithi049.stdout:Building src 2024-01-31T05:07:35.851 INFO:teuthology.orchestra.run.smithi049.stdout:Building log-writes 2024-01-31T05:07:35.857 INFO:teuthology.orchestra.run.smithi049.stdout:Building perf 2024-01-31T05:07:35.863 INFO:teuthology.orchestra.run.smithi049.stdout:Building aio-dio-regress 2024-01-31T05:07:35.871 INFO:teuthology.orchestra.run.smithi049.stdout:Building vfs 2024-01-31T05:07:35.878 INFO:teuthology.orchestra.run.smithi049.stdout:Building m4 2024-01-31T05:07:35.884 INFO:teuthology.orchestra.run.smithi049.stdout:Building common 2024-01-31T05:07:35.890 INFO:teuthology.orchestra.run.smithi049.stdout:Building tests 2024-01-31T05:07:35.899 INFO:teuthology.orchestra.run.smithi049.stdout:Building btrfs 2024-01-31T05:07:35.909 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/btrfs/group.list 2024-01-31T05:07:36.037 INFO:teuthology.orchestra.run.smithi049.stdout:Building ceph 2024-01-31T05:07:36.045 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/ceph/group.list 2024-01-31T05:07:36.077 INFO:teuthology.orchestra.run.smithi049.stdout:Building cifs 2024-01-31T05:07:36.086 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/cifs/group.list 2024-01-31T05:07:36.113 INFO:teuthology.orchestra.run.smithi049.stdout:Building ext4 2024-01-31T05:07:36.122 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/ext4/group.list 2024-01-31T05:07:36.204 INFO:teuthology.orchestra.run.smithi049.stdout:Building f2fs 2024-01-31T05:07:36.213 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/f2fs/group.list 2024-01-31T05:07:36.251 INFO:teuthology.orchestra.run.smithi049.stdout:Building generic 2024-01-31T05:07:36.262 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/generic/group.list 2024-01-31T05:07:36.470 INFO:teuthology.orchestra.run.smithi049.stdout:Building nfs 2024-01-31T05:07:36.478 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/nfs/group.list 2024-01-31T05:07:36.510 INFO:teuthology.orchestra.run.smithi049.stdout:Building ocfs2 2024-01-31T05:07:36.519 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/ocfs2/group.list 2024-01-31T05:07:36.549 INFO:teuthology.orchestra.run.smithi049.stdout:Building overlay 2024-01-31T05:07:36.559 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/overlay/group.list 2024-01-31T05:07:36.648 INFO:teuthology.orchestra.run.smithi049.stdout:Building perf 2024-01-31T05:07:36.657 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/perf/group.list 2024-01-31T05:07:36.682 INFO:teuthology.orchestra.run.smithi049.stdout:Building selftest 2024-01-31T05:07:36.690 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/selftest/group.list 2024-01-31T05:07:36.718 INFO:teuthology.orchestra.run.smithi049.stdout:Building shared 2024-01-31T05:07:36.727 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/shared/group.list 2024-01-31T05:07:36.764 INFO:teuthology.orchestra.run.smithi049.stdout:Building tmpfs 2024-01-31T05:07:36.773 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/tmpfs/group.list 2024-01-31T05:07:36.802 INFO:teuthology.orchestra.run.smithi049.stdout:Building udf 2024-01-31T05:07:36.811 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/udf/group.list 2024-01-31T05:07:36.836 INFO:teuthology.orchestra.run.smithi049.stdout:Building xfs 2024-01-31T05:07:36.847 INFO:teuthology.orchestra.run.smithi049.stdout: [GROUP] /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/xfs/group.list 2024-01-31T05:07:37.054 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-01-31T05:07:37.058 INFO:teuthology.orchestra.run.smithi049.stdout:gmake[1]: Nothing to be done for 'install'. 2024-01-31T05:07:37.058 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-01-31T05:07:37.063 INFO:teuthology.orchestra.run.smithi049.stdout:gmake[1]: Nothing to be done for 'install'. 2024-01-31T05:07:37.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-01-31T05:07:37.068 INFO:teuthology.orchestra.run.smithi049.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-01-31T05:07:37.088 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-01-31T05:07:37.246 INFO:teuthology.orchestra.run.smithi049.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-01-31T05:07:37.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-01-31T05:07:37.295 INFO:teuthology.orchestra.run.smithi049.stdout:Building log-writes 2024-01-31T05:07:37.302 INFO:teuthology.orchestra.run.smithi049.stdout:Building perf 2024-01-31T05:07:37.309 INFO:teuthology.orchestra.run.smithi049.stdout:Building aio-dio-regress 2024-01-31T05:07:37.315 INFO:teuthology.orchestra.run.smithi049.stdout:Building vfs 2024-01-31T05:07:37.321 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake -C log-writes install 2024-01-31T05:07:37.324 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-01-31T05:07:37.345 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-01-31T05:07:37.365 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake -C perf install 2024-01-31T05:07:37.369 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-01-31T05:07:37.389 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-01-31T05:07:37.437 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-01-31T05:07:37.442 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-01-31T05:07:37.462 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-01-31T05:07:37.574 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake -C vfs install 2024-01-31T05:07:37.577 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-01-31T05:07:37.598 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-01-31T05:07:37.626 INFO:teuthology.orchestra.run.smithi049.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-01-31T05:07:37.646 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio uring_read_fault xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-01-31T05:07:40.456 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-01-31T05:07:40.677 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-01-31T05:07:40.724 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-01-31T05:07:40.728 INFO:teuthology.orchestra.run.smithi049.stdout:gmake[1]: Nothing to be done for 'install'. 2024-01-31T05:07:40.728 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-01-31T05:07:40.732 INFO:teuthology.orchestra.run.smithi049.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-01-31T05:07:40.751 INFO:teuthology.orchestra.run.smithi049.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-01-31T05:07:41.033 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-01-31T05:07:41.037 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/btrfs/ install 2024-01-31T05:07:41.042 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-01-31T05:07:41.062 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 /var/lib/xfstests/tests/btrfs 2024-01-31T05:07:42.801 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-01-31T05:07:42.822 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out /var/lib/xfstests/tests/btrfs 2024-01-31T05:07:44.558 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/ceph/ install 2024-01-31T05:07:44.562 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-01-31T05:07:44.583 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-01-31T05:07:44.626 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-01-31T05:07:44.647 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-01-31T05:07:44.689 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/cifs/ install 2024-01-31T05:07:44.693 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-01-31T05:07:44.713 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-01-31T05:07:44.733 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-01-31T05:07:44.753 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-01-31T05:07:44.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/ext4/ install 2024-01-31T05:07:44.778 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-01-31T05:07:44.798 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-01-31T05:07:45.195 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-01-31T05:07:45.215 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-01-31T05:07:45.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/f2fs/ install 2024-01-31T05:07:45.632 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-01-31T05:07:45.652 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-01-31T05:07:45.679 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-01-31T05:07:45.698 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-01-31T05:07:45.724 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/generic/ install 2024-01-31T05:07:45.732 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-01-31T05:07:45.752 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 /var/lib/xfstests/tests/generic 2024-01-31T05:07:48.909 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:07:48.913 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:07:49.968 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-01-31T05:07:49.988 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out /var/lib/xfstests/tests/generic 2024-01-31T05:07:54.211 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/nfs/ install 2024-01-31T05:07:54.215 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-01-31T05:07:54.236 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-01-31T05:07:54.256 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-01-31T05:07:54.277 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-01-31T05:07:54.296 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/ocfs2/ install 2024-01-31T05:07:54.300 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-01-31T05:07:54.320 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-01-31T05:07:54.340 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-01-31T05:07:54.360 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-01-31T05:07:54.381 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/overlay/ install 2024-01-31T05:07:54.386 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-01-31T05:07:54.406 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-01-31T05:07:55.011 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-01-31T05:07:55.031 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-01-31T05:07:55.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/perf/ install 2024-01-31T05:07:55.637 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-01-31T05:07:55.657 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-01-31T05:07:55.677 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-01-31T05:07:55.697 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-01-31T05:07:55.718 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/selftest/ install 2024-01-31T05:07:55.722 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-01-31T05:07:55.741 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-01-31T05:07:55.790 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-01-31T05:07:55.810 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-01-31T05:07:55.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/shared/ install 2024-01-31T05:07:55.862 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-01-31T05:07:55.882 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-01-31T05:07:55.915 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-01-31T05:07:55.934 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-01-31T05:07:55.965 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/tmpfs/ install 2024-01-31T05:07:55.969 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-01-31T05:07:55.989 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-01-31T05:07:56.010 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-01-31T05:07:56.030 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-01-31T05:07:56.050 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/udf/ install 2024-01-31T05:07:56.054 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-01-31T05:07:56.074 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-01-31T05:07:56.094 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-01-31T05:07:56.114 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-01-31T05:07:56.135 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MqKNGSMQ15xfstests-dev/tests/xfs/ install 2024-01-31T05:07:56.143 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-01-31T05:07:56.162 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 602 603 604 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-01-31T05:08:00.127 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-01-31T05:08:00.148 INFO:teuthology.orchestra.run.smithi049.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 602.out 603.out 604.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-01-31T05:08:04.137 INFO:teuthology.orchestra.run.smithi049.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-01-31T05:08:04.158 INFO:teuthology.orchestra.run.smithi049.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-01-31T05:08:04.177 INFO:teuthology.orchestra.run.smithi049.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-01-31T05:08:04.198 INFO:teuthology.orchestra.run.smithi049.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-01-31T05:08:04.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:08:04.221 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec ls tests/generic) 2024-01-31T05:08:04.232 INFO:teuthology.orchestra.run.smithi049.stdout:001 2024-01-31T05:08:04.232 INFO:teuthology.orchestra.run.smithi049.stdout:001.out 2024-01-31T05:08:04.232 INFO:teuthology.orchestra.run.smithi049.stdout:002 2024-01-31T05:08:04.232 INFO:teuthology.orchestra.run.smithi049.stdout:002.out 2024-01-31T05:08:04.232 INFO:teuthology.orchestra.run.smithi049.stdout:003 2024-01-31T05:08:04.232 INFO:teuthology.orchestra.run.smithi049.stdout:003.out 2024-01-31T05:08:04.233 INFO:teuthology.orchestra.run.smithi049.stdout:004 2024-01-31T05:08:04.233 INFO:teuthology.orchestra.run.smithi049.stdout:004.out 2024-01-31T05:08:04.233 INFO:teuthology.orchestra.run.smithi049.stdout:005 2024-01-31T05:08:04.233 INFO:teuthology.orchestra.run.smithi049.stdout:005.out 2024-01-31T05:08:04.233 INFO:teuthology.orchestra.run.smithi049.stdout:006 2024-01-31T05:08:04.233 INFO:teuthology.orchestra.run.smithi049.stdout:006.out 2024-01-31T05:08:04.233 INFO:teuthology.orchestra.run.smithi049.stdout:007 2024-01-31T05:08:04.233 INFO:teuthology.orchestra.run.smithi049.stdout:007.out 2024-01-31T05:08:04.233 INFO:teuthology.orchestra.run.smithi049.stdout:008 2024-01-31T05:08:04.233 INFO:teuthology.orchestra.run.smithi049.stdout:008.out 2024-01-31T05:08:04.233 INFO:teuthology.orchestra.run.smithi049.stdout:009 2024-01-31T05:08:04.233 INFO:teuthology.orchestra.run.smithi049.stdout:009.out 2024-01-31T05:08:04.233 INFO:teuthology.orchestra.run.smithi049.stdout:010 2024-01-31T05:08:04.234 INFO:teuthology.orchestra.run.smithi049.stdout:010.out 2024-01-31T05:08:04.234 INFO:teuthology.orchestra.run.smithi049.stdout:011 2024-01-31T05:08:04.234 INFO:teuthology.orchestra.run.smithi049.stdout:011.out 2024-01-31T05:08:04.234 INFO:teuthology.orchestra.run.smithi049.stdout:012 2024-01-31T05:08:04.234 INFO:teuthology.orchestra.run.smithi049.stdout:012.out 2024-01-31T05:08:04.234 INFO:teuthology.orchestra.run.smithi049.stdout:013 2024-01-31T05:08:04.234 INFO:teuthology.orchestra.run.smithi049.stdout:013.out 2024-01-31T05:08:04.234 INFO:teuthology.orchestra.run.smithi049.stdout:014 2024-01-31T05:08:04.234 INFO:teuthology.orchestra.run.smithi049.stdout:014.out 2024-01-31T05:08:04.234 INFO:teuthology.orchestra.run.smithi049.stdout:015 2024-01-31T05:08:04.234 INFO:teuthology.orchestra.run.smithi049.stdout:015.out 2024-01-31T05:08:04.234 INFO:teuthology.orchestra.run.smithi049.stdout:016 2024-01-31T05:08:04.234 INFO:teuthology.orchestra.run.smithi049.stdout:016.out 2024-01-31T05:08:04.235 INFO:teuthology.orchestra.run.smithi049.stdout:017 2024-01-31T05:08:04.235 INFO:teuthology.orchestra.run.smithi049.stdout:017.out 2024-01-31T05:08:04.235 INFO:teuthology.orchestra.run.smithi049.stdout:018 2024-01-31T05:08:04.235 INFO:teuthology.orchestra.run.smithi049.stdout:018.out 2024-01-31T05:08:04.235 INFO:teuthology.orchestra.run.smithi049.stdout:019 2024-01-31T05:08:04.235 INFO:teuthology.orchestra.run.smithi049.stdout:019.out 2024-01-31T05:08:04.235 INFO:teuthology.orchestra.run.smithi049.stdout:020 2024-01-31T05:08:04.235 INFO:teuthology.orchestra.run.smithi049.stdout:020.out 2024-01-31T05:08:04.235 INFO:teuthology.orchestra.run.smithi049.stdout:021 2024-01-31T05:08:04.235 INFO:teuthology.orchestra.run.smithi049.stdout:021.out 2024-01-31T05:08:04.235 INFO:teuthology.orchestra.run.smithi049.stdout:022 2024-01-31T05:08:04.235 INFO:teuthology.orchestra.run.smithi049.stdout:022.out 2024-01-31T05:08:04.235 INFO:teuthology.orchestra.run.smithi049.stdout:023 2024-01-31T05:08:04.235 INFO:teuthology.orchestra.run.smithi049.stdout:023.out 2024-01-31T05:08:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:024 2024-01-31T05:08:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:024.out 2024-01-31T05:08:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:025 2024-01-31T05:08:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:025.out 2024-01-31T05:08:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:026 2024-01-31T05:08:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:026.out 2024-01-31T05:08:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:027 2024-01-31T05:08:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:027.out 2024-01-31T05:08:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:028 2024-01-31T05:08:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:028.out 2024-01-31T05:08:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:029 2024-01-31T05:08:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:029.out 2024-01-31T05:08:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:030 2024-01-31T05:08:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:030.out 2024-01-31T05:08:04.237 INFO:teuthology.orchestra.run.smithi049.stdout:031 2024-01-31T05:08:04.237 INFO:teuthology.orchestra.run.smithi049.stdout:031.out 2024-01-31T05:08:04.237 INFO:teuthology.orchestra.run.smithi049.stdout:032 2024-01-31T05:08:04.237 INFO:teuthology.orchestra.run.smithi049.stdout:032.out 2024-01-31T05:08:04.237 INFO:teuthology.orchestra.run.smithi049.stdout:033 2024-01-31T05:08:04.237 INFO:teuthology.orchestra.run.smithi049.stdout:033.out 2024-01-31T05:08:04.237 INFO:teuthology.orchestra.run.smithi049.stdout:034 2024-01-31T05:08:04.237 INFO:teuthology.orchestra.run.smithi049.stdout:034.out 2024-01-31T05:08:04.237 INFO:teuthology.orchestra.run.smithi049.stdout:035 2024-01-31T05:08:04.237 INFO:teuthology.orchestra.run.smithi049.stdout:035.cfg 2024-01-31T05:08:04.237 INFO:teuthology.orchestra.run.smithi049.stdout:035.out.default 2024-01-31T05:08:04.237 INFO:teuthology.orchestra.run.smithi049.stdout:035.out.nfs 2024-01-31T05:08:04.237 INFO:teuthology.orchestra.run.smithi049.stdout:036 2024-01-31T05:08:04.238 INFO:teuthology.orchestra.run.smithi049.stdout:036.out 2024-01-31T05:08:04.238 INFO:teuthology.orchestra.run.smithi049.stdout:037 2024-01-31T05:08:04.238 INFO:teuthology.orchestra.run.smithi049.stdout:037.out 2024-01-31T05:08:04.238 INFO:teuthology.orchestra.run.smithi049.stdout:038 2024-01-31T05:08:04.238 INFO:teuthology.orchestra.run.smithi049.stdout:038.out 2024-01-31T05:08:04.238 INFO:teuthology.orchestra.run.smithi049.stdout:039 2024-01-31T05:08:04.238 INFO:teuthology.orchestra.run.smithi049.stdout:039.out 2024-01-31T05:08:04.238 INFO:teuthology.orchestra.run.smithi049.stdout:040 2024-01-31T05:08:04.238 INFO:teuthology.orchestra.run.smithi049.stdout:040.out 2024-01-31T05:08:04.238 INFO:teuthology.orchestra.run.smithi049.stdout:041 2024-01-31T05:08:04.238 INFO:teuthology.orchestra.run.smithi049.stdout:041.out 2024-01-31T05:08:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:042 2024-01-31T05:08:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:042.out 2024-01-31T05:08:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:043 2024-01-31T05:08:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:043.out 2024-01-31T05:08:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:044 2024-01-31T05:08:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:044.out 2024-01-31T05:08:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:045 2024-01-31T05:08:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:045.out 2024-01-31T05:08:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:046 2024-01-31T05:08:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:046.out 2024-01-31T05:08:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:047 2024-01-31T05:08:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:047.out 2024-01-31T05:08:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:048 2024-01-31T05:08:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:048.out 2024-01-31T05:08:04.240 INFO:teuthology.orchestra.run.smithi049.stdout:049 2024-01-31T05:08:04.240 INFO:teuthology.orchestra.run.smithi049.stdout:049.out 2024-01-31T05:08:04.240 INFO:teuthology.orchestra.run.smithi049.stdout:050 2024-01-31T05:08:04.240 INFO:teuthology.orchestra.run.smithi049.stdout:050.cfg 2024-01-31T05:08:04.240 INFO:teuthology.orchestra.run.smithi049.stdout:050.out.default 2024-01-31T05:08:04.240 INFO:teuthology.orchestra.run.smithi049.stdout:050.out.nojournal 2024-01-31T05:08:04.240 INFO:teuthology.orchestra.run.smithi049.stdout:050.out.xfsquota 2024-01-31T05:08:04.240 INFO:teuthology.orchestra.run.smithi049.stdout:051 2024-01-31T05:08:04.240 INFO:teuthology.orchestra.run.smithi049.stdout:051.out 2024-01-31T05:08:04.240 INFO:teuthology.orchestra.run.smithi049.stdout:052 2024-01-31T05:08:04.240 INFO:teuthology.orchestra.run.smithi049.stdout:052.out 2024-01-31T05:08:04.240 INFO:teuthology.orchestra.run.smithi049.stdout:053 2024-01-31T05:08:04.240 INFO:teuthology.orchestra.run.smithi049.stdout:053.out 2024-01-31T05:08:04.241 INFO:teuthology.orchestra.run.smithi049.stdout:054 2024-01-31T05:08:04.241 INFO:teuthology.orchestra.run.smithi049.stdout:054.out 2024-01-31T05:08:04.241 INFO:teuthology.orchestra.run.smithi049.stdout:055 2024-01-31T05:08:04.241 INFO:teuthology.orchestra.run.smithi049.stdout:055.out 2024-01-31T05:08:04.241 INFO:teuthology.orchestra.run.smithi049.stdout:056 2024-01-31T05:08:04.241 INFO:teuthology.orchestra.run.smithi049.stdout:056.out 2024-01-31T05:08:04.241 INFO:teuthology.orchestra.run.smithi049.stdout:057 2024-01-31T05:08:04.241 INFO:teuthology.orchestra.run.smithi049.stdout:057.out 2024-01-31T05:08:04.241 INFO:teuthology.orchestra.run.smithi049.stdout:058 2024-01-31T05:08:04.241 INFO:teuthology.orchestra.run.smithi049.stdout:058.out 2024-01-31T05:08:04.241 INFO:teuthology.orchestra.run.smithi049.stdout:059 2024-01-31T05:08:04.241 INFO:teuthology.orchestra.run.smithi049.stdout:059.out 2024-01-31T05:08:04.241 INFO:teuthology.orchestra.run.smithi049.stdout:060 2024-01-31T05:08:04.242 INFO:teuthology.orchestra.run.smithi049.stdout:060.out 2024-01-31T05:08:04.242 INFO:teuthology.orchestra.run.smithi049.stdout:061 2024-01-31T05:08:04.242 INFO:teuthology.orchestra.run.smithi049.stdout:061.out 2024-01-31T05:08:04.242 INFO:teuthology.orchestra.run.smithi049.stdout:062 2024-01-31T05:08:04.242 INFO:teuthology.orchestra.run.smithi049.stdout:062.out 2024-01-31T05:08:04.242 INFO:teuthology.orchestra.run.smithi049.stdout:063 2024-01-31T05:08:04.242 INFO:teuthology.orchestra.run.smithi049.stdout:063.out 2024-01-31T05:08:04.242 INFO:teuthology.orchestra.run.smithi049.stdout:064 2024-01-31T05:08:04.242 INFO:teuthology.orchestra.run.smithi049.stdout:064.out 2024-01-31T05:08:04.242 INFO:teuthology.orchestra.run.smithi049.stdout:065 2024-01-31T05:08:04.242 INFO:teuthology.orchestra.run.smithi049.stdout:065.out 2024-01-31T05:08:04.242 INFO:teuthology.orchestra.run.smithi049.stdout:066 2024-01-31T05:08:04.242 INFO:teuthology.orchestra.run.smithi049.stdout:066.out 2024-01-31T05:08:04.243 INFO:teuthology.orchestra.run.smithi049.stdout:067 2024-01-31T05:08:04.243 INFO:teuthology.orchestra.run.smithi049.stdout:067.out 2024-01-31T05:08:04.243 INFO:teuthology.orchestra.run.smithi049.stdout:068 2024-01-31T05:08:04.243 INFO:teuthology.orchestra.run.smithi049.stdout:068.out 2024-01-31T05:08:04.243 INFO:teuthology.orchestra.run.smithi049.stdout:069 2024-01-31T05:08:04.243 INFO:teuthology.orchestra.run.smithi049.stdout:069.out 2024-01-31T05:08:04.243 INFO:teuthology.orchestra.run.smithi049.stdout:070 2024-01-31T05:08:04.243 INFO:teuthology.orchestra.run.smithi049.stdout:070.out 2024-01-31T05:08:04.243 INFO:teuthology.orchestra.run.smithi049.stdout:071 2024-01-31T05:08:04.243 INFO:teuthology.orchestra.run.smithi049.stdout:071.out 2024-01-31T05:08:04.243 INFO:teuthology.orchestra.run.smithi049.stdout:072 2024-01-31T05:08:04.243 INFO:teuthology.orchestra.run.smithi049.stdout:072.out 2024-01-31T05:08:04.243 INFO:teuthology.orchestra.run.smithi049.stdout:073 2024-01-31T05:08:04.243 INFO:teuthology.orchestra.run.smithi049.stdout:073.out 2024-01-31T05:08:04.244 INFO:teuthology.orchestra.run.smithi049.stdout:074 2024-01-31T05:08:04.244 INFO:teuthology.orchestra.run.smithi049.stdout:074.out 2024-01-31T05:08:04.244 INFO:teuthology.orchestra.run.smithi049.stdout:075 2024-01-31T05:08:04.244 INFO:teuthology.orchestra.run.smithi049.stdout:075.out 2024-01-31T05:08:04.244 INFO:teuthology.orchestra.run.smithi049.stdout:076 2024-01-31T05:08:04.244 INFO:teuthology.orchestra.run.smithi049.stdout:076.out 2024-01-31T05:08:04.244 INFO:teuthology.orchestra.run.smithi049.stdout:077 2024-01-31T05:08:04.244 INFO:teuthology.orchestra.run.smithi049.stdout:077.out 2024-01-31T05:08:04.244 INFO:teuthology.orchestra.run.smithi049.stdout:078 2024-01-31T05:08:04.244 INFO:teuthology.orchestra.run.smithi049.stdout:078.out 2024-01-31T05:08:04.244 INFO:teuthology.orchestra.run.smithi049.stdout:079 2024-01-31T05:08:04.244 INFO:teuthology.orchestra.run.smithi049.stdout:079.out 2024-01-31T05:08:04.244 INFO:teuthology.orchestra.run.smithi049.stdout:080 2024-01-31T05:08:04.245 INFO:teuthology.orchestra.run.smithi049.stdout:080.out 2024-01-31T05:08:04.245 INFO:teuthology.orchestra.run.smithi049.stdout:081 2024-01-31T05:08:04.245 INFO:teuthology.orchestra.run.smithi049.stdout:081.out 2024-01-31T05:08:04.245 INFO:teuthology.orchestra.run.smithi049.stdout:082 2024-01-31T05:08:04.245 INFO:teuthology.orchestra.run.smithi049.stdout:082.out 2024-01-31T05:08:04.245 INFO:teuthology.orchestra.run.smithi049.stdout:083 2024-01-31T05:08:04.245 INFO:teuthology.orchestra.run.smithi049.stdout:083.out 2024-01-31T05:08:04.245 INFO:teuthology.orchestra.run.smithi049.stdout:084 2024-01-31T05:08:04.245 INFO:teuthology.orchestra.run.smithi049.stdout:084.out 2024-01-31T05:08:04.245 INFO:teuthology.orchestra.run.smithi049.stdout:085 2024-01-31T05:08:04.245 INFO:teuthology.orchestra.run.smithi049.stdout:085.out 2024-01-31T05:08:04.245 INFO:teuthology.orchestra.run.smithi049.stdout:086 2024-01-31T05:08:04.245 INFO:teuthology.orchestra.run.smithi049.stdout:086.out 2024-01-31T05:08:04.245 INFO:teuthology.orchestra.run.smithi049.stdout:087 2024-01-31T05:08:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:087.out 2024-01-31T05:08:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:088 2024-01-31T05:08:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:088.out 2024-01-31T05:08:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:089 2024-01-31T05:08:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:089.out 2024-01-31T05:08:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:090 2024-01-31T05:08:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:090.out 2024-01-31T05:08:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:091 2024-01-31T05:08:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:091.out 2024-01-31T05:08:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:092 2024-01-31T05:08:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:092.out 2024-01-31T05:08:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:093 2024-01-31T05:08:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:093.out 2024-01-31T05:08:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:094 2024-01-31T05:08:04.246 INFO:teuthology.orchestra.run.smithi049.stdout:094.out 2024-01-31T05:08:04.247 INFO:teuthology.orchestra.run.smithi049.stdout:095 2024-01-31T05:08:04.247 INFO:teuthology.orchestra.run.smithi049.stdout:095.out 2024-01-31T05:08:04.247 INFO:teuthology.orchestra.run.smithi049.stdout:096 2024-01-31T05:08:04.247 INFO:teuthology.orchestra.run.smithi049.stdout:096.out 2024-01-31T05:08:04.247 INFO:teuthology.orchestra.run.smithi049.stdout:097 2024-01-31T05:08:04.247 INFO:teuthology.orchestra.run.smithi049.stdout:097.out 2024-01-31T05:08:04.247 INFO:teuthology.orchestra.run.smithi049.stdout:098 2024-01-31T05:08:04.247 INFO:teuthology.orchestra.run.smithi049.stdout:098.out 2024-01-31T05:08:04.247 INFO:teuthology.orchestra.run.smithi049.stdout:099 2024-01-31T05:08:04.247 INFO:teuthology.orchestra.run.smithi049.stdout:099.out 2024-01-31T05:08:04.247 INFO:teuthology.orchestra.run.smithi049.stdout:100 2024-01-31T05:08:04.247 INFO:teuthology.orchestra.run.smithi049.stdout:100.out 2024-01-31T05:08:04.247 INFO:teuthology.orchestra.run.smithi049.stdout:101 2024-01-31T05:08:04.247 INFO:teuthology.orchestra.run.smithi049.stdout:101.out 2024-01-31T05:08:04.248 INFO:teuthology.orchestra.run.smithi049.stdout:102 2024-01-31T05:08:04.248 INFO:teuthology.orchestra.run.smithi049.stdout:102.out 2024-01-31T05:08:04.248 INFO:teuthology.orchestra.run.smithi049.stdout:103 2024-01-31T05:08:04.248 INFO:teuthology.orchestra.run.smithi049.stdout:103.out 2024-01-31T05:08:04.248 INFO:teuthology.orchestra.run.smithi049.stdout:104 2024-01-31T05:08:04.248 INFO:teuthology.orchestra.run.smithi049.stdout:104.out 2024-01-31T05:08:04.248 INFO:teuthology.orchestra.run.smithi049.stdout:105 2024-01-31T05:08:04.248 INFO:teuthology.orchestra.run.smithi049.stdout:105.out 2024-01-31T05:08:04.248 INFO:teuthology.orchestra.run.smithi049.stdout:106 2024-01-31T05:08:04.248 INFO:teuthology.orchestra.run.smithi049.stdout:106.out 2024-01-31T05:08:04.248 INFO:teuthology.orchestra.run.smithi049.stdout:107 2024-01-31T05:08:04.248 INFO:teuthology.orchestra.run.smithi049.stdout:107.out 2024-01-31T05:08:04.248 INFO:teuthology.orchestra.run.smithi049.stdout:108 2024-01-31T05:08:04.249 INFO:teuthology.orchestra.run.smithi049.stdout:108.out 2024-01-31T05:08:04.249 INFO:teuthology.orchestra.run.smithi049.stdout:109 2024-01-31T05:08:04.249 INFO:teuthology.orchestra.run.smithi049.stdout:109.out 2024-01-31T05:08:04.249 INFO:teuthology.orchestra.run.smithi049.stdout:110 2024-01-31T05:08:04.249 INFO:teuthology.orchestra.run.smithi049.stdout:110.out 2024-01-31T05:08:04.249 INFO:teuthology.orchestra.run.smithi049.stdout:111 2024-01-31T05:08:04.249 INFO:teuthology.orchestra.run.smithi049.stdout:111.out 2024-01-31T05:08:04.249 INFO:teuthology.orchestra.run.smithi049.stdout:112 2024-01-31T05:08:04.249 INFO:teuthology.orchestra.run.smithi049.stdout:112.out 2024-01-31T05:08:04.249 INFO:teuthology.orchestra.run.smithi049.stdout:113 2024-01-31T05:08:04.249 INFO:teuthology.orchestra.run.smithi049.stdout:113.out 2024-01-31T05:08:04.249 INFO:teuthology.orchestra.run.smithi049.stdout:114 2024-01-31T05:08:04.249 INFO:teuthology.orchestra.run.smithi049.stdout:114.out 2024-01-31T05:08:04.249 INFO:teuthology.orchestra.run.smithi049.stdout:115 2024-01-31T05:08:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:115.out 2024-01-31T05:08:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:116 2024-01-31T05:08:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:116.out 2024-01-31T05:08:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:117 2024-01-31T05:08:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:117.out 2024-01-31T05:08:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:118 2024-01-31T05:08:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:118.out 2024-01-31T05:08:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:119 2024-01-31T05:08:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:119.out 2024-01-31T05:08:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:120 2024-01-31T05:08:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:120.out 2024-01-31T05:08:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:121 2024-01-31T05:08:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:121.out 2024-01-31T05:08:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:122 2024-01-31T05:08:04.250 INFO:teuthology.orchestra.run.smithi049.stdout:122.out 2024-01-31T05:08:04.251 INFO:teuthology.orchestra.run.smithi049.stdout:123 2024-01-31T05:08:04.251 INFO:teuthology.orchestra.run.smithi049.stdout:123.out 2024-01-31T05:08:04.251 INFO:teuthology.orchestra.run.smithi049.stdout:124 2024-01-31T05:08:04.251 INFO:teuthology.orchestra.run.smithi049.stdout:124.out 2024-01-31T05:08:04.251 INFO:teuthology.orchestra.run.smithi049.stdout:125 2024-01-31T05:08:04.251 INFO:teuthology.orchestra.run.smithi049.stdout:125.out 2024-01-31T05:08:04.251 INFO:teuthology.orchestra.run.smithi049.stdout:126 2024-01-31T05:08:04.251 INFO:teuthology.orchestra.run.smithi049.stdout:126.out 2024-01-31T05:08:04.251 INFO:teuthology.orchestra.run.smithi049.stdout:127 2024-01-31T05:08:04.251 INFO:teuthology.orchestra.run.smithi049.stdout:127.out 2024-01-31T05:08:04.251 INFO:teuthology.orchestra.run.smithi049.stdout:128 2024-01-31T05:08:04.251 INFO:teuthology.orchestra.run.smithi049.stdout:128.out 2024-01-31T05:08:04.251 INFO:teuthology.orchestra.run.smithi049.stdout:129 2024-01-31T05:08:04.251 INFO:teuthology.orchestra.run.smithi049.stdout:129.out 2024-01-31T05:08:04.251 INFO:teuthology.orchestra.run.smithi049.stdout:130 2024-01-31T05:08:04.252 INFO:teuthology.orchestra.run.smithi049.stdout:130.out 2024-01-31T05:08:04.252 INFO:teuthology.orchestra.run.smithi049.stdout:131 2024-01-31T05:08:04.252 INFO:teuthology.orchestra.run.smithi049.stdout:131.out 2024-01-31T05:08:04.252 INFO:teuthology.orchestra.run.smithi049.stdout:132 2024-01-31T05:08:04.252 INFO:teuthology.orchestra.run.smithi049.stdout:132.out 2024-01-31T05:08:04.252 INFO:teuthology.orchestra.run.smithi049.stdout:133 2024-01-31T05:08:04.252 INFO:teuthology.orchestra.run.smithi049.stdout:133.out 2024-01-31T05:08:04.252 INFO:teuthology.orchestra.run.smithi049.stdout:134 2024-01-31T05:08:04.252 INFO:teuthology.orchestra.run.smithi049.stdout:134.out 2024-01-31T05:08:04.252 INFO:teuthology.orchestra.run.smithi049.stdout:135 2024-01-31T05:08:04.252 INFO:teuthology.orchestra.run.smithi049.stdout:135.out 2024-01-31T05:08:04.252 INFO:teuthology.orchestra.run.smithi049.stdout:136 2024-01-31T05:08:04.252 INFO:teuthology.orchestra.run.smithi049.stdout:136.out 2024-01-31T05:08:04.252 INFO:teuthology.orchestra.run.smithi049.stdout:137 2024-01-31T05:08:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:137.out 2024-01-31T05:08:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:138 2024-01-31T05:08:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:138.out 2024-01-31T05:08:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:139 2024-01-31T05:08:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:139.out 2024-01-31T05:08:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:140 2024-01-31T05:08:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:140.out 2024-01-31T05:08:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:141 2024-01-31T05:08:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:141.out 2024-01-31T05:08:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:142 2024-01-31T05:08:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:142.out 2024-01-31T05:08:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:143 2024-01-31T05:08:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:143.out 2024-01-31T05:08:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:144 2024-01-31T05:08:04.253 INFO:teuthology.orchestra.run.smithi049.stdout:144.out 2024-01-31T05:08:04.254 INFO:teuthology.orchestra.run.smithi049.stdout:145 2024-01-31T05:08:04.254 INFO:teuthology.orchestra.run.smithi049.stdout:145.out 2024-01-31T05:08:04.254 INFO:teuthology.orchestra.run.smithi049.stdout:146 2024-01-31T05:08:04.254 INFO:teuthology.orchestra.run.smithi049.stdout:146.out 2024-01-31T05:08:04.254 INFO:teuthology.orchestra.run.smithi049.stdout:147 2024-01-31T05:08:04.254 INFO:teuthology.orchestra.run.smithi049.stdout:147.out 2024-01-31T05:08:04.254 INFO:teuthology.orchestra.run.smithi049.stdout:148 2024-01-31T05:08:04.254 INFO:teuthology.orchestra.run.smithi049.stdout:148.out 2024-01-31T05:08:04.254 INFO:teuthology.orchestra.run.smithi049.stdout:149 2024-01-31T05:08:04.254 INFO:teuthology.orchestra.run.smithi049.stdout:149.out 2024-01-31T05:08:04.254 INFO:teuthology.orchestra.run.smithi049.stdout:150 2024-01-31T05:08:04.254 INFO:teuthology.orchestra.run.smithi049.stdout:150.out 2024-01-31T05:08:04.254 INFO:teuthology.orchestra.run.smithi049.stdout:151 2024-01-31T05:08:04.254 INFO:teuthology.orchestra.run.smithi049.stdout:151.out 2024-01-31T05:08:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:152 2024-01-31T05:08:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:152.out 2024-01-31T05:08:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:153 2024-01-31T05:08:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:153.out 2024-01-31T05:08:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:154 2024-01-31T05:08:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:154.out 2024-01-31T05:08:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:155 2024-01-31T05:08:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:155.out 2024-01-31T05:08:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:156 2024-01-31T05:08:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:156.out 2024-01-31T05:08:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:157 2024-01-31T05:08:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:157.out 2024-01-31T05:08:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:158 2024-01-31T05:08:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:158.out 2024-01-31T05:08:04.255 INFO:teuthology.orchestra.run.smithi049.stdout:159 2024-01-31T05:08:04.256 INFO:teuthology.orchestra.run.smithi049.stdout:159.out 2024-01-31T05:08:04.256 INFO:teuthology.orchestra.run.smithi049.stdout:160 2024-01-31T05:08:04.256 INFO:teuthology.orchestra.run.smithi049.stdout:160.out 2024-01-31T05:08:04.256 INFO:teuthology.orchestra.run.smithi049.stdout:161 2024-01-31T05:08:04.256 INFO:teuthology.orchestra.run.smithi049.stdout:161.out 2024-01-31T05:08:04.256 INFO:teuthology.orchestra.run.smithi049.stdout:162 2024-01-31T05:08:04.256 INFO:teuthology.orchestra.run.smithi049.stdout:162.out 2024-01-31T05:08:04.256 INFO:teuthology.orchestra.run.smithi049.stdout:163 2024-01-31T05:08:04.256 INFO:teuthology.orchestra.run.smithi049.stdout:163.out 2024-01-31T05:08:04.256 INFO:teuthology.orchestra.run.smithi049.stdout:164 2024-01-31T05:08:04.256 INFO:teuthology.orchestra.run.smithi049.stdout:164.out 2024-01-31T05:08:04.256 INFO:teuthology.orchestra.run.smithi049.stdout:165 2024-01-31T05:08:04.256 INFO:teuthology.orchestra.run.smithi049.stdout:165.out 2024-01-31T05:08:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:166 2024-01-31T05:08:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:166.out 2024-01-31T05:08:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:167 2024-01-31T05:08:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:167.out 2024-01-31T05:08:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:168 2024-01-31T05:08:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:168.out 2024-01-31T05:08:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:169 2024-01-31T05:08:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:169.out 2024-01-31T05:08:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:170 2024-01-31T05:08:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:170.out 2024-01-31T05:08:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:171 2024-01-31T05:08:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:171.out 2024-01-31T05:08:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:172 2024-01-31T05:08:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:172.out 2024-01-31T05:08:04.257 INFO:teuthology.orchestra.run.smithi049.stdout:173 2024-01-31T05:08:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:173.out 2024-01-31T05:08:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:174 2024-01-31T05:08:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:174.out 2024-01-31T05:08:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:175 2024-01-31T05:08:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:175.out 2024-01-31T05:08:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:176 2024-01-31T05:08:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:176.out 2024-01-31T05:08:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:177 2024-01-31T05:08:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:177.out 2024-01-31T05:08:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:178 2024-01-31T05:08:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:178.out 2024-01-31T05:08:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:179 2024-01-31T05:08:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:179.out 2024-01-31T05:08:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:180 2024-01-31T05:08:04.258 INFO:teuthology.orchestra.run.smithi049.stdout:180.out 2024-01-31T05:08:04.259 INFO:teuthology.orchestra.run.smithi049.stdout:181 2024-01-31T05:08:04.259 INFO:teuthology.orchestra.run.smithi049.stdout:181.out 2024-01-31T05:08:04.259 INFO:teuthology.orchestra.run.smithi049.stdout:182 2024-01-31T05:08:04.259 INFO:teuthology.orchestra.run.smithi049.stdout:182.out 2024-01-31T05:08:04.259 INFO:teuthology.orchestra.run.smithi049.stdout:183 2024-01-31T05:08:04.259 INFO:teuthology.orchestra.run.smithi049.stdout:183.out 2024-01-31T05:08:04.259 INFO:teuthology.orchestra.run.smithi049.stdout:184 2024-01-31T05:08:04.259 INFO:teuthology.orchestra.run.smithi049.stdout:184.out 2024-01-31T05:08:04.259 INFO:teuthology.orchestra.run.smithi049.stdout:185 2024-01-31T05:08:04.259 INFO:teuthology.orchestra.run.smithi049.stdout:185.out 2024-01-31T05:08:04.259 INFO:teuthology.orchestra.run.smithi049.stdout:186 2024-01-31T05:08:04.259 INFO:teuthology.orchestra.run.smithi049.stdout:186.out 2024-01-31T05:08:04.259 INFO:teuthology.orchestra.run.smithi049.stdout:187 2024-01-31T05:08:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:187.out 2024-01-31T05:08:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:188 2024-01-31T05:08:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:188.out 2024-01-31T05:08:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:189 2024-01-31T05:08:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:189.out 2024-01-31T05:08:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:190 2024-01-31T05:08:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:190.out 2024-01-31T05:08:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:191 2024-01-31T05:08:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:191.out 2024-01-31T05:08:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:192 2024-01-31T05:08:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:192.out 2024-01-31T05:08:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:193 2024-01-31T05:08:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:193.out 2024-01-31T05:08:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:194 2024-01-31T05:08:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:194.out 2024-01-31T05:08:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:195 2024-01-31T05:08:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:195.out 2024-01-31T05:08:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:196 2024-01-31T05:08:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:196.out 2024-01-31T05:08:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:197 2024-01-31T05:08:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:197.out 2024-01-31T05:08:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:198 2024-01-31T05:08:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:198.out 2024-01-31T05:08:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:199 2024-01-31T05:08:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:199.out 2024-01-31T05:08:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:200 2024-01-31T05:08:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:200.out 2024-01-31T05:08:04.261 INFO:teuthology.orchestra.run.smithi049.stdout:201 2024-01-31T05:08:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:201.out 2024-01-31T05:08:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:202 2024-01-31T05:08:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:202.out 2024-01-31T05:08:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:203 2024-01-31T05:08:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:203.out 2024-01-31T05:08:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:204 2024-01-31T05:08:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:204.out 2024-01-31T05:08:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:205 2024-01-31T05:08:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:205.out 2024-01-31T05:08:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:206 2024-01-31T05:08:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:206.out 2024-01-31T05:08:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:207 2024-01-31T05:08:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:207.out 2024-01-31T05:08:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:208 2024-01-31T05:08:04.262 INFO:teuthology.orchestra.run.smithi049.stdout:208.out 2024-01-31T05:08:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:209 2024-01-31T05:08:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:209.out 2024-01-31T05:08:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:210 2024-01-31T05:08:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:210.out 2024-01-31T05:08:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:211 2024-01-31T05:08:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:211.out 2024-01-31T05:08:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:212 2024-01-31T05:08:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:212.out 2024-01-31T05:08:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:213 2024-01-31T05:08:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:213.out 2024-01-31T05:08:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:214 2024-01-31T05:08:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:214.out 2024-01-31T05:08:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:215 2024-01-31T05:08:04.263 INFO:teuthology.orchestra.run.smithi049.stdout:215.out 2024-01-31T05:08:04.264 INFO:teuthology.orchestra.run.smithi049.stdout:216 2024-01-31T05:08:04.264 INFO:teuthology.orchestra.run.smithi049.stdout:216.out 2024-01-31T05:08:04.264 INFO:teuthology.orchestra.run.smithi049.stdout:217 2024-01-31T05:08:04.264 INFO:teuthology.orchestra.run.smithi049.stdout:217.out 2024-01-31T05:08:04.264 INFO:teuthology.orchestra.run.smithi049.stdout:218 2024-01-31T05:08:04.264 INFO:teuthology.orchestra.run.smithi049.stdout:218.out 2024-01-31T05:08:04.264 INFO:teuthology.orchestra.run.smithi049.stdout:219 2024-01-31T05:08:04.264 INFO:teuthology.orchestra.run.smithi049.stdout:219.out 2024-01-31T05:08:04.264 INFO:teuthology.orchestra.run.smithi049.stdout:220 2024-01-31T05:08:04.264 INFO:teuthology.orchestra.run.smithi049.stdout:220.out 2024-01-31T05:08:04.264 INFO:teuthology.orchestra.run.smithi049.stdout:221 2024-01-31T05:08:04.264 INFO:teuthology.orchestra.run.smithi049.stdout:221.out 2024-01-31T05:08:04.264 INFO:teuthology.orchestra.run.smithi049.stdout:222 2024-01-31T05:08:04.264 INFO:teuthology.orchestra.run.smithi049.stdout:222.out 2024-01-31T05:08:04.265 INFO:teuthology.orchestra.run.smithi049.stdout:223 2024-01-31T05:08:04.265 INFO:teuthology.orchestra.run.smithi049.stdout:223.out 2024-01-31T05:08:04.265 INFO:teuthology.orchestra.run.smithi049.stdout:224 2024-01-31T05:08:04.265 INFO:teuthology.orchestra.run.smithi049.stdout:224.out 2024-01-31T05:08:04.265 INFO:teuthology.orchestra.run.smithi049.stdout:225 2024-01-31T05:08:04.265 INFO:teuthology.orchestra.run.smithi049.stdout:225.out 2024-01-31T05:08:04.265 INFO:teuthology.orchestra.run.smithi049.stdout:226 2024-01-31T05:08:04.265 INFO:teuthology.orchestra.run.smithi049.stdout:226.out 2024-01-31T05:08:04.265 INFO:teuthology.orchestra.run.smithi049.stdout:227 2024-01-31T05:08:04.265 INFO:teuthology.orchestra.run.smithi049.stdout:227.out 2024-01-31T05:08:04.265 INFO:teuthology.orchestra.run.smithi049.stdout:228 2024-01-31T05:08:04.265 INFO:teuthology.orchestra.run.smithi049.stdout:228.out 2024-01-31T05:08:04.265 INFO:teuthology.orchestra.run.smithi049.stdout:229 2024-01-31T05:08:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:229.out 2024-01-31T05:08:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:230 2024-01-31T05:08:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:230.out 2024-01-31T05:08:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:231 2024-01-31T05:08:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:231.out 2024-01-31T05:08:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:232 2024-01-31T05:08:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:232.out 2024-01-31T05:08:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:233 2024-01-31T05:08:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:233.out 2024-01-31T05:08:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:234 2024-01-31T05:08:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:234.out 2024-01-31T05:08:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:235 2024-01-31T05:08:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:235.out 2024-01-31T05:08:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:236 2024-01-31T05:08:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:236.out 2024-01-31T05:08:04.266 INFO:teuthology.orchestra.run.smithi049.stdout:237 2024-01-31T05:08:04.267 INFO:teuthology.orchestra.run.smithi049.stdout:237.out 2024-01-31T05:08:04.267 INFO:teuthology.orchestra.run.smithi049.stdout:238 2024-01-31T05:08:04.267 INFO:teuthology.orchestra.run.smithi049.stdout:238.out 2024-01-31T05:08:04.267 INFO:teuthology.orchestra.run.smithi049.stdout:239 2024-01-31T05:08:04.267 INFO:teuthology.orchestra.run.smithi049.stdout:239.out 2024-01-31T05:08:04.267 INFO:teuthology.orchestra.run.smithi049.stdout:240 2024-01-31T05:08:04.267 INFO:teuthology.orchestra.run.smithi049.stdout:240.out 2024-01-31T05:08:04.267 INFO:teuthology.orchestra.run.smithi049.stdout:241 2024-01-31T05:08:04.267 INFO:teuthology.orchestra.run.smithi049.stdout:241.out 2024-01-31T05:08:04.267 INFO:teuthology.orchestra.run.smithi049.stdout:242 2024-01-31T05:08:04.267 INFO:teuthology.orchestra.run.smithi049.stdout:242.out 2024-01-31T05:08:04.267 INFO:teuthology.orchestra.run.smithi049.stdout:243 2024-01-31T05:08:04.267 INFO:teuthology.orchestra.run.smithi049.stdout:243.out 2024-01-31T05:08:04.267 INFO:teuthology.orchestra.run.smithi049.stdout:244 2024-01-31T05:08:04.268 INFO:teuthology.orchestra.run.smithi049.stdout:244.out 2024-01-31T05:08:04.268 INFO:teuthology.orchestra.run.smithi049.stdout:245 2024-01-31T05:08:04.268 INFO:teuthology.orchestra.run.smithi049.stdout:245.out 2024-01-31T05:08:04.268 INFO:teuthology.orchestra.run.smithi049.stdout:246 2024-01-31T05:08:04.268 INFO:teuthology.orchestra.run.smithi049.stdout:246.out 2024-01-31T05:08:04.268 INFO:teuthology.orchestra.run.smithi049.stdout:247 2024-01-31T05:08:04.268 INFO:teuthology.orchestra.run.smithi049.stdout:247.out 2024-01-31T05:08:04.268 INFO:teuthology.orchestra.run.smithi049.stdout:248 2024-01-31T05:08:04.268 INFO:teuthology.orchestra.run.smithi049.stdout:248.out 2024-01-31T05:08:04.268 INFO:teuthology.orchestra.run.smithi049.stdout:249 2024-01-31T05:08:04.268 INFO:teuthology.orchestra.run.smithi049.stdout:249.out 2024-01-31T05:08:04.268 INFO:teuthology.orchestra.run.smithi049.stdout:250 2024-01-31T05:08:04.268 INFO:teuthology.orchestra.run.smithi049.stdout:250.out 2024-01-31T05:08:04.269 INFO:teuthology.orchestra.run.smithi049.stdout:251 2024-01-31T05:08:04.269 INFO:teuthology.orchestra.run.smithi049.stdout:251.out 2024-01-31T05:08:04.269 INFO:teuthology.orchestra.run.smithi049.stdout:252 2024-01-31T05:08:04.269 INFO:teuthology.orchestra.run.smithi049.stdout:252.out 2024-01-31T05:08:04.269 INFO:teuthology.orchestra.run.smithi049.stdout:253 2024-01-31T05:08:04.269 INFO:teuthology.orchestra.run.smithi049.stdout:253.out 2024-01-31T05:08:04.269 INFO:teuthology.orchestra.run.smithi049.stdout:254 2024-01-31T05:08:04.269 INFO:teuthology.orchestra.run.smithi049.stdout:254.out 2024-01-31T05:08:04.269 INFO:teuthology.orchestra.run.smithi049.stdout:255 2024-01-31T05:08:04.269 INFO:teuthology.orchestra.run.smithi049.stdout:255.out 2024-01-31T05:08:04.269 INFO:teuthology.orchestra.run.smithi049.stdout:256 2024-01-31T05:08:04.269 INFO:teuthology.orchestra.run.smithi049.stdout:256.out 2024-01-31T05:08:04.269 INFO:teuthology.orchestra.run.smithi049.stdout:257 2024-01-31T05:08:04.269 INFO:teuthology.orchestra.run.smithi049.stdout:257.out 2024-01-31T05:08:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:258 2024-01-31T05:08:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:258.out 2024-01-31T05:08:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:259 2024-01-31T05:08:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:259.out 2024-01-31T05:08:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:260 2024-01-31T05:08:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:260.out 2024-01-31T05:08:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:261 2024-01-31T05:08:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:261.out 2024-01-31T05:08:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:262 2024-01-31T05:08:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:262.out 2024-01-31T05:08:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:263 2024-01-31T05:08:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:263.out 2024-01-31T05:08:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:264 2024-01-31T05:08:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:264.out 2024-01-31T05:08:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:265 2024-01-31T05:08:04.270 INFO:teuthology.orchestra.run.smithi049.stdout:265.out 2024-01-31T05:08:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:266 2024-01-31T05:08:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:266.out 2024-01-31T05:08:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:267 2024-01-31T05:08:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:267.out 2024-01-31T05:08:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:268 2024-01-31T05:08:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:268.out 2024-01-31T05:08:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:269 2024-01-31T05:08:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:269.out 2024-01-31T05:08:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:270 2024-01-31T05:08:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:270.out 2024-01-31T05:08:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:271 2024-01-31T05:08:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:271.out 2024-01-31T05:08:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:272 2024-01-31T05:08:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:272.out 2024-01-31T05:08:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:273 2024-01-31T05:08:04.271 INFO:teuthology.orchestra.run.smithi049.stdout:273.out 2024-01-31T05:08:04.272 INFO:teuthology.orchestra.run.smithi049.stdout:274 2024-01-31T05:08:04.272 INFO:teuthology.orchestra.run.smithi049.stdout:274.out 2024-01-31T05:08:04.272 INFO:teuthology.orchestra.run.smithi049.stdout:275 2024-01-31T05:08:04.272 INFO:teuthology.orchestra.run.smithi049.stdout:275.out 2024-01-31T05:08:04.272 INFO:teuthology.orchestra.run.smithi049.stdout:276 2024-01-31T05:08:04.272 INFO:teuthology.orchestra.run.smithi049.stdout:276.out 2024-01-31T05:08:04.272 INFO:teuthology.orchestra.run.smithi049.stdout:277 2024-01-31T05:08:04.272 INFO:teuthology.orchestra.run.smithi049.stdout:277.out 2024-01-31T05:08:04.272 INFO:teuthology.orchestra.run.smithi049.stdout:278 2024-01-31T05:08:04.272 INFO:teuthology.orchestra.run.smithi049.stdout:278.out 2024-01-31T05:08:04.272 INFO:teuthology.orchestra.run.smithi049.stdout:279 2024-01-31T05:08:04.272 INFO:teuthology.orchestra.run.smithi049.stdout:279.out 2024-01-31T05:08:04.272 INFO:teuthology.orchestra.run.smithi049.stdout:280 2024-01-31T05:08:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:280.out 2024-01-31T05:08:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:281 2024-01-31T05:08:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:281.out 2024-01-31T05:08:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:282 2024-01-31T05:08:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:282.out 2024-01-31T05:08:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:283 2024-01-31T05:08:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:283.out 2024-01-31T05:08:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:284 2024-01-31T05:08:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:284.out 2024-01-31T05:08:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:285 2024-01-31T05:08:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:285.out 2024-01-31T05:08:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:286 2024-01-31T05:08:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:286.out 2024-01-31T05:08:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:287 2024-01-31T05:08:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:287.out 2024-01-31T05:08:04.273 INFO:teuthology.orchestra.run.smithi049.stdout:288 2024-01-31T05:08:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:288.out 2024-01-31T05:08:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:289 2024-01-31T05:08:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:289.out 2024-01-31T05:08:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:290 2024-01-31T05:08:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:290.out 2024-01-31T05:08:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:291 2024-01-31T05:08:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:291.out 2024-01-31T05:08:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:292 2024-01-31T05:08:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:292.out 2024-01-31T05:08:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:293 2024-01-31T05:08:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:293.out 2024-01-31T05:08:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:294 2024-01-31T05:08:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:294.out 2024-01-31T05:08:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:295 2024-01-31T05:08:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:295.out 2024-01-31T05:08:04.274 INFO:teuthology.orchestra.run.smithi049.stdout:296 2024-01-31T05:08:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:296.out 2024-01-31T05:08:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:297 2024-01-31T05:08:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:297.out 2024-01-31T05:08:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:298 2024-01-31T05:08:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:298.out 2024-01-31T05:08:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:299 2024-01-31T05:08:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:299.out 2024-01-31T05:08:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:300 2024-01-31T05:08:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:300.out 2024-01-31T05:08:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:301 2024-01-31T05:08:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:301.out 2024-01-31T05:08:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:302 2024-01-31T05:08:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:302.out 2024-01-31T05:08:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:303 2024-01-31T05:08:04.275 INFO:teuthology.orchestra.run.smithi049.stdout:303.out 2024-01-31T05:08:04.276 INFO:teuthology.orchestra.run.smithi049.stdout:304 2024-01-31T05:08:04.276 INFO:teuthology.orchestra.run.smithi049.stdout:304.out 2024-01-31T05:08:04.276 INFO:teuthology.orchestra.run.smithi049.stdout:305 2024-01-31T05:08:04.276 INFO:teuthology.orchestra.run.smithi049.stdout:305.out 2024-01-31T05:08:04.276 INFO:teuthology.orchestra.run.smithi049.stdout:306 2024-01-31T05:08:04.276 INFO:teuthology.orchestra.run.smithi049.stdout:306.out 2024-01-31T05:08:04.276 INFO:teuthology.orchestra.run.smithi049.stdout:307 2024-01-31T05:08:04.276 INFO:teuthology.orchestra.run.smithi049.stdout:307.out 2024-01-31T05:08:04.276 INFO:teuthology.orchestra.run.smithi049.stdout:308 2024-01-31T05:08:04.276 INFO:teuthology.orchestra.run.smithi049.stdout:308.out 2024-01-31T05:08:04.276 INFO:teuthology.orchestra.run.smithi049.stdout:309 2024-01-31T05:08:04.276 INFO:teuthology.orchestra.run.smithi049.stdout:309.out 2024-01-31T05:08:04.276 INFO:teuthology.orchestra.run.smithi049.stdout:310 2024-01-31T05:08:04.276 INFO:teuthology.orchestra.run.smithi049.stdout:310.out 2024-01-31T05:08:04.277 INFO:teuthology.orchestra.run.smithi049.stdout:311 2024-01-31T05:08:04.277 INFO:teuthology.orchestra.run.smithi049.stdout:311.out 2024-01-31T05:08:04.277 INFO:teuthology.orchestra.run.smithi049.stdout:312 2024-01-31T05:08:04.277 INFO:teuthology.orchestra.run.smithi049.stdout:312.out 2024-01-31T05:08:04.277 INFO:teuthology.orchestra.run.smithi049.stdout:313 2024-01-31T05:08:04.277 INFO:teuthology.orchestra.run.smithi049.stdout:313.out 2024-01-31T05:08:04.277 INFO:teuthology.orchestra.run.smithi049.stdout:314 2024-01-31T05:08:04.277 INFO:teuthology.orchestra.run.smithi049.stdout:314.out 2024-01-31T05:08:04.277 INFO:teuthology.orchestra.run.smithi049.stdout:315 2024-01-31T05:08:04.277 INFO:teuthology.orchestra.run.smithi049.stdout:315.out 2024-01-31T05:08:04.277 INFO:teuthology.orchestra.run.smithi049.stdout:316 2024-01-31T05:08:04.277 INFO:teuthology.orchestra.run.smithi049.stdout:316.out 2024-01-31T05:08:04.277 INFO:teuthology.orchestra.run.smithi049.stdout:317 2024-01-31T05:08:04.277 INFO:teuthology.orchestra.run.smithi049.stdout:317.out 2024-01-31T05:08:04.278 INFO:teuthology.orchestra.run.smithi049.stdout:318 2024-01-31T05:08:04.278 INFO:teuthology.orchestra.run.smithi049.stdout:318.out 2024-01-31T05:08:04.278 INFO:teuthology.orchestra.run.smithi049.stdout:319 2024-01-31T05:08:04.278 INFO:teuthology.orchestra.run.smithi049.stdout:319.out 2024-01-31T05:08:04.278 INFO:teuthology.orchestra.run.smithi049.stdout:320 2024-01-31T05:08:04.278 INFO:teuthology.orchestra.run.smithi049.stdout:320.out 2024-01-31T05:08:04.278 INFO:teuthology.orchestra.run.smithi049.stdout:321 2024-01-31T05:08:04.278 INFO:teuthology.orchestra.run.smithi049.stdout:321.out 2024-01-31T05:08:04.278 INFO:teuthology.orchestra.run.smithi049.stdout:322 2024-01-31T05:08:04.278 INFO:teuthology.orchestra.run.smithi049.stdout:322.out 2024-01-31T05:08:04.278 INFO:teuthology.orchestra.run.smithi049.stdout:323 2024-01-31T05:08:04.278 INFO:teuthology.orchestra.run.smithi049.stdout:323.out 2024-01-31T05:08:04.278 INFO:teuthology.orchestra.run.smithi049.stdout:324 2024-01-31T05:08:04.278 INFO:teuthology.orchestra.run.smithi049.stdout:324.out 2024-01-31T05:08:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:325 2024-01-31T05:08:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:325.out 2024-01-31T05:08:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:326 2024-01-31T05:08:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:326.out 2024-01-31T05:08:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:327 2024-01-31T05:08:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:327.out 2024-01-31T05:08:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:328 2024-01-31T05:08:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:328.out 2024-01-31T05:08:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:329 2024-01-31T05:08:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:329.out 2024-01-31T05:08:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:330 2024-01-31T05:08:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:330.out 2024-01-31T05:08:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:331 2024-01-31T05:08:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:331.out 2024-01-31T05:08:04.279 INFO:teuthology.orchestra.run.smithi049.stdout:332 2024-01-31T05:08:04.280 INFO:teuthology.orchestra.run.smithi049.stdout:332.out 2024-01-31T05:08:04.280 INFO:teuthology.orchestra.run.smithi049.stdout:333 2024-01-31T05:08:04.280 INFO:teuthology.orchestra.run.smithi049.stdout:333.out 2024-01-31T05:08:04.280 INFO:teuthology.orchestra.run.smithi049.stdout:334 2024-01-31T05:08:04.280 INFO:teuthology.orchestra.run.smithi049.stdout:334.out 2024-01-31T05:08:04.280 INFO:teuthology.orchestra.run.smithi049.stdout:335 2024-01-31T05:08:04.280 INFO:teuthology.orchestra.run.smithi049.stdout:335.out 2024-01-31T05:08:04.280 INFO:teuthology.orchestra.run.smithi049.stdout:336 2024-01-31T05:08:04.280 INFO:teuthology.orchestra.run.smithi049.stdout:336.out 2024-01-31T05:08:04.280 INFO:teuthology.orchestra.run.smithi049.stdout:337 2024-01-31T05:08:04.280 INFO:teuthology.orchestra.run.smithi049.stdout:337.out 2024-01-31T05:08:04.280 INFO:teuthology.orchestra.run.smithi049.stdout:338 2024-01-31T05:08:04.280 INFO:teuthology.orchestra.run.smithi049.stdout:338.out 2024-01-31T05:08:04.281 INFO:teuthology.orchestra.run.smithi049.stdout:339 2024-01-31T05:08:04.281 INFO:teuthology.orchestra.run.smithi049.stdout:339.out 2024-01-31T05:08:04.281 INFO:teuthology.orchestra.run.smithi049.stdout:340 2024-01-31T05:08:04.281 INFO:teuthology.orchestra.run.smithi049.stdout:340.out 2024-01-31T05:08:04.281 INFO:teuthology.orchestra.run.smithi049.stdout:341 2024-01-31T05:08:04.281 INFO:teuthology.orchestra.run.smithi049.stdout:341.out 2024-01-31T05:08:04.281 INFO:teuthology.orchestra.run.smithi049.stdout:342 2024-01-31T05:08:04.281 INFO:teuthology.orchestra.run.smithi049.stdout:342.out 2024-01-31T05:08:04.281 INFO:teuthology.orchestra.run.smithi049.stdout:343 2024-01-31T05:08:04.281 INFO:teuthology.orchestra.run.smithi049.stdout:343.out 2024-01-31T05:08:04.281 INFO:teuthology.orchestra.run.smithi049.stdout:344 2024-01-31T05:08:04.281 INFO:teuthology.orchestra.run.smithi049.stdout:344.out 2024-01-31T05:08:04.281 INFO:teuthology.orchestra.run.smithi049.stdout:345 2024-01-31T05:08:04.282 INFO:teuthology.orchestra.run.smithi049.stdout:345.out 2024-01-31T05:08:04.282 INFO:teuthology.orchestra.run.smithi049.stdout:346 2024-01-31T05:08:04.282 INFO:teuthology.orchestra.run.smithi049.stdout:346.out 2024-01-31T05:08:04.282 INFO:teuthology.orchestra.run.smithi049.stdout:347 2024-01-31T05:08:04.282 INFO:teuthology.orchestra.run.smithi049.stdout:347.out 2024-01-31T05:08:04.282 INFO:teuthology.orchestra.run.smithi049.stdout:348 2024-01-31T05:08:04.282 INFO:teuthology.orchestra.run.smithi049.stdout:348.out 2024-01-31T05:08:04.282 INFO:teuthology.orchestra.run.smithi049.stdout:349 2024-01-31T05:08:04.282 INFO:teuthology.orchestra.run.smithi049.stdout:349.out 2024-01-31T05:08:04.282 INFO:teuthology.orchestra.run.smithi049.stdout:350 2024-01-31T05:08:04.282 INFO:teuthology.orchestra.run.smithi049.stdout:350.out 2024-01-31T05:08:04.282 INFO:teuthology.orchestra.run.smithi049.stdout:351 2024-01-31T05:08:04.282 INFO:teuthology.orchestra.run.smithi049.stdout:351.out 2024-01-31T05:08:04.283 INFO:teuthology.orchestra.run.smithi049.stdout:352 2024-01-31T05:08:04.283 INFO:teuthology.orchestra.run.smithi049.stdout:352.out 2024-01-31T05:08:04.283 INFO:teuthology.orchestra.run.smithi049.stdout:353 2024-01-31T05:08:04.283 INFO:teuthology.orchestra.run.smithi049.stdout:353.out 2024-01-31T05:08:04.283 INFO:teuthology.orchestra.run.smithi049.stdout:354 2024-01-31T05:08:04.283 INFO:teuthology.orchestra.run.smithi049.stdout:354.out 2024-01-31T05:08:04.283 INFO:teuthology.orchestra.run.smithi049.stdout:355 2024-01-31T05:08:04.283 INFO:teuthology.orchestra.run.smithi049.stdout:355.out 2024-01-31T05:08:04.283 INFO:teuthology.orchestra.run.smithi049.stdout:356 2024-01-31T05:08:04.283 INFO:teuthology.orchestra.run.smithi049.stdout:356.out 2024-01-31T05:08:04.283 INFO:teuthology.orchestra.run.smithi049.stdout:357 2024-01-31T05:08:04.283 INFO:teuthology.orchestra.run.smithi049.stdout:357.out 2024-01-31T05:08:04.283 INFO:teuthology.orchestra.run.smithi049.stdout:358 2024-01-31T05:08:04.283 INFO:teuthology.orchestra.run.smithi049.stdout:358.out 2024-01-31T05:08:04.284 INFO:teuthology.orchestra.run.smithi049.stdout:359 2024-01-31T05:08:04.284 INFO:teuthology.orchestra.run.smithi049.stdout:359.out 2024-01-31T05:08:04.284 INFO:teuthology.orchestra.run.smithi049.stdout:360 2024-01-31T05:08:04.284 INFO:teuthology.orchestra.run.smithi049.stdout:360.out 2024-01-31T05:08:04.284 INFO:teuthology.orchestra.run.smithi049.stdout:361 2024-01-31T05:08:04.284 INFO:teuthology.orchestra.run.smithi049.stdout:361.out 2024-01-31T05:08:04.284 INFO:teuthology.orchestra.run.smithi049.stdout:362 2024-01-31T05:08:04.284 INFO:teuthology.orchestra.run.smithi049.stdout:362.out 2024-01-31T05:08:04.284 INFO:teuthology.orchestra.run.smithi049.stdout:363 2024-01-31T05:08:04.284 INFO:teuthology.orchestra.run.smithi049.stdout:363.out 2024-01-31T05:08:04.284 INFO:teuthology.orchestra.run.smithi049.stdout:364 2024-01-31T05:08:04.284 INFO:teuthology.orchestra.run.smithi049.stdout:364.out 2024-01-31T05:08:04.284 INFO:teuthology.orchestra.run.smithi049.stdout:365 2024-01-31T05:08:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:365.out 2024-01-31T05:08:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:366 2024-01-31T05:08:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:366.out 2024-01-31T05:08:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:367 2024-01-31T05:08:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:367.out 2024-01-31T05:08:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:368 2024-01-31T05:08:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:368.out 2024-01-31T05:08:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:369 2024-01-31T05:08:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:369.out 2024-01-31T05:08:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:370 2024-01-31T05:08:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:370.out 2024-01-31T05:08:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:371 2024-01-31T05:08:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:371.out 2024-01-31T05:08:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:372 2024-01-31T05:08:04.285 INFO:teuthology.orchestra.run.smithi049.stdout:372.out 2024-01-31T05:08:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:373 2024-01-31T05:08:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:373.out 2024-01-31T05:08:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:374 2024-01-31T05:08:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:374.out 2024-01-31T05:08:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:375 2024-01-31T05:08:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:375.out 2024-01-31T05:08:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:376 2024-01-31T05:08:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:376.out 2024-01-31T05:08:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:377 2024-01-31T05:08:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:377.out 2024-01-31T05:08:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:378 2024-01-31T05:08:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:378.out 2024-01-31T05:08:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:379 2024-01-31T05:08:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:379.out 2024-01-31T05:08:04.286 INFO:teuthology.orchestra.run.smithi049.stdout:380 2024-01-31T05:08:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:380.out 2024-01-31T05:08:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:381 2024-01-31T05:08:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:381.out 2024-01-31T05:08:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:382 2024-01-31T05:08:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:382.out 2024-01-31T05:08:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:383 2024-01-31T05:08:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:383.out 2024-01-31T05:08:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:384 2024-01-31T05:08:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:384.out 2024-01-31T05:08:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:385 2024-01-31T05:08:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:385.out 2024-01-31T05:08:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:386 2024-01-31T05:08:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:386.out 2024-01-31T05:08:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:387 2024-01-31T05:08:04.287 INFO:teuthology.orchestra.run.smithi049.stdout:387.out 2024-01-31T05:08:04.288 INFO:teuthology.orchestra.run.smithi049.stdout:388 2024-01-31T05:08:04.288 INFO:teuthology.orchestra.run.smithi049.stdout:388.out 2024-01-31T05:08:04.288 INFO:teuthology.orchestra.run.smithi049.stdout:389 2024-01-31T05:08:04.288 INFO:teuthology.orchestra.run.smithi049.stdout:389.out 2024-01-31T05:08:04.288 INFO:teuthology.orchestra.run.smithi049.stdout:390 2024-01-31T05:08:04.288 INFO:teuthology.orchestra.run.smithi049.stdout:390.out 2024-01-31T05:08:04.288 INFO:teuthology.orchestra.run.smithi049.stdout:391 2024-01-31T05:08:04.288 INFO:teuthology.orchestra.run.smithi049.stdout:391.out 2024-01-31T05:08:04.288 INFO:teuthology.orchestra.run.smithi049.stdout:392 2024-01-31T05:08:04.288 INFO:teuthology.orchestra.run.smithi049.stdout:392.out 2024-01-31T05:08:04.288 INFO:teuthology.orchestra.run.smithi049.stdout:393 2024-01-31T05:08:04.288 INFO:teuthology.orchestra.run.smithi049.stdout:393.out 2024-01-31T05:08:04.288 INFO:teuthology.orchestra.run.smithi049.stdout:394 2024-01-31T05:08:04.288 INFO:teuthology.orchestra.run.smithi049.stdout:394.out 2024-01-31T05:08:04.289 INFO:teuthology.orchestra.run.smithi049.stdout:395 2024-01-31T05:08:04.289 INFO:teuthology.orchestra.run.smithi049.stdout:395.out 2024-01-31T05:08:04.289 INFO:teuthology.orchestra.run.smithi049.stdout:396 2024-01-31T05:08:04.289 INFO:teuthology.orchestra.run.smithi049.stdout:396.out 2024-01-31T05:08:04.289 INFO:teuthology.orchestra.run.smithi049.stdout:397 2024-01-31T05:08:04.289 INFO:teuthology.orchestra.run.smithi049.stdout:397.out 2024-01-31T05:08:04.289 INFO:teuthology.orchestra.run.smithi049.stdout:398 2024-01-31T05:08:04.289 INFO:teuthology.orchestra.run.smithi049.stdout:398.out 2024-01-31T05:08:04.289 INFO:teuthology.orchestra.run.smithi049.stdout:399 2024-01-31T05:08:04.344 INFO:teuthology.orchestra.run.smithi049.stdout:399.out 2024-01-31T05:08:04.344 INFO:teuthology.orchestra.run.smithi049.stdout:400 2024-01-31T05:08:04.344 INFO:teuthology.orchestra.run.smithi049.stdout:400.out 2024-01-31T05:08:04.344 INFO:teuthology.orchestra.run.smithi049.stdout:401 2024-01-31T05:08:04.344 INFO:teuthology.orchestra.run.smithi049.stdout:401.out 2024-01-31T05:08:04.344 INFO:teuthology.orchestra.run.smithi049.stdout:402 2024-01-31T05:08:04.344 INFO:teuthology.orchestra.run.smithi049.stdout:402.out 2024-01-31T05:08:04.345 INFO:teuthology.orchestra.run.smithi049.stdout:403 2024-01-31T05:08:04.345 INFO:teuthology.orchestra.run.smithi049.stdout:403.out 2024-01-31T05:08:04.345 INFO:teuthology.orchestra.run.smithi049.stdout:404 2024-01-31T05:08:04.345 INFO:teuthology.orchestra.run.smithi049.stdout:404.out 2024-01-31T05:08:04.345 INFO:teuthology.orchestra.run.smithi049.stdout:405 2024-01-31T05:08:04.345 INFO:teuthology.orchestra.run.smithi049.stdout:405.out 2024-01-31T05:08:04.345 INFO:teuthology.orchestra.run.smithi049.stdout:406 2024-01-31T05:08:04.345 INFO:teuthology.orchestra.run.smithi049.stdout:406.out 2024-01-31T05:08:04.345 INFO:teuthology.orchestra.run.smithi049.stdout:407 2024-01-31T05:08:04.345 INFO:teuthology.orchestra.run.smithi049.stdout:407.out 2024-01-31T05:08:04.345 INFO:teuthology.orchestra.run.smithi049.stdout:408 2024-01-31T05:08:04.346 INFO:teuthology.orchestra.run.smithi049.stdout:408.out 2024-01-31T05:08:04.346 INFO:teuthology.orchestra.run.smithi049.stdout:409 2024-01-31T05:08:04.346 INFO:teuthology.orchestra.run.smithi049.stdout:409.out 2024-01-31T05:08:04.346 INFO:teuthology.orchestra.run.smithi049.stdout:410 2024-01-31T05:08:04.346 INFO:teuthology.orchestra.run.smithi049.stdout:410.out 2024-01-31T05:08:04.346 INFO:teuthology.orchestra.run.smithi049.stdout:411 2024-01-31T05:08:04.346 INFO:teuthology.orchestra.run.smithi049.stdout:411.out 2024-01-31T05:08:04.346 INFO:teuthology.orchestra.run.smithi049.stdout:412 2024-01-31T05:08:04.346 INFO:teuthology.orchestra.run.smithi049.stdout:412.out 2024-01-31T05:08:04.346 INFO:teuthology.orchestra.run.smithi049.stdout:413 2024-01-31T05:08:04.346 INFO:teuthology.orchestra.run.smithi049.stdout:413.out 2024-01-31T05:08:04.346 INFO:teuthology.orchestra.run.smithi049.stdout:414 2024-01-31T05:08:04.346 INFO:teuthology.orchestra.run.smithi049.stdout:414.out 2024-01-31T05:08:04.347 INFO:teuthology.orchestra.run.smithi049.stdout:415 2024-01-31T05:08:04.347 INFO:teuthology.orchestra.run.smithi049.stdout:415.out 2024-01-31T05:08:04.347 INFO:teuthology.orchestra.run.smithi049.stdout:416 2024-01-31T05:08:04.347 INFO:teuthology.orchestra.run.smithi049.stdout:416.out 2024-01-31T05:08:04.347 INFO:teuthology.orchestra.run.smithi049.stdout:417 2024-01-31T05:08:04.347 INFO:teuthology.orchestra.run.smithi049.stdout:417.out 2024-01-31T05:08:04.347 INFO:teuthology.orchestra.run.smithi049.stdout:418 2024-01-31T05:08:04.347 INFO:teuthology.orchestra.run.smithi049.stdout:418.out 2024-01-31T05:08:04.347 INFO:teuthology.orchestra.run.smithi049.stdout:419 2024-01-31T05:08:04.347 INFO:teuthology.orchestra.run.smithi049.stdout:419.out 2024-01-31T05:08:04.347 INFO:teuthology.orchestra.run.smithi049.stdout:420 2024-01-31T05:08:04.347 INFO:teuthology.orchestra.run.smithi049.stdout:420.out 2024-01-31T05:08:04.348 INFO:teuthology.orchestra.run.smithi049.stdout:421 2024-01-31T05:08:04.348 INFO:teuthology.orchestra.run.smithi049.stdout:421.out 2024-01-31T05:08:04.348 INFO:teuthology.orchestra.run.smithi049.stdout:422 2024-01-31T05:08:04.348 INFO:teuthology.orchestra.run.smithi049.stdout:422.out 2024-01-31T05:08:04.348 INFO:teuthology.orchestra.run.smithi049.stdout:423 2024-01-31T05:08:04.348 INFO:teuthology.orchestra.run.smithi049.stdout:423.out 2024-01-31T05:08:04.348 INFO:teuthology.orchestra.run.smithi049.stdout:424 2024-01-31T05:08:04.348 INFO:teuthology.orchestra.run.smithi049.stdout:424.out 2024-01-31T05:08:04.348 INFO:teuthology.orchestra.run.smithi049.stdout:425 2024-01-31T05:08:04.348 INFO:teuthology.orchestra.run.smithi049.stdout:425.out 2024-01-31T05:08:04.348 INFO:teuthology.orchestra.run.smithi049.stdout:426 2024-01-31T05:08:04.348 INFO:teuthology.orchestra.run.smithi049.stdout:426.out 2024-01-31T05:08:04.348 INFO:teuthology.orchestra.run.smithi049.stdout:427 2024-01-31T05:08:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:427.out 2024-01-31T05:08:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:428 2024-01-31T05:08:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:428.out 2024-01-31T05:08:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:429 2024-01-31T05:08:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:429.out 2024-01-31T05:08:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:430 2024-01-31T05:08:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:430.out 2024-01-31T05:08:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:431 2024-01-31T05:08:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:431.out 2024-01-31T05:08:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:432 2024-01-31T05:08:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:432.out 2024-01-31T05:08:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:433 2024-01-31T05:08:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:433.out 2024-01-31T05:08:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:434 2024-01-31T05:08:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:434.out 2024-01-31T05:08:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:435 2024-01-31T05:08:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:435.out 2024-01-31T05:08:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:436 2024-01-31T05:08:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:436.out 2024-01-31T05:08:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:437 2024-01-31T05:08:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:437.out 2024-01-31T05:08:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:438 2024-01-31T05:08:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:438.out 2024-01-31T05:08:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:439 2024-01-31T05:08:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:439.out 2024-01-31T05:08:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:440 2024-01-31T05:08:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:440.out 2024-01-31T05:08:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:441 2024-01-31T05:08:04.350 INFO:teuthology.orchestra.run.smithi049.stdout:441.out 2024-01-31T05:08:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:442 2024-01-31T05:08:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:442.out 2024-01-31T05:08:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:443 2024-01-31T05:08:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:443.out 2024-01-31T05:08:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:444 2024-01-31T05:08:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:444.out 2024-01-31T05:08:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:445 2024-01-31T05:08:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:445.out 2024-01-31T05:08:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:446 2024-01-31T05:08:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:446.out 2024-01-31T05:08:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:447 2024-01-31T05:08:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:447.out 2024-01-31T05:08:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:448 2024-01-31T05:08:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:448.out 2024-01-31T05:08:04.351 INFO:teuthology.orchestra.run.smithi049.stdout:449 2024-01-31T05:08:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:449.out 2024-01-31T05:08:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:450 2024-01-31T05:08:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:450.out 2024-01-31T05:08:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:451 2024-01-31T05:08:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:451.out 2024-01-31T05:08:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:452 2024-01-31T05:08:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:452.out 2024-01-31T05:08:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:453 2024-01-31T05:08:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:453.out 2024-01-31T05:08:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:454 2024-01-31T05:08:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:454.out 2024-01-31T05:08:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:455 2024-01-31T05:08:04.352 INFO:teuthology.orchestra.run.smithi049.stdout:455.out 2024-01-31T05:08:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:456 2024-01-31T05:08:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:456.out 2024-01-31T05:08:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:457 2024-01-31T05:08:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:457.out 2024-01-31T05:08:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:458 2024-01-31T05:08:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:458.out 2024-01-31T05:08:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:459 2024-01-31T05:08:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:459.out 2024-01-31T05:08:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:460 2024-01-31T05:08:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:460.out 2024-01-31T05:08:04.353 INFO:teuthology.orchestra.run.smithi049.stdout:461 2024-01-31T05:08:04.354 INFO:teuthology.orchestra.run.smithi049.stdout:461.out 2024-01-31T05:08:04.354 INFO:teuthology.orchestra.run.smithi049.stdout:462 2024-01-31T05:08:04.354 INFO:teuthology.orchestra.run.smithi049.stdout:462.out 2024-01-31T05:08:04.354 INFO:teuthology.orchestra.run.smithi049.stdout:463 2024-01-31T05:08:04.354 INFO:teuthology.orchestra.run.smithi049.stdout:463.out 2024-01-31T05:08:04.354 INFO:teuthology.orchestra.run.smithi049.stdout:464 2024-01-31T05:08:04.354 INFO:teuthology.orchestra.run.smithi049.stdout:464.out 2024-01-31T05:08:04.354 INFO:teuthology.orchestra.run.smithi049.stdout:465 2024-01-31T05:08:04.354 INFO:teuthology.orchestra.run.smithi049.stdout:465.out 2024-01-31T05:08:04.354 INFO:teuthology.orchestra.run.smithi049.stdout:466 2024-01-31T05:08:04.354 INFO:teuthology.orchestra.run.smithi049.stdout:466.out 2024-01-31T05:08:04.354 INFO:teuthology.orchestra.run.smithi049.stdout:467 2024-01-31T05:08:04.354 INFO:teuthology.orchestra.run.smithi049.stdout:467.out 2024-01-31T05:08:04.354 INFO:teuthology.orchestra.run.smithi049.stdout:468 2024-01-31T05:08:04.355 INFO:teuthology.orchestra.run.smithi049.stdout:468.out 2024-01-31T05:08:04.355 INFO:teuthology.orchestra.run.smithi049.stdout:469 2024-01-31T05:08:04.355 INFO:teuthology.orchestra.run.smithi049.stdout:469.out 2024-01-31T05:08:04.355 INFO:teuthology.orchestra.run.smithi049.stdout:470 2024-01-31T05:08:04.355 INFO:teuthology.orchestra.run.smithi049.stdout:470.out 2024-01-31T05:08:04.355 INFO:teuthology.orchestra.run.smithi049.stdout:471 2024-01-31T05:08:04.355 INFO:teuthology.orchestra.run.smithi049.stdout:471.out 2024-01-31T05:08:04.355 INFO:teuthology.orchestra.run.smithi049.stdout:472 2024-01-31T05:08:04.355 INFO:teuthology.orchestra.run.smithi049.stdout:472.out 2024-01-31T05:08:04.355 INFO:teuthology.orchestra.run.smithi049.stdout:473 2024-01-31T05:08:04.355 INFO:teuthology.orchestra.run.smithi049.stdout:473.out 2024-01-31T05:08:04.355 INFO:teuthology.orchestra.run.smithi049.stdout:474 2024-01-31T05:08:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:474.out 2024-01-31T05:08:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:475 2024-01-31T05:08:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:475.out 2024-01-31T05:08:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:476 2024-01-31T05:08:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:476.out 2024-01-31T05:08:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:477 2024-01-31T05:08:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:477.out 2024-01-31T05:08:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:478 2024-01-31T05:08:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:478.out 2024-01-31T05:08:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:479 2024-01-31T05:08:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:479.out 2024-01-31T05:08:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:480 2024-01-31T05:08:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:480.out 2024-01-31T05:08:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:481 2024-01-31T05:08:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:481.out 2024-01-31T05:08:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:482 2024-01-31T05:08:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:482.out 2024-01-31T05:08:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:483 2024-01-31T05:08:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:483.out 2024-01-31T05:08:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:484 2024-01-31T05:08:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:484.out 2024-01-31T05:08:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:485 2024-01-31T05:08:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:485.out 2024-01-31T05:08:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:486 2024-01-31T05:08:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:486.out 2024-01-31T05:08:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:487 2024-01-31T05:08:04.357 INFO:teuthology.orchestra.run.smithi049.stdout:487.out 2024-01-31T05:08:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:488 2024-01-31T05:08:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:488.out 2024-01-31T05:08:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:489 2024-01-31T05:08:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:489.out 2024-01-31T05:08:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:490 2024-01-31T05:08:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:490.out 2024-01-31T05:08:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:491 2024-01-31T05:08:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:491.out 2024-01-31T05:08:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:492 2024-01-31T05:08:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:492.out 2024-01-31T05:08:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:493 2024-01-31T05:08:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:493.out 2024-01-31T05:08:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:494 2024-01-31T05:08:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:494.out 2024-01-31T05:08:04.358 INFO:teuthology.orchestra.run.smithi049.stdout:495 2024-01-31T05:08:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:495.out 2024-01-31T05:08:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:496 2024-01-31T05:08:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:496.out 2024-01-31T05:08:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:497 2024-01-31T05:08:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:497.out 2024-01-31T05:08:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:498 2024-01-31T05:08:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:498.out 2024-01-31T05:08:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:499 2024-01-31T05:08:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:499.out 2024-01-31T05:08:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:500 2024-01-31T05:08:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:500.out 2024-01-31T05:08:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:501 2024-01-31T05:08:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:501.out 2024-01-31T05:08:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:502 2024-01-31T05:08:04.359 INFO:teuthology.orchestra.run.smithi049.stdout:502.out 2024-01-31T05:08:04.360 INFO:teuthology.orchestra.run.smithi049.stdout:503 2024-01-31T05:08:04.360 INFO:teuthology.orchestra.run.smithi049.stdout:503.out 2024-01-31T05:08:04.360 INFO:teuthology.orchestra.run.smithi049.stdout:504 2024-01-31T05:08:04.360 INFO:teuthology.orchestra.run.smithi049.stdout:504.out 2024-01-31T05:08:04.360 INFO:teuthology.orchestra.run.smithi049.stdout:505 2024-01-31T05:08:04.360 INFO:teuthology.orchestra.run.smithi049.stdout:505.out 2024-01-31T05:08:04.360 INFO:teuthology.orchestra.run.smithi049.stdout:506 2024-01-31T05:08:04.360 INFO:teuthology.orchestra.run.smithi049.stdout:506.out 2024-01-31T05:08:04.360 INFO:teuthology.orchestra.run.smithi049.stdout:507 2024-01-31T05:08:04.360 INFO:teuthology.orchestra.run.smithi049.stdout:507.out 2024-01-31T05:08:04.360 INFO:teuthology.orchestra.run.smithi049.stdout:508 2024-01-31T05:08:04.360 INFO:teuthology.orchestra.run.smithi049.stdout:508.out 2024-01-31T05:08:04.360 INFO:teuthology.orchestra.run.smithi049.stdout:509 2024-01-31T05:08:04.360 INFO:teuthology.orchestra.run.smithi049.stdout:509.out 2024-01-31T05:08:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:510 2024-01-31T05:08:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:510.out 2024-01-31T05:08:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:511 2024-01-31T05:08:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:511.out 2024-01-31T05:08:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:512 2024-01-31T05:08:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:512.out 2024-01-31T05:08:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:513 2024-01-31T05:08:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:513.out 2024-01-31T05:08:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:514 2024-01-31T05:08:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:514.out 2024-01-31T05:08:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:515 2024-01-31T05:08:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:515.out 2024-01-31T05:08:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:516 2024-01-31T05:08:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:516.out 2024-01-31T05:08:04.361 INFO:teuthology.orchestra.run.smithi049.stdout:517 2024-01-31T05:08:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:517.out 2024-01-31T05:08:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:518 2024-01-31T05:08:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:518.out 2024-01-31T05:08:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:519 2024-01-31T05:08:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:519.out 2024-01-31T05:08:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:520 2024-01-31T05:08:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:520.out 2024-01-31T05:08:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:521 2024-01-31T05:08:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:521.out 2024-01-31T05:08:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:522 2024-01-31T05:08:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:522.out 2024-01-31T05:08:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:523 2024-01-31T05:08:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:523.out 2024-01-31T05:08:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:524 2024-01-31T05:08:04.362 INFO:teuthology.orchestra.run.smithi049.stdout:524.out 2024-01-31T05:08:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:525 2024-01-31T05:08:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:525.out 2024-01-31T05:08:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:526 2024-01-31T05:08:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:526.out 2024-01-31T05:08:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:527 2024-01-31T05:08:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:527.out 2024-01-31T05:08:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:528 2024-01-31T05:08:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:528.out 2024-01-31T05:08:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:529 2024-01-31T05:08:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:529.out 2024-01-31T05:08:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:530 2024-01-31T05:08:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:530.out 2024-01-31T05:08:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:531 2024-01-31T05:08:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:531.out 2024-01-31T05:08:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:532 2024-01-31T05:08:04.363 INFO:teuthology.orchestra.run.smithi049.stdout:532.out 2024-01-31T05:08:04.364 INFO:teuthology.orchestra.run.smithi049.stdout:533 2024-01-31T05:08:04.364 INFO:teuthology.orchestra.run.smithi049.stdout:533.out 2024-01-31T05:08:04.364 INFO:teuthology.orchestra.run.smithi049.stdout:534 2024-01-31T05:08:04.364 INFO:teuthology.orchestra.run.smithi049.stdout:534.out 2024-01-31T05:08:04.364 INFO:teuthology.orchestra.run.smithi049.stdout:535 2024-01-31T05:08:04.364 INFO:teuthology.orchestra.run.smithi049.stdout:535.out 2024-01-31T05:08:04.364 INFO:teuthology.orchestra.run.smithi049.stdout:536 2024-01-31T05:08:04.364 INFO:teuthology.orchestra.run.smithi049.stdout:536.out 2024-01-31T05:08:04.364 INFO:teuthology.orchestra.run.smithi049.stdout:537 2024-01-31T05:08:04.364 INFO:teuthology.orchestra.run.smithi049.stdout:537.out 2024-01-31T05:08:04.364 INFO:teuthology.orchestra.run.smithi049.stdout:538 2024-01-31T05:08:04.364 INFO:teuthology.orchestra.run.smithi049.stdout:538.out 2024-01-31T05:08:04.364 INFO:teuthology.orchestra.run.smithi049.stdout:539 2024-01-31T05:08:04.364 INFO:teuthology.orchestra.run.smithi049.stdout:539.out 2024-01-31T05:08:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:540 2024-01-31T05:08:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:540.out 2024-01-31T05:08:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:541 2024-01-31T05:08:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:541.out 2024-01-31T05:08:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:542 2024-01-31T05:08:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:542.out 2024-01-31T05:08:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:543 2024-01-31T05:08:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:543.out 2024-01-31T05:08:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:544 2024-01-31T05:08:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:544.out 2024-01-31T05:08:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:545 2024-01-31T05:08:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:545.out 2024-01-31T05:08:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:546 2024-01-31T05:08:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:546.out 2024-01-31T05:08:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:547 2024-01-31T05:08:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:547.out 2024-01-31T05:08:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:548 2024-01-31T05:08:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:548.out 2024-01-31T05:08:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:549 2024-01-31T05:08:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:549.out 2024-01-31T05:08:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:550 2024-01-31T05:08:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:550.out 2024-01-31T05:08:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:551 2024-01-31T05:08:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:551.out 2024-01-31T05:08:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:552 2024-01-31T05:08:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:552.out 2024-01-31T05:08:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:553 2024-01-31T05:08:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:553.out 2024-01-31T05:08:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:554 2024-01-31T05:08:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:554.out 2024-01-31T05:08:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:555 2024-01-31T05:08:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:555.out 2024-01-31T05:08:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:556 2024-01-31T05:08:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:556.out 2024-01-31T05:08:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:557 2024-01-31T05:08:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:557.out 2024-01-31T05:08:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:558 2024-01-31T05:08:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:558.out 2024-01-31T05:08:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:559 2024-01-31T05:08:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:559.out 2024-01-31T05:08:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:560 2024-01-31T05:08:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:560.out 2024-01-31T05:08:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:561 2024-01-31T05:08:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:561.out 2024-01-31T05:08:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:562 2024-01-31T05:08:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:562.out 2024-01-31T05:08:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:563 2024-01-31T05:08:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:563.out 2024-01-31T05:08:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:564 2024-01-31T05:08:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:564.out 2024-01-31T05:08:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:565 2024-01-31T05:08:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:565.out 2024-01-31T05:08:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:566 2024-01-31T05:08:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:566.out 2024-01-31T05:08:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:567 2024-01-31T05:08:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:567.out 2024-01-31T05:08:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:568 2024-01-31T05:08:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:568.out 2024-01-31T05:08:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:569 2024-01-31T05:08:04.368 INFO:teuthology.orchestra.run.smithi049.stdout:569.out 2024-01-31T05:08:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:570 2024-01-31T05:08:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:570.out 2024-01-31T05:08:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:571 2024-01-31T05:08:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:571.out 2024-01-31T05:08:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:572 2024-01-31T05:08:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:572.out 2024-01-31T05:08:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:573 2024-01-31T05:08:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:573.out 2024-01-31T05:08:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:574 2024-01-31T05:08:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:574.out 2024-01-31T05:08:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:575 2024-01-31T05:08:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:575.out 2024-01-31T05:08:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:576 2024-01-31T05:08:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:576.out 2024-01-31T05:08:04.369 INFO:teuthology.orchestra.run.smithi049.stdout:577 2024-01-31T05:08:04.370 INFO:teuthology.orchestra.run.smithi049.stdout:577.out 2024-01-31T05:08:04.370 INFO:teuthology.orchestra.run.smithi049.stdout:578 2024-01-31T05:08:04.370 INFO:teuthology.orchestra.run.smithi049.stdout:578.out 2024-01-31T05:08:04.370 INFO:teuthology.orchestra.run.smithi049.stdout:579 2024-01-31T05:08:04.370 INFO:teuthology.orchestra.run.smithi049.stdout:579.out 2024-01-31T05:08:04.370 INFO:teuthology.orchestra.run.smithi049.stdout:580 2024-01-31T05:08:04.370 INFO:teuthology.orchestra.run.smithi049.stdout:580.out 2024-01-31T05:08:04.370 INFO:teuthology.orchestra.run.smithi049.stdout:581 2024-01-31T05:08:04.370 INFO:teuthology.orchestra.run.smithi049.stdout:581.out 2024-01-31T05:08:04.370 INFO:teuthology.orchestra.run.smithi049.stdout:582 2024-01-31T05:08:04.370 INFO:teuthology.orchestra.run.smithi049.stdout:582.out 2024-01-31T05:08:04.370 INFO:teuthology.orchestra.run.smithi049.stdout:583 2024-01-31T05:08:04.370 INFO:teuthology.orchestra.run.smithi049.stdout:583.out 2024-01-31T05:08:04.370 INFO:teuthology.orchestra.run.smithi049.stdout:584 2024-01-31T05:08:04.371 INFO:teuthology.orchestra.run.smithi049.stdout:584.out 2024-01-31T05:08:04.371 INFO:teuthology.orchestra.run.smithi049.stdout:585 2024-01-31T05:08:04.371 INFO:teuthology.orchestra.run.smithi049.stdout:585.out 2024-01-31T05:08:04.371 INFO:teuthology.orchestra.run.smithi049.stdout:586 2024-01-31T05:08:04.371 INFO:teuthology.orchestra.run.smithi049.stdout:586.out 2024-01-31T05:08:04.371 INFO:teuthology.orchestra.run.smithi049.stdout:587 2024-01-31T05:08:04.371 INFO:teuthology.orchestra.run.smithi049.stdout:587.out 2024-01-31T05:08:04.371 INFO:teuthology.orchestra.run.smithi049.stdout:588 2024-01-31T05:08:04.371 INFO:teuthology.orchestra.run.smithi049.stdout:588.out 2024-01-31T05:08:04.371 INFO:teuthology.orchestra.run.smithi049.stdout:589 2024-01-31T05:08:04.371 INFO:teuthology.orchestra.run.smithi049.stdout:589.out 2024-01-31T05:08:04.371 INFO:teuthology.orchestra.run.smithi049.stdout:590 2024-01-31T05:08:04.371 INFO:teuthology.orchestra.run.smithi049.stdout:590.out 2024-01-31T05:08:04.372 INFO:teuthology.orchestra.run.smithi049.stdout:591 2024-01-31T05:08:04.372 INFO:teuthology.orchestra.run.smithi049.stdout:591.out 2024-01-31T05:08:04.372 INFO:teuthology.orchestra.run.smithi049.stdout:592 2024-01-31T05:08:04.372 INFO:teuthology.orchestra.run.smithi049.stdout:592.out 2024-01-31T05:08:04.372 INFO:teuthology.orchestra.run.smithi049.stdout:593 2024-01-31T05:08:04.372 INFO:teuthology.orchestra.run.smithi049.stdout:593.out 2024-01-31T05:08:04.372 INFO:teuthology.orchestra.run.smithi049.stdout:594 2024-01-31T05:08:04.372 INFO:teuthology.orchestra.run.smithi049.stdout:594.out 2024-01-31T05:08:04.372 INFO:teuthology.orchestra.run.smithi049.stdout:595 2024-01-31T05:08:04.372 INFO:teuthology.orchestra.run.smithi049.stdout:595.out 2024-01-31T05:08:04.372 INFO:teuthology.orchestra.run.smithi049.stdout:596 2024-01-31T05:08:04.372 INFO:teuthology.orchestra.run.smithi049.stdout:596.out 2024-01-31T05:08:04.372 INFO:teuthology.orchestra.run.smithi049.stdout:597 2024-01-31T05:08:04.372 INFO:teuthology.orchestra.run.smithi049.stdout:597.out 2024-01-31T05:08:04.373 INFO:teuthology.orchestra.run.smithi049.stdout:598 2024-01-31T05:08:04.373 INFO:teuthology.orchestra.run.smithi049.stdout:598.out 2024-01-31T05:08:04.373 INFO:teuthology.orchestra.run.smithi049.stdout:599 2024-01-31T05:08:04.373 INFO:teuthology.orchestra.run.smithi049.stdout:599.out 2024-01-31T05:08:04.373 INFO:teuthology.orchestra.run.smithi049.stdout:600 2024-01-31T05:08:04.373 INFO:teuthology.orchestra.run.smithi049.stdout:600.out 2024-01-31T05:08:04.373 INFO:teuthology.orchestra.run.smithi049.stdout:601 2024-01-31T05:08:04.373 INFO:teuthology.orchestra.run.smithi049.stdout:601.out 2024-01-31T05:08:04.373 INFO:teuthology.orchestra.run.smithi049.stdout:602 2024-01-31T05:08:04.373 INFO:teuthology.orchestra.run.smithi049.stdout:602.out 2024-01-31T05:08:04.373 INFO:teuthology.orchestra.run.smithi049.stdout:603 2024-01-31T05:08:04.373 INFO:teuthology.orchestra.run.smithi049.stdout:603.out 2024-01-31T05:08:04.373 INFO:teuthology.orchestra.run.smithi049.stdout:604 2024-01-31T05:08:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:604.out 2024-01-31T05:08:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:605 2024-01-31T05:08:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:605.out 2024-01-31T05:08:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:606 2024-01-31T05:08:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:606.out 2024-01-31T05:08:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:607 2024-01-31T05:08:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:607.out 2024-01-31T05:08:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:608 2024-01-31T05:08:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:608.out 2024-01-31T05:08:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:609 2024-01-31T05:08:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:609.out 2024-01-31T05:08:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:610 2024-01-31T05:08:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:610.out 2024-01-31T05:08:04.374 INFO:teuthology.orchestra.run.smithi049.stdout:611 2024-01-31T05:08:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:611.out 2024-01-31T05:08:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:612 2024-01-31T05:08:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:612.out 2024-01-31T05:08:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:613 2024-01-31T05:08:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:613.out 2024-01-31T05:08:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:614 2024-01-31T05:08:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:614.out 2024-01-31T05:08:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:615 2024-01-31T05:08:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:615.out 2024-01-31T05:08:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:616 2024-01-31T05:08:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:616.out 2024-01-31T05:08:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:617 2024-01-31T05:08:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:617.out 2024-01-31T05:08:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:618 2024-01-31T05:08:04.375 INFO:teuthology.orchestra.run.smithi049.stdout:618.out 2024-01-31T05:08:04.376 INFO:teuthology.orchestra.run.smithi049.stdout:619 2024-01-31T05:08:04.376 INFO:teuthology.orchestra.run.smithi049.stdout:619.out 2024-01-31T05:08:04.376 INFO:teuthology.orchestra.run.smithi049.stdout:620 2024-01-31T05:08:04.376 INFO:teuthology.orchestra.run.smithi049.stdout:620.out 2024-01-31T05:08:04.376 INFO:teuthology.orchestra.run.smithi049.stdout:621 2024-01-31T05:08:04.376 INFO:teuthology.orchestra.run.smithi049.stdout:621.out 2024-01-31T05:08:04.376 INFO:teuthology.orchestra.run.smithi049.stdout:622 2024-01-31T05:08:04.376 INFO:teuthology.orchestra.run.smithi049.stdout:622.out 2024-01-31T05:08:04.376 INFO:teuthology.orchestra.run.smithi049.stdout:623 2024-01-31T05:08:04.376 INFO:teuthology.orchestra.run.smithi049.stdout:623.out 2024-01-31T05:08:04.376 INFO:teuthology.orchestra.run.smithi049.stdout:624 2024-01-31T05:08:04.376 INFO:teuthology.orchestra.run.smithi049.stdout:624.out 2024-01-31T05:08:04.376 INFO:teuthology.orchestra.run.smithi049.stdout:625 2024-01-31T05:08:04.377 INFO:teuthology.orchestra.run.smithi049.stdout:625.out 2024-01-31T05:08:04.377 INFO:teuthology.orchestra.run.smithi049.stdout:626 2024-01-31T05:08:04.377 INFO:teuthology.orchestra.run.smithi049.stdout:626.out 2024-01-31T05:08:04.377 INFO:teuthology.orchestra.run.smithi049.stdout:627 2024-01-31T05:08:04.377 INFO:teuthology.orchestra.run.smithi049.stdout:627.out 2024-01-31T05:08:04.377 INFO:teuthology.orchestra.run.smithi049.stdout:628 2024-01-31T05:08:04.377 INFO:teuthology.orchestra.run.smithi049.stdout:628.out 2024-01-31T05:08:04.377 INFO:teuthology.orchestra.run.smithi049.stdout:629 2024-01-31T05:08:04.377 INFO:teuthology.orchestra.run.smithi049.stdout:629.out 2024-01-31T05:08:04.377 INFO:teuthology.orchestra.run.smithi049.stdout:630 2024-01-31T05:08:04.377 INFO:teuthology.orchestra.run.smithi049.stdout:630.out 2024-01-31T05:08:04.377 INFO:teuthology.orchestra.run.smithi049.stdout:631 2024-01-31T05:08:04.377 INFO:teuthology.orchestra.run.smithi049.stdout:631.out 2024-01-31T05:08:04.377 INFO:teuthology.orchestra.run.smithi049.stdout:632 2024-01-31T05:08:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:632.out 2024-01-31T05:08:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:633 2024-01-31T05:08:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:633.out 2024-01-31T05:08:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:634 2024-01-31T05:08:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:634.out 2024-01-31T05:08:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:635 2024-01-31T05:08:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:635.out 2024-01-31T05:08:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:636 2024-01-31T05:08:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:636.out 2024-01-31T05:08:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:637 2024-01-31T05:08:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:637.out 2024-01-31T05:08:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:638 2024-01-31T05:08:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:638.out 2024-01-31T05:08:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:639 2024-01-31T05:08:04.378 INFO:teuthology.orchestra.run.smithi049.stdout:639.out 2024-01-31T05:08:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:640 2024-01-31T05:08:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:640.out 2024-01-31T05:08:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:641 2024-01-31T05:08:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:641.out 2024-01-31T05:08:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:642 2024-01-31T05:08:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:642.out 2024-01-31T05:08:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:643 2024-01-31T05:08:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:643.out 2024-01-31T05:08:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:644 2024-01-31T05:08:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:644.out 2024-01-31T05:08:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:645 2024-01-31T05:08:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:645.out 2024-01-31T05:08:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:646 2024-01-31T05:08:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:646.out 2024-01-31T05:08:04.379 INFO:teuthology.orchestra.run.smithi049.stdout:647 2024-01-31T05:08:04.380 INFO:teuthology.orchestra.run.smithi049.stdout:647.out 2024-01-31T05:08:04.380 INFO:teuthology.orchestra.run.smithi049.stdout:648 2024-01-31T05:08:04.380 INFO:teuthology.orchestra.run.smithi049.stdout:648.out 2024-01-31T05:08:04.380 INFO:teuthology.orchestra.run.smithi049.stdout:649 2024-01-31T05:08:04.380 INFO:teuthology.orchestra.run.smithi049.stdout:649.out 2024-01-31T05:08:04.380 INFO:teuthology.orchestra.run.smithi049.stdout:650 2024-01-31T05:08:04.380 INFO:teuthology.orchestra.run.smithi049.stdout:650.out 2024-01-31T05:08:04.380 INFO:teuthology.orchestra.run.smithi049.stdout:651 2024-01-31T05:08:04.380 INFO:teuthology.orchestra.run.smithi049.stdout:651.out 2024-01-31T05:08:04.380 INFO:teuthology.orchestra.run.smithi049.stdout:652 2024-01-31T05:08:04.380 INFO:teuthology.orchestra.run.smithi049.stdout:652.out 2024-01-31T05:08:04.380 INFO:teuthology.orchestra.run.smithi049.stdout:653 2024-01-31T05:08:04.380 INFO:teuthology.orchestra.run.smithi049.stdout:653.out 2024-01-31T05:08:04.380 INFO:teuthology.orchestra.run.smithi049.stdout:654 2024-01-31T05:08:04.381 INFO:teuthology.orchestra.run.smithi049.stdout:654.out 2024-01-31T05:08:04.381 INFO:teuthology.orchestra.run.smithi049.stdout:655 2024-01-31T05:08:04.381 INFO:teuthology.orchestra.run.smithi049.stdout:655.out 2024-01-31T05:08:04.381 INFO:teuthology.orchestra.run.smithi049.stdout:656 2024-01-31T05:08:04.381 INFO:teuthology.orchestra.run.smithi049.stdout:656.out 2024-01-31T05:08:04.381 INFO:teuthology.orchestra.run.smithi049.stdout:657 2024-01-31T05:08:04.381 INFO:teuthology.orchestra.run.smithi049.stdout:657.out 2024-01-31T05:08:04.381 INFO:teuthology.orchestra.run.smithi049.stdout:658 2024-01-31T05:08:04.381 INFO:teuthology.orchestra.run.smithi049.stdout:658.out 2024-01-31T05:08:04.381 INFO:teuthology.orchestra.run.smithi049.stdout:659 2024-01-31T05:08:04.381 INFO:teuthology.orchestra.run.smithi049.stdout:659.out 2024-01-31T05:08:04.381 INFO:teuthology.orchestra.run.smithi049.stdout:660 2024-01-31T05:08:04.381 INFO:teuthology.orchestra.run.smithi049.stdout:660.out 2024-01-31T05:08:04.381 INFO:teuthology.orchestra.run.smithi049.stdout:661 2024-01-31T05:08:04.382 INFO:teuthology.orchestra.run.smithi049.stdout:661.out 2024-01-31T05:08:04.382 INFO:teuthology.orchestra.run.smithi049.stdout:662 2024-01-31T05:08:04.382 INFO:teuthology.orchestra.run.smithi049.stdout:662.out 2024-01-31T05:08:04.382 INFO:teuthology.orchestra.run.smithi049.stdout:663 2024-01-31T05:08:04.382 INFO:teuthology.orchestra.run.smithi049.stdout:663.out 2024-01-31T05:08:04.382 INFO:teuthology.orchestra.run.smithi049.stdout:664 2024-01-31T05:08:04.382 INFO:teuthology.orchestra.run.smithi049.stdout:664.out 2024-01-31T05:08:04.382 INFO:teuthology.orchestra.run.smithi049.stdout:665 2024-01-31T05:08:04.382 INFO:teuthology.orchestra.run.smithi049.stdout:665.out 2024-01-31T05:08:04.382 INFO:teuthology.orchestra.run.smithi049.stdout:666 2024-01-31T05:08:04.382 INFO:teuthology.orchestra.run.smithi049.stdout:666.out 2024-01-31T05:08:04.382 INFO:teuthology.orchestra.run.smithi049.stdout:667 2024-01-31T05:08:04.382 INFO:teuthology.orchestra.run.smithi049.stdout:667.out 2024-01-31T05:08:04.382 INFO:teuthology.orchestra.run.smithi049.stdout:668 2024-01-31T05:08:04.382 INFO:teuthology.orchestra.run.smithi049.stdout:668.out 2024-01-31T05:08:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:669 2024-01-31T05:08:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:669.out 2024-01-31T05:08:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:670 2024-01-31T05:08:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:670.out 2024-01-31T05:08:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:671 2024-01-31T05:08:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:671.out 2024-01-31T05:08:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:672 2024-01-31T05:08:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:672.out 2024-01-31T05:08:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:673 2024-01-31T05:08:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:673.out 2024-01-31T05:08:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:674 2024-01-31T05:08:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:674.out 2024-01-31T05:08:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:675 2024-01-31T05:08:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:675.out 2024-01-31T05:08:04.383 INFO:teuthology.orchestra.run.smithi049.stdout:676 2024-01-31T05:08:04.384 INFO:teuthology.orchestra.run.smithi049.stdout:676.out 2024-01-31T05:08:04.384 INFO:teuthology.orchestra.run.smithi049.stdout:677 2024-01-31T05:08:04.384 INFO:teuthology.orchestra.run.smithi049.stdout:677.out 2024-01-31T05:08:04.384 INFO:teuthology.orchestra.run.smithi049.stdout:678 2024-01-31T05:08:04.384 INFO:teuthology.orchestra.run.smithi049.stdout:678.out 2024-01-31T05:08:04.384 INFO:teuthology.orchestra.run.smithi049.stdout:679 2024-01-31T05:08:04.384 INFO:teuthology.orchestra.run.smithi049.stdout:679.out 2024-01-31T05:08:04.384 INFO:teuthology.orchestra.run.smithi049.stdout:680 2024-01-31T05:08:04.384 INFO:teuthology.orchestra.run.smithi049.stdout:680.out 2024-01-31T05:08:04.384 INFO:teuthology.orchestra.run.smithi049.stdout:681 2024-01-31T05:08:04.384 INFO:teuthology.orchestra.run.smithi049.stdout:681.out 2024-01-31T05:08:04.384 INFO:teuthology.orchestra.run.smithi049.stdout:682 2024-01-31T05:08:04.384 INFO:teuthology.orchestra.run.smithi049.stdout:682.out 2024-01-31T05:08:04.384 INFO:teuthology.orchestra.run.smithi049.stdout:683 2024-01-31T05:08:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:683.out 2024-01-31T05:08:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:684 2024-01-31T05:08:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:684.out 2024-01-31T05:08:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:685 2024-01-31T05:08:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:685.out 2024-01-31T05:08:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:686 2024-01-31T05:08:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:686.out 2024-01-31T05:08:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:687 2024-01-31T05:08:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:687.out 2024-01-31T05:08:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:688 2024-01-31T05:08:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:688.out 2024-01-31T05:08:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:689 2024-01-31T05:08:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:689.out 2024-01-31T05:08:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:690 2024-01-31T05:08:04.385 INFO:teuthology.orchestra.run.smithi049.stdout:690.out 2024-01-31T05:08:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:691 2024-01-31T05:08:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:691.out 2024-01-31T05:08:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:692 2024-01-31T05:08:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:692.out 2024-01-31T05:08:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:693 2024-01-31T05:08:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:693.out 2024-01-31T05:08:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:694 2024-01-31T05:08:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:694.out 2024-01-31T05:08:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:695 2024-01-31T05:08:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:695.out 2024-01-31T05:08:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:696 2024-01-31T05:08:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:696.out 2024-01-31T05:08:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:697 2024-01-31T05:08:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:697.out 2024-01-31T05:08:04.386 INFO:teuthology.orchestra.run.smithi049.stdout:698 2024-01-31T05:08:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:698.out 2024-01-31T05:08:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:699 2024-01-31T05:08:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:699.out 2024-01-31T05:08:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:700 2024-01-31T05:08:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:700.out 2024-01-31T05:08:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:701 2024-01-31T05:08:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:701.out 2024-01-31T05:08:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:702 2024-01-31T05:08:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:702.out 2024-01-31T05:08:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:703 2024-01-31T05:08:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:703.out 2024-01-31T05:08:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:704 2024-01-31T05:08:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:704.out 2024-01-31T05:08:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:705 2024-01-31T05:08:04.387 INFO:teuthology.orchestra.run.smithi049.stdout:705.out 2024-01-31T05:08:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:706 2024-01-31T05:08:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:706.out 2024-01-31T05:08:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:707 2024-01-31T05:08:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:707.out 2024-01-31T05:08:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:708 2024-01-31T05:08:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:708.out 2024-01-31T05:08:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:709 2024-01-31T05:08:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:709.out 2024-01-31T05:08:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:710 2024-01-31T05:08:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:710.out 2024-01-31T05:08:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:711 2024-01-31T05:08:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:711.out 2024-01-31T05:08:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:712 2024-01-31T05:08:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:712.out 2024-01-31T05:08:04.388 INFO:teuthology.orchestra.run.smithi049.stdout:713 2024-01-31T05:08:04.389 INFO:teuthology.orchestra.run.smithi049.stdout:713.out 2024-01-31T05:08:04.389 INFO:teuthology.orchestra.run.smithi049.stdout:714 2024-01-31T05:08:04.389 INFO:teuthology.orchestra.run.smithi049.stdout:714.out 2024-01-31T05:08:04.389 INFO:teuthology.orchestra.run.smithi049.stdout:715 2024-01-31T05:08:04.389 INFO:teuthology.orchestra.run.smithi049.stdout:715.out 2024-01-31T05:08:04.389 INFO:teuthology.orchestra.run.smithi049.stdout:716 2024-01-31T05:08:04.389 INFO:teuthology.orchestra.run.smithi049.stdout:716.out 2024-01-31T05:08:04.389 INFO:teuthology.orchestra.run.smithi049.stdout:717 2024-01-31T05:08:04.389 INFO:teuthology.orchestra.run.smithi049.stdout:717.out 2024-01-31T05:08:04.389 INFO:teuthology.orchestra.run.smithi049.stdout:718 2024-01-31T05:08:04.389 INFO:teuthology.orchestra.run.smithi049.stdout:718.out 2024-01-31T05:08:04.389 INFO:teuthology.orchestra.run.smithi049.stdout:719 2024-01-31T05:08:04.389 INFO:teuthology.orchestra.run.smithi049.stdout:719.out 2024-01-31T05:08:04.389 INFO:teuthology.orchestra.run.smithi049.stdout:720 2024-01-31T05:08:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:720.out 2024-01-31T05:08:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:721 2024-01-31T05:08:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:721.out 2024-01-31T05:08:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:722 2024-01-31T05:08:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:722.out 2024-01-31T05:08:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:723 2024-01-31T05:08:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:723.out 2024-01-31T05:08:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:724 2024-01-31T05:08:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:724.out 2024-01-31T05:08:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:725 2024-01-31T05:08:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:725.out 2024-01-31T05:08:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:726 2024-01-31T05:08:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:726.out 2024-01-31T05:08:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:727 2024-01-31T05:08:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:727.out 2024-01-31T05:08:04.390 INFO:teuthology.orchestra.run.smithi049.stdout:728 2024-01-31T05:08:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:728.out 2024-01-31T05:08:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:729 2024-01-31T05:08:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:729.out 2024-01-31T05:08:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:730 2024-01-31T05:08:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:730.out 2024-01-31T05:08:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:731 2024-01-31T05:08:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:731.out 2024-01-31T05:08:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:732 2024-01-31T05:08:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:732.out 2024-01-31T05:08:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:733 2024-01-31T05:08:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:733.out 2024-01-31T05:08:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:734 2024-01-31T05:08:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:734.out 2024-01-31T05:08:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:735 2024-01-31T05:08:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:735.out 2024-01-31T05:08:04.391 INFO:teuthology.orchestra.run.smithi049.stdout:736 2024-01-31T05:08:04.392 INFO:teuthology.orchestra.run.smithi049.stdout:736.out 2024-01-31T05:08:04.392 INFO:teuthology.orchestra.run.smithi049.stdout:737 2024-01-31T05:08:04.392 INFO:teuthology.orchestra.run.smithi049.stdout:737.out 2024-01-31T05:08:04.392 INFO:teuthology.orchestra.run.smithi049.stdout:738 2024-01-31T05:08:04.392 INFO:teuthology.orchestra.run.smithi049.stdout:738.out 2024-01-31T05:08:04.392 INFO:teuthology.orchestra.run.smithi049.stdout:group.list 2024-01-31T05:08:04.392 INFO:teuthology.orchestra.run.smithi049.stdout:Makefile 2024-01-31T05:08:04.394 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-01-31T05:08:04.760 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:08:04.770 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:08:04.770 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:08:08.887 INFO:teuthology.orchestra.run.smithi049.stdout:generic/001 4s 2024-01-31T05:08:08.899 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/001 2024-01-31T05:08:08.899 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:08:08.905 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:08:08.908 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[37318]: fuse finished with error 0 and tester_r 0 2024-01-31T05:08:08.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:08:08.926 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-01-31T05:08:09.285 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:08:09.295 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:08:09.296 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:08:10.024 INFO:teuthology.orchestra.run.smithi049.stdout:generic/002 1s 2024-01-31T05:08:10.036 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/002 2024-01-31T05:08:10.036 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:08:10.042 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:08:10.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:08:10.067 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-01-31T05:08:10.458 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:08:10.468 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:08:10.468 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:08:10.730 INFO:teuthology.orchestra.run.smithi049.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:08:10.738 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/003 2024-01-31T05:08:10.738 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/003 2024-01-31T05:08:10.738 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:08:10.744 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:08:10.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:08:10.763 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-01-31T05:08:11.119 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:08:11.129 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:08:11.129 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:08:11.413 INFO:teuthology.orchestra.run.smithi049.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-01-31T05:08:11.421 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/004 2024-01-31T05:08:11.421 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/004 2024-01-31T05:08:11.421 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:08:11.427 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:08:11.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:08:11.447 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-01-31T05:08:11.806 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:08:11.816 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:08:11.816 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:08:12.730 INFO:teuthology.orchestra.run.smithi049.stdout:generic/005 1s 2024-01-31T05:08:12.742 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/005 2024-01-31T05:08:12.742 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:08:12.748 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:08:12.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:08:12.769 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-01-31T05:08:13.174 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:08:13.184 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:08:13.184 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:08:18.981 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:08:18.985 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:08:48.422 INFO:teuthology.orchestra.run.smithi049.stdout:generic/006 35s 2024-01-31T05:08:48.999 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/006 2024-01-31T05:08:48.999 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:08:49.014 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:08:49.048 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:08:49.052 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:08:49.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:08:49.059 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-01-31T05:08:49.502 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:08:49.512 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:08:49.512 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:09:19.107 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:09:19.111 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:09:50.323 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:09:50.328 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:10:10.842 INFO:teuthology.orchestra.run.smithi049.stdout:generic/007 81s 2024-01-31T05:10:10.855 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/007 2024-01-31T05:10:10.856 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:10:10.862 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:10:10.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:10:10.914 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-01-31T05:10:11.296 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:10:11.306 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:10:11.306 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:10:12.927 INFO:teuthology.orchestra.run.smithi049.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-01-31T05:10:12.935 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/008 2024-01-31T05:10:12.935 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/008 2024-01-31T05:10:12.935 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:10:12.941 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:10:12.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:10:12.963 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-01-31T05:10:13.329 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:10:13.339 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:10:13.339 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:10:14.802 INFO:teuthology.orchestra.run.smithi049.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-01-31T05:10:14.810 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/009 2024-01-31T05:10:14.810 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/009 2024-01-31T05:10:14.810 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:10:14.817 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:10:14.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:10:14.837 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-01-31T05:10:15.194 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:10:15.204 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:10:15.204 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:10:15.515 INFO:teuthology.orchestra.run.smithi049.stdout:generic/010 [not run] /tmp/tmp.MqKNGSMQ15xfstests-dev/src/dbtest not built 2024-01-31T05:10:15.523 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/010 2024-01-31T05:10:15.523 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/010 2024-01-31T05:10:15.523 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:10:15.529 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:10:15.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:10:15.550 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-01-31T05:10:15.917 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:10:15.927 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:10:15.927 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:10:20.998 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:10:21.002 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:10:52.611 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:10:52.616 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:10:56.872 INFO:teuthology.orchestra.run.smithi049.stdout:generic/011 41s 2024-01-31T05:10:56.884 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/011 2024-01-31T05:10:56.884 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:10:56.890 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:10:56.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:10:56.996 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-01-31T05:10:57.400 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:10:57.419 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:10:57.419 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:10:58.939 INFO:teuthology.orchestra.run.smithi049.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-01-31T05:10:58.948 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/012 2024-01-31T05:10:58.948 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/012 2024-01-31T05:10:58.948 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:10:58.954 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:10:59.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:10:59.001 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-01-31T05:10:59.371 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:10:59.381 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:10:59.381 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:11:22.666 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:11:22.673 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:11:52.746 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:11:52.752 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:12:23.863 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:12:23.877 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:12:54.811 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:12:54.820 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:12:56.625 INFO:teuthology.orchestra.run.smithi049.stdout:generic/013 117s 2024-01-31T05:12:56.877 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/013 2024-01-31T05:12:56.877 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:12:56.889 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:12:56.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:12:56.919 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-01-31T05:12:57.643 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:12:57.659 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:12:57.660 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:00.823 INFO:teuthology.orchestra.run.smithi049.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-01-31T05:13:00.836 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/014 2024-01-31T05:13:00.836 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/014 2024-01-31T05:13:00.836 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:00.845 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:00.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:00.880 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-01-31T05:13:01.445 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:01.461 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:01.461 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:01.874 INFO:teuthology.orchestra.run.smithi049.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:13:01.887 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/015 2024-01-31T05:13:01.888 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/015 2024-01-31T05:13:01.888 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:01.898 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:01.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:01.955 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-01-31T05:13:02.491 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:02.508 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:02.508 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:05.581 INFO:teuthology.orchestra.run.smithi049.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-01-31T05:13:05.595 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/016 2024-01-31T05:13:05.595 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/016 2024-01-31T05:13:05.595 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:05.606 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:05.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:05.733 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-01-31T05:13:06.300 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:06.318 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:06.318 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:06.752 INFO:teuthology.orchestra.run.smithi049.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:13:06.764 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/017 2024-01-31T05:13:06.764 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/017 2024-01-31T05:13:06.764 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:06.772 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:06.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:06.801 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-01-31T05:13:07.350 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:07.364 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:07.364 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:07.772 INFO:teuthology.orchestra.run.smithi049.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:13:07.783 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/018 2024-01-31T05:13:07.784 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/018 2024-01-31T05:13:07.784 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:07.793 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:07.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:07.823 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-01-31T05:13:08.354 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:08.369 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:08.369 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:08.764 INFO:teuthology.orchestra.run.smithi049.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:13:08.778 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/019 2024-01-31T05:13:08.778 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/019 2024-01-31T05:13:08.778 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:08.789 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:08.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:08.825 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-01-31T05:13:09.367 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:09.385 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:09.385 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:26.238 INFO:teuthology.orchestra.run.smithi049.stdout:generic/020 - output mismatch (see /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/020.out.bad) 2024-01-31T05:13:26.246 INFO:teuthology.orchestra.run.smithi049.stdout: --- tests/generic/020.out 2024-01-31 05:06:00.851953074 +0000 2024-01-31T05:13:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: +++ /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/020.out.bad 2024-01-31 05:13:26.241336096 +0000 2024-01-31T05:13:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -47,9 +47,13 @@ 2024-01-31T05:13:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: user.snrub="fish2\012" 2024-01-31T05:13:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: *** really long value 2024-01-31T05:13:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: -0000000 00 2024-01-31T05:13:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: -* 2024-01-31T05:13:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: -ATTRSIZE 2024-01-31T05:13:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: +attr_set: No space left on device 2024-01-31T05:13:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: +Could not set "long_attr" for 2024-01-31T05:13:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: +attr_get: No data available 2024-01-31T05:13:26.248 INFO:teuthology.orchestra.run.smithi049.stdout: +Could not get "long_attr" for 2024-01-31T05:13:26.248 INFO:teuthology.orchestra.run.smithi049.stdout: +0000000 2024-01-31T05:13:26.248 INFO:teuthology.orchestra.run.smithi049.stdout: +attr_remove: No data available 2024-01-31T05:13:26.248 INFO:teuthology.orchestra.run.smithi049.stdout: +Could not remove "long_attr" for 2024-01-31T05:13:26.248 INFO:teuthology.orchestra.run.smithi049.stdout: *** set/get/remove really long names (expect failure) 2024-01-31T05:13:26.248 INFO:teuthology.orchestra.run.smithi049.stdout: attr_set: Invalid argument 2024-01-31T05:13:26.248 INFO:teuthology.orchestra.run.smithi049.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2024-01-31T05:13:26.255 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/020 2024-01-31T05:13:26.256 INFO:teuthology.orchestra.run.smithi049.stdout:Failures: generic/020 2024-01-31T05:13:26.256 INFO:teuthology.orchestra.run.smithi049.stdout:Failed 1 of 1 tests 2024-01-31T05:13:26.263 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:26.416 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T05:13:26.417 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-01-31T05:13:26.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-01-31T05:13:26.417 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-01-31T05:13:26.989 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:27.005 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:27.006 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:27.496 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:13:27.507 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:13:28.256 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-31T05:13:28.261+0000 7fd9fae00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 87769) UID: 0 2024-01-31T05:13:28.257 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-31T05:13:28.261+0000 7fab97400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 87769) UID: 0 2024-01-31T05:13:30.223 INFO:teuthology.orchestra.run.smithi049.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-01-31T05:13:30.236 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/021 2024-01-31T05:13:30.236 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/021 2024-01-31T05:13:30.237 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:30.247 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:30.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:30.288 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-01-31T05:13:31.068 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:31.084 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:31.084 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:34.096 INFO:teuthology.orchestra.run.smithi049.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-01-31T05:13:34.115 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/022 2024-01-31T05:13:34.115 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/022 2024-01-31T05:13:34.115 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:34.130 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:34.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:34.191 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-01-31T05:13:34.931 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:34.948 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:34.948 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:38.466 INFO:teuthology.orchestra.run.smithi049.stdout:generic/023 4s 2024-01-31T05:13:38.488 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/023 2024-01-31T05:13:38.489 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:38.498 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:38.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:38.567 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-01-31T05:13:39.317 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:39.333 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:39.334 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:39.829 INFO:teuthology.orchestra.run.smithi049.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-01-31T05:13:39.845 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/024 2024-01-31T05:13:39.846 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/024 2024-01-31T05:13:39.846 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:39.857 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:39.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:39.947 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-01-31T05:13:40.640 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:40.665 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:40.666 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:41.206 INFO:teuthology.orchestra.run.smithi049.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-01-31T05:13:41.223 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/025 2024-01-31T05:13:41.223 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/025 2024-01-31T05:13:41.223 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:41.233 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:41.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:41.307 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-01-31T05:13:41.986 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:42.006 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:42.006 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:42.575 INFO:teuthology.orchestra.run.smithi049.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-01-31T05:13:42.589 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/026 2024-01-31T05:13:42.589 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/026 2024-01-31T05:13:42.589 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:42.596 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:42.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:42.615 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-01-31T05:13:43.078 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:43.104 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:43.104 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:43.553 INFO:teuthology.orchestra.run.smithi049.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:13:43.565 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/027 2024-01-31T05:13:43.566 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/027 2024-01-31T05:13:43.566 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:43.578 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:43.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:43.616 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-01-31T05:13:44.231 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:44.246 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:44.246 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:49.747 INFO:teuthology.orchestra.run.smithi049.stdout:generic/028 5s 2024-01-31T05:13:49.767 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/028 2024-01-31T05:13:49.768 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:49.778 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:49.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:49.815 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-01-31T05:13:50.451 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:50.466 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:50.467 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:50.937 INFO:teuthology.orchestra.run.smithi049.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:13:50.951 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/029 2024-01-31T05:13:50.951 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/029 2024-01-31T05:13:50.951 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:50.962 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:51.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:51.000 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-01-31T05:13:51.619 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:51.635 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:51.635 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:52.083 INFO:teuthology.orchestra.run.smithi049.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:13:52.093 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/030 2024-01-31T05:13:52.093 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/030 2024-01-31T05:13:52.093 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:52.104 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:52.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:52.137 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-01-31T05:13:52.738 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:52.761 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:52.761 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:53.184 INFO:teuthology.orchestra.run.smithi049.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:13:53.196 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/031 2024-01-31T05:13:53.196 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/031 2024-01-31T05:13:53.196 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:53.212 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:53.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:53.249 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-01-31T05:13:53.879 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:53.897 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:53.898 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:54.346 INFO:teuthology.orchestra.run.smithi049.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:13:54.356 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/032 2024-01-31T05:13:54.357 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/032 2024-01-31T05:13:54.357 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:54.368 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:54.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:54.409 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-01-31T05:13:55.019 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:55.045 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:55.045 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:55.482 INFO:teuthology.orchestra.run.smithi049.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:13:55.495 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/033 2024-01-31T05:13:55.495 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/033 2024-01-31T05:13:55.495 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:55.509 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:55.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:55.547 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-01-31T05:13:56.160 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:56.183 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:56.183 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:56.667 INFO:teuthology.orchestra.run.smithi049.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:13:56.682 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/034 2024-01-31T05:13:56.682 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/034 2024-01-31T05:13:56.682 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:56.693 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:56.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:56.765 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-01-31T05:13:57.389 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:57.406 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:57.406 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:58.024 INFO:teuthology.orchestra.run.smithi049.stdout:generic/035 1s 2024-01-31T05:13:58.047 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/035 2024-01-31T05:13:58.047 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:13:58.057 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:13:58.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:13:58.136 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-01-31T05:13:58.853 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:13:58.871 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:13:58.871 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:09.621 INFO:teuthology.orchestra.run.smithi049.stdout:generic/036 11s 2024-01-31T05:14:09.641 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/036 2024-01-31T05:14:09.641 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:09.653 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:09.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:09.751 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-01-31T05:14:10.474 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:10.489 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:10.490 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:10.931 INFO:teuthology.orchestra.run.smithi049.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:10.943 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/037 2024-01-31T05:14:10.943 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/037 2024-01-31T05:14:10.943 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:10.952 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:10.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:10.991 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-01-31T05:14:11.595 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:11.611 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:11.611 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:12.039 INFO:teuthology.orchestra.run.smithi049.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:12.050 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/038 2024-01-31T05:14:12.051 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/038 2024-01-31T05:14:12.051 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:12.060 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:12.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:12.104 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-01-31T05:14:12.744 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:12.764 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:12.765 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:13.223 INFO:teuthology.orchestra.run.smithi049.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:13.244 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/039 2024-01-31T05:14:13.244 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/039 2024-01-31T05:14:13.244 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:13.253 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:13.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:13.286 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-01-31T05:14:13.896 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:13.912 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:13.913 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:14.393 INFO:teuthology.orchestra.run.smithi049.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:14.406 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/040 2024-01-31T05:14:14.406 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/040 2024-01-31T05:14:14.406 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:14.419 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:14.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:14.451 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-01-31T05:14:15.018 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:15.032 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:15.032 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:15.489 INFO:teuthology.orchestra.run.smithi049.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:15.500 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/041 2024-01-31T05:14:15.500 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/041 2024-01-31T05:14:15.501 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:15.511 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:15.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:15.546 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-01-31T05:14:16.136 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:16.152 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:16.152 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:16.579 INFO:teuthology.orchestra.run.smithi049.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:16.592 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/042 2024-01-31T05:14:16.592 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/042 2024-01-31T05:14:16.592 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:16.604 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:16.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:16.639 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-01-31T05:14:17.229 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:17.244 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:17.245 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:17.704 INFO:teuthology.orchestra.run.smithi049.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:17.718 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/043 2024-01-31T05:14:17.718 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/043 2024-01-31T05:14:17.718 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:17.727 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:17.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:17.758 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-01-31T05:14:18.349 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:18.369 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:18.369 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:18.797 INFO:teuthology.orchestra.run.smithi049.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:18.811 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/044 2024-01-31T05:14:18.811 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/044 2024-01-31T05:14:18.811 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:18.823 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:18.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:18.858 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-01-31T05:14:19.452 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:19.463 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:19.463 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:19.886 INFO:teuthology.orchestra.run.smithi049.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:19.897 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/045 2024-01-31T05:14:19.897 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/045 2024-01-31T05:14:19.897 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:19.916 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:19.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:19.949 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-01-31T05:14:20.546 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:20.566 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:20.566 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:21.009 INFO:teuthology.orchestra.run.smithi049.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:21.021 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/046 2024-01-31T05:14:21.021 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/046 2024-01-31T05:14:21.021 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:21.032 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:21.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:21.064 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-01-31T05:14:21.656 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:21.670 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:21.670 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:22.075 INFO:teuthology.orchestra.run.smithi049.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:22.086 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/047 2024-01-31T05:14:22.086 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/047 2024-01-31T05:14:22.086 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:22.101 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:22.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:22.141 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-01-31T05:14:22.729 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:22.745 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:22.745 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:23.181 INFO:teuthology.orchestra.run.smithi049.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:23.193 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/048 2024-01-31T05:14:23.193 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/048 2024-01-31T05:14:23.194 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:23.201 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:23.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:23.232 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-01-31T05:14:23.862 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:23.878 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:23.878 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:24.288 INFO:teuthology.orchestra.run.smithi049.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:24.305 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/049 2024-01-31T05:14:24.306 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/049 2024-01-31T05:14:24.306 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:24.315 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:24.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:24.351 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-01-31T05:14:24.989 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:25.005 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:25.005 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:25.427 INFO:teuthology.orchestra.run.smithi049.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:25.439 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/050 2024-01-31T05:14:25.439 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/050 2024-01-31T05:14:25.439 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:25.448 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:25.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:25.480 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-01-31T05:14:26.059 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:26.076 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:26.076 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:26.519 INFO:teuthology.orchestra.run.smithi049.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:26.531 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/051 2024-01-31T05:14:26.531 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/051 2024-01-31T05:14:26.532 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:26.541 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:26.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:26.569 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-01-31T05:14:27.153 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:27.169 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:27.169 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:27.602 INFO:teuthology.orchestra.run.smithi049.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:27.616 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/052 2024-01-31T05:14:27.616 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/052 2024-01-31T05:14:27.616 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:27.625 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:27.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:27.655 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-01-31T05:14:28.276 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:28.296 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:28.296 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:28.727 INFO:teuthology.orchestra.run.smithi049.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:28.740 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/053 2024-01-31T05:14:28.740 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/053 2024-01-31T05:14:28.740 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:28.749 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:28.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:28.783 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-01-31T05:14:29.423 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:29.439 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:29.439 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:29.874 INFO:teuthology.orchestra.run.smithi049.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:29.887 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/054 2024-01-31T05:14:29.887 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/054 2024-01-31T05:14:29.887 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:29.895 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:29.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:29.926 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-01-31T05:14:30.537 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:30.555 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:30.555 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:30.994 INFO:teuthology.orchestra.run.smithi049.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:31.007 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/055 2024-01-31T05:14:31.007 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/055 2024-01-31T05:14:31.007 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:31.016 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:31.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:31.047 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-01-31T05:14:31.652 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:31.671 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:31.671 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:32.153 INFO:teuthology.orchestra.run.smithi049.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:32.166 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/056 2024-01-31T05:14:32.167 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/056 2024-01-31T05:14:32.167 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:32.176 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:32.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:32.224 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-01-31T05:14:32.807 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:32.824 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:32.824 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:33.327 INFO:teuthology.orchestra.run.smithi049.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:33.341 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/057 2024-01-31T05:14:33.341 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/057 2024-01-31T05:14:33.341 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:33.349 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:33.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:33.384 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-01-31T05:14:34.007 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:34.025 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:34.025 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:37.391 INFO:teuthology.orchestra.run.smithi049.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-01-31T05:14:37.406 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/058 2024-01-31T05:14:37.407 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/058 2024-01-31T05:14:37.408 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:37.418 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:37.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:37.593 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-01-31T05:14:38.299 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:38.317 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:38.317 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:38.784 INFO:teuthology.orchestra.run.smithi049.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:38.799 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/059 2024-01-31T05:14:38.799 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/059 2024-01-31T05:14:38.799 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:38.810 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:38.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:38.845 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-01-31T05:14:39.436 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:39.456 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:39.456 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:43.167 INFO:teuthology.orchestra.run.smithi049.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-01-31T05:14:43.179 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/060 2024-01-31T05:14:43.179 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/060 2024-01-31T05:14:43.179 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:43.190 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:43.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:43.250 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-01-31T05:14:44.000 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:44.017 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:44.017 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:47.385 INFO:teuthology.orchestra.run.smithi049.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-01-31T05:14:47.399 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/061 2024-01-31T05:14:47.400 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/061 2024-01-31T05:14:47.400 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:47.409 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:47.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:47.522 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-01-31T05:14:48.192 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:48.211 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:48.211 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:48.659 INFO:teuthology.orchestra.run.smithi049.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:48.672 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/062 2024-01-31T05:14:48.672 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/062 2024-01-31T05:14:48.672 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:48.685 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:48.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:48.725 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-01-31T05:14:49.318 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:49.332 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:49.332 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:52.456 INFO:teuthology.orchestra.run.smithi049.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-01-31T05:14:52.469 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/063 2024-01-31T05:14:52.469 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/063 2024-01-31T05:14:52.470 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:52.480 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:52.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:52.526 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-01-31T05:14:53.210 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:53.231 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:53.231 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:53.662 INFO:teuthology.orchestra.run.smithi049.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:53.679 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/064 2024-01-31T05:14:53.679 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/064 2024-01-31T05:14:53.679 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:53.690 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:53.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:53.770 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-01-31T05:14:54.376 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:54.391 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:54.391 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:54.836 INFO:teuthology.orchestra.run.smithi049.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:54.849 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/065 2024-01-31T05:14:54.849 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/065 2024-01-31T05:14:54.849 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:54.858 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:54.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:54.932 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-01-31T05:14:55.543 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:55.563 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:55.563 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:56.003 INFO:teuthology.orchestra.run.smithi049.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:56.014 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/066 2024-01-31T05:14:56.014 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/066 2024-01-31T05:14:56.015 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:56.024 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:56.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:56.062 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-01-31T05:14:56.677 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:56.690 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:56.691 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:57.211 INFO:teuthology.orchestra.run.smithi049.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:57.223 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/067 2024-01-31T05:14:57.223 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/067 2024-01-31T05:14:57.223 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:57.234 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:57.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:57.267 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-01-31T05:14:57.875 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:57.891 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:57.891 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:58.348 INFO:teuthology.orchestra.run.smithi049.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:58.361 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/068 2024-01-31T05:14:58.361 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/068 2024-01-31T05:14:58.361 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:58.370 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:58.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:58.400 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-01-31T05:14:58.977 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:14:58.995 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:14:58.995 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:59.410 INFO:teuthology.orchestra.run.smithi049.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:14:59.430 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/069 2024-01-31T05:14:59.430 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/069 2024-01-31T05:14:59.430 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:14:59.440 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:14:59.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:14:59.476 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-01-31T05:15:00.115 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:15:00.133 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:15:00.133 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:16:50.307 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:16:50.312 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:17:11.809 INFO:teuthology.orchestra.run.smithi049.stdout:generic/070 131s 2024-01-31T05:17:11.861 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/070 2024-01-31T05:17:11.862 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:17:11.871 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:17:11.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:17:11.922 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-01-31T05:17:12.678 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:17:12.694 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:17:12.694 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:17:13.080 INFO:teuthology.orchestra.run.smithi049.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:17:13.096 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/071 2024-01-31T05:17:13.096 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/071 2024-01-31T05:17:13.096 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:17:13.105 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:17:13.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:17:13.133 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-01-31T05:17:13.679 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:17:13.694 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:17:13.694 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:17:16.182 INFO:teuthology.orchestra.run.smithi049.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-01-31T05:17:16.195 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/072 2024-01-31T05:17:16.195 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/072 2024-01-31T05:17:16.195 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:17:16.203 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:17:16.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:17:16.234 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-01-31T05:17:16.770 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:17:16.785 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:17:16.785 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:17:17.205 INFO:teuthology.orchestra.run.smithi049.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:17:17.223 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/073 2024-01-31T05:17:17.224 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/073 2024-01-31T05:17:17.224 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:17:17.233 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:17:17.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:17:17.263 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-01-31T05:17:17.775 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:17:17.789 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:17:17.790 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:17:20.481 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:17:20.484 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:17:51.381 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:17:51.386 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:18:21.467 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:18:21.473 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:18:52.514 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:18:52.519 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:19:24.670 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:19:24.675 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:19:54.736 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:19:54.742 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:20:24.945 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:20:24.985 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:20:55.188 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:20:55.192 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:21:26.662 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:21:26.667 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:21:57.400 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:21:57.405 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:22:29.088 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:22:29.094 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:23:00.238 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:23:00.243 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:23:31.384 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:23:31.389 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:24:02.768 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:24:02.773 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:24:34.065 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:24:34.070 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:25:05.816 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:25:05.820 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:25:36.755 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:25:36.761 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:26:07.613 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:26:07.622 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:26:07.825 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T05:26:07.827+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32382) UID: 0 2024-01-31T05:26:07.825 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T05:26:07.827+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32382) UID: 0 2024-01-31T05:26:07.825 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T05:26:07.827+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32382) UID: 0 2024-01-31T05:26:07.826 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T05:26:07.827+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32382) UID: 0 2024-01-31T05:30:26.198 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:30:26.204 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:30:26.285 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T05:30:26.289+0000 7f79d2800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115677) UID: 0 2024-01-31T05:30:26.286 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T05:30:26.289+0000 7f4aaf800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115677) UID: 0 2024-01-31T05:30:26.286 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T05:30:26.289+0000 7f91cc000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115677) UID: 0 2024-01-31T05:30:26.289 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T05:30:26.293+0000 7f96ce200640 -1 Fail to open '/proc/115677/cmdline' error = (2) No such file or directory 2024-01-31T05:30:26.289 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T05:30:26.293+0000 7f96ce200640 -1 received signal: Hangup from (PID: 115677) UID: 0 2024-01-31T05:35:44.811 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:35:44.816 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:35:45.222 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T05:35:45.224+0000 7f91cc000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118077) UID: 0 2024-01-31T05:35:45.223 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T05:35:45.224+0000 7f79d2800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118077) UID: 0 2024-01-31T05:35:45.268 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T05:35:45.224+0000 7f96ce200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118077) UID: 0 2024-01-31T05:35:45.269 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T05:35:45.224+0000 7f4aaf800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118077) UID: 0 2024-01-31T05:35:45.953 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T05:35:45.951+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32535) UID: 0 2024-01-31T05:35:45.953 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T05:35:45.951+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32535) UID: 0 2024-01-31T05:35:46.190 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T05:35:45.951+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32535) UID: 0 2024-01-31T05:35:46.193 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T05:35:45.951+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32535) UID: 0 2024-01-31T05:50:35.479 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:50:35.515 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T05:50:35.848 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T05:50:35.847+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32809) UID: 0 2024-01-31T05:50:35.848 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T05:50:35.847+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32809) UID: 0 2024-01-31T05:50:35.849 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T05:50:35.847+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32809) UID: 0 2024-01-31T05:50:35.849 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T05:50:35.847+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32809) UID: 0 2024-01-31T05:50:40.562 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T05:50:40.563+0000 7f4aaf800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123734) UID: 0 2024-01-31T05:50:40.563 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T05:50:40.563+0000 7f79d2800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123734) UID: 0 2024-01-31T05:50:40.568 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T05:50:40.567+0000 7f96ce200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123734) UID: 0 2024-01-31T05:50:40.568 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T05:50:40.567+0000 7f91cc000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123734) UID: 0 2024-01-31T05:52:25.238 INFO:teuthology.orchestra.run.smithi049.stdout:generic/074 2108s 2024-01-31T05:52:25.510 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/074 2024-01-31T05:52:25.511 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:52:25.516 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:52:25.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:52:25.536 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-01-31T05:52:27.110 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:52:27.120 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:52:27.120 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:11.827 INFO:teuthology.orchestra.run.smithi049.stdout:generic/075 44s 2024-01-31T05:53:11.839 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/075 2024-01-31T05:53:11.839 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:53:11.845 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:12.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:53:12.030 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-01-31T05:53:12.591 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:53:12.601 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:53:12.601 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:12.894 INFO:teuthology.orchestra.run.smithi049.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:53:12.902 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/076 2024-01-31T05:53:12.902 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/076 2024-01-31T05:53:12.902 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:53:12.909 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:12.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:53:12.928 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-01-31T05:53:13.318 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:53:13.329 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:53:13.329 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:19.851 INFO:teuthology.orchestra.run.smithi049.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:53:19.859 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/077 2024-01-31T05:53:19.860 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/077 2024-01-31T05:53:19.860 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:53:19.866 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:19.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:53:19.885 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-01-31T05:53:20.238 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:53:20.248 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:53:20.248 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:20.571 INFO:teuthology.orchestra.run.smithi049.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-01-31T05:53:20.579 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/078 2024-01-31T05:53:20.579 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/078 2024-01-31T05:53:20.580 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:53:20.586 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:20.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:53:20.638 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-01-31T05:53:21.286 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:53:21.297 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:53:21.297 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:21.649 INFO:teuthology.orchestra.run.smithi049.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-01-31T05:53:21.657 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/079 2024-01-31T05:53:21.657 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/079 2024-01-31T05:53:21.658 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:53:21.663 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:21.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:53:21.684 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-01-31T05:53:22.062 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:53:22.072 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:53:22.072 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:24.439 INFO:teuthology.orchestra.run.smithi049.stdout:generic/080 2s 2024-01-31T05:53:24.452 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/080 2024-01-31T05:53:24.452 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:53:24.458 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:24.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:53:24.478 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-01-31T05:53:24.837 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:53:24.847 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:53:24.848 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:25.130 INFO:teuthology.orchestra.run.smithi049.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:53:25.138 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/081 2024-01-31T05:53:25.138 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/081 2024-01-31T05:53:25.138 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:53:25.144 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:25.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:53:25.164 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-01-31T05:53:25.515 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:53:25.525 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:53:25.525 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:25.812 INFO:teuthology.orchestra.run.smithi049.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:53:25.820 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/082 2024-01-31T05:53:25.821 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/082 2024-01-31T05:53:25.821 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:53:25.828 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:25.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:53:25.848 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-01-31T05:53:26.210 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:53:26.220 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:53:26.220 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:26.509 INFO:teuthology.orchestra.run.smithi049.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:53:26.517 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/083 2024-01-31T05:53:26.517 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/083 2024-01-31T05:53:26.517 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:53:26.523 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:26.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:53:26.543 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-01-31T05:53:26.912 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:53:26.923 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:53:26.923 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:27.194 INFO:teuthology.orchestra.run.smithi049.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:53:27.203 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/084 2024-01-31T05:53:27.203 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/084 2024-01-31T05:53:27.203 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:53:27.209 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:27.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:53:27.229 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-01-31T05:53:27.603 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:53:27.613 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:53:27.613 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:28.013 INFO:teuthology.orchestra.run.smithi049.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T05:53:28.021 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/085 2024-01-31T05:53:28.021 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/085 2024-01-31T05:53:28.021 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:53:28.027 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:28.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:53:28.048 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-01-31T05:53:28.402 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:53:28.413 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:53:28.413 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:50.704 INFO:teuthology.orchestra.run.smithi049.stdout:generic/086 22s 2024-01-31T05:53:51.068 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/086 2024-01-31T05:53:51.068 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:53:51.074 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:51.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:53:51.163 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-01-31T05:53:55.529 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:53:55.539 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:53:55.540 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:56.280 INFO:teuthology.orchestra.run.smithi049.stdout:generic/087 1s 2024-01-31T05:53:56.292 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/087 2024-01-31T05:53:56.292 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:53:56.298 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:56.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:53:56.369 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-01-31T05:53:57.065 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:53:57.075 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:53:57.075 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:57.493 INFO:teuthology.orchestra.run.smithi049.stdout:generic/088 0s 2024-01-31T05:53:57.505 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/088 2024-01-31T05:53:57.506 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T05:53:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T05:53:57.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T05:53:57.561 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-01-31T05:53:58.236 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T05:53:58.246 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T05:53:58.246 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:01:25.629 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:01:25.634 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:01:25.920 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-31T06:01:25.924+0000 7fd9fae00640 -1 Fail to open '/proc/131929/cmdline' error = (2) No such file or directory 2024-01-31T06:01:25.921 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-31T06:01:25.924+0000 7fd9fae00640 -1 received signal: Hangup from (PID: 131929) UID: 0 2024-01-31T06:01:25.921 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-31T06:01:25.924+0000 7fab97400640 -1 Fail to open '/proc/131929/cmdline' error = (2) No such file or directory 2024-01-31T06:01:25.921 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-31T06:01:25.924+0000 7fab97400640 -1 received signal: Hangup from (PID: 131929) UID: 0 2024-01-31T06:09:05.535 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:09:05.540 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:09:05.786 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-31T06:09:05.788+0000 7fd9fae00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 133962) UID: 0 2024-01-31T06:09:05.787 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-31T06:09:05.788+0000 7fab97400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 133962) UID: 0 2024-01-31T06:12:18.510 INFO:teuthology.orchestra.run.smithi049.stdout:generic/089 1100s 2024-01-31T06:12:18.653 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/089 2024-01-31T06:12:18.653 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:12:18.659 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:12:18.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:12:18.685 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-01-31T06:12:20.670 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:12:20.679 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:12:20.679 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:12:21.332 INFO:teuthology.orchestra.run.smithi049.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:12:21.340 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/090 2024-01-31T06:12:21.340 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/090 2024-01-31T06:12:21.340 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:12:21.346 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:12:21.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:12:21.367 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-01-31T06:12:21.785 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:12:21.796 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:12:21.796 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:14:45.353 INFO:teuthology.orchestra.run.smithi049.stdout:generic/091 144s 2024-01-31T06:14:45.365 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/091 2024-01-31T06:14:45.365 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:14:45.371 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:14:45.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:14:45.405 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-01-31T06:14:46.084 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:14:46.095 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:14:46.095 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:14:46.467 INFO:teuthology.orchestra.run.smithi049.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-01-31T06:14:46.475 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/092 2024-01-31T06:14:46.476 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/092 2024-01-31T06:14:46.476 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:14:46.482 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:14:46.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:14:46.519 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-01-31T06:14:47.193 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:14:47.203 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:14:47.204 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:14:48.462 INFO:teuthology.orchestra.run.smithi049.stdout:generic/093 1s 2024-01-31T06:14:48.474 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/093 2024-01-31T06:14:48.474 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:14:48.480 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:14:48.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:14:48.508 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-01-31T06:14:49.164 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:14:49.174 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:14:49.174 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:14:49.444 INFO:teuthology.orchestra.run.smithi049.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:14:49.450 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/094 2024-01-31T06:14:49.451 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/094 2024-01-31T06:14:49.451 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:14:49.456 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:14:49.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:14:49.476 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-01-31T06:14:49.856 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:14:49.866 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:14:49.866 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:14:50.128 INFO:teuthology.orchestra.run.smithi049.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:14:50.136 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/095 2024-01-31T06:14:50.137 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/095 2024-01-31T06:14:50.137 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:14:50.142 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:14:50.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:14:50.162 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-01-31T06:14:50.519 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:14:50.529 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:14:50.530 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:14:50.804 INFO:teuthology.orchestra.run.smithi049.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:14:50.812 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/096 2024-01-31T06:14:50.812 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/096 2024-01-31T06:14:50.813 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:14:50.818 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:14:50.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:14:50.838 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-01-31T06:14:51.181 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:14:51.192 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:14:51.192 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:14:52.099 INFO:teuthology.orchestra.run.smithi049.stdout:generic/097 1s 2024-01-31T06:14:52.111 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/097 2024-01-31T06:14:52.112 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:14:52.118 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:14:52.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:14:52.136 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-01-31T06:14:52.495 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:14:52.506 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:14:52.506 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:14:52.792 INFO:teuthology.orchestra.run.smithi049.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:14:52.800 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/098 2024-01-31T06:14:52.800 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/098 2024-01-31T06:14:52.801 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:14:52.806 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:14:52.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:14:52.827 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-01-31T06:14:53.193 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:14:53.203 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:14:53.203 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:14:53.558 INFO:teuthology.orchestra.run.smithi049.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-01-31T06:14:53.566 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/099 2024-01-31T06:14:53.567 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/099 2024-01-31T06:14:53.567 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:14:53.572 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:14:53.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:14:53.592 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-01-31T06:14:53.956 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:14:53.966 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:14:53.966 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:00.361 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:15:00.365 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:15:00.392 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T06:15:00.393+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32946) UID: 0 2024-01-31T06:15:00.393 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T06:15:00.393+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32946) UID: 0 2024-01-31T06:15:00.393 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T06:15:00.393+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32946) UID: 0 2024-01-31T06:15:00.393 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T06:15:00.393+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 32946) UID: 0 2024-01-31T06:15:42.394 INFO:teuthology.orchestra.run.smithi049.stdout:generic/100 49s 2024-01-31T06:15:42.406 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/100 2024-01-31T06:15:42.406 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:15:42.412 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:42.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:15:42.458 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-01-31T06:15:43.408 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:15:43.418 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:15:43.418 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:45.986 INFO:teuthology.orchestra.run.smithi049.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:15:45.995 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/101 2024-01-31T06:15:45.996 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/101 2024-01-31T06:15:45.996 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:15:46.003 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:46.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:15:46.025 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-01-31T06:15:46.391 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:15:46.402 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:15:46.402 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:46.700 INFO:teuthology.orchestra.run.smithi049.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:15:46.708 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/102 2024-01-31T06:15:46.708 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/102 2024-01-31T06:15:46.709 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:15:46.714 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:46.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:15:46.734 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-01-31T06:15:47.092 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:15:47.102 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:15:47.103 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:47.360 INFO:teuthology.orchestra.run.smithi049.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:15:47.368 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/103 2024-01-31T06:15:47.368 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/103 2024-01-31T06:15:47.368 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:15:47.374 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:47.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:15:47.394 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-01-31T06:15:47.747 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:15:47.758 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:15:47.758 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:48.046 INFO:teuthology.orchestra.run.smithi049.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:15:48.054 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/104 2024-01-31T06:15:48.055 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/104 2024-01-31T06:15:48.055 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:15:48.061 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:48.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:15:48.082 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-01-31T06:15:48.431 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:15:48.442 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:15:48.442 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:48.722 INFO:teuthology.orchestra.run.smithi049.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:15:48.730 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/105 2024-01-31T06:15:48.730 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/105 2024-01-31T06:15:48.730 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:15:48.736 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:48.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:15:48.756 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-01-31T06:15:49.121 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:15:49.132 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:15:49.132 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:49.421 INFO:teuthology.orchestra.run.smithi049.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:15:49.429 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/106 2024-01-31T06:15:49.429 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/106 2024-01-31T06:15:49.429 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:15:49.435 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:49.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:15:49.454 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-01-31T06:15:49.812 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:15:49.822 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:15:49.822 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:50.129 INFO:teuthology.orchestra.run.smithi049.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:15:50.137 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/107 2024-01-31T06:15:50.137 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/107 2024-01-31T06:15:50.137 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:15:50.143 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:50.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:15:50.163 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-01-31T06:15:50.533 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:15:50.543 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:15:50.543 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:51.019 INFO:teuthology.orchestra.run.smithi049.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:15:51.027 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/108 2024-01-31T06:15:51.027 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/108 2024-01-31T06:15:51.028 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:15:51.036 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:51.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:15:51.053 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-01-31T06:15:51.399 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:15:51.410 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:15:51.410 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:51.675 INFO:teuthology.orchestra.run.smithi049.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:15:51.683 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/109 2024-01-31T06:15:51.683 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/109 2024-01-31T06:15:51.683 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:15:51.689 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:51.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:15:51.743 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-01-31T06:15:52.108 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:15:52.119 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:15:52.119 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:52.484 INFO:teuthology.orchestra.run.smithi049.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:15:52.493 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/110 2024-01-31T06:15:52.493 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/110 2024-01-31T06:15:52.493 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:15:52.499 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:52.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:15:52.519 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-01-31T06:15:53.179 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:15:53.190 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:15:53.190 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:53.546 INFO:teuthology.orchestra.run.smithi049.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:15:53.554 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/111 2024-01-31T06:15:53.554 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/111 2024-01-31T06:15:53.554 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:15:53.560 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:15:53.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:15:53.592 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-01-31T06:15:54.248 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:15:54.258 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:15:54.258 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:16:44.368 INFO:teuthology.orchestra.run.smithi049.stdout:generic/112 50s 2024-01-31T06:16:44.379 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/112 2024-01-31T06:16:44.380 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:16:44.385 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:16:44.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:16:44.427 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-01-31T06:16:45.080 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:16:45.090 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:16:45.090 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:27.444 INFO:teuthology.orchestra.run.smithi049.stdout:generic/113 42s 2024-01-31T06:17:27.455 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/113 2024-01-31T06:17:27.455 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:17:27.462 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:27.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:17:27.526 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-01-31T06:17:28.223 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:17:28.235 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:17:28.235 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:28.578 INFO:teuthology.orchestra.run.smithi049.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-01-31T06:17:28.586 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/114 2024-01-31T06:17:28.586 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/114 2024-01-31T06:17:28.586 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:17:28.592 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:28.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:17:28.611 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-01-31T06:17:28.965 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:17:28.975 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:17:28.975 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:29.551 INFO:teuthology.orchestra.run.smithi049.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:17:29.559 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/115 2024-01-31T06:17:29.559 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/115 2024-01-31T06:17:29.559 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:17:29.565 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:29.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:17:29.605 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-01-31T06:17:30.247 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:17:30.258 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:17:30.259 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:30.595 INFO:teuthology.orchestra.run.smithi049.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:17:30.602 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/116 2024-01-31T06:17:30.603 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/116 2024-01-31T06:17:30.603 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:17:30.611 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:30.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:17:30.649 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-01-31T06:17:31.292 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:17:31.302 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:17:31.303 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:31.568 INFO:teuthology.orchestra.run.smithi049.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:17:31.575 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/117 2024-01-31T06:17:31.576 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/117 2024-01-31T06:17:31.576 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:17:31.582 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:31.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:17:31.602 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-01-31T06:17:31.971 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:17:31.981 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:17:31.982 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:32.327 INFO:teuthology.orchestra.run.smithi049.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:17:32.335 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/118 2024-01-31T06:17:32.335 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/118 2024-01-31T06:17:32.335 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:17:32.341 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:32.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:17:32.381 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-01-31T06:17:33.048 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:17:33.058 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:17:33.058 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:33.420 INFO:teuthology.orchestra.run.smithi049.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:17:33.428 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/119 2024-01-31T06:17:33.428 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/119 2024-01-31T06:17:33.428 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:17:33.433 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:33.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:17:33.488 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-01-31T06:17:34.123 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:17:34.140 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:17:34.140 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:34.392 INFO:teuthology.orchestra.run.smithi049.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:17:34.400 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/120 2024-01-31T06:17:34.401 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/120 2024-01-31T06:17:34.401 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:17:34.406 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:34.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:17:34.425 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-01-31T06:17:34.783 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:17:34.794 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:17:34.794 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:35.152 INFO:teuthology.orchestra.run.smithi049.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-01-31T06:17:35.164 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/121 2024-01-31T06:17:35.164 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/121 2024-01-31T06:17:35.164 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:17:35.167 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:35.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:17:35.201 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-01-31T06:17:35.888 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:17:35.898 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:17:35.898 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:36.242 INFO:teuthology.orchestra.run.smithi049.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-01-31T06:17:36.251 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/122 2024-01-31T06:17:36.251 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/122 2024-01-31T06:17:36.251 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:17:36.257 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:36.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:17:36.309 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-01-31T06:17:36.940 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:17:36.951 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:17:36.951 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:37.704 INFO:teuthology.orchestra.run.smithi049.stdout:generic/123 1s 2024-01-31T06:17:37.714 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/123 2024-01-31T06:17:37.714 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:17:37.720 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:37.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:17:37.745 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-01-31T06:17:38.423 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:17:38.433 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:17:38.433 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:38.707 INFO:teuthology.orchestra.run.smithi049.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:17:38.716 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/124 2024-01-31T06:17:38.716 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/124 2024-01-31T06:17:38.716 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:17:38.722 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:17:38.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:17:38.741 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-01-31T06:17:39.104 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:17:39.114 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:17:39.114 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:18:11.452 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:18:11.457 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:18:11.486 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T06:18:11.485+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33010) UID: 0 2024-01-31T06:18:11.487 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T06:18:11.489+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33010) UID: 0 2024-01-31T06:18:11.487 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T06:18:11.485+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33010) UID: 0 2024-01-31T06:18:11.487 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T06:18:11.489+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33010) UID: 0 2024-01-31T06:18:40.799 INFO:teuthology.orchestra.run.smithi049.stdout:generic/125 61s 2024-01-31T06:18:40.812 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/125 2024-01-31T06:18:40.812 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:18:40.820 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:18:40.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:18:40.866 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-01-31T06:18:41.500 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:18:41.510 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:18:41.510 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:18:42.320 INFO:teuthology.orchestra.run.smithi049.stdout:generic/126 - output mismatch (see /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/126.out.bad) 2024-01-31T06:18:42.325 INFO:teuthology.orchestra.run.smithi049.stdout: --- tests/generic/126.out 2024-01-31 05:06:00.867952739 +0000 2024-01-31T06:18:42.326 INFO:teuthology.orchestra.run.smithi049.stdout: +++ /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/126.out.bad 2024-01-31 06:18:42.316975333 +0000 2024-01-31T06:18:42.326 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -1,7 +1,7 @@ 2024-01-31T06:18:42.326 INFO:teuthology.orchestra.run.smithi049.stdout: QA output created by 126 2024-01-31T06:18:42.326 INFO:teuthology.orchestra.run.smithi049.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2024-01-31T06:18:42.326 INFO:teuthology.orchestra.run.smithi049.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2024-01-31T06:18:42.326 INFO:teuthology.orchestra.run.smithi049.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2024-01-31T06:18:42.326 INFO:teuthology.orchestra.run.smithi049.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2024-01-31T06:18:42.326 INFO:teuthology.orchestra.run.smithi049.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2024-01-31T06:18:42.326 INFO:teuthology.orchestra.run.smithi049.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2024-01-31T06:18:42.326 INFO:teuthology.orchestra.run.smithi049.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2024-01-31T06:18:42.326 INFO:teuthology.orchestra.run.smithi049.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2024-01-31T06:18:42.326 INFO:teuthology.orchestra.run.smithi049.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2024-01-31T06:18:42.337 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/126 2024-01-31T06:18:42.337 INFO:teuthology.orchestra.run.smithi049.stdout:Failures: generic/126 2024-01-31T06:18:42.337 INFO:teuthology.orchestra.run.smithi049.stdout:Failed 1 of 1 tests 2024-01-31T06:18:42.383 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:18:42.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T06:18:42.420 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-01-31T06:18:42.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-01-31T06:18:42.421 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-01-31T06:18:43.071 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:18:43.082 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:18:43.082 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:21:06.042 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:21:06.047 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:21:36.137 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:21:36.141 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:22:06.193 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:22:06.197 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:22:36.275 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:22:36.279 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:23:06.348 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:23:06.352 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:23:36.420 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:23:36.425 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:24:06.494 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:24:06.499 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:24:36.567 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:24:36.571 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:25:07.717 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:25:07.721 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:25:37.773 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:25:37.777 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:26:08.100 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:26:08.104 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:26:38.213 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:26:38.218 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:27:08.272 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:27:08.276 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:27:38.480 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:27:38.488 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:28:08.544 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:28:08.550 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:28:38.607 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:28:38.611 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:29:08.665 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:29:08.669 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:29:38.727 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:29:38.731 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:30:08.803 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:30:08.808 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:30:38.893 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:30:38.897 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:31:09.024 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:31:09.028 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:31:09.055 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T06:31:09.056+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33104) UID: 0 2024-01-31T06:31:09.055 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T06:31:09.056+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33104) UID: 0 2024-01-31T06:31:09.056 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T06:31:09.056+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33104) UID: 0 2024-01-31T06:31:09.056 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T06:31:09.056+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33104) UID: 0 2024-01-31T06:33:22.418 INFO:teuthology.orchestra.run.smithi049.stdout:generic/127 879s 2024-01-31T06:33:22.429 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/127 2024-01-31T06:33:22.429 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:33:22.435 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:33:22.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:33:22.461 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-01-31T06:33:23.265 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:33:23.275 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:33:23.275 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:33:24.544 INFO:teuthology.orchestra.run.smithi049.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:33:24.551 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/128 2024-01-31T06:33:24.551 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/128 2024-01-31T06:33:24.551 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:33:24.558 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:33:24.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:33:24.576 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-01-31T06:33:24.940 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:33:24.950 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:33:24.950 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:33:25.223 INFO:teuthology.orchestra.run.smithi049.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:33:25.232 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/129 2024-01-31T06:33:25.233 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/129 2024-01-31T06:33:25.233 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:33:25.238 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:33:25.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:33:25.259 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-01-31T06:33:25.617 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:33:25.628 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:33:25.628 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:33:25.882 INFO:teuthology.orchestra.run.smithi049.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:33:25.890 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/130 2024-01-31T06:33:25.890 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/130 2024-01-31T06:33:25.890 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:33:25.896 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:33:25.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:33:25.915 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-01-31T06:33:26.275 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:33:26.286 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:33:26.286 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:33:27.797 INFO:teuthology.orchestra.run.smithi049.stdout:generic/131 1s 2024-01-31T06:33:27.809 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/131 2024-01-31T06:33:27.809 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:33:27.815 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:33:27.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:33:27.858 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-01-31T06:33:28.518 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:33:28.528 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:33:28.529 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:33:28.796 INFO:teuthology.orchestra.run.smithi049.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:33:28.804 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/132 2024-01-31T06:33:28.804 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/132 2024-01-31T06:33:28.804 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:33:28.810 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:33:28.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:33:28.829 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-01-31T06:33:29.175 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:33:29.185 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:33:29.185 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:34:09.297 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:34:09.302 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:34:39.699 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:34:39.704 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:34:39.754 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T06:34:39.751+0000 7f96ce200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 167339) UID: 0 2024-01-31T06:34:39.755 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T06:34:39.751+0000 7f91cc000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 167339) UID: 0 2024-01-31T06:34:39.755 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T06:34:39.751+0000 7f4aaf800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 167339) UID: 0 2024-01-31T06:34:39.755 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T06:34:39.751+0000 7f79d2800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 167339) UID: 0 2024-01-31T06:37:42.821 INFO:teuthology.orchestra.run.smithi049.stdout:generic/133 253s 2024-01-31T06:37:42.870 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/133 2024-01-31T06:37:42.870 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:37:42.876 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:42.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:37:42.987 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-01-31T06:37:43.855 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:37:43.865 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:37:43.865 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:44.269 INFO:teuthology.orchestra.run.smithi049.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:37:44.277 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/134 2024-01-31T06:37:44.277 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/134 2024-01-31T06:37:44.277 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:37:44.283 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:44.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:37:44.323 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-01-31T06:37:44.959 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:37:44.970 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:37:44.970 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:45.314 INFO:teuthology.orchestra.run.smithi049.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:37:45.322 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/135 2024-01-31T06:37:45.322 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/135 2024-01-31T06:37:45.323 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:37:45.328 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:45.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:37:45.347 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-01-31T06:37:45.736 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:37:45.746 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:37:45.746 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:46.093 INFO:teuthology.orchestra.run.smithi049.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-01-31T06:37:46.101 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/136 2024-01-31T06:37:46.101 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/136 2024-01-31T06:37:46.102 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:37:46.108 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:46.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:37:46.167 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-01-31T06:37:46.844 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:37:46.854 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:37:46.854 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:47.196 INFO:teuthology.orchestra.run.smithi049.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:37:47.204 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/137 2024-01-31T06:37:47.204 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/137 2024-01-31T06:37:47.204 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:37:47.210 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:47.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:37:47.247 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-01-31T06:37:47.944 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:37:47.954 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:37:47.954 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:48.303 INFO:teuthology.orchestra.run.smithi049.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:37:48.311 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/138 2024-01-31T06:37:48.311 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/138 2024-01-31T06:37:48.311 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:37:48.317 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:48.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:37:48.342 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-01-31T06:37:49.007 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:37:49.017 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:37:49.018 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:49.363 INFO:teuthology.orchestra.run.smithi049.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:37:49.371 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/139 2024-01-31T06:37:49.371 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/139 2024-01-31T06:37:49.371 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:37:49.377 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:49.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:37:49.511 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-01-31T06:37:50.096 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:37:50.106 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:37:50.106 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:50.457 INFO:teuthology.orchestra.run.smithi049.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:37:50.466 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/140 2024-01-31T06:37:50.466 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/140 2024-01-31T06:37:50.466 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:37:50.472 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:50.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:37:50.625 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-01-31T06:37:51.188 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:37:51.198 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:37:51.198 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:51.461 INFO:teuthology.orchestra.run.smithi049.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:37:51.469 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/141 2024-01-31T06:37:51.469 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/141 2024-01-31T06:37:51.469 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:37:51.475 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:51.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:37:51.493 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-01-31T06:37:51.864 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:37:51.874 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:37:51.874 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:52.235 INFO:teuthology.orchestra.run.smithi049.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:37:52.243 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/142 2024-01-31T06:37:52.243 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/142 2024-01-31T06:37:52.243 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:37:52.249 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:52.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:37:52.426 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-01-31T06:37:52.428 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:37:52.486 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:37:52.614 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T06:37:52.613+0000 7f4aaf800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 171239) UID: 0 2024-01-31T06:37:52.615 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T06:37:52.613+0000 7f96ce200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 171239) UID: 0 2024-01-31T06:37:52.618 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T06:37:52.617+0000 7f79d2800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 171239) UID: 0 2024-01-31T06:37:52.619 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T06:37:52.617+0000 7f91cc000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 171239) UID: 0 2024-01-31T06:37:52.985 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:37:52.995 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:37:52.995 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:53.350 INFO:teuthology.orchestra.run.smithi049.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:37:53.358 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/143 2024-01-31T06:37:53.358 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/143 2024-01-31T06:37:53.358 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:37:53.364 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:53.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:37:53.430 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-01-31T06:37:54.088 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:37:54.099 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:37:54.099 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:54.449 INFO:teuthology.orchestra.run.smithi049.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:37:54.458 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/144 2024-01-31T06:37:54.458 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/144 2024-01-31T06:37:54.458 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:37:54.465 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:54.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:37:54.516 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-01-31T06:37:55.223 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:37:55.233 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:37:55.233 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:55.582 INFO:teuthology.orchestra.run.smithi049.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:37:55.591 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/145 2024-01-31T06:37:55.591 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/145 2024-01-31T06:37:55.591 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:37:55.598 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:55.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:37:55.633 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-01-31T06:37:56.326 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:37:56.336 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:37:56.336 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:56.714 INFO:teuthology.orchestra.run.smithi049.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:37:56.722 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/146 2024-01-31T06:37:56.722 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/146 2024-01-31T06:37:56.723 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:37:56.728 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:56.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:37:56.795 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-01-31T06:37:57.452 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:37:57.462 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:37:57.462 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:57.798 INFO:teuthology.orchestra.run.smithi049.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:37:57.806 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/147 2024-01-31T06:37:57.806 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/147 2024-01-31T06:37:57.806 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:37:57.812 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:57.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:37:57.850 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-01-31T06:37:58.507 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:37:58.517 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:37:58.517 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:59.168 INFO:teuthology.orchestra.run.smithi049.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:37:59.177 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/148 2024-01-31T06:37:59.177 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/148 2024-01-31T06:37:59.177 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:37:59.183 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:37:59.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:37:59.230 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-01-31T06:37:59.934 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:37:59.944 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:37:59.944 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:00.292 INFO:teuthology.orchestra.run.smithi049.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:38:00.300 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/149 2024-01-31T06:38:00.300 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/149 2024-01-31T06:38:00.300 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:00.306 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:00.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:00.372 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-01-31T06:38:01.066 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:01.076 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:01.076 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:01.420 INFO:teuthology.orchestra.run.smithi049.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:38:01.428 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/150 2024-01-31T06:38:01.428 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/150 2024-01-31T06:38:01.428 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:01.434 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:01.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:01.529 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-01-31T06:38:02.171 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:02.182 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:02.182 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:02.546 INFO:teuthology.orchestra.run.smithi049.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:38:02.554 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/151 2024-01-31T06:38:02.554 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/151 2024-01-31T06:38:02.554 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:02.560 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:02.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:02.591 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-01-31T06:38:03.303 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:03.314 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:03.314 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:03.670 INFO:teuthology.orchestra.run.smithi049.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:38:03.678 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/152 2024-01-31T06:38:03.678 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/152 2024-01-31T06:38:03.678 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:03.684 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:03.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:03.759 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-01-31T06:38:04.415 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:04.425 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:04.425 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:04.778 INFO:teuthology.orchestra.run.smithi049.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:38:04.786 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/153 2024-01-31T06:38:04.786 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/153 2024-01-31T06:38:04.787 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:04.792 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:04.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:04.818 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-01-31T06:38:05.515 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:05.525 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:05.525 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:05.880 INFO:teuthology.orchestra.run.smithi049.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:38:05.888 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/154 2024-01-31T06:38:05.889 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/154 2024-01-31T06:38:05.889 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:05.895 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:05.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:05.948 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-01-31T06:38:06.633 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:06.643 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:06.643 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:06.998 INFO:teuthology.orchestra.run.smithi049.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:38:07.009 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/155 2024-01-31T06:38:07.009 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/155 2024-01-31T06:38:07.009 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:07.012 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:07.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:07.059 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-01-31T06:38:07.763 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:07.773 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:07.773 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:08.128 INFO:teuthology.orchestra.run.smithi049.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:38:08.136 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/156 2024-01-31T06:38:08.136 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/156 2024-01-31T06:38:08.136 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:08.142 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:08.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:08.186 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-01-31T06:38:08.863 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:08.873 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:08.873 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:09.236 INFO:teuthology.orchestra.run.smithi049.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:38:09.245 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/157 2024-01-31T06:38:09.245 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/157 2024-01-31T06:38:09.245 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:09.251 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:09.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:09.284 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-01-31T06:38:09.959 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:09.969 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:09.970 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:10.332 INFO:teuthology.orchestra.run.smithi049.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-01-31T06:38:10.340 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/158 2024-01-31T06:38:10.340 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/158 2024-01-31T06:38:10.340 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:10.346 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:10.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:10.410 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-01-31T06:38:11.075 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:11.086 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:11.086 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:11.439 INFO:teuthology.orchestra.run.smithi049.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-01-31T06:38:11.447 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/159 2024-01-31T06:38:11.447 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/159 2024-01-31T06:38:11.447 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:11.453 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:11.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:11.473 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-01-31T06:38:11.840 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:11.850 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:11.850 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:12.166 INFO:teuthology.orchestra.run.smithi049.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-01-31T06:38:12.175 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/160 2024-01-31T06:38:12.175 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/160 2024-01-31T06:38:12.175 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:12.181 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:12.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:12.200 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-01-31T06:38:12.571 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:12.581 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:12.582 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:12.866 INFO:teuthology.orchestra.run.smithi049.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:12.874 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/161 2024-01-31T06:38:12.874 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/161 2024-01-31T06:38:12.874 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:12.880 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:12.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:12.901 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-01-31T06:38:13.264 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:13.274 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:13.274 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:13.539 INFO:teuthology.orchestra.run.smithi049.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:13.548 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/162 2024-01-31T06:38:13.548 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/162 2024-01-31T06:38:13.548 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:13.554 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:13.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:13.574 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-01-31T06:38:13.943 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:13.953 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:13.953 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:14.252 INFO:teuthology.orchestra.run.smithi049.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:14.260 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/163 2024-01-31T06:38:14.260 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/163 2024-01-31T06:38:14.260 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:14.266 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:14.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:14.307 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-01-31T06:38:14.662 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:14.672 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:14.672 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:14.975 INFO:teuthology.orchestra.run.smithi049.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:14.983 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/164 2024-01-31T06:38:14.983 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/164 2024-01-31T06:38:14.983 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:14.989 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:15.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:15.009 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-01-31T06:38:15.384 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:15.395 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:15.395 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:15.664 INFO:teuthology.orchestra.run.smithi049.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:15.673 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/165 2024-01-31T06:38:15.673 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/165 2024-01-31T06:38:15.673 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:15.679 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:15.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:15.698 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-01-31T06:38:16.062 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:16.072 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:16.072 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:16.350 INFO:teuthology.orchestra.run.smithi049.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:16.359 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/166 2024-01-31T06:38:16.359 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/166 2024-01-31T06:38:16.359 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:16.364 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:16.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:16.384 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-01-31T06:38:16.740 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:16.750 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:16.750 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:17.021 INFO:teuthology.orchestra.run.smithi049.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:17.030 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/167 2024-01-31T06:38:17.030 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/167 2024-01-31T06:38:17.030 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:17.036 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:17.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:17.055 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-01-31T06:38:17.456 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:17.467 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:17.467 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:17.740 INFO:teuthology.orchestra.run.smithi049.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:17.748 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/168 2024-01-31T06:38:17.749 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/168 2024-01-31T06:38:17.749 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:17.755 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:17.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:17.775 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-01-31T06:38:18.156 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:18.164 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:18.164 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:18.425 INFO:teuthology.orchestra.run.smithi049.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:18.433 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/169 2024-01-31T06:38:18.433 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/169 2024-01-31T06:38:18.433 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:18.439 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:18.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:18.458 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-01-31T06:38:18.813 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:18.823 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:18.823 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:19.100 INFO:teuthology.orchestra.run.smithi049.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:19.109 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/170 2024-01-31T06:38:19.109 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/170 2024-01-31T06:38:19.109 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:19.115 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:19.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:19.136 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-01-31T06:38:19.503 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:19.513 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:19.513 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:19.828 INFO:teuthology.orchestra.run.smithi049.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:19.836 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/171 2024-01-31T06:38:19.836 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/171 2024-01-31T06:38:19.836 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:19.842 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:19.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:19.862 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-01-31T06:38:20.243 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:20.253 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:20.253 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:20.525 INFO:teuthology.orchestra.run.smithi049.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:20.533 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/172 2024-01-31T06:38:20.533 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/172 2024-01-31T06:38:20.533 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:20.539 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:20.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:20.558 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-01-31T06:38:20.933 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:20.943 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:20.943 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:21.216 INFO:teuthology.orchestra.run.smithi049.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:21.224 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/173 2024-01-31T06:38:21.225 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/173 2024-01-31T06:38:21.225 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:21.232 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:21.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:21.252 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-01-31T06:38:21.638 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:21.648 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:21.649 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:21.920 INFO:teuthology.orchestra.run.smithi049.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:21.928 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/174 2024-01-31T06:38:21.928 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/174 2024-01-31T06:38:21.928 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:21.934 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:21.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:21.954 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-01-31T06:38:22.316 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:22.326 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:22.327 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:22.627 INFO:teuthology.orchestra.run.smithi049.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:22.635 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/175 2024-01-31T06:38:22.635 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/175 2024-01-31T06:38:22.635 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:22.641 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:22.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:22.661 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-01-31T06:38:23.019 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:23.029 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:23.029 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:23.284 INFO:teuthology.orchestra.run.smithi049.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:23.292 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/176 2024-01-31T06:38:23.292 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/176 2024-01-31T06:38:23.292 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:23.298 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:23.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:23.375 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-01-31T06:38:23.735 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:23.745 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:23.746 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:24.145 INFO:teuthology.orchestra.run.smithi049.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:24.153 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/177 2024-01-31T06:38:24.153 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/177 2024-01-31T06:38:24.153 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:24.159 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:24.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:24.178 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-01-31T06:38:24.558 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:24.568 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:24.568 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:24.911 INFO:teuthology.orchestra.run.smithi049.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:38:24.919 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/178 2024-01-31T06:38:24.919 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/178 2024-01-31T06:38:24.919 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:24.925 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:25.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:25.133 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-01-31T06:38:25.625 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:25.639 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:25.639 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:26.056 INFO:teuthology.orchestra.run.smithi049.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:38:26.064 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/179 2024-01-31T06:38:26.064 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/179 2024-01-31T06:38:26.065 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:26.071 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:26.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:26.098 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-01-31T06:38:26.809 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:26.819 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:26.820 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:27.163 INFO:teuthology.orchestra.run.smithi049.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:38:27.171 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/180 2024-01-31T06:38:27.171 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/180 2024-01-31T06:38:27.171 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:27.177 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:27.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:27.231 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-01-31T06:38:27.895 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:27.905 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:27.905 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:28.263 INFO:teuthology.orchestra.run.smithi049.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:38:28.272 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/181 2024-01-31T06:38:28.272 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/181 2024-01-31T06:38:28.272 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:28.279 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:28.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:28.467 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-01-31T06:38:28.992 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:29.002 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:29.002 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:29.363 INFO:teuthology.orchestra.run.smithi049.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-01-31T06:38:29.372 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/182 2024-01-31T06:38:29.372 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/182 2024-01-31T06:38:29.373 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:29.379 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:29.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:29.428 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-01-31T06:38:30.107 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:30.117 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:30.117 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:30.405 INFO:teuthology.orchestra.run.smithi049.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:30.413 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/183 2024-01-31T06:38:30.413 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/183 2024-01-31T06:38:30.414 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:30.420 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:30.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:30.439 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-01-31T06:38:30.808 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:30.818 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:30.818 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:31.471 INFO:teuthology.orchestra.run.smithi049.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/184.out.bad) 2024-01-31T06:38:31.477 INFO:teuthology.orchestra.run.smithi049.stdout: --- tests/generic/184.out 2024-01-31 05:06:00.875952573 +0000 2024-01-31T06:38:31.477 INFO:teuthology.orchestra.run.smithi049.stdout: +++ /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/184.out.bad 2024-01-31 06:38:31.452849782 +0000 2024-01-31T06:38:31.477 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -1 +1,2 @@ 2024-01-31T06:38:31.477 INFO:teuthology.orchestra.run.smithi049.stdout: QA output created by 184 2024-01-31T06:38:31.477 INFO:teuthology.orchestra.run.smithi049.stdout: +/tmp/tmp.MqKNGSMQ15xfstests-dev/tests/generic/184: line 23: /tmp/tmp.ULOG6qSi2atest/null: Permission denied 2024-01-31T06:38:31.482 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/184 2024-01-31T06:38:31.482 INFO:teuthology.orchestra.run.smithi049.stdout:Failures: generic/184 2024-01-31T06:38:31.482 INFO:teuthology.orchestra.run.smithi049.stdout:Failed 1 of 1 tests 2024-01-31T06:38:31.489 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:31.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T06:38:31.508 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-01-31T06:38:31.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-01-31T06:38:31.509 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-01-31T06:38:31.883 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:31.894 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:31.894 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:32.181 INFO:teuthology.orchestra.run.smithi049.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:32.189 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/185 2024-01-31T06:38:32.189 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/185 2024-01-31T06:38:32.189 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:32.195 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:32.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:32.215 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-01-31T06:38:32.584 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:32.594 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:32.594 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:33.128 INFO:teuthology.orchestra.run.smithi049.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:33.136 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/186 2024-01-31T06:38:33.136 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/186 2024-01-31T06:38:33.136 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:33.142 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:33.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:33.162 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-01-31T06:38:33.519 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:33.530 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:33.530 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:33.807 INFO:teuthology.orchestra.run.smithi049.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:33.815 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/187 2024-01-31T06:38:33.815 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/187 2024-01-31T06:38:33.816 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:33.821 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:33.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:33.841 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-01-31T06:38:34.200 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:34.210 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:34.210 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:34.492 INFO:teuthology.orchestra.run.smithi049.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:34.500 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/188 2024-01-31T06:38:34.500 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/188 2024-01-31T06:38:34.500 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:34.506 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:34.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:34.526 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-01-31T06:38:34.893 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:34.903 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:34.904 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:35.177 INFO:teuthology.orchestra.run.smithi049.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:35.185 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/189 2024-01-31T06:38:35.185 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/189 2024-01-31T06:38:35.185 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:35.191 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:35.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:35.210 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-01-31T06:38:35.575 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:35.585 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:35.585 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:35.868 INFO:teuthology.orchestra.run.smithi049.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:35.877 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/190 2024-01-31T06:38:35.877 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/190 2024-01-31T06:38:35.877 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:35.883 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:35.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:35.902 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-01-31T06:38:36.260 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:36.270 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:36.271 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:36.549 INFO:teuthology.orchestra.run.smithi049.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:36.557 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/191 2024-01-31T06:38:36.557 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/191 2024-01-31T06:38:36.557 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:36.563 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:36.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:36.582 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-01-31T06:38:36.965 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:36.975 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:36.975 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:37.271 INFO:teuthology.orchestra.run.smithi049.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2024-01-31T06:38:37.279 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/192 2024-01-31T06:38:37.279 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/192 2024-01-31T06:38:37.279 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:37.285 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:37.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:37.340 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-01-31T06:38:37.704 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:37.715 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:37.715 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:39.830 INFO:teuthology.orchestra.run.smithi049.stdout:generic/193 - output mismatch (see /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/193.out.bad) 2024-01-31T06:38:39.836 INFO:teuthology.orchestra.run.smithi049.stdout: --- tests/generic/193.out 2024-01-31 05:06:00.875952573 +0000 2024-01-31T06:38:39.836 INFO:teuthology.orchestra.run.smithi049.stdout: +++ /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/193.out.bad 2024-01-31 06:38:39.824614500 +0000 2024-01-31T06:38:39.836 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -24,7 +24,6 @@ 2024-01-31T06:38:39.836 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:39.836 INFO:teuthology.orchestra.run.smithi049.stdout: user: chmod a+r on qa_user owned file (should succeed) 2024-01-31T06:38:39.836 INFO:teuthology.orchestra.run.smithi049.stdout: user: chmod a+r on root owned file (should fail) 2024-01-31T06:38:39.836 INFO:teuthology.orchestra.run.smithi049.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2024-01-31T06:38:39.836 INFO:teuthology.orchestra.run.smithi049.stdout: check that the sgid bit is cleared 2024-01-31T06:38:39.836 INFO:teuthology.orchestra.run.smithi049.stdout: -rw-rw-rw- 2024-01-31T06:38:39.836 INFO:teuthology.orchestra.run.smithi049.stdout: check that suid bit is not cleared 2024-01-31T06:38:39.841 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/193 2024-01-31T06:38:39.841 INFO:teuthology.orchestra.run.smithi049.stdout:Failures: generic/193 2024-01-31T06:38:39.841 INFO:teuthology.orchestra.run.smithi049.stdout:Failed 1 of 1 tests 2024-01-31T06:38:39.847 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:39.905 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T06:38:39.906 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-01-31T06:38:39.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-01-31T06:38:39.907 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-01-31T06:38:40.572 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:40.582 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:40.582 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:40.883 INFO:teuthology.orchestra.run.smithi049.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:40.891 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/194 2024-01-31T06:38:40.891 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/194 2024-01-31T06:38:40.891 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:40.897 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:40.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:40.917 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-01-31T06:38:41.292 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:41.302 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:41.302 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:41.586 INFO:teuthology.orchestra.run.smithi049.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:41.594 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/195 2024-01-31T06:38:41.595 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/195 2024-01-31T06:38:41.595 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:41.601 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:41.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:41.644 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-01-31T06:38:42.010 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:42.020 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:42.021 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:42.306 INFO:teuthology.orchestra.run.smithi049.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:42.314 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/196 2024-01-31T06:38:42.314 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/196 2024-01-31T06:38:42.315 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:42.320 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:42.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:42.340 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-01-31T06:38:42.711 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:42.721 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:42.721 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:43.000 INFO:teuthology.orchestra.run.smithi049.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:43.008 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/197 2024-01-31T06:38:43.008 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/197 2024-01-31T06:38:43.008 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:43.014 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:43.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:43.035 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-01-31T06:38:43.403 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:43.413 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:43.413 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:44.898 INFO:teuthology.orchestra.run.smithi049.stdout:generic/198 1s 2024-01-31T06:38:44.911 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/198 2024-01-31T06:38:44.911 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:44.917 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:44.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:44.938 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-01-31T06:38:45.663 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:45.681 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:45.681 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:45.976 INFO:teuthology.orchestra.run.smithi049.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:45.984 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/199 2024-01-31T06:38:45.984 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/199 2024-01-31T06:38:45.984 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:45.990 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:46.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:46.010 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-01-31T06:38:46.396 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:46.406 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:46.406 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:46.668 INFO:teuthology.orchestra.run.smithi049.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:46.677 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/200 2024-01-31T06:38:46.677 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/200 2024-01-31T06:38:46.677 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:46.683 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:46.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:46.702 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-01-31T06:38:47.069 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:47.079 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:47.079 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:47.340 INFO:teuthology.orchestra.run.smithi049.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:47.349 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/201 2024-01-31T06:38:47.349 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/201 2024-01-31T06:38:47.349 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:47.355 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:47.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:47.408 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-01-31T06:38:47.779 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:47.790 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:47.790 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:48.073 INFO:teuthology.orchestra.run.smithi049.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:48.081 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/202 2024-01-31T06:38:48.081 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/202 2024-01-31T06:38:48.081 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:48.087 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:48.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:48.139 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-01-31T06:38:48.499 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:48.509 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:48.509 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:48.775 INFO:teuthology.orchestra.run.smithi049.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:48.783 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/203 2024-01-31T06:38:48.783 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/203 2024-01-31T06:38:48.783 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:48.789 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:48.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:48.808 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-01-31T06:38:49.177 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:49.187 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:49.187 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:51.159 INFO:teuthology.orchestra.run.smithi049.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:51.168 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/204 2024-01-31T06:38:51.168 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/204 2024-01-31T06:38:51.168 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:51.175 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:51.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:51.197 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-01-31T06:38:51.577 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:51.587 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:51.587 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:51.856 INFO:teuthology.orchestra.run.smithi049.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:51.865 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/205 2024-01-31T06:38:51.865 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/205 2024-01-31T06:38:51.865 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:51.872 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:51.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:51.893 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-01-31T06:38:52.282 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:52.292 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:52.292 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:52.579 INFO:teuthology.orchestra.run.smithi049.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:38:52.588 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/206 2024-01-31T06:38:52.588 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/206 2024-01-31T06:38:52.588 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:38:52.595 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:38:52.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:38:52.614 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-01-31T06:38:52.979 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:38:52.990 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:38:52.990 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:39:13.747 INFO:teuthology.orchestra.run.smithi049.stdout:generic/207 20s 2024-01-31T06:39:13.759 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/207 2024-01-31T06:39:13.759 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:39:13.765 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:39:13.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:39:13.808 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-01-31T06:39:14.511 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:39:14.522 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:39:14.522 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:41:17.469 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:41:17.474 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:41:47.548 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:41:47.553 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:42:17.604 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:42:17.609 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:42:35.113 INFO:teuthology.orchestra.run.smithi049.stdout:generic/208 201s 2024-01-31T06:42:35.136 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/208 2024-01-31T06:42:35.136 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:42:35.142 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:35.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:42:35.232 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-01-31T06:42:35.904 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:42:35.915 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:42:35.915 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:45.473 INFO:teuthology.orchestra.run.smithi049.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/209.out.bad) 2024-01-31T06:42:45.502 INFO:teuthology.orchestra.run.smithi049.stdout: --- tests/generic/209.out 2024-01-31 05:06:00.875952573 +0000 2024-01-31T06:42:45.502 INFO:teuthology.orchestra.run.smithi049.stdout: +++ /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/209.out.bad 2024-01-31 06:42:45.453817960 +0000 2024-01-31T06:42:45.502 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -1,2 +1,2 @@ 2024-01-31T06:42:45.502 INFO:teuthology.orchestra.run.smithi049.stdout: QA output created by 209 2024-01-31T06:42:45.502 INFO:teuthology.orchestra.run.smithi049.stdout: -test ran for 30 seconds without error 2024-01-31T06:42:45.502 INFO:teuthology.orchestra.run.smithi049.stdout: +reader found old byte at pos 4096 2024-01-31T06:42:45.502 INFO:teuthology.orchestra.run.smithi049.stdout: \ No newline at end of file 2024-01-31T06:42:45.522 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/209 2024-01-31T06:42:45.522 INFO:teuthology.orchestra.run.smithi049.stdout:Failures: generic/209 2024-01-31T06:42:45.522 INFO:teuthology.orchestra.run.smithi049.stdout:Failed 1 of 1 tests 2024-01-31T06:42:45.563 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:45.641 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T06:42:45.642 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-01-31T06:42:45.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-01-31T06:42:45.642 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-01-31T06:42:46.092 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:42:46.102 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:42:46.102 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:46.633 INFO:teuthology.orchestra.run.smithi049.stdout:generic/210 0s 2024-01-31T06:42:46.645 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/210 2024-01-31T06:42:46.645 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:42:46.651 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:46.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:42:46.709 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-01-31T06:42:47.349 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:42:47.359 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:42:47.359 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:48.142 INFO:teuthology.orchestra.run.smithi049.stdout:generic/211 1s 2024-01-31T06:42:48.154 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/211 2024-01-31T06:42:48.154 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:42:48.161 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:48.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:42:48.180 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-01-31T06:42:48.285 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:42:48.289 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:42:48.527 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:42:48.537 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:42:48.537 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:48.969 INFO:teuthology.orchestra.run.smithi049.stdout:generic/212 0s 2024-01-31T06:42:48.981 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/212 2024-01-31T06:42:48.981 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:42:48.987 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:49.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:42:49.006 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-01-31T06:42:49.364 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:42:49.374 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:42:49.374 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:50.012 INFO:teuthology.orchestra.run.smithi049.stdout:generic/213 - output mismatch (see /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/213.out.bad) 2024-01-31T06:42:50.017 INFO:teuthology.orchestra.run.smithi049.stdout: --- tests/generic/213.out 2024-01-31 05:06:00.879952488 +0000 2024-01-31T06:42:50.017 INFO:teuthology.orchestra.run.smithi049.stdout: +++ /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/213.out.bad 2024-01-31 06:42:50.009693690 +0000 2024-01-31T06:42:50.017 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -1,4 +1,3 @@ 2024-01-31T06:42:50.018 INFO:teuthology.orchestra.run.smithi049.stdout: QA output created by 213 2024-01-31T06:42:50.018 INFO:teuthology.orchestra.run.smithi049.stdout: We should get: fallocate: No space left on device 2024-01-31T06:42:50.018 INFO:teuthology.orchestra.run.smithi049.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2024-01-31T06:42:50.018 INFO:teuthology.orchestra.run.smithi049.stdout: -fallocate: No space left on device 2024-01-31T06:42:50.022 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/213 2024-01-31T06:42:50.023 INFO:teuthology.orchestra.run.smithi049.stdout:Failures: generic/213 2024-01-31T06:42:50.023 INFO:teuthology.orchestra.run.smithi049.stdout:Failed 1 of 1 tests 2024-01-31T06:42:50.029 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:50.066 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T06:42:50.066 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-01-31T06:42:50.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-01-31T06:42:50.067 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-01-31T06:42:50.720 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:42:50.730 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:42:50.730 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:51.637 INFO:teuthology.orchestra.run.smithi049.stdout:generic/214 1s 2024-01-31T06:42:51.654 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/214 2024-01-31T06:42:51.654 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:42:51.662 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:51.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:42:51.705 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-01-31T06:42:52.469 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:42:52.483 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:42:52.483 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:56.436 INFO:teuthology.orchestra.run.smithi049.stdout:generic/215 4s 2024-01-31T06:42:56.456 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/215 2024-01-31T06:42:56.457 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:42:56.467 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:56.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:42:56.499 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-01-31T06:42:57.020 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:42:57.035 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:42:57.035 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:57.438 INFO:teuthology.orchestra.run.smithi049.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:42:57.449 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/216 2024-01-31T06:42:57.449 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/216 2024-01-31T06:42:57.449 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:42:57.458 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:57.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:42:57.485 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-01-31T06:42:57.981 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:42:57.996 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:42:57.996 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:58.413 INFO:teuthology.orchestra.run.smithi049.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:42:58.423 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/217 2024-01-31T06:42:58.424 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/217 2024-01-31T06:42:58.424 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:42:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:58.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:42:58.463 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-01-31T06:42:58.964 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:42:58.977 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:42:58.977 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:59.368 INFO:teuthology.orchestra.run.smithi049.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:42:59.379 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/218 2024-01-31T06:42:59.379 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/218 2024-01-31T06:42:59.380 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:42:59.387 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:42:59.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:42:59.414 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-01-31T06:42:59.943 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:42:59.957 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:42:59.957 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:00.366 INFO:teuthology.orchestra.run.smithi049.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:43:00.378 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/219 2024-01-31T06:43:00.378 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/219 2024-01-31T06:43:00.378 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:00.388 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:00.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:00.414 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-01-31T06:43:00.940 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:00.949 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:00.949 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:01.338 INFO:teuthology.orchestra.run.smithi049.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:43:01.351 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/220 2024-01-31T06:43:01.351 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/220 2024-01-31T06:43:01.351 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:01.359 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:01.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:01.382 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-01-31T06:43:01.910 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:01.927 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:01.927 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:03.418 INFO:teuthology.orchestra.run.smithi049.stdout:generic/221 2s 2024-01-31T06:43:03.437 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/221 2024-01-31T06:43:03.437 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:03.447 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:03.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:03.468 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-01-31T06:43:04.003 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:04.020 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:04.020 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:04.415 INFO:teuthology.orchestra.run.smithi049.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:43:04.430 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/222 2024-01-31T06:43:04.430 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/222 2024-01-31T06:43:04.430 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:04.439 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:04.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:04.500 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-01-31T06:43:05.013 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:05.027 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:05.027 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:05.419 INFO:teuthology.orchestra.run.smithi049.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:43:05.433 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/223 2024-01-31T06:43:05.433 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/223 2024-01-31T06:43:05.433 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:05.442 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:05.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:05.505 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-01-31T06:43:06.001 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:06.012 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:06.012 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:06.416 INFO:teuthology.orchestra.run.smithi049.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:43:06.429 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/224 2024-01-31T06:43:06.429 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/224 2024-01-31T06:43:06.429 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:06.437 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:06.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:06.500 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-01-31T06:43:07.020 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:07.033 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:07.033 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:07.406 INFO:teuthology.orchestra.run.smithi049.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:43:07.418 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/225 2024-01-31T06:43:07.418 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/225 2024-01-31T06:43:07.418 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:07.427 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:07.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:07.458 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-01-31T06:43:08.043 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:08.058 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:08.058 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:08.435 INFO:teuthology.orchestra.run.smithi049.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:43:08.444 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/226 2024-01-31T06:43:08.445 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/226 2024-01-31T06:43:08.445 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:08.453 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:08.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:08.487 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-01-31T06:43:09.000 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:09.015 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:09.015 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:09.399 INFO:teuthology.orchestra.run.smithi049.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:43:09.416 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/227 2024-01-31T06:43:09.416 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/227 2024-01-31T06:43:09.416 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:09.425 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:09.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:09.498 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-01-31T06:43:09.996 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:10.007 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:10.007 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:11.069 INFO:teuthology.orchestra.run.smithi049.stdout:generic/228 0s 2024-01-31T06:43:11.295 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/228 2024-01-31T06:43:11.295 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:11.303 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:11.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:11.352 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-01-31T06:43:12.160 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:12.176 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:12.176 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:12.656 INFO:teuthology.orchestra.run.smithi049.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:43:12.668 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/229 2024-01-31T06:43:12.668 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/229 2024-01-31T06:43:12.668 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:12.680 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:12.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:12.742 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-01-31T06:43:13.314 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:13.332 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:13.332 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:14.012 INFO:teuthology.orchestra.run.smithi049.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:43:14.022 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/230 2024-01-31T06:43:14.022 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/230 2024-01-31T06:43:14.022 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:14.029 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:14.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:14.086 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-01-31T06:43:14.616 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:14.630 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:14.630 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:15.036 INFO:teuthology.orchestra.run.smithi049.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:43:15.047 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/231 2024-01-31T06:43:15.047 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/231 2024-01-31T06:43:15.048 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:15.058 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:15.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:15.088 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-01-31T06:43:15.602 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:15.615 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:15.615 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:16.004 INFO:teuthology.orchestra.run.smithi049.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:43:16.016 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/232 2024-01-31T06:43:16.016 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/232 2024-01-31T06:43:16.016 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:16.024 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:16.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:16.050 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-01-31T06:43:16.552 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:16.564 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:16.565 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:16.941 INFO:teuthology.orchestra.run.smithi049.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:43:16.953 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/233 2024-01-31T06:43:16.954 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/233 2024-01-31T06:43:16.954 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:16.961 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:16.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:16.989 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-01-31T06:43:17.481 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:17.495 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:17.495 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:17.841 INFO:teuthology.orchestra.run.smithi049.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:43:17.853 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/234 2024-01-31T06:43:17.854 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/234 2024-01-31T06:43:17.854 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:17.868 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:17.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:17.898 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-01-31T06:43:18.352 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:43:18.357 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:43:18.434 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:18.449 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:18.449 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:18.849 INFO:teuthology.orchestra.run.smithi049.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:43:18.861 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/235 2024-01-31T06:43:18.861 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/235 2024-01-31T06:43:18.861 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:18.868 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:18.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:18.897 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-01-31T06:43:19.447 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:19.464 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:19.464 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:21.054 INFO:teuthology.orchestra.run.smithi049.stdout:generic/236 2s 2024-01-31T06:43:21.069 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/236 2024-01-31T06:43:21.069 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:21.076 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:21.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:21.145 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-01-31T06:43:21.888 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:21.904 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:21.904 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:22.392 INFO:teuthology.orchestra.run.smithi049.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-01-31T06:43:22.402 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/237 2024-01-31T06:43:22.402 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/237 2024-01-31T06:43:22.402 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:22.409 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:22.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:22.439 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-01-31T06:43:22.945 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:22.959 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:22.959 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:23.322 INFO:teuthology.orchestra.run.smithi049.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:43:23.335 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/238 2024-01-31T06:43:23.335 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/238 2024-01-31T06:43:23.335 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:23.345 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:23.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:23.371 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-01-31T06:43:23.906 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:23.921 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:23.922 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:24.363 INFO:teuthology.orchestra.run.smithi049.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-01-31T06:43:24.373 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/239 2024-01-31T06:43:24.373 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/239 2024-01-31T06:43:24.373 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:24.382 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:24.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:24.413 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-01-31T06:43:24.935 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:24.948 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:24.948 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:25.405 INFO:teuthology.orchestra.run.smithi049.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-01-31T06:43:25.414 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/240 2024-01-31T06:43:25.414 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/240 2024-01-31T06:43:25.414 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:43:25.425 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:25.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:43:25.457 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-01-31T06:43:25.988 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:43:26.001 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:43:26.001 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:43:48.440 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:43:48.445 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:43:49.070 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-31T06:43:49.068+0000 7fab97400640 -1 Fail to open '/proc/212582/cmdline' error = (2) No such file or directory 2024-01-31T06:43:49.070 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-31T06:43:49.068+0000 7fab97400640 -1 received signal: Hangup from (PID: 212582) UID: 0 2024-01-31T06:43:49.070 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-31T06:43:49.068+0000 7fd9fae00640 -1 Fail to open '/proc/212582/cmdline' error = (2) No such file or directory 2024-01-31T06:43:49.070 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-31T06:43:49.068+0000 7fd9fae00640 -1 received signal: Hangup from (PID: 212582) UID: 0 2024-01-31T06:44:40.615 INFO:teuthology.orchestra.run.smithi049.stdout:generic/241 74s 2024-01-31T06:44:40.633 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/241 2024-01-31T06:44:40.633 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:44:40.645 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:44:40.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:44:40.689 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-01-31T06:44:41.582 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:44:41.599 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:44:41.599 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:44:42.032 INFO:teuthology.orchestra.run.smithi049.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:44:42.045 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/242 2024-01-31T06:44:42.045 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/242 2024-01-31T06:44:42.045 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:44:42.055 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:44:42.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:44:42.087 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-01-31T06:44:42.704 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:44:42.718 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:44:42.718 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:44:43.136 INFO:teuthology.orchestra.run.smithi049.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:44:43.152 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/243 2024-01-31T06:44:43.152 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/243 2024-01-31T06:44:43.152 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:44:43.165 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:44:43.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:44:43.202 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-01-31T06:44:43.808 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:44:43.824 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:44:43.824 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:44:44.262 INFO:teuthology.orchestra.run.smithi049.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-01-31T06:44:44.278 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/244 2024-01-31T06:44:44.279 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/244 2024-01-31T06:44:44.279 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:44:44.288 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:44:44.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:44:44.323 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-01-31T06:44:44.926 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:44:44.940 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:44:44.941 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:44:45.658 INFO:teuthology.orchestra.run.smithi049.stdout:generic/245 1s 2024-01-31T06:44:45.675 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/245 2024-01-31T06:44:45.675 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:44:45.682 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:44:45.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:44:45.715 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-01-31T06:44:46.624 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:44:46.643 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:44:46.643 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:44:47.182 INFO:teuthology.orchestra.run.smithi049.stdout:generic/246 1s 2024-01-31T06:44:47.201 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/246 2024-01-31T06:44:47.201 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:44:47.212 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:44:47.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:44:47.255 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-01-31T06:44:48.139 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:44:48.153 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:44:48.153 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:45:46.661 INFO:teuthology.orchestra.run.smithi049.stdout:generic/247 58s 2024-01-31T06:45:46.676 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/247 2024-01-31T06:45:46.676 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:45:46.684 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:45:46.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:45:46.714 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-01-31T06:45:47.298 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:45:47.316 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:45:47.317 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:45:47.964 INFO:teuthology.orchestra.run.smithi049.stdout:generic/248 0s 2024-01-31T06:45:47.981 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/248 2024-01-31T06:45:47.981 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:45:47.991 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:45:48.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:45:48.026 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-01-31T06:45:48.593 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:45:48.612 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:45:48.613 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:45:53.952 INFO:teuthology.orchestra.run.smithi049.stdout:generic/249 5s 2024-01-31T06:45:54.123 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/249 2024-01-31T06:45:54.123 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:45:54.134 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:45:54.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:45:54.168 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-01-31T06:45:54.947 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:45:54.961 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:45:54.961 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:45:56.771 INFO:teuthology.orchestra.run.smithi049.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:45:56.783 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/250 2024-01-31T06:45:56.783 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/250 2024-01-31T06:45:56.784 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:45:56.793 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:45:56.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:45:56.832 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-01-31T06:45:57.433 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:45:57.452 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:45:57.452 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:45:58.314 INFO:teuthology.orchestra.run.smithi049.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:45:58.328 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/251 2024-01-31T06:45:58.328 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/251 2024-01-31T06:45:58.329 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:45:58.337 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:45:58.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:45:58.408 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-01-31T06:45:58.918 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:45:58.936 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:45:58.936 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:45:59.556 INFO:teuthology.orchestra.run.smithi049.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:45:59.566 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/252 2024-01-31T06:45:59.566 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/252 2024-01-31T06:45:59.566 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:45:59.576 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:45:59.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:45:59.637 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-01-31T06:46:00.280 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:46:00.296 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:46:00.296 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:00.736 INFO:teuthology.orchestra.run.smithi049.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:46:00.747 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/253 2024-01-31T06:46:00.747 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/253 2024-01-31T06:46:00.747 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:46:00.760 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:00.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:46:00.791 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-01-31T06:46:01.324 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:46:01.342 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:46:01.342 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:01.757 INFO:teuthology.orchestra.run.smithi049.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:46:01.768 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/254 2024-01-31T06:46:01.768 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/254 2024-01-31T06:46:01.768 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:46:01.775 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:01.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:46:01.815 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-01-31T06:46:02.404 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:46:02.417 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:46:02.417 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:05.422 INFO:teuthology.orchestra.run.smithi049.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-01-31T06:46:05.435 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/255 2024-01-31T06:46:05.435 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/255 2024-01-31T06:46:05.435 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:46:05.444 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:05.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:46:05.502 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-01-31T06:46:06.376 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:46:06.396 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:46:06.396 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:09.473 INFO:teuthology.orchestra.run.smithi049.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:46:09.485 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/256 2024-01-31T06:46:09.485 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/256 2024-01-31T06:46:09.485 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:46:09.493 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:09.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:46:09.566 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-01-31T06:46:10.177 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:46:10.196 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:46:10.196 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:13.016 INFO:teuthology.orchestra.run.smithi049.stdout:generic/257 3s 2024-01-31T06:46:13.035 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/257 2024-01-31T06:46:13.036 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:46:13.047 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:13.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:46:13.118 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-01-31T06:46:13.965 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:46:13.979 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:46:13.979 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:15.378 INFO:teuthology.orchestra.run.smithi049.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/258.out.bad) 2024-01-31T06:46:15.388 INFO:teuthology.orchestra.run.smithi049.stdout: --- tests/generic/258.out 2024-01-31 05:06:00.883952405 +0000 2024-01-31T06:46:15.389 INFO:teuthology.orchestra.run.smithi049.stdout: +++ /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/258.out.bad 2024-01-31 06:46:15.372150451 +0000 2024-01-31T06:46:15.389 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -1,5 +1,6 @@ 2024-01-31T06:46:15.389 INFO:teuthology.orchestra.run.smithi049.stdout: QA output created by 258 2024-01-31T06:46:15.389 INFO:teuthology.orchestra.run.smithi049.stdout: Creating file with timestamp of Jan 1, 1960 2024-01-31T06:46:15.389 INFO:teuthology.orchestra.run.smithi049.stdout: Testing for negative seconds since epoch 2024-01-31T06:46:15.389 INFO:teuthology.orchestra.run.smithi049.stdout: -Remounting to flush cache 2024-01-31T06:46:15.389 INFO:teuthology.orchestra.run.smithi049.stdout: -Testing for negative seconds since epoch 2024-01-31T06:46:15.389 INFO:teuthology.orchestra.run.smithi049.stdout: +Timestamp wrapped: 3979351756 2024-01-31T06:46:15.389 INFO:teuthology.orchestra.run.smithi049.stdout: +Timestamp wrapped 2024-01-31T06:46:15.389 INFO:teuthology.orchestra.run.smithi049.stdout: +(see /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/258.full for details) 2024-01-31T06:46:15.398 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/258 2024-01-31T06:46:15.398 INFO:teuthology.orchestra.run.smithi049.stdout:Failures: generic/258 2024-01-31T06:46:15.399 INFO:teuthology.orchestra.run.smithi049.stdout:Failed 1 of 1 tests 2024-01-31T06:46:15.405 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:15.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T06:46:15.432 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-01-31T06:46:15.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-01-31T06:46:15.433 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-01-31T06:46:16.068 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:46:16.084 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:46:16.084 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:16.650 INFO:teuthology.orchestra.run.smithi049.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:46:16.664 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/259 2024-01-31T06:46:16.664 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/259 2024-01-31T06:46:16.665 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:46:16.675 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:16.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:46:16.752 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-01-31T06:46:17.343 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:46:17.360 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:46:17.360 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:17.779 INFO:teuthology.orchestra.run.smithi049.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:46:17.791 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/260 2024-01-31T06:46:17.791 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/260 2024-01-31T06:46:17.791 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:46:17.801 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:17.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:46:17.827 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-01-31T06:46:18.454 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:46:18.468 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:46:18.468 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:19.127 INFO:teuthology.orchestra.run.smithi049.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:46:19.140 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/261 2024-01-31T06:46:19.140 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/261 2024-01-31T06:46:19.141 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:46:19.150 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:19.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:46:19.187 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-01-31T06:46:19.784 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:46:19.794 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:46:19.794 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:20.223 INFO:teuthology.orchestra.run.smithi049.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:46:20.233 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/262 2024-01-31T06:46:20.233 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/262 2024-01-31T06:46:20.233 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:46:20.246 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:46:20.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:46:20.277 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-01-31T06:46:20.835 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:46:20.850 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:46:20.850 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:36.310 INFO:teuthology.orchestra.run.smithi049.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.a.log.1: 2024-01-31T06:47:36.310 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: stdin: file size changed while zipping 2024-01-31T06:47:44.855 INFO:teuthology.orchestra.run.smithi049.stdout:generic/263 84s 2024-01-31T06:47:44.867 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/263 2024-01-31T06:47:44.867 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:44.873 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:44.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:44.915 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-01-31T06:47:45.572 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:45.582 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:45.582 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:45.917 INFO:teuthology.orchestra.run.smithi049.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:47:45.925 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/264 2024-01-31T06:47:45.926 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/264 2024-01-31T06:47:45.926 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:45.932 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:45.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:45.951 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-01-31T06:47:46.307 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:46.317 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:46.317 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:46.660 INFO:teuthology.orchestra.run.smithi049.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:47:46.668 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/265 2024-01-31T06:47:46.668 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/265 2024-01-31T06:47:46.668 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:46.674 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:46.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:46.694 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-01-31T06:47:47.063 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:47.073 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:47.073 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:47.387 INFO:teuthology.orchestra.run.smithi049.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:47:47.395 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/266 2024-01-31T06:47:47.395 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/266 2024-01-31T06:47:47.395 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:47.401 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:47.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:47.420 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-01-31T06:47:47.784 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:47.794 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:47.794 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:48.103 INFO:teuthology.orchestra.run.smithi049.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:47:48.111 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/267 2024-01-31T06:47:48.111 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/267 2024-01-31T06:47:48.111 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:48.117 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:48.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:48.136 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-01-31T06:47:48.503 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:48.513 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:48.513 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:48.810 INFO:teuthology.orchestra.run.smithi049.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:47:48.818 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/268 2024-01-31T06:47:48.818 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/268 2024-01-31T06:47:48.818 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:48.824 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:48.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:48.843 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-01-31T06:47:49.224 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:49.234 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:49.234 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:49.500 INFO:teuthology.orchestra.run.smithi049.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:47:49.508 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/269 2024-01-31T06:47:49.509 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/269 2024-01-31T06:47:49.509 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:49.515 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:49.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:49.535 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-01-31T06:47:49.896 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:49.906 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:49.906 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:50.187 INFO:teuthology.orchestra.run.smithi049.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-01-31T06:47:50.195 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/270 2024-01-31T06:47:50.195 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/270 2024-01-31T06:47:50.195 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:50.201 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:50.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:50.222 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-01-31T06:47:50.583 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:50.593 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:50.593 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:50.907 INFO:teuthology.orchestra.run.smithi049.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:47:50.915 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/271 2024-01-31T06:47:50.915 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/271 2024-01-31T06:47:50.915 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:50.921 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:50.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:50.940 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-01-31T06:47:51.303 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:51.314 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:51.314 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:51.631 INFO:teuthology.orchestra.run.smithi049.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:47:51.639 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/272 2024-01-31T06:47:51.639 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/272 2024-01-31T06:47:51.639 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:51.645 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:51.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:51.664 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-01-31T06:47:52.024 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:52.034 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:52.034 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:52.334 INFO:teuthology.orchestra.run.smithi049.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:47:52.342 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/273 2024-01-31T06:47:52.342 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/273 2024-01-31T06:47:52.342 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:52.348 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:52.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:52.367 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-01-31T06:47:52.723 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:52.734 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:52.734 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:53.017 INFO:teuthology.orchestra.run.smithi049.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:47:53.025 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/274 2024-01-31T06:47:53.026 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/274 2024-01-31T06:47:53.026 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:53.032 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:53.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:53.052 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-01-31T06:47:53.418 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:53.428 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:53.428 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:53.707 INFO:teuthology.orchestra.run.smithi049.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:47:53.715 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/275 2024-01-31T06:47:53.715 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/275 2024-01-31T06:47:53.715 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:53.721 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:53.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:53.741 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-01-31T06:47:54.104 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:54.117 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:54.117 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:54.431 INFO:teuthology.orchestra.run.smithi049.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:47:54.439 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/276 2024-01-31T06:47:54.439 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/276 2024-01-31T06:47:54.439 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:54.445 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:54.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:54.466 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-01-31T06:47:54.820 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:54.830 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:54.830 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:55.144 INFO:teuthology.orchestra.run.smithi049.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:47:55.152 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/277 2024-01-31T06:47:55.153 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/277 2024-01-31T06:47:55.153 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:55.159 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:55.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:55.178 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-01-31T06:47:55.532 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:55.542 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:55.543 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:55.813 INFO:teuthology.orchestra.run.smithi049.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:47:55.821 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/278 2024-01-31T06:47:55.821 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/278 2024-01-31T06:47:55.821 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:55.827 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:55.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:55.846 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-01-31T06:47:56.211 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:56.221 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:56.221 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:56.685 INFO:teuthology.orchestra.run.smithi049.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:47:56.693 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/279 2024-01-31T06:47:56.693 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/279 2024-01-31T06:47:56.693 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:56.699 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:56.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:56.718 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-01-31T06:47:57.068 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:57.078 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:57.078 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:57.415 INFO:teuthology.orchestra.run.smithi049.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:47:57.423 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/280 2024-01-31T06:47:57.423 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/280 2024-01-31T06:47:57.423 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:57.429 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:57.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:57.448 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-01-31T06:47:57.803 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:57.814 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:58.100 INFO:teuthology.orchestra.run.smithi049.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:47:58.108 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/281 2024-01-31T06:47:58.108 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/281 2024-01-31T06:47:58.108 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:58.114 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:58.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:58.132 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-01-31T06:47:58.503 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:58.513 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:58.513 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:58.795 INFO:teuthology.orchestra.run.smithi049.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:47:58.803 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/282 2024-01-31T06:47:58.803 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/282 2024-01-31T06:47:58.803 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:58.809 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:58.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:58.828 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-01-31T06:47:59.183 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:59.194 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:59.194 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:59.527 INFO:teuthology.orchestra.run.smithi049.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:47:59.535 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/283 2024-01-31T06:47:59.535 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/283 2024-01-31T06:47:59.535 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:47:59.541 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:47:59.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:47:59.611 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-01-31T06:47:59.988 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:47:59.999 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:47:59.999 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:48:00.306 INFO:teuthology.orchestra.run.smithi049.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:48:00.314 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/284 2024-01-31T06:48:00.314 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/284 2024-01-31T06:48:00.314 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:48:00.320 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:48:00.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:48:00.341 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-01-31T06:48:00.695 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:48:00.706 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:48:00.706 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:48:03.020 INFO:teuthology.orchestra.run.smithi049.stdout:generic/285 3s 2024-01-31T06:48:03.033 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/285 2024-01-31T06:48:03.033 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:48:03.039 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:48:03.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:48:03.160 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-01-31T06:48:03.938 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:48:03.952 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:48:03.952 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:48:09.146 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:48:09.150 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:48:39.204 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:48:39.209 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:48:56.602 INFO:teuthology.orchestra.run.smithi049.stdout:generic/286 53s 2024-01-31T06:48:56.614 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/286 2024-01-31T06:48:56.614 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:48:56.620 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:48:56.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:48:56.641 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-01-31T06:48:57.312 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:48:57.322 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:48:57.322 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:48:57.641 INFO:teuthology.orchestra.run.smithi049.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:48:57.652 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/287 2024-01-31T06:48:57.652 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/287 2024-01-31T06:48:57.653 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:48:57.660 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:48:57.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:48:57.689 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-01-31T06:48:58.087 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:48:58.098 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:48:58.098 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:48:58.370 INFO:teuthology.orchestra.run.smithi049.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:48:58.378 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/288 2024-01-31T06:48:58.378 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/288 2024-01-31T06:48:58.378 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:48:58.384 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:48:58.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:48:58.403 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-01-31T06:48:58.761 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:48:58.771 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:48:58.771 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:48:59.051 INFO:teuthology.orchestra.run.smithi049.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:48:59.059 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/289 2024-01-31T06:48:59.059 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/289 2024-01-31T06:48:59.059 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:48:59.065 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:48:59.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:48:59.084 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-01-31T06:48:59.428 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:48:59.438 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:48:59.438 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:48:59.714 INFO:teuthology.orchestra.run.smithi049.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:48:59.722 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/290 2024-01-31T06:48:59.722 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/290 2024-01-31T06:48:59.722 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:48:59.728 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:48:59.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:48:59.747 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-01-31T06:49:00.175 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:00.185 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:00.186 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:00.461 INFO:teuthology.orchestra.run.smithi049.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:49:00.469 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/291 2024-01-31T06:49:00.470 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/291 2024-01-31T06:49:00.470 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:49:00.476 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:00.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:49:00.496 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-01-31T06:49:00.867 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:00.877 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:00.877 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:01.145 INFO:teuthology.orchestra.run.smithi049.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:49:01.153 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/292 2024-01-31T06:49:01.153 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/292 2024-01-31T06:49:01.153 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:49:01.159 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:01.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:49:01.178 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-01-31T06:49:01.532 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:01.542 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:01.542 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:01.812 INFO:teuthology.orchestra.run.smithi049.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:49:01.820 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/293 2024-01-31T06:49:01.820 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/293 2024-01-31T06:49:01.821 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:49:01.827 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:01.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:49:01.846 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-01-31T06:49:02.216 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:02.226 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:02.226 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:02.497 INFO:teuthology.orchestra.run.smithi049.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:49:02.505 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/294 2024-01-31T06:49:02.505 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/294 2024-01-31T06:49:02.505 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:49:02.511 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:02.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:49:02.563 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-01-31T06:49:02.912 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:02.922 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:02.922 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:03.220 INFO:teuthology.orchestra.run.smithi049.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:49:03.228 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/295 2024-01-31T06:49:03.228 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/295 2024-01-31T06:49:03.228 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:49:03.234 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:03.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:49:03.253 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-01-31T06:49:03.625 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:03.635 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:03.635 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:03.927 INFO:teuthology.orchestra.run.smithi049.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:49:03.935 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/296 2024-01-31T06:49:03.935 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/296 2024-01-31T06:49:03.935 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:49:03.941 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:03.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:49:03.961 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-01-31T06:49:04.303 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:04.313 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:04.314 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:04.594 INFO:teuthology.orchestra.run.smithi049.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:49:04.603 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/297 2024-01-31T06:49:04.603 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/297 2024-01-31T06:49:04.603 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:49:04.609 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:04.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:49:04.628 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-01-31T06:49:04.980 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:04.990 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:04.990 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:05.263 INFO:teuthology.orchestra.run.smithi049.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:49:05.271 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/298 2024-01-31T06:49:05.271 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/298 2024-01-31T06:49:05.271 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:49:05.277 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:05.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:49:05.297 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-01-31T06:49:05.664 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:05.674 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:05.674 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:05.943 INFO:teuthology.orchestra.run.smithi049.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:49:05.951 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/299 2024-01-31T06:49:05.951 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/299 2024-01-31T06:49:05.952 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:49:05.958 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:05.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:49:05.977 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-01-31T06:49:06.344 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:06.354 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:06.354 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:06.648 INFO:teuthology.orchestra.run.smithi049.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:49:06.656 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/300 2024-01-31T06:49:06.656 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/300 2024-01-31T06:49:06.656 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:49:06.662 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:06.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:49:06.682 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-01-31T06:49:07.045 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:07.055 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:07.055 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:07.317 INFO:teuthology.orchestra.run.smithi049.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:49:07.325 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/301 2024-01-31T06:49:07.325 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/301 2024-01-31T06:49:07.325 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:49:07.331 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:07.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:49:07.351 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-01-31T06:49:07.695 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:07.706 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:07.706 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:08.003 INFO:teuthology.orchestra.run.smithi049.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:49:08.011 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/302 2024-01-31T06:49:08.011 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/302 2024-01-31T06:49:08.011 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:49:08.017 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:08.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:49:08.036 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-01-31T06:49:08.412 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:08.422 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:08.422 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:08.778 INFO:teuthology.orchestra.run.smithi049.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:49:08.786 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/303 2024-01-31T06:49:08.786 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/303 2024-01-31T06:49:08.786 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:49:08.792 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:08.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:49:08.816 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-01-31T06:49:09.476 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:09.486 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:09.486 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:09.842 INFO:teuthology.orchestra.run.smithi049.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-01-31T06:49:09.850 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/304 2024-01-31T06:49:09.850 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/304 2024-01-31T06:49:09.850 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:49:09.856 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:09.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:49:09.900 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-01-31T06:49:10.540 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:10.550 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:10.551 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:10.808 INFO:teuthology.orchestra.run.smithi049.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:49:10.816 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/305 2024-01-31T06:49:10.816 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/305 2024-01-31T06:49:10.816 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:49:10.822 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:10.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:49:10.842 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-01-31T06:49:11.207 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:11.217 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:11.218 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:11.491 INFO:teuthology.orchestra.run.smithi049.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:49:11.499 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/306 2024-01-31T06:49:11.499 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/306 2024-01-31T06:49:11.499 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:49:11.505 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:11.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:49:11.525 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-01-31T06:49:11.876 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:11.886 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:11.886 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:12.155 INFO:teuthology.orchestra.run.smithi049.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:49:12.163 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/307 2024-01-31T06:49:12.163 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/307 2024-01-31T06:49:12.163 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:49:12.169 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:12.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:49:12.188 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-01-31T06:49:12.558 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:12.569 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:12.569 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:12.886 INFO:teuthology.orchestra.run.smithi049.stdout:generic/308 0s 2024-01-31T06:49:12.886 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:49:12.889 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:49:12.898 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/308 2024-01-31T06:49:12.898 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:49:12.908 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:12.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:49:12.924 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-01-31T06:49:13.324 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:13.334 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:13.334 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:15.892 INFO:teuthology.orchestra.run.smithi049.stdout:generic/309 2s 2024-01-31T06:49:15.904 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/309 2024-01-31T06:49:15.905 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:49:15.911 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:15.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:49:15.936 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-01-31T06:49:16.604 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:49:16.614 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:49:16.615 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:49:42.950 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:49:42.956 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:50:13.014 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:50:13.020 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:50:43.074 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:50:43.079 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:50:50.317 INFO:teuthology.orchestra.run.smithi049.stdout:generic/310 94s 2024-01-31T06:50:50.329 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/310 2024-01-31T06:50:50.330 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:50:50.336 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:50:50.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:50:50.410 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-01-31T06:50:51.361 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:50:51.376 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:50:51.376 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:50:51.796 INFO:teuthology.orchestra.run.smithi049.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:50:51.805 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/311 2024-01-31T06:50:51.805 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/311 2024-01-31T06:50:51.805 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:50:51.811 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:50:51.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:50:51.831 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-01-31T06:50:52.199 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:50:52.209 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:50:52.209 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:50:52.525 INFO:teuthology.orchestra.run.smithi049.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:50:52.532 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/312 2024-01-31T06:50:52.533 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/312 2024-01-31T06:50:52.533 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:50:52.539 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:50:52.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:50:52.559 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-01-31T06:50:52.924 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:50:52.934 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:50:52.934 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:50:57.316 INFO:teuthology.orchestra.run.smithi049.stdout:generic/313 5s 2024-01-31T06:50:57.329 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/313 2024-01-31T06:50:57.329 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:50:57.336 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:50:57.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:50:57.356 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-01-31T06:50:57.728 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:50:57.738 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:50:57.738 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:50:58.518 INFO:teuthology.orchestra.run.smithi049.stdout:generic/314 1s 2024-01-31T06:50:58.530 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/314 2024-01-31T06:50:58.530 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:50:58.537 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:50:58.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:50:58.558 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-01-31T06:50:58.924 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:50:58.934 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:50:58.934 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:51:02.944 INFO:teuthology.orchestra.run.smithi049.stdout:generic/315 4s 2024-01-31T06:51:02.957 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/315 2024-01-31T06:51:02.957 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:51:02.963 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:51:03.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:51:03.009 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-01-31T06:51:03.635 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:51:03.645 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:51:03.645 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:51:05.139 INFO:teuthology.orchestra.run.smithi049.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-01-31T06:51:05.147 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/316 2024-01-31T06:51:05.147 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/316 2024-01-31T06:51:05.147 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:51:05.153 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:51:05.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:51:05.191 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-01-31T06:51:05.844 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:51:05.854 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:51:05.854 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:51:06.142 INFO:teuthology.orchestra.run.smithi049.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:51:06.150 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/317 2024-01-31T06:51:06.150 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/317 2024-01-31T06:51:06.150 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:51:06.156 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:51:06.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:51:06.177 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-01-31T06:51:06.523 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:51:06.533 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:51:06.533 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:51:06.807 INFO:teuthology.orchestra.run.smithi049.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:51:06.815 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/318 2024-01-31T06:51:06.815 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/318 2024-01-31T06:51:06.815 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:51:06.821 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:51:06.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:51:06.841 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-01-31T06:51:07.216 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:51:07.226 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:51:07.226 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:51:07.558 INFO:teuthology.orchestra.run.smithi049.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-01-31T06:51:07.566 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/319 2024-01-31T06:51:07.566 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/319 2024-01-31T06:51:07.566 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:51:07.572 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:51:07.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:51:07.591 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-01-31T06:51:07.956 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:51:07.966 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:51:07.966 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:51:08.242 INFO:teuthology.orchestra.run.smithi049.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:51:08.250 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/320 2024-01-31T06:51:08.251 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/320 2024-01-31T06:51:08.251 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:51:08.257 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:51:08.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:51:08.276 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-01-31T06:51:08.606 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:51:08.616 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:51:08.616 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:51:08.918 INFO:teuthology.orchestra.run.smithi049.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:51:08.926 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/321 2024-01-31T06:51:08.926 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/321 2024-01-31T06:51:08.926 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:51:08.932 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:51:08.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:51:08.952 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-01-31T06:51:09.304 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:51:09.315 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:51:09.315 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:51:09.627 INFO:teuthology.orchestra.run.smithi049.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:51:09.635 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/322 2024-01-31T06:51:09.635 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/322 2024-01-31T06:51:09.636 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:51:09.641 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:51:09.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:51:09.661 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-01-31T06:51:10.044 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:51:10.054 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:51:10.054 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:51:14.816 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:51:14.820 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:51:44.875 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:51:44.880 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:52:15.616 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:52:15.620 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:52:15.680 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T06:52:15.678+0000 7f96ce200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 267928) UID: 0 2024-01-31T06:52:15.681 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T06:52:15.678+0000 7f91cc000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 267928) UID: 0 2024-01-31T06:52:15.681 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T06:52:15.678+0000 7f79d2800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 267928) UID: 0 2024-01-31T06:52:15.681 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T06:52:15.678+0000 7f4aaf800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 267928) UID: 0 2024-01-31T06:53:12.600 INFO:teuthology.orchestra.run.smithi049.stdout:generic/323 122s 2024-01-31T06:53:12.714 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/323 2024-01-31T06:53:12.714 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:12.721 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:12.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:12.777 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-01-31T06:53:14.145 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:14.155 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:14.155 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:14.480 INFO:teuthology.orchestra.run.smithi049.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:14.488 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/324 2024-01-31T06:53:14.488 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/324 2024-01-31T06:53:14.488 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:14.494 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:14.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:14.516 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-01-31T06:53:14.877 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:14.887 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:14.887 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:15.307 INFO:teuthology.orchestra.run.smithi049.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:15.314 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/325 2024-01-31T06:53:15.315 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/325 2024-01-31T06:53:15.315 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:15.321 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:15.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:15.340 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-01-31T06:53:15.718 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:15.728 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:15.728 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:16.003 INFO:teuthology.orchestra.run.smithi049.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:16.011 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/326 2024-01-31T06:53:16.011 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/326 2024-01-31T06:53:16.012 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:16.017 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:16.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:16.038 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-01-31T06:53:16.404 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:16.415 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:16.415 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:16.696 INFO:teuthology.orchestra.run.smithi049.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:16.704 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/327 2024-01-31T06:53:16.705 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/327 2024-01-31T06:53:16.705 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:16.710 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:16.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:16.730 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-01-31T06:53:17.094 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:17.104 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:17.104 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:17.722 INFO:teuthology.orchestra.run.smithi049.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:17.730 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/328 2024-01-31T06:53:17.730 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/328 2024-01-31T06:53:17.730 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:17.736 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:17.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:17.755 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-01-31T06:53:19.016 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:19.024 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:19.025 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:19.939 INFO:teuthology.orchestra.run.smithi049.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:19.947 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/329 2024-01-31T06:53:19.948 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/329 2024-01-31T06:53:19.948 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:19.953 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:19.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:19.974 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-01-31T06:53:20.340 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:20.350 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:20.350 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:20.632 INFO:teuthology.orchestra.run.smithi049.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:20.640 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/330 2024-01-31T06:53:20.641 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/330 2024-01-31T06:53:20.641 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:20.646 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:20.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:20.666 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-01-31T06:53:21.025 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:21.036 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:21.037 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:21.339 INFO:teuthology.orchestra.run.smithi049.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:21.347 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/331 2024-01-31T06:53:21.348 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/331 2024-01-31T06:53:21.348 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:21.354 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:21.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:21.373 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-01-31T06:53:21.750 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:21.760 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:21.760 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:22.087 INFO:teuthology.orchestra.run.smithi049.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:22.096 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/332 2024-01-31T06:53:22.096 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/332 2024-01-31T06:53:22.096 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:22.101 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:22.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:22.121 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-01-31T06:53:22.475 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:22.485 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:22.486 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:22.773 INFO:teuthology.orchestra.run.smithi049.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:22.781 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/333 2024-01-31T06:53:22.781 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/333 2024-01-31T06:53:22.781 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:22.787 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:22.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:22.808 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-01-31T06:53:23.181 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:23.191 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:23.191 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:23.480 INFO:teuthology.orchestra.run.smithi049.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:23.489 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/334 2024-01-31T06:53:23.489 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/334 2024-01-31T06:53:23.489 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:23.496 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:23.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:23.565 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-01-31T06:53:23.936 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:23.946 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:23.946 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:24.372 INFO:teuthology.orchestra.run.smithi049.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:24.380 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/335 2024-01-31T06:53:24.380 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/335 2024-01-31T06:53:24.380 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:24.386 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:24.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:24.407 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-01-31T06:53:24.775 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:24.786 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:24.786 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:25.173 INFO:teuthology.orchestra.run.smithi049.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:25.181 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/336 2024-01-31T06:53:25.181 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/336 2024-01-31T06:53:25.181 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:25.188 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:25.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:25.207 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-01-31T06:53:25.577 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:25.588 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:25.589 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:25.869 INFO:teuthology.orchestra.run.smithi049.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:25.909 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/337 2024-01-31T06:53:25.909 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/337 2024-01-31T06:53:25.909 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:25.909 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:25.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:25.910 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-01-31T06:53:26.287 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:26.297 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:26.298 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:26.585 INFO:teuthology.orchestra.run.smithi049.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:26.593 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/338 2024-01-31T06:53:26.593 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/338 2024-01-31T06:53:26.593 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:26.600 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:26.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:26.620 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-01-31T06:53:26.992 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:27.003 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:27.003 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:27.286 INFO:teuthology.orchestra.run.smithi049.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:27.294 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/339 2024-01-31T06:53:27.294 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/339 2024-01-31T06:53:27.294 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:27.300 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:27.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:27.320 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-01-31T06:53:27.693 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:27.703 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:27.703 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:27.973 INFO:teuthology.orchestra.run.smithi049.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:27.981 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/340 2024-01-31T06:53:27.981 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/340 2024-01-31T06:53:27.981 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:27.987 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:28.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:28.007 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-01-31T06:53:28.402 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:28.412 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:28.413 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:28.733 INFO:teuthology.orchestra.run.smithi049.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:28.742 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/341 2024-01-31T06:53:28.742 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/341 2024-01-31T06:53:28.742 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:28.749 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:28.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:28.770 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-01-31T06:53:29.151 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:29.161 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:29.162 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:29.477 INFO:teuthology.orchestra.run.smithi049.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:29.485 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/342 2024-01-31T06:53:29.485 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/342 2024-01-31T06:53:29.485 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:29.491 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:29.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:29.510 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-01-31T06:53:29.875 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:29.886 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:29.886 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:30.213 INFO:teuthology.orchestra.run.smithi049.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:30.221 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/343 2024-01-31T06:53:30.221 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/343 2024-01-31T06:53:30.221 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:30.227 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:30.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:30.248 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-01-31T06:53:30.620 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:30.630 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:30.630 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:30.894 INFO:teuthology.orchestra.run.smithi049.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:30.902 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/344 2024-01-31T06:53:30.903 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/344 2024-01-31T06:53:30.903 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:30.912 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:30.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:30.928 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-01-31T06:53:31.311 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:31.324 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:31.324 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:31.584 INFO:teuthology.orchestra.run.smithi049.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:31.592 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/345 2024-01-31T06:53:31.592 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/345 2024-01-31T06:53:31.592 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:31.598 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:31.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:31.618 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-01-31T06:53:31.998 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:32.009 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:32.009 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:32.302 INFO:teuthology.orchestra.run.smithi049.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:32.310 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/346 2024-01-31T06:53:32.310 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/346 2024-01-31T06:53:32.310 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:32.317 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:32.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:32.380 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-01-31T06:53:32.756 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:32.764 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:32.764 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:33.497 INFO:teuthology.orchestra.run.smithi049.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:33.505 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/347 2024-01-31T06:53:33.505 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/347 2024-01-31T06:53:33.505 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:33.511 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:33.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:33.532 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-01-31T06:53:33.938 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:33.949 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:33.949 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:34.258 INFO:teuthology.orchestra.run.smithi049.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:34.267 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/348 2024-01-31T06:53:34.267 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/348 2024-01-31T06:53:34.267 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:34.274 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:34.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:34.296 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-01-31T06:53:34.652 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:34.662 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:34.662 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:36.505 INFO:teuthology.orchestra.run.smithi049.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-01-31T06:53:36.513 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/349 2024-01-31T06:53:36.513 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/349 2024-01-31T06:53:36.513 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:36.519 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:36.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:36.540 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-01-31T06:53:36.907 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:36.917 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:36.917 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:40.141 INFO:teuthology.orchestra.run.smithi049.stdout:generic/350 4s 2024-01-31T06:53:40.153 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/350 2024-01-31T06:53:40.153 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:40.159 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:40.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:40.177 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-01-31T06:53:40.548 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:40.558 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:40.558 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:42.280 INFO:teuthology.orchestra.run.smithi049.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-01-31T06:53:42.288 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/351 2024-01-31T06:53:42.288 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/351 2024-01-31T06:53:42.288 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:42.294 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:42.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:42.363 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-01-31T06:53:43.032 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:43.042 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:43.043 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:43.332 INFO:teuthology.orchestra.run.smithi049.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:43.340 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/352 2024-01-31T06:53:43.340 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/352 2024-01-31T06:53:43.340 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:43.346 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:43.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:43.368 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-01-31T06:53:43.728 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:43.739 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:43.739 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:44.017 INFO:teuthology.orchestra.run.smithi049.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:44.025 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/353 2024-01-31T06:53:44.026 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/353 2024-01-31T06:53:44.026 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:44.032 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:44.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:44.052 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-01-31T06:53:44.420 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:44.430 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:44.430 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:44.706 INFO:teuthology.orchestra.run.smithi049.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:44.714 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/354 2024-01-31T06:53:44.714 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/354 2024-01-31T06:53:44.714 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:44.720 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:44.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:44.740 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-01-31T06:53:45.121 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:45.131 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:45.131 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:47.020 INFO:teuthology.orchestra.run.smithi049.stdout:generic/355 2s 2024-01-31T06:53:47.032 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/355 2024-01-31T06:53:47.033 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:47.039 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:47.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:47.060 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-01-31T06:53:47.759 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:47.770 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:47.770 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:48.122 INFO:teuthology.orchestra.run.smithi049.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:48.130 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/356 2024-01-31T06:53:48.130 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/356 2024-01-31T06:53:48.130 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:48.136 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:48.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:48.156 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-01-31T06:53:48.535 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:48.547 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:48.547 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:48.867 INFO:teuthology.orchestra.run.smithi049.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:48.872 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/357 2024-01-31T06:53:48.872 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/357 2024-01-31T06:53:48.872 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:48.878 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:48.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:48.900 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-01-31T06:53:49.268 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:49.278 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:49.278 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:49.553 INFO:teuthology.orchestra.run.smithi049.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:49.561 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/358 2024-01-31T06:53:49.561 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/358 2024-01-31T06:53:49.561 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:49.567 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:49.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:49.587 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-01-31T06:53:49.959 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:49.969 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:49.969 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:50.262 INFO:teuthology.orchestra.run.smithi049.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:50.270 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/359 2024-01-31T06:53:50.270 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/359 2024-01-31T06:53:50.270 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:50.276 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:50.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:50.297 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-01-31T06:53:50.661 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:50.672 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:50.672 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:51.273 INFO:teuthology.orchestra.run.smithi049.stdout:generic/360 1s 2024-01-31T06:53:51.286 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/360 2024-01-31T06:53:51.286 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:51.292 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:51.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:51.312 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-01-31T06:53:51.668 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:51.678 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:51.678 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:52.116 INFO:teuthology.orchestra.run.smithi049.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:52.124 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/361 2024-01-31T06:53:52.124 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/361 2024-01-31T06:53:52.125 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:52.130 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:52.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:52.150 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-01-31T06:53:52.526 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:52.536 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:52.536 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:52.807 INFO:teuthology.orchestra.run.smithi049.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:52.815 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/362 2024-01-31T06:53:52.815 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/362 2024-01-31T06:53:52.816 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:52.822 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:52.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:52.841 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2024-01-31T06:53:53.203 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:53.213 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:53.213 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:53.509 INFO:teuthology.orchestra.run.smithi049.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:53.518 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/363 2024-01-31T06:53:53.518 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/363 2024-01-31T06:53:53.518 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:53.524 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:53.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:53.543 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2024-01-31T06:53:53.908 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:53.919 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:53.919 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:54.228 INFO:teuthology.orchestra.run.smithi049.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:54.236 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/364 2024-01-31T06:53:54.236 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/364 2024-01-31T06:53:54.236 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:54.242 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:54.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:54.263 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2024-01-31T06:53:54.658 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:54.668 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:54.668 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:54.944 INFO:teuthology.orchestra.run.smithi049.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:54.952 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/365 2024-01-31T06:53:54.952 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/365 2024-01-31T06:53:54.952 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:54.958 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:54.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:54.979 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2024-01-31T06:53:55.345 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:55.356 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:55.356 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:55.623 INFO:teuthology.orchestra.run.smithi049.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:55.631 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/366 2024-01-31T06:53:55.631 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/366 2024-01-31T06:53:55.631 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:55.637 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:55.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:55.657 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2024-01-31T06:53:56.016 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:56.027 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:56.027 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:56.302 INFO:teuthology.orchestra.run.smithi049.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:56.310 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/367 2024-01-31T06:53:56.310 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/367 2024-01-31T06:53:56.310 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:56.316 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:56.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:56.336 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2024-01-31T06:53:56.694 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:56.704 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:56.704 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:56.966 INFO:teuthology.orchestra.run.smithi049.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:56.975 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/368 2024-01-31T06:53:56.975 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/368 2024-01-31T06:53:56.975 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:56.981 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:57.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:57.001 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2024-01-31T06:53:57.368 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:57.378 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:57.378 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:57.658 INFO:teuthology.orchestra.run.smithi049.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:57.666 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/369 2024-01-31T06:53:57.666 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/369 2024-01-31T06:53:57.666 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:57.672 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:57.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:57.692 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2024-01-31T06:53:58.056 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:58.066 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:58.066 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:58.355 INFO:teuthology.orchestra.run.smithi049.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:58.364 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/370 2024-01-31T06:53:58.364 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/370 2024-01-31T06:53:58.364 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:58.370 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:58.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:58.390 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-01-31T06:53:58.739 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:58.749 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:58.749 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:59.054 INFO:teuthology.orchestra.run.smithi049.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:59.062 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/371 2024-01-31T06:53:59.062 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/371 2024-01-31T06:53:59.062 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:59.068 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:59.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:59.089 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-01-31T06:53:59.472 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:53:59.482 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:53:59.482 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:59.787 INFO:teuthology.orchestra.run.smithi049.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:53:59.795 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/372 2024-01-31T06:53:59.795 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/372 2024-01-31T06:53:59.795 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:53:59.801 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:53:59.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:53:59.822 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-01-31T06:54:00.192 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:54:00.202 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:54:00.202 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:00.483 INFO:teuthology.orchestra.run.smithi049.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:54:00.491 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/373 2024-01-31T06:54:00.491 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/373 2024-01-31T06:54:00.491 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:54:00.497 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:00.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:54:00.517 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-01-31T06:54:00.886 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:54:00.896 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:54:00.896 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:01.156 INFO:teuthology.orchestra.run.smithi049.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:54:01.164 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/374 2024-01-31T06:54:01.164 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/374 2024-01-31T06:54:01.164 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:54:01.170 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:01.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:54:01.189 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-01-31T06:54:01.550 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:54:01.561 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:54:01.561 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:01.935 INFO:teuthology.orchestra.run.smithi049.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-01-31T06:54:01.943 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/375 2024-01-31T06:54:01.943 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/375 2024-01-31T06:54:01.943 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:54:01.949 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:01.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:54:01.969 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-01-31T06:54:02.331 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:54:02.341 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:54:02.341 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:02.777 INFO:teuthology.orchestra.run.smithi049.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:54:02.785 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/376 2024-01-31T06:54:02.785 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/376 2024-01-31T06:54:02.786 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:54:02.792 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:02.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:54:02.811 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-01-31T06:54:03.173 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:54:03.183 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:54:03.184 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:03.461 INFO:teuthology.orchestra.run.smithi049.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:54:03.469 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/377 2024-01-31T06:54:03.469 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/377 2024-01-31T06:54:03.470 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:54:03.476 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:03.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:54:03.496 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-01-31T06:54:03.856 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:54:03.867 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:54:03.867 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:05.170 INFO:teuthology.orchestra.run.smithi049.stdout:generic/378 2s 2024-01-31T06:54:05.182 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/378 2024-01-31T06:54:05.183 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:54:05.188 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:05.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:54:05.255 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-01-31T06:54:05.931 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:54:05.942 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:54:05.942 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:06.309 INFO:teuthology.orchestra.run.smithi049.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:54:06.317 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/379 2024-01-31T06:54:06.317 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/379 2024-01-31T06:54:06.318 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:54:06.324 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:06.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:54:06.344 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-01-31T06:54:06.726 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:54:06.737 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:54:06.737 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:07.177 INFO:teuthology.orchestra.run.smithi049.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:54:07.187 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/380 2024-01-31T06:54:07.187 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/380 2024-01-31T06:54:07.187 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:54:07.194 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:07.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:54:07.215 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-01-31T06:54:07.572 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:54:07.583 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:54:07.583 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:07.861 INFO:teuthology.orchestra.run.smithi049.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:54:07.869 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/381 2024-01-31T06:54:07.869 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/381 2024-01-31T06:54:07.869 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:54:07.875 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:07.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:54:07.897 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-01-31T06:54:08.269 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:54:08.279 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:54:08.279 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:08.562 INFO:teuthology.orchestra.run.smithi049.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:54:08.570 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/382 2024-01-31T06:54:08.571 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/382 2024-01-31T06:54:08.571 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:54:08.577 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:08.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:54:08.600 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-01-31T06:54:08.978 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:54:08.988 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:54:08.988 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:09.269 INFO:teuthology.orchestra.run.smithi049.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:54:09.278 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/383 2024-01-31T06:54:09.278 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/383 2024-01-31T06:54:09.278 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:54:09.285 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:09.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:54:09.307 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-01-31T06:54:09.670 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:54:09.680 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:54:09.680 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:10.038 INFO:teuthology.orchestra.run.smithi049.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-01-31T06:54:10.046 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/384 2024-01-31T06:54:10.046 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/384 2024-01-31T06:54:10.046 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:54:10.052 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:10.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:54:10.072 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-01-31T06:54:10.449 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:54:10.460 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:54:10.460 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:10.760 INFO:teuthology.orchestra.run.smithi049.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:54:10.768 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/385 2024-01-31T06:54:10.768 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/385 2024-01-31T06:54:10.768 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:54:10.774 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:10.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:54:10.797 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-01-31T06:54:11.161 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:54:11.171 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:54:11.171 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:11.607 INFO:teuthology.orchestra.run.smithi049.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-01-31T06:54:11.616 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/386 2024-01-31T06:54:11.616 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/386 2024-01-31T06:54:11.616 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:54:11.622 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:11.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:54:11.642 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-01-31T06:54:12.022 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:54:12.032 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:54:12.032 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:12.307 INFO:teuthology.orchestra.run.smithi049.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:54:12.315 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/387 2024-01-31T06:54:12.315 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/387 2024-01-31T06:54:12.315 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:54:12.321 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:12.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:54:12.385 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-01-31T06:54:12.752 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:54:12.763 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:54:12.763 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:13.035 INFO:teuthology.orchestra.run.smithi049.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:54:13.043 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/388 2024-01-31T06:54:13.044 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/388 2024-01-31T06:54:13.044 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:54:13.051 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:13.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:54:13.072 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-01-31T06:54:13.433 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:54:13.443 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:54:13.443 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:13.758 INFO:teuthology.orchestra.run.smithi049.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-01-31T06:54:13.767 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/389 2024-01-31T06:54:13.767 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/389 2024-01-31T06:54:13.768 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:54:13.773 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:13.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:54:13.795 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-01-31T06:54:14.156 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:54:14.167 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:54:14.167 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:14.510 INFO:teuthology.orchestra.run.smithi049.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:54:14.518 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/390 2024-01-31T06:54:14.518 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/390 2024-01-31T06:54:14.518 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:54:14.524 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:14.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:54:14.544 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-01-31T06:54:14.906 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:54:14.916 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:54:14.917 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:58.807 INFO:teuthology.orchestra.run.smithi049.stdout:generic/391 44s 2024-01-31T06:54:59.347 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/391 2024-01-31T06:54:59.347 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:54:59.354 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:54:59.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:54:59.468 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-01-31T06:55:03.676 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:03.686 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:03.686 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:04.117 INFO:teuthology.orchestra.run.smithi049.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:04.125 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/392 2024-01-31T06:55:04.126 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/392 2024-01-31T06:55:04.126 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:04.131 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:04.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:04.152 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-01-31T06:55:04.543 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:04.553 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:04.553 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:04.830 INFO:teuthology.orchestra.run.smithi049.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:04.838 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/393 2024-01-31T06:55:04.838 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/393 2024-01-31T06:55:04.838 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:04.844 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:04.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:04.865 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-01-31T06:55:05.256 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:05.267 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:05.267 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:05.629 INFO:teuthology.orchestra.run.smithi049.stdout:generic/394 0s 2024-01-31T06:55:05.642 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/394 2024-01-31T06:55:05.642 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:05.648 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:05.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:05.675 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-01-31T06:55:06.516 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:06.528 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:06.528 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:06.968 INFO:teuthology.orchestra.run.smithi049.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:06.976 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/395 2024-01-31T06:55:06.976 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/395 2024-01-31T06:55:06.976 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:06.982 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:07.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:07.001 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-01-31T06:55:07.368 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:07.378 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:07.378 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:07.744 INFO:teuthology.orchestra.run.smithi049.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:07.753 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/396 2024-01-31T06:55:07.753 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/396 2024-01-31T06:55:07.753 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:07.759 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:07.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:07.780 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-01-31T06:55:08.138 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:08.149 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:08.149 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:08.562 INFO:teuthology.orchestra.run.smithi049.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:08.570 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/397 2024-01-31T06:55:08.570 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/397 2024-01-31T06:55:08.570 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:08.576 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:08.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:08.597 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-01-31T06:55:08.960 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:08.970 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:08.971 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:09.350 INFO:teuthology.orchestra.run.smithi049.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:09.358 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/398 2024-01-31T06:55:09.358 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/398 2024-01-31T06:55:09.358 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:09.364 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:09.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:09.384 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-01-31T06:55:09.750 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:09.761 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:09.761 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:10.089 INFO:teuthology.orchestra.run.smithi049.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:10.097 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/399 2024-01-31T06:55:10.098 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/399 2024-01-31T06:55:10.098 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:10.104 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:10.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:10.123 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-01-31T06:55:10.479 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:10.490 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:10.490 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:10.800 INFO:teuthology.orchestra.run.smithi049.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-01-31T06:55:10.808 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/400 2024-01-31T06:55:10.809 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/400 2024-01-31T06:55:10.809 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:10.815 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:10.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:10.836 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-01-31T06:55:11.211 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:11.222 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:11.222 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:11.515 INFO:teuthology.orchestra.run.smithi049.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:11.524 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/401 2024-01-31T06:55:11.524 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/401 2024-01-31T06:55:11.524 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:11.530 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:11.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:11.550 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-01-31T06:55:11.911 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:11.922 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:11.922 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:12.225 INFO:teuthology.orchestra.run.smithi049.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:12.233 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/402 2024-01-31T06:55:12.233 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/402 2024-01-31T06:55:12.233 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:12.239 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:12.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:12.258 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-01-31T06:55:12.619 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:12.629 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:12.629 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:12.916 INFO:teuthology.orchestra.run.smithi049.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:12.924 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/403 2024-01-31T06:55:12.924 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/403 2024-01-31T06:55:12.924 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:12.930 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:12.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:12.950 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-01-31T06:55:13.316 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:13.327 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:13.327 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:14.920 INFO:teuthology.orchestra.run.smithi049.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-01-31T06:55:14.929 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/404 2024-01-31T06:55:14.929 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/404 2024-01-31T06:55:14.929 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:14.935 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:15.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:15.050 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-01-31T06:55:15.673 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:15.683 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:15.683 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:16.159 INFO:teuthology.orchestra.run.smithi049.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:16.167 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/405 2024-01-31T06:55:16.167 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/405 2024-01-31T06:55:16.167 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:16.173 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:16.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:16.219 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-01-31T06:55:16.579 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:16.589 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:16.589 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:16.876 INFO:teuthology.orchestra.run.smithi049.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:16.884 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/406 2024-01-31T06:55:16.885 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/406 2024-01-31T06:55:16.885 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:16.890 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:16.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:16.910 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-01-31T06:55:17.278 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:17.288 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:17.288 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:17.743 INFO:teuthology.orchestra.run.smithi049.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:55:17.752 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/407 2024-01-31T06:55:17.752 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/407 2024-01-31T06:55:17.752 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:17.759 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:17.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:17.804 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-01-31T06:55:18.452 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:18.462 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:18.462 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:18.850 INFO:teuthology.orchestra.run.smithi049.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-01-31T06:55:18.859 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/408 2024-01-31T06:55:18.859 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/408 2024-01-31T06:55:18.859 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:18.868 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:19.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:19.101 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-01-31T06:55:19.625 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:19.634 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:19.634 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:19.921 INFO:teuthology.orchestra.run.smithi049.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:19.929 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/409 2024-01-31T06:55:19.929 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/409 2024-01-31T06:55:19.929 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:19.935 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:19.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:19.955 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-01-31T06:55:20.324 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:20.334 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:20.334 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:20.616 INFO:teuthology.orchestra.run.smithi049.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:20.624 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/410 2024-01-31T06:55:20.624 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/410 2024-01-31T06:55:20.625 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:20.631 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:20.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:20.651 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-01-31T06:55:21.019 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:21.029 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:21.029 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:21.342 INFO:teuthology.orchestra.run.smithi049.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:21.350 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/411 2024-01-31T06:55:21.350 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/411 2024-01-31T06:55:21.350 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:21.356 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:21.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:21.377 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-01-31T06:55:21.763 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:21.774 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:21.774 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:22.105 INFO:teuthology.orchestra.run.smithi049.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:22.114 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/412 2024-01-31T06:55:22.114 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/412 2024-01-31T06:55:22.114 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:22.121 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:22.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:22.176 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-01-31T06:55:22.555 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:22.565 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:22.565 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:22.870 INFO:teuthology.orchestra.run.smithi049.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:22.878 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/413 2024-01-31T06:55:22.879 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/413 2024-01-31T06:55:22.879 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:22.885 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:22.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:22.906 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-01-31T06:55:23.279 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:23.289 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:23.289 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:23.570 INFO:teuthology.orchestra.run.smithi049.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:23.578 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/414 2024-01-31T06:55:23.578 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/414 2024-01-31T06:55:23.578 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:23.584 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:23.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:23.606 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-01-31T06:55:23.970 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:23.981 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:23.981 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:24.258 INFO:teuthology.orchestra.run.smithi049.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:24.266 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/415 2024-01-31T06:55:24.266 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/415 2024-01-31T06:55:24.266 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:24.272 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:24.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:24.292 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-01-31T06:55:24.646 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:24.656 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:24.656 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:24.932 INFO:teuthology.orchestra.run.smithi049.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:24.940 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/416 2024-01-31T06:55:24.940 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/416 2024-01-31T06:55:24.940 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:24.946 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:24.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:24.966 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-01-31T06:55:25.327 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:25.337 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:25.337 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:25.607 INFO:teuthology.orchestra.run.smithi049.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:25.615 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/417 2024-01-31T06:55:25.615 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/417 2024-01-31T06:55:25.615 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:25.621 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:25.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:25.642 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-01-31T06:55:26.030 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:26.041 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:26.041 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:26.370 INFO:teuthology.orchestra.run.smithi049.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2024-01-31T06:55:26.378 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/418 2024-01-31T06:55:26.379 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/418 2024-01-31T06:55:26.379 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:26.385 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:26.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:26.451 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-01-31T06:55:26.811 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:26.822 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:26.822 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:27.168 INFO:teuthology.orchestra.run.smithi049.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:27.177 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/419 2024-01-31T06:55:27.177 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/419 2024-01-31T06:55:27.177 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:27.183 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:27.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:27.203 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-01-31T06:55:27.566 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:27.577 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:27.577 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:29.167 INFO:teuthology.orchestra.run.smithi049.stdout:generic/420 2s 2024-01-31T06:55:29.180 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/420 2024-01-31T06:55:29.180 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:29.186 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:29.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:29.234 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-01-31T06:55:29.899 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:29.909 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:29.909 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:30.260 INFO:teuthology.orchestra.run.smithi049.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:30.269 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/421 2024-01-31T06:55:30.269 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/421 2024-01-31T06:55:30.269 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:30.275 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:30.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:30.295 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-01-31T06:55:30.663 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:30.673 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:30.673 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:30.974 INFO:teuthology.orchestra.run.smithi049.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:30.982 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/422 2024-01-31T06:55:30.983 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/422 2024-01-31T06:55:30.983 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:30.988 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:31.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:31.008 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-01-31T06:55:31.368 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:31.379 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:31.379 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:31.958 INFO:teuthology.orchestra.run.smithi049.stdout:generic/423 0s 2024-01-31T06:55:31.971 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/423 2024-01-31T06:55:31.971 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:31.977 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:32.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:32.012 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-01-31T06:55:32.754 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:32.764 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:32.765 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:33.128 INFO:teuthology.orchestra.run.smithi049.stdout:generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i 2024-01-31T06:55:33.136 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/424 2024-01-31T06:55:33.136 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/424 2024-01-31T06:55:33.136 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:33.142 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:33.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:33.163 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-01-31T06:55:33.532 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:33.542 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:33.542 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:34.197 INFO:teuthology.orchestra.run.smithi049.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:55:34.205 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/425 2024-01-31T06:55:34.205 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/425 2024-01-31T06:55:34.205 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:55:34.211 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:55:34.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:55:34.231 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-01-31T06:55:34.582 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:55:34.593 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:55:34.593 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:19.296 INFO:teuthology.orchestra.run.smithi049.stdout:generic/426 - output mismatch (see /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/426.out.bad) 2024-01-31T06:56:19.325 INFO:teuthology.orchestra.run.smithi049.stdout: --- tests/generic/426.out 2024-01-31 05:06:00.907951904 +0000 2024-01-31T06:56:19.325 INFO:teuthology.orchestra.run.smithi049.stdout: +++ /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/426.out.bad 2024-01-31 06:56:19.280363648 +0000 2024-01-31T06:56:19.325 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -1,5 +1,263 @@ 2024-01-31T06:56:19.325 INFO:teuthology.orchestra.run.smithi049.stdout: QA output created by 426 2024-01-31T06:56:19.325 INFO:teuthology.orchestra.run.smithi049.stdout: test_file_handles TEST_DIR/426-dir -d 2024-01-31T06:56:19.325 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000766) opened an unlinked file! 2024-01-31T06:56:19.326 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000767) opened an unlinked file! 2024-01-31T06:56:19.326 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000768) opened an unlinked file! 2024-01-31T06:56:19.326 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000769) opened an unlinked file! 2024-01-31T06:56:19.326 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000770) opened an unlinked file! 2024-01-31T06:56:19.326 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000771) opened an unlinked file! 2024-01-31T06:56:19.326 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000772) opened an unlinked file! 2024-01-31T06:56:19.326 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000773) opened an unlinked file! 2024-01-31T06:56:19.326 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000774) opened an unlinked file! 2024-01-31T06:56:19.326 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000775) opened an unlinked file! 2024-01-31T06:56:19.326 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000776) opened an unlinked file! 2024-01-31T06:56:19.326 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000777) opened an unlinked file! 2024-01-31T06:56:19.326 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000778) opened an unlinked file! 2024-01-31T06:56:19.327 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000779) opened an unlinked file! 2024-01-31T06:56:19.327 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000780) opened an unlinked file! 2024-01-31T06:56:19.327 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000781) opened an unlinked file! 2024-01-31T06:56:19.327 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000782) opened an unlinked file! 2024-01-31T06:56:19.327 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000783) opened an unlinked file! 2024-01-31T06:56:19.327 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000784) opened an unlinked file! 2024-01-31T06:56:19.327 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000785) opened an unlinked file! 2024-01-31T06:56:19.327 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000786) opened an unlinked file! 2024-01-31T06:56:19.327 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000787) opened an unlinked file! 2024-01-31T06:56:19.328 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000788) opened an unlinked file! 2024-01-31T06:56:19.328 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000789) opened an unlinked file! 2024-01-31T06:56:19.328 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000790) opened an unlinked file! 2024-01-31T06:56:19.328 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000791) opened an unlinked file! 2024-01-31T06:56:19.328 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000792) opened an unlinked file! 2024-01-31T06:56:19.328 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000793) opened an unlinked file! 2024-01-31T06:56:19.328 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000794) opened an unlinked file! 2024-01-31T06:56:19.328 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000795) opened an unlinked file! 2024-01-31T06:56:19.328 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000796) opened an unlinked file! 2024-01-31T06:56:19.328 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000797) opened an unlinked file! 2024-01-31T06:56:19.328 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000798) opened an unlinked file! 2024-01-31T06:56:19.328 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000799) opened an unlinked file! 2024-01-31T06:56:19.328 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000800) opened an unlinked file! 2024-01-31T06:56:19.329 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000801) opened an unlinked file! 2024-01-31T06:56:19.329 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000802) opened an unlinked file! 2024-01-31T06:56:19.329 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000803) opened an unlinked file! 2024-01-31T06:56:19.329 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000804) opened an unlinked file! 2024-01-31T06:56:19.329 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000805) opened an unlinked file! 2024-01-31T06:56:19.329 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000806) opened an unlinked file! 2024-01-31T06:56:19.329 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000807) opened an unlinked file! 2024-01-31T06:56:19.329 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000808) opened an unlinked file! 2024-01-31T06:56:19.329 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000809) opened an unlinked file! 2024-01-31T06:56:19.329 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000810) opened an unlinked file! 2024-01-31T06:56:19.329 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000811) opened an unlinked file! 2024-01-31T06:56:19.329 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000812) opened an unlinked file! 2024-01-31T06:56:19.329 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000813) opened an unlinked file! 2024-01-31T06:56:19.330 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000814) opened an unlinked file! 2024-01-31T06:56:19.330 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000815) opened an unlinked file! 2024-01-31T06:56:19.330 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000816) opened an unlinked file! 2024-01-31T06:56:19.330 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000817) opened an unlinked file! 2024-01-31T06:56:19.330 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000818) opened an unlinked file! 2024-01-31T06:56:19.330 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000819) opened an unlinked file! 2024-01-31T06:56:19.330 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000820) opened an unlinked file! 2024-01-31T06:56:19.330 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000821) opened an unlinked file! 2024-01-31T06:56:19.330 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000822) opened an unlinked file! 2024-01-31T06:56:19.330 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000823) opened an unlinked file! 2024-01-31T06:56:19.330 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000824) opened an unlinked file! 2024-01-31T06:56:19.330 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000825) opened an unlinked file! 2024-01-31T06:56:19.330 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000826) opened an unlinked file! 2024-01-31T06:56:19.331 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000827) opened an unlinked file! 2024-01-31T06:56:19.331 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000828) opened an unlinked file! 2024-01-31T06:56:19.331 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000829) opened an unlinked file! 2024-01-31T06:56:19.331 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000830) opened an unlinked file! 2024-01-31T06:56:19.331 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000831) opened an unlinked file! 2024-01-31T06:56:19.331 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000832) opened an unlinked file! 2024-01-31T06:56:19.331 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000833) opened an unlinked file! 2024-01-31T06:56:19.331 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000834) opened an unlinked file! 2024-01-31T06:56:19.331 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000835) opened an unlinked file! 2024-01-31T06:56:19.332 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000836) opened an unlinked file! 2024-01-31T06:56:19.332 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000837) opened an unlinked file! 2024-01-31T06:56:19.332 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000838) opened an unlinked file! 2024-01-31T06:56:19.332 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000839) opened an unlinked file! 2024-01-31T06:56:19.332 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000840) opened an unlinked file! 2024-01-31T06:56:19.332 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000841) opened an unlinked file! 2024-01-31T06:56:19.332 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000842) opened an unlinked file! 2024-01-31T06:56:19.332 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000843) opened an unlinked file! 2024-01-31T06:56:19.332 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000844) opened an unlinked file! 2024-01-31T06:56:19.332 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000845) opened an unlinked file! 2024-01-31T06:56:19.332 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000846) opened an unlinked file! 2024-01-31T06:56:19.332 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000847) opened an unlinked file! 2024-01-31T06:56:19.333 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000848) opened an unlinked file! 2024-01-31T06:56:19.333 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000849) opened an unlinked file! 2024-01-31T06:56:19.333 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000850) opened an unlinked file! 2024-01-31T06:56:19.333 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000851) opened an unlinked file! 2024-01-31T06:56:19.333 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000852) opened an unlinked file! 2024-01-31T06:56:19.333 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000853) opened an unlinked file! 2024-01-31T06:56:19.333 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000854) opened an unlinked file! 2024-01-31T06:56:19.334 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000855) opened an unlinked file! 2024-01-31T06:56:19.334 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000856) opened an unlinked file! 2024-01-31T06:56:19.335 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000857) opened an unlinked file! 2024-01-31T06:56:19.335 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000858) opened an unlinked file! 2024-01-31T06:56:19.335 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000859) opened an unlinked file! 2024-01-31T06:56:19.335 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000860) opened an unlinked file! 2024-01-31T06:56:19.335 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000861) opened an unlinked file! 2024-01-31T06:56:19.335 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000862) opened an unlinked file! 2024-01-31T06:56:19.335 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000863) opened an unlinked file! 2024-01-31T06:56:19.335 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000864) opened an unlinked file! 2024-01-31T06:56:19.335 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000865) opened an unlinked file! 2024-01-31T06:56:19.335 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000866) opened an unlinked file! 2024-01-31T06:56:19.336 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000867) opened an unlinked file! 2024-01-31T06:56:19.336 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000868) opened an unlinked file! 2024-01-31T06:56:19.336 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000869) opened an unlinked file! 2024-01-31T06:56:19.336 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000870) opened an unlinked file! 2024-01-31T06:56:19.336 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000871) opened an unlinked file! 2024-01-31T06:56:19.336 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000872) opened an unlinked file! 2024-01-31T06:56:19.336 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000873) opened an unlinked file! 2024-01-31T06:56:19.336 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000874) opened an unlinked file! 2024-01-31T06:56:19.336 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000875) opened an unlinked file! 2024-01-31T06:56:19.336 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000876) opened an unlinked file! 2024-01-31T06:56:19.337 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000877) opened an unlinked file! 2024-01-31T06:56:19.337 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000878) opened an unlinked file! 2024-01-31T06:56:19.337 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000879) opened an unlinked file! 2024-01-31T06:56:19.337 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000880) opened an unlinked file! 2024-01-31T06:56:19.337 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000881) opened an unlinked file! 2024-01-31T06:56:19.337 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000882) opened an unlinked file! 2024-01-31T06:56:19.337 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000883) opened an unlinked file! 2024-01-31T06:56:19.337 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000884) opened an unlinked file! 2024-01-31T06:56:19.337 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000885) opened an unlinked file! 2024-01-31T06:56:19.337 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000886) opened an unlinked file! 2024-01-31T06:56:19.337 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000887) opened an unlinked file! 2024-01-31T06:56:19.337 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000888) opened an unlinked file! 2024-01-31T06:56:19.338 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000889) opened an unlinked file! 2024-01-31T06:56:19.338 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000890) opened an unlinked file! 2024-01-31T06:56:19.338 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000891) opened an unlinked file! 2024-01-31T06:56:19.338 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000892) opened an unlinked file! 2024-01-31T06:56:19.338 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000893) opened an unlinked file! 2024-01-31T06:56:19.338 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000894) opened an unlinked file! 2024-01-31T06:56:19.338 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000895) opened an unlinked file! 2024-01-31T06:56:19.338 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000896) opened an unlinked file! 2024-01-31T06:56:19.338 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000897) opened an unlinked file! 2024-01-31T06:56:19.338 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000898) opened an unlinked file! 2024-01-31T06:56:19.338 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000899) opened an unlinked file! 2024-01-31T06:56:19.338 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000900) opened an unlinked file! 2024-01-31T06:56:19.339 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000901) opened an unlinked file! 2024-01-31T06:56:19.339 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000902) opened an unlinked file! 2024-01-31T06:56:19.339 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000903) opened an unlinked file! 2024-01-31T06:56:19.339 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000904) opened an unlinked file! 2024-01-31T06:56:19.339 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000905) opened an unlinked file! 2024-01-31T06:56:19.339 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000906) opened an unlinked file! 2024-01-31T06:56:19.339 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000907) opened an unlinked file! 2024-01-31T06:56:19.339 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000908) opened an unlinked file! 2024-01-31T06:56:19.340 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000909) opened an unlinked file! 2024-01-31T06:56:19.340 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000910) opened an unlinked file! 2024-01-31T06:56:19.340 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000911) opened an unlinked file! 2024-01-31T06:56:19.340 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000912) opened an unlinked file! 2024-01-31T06:56:19.340 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000913) opened an unlinked file! 2024-01-31T06:56:19.340 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000914) opened an unlinked file! 2024-01-31T06:56:19.340 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000915) opened an unlinked file! 2024-01-31T06:56:19.340 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000916) opened an unlinked file! 2024-01-31T06:56:19.340 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000917) opened an unlinked file! 2024-01-31T06:56:19.340 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000918) opened an unlinked file! 2024-01-31T06:56:19.340 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000919) opened an unlinked file! 2024-01-31T06:56:19.340 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000920) opened an unlinked file! 2024-01-31T06:56:19.341 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000921) opened an unlinked file! 2024-01-31T06:56:19.341 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000922) opened an unlinked file! 2024-01-31T06:56:19.341 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000923) opened an unlinked file! 2024-01-31T06:56:19.341 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000924) opened an unlinked file! 2024-01-31T06:56:19.341 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000925) opened an unlinked file! 2024-01-31T06:56:19.341 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000926) opened an unlinked file! 2024-01-31T06:56:19.341 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000927) opened an unlinked file! 2024-01-31T06:56:19.341 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000928) opened an unlinked file! 2024-01-31T06:56:19.341 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000929) opened an unlinked file! 2024-01-31T06:56:19.341 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000930) opened an unlinked file! 2024-01-31T06:56:19.341 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000931) opened an unlinked file! 2024-01-31T06:56:19.342 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000932) opened an unlinked file! 2024-01-31T06:56:19.342 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000933) opened an unlinked file! 2024-01-31T06:56:19.342 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000934) opened an unlinked file! 2024-01-31T06:56:19.342 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000935) opened an unlinked file! 2024-01-31T06:56:19.342 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000936) opened an unlinked file! 2024-01-31T06:56:19.342 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000937) opened an unlinked file! 2024-01-31T06:56:19.342 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000938) opened an unlinked file! 2024-01-31T06:56:19.342 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000939) opened an unlinked file! 2024-01-31T06:56:19.342 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000940) opened an unlinked file! 2024-01-31T06:56:19.342 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000941) opened an unlinked file! 2024-01-31T06:56:19.342 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000942) opened an unlinked file! 2024-01-31T06:56:19.343 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000943) opened an unlinked file! 2024-01-31T06:56:19.343 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000944) opened an unlinked file! 2024-01-31T06:56:19.343 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000945) opened an unlinked file! 2024-01-31T06:56:19.343 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000946) opened an unlinked file! 2024-01-31T06:56:19.343 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000947) opened an unlinked file! 2024-01-31T06:56:19.343 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000948) opened an unlinked file! 2024-01-31T06:56:19.343 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000949) opened an unlinked file! 2024-01-31T06:56:19.343 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000950) opened an unlinked file! 2024-01-31T06:56:19.343 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000951) opened an unlinked file! 2024-01-31T06:56:19.343 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000952) opened an unlinked file! 2024-01-31T06:56:19.344 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000953) opened an unlinked file! 2024-01-31T06:56:19.344 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000954) opened an unlinked file! 2024-01-31T06:56:19.344 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000955) opened an unlinked file! 2024-01-31T06:56:19.344 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000956) opened an unlinked file! 2024-01-31T06:56:19.344 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000957) opened an unlinked file! 2024-01-31T06:56:19.344 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000958) opened an unlinked file! 2024-01-31T06:56:19.344 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000959) opened an unlinked file! 2024-01-31T06:56:19.344 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000960) opened an unlinked file! 2024-01-31T06:56:19.344 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000961) opened an unlinked file! 2024-01-31T06:56:19.345 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000962) opened an unlinked file! 2024-01-31T06:56:19.345 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000963) opened an unlinked file! 2024-01-31T06:56:19.345 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000964) opened an unlinked file! 2024-01-31T06:56:19.345 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000965) opened an unlinked file! 2024-01-31T06:56:19.345 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000966) opened an unlinked file! 2024-01-31T06:56:19.345 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000967) opened an unlinked file! 2024-01-31T06:56:19.345 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000968) opened an unlinked file! 2024-01-31T06:56:19.345 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000969) opened an unlinked file! 2024-01-31T06:56:19.345 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000970) opened an unlinked file! 2024-01-31T06:56:19.345 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000971) opened an unlinked file! 2024-01-31T06:56:19.345 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000972) opened an unlinked file! 2024-01-31T06:56:19.346 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000973) opened an unlinked file! 2024-01-31T06:56:19.346 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000974) opened an unlinked file! 2024-01-31T06:56:19.346 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000975) opened an unlinked file! 2024-01-31T06:56:19.346 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000976) opened an unlinked file! 2024-01-31T06:56:19.346 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000977) opened an unlinked file! 2024-01-31T06:56:19.346 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000978) opened an unlinked file! 2024-01-31T06:56:19.346 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000979) opened an unlinked file! 2024-01-31T06:56:19.346 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000980) opened an unlinked file! 2024-01-31T06:56:19.346 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000981) opened an unlinked file! 2024-01-31T06:56:19.346 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000982) opened an unlinked file! 2024-01-31T06:56:19.346 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000983) opened an unlinked file! 2024-01-31T06:56:19.346 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000984) opened an unlinked file! 2024-01-31T06:56:19.346 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000985) opened an unlinked file! 2024-01-31T06:56:19.346 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000986) opened an unlinked file! 2024-01-31T06:56:19.347 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000987) opened an unlinked file! 2024-01-31T06:56:19.347 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000988) opened an unlinked file! 2024-01-31T06:56:19.347 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000989) opened an unlinked file! 2024-01-31T06:56:19.347 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000990) opened an unlinked file! 2024-01-31T06:56:19.347 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000991) opened an unlinked file! 2024-01-31T06:56:19.347 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000992) opened an unlinked file! 2024-01-31T06:56:19.347 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000993) opened an unlinked file! 2024-01-31T06:56:19.347 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000994) opened an unlinked file! 2024-01-31T06:56:19.347 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000995) opened an unlinked file! 2024-01-31T06:56:19.347 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000996) opened an unlinked file! 2024-01-31T06:56:19.347 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000997) opened an unlinked file! 2024-01-31T06:56:19.347 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000998) opened an unlinked file! 2024-01-31T06:56:19.347 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file000999) opened an unlinked file! 2024-01-31T06:56:19.347 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001000) opened an unlinked file! 2024-01-31T06:56:19.348 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001001) opened an unlinked file! 2024-01-31T06:56:19.348 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001002) opened an unlinked file! 2024-01-31T06:56:19.348 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001003) opened an unlinked file! 2024-01-31T06:56:19.348 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001004) opened an unlinked file! 2024-01-31T06:56:19.348 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001005) opened an unlinked file! 2024-01-31T06:56:19.348 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001006) opened an unlinked file! 2024-01-31T06:56:19.348 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001007) opened an unlinked file! 2024-01-31T06:56:19.348 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001008) opened an unlinked file! 2024-01-31T06:56:19.348 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001009) opened an unlinked file! 2024-01-31T06:56:19.349 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001010) opened an unlinked file! 2024-01-31T06:56:19.349 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001011) opened an unlinked file! 2024-01-31T06:56:19.349 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001012) opened an unlinked file! 2024-01-31T06:56:19.349 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001013) opened an unlinked file! 2024-01-31T06:56:19.349 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001014) opened an unlinked file! 2024-01-31T06:56:19.349 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001015) opened an unlinked file! 2024-01-31T06:56:19.349 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001016) opened an unlinked file! 2024-01-31T06:56:19.349 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001017) opened an unlinked file! 2024-01-31T06:56:19.349 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001018) opened an unlinked file! 2024-01-31T06:56:19.349 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001019) opened an unlinked file! 2024-01-31T06:56:19.349 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001020) opened an unlinked file! 2024-01-31T06:56:19.349 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001021) opened an unlinked file! 2024-01-31T06:56:19.349 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001022) opened an unlinked file! 2024-01-31T06:56:19.349 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/426-dir/file001023) opened an unlinked file! 2024-01-31T06:56:19.350 INFO:teuthology.orchestra.run.smithi049.stdout: test_file_handles TEST_DIR/426-dir 2024-01-31T06:56:19.350 INFO:teuthology.orchestra.run.smithi049.stdout: test_file_handles TEST_DIR/426-dir -l 2024-01-31T06:56:19.350 INFO:teuthology.orchestra.run.smithi049.stdout: test_file_handles TEST_DIR/426-dir -u 2024-01-31T06:56:19.350 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/426 2024-01-31T06:56:19.350 INFO:teuthology.orchestra.run.smithi049.stdout:Failures: generic/426 2024-01-31T06:56:19.350 INFO:teuthology.orchestra.run.smithi049.stdout:Failed 1 of 1 tests 2024-01-31T06:56:19.385 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:19.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T06:56:19.444 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-01-31T06:56:19.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-01-31T06:56:19.445 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-01-31T06:56:21.202 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:56:21.212 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:56:21.212 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:21.546 INFO:teuthology.orchestra.run.smithi049.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:56:21.554 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/427 2024-01-31T06:56:21.554 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/427 2024-01-31T06:56:21.554 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:56:21.560 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:21.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:56:21.579 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-01-31T06:56:21.935 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:56:21.945 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:56:21.945 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:22.361 INFO:teuthology.orchestra.run.smithi049.stdout:generic/428 1s 2024-01-31T06:56:22.383 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/428 2024-01-31T06:56:22.384 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:56:22.389 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:22.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:56:22.410 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-01-31T06:56:22.771 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:56:22.781 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:56:22.782 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:23.128 INFO:teuthology.orchestra.run.smithi049.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:56:23.136 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/429 2024-01-31T06:56:23.136 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/429 2024-01-31T06:56:23.136 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:56:23.142 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:23.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:56:23.161 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-01-31T06:56:23.523 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:56:23.534 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:56:23.534 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:24.088 INFO:teuthology.orchestra.run.smithi049.stdout:generic/430 1s 2024-01-31T06:56:24.100 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/430 2024-01-31T06:56:24.100 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:56:24.106 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:24.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:56:24.127 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-01-31T06:56:24.779 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:56:24.789 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:56:24.789 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:25.271 INFO:teuthology.orchestra.run.smithi049.stdout:generic/431 1s 2024-01-31T06:56:25.283 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/431 2024-01-31T06:56:25.283 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:56:25.289 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:25.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:56:25.310 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-01-31T06:56:25.959 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:56:25.969 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:56:25.970 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:26.488 INFO:teuthology.orchestra.run.smithi049.stdout:generic/432 1s 2024-01-31T06:56:26.500 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/432 2024-01-31T06:56:26.500 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:56:26.506 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:26.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:56:26.633 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-01-31T06:56:27.178 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:56:27.189 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:56:27.189 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:27.653 INFO:teuthology.orchestra.run.smithi049.stdout:generic/433 0s 2024-01-31T06:56:27.665 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/433 2024-01-31T06:56:27.665 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:56:27.671 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:27.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:56:27.692 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-01-31T06:56:28.332 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:56:28.342 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:56:28.343 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:28.804 INFO:teuthology.orchestra.run.smithi049.stdout:generic/434 - output mismatch (see /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/434.out.bad) 2024-01-31T06:56:28.809 INFO:teuthology.orchestra.run.smithi049.stdout: --- tests/generic/434.out 2024-01-31 05:06:00.907951904 +0000 2024-01-31T06:56:28.809 INFO:teuthology.orchestra.run.smithi049.stdout: +++ /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/434.out.bad 2024-01-31 06:56:28.800119479 +0000 2024-01-31T06:56:28.810 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -9,6 +9,6 @@ 2024-01-31T06:56:28.810 INFO:teuthology.orchestra.run.smithi049.stdout: copy_range: Bad file descriptor 2024-01-31T06:56:28.810 INFO:teuthology.orchestra.run.smithi049.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2024-01-31T06:56:28.810 INFO:teuthology.orchestra.run.smithi049.stdout: Try to copy to a device 2024-01-31T06:56:28.810 INFO:teuthology.orchestra.run.smithi049.stdout: -copy_range: Invalid argument 2024-01-31T06:56:28.810 INFO:teuthology.orchestra.run.smithi049.stdout: +/tmp/tmp.ULOG6qSi2atest/test-434/dev1: Permission denied 2024-01-31T06:56:28.810 INFO:teuthology.orchestra.run.smithi049.stdout: Try to copy to a fifo 2024-01-31T06:56:28.810 INFO:teuthology.orchestra.run.smithi049.stdout: copy_range: Invalid argument 2024-01-31T06:56:28.815 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/434 2024-01-31T06:56:28.815 INFO:teuthology.orchestra.run.smithi049.stdout:Failures: generic/434 2024-01-31T06:56:28.815 INFO:teuthology.orchestra.run.smithi049.stdout:Failed 1 of 1 tests 2024-01-31T06:56:28.821 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:29.002 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T06:56:29.003 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-01-31T06:56:29.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-01-31T06:56:29.003 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-01-31T06:56:29.530 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:56:29.541 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:56:29.541 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:29.886 INFO:teuthology.orchestra.run.smithi049.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:56:29.894 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/435 2024-01-31T06:56:29.894 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/435 2024-01-31T06:56:29.894 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:56:29.900 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:29.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:56:29.920 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-01-31T06:56:30.288 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:56:30.298 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:56:30.298 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:31.464 INFO:teuthology.orchestra.run.smithi049.stdout:generic/436 1s 2024-01-31T06:56:31.477 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/436 2024-01-31T06:56:31.477 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:56:31.483 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:31.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:56:31.692 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-01-31T06:56:32.203 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:56:32.213 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:56:32.213 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:33.321 INFO:teuthology.orchestra.run.smithi049.stdout:generic/437 1s 2024-01-31T06:56:33.333 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/437 2024-01-31T06:56:33.333 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:56:33.340 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:33.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:56:33.359 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-01-31T06:56:33.723 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:56:33.734 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:56:33.734 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:56:42.388 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:56:42.391 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:57:12.753 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:57:12.757 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T06:57:12.796 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T06:57:12.800+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33272) UID: 0 2024-01-31T06:57:12.797 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T06:57:12.800+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33272) UID: 0 2024-01-31T06:57:12.797 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T06:57:12.800+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33272) UID: 0 2024-01-31T06:57:12.797 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T06:57:12.800+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33272) UID: 0 2024-01-31T06:58:16.508 INFO:teuthology.orchestra.run.smithi049.stdout:generic/438 103s 2024-01-31T06:58:16.519 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/438 2024-01-31T06:58:16.519 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:16.525 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:16.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:16.596 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-01-31T06:58:16.971 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:16.981 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:16.981 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:17.267 INFO:teuthology.orchestra.run.smithi049.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:17.275 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/439 2024-01-31T06:58:17.275 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/439 2024-01-31T06:58:17.275 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:17.281 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:17.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:17.300 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-01-31T06:58:17.668 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:17.678 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:17.678 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:18.011 INFO:teuthology.orchestra.run.smithi049.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:18.019 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/440 2024-01-31T06:58:18.019 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/440 2024-01-31T06:58:18.019 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:18.025 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:18.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:18.044 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-01-31T06:58:18.399 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:18.409 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:18.409 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:18.779 INFO:teuthology.orchestra.run.smithi049.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:18.787 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/441 2024-01-31T06:58:18.787 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/441 2024-01-31T06:58:18.787 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:18.793 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:18.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:18.812 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-01-31T06:58:19.190 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:19.200 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:19.200 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:19.510 INFO:teuthology.orchestra.run.smithi049.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:19.518 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/442 2024-01-31T06:58:19.518 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/442 2024-01-31T06:58:19.518 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:19.525 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:19.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:19.543 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-01-31T06:58:19.907 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:19.917 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:19.917 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:20.252 INFO:teuthology.orchestra.run.smithi049.stdout:generic/443 1s 2024-01-31T06:58:20.264 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/443 2024-01-31T06:58:20.264 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:20.270 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:20.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:20.289 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-01-31T06:58:20.644 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:20.654 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:20.654 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:20.990 INFO:teuthology.orchestra.run.smithi049.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-01-31T06:58:20.998 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/444 2024-01-31T06:58:20.998 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/444 2024-01-31T06:58:20.998 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:21.004 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:21.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:21.023 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-01-31T06:58:21.387 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:21.397 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:21.397 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:22.616 INFO:teuthology.orchestra.run.smithi049.stdout:generic/445 1s 2024-01-31T06:58:22.628 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/445 2024-01-31T06:58:22.629 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:22.634 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:22.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:22.819 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-01-31T06:58:23.340 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:23.351 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:23.351 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:23.630 INFO:teuthology.orchestra.run.smithi049.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:23.638 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/446 2024-01-31T06:58:23.638 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/446 2024-01-31T06:58:23.638 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:23.645 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:23.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:23.695 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-01-31T06:58:24.059 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:24.070 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:24.070 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:24.340 INFO:teuthology.orchestra.run.smithi049.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:24.349 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/447 2024-01-31T06:58:24.349 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/447 2024-01-31T06:58:24.349 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:24.355 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:24.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:24.374 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-01-31T06:58:24.728 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:24.738 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:24.738 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:25.931 INFO:teuthology.orchestra.run.smithi049.stdout:generic/448 1s 2024-01-31T06:58:25.943 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/448 2024-01-31T06:58:25.943 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:25.949 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:26.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:26.208 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-01-31T06:58:26.649 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:26.661 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:26.661 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:26.950 INFO:teuthology.orchestra.run.smithi049.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:26.958 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/449 2024-01-31T06:58:26.958 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/449 2024-01-31T06:58:26.958 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:26.964 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:27.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:27.039 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-01-31T06:58:27.403 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:27.413 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:27.413 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:28.943 INFO:teuthology.orchestra.run.smithi049.stdout:generic/450 1s 2024-01-31T06:58:28.955 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/450 2024-01-31T06:58:28.955 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:28.962 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:29.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:29.089 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-01-31T06:58:29.661 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:29.671 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:29.672 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:30.310 INFO:teuthology.orchestra.run.smithi049.stdout:generic/451 - output mismatch (see /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/451.out.bad) 2024-01-31T06:58:30.315 INFO:teuthology.orchestra.run.smithi049.stdout: --- tests/generic/451.out 2024-01-31 05:06:00.911951819 +0000 2024-01-31T06:58:30.316 INFO:teuthology.orchestra.run.smithi049.stdout: +++ /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/451.out.bad 2024-01-31 06:58:30.309012918 +0000 2024-01-31T06:58:30.316 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -1,2 +1,9 @@ 2024-01-31T06:58:30.316 INFO:teuthology.orchestra.run.smithi049.stdout: QA output created by 451 2024-01-31T06:58:30.316 INFO:teuthology.orchestra.run.smithi049.stdout: +get stale data from buffer read 2024-01-31T06:58:30.316 INFO:teuthology.orchestra.run.smithi049.stdout: +00000000 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 UUUUUUUUUUUUUUUU 2024-01-31T06:58:30.316 INFO:teuthology.orchestra.run.smithi049.stdout: +* 2024-01-31T06:58:30.316 INFO:teuthology.orchestra.run.smithi049.stdout: +00080000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 2024-01-31T06:58:30.316 INFO:teuthology.orchestra.run.smithi049.stdout: +* 2024-01-31T06:58:30.316 INFO:teuthology.orchestra.run.smithi049.stdout: +00088000 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 UUUUUUUUUUUUUUUU 2024-01-31T06:58:30.316 INFO:teuthology.orchestra.run.smithi049.stdout: +000a0000 2024-01-31T06:58:30.316 INFO:teuthology.orchestra.run.smithi049.stdout: Silence is golden 2024-01-31T06:58:30.321 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/451 2024-01-31T06:58:30.321 INFO:teuthology.orchestra.run.smithi049.stdout:Failures: generic/451 2024-01-31T06:58:30.321 INFO:teuthology.orchestra.run.smithi049.stdout:Failed 1 of 1 tests 2024-01-31T06:58:30.327 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:30.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T06:58:30.503 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-01-31T06:58:30.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-01-31T06:58:30.504 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-01-31T06:58:31.062 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:31.072 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:31.073 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:31.345 INFO:teuthology.orchestra.run.smithi049.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:31.353 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/452 2024-01-31T06:58:31.353 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/452 2024-01-31T06:58:31.353 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:31.359 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:31.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:31.379 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-01-31T06:58:31.723 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:31.733 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:31.734 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:32.015 INFO:teuthology.orchestra.run.smithi049.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:32.023 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/453 2024-01-31T06:58:32.023 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/453 2024-01-31T06:58:32.024 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:32.029 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:32.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:32.048 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-01-31T06:58:32.416 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:32.426 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:32.426 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:32.726 INFO:teuthology.orchestra.run.smithi049.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:32.736 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/454 2024-01-31T06:58:32.736 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/454 2024-01-31T06:58:32.736 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:32.740 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:32.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:32.759 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-01-31T06:58:33.118 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:33.129 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:33.129 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:33.513 INFO:teuthology.orchestra.run.smithi049.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:33.521 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/455 2024-01-31T06:58:33.521 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/455 2024-01-31T06:58:33.521 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:33.527 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:33.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:33.547 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-01-31T06:58:33.915 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:33.925 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:33.925 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:34.236 INFO:teuthology.orchestra.run.smithi049.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:34.245 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/456 2024-01-31T06:58:34.245 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/456 2024-01-31T06:58:34.245 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:34.251 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:34.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:34.271 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-01-31T06:58:34.627 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:34.637 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:34.637 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:34.990 INFO:teuthology.orchestra.run.smithi049.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:34.998 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/457 2024-01-31T06:58:34.998 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/457 2024-01-31T06:58:34.998 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:35.004 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:35.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:35.024 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-01-31T06:58:35.395 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:35.406 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:35.406 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:35.686 INFO:teuthology.orchestra.run.smithi049.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:35.695 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/458 2024-01-31T06:58:35.695 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/458 2024-01-31T06:58:35.695 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:35.701 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:35.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:35.720 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-01-31T06:58:36.099 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:36.109 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:36.109 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:36.543 INFO:teuthology.orchestra.run.smithi049.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:36.551 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/459 2024-01-31T06:58:36.551 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/459 2024-01-31T06:58:36.551 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:36.557 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:36.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:36.577 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-01-31T06:58:36.935 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:36.945 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:36.946 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:37.215 INFO:teuthology.orchestra.run.smithi049.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:37.223 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/460 2024-01-31T06:58:37.223 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/460 2024-01-31T06:58:37.223 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:37.229 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:37.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:37.249 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-01-31T06:58:37.607 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:37.617 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:37.617 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:37.903 INFO:teuthology.orchestra.run.smithi049.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:37.911 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/461 2024-01-31T06:58:37.911 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/461 2024-01-31T06:58:37.911 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:37.917 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:37.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:37.984 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-01-31T06:58:38.347 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:38.357 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:38.357 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:38.651 INFO:teuthology.orchestra.run.smithi049.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:38.659 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/462 2024-01-31T06:58:38.660 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/462 2024-01-31T06:58:38.660 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:38.665 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:38.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:38.684 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-01-31T06:58:39.064 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:39.074 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:39.074 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:39.445 INFO:teuthology.orchestra.run.smithi049.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T06:58:39.454 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/463 2024-01-31T06:58:39.454 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/463 2024-01-31T06:58:39.454 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:39.460 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:39.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:39.488 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-01-31T06:58:40.131 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:40.141 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:40.142 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:40.409 INFO:teuthology.orchestra.run.smithi049.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:40.417 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/464 2024-01-31T06:58:40.417 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/464 2024-01-31T06:58:40.417 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:40.423 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:40.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:40.442 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-01-31T06:58:40.794 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:40.805 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:40.805 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:52.567 INFO:teuthology.orchestra.run.smithi049.stdout:generic/465 12s 2024-01-31T06:58:52.616 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/465 2024-01-31T06:58:52.616 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:52.684 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:52.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:52.789 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-01-31T06:58:53.239 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:53.249 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:53.249 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:53.523 INFO:teuthology.orchestra.run.smithi049.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:58:53.531 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/466 2024-01-31T06:58:53.532 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/466 2024-01-31T06:58:53.532 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:58:53.537 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:58:53.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:58:53.556 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-01-31T06:58:53.919 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:58:53.929 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:58:53.930 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:59:01.782 INFO:teuthology.orchestra.run.smithi049.stdout:generic/467 - output mismatch (see /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/467.out.bad) 2024-01-31T06:59:01.798 INFO:teuthology.orchestra.run.smithi049.stdout: --- tests/generic/467.out 2024-01-31 05:06:00.911951819 +0000 2024-01-31T06:59:01.798 INFO:teuthology.orchestra.run.smithi049.stdout: +++ /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/467.out.bad 2024-01-31 06:59:01.768211471 +0000 2024-01-31T06:59:01.798 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -1,5 +1,15 @@ 2024-01-31T06:59:01.798 INFO:teuthology.orchestra.run.smithi049.stdout: QA output created by 467 2024-01-31T06:59:01.798 INFO:teuthology.orchestra.run.smithi049.stdout: test_file_handles TEST_DIR/467-dir -dp 2024-01-31T06:59:01.798 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/467-dir/file000000) opened an unlinked file! 2024-01-31T06:59:01.798 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/467-dir/file000001) opened an unlinked file! 2024-01-31T06:59:01.798 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/467-dir/file000002) opened an unlinked file! 2024-01-31T06:59:01.798 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/467-dir/file000003) opened an unlinked file! 2024-01-31T06:59:01.798 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/467-dir/file000004) opened an unlinked file! 2024-01-31T06:59:01.799 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/467-dir/file000005) opened an unlinked file! 2024-01-31T06:59:01.799 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/467-dir/file000006) opened an unlinked file! 2024-01-31T06:59:01.799 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/467-dir/file000007) opened an unlinked file! 2024-01-31T06:59:01.799 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/467-dir/file000008) opened an unlinked file! 2024-01-31T06:59:01.799 INFO:teuthology.orchestra.run.smithi049.stdout: +open_by_handle(/tmp/tmp.ULOG6qSi2atest/467-dir/file000009) opened an unlinked file! 2024-01-31T06:59:01.799 INFO:teuthology.orchestra.run.smithi049.stdout: test_file_handles TEST_DIR/467-dir -rp 2024-01-31T06:59:01.799 INFO:teuthology.orchestra.run.smithi049.stdout: test_file_handles TEST_DIR/467-dir -dkr 2024-01-31T06:59:01.799 INFO:teuthology.orchestra.run.smithi049.stdout: test_file_handles TEST_DIR/467-dir -lr 2024-01-31T06:59:01.811 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/467 2024-01-31T06:59:01.811 INFO:teuthology.orchestra.run.smithi049.stdout:Failures: generic/467 2024-01-31T06:59:01.811 INFO:teuthology.orchestra.run.smithi049.stdout:Failed 1 of 1 tests 2024-01-31T06:59:01.840 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:59:01.960 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T06:59:01.961 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-01-31T06:59:01.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-01-31T06:59:01.961 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-01-31T06:59:03.791 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:59:03.801 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:59:03.802 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:59:04.149 INFO:teuthology.orchestra.run.smithi049.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:59:04.157 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/468 2024-01-31T06:59:04.157 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/468 2024-01-31T06:59:04.157 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:59:04.163 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:59:04.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:59:04.182 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-01-31T06:59:04.551 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:59:04.561 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:59:04.561 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:59:07.295 INFO:teuthology.orchestra.run.smithi049.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-01-31T06:59:07.303 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/469 2024-01-31T06:59:07.303 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/469 2024-01-31T06:59:07.303 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:59:07.309 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:59:07.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:59:07.336 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-01-31T06:59:07.984 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:59:07.994 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:59:07.994 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:59:08.341 INFO:teuthology.orchestra.run.smithi049.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T06:59:08.349 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/470 2024-01-31T06:59:08.349 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/470 2024-01-31T06:59:08.350 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T06:59:08.355 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T06:59:08.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T06:59:08.375 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-01-31T06:59:08.759 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T06:59:08.769 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T06:59:08.769 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:08.810 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:00:08.814 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:00:13.149 INFO:teuthology.orchestra.run.smithi049.stdout:generic/471 64s 2024-01-31T07:00:13.167 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/471 2024-01-31T07:00:13.167 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:13.177 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:13.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:13.237 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-01-31T07:00:14.253 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:14.263 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:14.263 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:16.185 INFO:teuthology.orchestra.run.smithi049.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:00:16.193 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/472 2024-01-31T07:00:16.194 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/472 2024-01-31T07:00:16.194 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:16.200 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:16.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:16.247 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-01-31T07:00:16.858 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:16.869 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:16.869 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:17.684 INFO:teuthology.orchestra.run.smithi049.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-01-31T07:00:17.693 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/473 2024-01-31T07:00:17.693 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/473 2024-01-31T07:00:17.693 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:17.699 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:17.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:17.719 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-01-31T07:00:18.088 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:18.098 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:18.098 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:18.629 INFO:teuthology.orchestra.run.smithi049.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:00:18.637 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/474 2024-01-31T07:00:18.637 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/474 2024-01-31T07:00:18.637 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:18.644 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:18.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:18.664 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-01-31T07:00:19.033 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:19.043 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:19.043 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:20.444 INFO:teuthology.orchestra.run.smithi049.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:00:20.453 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/475 2024-01-31T07:00:20.453 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/475 2024-01-31T07:00:20.453 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:20.460 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:20.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:20.519 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-01-31T07:00:20.874 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:20.884 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:20.884 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:21.471 INFO:teuthology.orchestra.run.smithi049.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:00:21.479 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/476 2024-01-31T07:00:21.479 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/476 2024-01-31T07:00:21.479 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:21.486 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:21.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:21.505 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2024-01-31T07:00:21.867 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:21.877 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:21.877 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:32.457 INFO:teuthology.orchestra.run.smithi049.stdout:generic/477 11s 2024-01-31T07:00:32.579 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/477 2024-01-31T07:00:32.579 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:32.597 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:32.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:32.660 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2024-01-31T07:00:34.251 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:34.261 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:34.261 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:39.039 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:00:39.043 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:00:45.071 INFO:teuthology.orchestra.run.smithi049.stdout:generic/478 - output mismatch (see /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/478.out.bad) 2024-01-31T07:00:45.076 INFO:teuthology.orchestra.run.smithi049.stdout: --- tests/generic/478.out 2024-01-31 05:06:00.915951735 +0000 2024-01-31T07:00:45.076 INFO:teuthology.orchestra.run.smithi049.stdout: +++ /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/478.out.bad 2024-01-31 07:00:45.069587399 +0000 2024-01-31T07:00:45.076 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -10,7 +10,7 @@ 2024-01-31T07:00:45.077 INFO:teuthology.orchestra.run.smithi049.stdout: lock could be placed 2024-01-31T07:00:45.077 INFO:teuthology.orchestra.run.smithi049.stdout: get wrlck 2024-01-31T07:00:45.077 INFO:teuthology.orchestra.run.smithi049.stdout: lock could be placed 2024-01-31T07:00:45.077 INFO:teuthology.orchestra.run.smithi049.stdout: -lock could be placed 2024-01-31T07:00:45.077 INFO:teuthology.orchestra.run.smithi049.stdout: +get wrlck 2024-01-31T07:00:45.077 INFO:teuthology.orchestra.run.smithi049.stdout: lock could be placed 2024-01-31T07:00:45.077 INFO:teuthology.orchestra.run.smithi049.stdout: lock could be placed 2024-01-31T07:00:45.077 INFO:teuthology.orchestra.run.smithi049.stdout: lock could be placed 2024-01-31T07:00:45.077 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -25,7 +25,7 @@ 2024-01-31T07:00:45.077 INFO:teuthology.orchestra.run.smithi049.stdout: lock could be placed 2024-01-31T07:00:45.077 INFO:teuthology.orchestra.run.smithi049.stdout: get wrlck 2024-01-31T07:00:45.077 INFO:teuthology.orchestra.run.smithi049.stdout: lock could be placed 2024-01-31T07:00:45.077 INFO:teuthology.orchestra.run.smithi049.stdout: -lock could be placed 2024-01-31T07:00:45.078 INFO:teuthology.orchestra.run.smithi049.stdout: +get wrlck 2024-01-31T07:00:45.078 INFO:teuthology.orchestra.run.smithi049.stdout: lock could be placed 2024-01-31T07:00:45.078 INFO:teuthology.orchestra.run.smithi049.stdout: lock could be placed 2024-01-31T07:00:45.078 INFO:teuthology.orchestra.run.smithi049.stdout: lock could be placed 2024-01-31T07:00:45.078 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -37,7 +37,7 @@ 2024-01-31T07:00:45.078 INFO:teuthology.orchestra.run.smithi049.stdout: get rdlck 2024-01-31T07:00:45.078 INFO:teuthology.orchestra.run.smithi049.stdout: get rdlck 2024-01-31T07:00:45.078 INFO:teuthology.orchestra.run.smithi049.stdout: lock could be placed 2024-01-31T07:00:45.078 INFO:teuthology.orchestra.run.smithi049.stdout: -lock could be placed 2024-01-31T07:00:45.078 INFO:teuthology.orchestra.run.smithi049.stdout: +get rdlck 2024-01-31T07:00:45.078 INFO:teuthology.orchestra.run.smithi049.stdout: get rdlck 2024-01-31T07:00:45.078 INFO:teuthology.orchestra.run.smithi049.stdout: lock could be placed 2024-01-31T07:00:45.078 INFO:teuthology.orchestra.run.smithi049.stdout: get rdlck 2024-01-31T07:00:45.078 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -46,7 +46,7 @@ 2024-01-31T07:00:45.078 INFO:teuthology.orchestra.run.smithi049.stdout: get rdlck 2024-01-31T07:00:45.079 INFO:teuthology.orchestra.run.smithi049.stdout: get rdlck 2024-01-31T07:00:45.079 INFO:teuthology.orchestra.run.smithi049.stdout: lock could be placed 2024-01-31T07:00:45.079 INFO:teuthology.orchestra.run.smithi049.stdout: -lock could be placed 2024-01-31T07:00:45.079 INFO:teuthology.orchestra.run.smithi049.stdout: +get rdlck 2024-01-31T07:00:45.079 INFO:teuthology.orchestra.run.smithi049.stdout: lock could be placed 2024-01-31T07:00:45.079 INFO:teuthology.orchestra.run.smithi049.stdout: lock could be placed 2024-01-31T07:00:45.079 INFO:teuthology.orchestra.run.smithi049.stdout: lock could be placed 2024-01-31T07:00:45.082 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/478 2024-01-31T07:00:45.082 INFO:teuthology.orchestra.run.smithi049.stdout:Failures: generic/478 2024-01-31T07:00:45.082 INFO:teuthology.orchestra.run.smithi049.stdout:Failed 1 of 1 tests 2024-01-31T07:00:45.089 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:45.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T07:00:45.110 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-01-31T07:00:45.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-01-31T07:00:45.111 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2024-01-31T07:00:45.483 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:45.493 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:45.493 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:45.815 INFO:teuthology.orchestra.run.smithi049.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:00:45.823 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/479 2024-01-31T07:00:45.823 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/479 2024-01-31T07:00:45.823 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:45.829 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:45.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:45.848 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2024-01-31T07:00:46.195 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:46.205 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:46.205 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:46.479 INFO:teuthology.orchestra.run.smithi049.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:00:46.488 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/480 2024-01-31T07:00:46.488 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/480 2024-01-31T07:00:46.488 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:46.494 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:46.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:46.513 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2024-01-31T07:00:46.886 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:46.897 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:46.897 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:47.176 INFO:teuthology.orchestra.run.smithi049.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:00:47.184 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/481 2024-01-31T07:00:47.184 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/481 2024-01-31T07:00:47.184 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:47.190 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:47.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:47.209 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2024-01-31T07:00:47.562 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:47.572 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:47.572 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:47.972 INFO:teuthology.orchestra.run.smithi049.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:00:47.980 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/482 2024-01-31T07:00:47.980 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/482 2024-01-31T07:00:47.980 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:47.986 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:48.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:48.005 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2024-01-31T07:00:48.371 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:48.381 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:48.381 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:48.676 INFO:teuthology.orchestra.run.smithi049.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:00:48.684 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/483 2024-01-31T07:00:48.684 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/483 2024-01-31T07:00:48.684 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:48.690 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:48.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:48.710 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2024-01-31T07:00:49.086 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:49.097 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:49.097 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:49.398 INFO:teuthology.orchestra.run.smithi049.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:00:49.406 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/484 2024-01-31T07:00:49.406 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/484 2024-01-31T07:00:49.406 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:49.412 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:49.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:49.431 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2024-01-31T07:00:49.799 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:49.810 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:49.810 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:51.460 INFO:teuthology.orchestra.run.smithi049.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-01-31T07:00:51.468 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/485 2024-01-31T07:00:51.468 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/485 2024-01-31T07:00:51.468 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:51.475 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:51.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:51.495 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2024-01-31T07:00:52.175 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:52.185 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:52.186 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:52.494 INFO:teuthology.orchestra.run.smithi049.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:00:52.502 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/486 2024-01-31T07:00:52.502 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/486 2024-01-31T07:00:52.502 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:52.509 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:52.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:52.530 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2024-01-31T07:00:52.891 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:52.901 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:52.902 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:53.218 INFO:teuthology.orchestra.run.smithi049.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:00:53.226 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/487 2024-01-31T07:00:53.226 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/487 2024-01-31T07:00:53.226 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:53.232 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:53.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:53.252 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2024-01-31T07:00:53.606 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:53.617 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:53.617 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:53.885 INFO:teuthology.orchestra.run.smithi049.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:00:53.892 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/488 2024-01-31T07:00:53.893 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/488 2024-01-31T07:00:53.893 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:53.899 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:53.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:53.918 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2024-01-31T07:00:54.267 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:54.277 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:54.277 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:54.585 INFO:teuthology.orchestra.run.smithi049.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:00:54.592 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/489 2024-01-31T07:00:54.592 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/489 2024-01-31T07:00:54.592 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:54.598 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:54.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:54.617 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2024-01-31T07:00:54.978 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:54.993 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:54.993 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:56.197 INFO:teuthology.orchestra.run.smithi049.stdout:generic/490 1s 2024-01-31T07:00:56.209 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/490 2024-01-31T07:00:56.210 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:56.216 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:56.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:56.239 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2024-01-31T07:00:56.895 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:56.905 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:56.906 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:57.209 INFO:teuthology.orchestra.run.smithi049.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:00:57.217 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/491 2024-01-31T07:00:57.217 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/491 2024-01-31T07:00:57.217 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:57.223 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:57.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:57.243 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2024-01-31T07:00:57.595 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:57.605 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:57.605 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:57.868 INFO:teuthology.orchestra.run.smithi049.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:00:57.877 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/492 2024-01-31T07:00:57.877 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/492 2024-01-31T07:00:57.877 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:57.883 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:57.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:57.903 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2024-01-31T07:00:58.247 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:58.257 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:58.257 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:58.550 INFO:teuthology.orchestra.run.smithi049.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:00:58.558 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/493 2024-01-31T07:00:58.559 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/493 2024-01-31T07:00:58.559 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:58.564 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:58.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:58.584 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2024-01-31T07:00:58.947 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:58.957 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:58.958 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:59.250 INFO:teuthology.orchestra.run.smithi049.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:00:59.258 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/494 2024-01-31T07:00:59.259 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/494 2024-01-31T07:00:59.259 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:59.265 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:59.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:59.285 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2024-01-31T07:00:59.662 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:00:59.672 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:00:59.672 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:59.932 INFO:teuthology.orchestra.run.smithi049.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:00:59.940 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/495 2024-01-31T07:00:59.940 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/495 2024-01-31T07:00:59.941 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:00:59.946 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:00:59.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:00:59.966 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2024-01-31T07:01:00.344 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:00.354 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:00.354 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:00.803 INFO:teuthology.orchestra.run.smithi049.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:00.811 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/496 2024-01-31T07:01:00.811 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/496 2024-01-31T07:01:00.811 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:00.817 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:00.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:00.837 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2024-01-31T07:01:01.191 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:01.201 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:01.201 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:01.485 INFO:teuthology.orchestra.run.smithi049.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:01.493 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/497 2024-01-31T07:01:01.494 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/497 2024-01-31T07:01:01.494 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:01.500 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:01.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:01.519 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2024-01-31T07:01:01.887 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:01.897 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:01.897 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:02.192 INFO:teuthology.orchestra.run.smithi049.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:02.200 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/498 2024-01-31T07:01:02.200 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/498 2024-01-31T07:01:02.200 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:02.206 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:02.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:02.225 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2024-01-31T07:01:02.599 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:02.609 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:02.609 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:02.936 INFO:teuthology.orchestra.run.smithi049.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:02.944 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/499 2024-01-31T07:01:02.945 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/499 2024-01-31T07:01:02.945 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:02.951 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:02.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:02.970 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2024-01-31T07:01:03.327 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:03.337 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:03.338 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:03.651 INFO:teuthology.orchestra.run.smithi049.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:03.659 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/500 2024-01-31T07:01:03.659 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/500 2024-01-31T07:01:03.659 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:03.665 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:03.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:03.684 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2024-01-31T07:01:04.051 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:04.061 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:04.061 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:04.341 INFO:teuthology.orchestra.run.smithi049.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/501 2024-01-31T07:01:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/501 2024-01-31T07:01:04.349 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:04.355 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:04.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:04.376 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2024-01-31T07:01:04.761 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:04.772 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:04.772 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:05.072 INFO:teuthology.orchestra.run.smithi049.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:05.081 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/502 2024-01-31T07:01:05.081 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/502 2024-01-31T07:01:05.081 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:05.087 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:05.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:05.108 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2024-01-31T07:01:05.467 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:05.477 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:05.477 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:05.765 INFO:teuthology.orchestra.run.smithi049.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:05.774 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/503 2024-01-31T07:01:05.775 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/503 2024-01-31T07:01:05.776 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:05.780 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:05.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:05.799 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2024-01-31T07:01:06.180 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:06.189 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:06.189 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:06.541 INFO:teuthology.orchestra.run.smithi049.stdout:generic/504 - output mismatch (see /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/504.out.bad) 2024-01-31T07:01:06.547 INFO:teuthology.orchestra.run.smithi049.stdout: --- tests/generic/504.out 2024-01-31 05:06:00.919951652 +0000 2024-01-31T07:01:06.547 INFO:teuthology.orchestra.run.smithi049.stdout: +++ /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/504.out.bad 2024-01-31 07:01:06.541043369 +0000 2024-01-31T07:01:06.547 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -1,2 +1,3 @@ 2024-01-31T07:01:06.547 INFO:teuthology.orchestra.run.smithi049.stdout: QA output created by 504 2024-01-31T07:01:06.547 INFO:teuthology.orchestra.run.smithi049.stdout: +lock info not found 2024-01-31T07:01:06.548 INFO:teuthology.orchestra.run.smithi049.stdout: Silence is golden 2024-01-31T07:01:06.552 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/504 2024-01-31T07:01:06.553 INFO:teuthology.orchestra.run.smithi049.stdout:Failures: generic/504 2024-01-31T07:01:06.553 INFO:teuthology.orchestra.run.smithi049.stdout:Failed 1 of 1 tests 2024-01-31T07:01:06.559 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:06.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T07:01:06.634 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-01-31T07:01:06.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-01-31T07:01:06.635 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2024-01-31T07:01:06.995 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:07.005 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:07.005 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:07.283 INFO:teuthology.orchestra.run.smithi049.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:07.291 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/505 2024-01-31T07:01:07.291 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/505 2024-01-31T07:01:07.292 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:07.297 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:07.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:07.317 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2024-01-31T07:01:07.683 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:07.694 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:07.694 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:08.000 INFO:teuthology.orchestra.run.smithi049.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:08.008 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/506 2024-01-31T07:01:08.008 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/506 2024-01-31T07:01:08.008 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:08.014 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:08.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:08.033 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2024-01-31T07:01:08.407 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:08.417 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:08.417 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:08.770 INFO:teuthology.orchestra.run.smithi049.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-01-31T07:01:08.778 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/507 2024-01-31T07:01:08.778 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/507 2024-01-31T07:01:08.778 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:08.784 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:08.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:08.859 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2024-01-31T07:01:09.138 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:01:09.142 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:01:09.219 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:09.229 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:09.229 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:09.503 INFO:teuthology.orchestra.run.smithi049.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2024-01-31T07:01:09.511 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/508 2024-01-31T07:01:09.511 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/508 2024-01-31T07:01:09.511 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:09.519 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:09.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:09.537 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2024-01-31T07:01:09.954 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:09.964 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:09.964 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:10.256 INFO:teuthology.orchestra.run.smithi049.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:10.264 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/509 2024-01-31T07:01:10.264 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/509 2024-01-31T07:01:10.264 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:10.270 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:10.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:10.334 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2024-01-31T07:01:10.707 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:10.717 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:10.717 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:11.001 INFO:teuthology.orchestra.run.smithi049.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:11.009 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/510 2024-01-31T07:01:11.009 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/510 2024-01-31T07:01:11.009 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:11.015 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:11.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:11.034 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2024-01-31T07:01:11.399 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:11.409 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:11.409 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:11.676 INFO:teuthology.orchestra.run.smithi049.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:11.684 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/511 2024-01-31T07:01:11.684 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/511 2024-01-31T07:01:11.684 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:11.690 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:11.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:11.709 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2024-01-31T07:01:12.071 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:12.081 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:12.081 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:12.392 INFO:teuthology.orchestra.run.smithi049.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:12.400 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/512 2024-01-31T07:01:12.400 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/512 2024-01-31T07:01:12.400 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:12.406 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:12.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:12.426 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2024-01-31T07:01:12.791 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:12.801 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:12.801 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:13.071 INFO:teuthology.orchestra.run.smithi049.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:13.080 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/513 2024-01-31T07:01:13.080 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/513 2024-01-31T07:01:13.080 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:13.086 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:13.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:13.104 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2024-01-31T07:01:13.461 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:13.471 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:13.471 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:13.750 INFO:teuthology.orchestra.run.smithi049.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:13.758 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/514 2024-01-31T07:01:13.758 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/514 2024-01-31T07:01:13.758 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:13.765 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:13.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:13.784 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2024-01-31T07:01:14.158 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:14.168 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:14.168 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:14.468 INFO:teuthology.orchestra.run.smithi049.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:14.476 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/515 2024-01-31T07:01:14.476 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/515 2024-01-31T07:01:14.477 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:14.483 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:14.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:14.502 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2024-01-31T07:01:14.863 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:14.873 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:14.873 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:15.228 INFO:teuthology.orchestra.run.smithi049.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-01-31T07:01:15.237 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/516 2024-01-31T07:01:15.237 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/516 2024-01-31T07:01:15.237 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:15.243 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:15.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:15.293 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2024-01-31T07:01:15.931 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:15.941 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:15.941 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:16.218 INFO:teuthology.orchestra.run.smithi049.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:16.226 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/517 2024-01-31T07:01:16.226 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/517 2024-01-31T07:01:16.227 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:16.232 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:16.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:16.252 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2024-01-31T07:01:16.622 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:16.633 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:16.633 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:16.911 INFO:teuthology.orchestra.run.smithi049.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:16.919 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/518 2024-01-31T07:01:16.919 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/518 2024-01-31T07:01:16.919 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:16.925 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:16.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:16.945 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2024-01-31T07:01:17.294 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:17.305 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:17.306 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:17.595 INFO:teuthology.orchestra.run.smithi049.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:17.603 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/519 2024-01-31T07:01:17.603 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/519 2024-01-31T07:01:17.603 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:17.609 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:17.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:17.630 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2024-01-31T07:01:17.980 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:17.990 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:17.990 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:18.293 INFO:teuthology.orchestra.run.smithi049.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T07:01:18.301 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/520 2024-01-31T07:01:18.301 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/520 2024-01-31T07:01:18.301 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:01:18.307 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:18.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:01:18.326 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2024-01-31T07:01:18.699 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:01:18.709 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:01:18.709 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:01:39.201 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:01:39.205 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:02:09.258 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:02:09.262 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:02:39.580 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:02:39.584 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:03:09.628 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:03:09.632 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:03:41.333 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:03:41.338 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:04:11.406 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:04:11.409 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:04:41.463 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:04:41.468 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:05:11.527 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:05:11.531 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:05:11.558 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T07:05:11.554+0000 7f91cc000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 382918) UID: 0 2024-01-31T07:05:11.558 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T07:05:11.554+0000 7f96ce200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 382918) UID: 0 2024-01-31T07:05:11.558 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T07:05:11.554+0000 7f4aaf800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 382918) UID: 0 2024-01-31T07:05:11.559 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T07:05:11.554+0000 7f79d2800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 382918) UID: 0 2024-01-31T07:08:35.885 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:08:35.889 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:09:05.940 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:09:05.944 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:09:36.019 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:09:36.023 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:10:06.118 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:10:06.122 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:10:36.184 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:10:36.188 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:11:06.248 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:11:06.253 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:11:36.396 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:11:36.400 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:12:06.913 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:12:06.918 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:12:36.999 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:12:37.004 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:13:07.823 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:13:07.827 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:13:37.892 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:13:37.896 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:14:07.976 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:14:07.981 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:14:38.082 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:14:38.086 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:15:08.139 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:15:08.144 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:15:38.205 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:15:38.209 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:16:08.342 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:16:08.346 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:16:38.456 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:16:38.461 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:17:08.579 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:17:08.583 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:17:38.963 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:17:38.969 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:18:09.019 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:18:09.023 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:18:39.114 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:18:39.119 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:19:09.246 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:19:09.250 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:19:39.304 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:19:39.308 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:20:09.432 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:20:09.436 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:20:39.484 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:20:39.488 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:21:09.569 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:21:09.573 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:21:39.667 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:21:39.671 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:22:09.790 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:22:09.795 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:22:39.851 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:22:39.855 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:23:10.850 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:23:10.854 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:23:40.899 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:23:40.903 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:24:10.954 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:24:10.958 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:24:41.045 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:24:41.049 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:25:11.152 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:25:11.156 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:25:41.275 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:25:41.279 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:26:11.347 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:26:11.351 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:26:41.403 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:26:41.407 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:27:11.476 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:27:11.480 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:27:41.565 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:27:41.570 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:27:41.600 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T07:27:41.599+0000 7f96ce200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 383064) UID: 0 2024-01-31T07:27:41.600 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T07:27:41.599+0000 7f91cc000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 383064) UID: 0 2024-01-31T07:27:41.600 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T07:27:41.599+0000 7f4aaf800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 383064) UID: 0 2024-01-31T07:27:41.601 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T07:27:41.599+0000 7f79d2800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 383064) UID: 0 2024-01-31T07:30:42.399 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:30:42.404 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:30:42.432 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-31T07:30:42.431+0000 7fd9fae00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 383077) UID: 0 2024-01-31T07:30:42.432 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-31T07:30:42.431+0000 7fab97400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 383077) UID: 0 2024-01-31T07:33:41.009 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:33:41.013 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:34:11.146 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:34:11.150 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:34:41.193 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:34:41.197 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:35:11.325 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:35:11.329 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:35:41.374 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:35:41.378 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:36:11.468 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:36:11.472 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:36:41.629 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:36:41.633 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:37:11.736 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:37:11.741 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:37:41.799 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:37:41.804 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:38:11.912 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:38:11.916 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:38:42.878 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:38:42.884 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:39:12.943 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:39:12.947 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:39:43.048 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:39:43.053 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:40:13.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:40:13.150 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:40:43.267 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:40:43.273 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:41:13.408 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:41:13.412 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:41:43.549 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:41:43.553 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:42:13.602 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:42:13.607 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:42:43.718 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:42:43.722 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:43:13.815 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:43:13.819 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:43:43.912 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:43:43.916 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:44:14.052 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:44:14.056 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:44:44.158 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:44:44.162 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:44:44.189 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T07:44:44.182+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33554) UID: 0 2024-01-31T07:44:44.189 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T07:44:44.182+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33554) UID: 0 2024-01-31T07:44:44.189 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T07:44:44.182+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33554) UID: 0 2024-01-31T07:44:44.190 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T07:44:44.182+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33554) UID: 0 2024-01-31T07:47:23.211 INFO:teuthology.orchestra.run.smithi049.stdout:generic/521 2765s 2024-01-31T07:47:23.222 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/521 2024-01-31T07:47:23.223 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T07:47:23.228 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:47:23.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T07:47:23.403 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2024-01-31T07:47:23.938 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T07:47:23.948 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T07:47:23.948 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T07:47:30.739 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:47:30.744 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:48:00.877 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:48:00.881 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:48:31.424 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:48:31.428 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:49:01.473 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:49:01.478 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:49:31.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:49:31.556 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:50:02.419 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:50:02.423 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:50:32.474 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:50:32.479 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:51:02.732 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:51:02.736 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:51:32.804 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:51:32.809 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:52:02.882 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:52:02.886 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:52:33.022 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:52:33.027 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:53:03.112 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:53:03.116 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:53:33.217 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:53:33.221 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:54:03.694 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:54:03.698 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:54:33.741 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:54:33.745 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:55:03.843 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:55:03.848 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:55:33.991 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:55:33.995 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:56:04.127 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:56:04.131 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:56:34.175 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:56:34.179 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:57:04.224 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:57:04.228 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:57:34.314 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:57:34.318 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:58:04.429 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:58:04.433 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:58:34.735 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:58:34.739 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:59:05.399 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:59:05.403 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:59:35.460 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T07:59:35.465 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:00:05.544 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:00:05.548 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:00:35.673 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:00:35.677 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:01:05.730 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:01:05.734 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:01:35.787 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:01:35.792 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:02:05.859 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:02:05.866 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:02:35.940 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:02:35.945 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:02:35.973 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T08:02:35.967+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33672) UID: 0 2024-01-31T08:02:36.048 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T08:02:35.967+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33672) UID: 0 2024-01-31T08:02:36.049 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T08:02:35.967+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33672) UID: 0 2024-01-31T08:02:36.049 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T08:02:35.967+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33672) UID: 0 2024-01-31T08:05:34.272 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:05:34.277 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:06:04.393 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:06:04.398 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:06:34.483 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:06:34.487 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:07:04.876 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:07:04.880 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:07:34.927 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:07:34.931 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:08:05.010 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:08:05.014 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:08:35.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:08:35.216 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:09:05.275 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:09:05.279 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:09:35.387 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:09:35.391 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:10:05.634 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:10:05.639 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:10:36.326 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:10:36.330 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:11:06.387 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:11:06.392 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:11:36.441 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:11:36.445 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:12:06.504 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:12:06.509 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:12:36.680 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:12:36.685 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:13:06.845 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:13:06.850 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:13:36.985 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:13:36.989 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:14:07.045 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:14:07.050 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:14:37.146 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:14:37.151 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:15:07.236 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:15:07.240 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:15:37.297 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:15:37.301 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:16:07.399 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:16:07.403 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:16:37.488 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:16:37.492 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:17:07.628 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:17:07.633 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:17:37.726 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:17:37.730 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:17:37.763 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T08:17:37.762+0000 7f91cc000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 383791) UID: 0 2024-01-31T08:17:37.763 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T08:17:37.766+0000 7f96ce200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 383791) UID: 0 2024-01-31T08:17:37.763 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T08:17:37.766+0000 7f4aaf800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 383791) UID: 0 2024-01-31T08:17:37.764 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T08:17:37.766+0000 7f79d2800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 383791) UID: 0 2024-01-31T08:21:06.318 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:21:06.322 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:21:36.546 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:21:36.550 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:22:06.660 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:22:06.665 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:22:36.833 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:22:36.838 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:23:06.889 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:23:06.896 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:23:37.063 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:23:37.067 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:24:07.169 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:24:07.173 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:24:37.274 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:24:37.279 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:25:08.350 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:25:08.355 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:25:18.975 INFO:teuthology.orchestra.run.smithi049.stdout:generic/522 2275s 2024-01-31T08:25:19.028 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/522 2024-01-31T08:25:19.029 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T08:25:19.034 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:19.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T08:25:19.054 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2024-01-31T08:25:19.692 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T08:25:19.702 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T08:25:19.702 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:20.015 INFO:teuthology.orchestra.run.smithi049.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T08:25:20.023 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/523 2024-01-31T08:25:20.023 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/523 2024-01-31T08:25:20.023 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T08:25:20.029 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:20.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T08:25:20.049 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2024-01-31T08:25:20.411 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T08:25:20.421 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T08:25:20.421 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:20.691 INFO:teuthology.orchestra.run.smithi049.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T08:25:20.699 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/524 2024-01-31T08:25:20.699 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/524 2024-01-31T08:25:20.699 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T08:25:20.705 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:20.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T08:25:20.726 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2024-01-31T08:25:21.098 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T08:25:21.109 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T08:25:21.109 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:21.373 INFO:teuthology.orchestra.run.smithi049.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T08:25:21.381 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/525 2024-01-31T08:25:21.381 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/525 2024-01-31T08:25:21.381 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T08:25:21.387 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:21.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T08:25:21.406 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2024-01-31T08:25:21.759 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T08:25:21.769 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T08:25:21.769 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:22.100 INFO:teuthology.orchestra.run.smithi049.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T08:25:22.108 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/526 2024-01-31T08:25:22.108 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/526 2024-01-31T08:25:22.108 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T08:25:22.114 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:22.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T08:25:22.136 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2024-01-31T08:25:22.499 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T08:25:22.509 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T08:25:22.510 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:22.804 INFO:teuthology.orchestra.run.smithi049.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T08:25:22.812 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/527 2024-01-31T08:25:22.812 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/527 2024-01-31T08:25:22.812 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T08:25:22.818 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:22.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T08:25:22.839 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2024-01-31T08:25:23.203 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T08:25:23.213 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T08:25:23.213 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:23.532 INFO:teuthology.orchestra.run.smithi049.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2024-01-31T08:25:23.540 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/528 2024-01-31T08:25:23.540 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/528 2024-01-31T08:25:23.540 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T08:25:23.545 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:23.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T08:25:23.566 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2024-01-31T08:25:23.939 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T08:25:23.949 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T08:25:23.949 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:24.242 INFO:teuthology.orchestra.run.smithi049.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-01-31T08:25:24.250 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/529 2024-01-31T08:25:24.250 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/529 2024-01-31T08:25:24.250 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T08:25:24.257 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:24.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T08:25:24.275 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2024-01-31T08:25:24.639 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T08:25:24.650 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T08:25:24.650 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:24.925 INFO:teuthology.orchestra.run.smithi049.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T08:25:24.933 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/530 2024-01-31T08:25:24.933 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/530 2024-01-31T08:25:24.933 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T08:25:24.939 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:24.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T08:25:24.959 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2024-01-31T08:25:25.311 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T08:25:25.321 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T08:25:25.322 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:25.578 INFO:teuthology.orchestra.run.smithi049.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T08:25:25.586 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/531 2024-01-31T08:25:25.587 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/531 2024-01-31T08:25:25.587 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T08:25:25.592 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:25.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T08:25:25.643 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2024-01-31T08:25:26.011 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T08:25:26.021 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T08:25:26.021 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:26.375 INFO:teuthology.orchestra.run.smithi049.stdout:generic/532 0s 2024-01-31T08:25:26.387 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/532 2024-01-31T08:25:26.388 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T08:25:26.393 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:26.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T08:25:26.414 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2024-01-31T08:25:26.779 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T08:25:26.790 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T08:25:26.790 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:27.480 INFO:teuthology.orchestra.run.smithi049.stdout:generic/533 1s 2024-01-31T08:25:27.493 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/533 2024-01-31T08:25:27.493 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T08:25:27.499 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:27.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T08:25:27.517 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2024-01-31T08:25:27.904 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T08:25:27.914 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T08:25:27.915 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:28.223 INFO:teuthology.orchestra.run.smithi049.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T08:25:28.231 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/534 2024-01-31T08:25:28.231 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/534 2024-01-31T08:25:28.231 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T08:25:28.237 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:28.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T08:25:28.257 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2024-01-31T08:25:28.623 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T08:25:28.633 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T08:25:28.633 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:28.952 INFO:teuthology.orchestra.run.smithi049.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T08:25:28.960 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/535 2024-01-31T08:25:28.960 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/535 2024-01-31T08:25:28.960 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T08:25:28.966 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:28.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T08:25:28.986 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2024-01-31T08:25:29.339 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T08:25:29.350 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T08:25:29.350 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:29.630 INFO:teuthology.orchestra.run.smithi049.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T08:25:29.638 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/536 2024-01-31T08:25:29.638 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/536 2024-01-31T08:25:29.638 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T08:25:29.644 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:29.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T08:25:29.665 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2024-01-31T08:25:30.025 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T08:25:30.035 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T08:25:30.036 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:30.301 INFO:teuthology.orchestra.run.smithi049.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T08:25:30.310 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/537 2024-01-31T08:25:30.310 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/537 2024-01-31T08:25:30.310 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T08:25:30.316 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:30.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T08:25:30.336 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2024-01-31T08:25:30.703 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T08:25:30.714 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T08:25:30.714 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T08:25:38.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:25:38.506 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:26:08.584 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:26:08.589 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:26:38.667 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:26:38.671 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:27:08.729 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:27:08.733 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:27:38.845 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:27:38.849 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:28:08.908 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:28:08.912 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:28:38.990 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:28:38.995 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:29:09.045 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:29:09.050 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:29:39.152 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:29:39.156 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:30:09.274 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:30:09.278 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:30:39.389 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:30:39.394 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:31:09.512 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:31:09.517 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:31:39.626 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:31:39.631 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:32:09.691 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:32:09.695 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:32:09.809 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T08:32:09.802+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33861) UID: 0 2024-01-31T08:32:09.809 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T08:32:09.802+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33861) UID: 0 2024-01-31T08:32:09.809 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T08:32:09.802+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33861) UID: 0 2024-01-31T08:32:09.810 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T08:32:09.802+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33861) UID: 0 2024-01-31T08:35:16.983 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:35:16.987 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:35:47.045 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:35:47.049 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:36:17.400 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:36:17.404 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:36:47.524 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:36:47.528 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:37:17.645 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:37:17.649 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:37:47.777 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:37:47.781 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:38:17.892 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:38:17.896 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:38:47.947 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:38:47.951 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:39:18.952 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:39:18.956 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:39:49.009 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:39:49.013 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:40:19.082 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:40:19.086 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:40:49.196 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:40:49.201 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:41:19.318 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:41:19.324 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:41:49.433 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:41:49.438 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:41:49.469 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T08:41:49.464+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33914) UID: 0 2024-01-31T08:41:49.469 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T08:41:49.464+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33914) UID: 0 2024-01-31T08:41:49.469 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T08:41:49.464+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33914) UID: 0 2024-01-31T08:41:49.470 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T08:41:49.464+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33914) UID: 0 2024-01-31T08:44:47.690 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:44:47.695 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:45:17.754 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:45:17.759 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:45:47.833 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:45:47.837 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:46:17.948 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:46:17.952 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:46:48.045 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:46:48.049 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:47:18.160 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:47:18.165 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:47:49.017 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:47:49.021 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:47:49.049 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T08:47:49.049+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33947) UID: 0 2024-01-31T08:47:49.050 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T08:47:49.049+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33947) UID: 0 2024-01-31T08:47:49.050 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T08:47:49.049+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33947) UID: 0 2024-01-31T08:47:49.050 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T08:47:49.049+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 33947) UID: 0 2024-01-31T08:50:38.189 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:50:38.194 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:51:08.310 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:51:08.314 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:51:38.441 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:51:38.445 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:52:08.556 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:52:08.560 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:52:38.653 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:52:38.658 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:53:08.734 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:53:08.739 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:53:38.861 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:53:38.865 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:54:09.104 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:54:09.112 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:54:39.210 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:54:39.214 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:55:09.341 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:55:09.346 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:55:39.413 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:55:39.417 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:56:09.470 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:56:09.474 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:56:39.560 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:56:39.564 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:56:39.590 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T08:56:39.591+0000 7f96ce200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 395313) UID: 0 2024-01-31T08:56:39.591 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T08:56:39.591+0000 7f91cc000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 395313) UID: 0 2024-01-31T08:56:39.591 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T08:56:39.591+0000 7f4aaf800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 395313) UID: 0 2024-01-31T08:56:39.591 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T08:56:39.591+0000 7f79d2800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 395313) UID: 0 2024-01-31T08:59:28.565 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:59:28.569 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:59:58.817 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T08:59:58.821 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:00:28.879 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:00:28.883 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:00:59.044 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:00:59.049 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:01:29.175 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:01:29.180 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:01:59.306 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:01:59.310 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:02:29.387 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:02:29.392 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:02:59.509 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:02:59.513 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:03:29.649 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:03:29.653 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:03:59.705 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:03:59.710 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:04:29.769 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:04:29.774 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:04:59.932 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:04:59.936 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:05:30.039 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:05:30.043 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:06:00.136 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:06:00.140 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:06:30.235 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:06:30.240 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:07:00.349 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:07:00.353 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:07:30.429 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:07:30.433 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:07:58.838 INFO:teuthology.orchestra.run.smithi049.stdout:generic/538 2548s 2024-01-31T09:07:58.891 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/538 2024-01-31T09:07:58.891 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:07:58.897 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:07:58.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:07:58.933 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2024-01-31T09:08:00.561 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:08:00.565 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:08:00.572 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:00.583 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:00.583 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:03.108 INFO:teuthology.orchestra.run.smithi049.stdout:generic/539 3s 2024-01-31T09:08:03.120 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/539 2024-01-31T09:08:03.120 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:03.126 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:03.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:03.149 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2024-01-31T09:08:03.871 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:03.881 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:03.881 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:04.169 INFO:teuthology.orchestra.run.smithi049.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:04.177 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/540 2024-01-31T09:08:04.177 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/540 2024-01-31T09:08:04.177 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:04.183 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:04.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:04.203 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2024-01-31T09:08:04.555 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:04.565 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:04.565 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:04.836 INFO:teuthology.orchestra.run.smithi049.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:04.844 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/541 2024-01-31T09:08:04.844 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/541 2024-01-31T09:08:04.844 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:04.850 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:04.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:04.869 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2024-01-31T09:08:05.231 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:05.241 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:05.241 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:05.811 INFO:teuthology.orchestra.run.smithi049.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:05.819 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/542 2024-01-31T09:08:05.819 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/542 2024-01-31T09:08:05.819 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:05.825 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:05.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:05.844 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2024-01-31T09:08:06.203 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:06.213 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:06.213 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:06.504 INFO:teuthology.orchestra.run.smithi049.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:06.512 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/543 2024-01-31T09:08:06.512 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/543 2024-01-31T09:08:06.512 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:06.518 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:06.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:06.538 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2024-01-31T09:08:06.911 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:06.921 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:06.921 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:07.197 INFO:teuthology.orchestra.run.smithi049.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:07.205 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/544 2024-01-31T09:08:07.205 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/544 2024-01-31T09:08:07.206 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:07.211 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:07.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:07.232 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2024-01-31T09:08:07.573 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:07.583 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:07.583 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:07.950 INFO:teuthology.orchestra.run.smithi049.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-01-31T09:08:07.958 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/545 2024-01-31T09:08:07.958 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/545 2024-01-31T09:08:07.958 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:07.964 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:07.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:07.985 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2024-01-31T09:08:08.347 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:08.357 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:08.357 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:08.728 INFO:teuthology.orchestra.run.smithi049.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:08.736 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/546 2024-01-31T09:08:08.737 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/546 2024-01-31T09:08:08.737 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:08.743 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:08.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:08.763 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2024-01-31T09:08:09.127 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:09.138 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:09.138 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:09.468 INFO:teuthology.orchestra.run.smithi049.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:09.476 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/547 2024-01-31T09:08:09.476 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/547 2024-01-31T09:08:09.476 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:09.483 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:09.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:09.502 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2024-01-31T09:08:09.851 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:09.861 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:09.861 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:10.213 INFO:teuthology.orchestra.run.smithi049.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:10.221 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/548 2024-01-31T09:08:10.221 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/548 2024-01-31T09:08:10.221 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:10.227 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:10.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:10.247 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2024-01-31T09:08:10.615 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:10.625 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:10.625 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:10.970 INFO:teuthology.orchestra.run.smithi049.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:10.978 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/549 2024-01-31T09:08:10.978 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/549 2024-01-31T09:08:10.978 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:10.984 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:11.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:11.035 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2024-01-31T09:08:11.399 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:11.409 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:11.409 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:11.751 INFO:teuthology.orchestra.run.smithi049.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:11.759 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/550 2024-01-31T09:08:11.759 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/550 2024-01-31T09:08:11.759 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:11.765 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:11.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:11.786 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2024-01-31T09:08:12.151 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:12.161 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:12.162 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:12.433 INFO:teuthology.orchestra.run.smithi049.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:12.441 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/551 2024-01-31T09:08:12.441 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/551 2024-01-31T09:08:12.441 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:12.447 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:12.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:12.469 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2024-01-31T09:08:12.831 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:12.841 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:12.841 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:13.116 INFO:teuthology.orchestra.run.smithi049.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:13.124 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/552 2024-01-31T09:08:13.124 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/552 2024-01-31T09:08:13.124 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:13.130 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:13.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:13.150 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2024-01-31T09:08:13.503 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:13.513 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:13.513 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:13.920 INFO:teuthology.orchestra.run.smithi049.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2024-01-31T09:08:13.928 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/553 2024-01-31T09:08:13.928 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/553 2024-01-31T09:08:13.928 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:13.934 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:13.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:13.955 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2024-01-31T09:08:14.631 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:14.641 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:14.641 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:14.919 INFO:teuthology.orchestra.run.smithi049.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:14.927 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/554 2024-01-31T09:08:14.928 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/554 2024-01-31T09:08:14.928 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:14.933 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:14.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:14.954 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2024-01-31T09:08:15.307 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:15.317 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:15.317 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:15.682 INFO:teuthology.orchestra.run.smithi049.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2024-01-31T09:08:15.690 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/555 2024-01-31T09:08:15.690 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/555 2024-01-31T09:08:15.690 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:15.696 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:15.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:15.718 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2024-01-31T09:08:16.409 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:16.420 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:16.420 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:16.703 INFO:teuthology.orchestra.run.smithi049.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:16.711 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/556 2024-01-31T09:08:16.711 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/556 2024-01-31T09:08:16.711 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:16.717 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:16.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:16.737 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2024-01-31T09:08:17.111 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:17.122 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:17.122 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:17.409 INFO:teuthology.orchestra.run.smithi049.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:17.417 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/557 2024-01-31T09:08:17.417 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/557 2024-01-31T09:08:17.417 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:17.423 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:17.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:17.442 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2024-01-31T09:08:17.811 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:17.821 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:17.821 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:18.152 INFO:teuthology.orchestra.run.smithi049.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:18.160 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/558 2024-01-31T09:08:18.160 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/558 2024-01-31T09:08:18.160 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:18.166 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:18.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:18.231 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2024-01-31T09:08:18.587 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:18.597 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:18.597 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:18.869 INFO:teuthology.orchestra.run.smithi049.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:18.877 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/559 2024-01-31T09:08:18.877 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/559 2024-01-31T09:08:18.877 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:18.884 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:18.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:18.903 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2024-01-31T09:08:19.267 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:19.280 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:19.281 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:19.561 INFO:teuthology.orchestra.run.smithi049.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:19.569 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/560 2024-01-31T09:08:19.569 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/560 2024-01-31T09:08:19.570 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:19.575 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:19.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:19.594 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2024-01-31T09:08:19.961 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:19.971 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:19.972 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:20.242 INFO:teuthology.orchestra.run.smithi049.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:20.250 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/561 2024-01-31T09:08:20.250 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/561 2024-01-31T09:08:20.250 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:20.256 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:20.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:20.275 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2024-01-31T09:08:20.651 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:20.662 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:20.662 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:20.945 INFO:teuthology.orchestra.run.smithi049.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:20.953 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/562 2024-01-31T09:08:20.953 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/562 2024-01-31T09:08:20.953 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:20.960 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:20.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:20.980 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2024-01-31T09:08:21.334 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:21.345 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:21.345 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:21.674 INFO:teuthology.orchestra.run.smithi049.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:21.682 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/563 2024-01-31T09:08:21.682 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/563 2024-01-31T09:08:21.682 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:21.688 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:21.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:21.709 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2024-01-31T09:08:22.071 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:22.081 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:22.082 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:22.919 INFO:teuthology.orchestra.run.smithi049.stdout:generic/564 0s 2024-01-31T09:08:22.931 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/564 2024-01-31T09:08:22.931 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:22.937 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:23.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:23.085 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2024-01-31T09:08:23.678 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:23.688 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:23.688 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:23.979 INFO:teuthology.orchestra.run.smithi049.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:23.987 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/565 2024-01-31T09:08:23.987 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/565 2024-01-31T09:08:23.987 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:23.993 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:24.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:24.012 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2024-01-31T09:08:24.379 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:24.389 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:24.389 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:24.662 INFO:teuthology.orchestra.run.smithi049.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:24.670 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/566 2024-01-31T09:08:24.670 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/566 2024-01-31T09:08:24.670 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:24.676 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:24.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:24.695 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2024-01-31T09:08:25.059 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:25.070 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:25.070 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:25.349 INFO:teuthology.orchestra.run.smithi049.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:25.357 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/567 2024-01-31T09:08:25.357 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/567 2024-01-31T09:08:25.358 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:25.364 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:25.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:25.383 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2024-01-31T09:08:25.729 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:25.739 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:26.195 INFO:teuthology.orchestra.run.smithi049.stdout:generic/568 1s 2024-01-31T09:08:26.274 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/568 2024-01-31T09:08:26.275 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:26.315 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:26.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:26.408 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2024-01-31T09:08:26.851 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:26.861 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:26.862 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:27.190 INFO:teuthology.orchestra.run.smithi049.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:27.198 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/569 2024-01-31T09:08:27.198 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/569 2024-01-31T09:08:27.198 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:27.204 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:27.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:27.225 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2024-01-31T09:08:27.603 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:27.613 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:27.613 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:27.875 INFO:teuthology.orchestra.run.smithi049.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:27.883 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/570 2024-01-31T09:08:27.883 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/570 2024-01-31T09:08:27.883 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:27.889 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:27.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:27.909 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2024-01-31T09:08:28.278 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:28.289 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:28.289 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:30.691 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:08:30.695 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:08:34.716 INFO:teuthology.orchestra.run.smithi049.stdout:generic/571 6s 2024-01-31T09:08:34.728 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/571 2024-01-31T09:08:34.728 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:34.734 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:34.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:34.907 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2024-01-31T09:08:35.455 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:35.465 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:35.465 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:35.756 INFO:teuthology.orchestra.run.smithi049.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:35.764 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/572 2024-01-31T09:08:35.764 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/572 2024-01-31T09:08:35.764 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:35.770 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:35.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:35.789 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2024-01-31T09:08:36.135 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:36.146 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:36.146 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:36.419 INFO:teuthology.orchestra.run.smithi049.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:36.427 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/573 2024-01-31T09:08:36.428 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/573 2024-01-31T09:08:36.428 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:36.433 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:36.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:36.453 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2024-01-31T09:08:36.811 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:36.821 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:36.821 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:37.117 INFO:teuthology.orchestra.run.smithi049.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:37.125 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/574 2024-01-31T09:08:37.125 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/574 2024-01-31T09:08:37.125 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:37.131 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:37.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:37.150 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2024-01-31T09:08:37.511 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:37.521 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:37.521 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:37.784 INFO:teuthology.orchestra.run.smithi049.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:37.792 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/575 2024-01-31T09:08:37.792 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/575 2024-01-31T09:08:37.792 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:37.798 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:37.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:37.817 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2024-01-31T09:08:38.188 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:38.198 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:38.198 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:38.529 INFO:teuthology.orchestra.run.smithi049.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:38.537 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/576 2024-01-31T09:08:38.537 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/576 2024-01-31T09:08:38.537 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:38.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:38.563 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2024-01-31T09:08:38.931 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:38.942 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:38.942 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:39.229 INFO:teuthology.orchestra.run.smithi049.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:39.237 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/577 2024-01-31T09:08:39.238 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/577 2024-01-31T09:08:39.238 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:39.244 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:39.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:39.264 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2024-01-31T09:08:39.616 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:39.626 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:39.626 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:39.958 INFO:teuthology.orchestra.run.smithi049.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-01-31T09:08:39.966 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/578 2024-01-31T09:08:39.966 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/578 2024-01-31T09:08:39.966 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:39.973 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:39.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:39.992 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2024-01-31T09:08:40.352 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:40.362 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:40.362 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:40.659 INFO:teuthology.orchestra.run.smithi049.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:40.667 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/579 2024-01-31T09:08:40.667 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/579 2024-01-31T09:08:40.667 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:40.673 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:40.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:40.693 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2024-01-31T09:08:41.052 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:41.062 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:41.062 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:41.390 INFO:teuthology.orchestra.run.smithi049.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:41.398 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/580 2024-01-31T09:08:41.398 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/580 2024-01-31T09:08:41.398 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:41.404 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:41.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:41.423 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2024-01-31T09:08:41.779 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:41.789 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:41.789 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:42.719 INFO:teuthology.orchestra.run.smithi049.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:42.724 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/581 2024-01-31T09:08:42.724 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/581 2024-01-31T09:08:42.724 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:42.731 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:42.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:42.799 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2024-01-31T09:08:43.159 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:43.169 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:43.169 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:43.515 INFO:teuthology.orchestra.run.smithi049.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:43.523 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/582 2024-01-31T09:08:43.523 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/582 2024-01-31T09:08:43.524 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:43.530 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:43.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:43.595 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2024-01-31T09:08:43.955 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:43.965 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:43.966 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:44.307 INFO:teuthology.orchestra.run.smithi049.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:44.315 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/583 2024-01-31T09:08:44.315 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/583 2024-01-31T09:08:44.315 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:44.321 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:44.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:44.342 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2024-01-31T09:08:44.716 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:44.725 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:44.725 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:45.089 INFO:teuthology.orchestra.run.smithi049.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:45.097 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/584 2024-01-31T09:08:45.097 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/584 2024-01-31T09:08:45.097 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:45.103 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:45.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:45.122 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2024-01-31T09:08:45.487 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:45.497 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:45.497 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:45.775 INFO:teuthology.orchestra.run.smithi049.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:08:45.783 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/585 2024-01-31T09:08:45.783 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/585 2024-01-31T09:08:45.783 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:08:45.789 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:08:45.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:08:45.810 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2024-01-31T09:08:46.162 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:08:46.173 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:08:46.173 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:00.801 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:09:00.806 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:09:10.592 INFO:teuthology.orchestra.run.smithi049.stdout:generic/586 24s 2024-01-31T09:09:10.604 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/586 2024-01-31T09:09:10.604 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:10.610 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:10.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:10.635 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2024-01-31T09:09:11.324 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:11.334 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:11.334 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:11.838 INFO:teuthology.orchestra.run.smithi049.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-01-31T09:09:11.846 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/587 2024-01-31T09:09:11.846 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/587 2024-01-31T09:09:11.846 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:11.852 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:11.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:11.872 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2024-01-31T09:09:12.227 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:12.237 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:12.237 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:12.556 INFO:teuthology.orchestra.run.smithi049.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:12.564 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/588 2024-01-31T09:09:12.564 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/588 2024-01-31T09:09:12.564 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:12.570 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:12.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:12.590 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2024-01-31T09:09:12.968 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:12.978 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:12.978 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:13.256 INFO:teuthology.orchestra.run.smithi049.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:13.263 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/589 2024-01-31T09:09:13.264 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/589 2024-01-31T09:09:13.264 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:13.270 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:13.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:13.290 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2024-01-31T09:09:13.651 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:13.661 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:13.661 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:13.940 INFO:teuthology.orchestra.run.smithi049.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:13.948 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/590 2024-01-31T09:09:13.948 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/590 2024-01-31T09:09:13.948 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:13.954 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:13.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:13.974 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2024-01-31T09:09:14.344 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:14.354 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:14.354 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:14.830 INFO:teuthology.orchestra.run.smithi049.stdout:generic/591 0s 2024-01-31T09:09:14.842 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/591 2024-01-31T09:09:14.843 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:14.849 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:14.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:14.869 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2024-01-31T09:09:15.555 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:15.565 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:15.565 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:15.913 INFO:teuthology.orchestra.run.smithi049.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:15.921 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/592 2024-01-31T09:09:15.921 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/592 2024-01-31T09:09:15.921 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:15.927 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:15.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:15.947 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2024-01-31T09:09:16.315 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:16.325 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:16.325 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:16.662 INFO:teuthology.orchestra.run.smithi049.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:16.669 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/593 2024-01-31T09:09:16.669 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/593 2024-01-31T09:09:16.669 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:16.675 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:16.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:16.695 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2024-01-31T09:09:17.059 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:17.070 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:17.070 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:17.363 INFO:teuthology.orchestra.run.smithi049.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:17.371 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/594 2024-01-31T09:09:17.371 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/594 2024-01-31T09:09:17.371 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:17.377 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:17.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:17.396 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2024-01-31T09:09:17.748 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:17.759 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:17.759 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:18.099 INFO:teuthology.orchestra.run.smithi049.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:18.106 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/595 2024-01-31T09:09:18.107 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/595 2024-01-31T09:09:18.107 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:18.113 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:18.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:18.133 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2024-01-31T09:09:18.496 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:18.506 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:18.506 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:18.795 INFO:teuthology.orchestra.run.smithi049.stdout:generic/596 [not run] accton utility required, skipped this test 2024-01-31T09:09:18.803 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/596 2024-01-31T09:09:18.803 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/596 2024-01-31T09:09:18.803 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:18.809 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:18.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:18.828 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2024-01-31T09:09:19.203 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:19.213 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:19.213 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:20.149 INFO:teuthology.orchestra.run.smithi049.stdout:generic/597 - output mismatch (see /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/597.out.bad) 2024-01-31T09:09:20.154 INFO:teuthology.orchestra.run.smithi049.stdout: --- tests/generic/597.out 2024-01-31 05:06:00.931951401 +0000 2024-01-31T09:09:20.154 INFO:teuthology.orchestra.run.smithi049.stdout: +++ /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/597.out.bad 2024-01-31 09:09:20.142612613 +0000 2024-01-31T09:09:20.154 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -4,11 +4,11 @@ 2024-01-31T09:09:20.154 INFO:teuthology.orchestra.run.smithi049.stdout: fs.protected_symlinks = 0 2024-01-31T09:09:20.154 INFO:teuthology.orchestra.run.smithi049.stdout: successfully followed symlink 2024-01-31T09:09:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: fs.protected_symlinks = 1 2024-01-31T09:09:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: -Permission denied 2024-01-31T09:09:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: +successfully followed symlink 2024-01-31T09:09:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: == Test hardlink create protection when 2024-01-31T09:09:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: == process != target owner and process cannot read target 2024-01-31T09:09:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: fs.protected_hardlinks = 0 2024-01-31T09:09:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: -successfully created hardlink 2024-01-31T09:09:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: +Permission denied 2024-01-31T09:09:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: fs.protected_hardlinks = 1 2024-01-31T09:09:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2024-01-31T09:09:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: +Permission denied 2024-01-31T09:09:20.159 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/597 2024-01-31T09:09:20.160 INFO:teuthology.orchestra.run.smithi049.stdout:Failures: generic/597 2024-01-31T09:09:20.160 INFO:teuthology.orchestra.run.smithi049.stdout:Failed 1 of 1 tests 2024-01-31T09:09:20.166 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:20.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T09:09:20.224 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-01-31T09:09:20.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-01-31T09:09:20.224 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2024-01-31T09:09:20.883 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:20.893 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:20.893 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:22.071 INFO:teuthology.orchestra.run.smithi049.stdout:generic/598 - output mismatch (see /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/598.out.bad) 2024-01-31T09:09:22.076 INFO:teuthology.orchestra.run.smithi049.stdout: --- tests/generic/598.out 2024-01-31 05:06:00.931951401 +0000 2024-01-31T09:09:22.077 INFO:teuthology.orchestra.run.smithi049.stdout: +++ /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/598.out.bad 2024-01-31 09:09:22.066560563 +0000 2024-01-31T09:09:22.077 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -5,13 +5,10 @@ 2024-01-31T09:09:22.077 INFO:teuthology.orchestra.run.smithi049.stdout: = only group writable dir 2024-01-31T09:09:22.077 INFO:teuthology.orchestra.run.smithi049.stdout: fs.protected_regular = 1 2024-01-31T09:09:22.077 INFO:teuthology.orchestra.run.smithi049.stdout: = group & world writable dir 2024-01-31T09:09:22.077 INFO:teuthology.orchestra.run.smithi049.stdout: -Permission denied 2024-01-31T09:09:22.077 INFO:teuthology.orchestra.run.smithi049.stdout: = only group writable dir 2024-01-31T09:09:22.077 INFO:teuthology.orchestra.run.smithi049.stdout: fs.protected_regular = 2 2024-01-31T09:09:22.077 INFO:teuthology.orchestra.run.smithi049.stdout: = group & world writable dir 2024-01-31T09:09:22.077 INFO:teuthology.orchestra.run.smithi049.stdout: -Permission denied 2024-01-31T09:09:22.077 INFO:teuthology.orchestra.run.smithi049.stdout: = only group writable dir 2024-01-31T09:09:22.077 INFO:teuthology.orchestra.run.smithi049.stdout: -Permission denied 2024-01-31T09:09:22.077 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:22.077 INFO:teuthology.orchestra.run.smithi049.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2024-01-31T09:09:22.077 INFO:teuthology.orchestra.run.smithi049.stdout: fs.protected_fifos = 0 2024-01-31T09:09:22.078 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -19,10 +16,7 @@ 2024-01-31T09:09:22.078 INFO:teuthology.orchestra.run.smithi049.stdout: = only group writable dir 2024-01-31T09:09:22.078 INFO:teuthology.orchestra.run.smithi049.stdout: fs.protected_fifos = 1 2024-01-31T09:09:22.078 INFO:teuthology.orchestra.run.smithi049.stdout: = group & world writable dir 2024-01-31T09:09:22.078 INFO:teuthology.orchestra.run.smithi049.stdout: -Permission denied 2024-01-31T09:09:22.078 INFO:teuthology.orchestra.run.smithi049.stdout: = only group writable dir 2024-01-31T09:09:22.078 INFO:teuthology.orchestra.run.smithi049.stdout: fs.protected_fifos = 2 2024-01-31T09:09:22.078 INFO:teuthology.orchestra.run.smithi049.stdout: = group & world writable dir 2024-01-31T09:09:22.078 INFO:teuthology.orchestra.run.smithi049.stdout: -Permission denied 2024-01-31T09:09:22.078 INFO:teuthology.orchestra.run.smithi049.stdout: = only group writable dir 2024-01-31T09:09:22.078 INFO:teuthology.orchestra.run.smithi049.stdout: -Permission denied 2024-01-31T09:09:22.082 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/598 2024-01-31T09:09:22.082 INFO:teuthology.orchestra.run.smithi049.stdout:Failures: generic/598 2024-01-31T09:09:22.082 INFO:teuthology.orchestra.run.smithi049.stdout:Failed 1 of 1 tests 2024-01-31T09:09:22.088 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:22.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T09:09:22.110 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-01-31T09:09:22.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-01-31T09:09:22.110 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2024-01-31T09:09:22.807 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:22.817 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:22.818 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:23.301 INFO:teuthology.orchestra.run.smithi049.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:23.309 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/599 2024-01-31T09:09:23.309 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/599 2024-01-31T09:09:23.309 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:23.315 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:23.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:23.336 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2024-01-31T09:09:23.719 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:23.729 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:23.729 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:24.030 INFO:teuthology.orchestra.run.smithi049.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:24.039 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/600 2024-01-31T09:09:24.039 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/600 2024-01-31T09:09:24.039 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:24.045 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:24.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:24.067 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2024-01-31T09:09:24.427 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:24.439 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:24.439 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:24.711 INFO:teuthology.orchestra.run.smithi049.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:24.719 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/601 2024-01-31T09:09:24.719 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/601 2024-01-31T09:09:24.719 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:24.725 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:24.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:24.745 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2024-01-31T09:09:25.119 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:25.130 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:25.130 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:25.469 INFO:teuthology.orchestra.run.smithi049.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:25.478 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/602 2024-01-31T09:09:25.478 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/602 2024-01-31T09:09:25.478 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:25.484 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:25.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:25.504 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2024-01-31T09:09:25.876 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:25.886 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:25.886 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:26.181 INFO:teuthology.orchestra.run.smithi049.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:26.189 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/603 2024-01-31T09:09:26.189 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/603 2024-01-31T09:09:26.189 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:26.195 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:26.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:26.215 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2024-01-31T09:09:26.591 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:26.601 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:26.601 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:26.874 INFO:teuthology.orchestra.run.smithi049.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:26.882 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/604 2024-01-31T09:09:26.883 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/604 2024-01-31T09:09:26.883 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:26.889 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:26.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:26.908 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2024-01-31T09:09:27.263 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:27.273 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:27.273 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:27.565 INFO:teuthology.orchestra.run.smithi049.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:27.573 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/605 2024-01-31T09:09:27.573 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/605 2024-01-31T09:09:27.573 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:27.579 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:27.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:27.600 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2024-01-31T09:09:27.954 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:27.964 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:27.964 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:28.257 INFO:teuthology.orchestra.run.smithi049.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:28.265 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/606 2024-01-31T09:09:28.265 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/606 2024-01-31T09:09:28.265 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:28.271 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:28.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:28.292 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2024-01-31T09:09:28.656 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:28.666 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:28.666 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:28.946 INFO:teuthology.orchestra.run.smithi049.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:28.954 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/607 2024-01-31T09:09:28.954 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/607 2024-01-31T09:09:28.954 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:28.960 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:28.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:28.981 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2024-01-31T09:09:29.348 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:29.358 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:29.358 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:29.640 INFO:teuthology.orchestra.run.smithi049.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:29.649 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/608 2024-01-31T09:09:29.649 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/608 2024-01-31T09:09:29.649 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:29.655 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:29.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:29.676 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2024-01-31T09:09:30.043 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:30.053 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:30.053 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:30.648 INFO:teuthology.orchestra.run.smithi049.stdout:generic/609 0s 2024-01-31T09:09:30.660 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/609 2024-01-31T09:09:30.660 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:30.666 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:30.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:30.824 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2024-01-31T09:09:30.920 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:09:30.925 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:09:31.359 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:31.369 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:31.369 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:31.637 INFO:teuthology.orchestra.run.smithi049.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:31.645 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/610 2024-01-31T09:09:31.645 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/610 2024-01-31T09:09:31.645 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:31.651 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:31.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:31.671 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2024-01-31T09:09:32.028 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:32.038 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:32.038 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:32.280 INFO:teuthology.orchestra.run.smithi049.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:32.289 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/611 2024-01-31T09:09:32.289 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/611 2024-01-31T09:09:32.289 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:32.295 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:32.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:32.315 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2024-01-31T09:09:32.667 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:32.677 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:32.677 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:33.046 INFO:teuthology.orchestra.run.smithi049.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T09:09:33.054 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/612 2024-01-31T09:09:33.055 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/612 2024-01-31T09:09:33.055 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:33.061 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:33.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:33.088 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2024-01-31T09:09:33.758 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:33.769 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:33.769 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:34.235 INFO:teuthology.orchestra.run.smithi049.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:34.243 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/613 2024-01-31T09:09:34.243 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/613 2024-01-31T09:09:34.243 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:34.249 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:34.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:34.269 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2024-01-31T09:09:34.655 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:34.666 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:34.666 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:34.925 INFO:teuthology.orchestra.run.smithi049.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:34.933 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/614 2024-01-31T09:09:34.933 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/614 2024-01-31T09:09:34.933 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:34.939 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:34.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:34.959 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2024-01-31T09:09:35.324 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:35.334 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:35.334 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:35.614 INFO:teuthology.orchestra.run.smithi049.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:09:35.621 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/615 2024-01-31T09:09:35.622 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/615 2024-01-31T09:09:35.622 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:09:35.627 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:09:35.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:09:35.647 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2024-01-31T09:09:36.011 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:09:36.021 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:09:36.021 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:10:01.086 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:10:01.090 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:10:31.135 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:10:31.140 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:10:31.173 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-31T09:10:31.172+0000 7fd9fae00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 430395) UID: 0 2024-01-31T09:10:31.173 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-31T09:10:31.172+0000 7fab97400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 430395) UID: 0 2024-01-31T09:13:18.789 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T09:13:18.788+0000 7f91cc000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 430407) UID: 0 2024-01-31T09:13:18.790 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T09:13:18.788+0000 7f96ce200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 430407) UID: 0 2024-01-31T09:13:18.790 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T09:13:18.788+0000 7f79d2800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 430407) UID: 0 2024-01-31T09:13:18.790 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T09:13:18.788+0000 7f4aaf800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 430407) UID: 0 2024-01-31T09:13:25.925 INFO:teuthology.orchestra.run.smithi049.stdout:generic/616 229s 2024-01-31T09:13:25.938 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/616 2024-01-31T09:13:25.938 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:13:25.944 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:13:25.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:13:25.965 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2024-01-31T09:13:26.383 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:13:26.393 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:13:26.393 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:31.557 INFO:teuthology.orchestra.run.smithi049.stdout:generic/617 65s 2024-01-31T09:14:31.568 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/617 2024-01-31T09:14:31.569 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:31.574 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:31.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:31.620 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2024-01-31T09:14:32.295 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:32.305 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:32.305 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:32.592 INFO:teuthology.orchestra.run.smithi049.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:14:32.600 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/618 2024-01-31T09:14:32.600 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/618 2024-01-31T09:14:32.600 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:32.606 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:32.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:32.627 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2024-01-31T09:14:32.996 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:33.006 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:33.006 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:33.277 INFO:teuthology.orchestra.run.smithi049.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:14:33.286 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/619 2024-01-31T09:14:33.287 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/619 2024-01-31T09:14:33.287 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:33.293 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:33.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:33.315 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2024-01-31T09:14:33.683 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:33.693 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:33.693 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:34.156 INFO:teuthology.orchestra.run.smithi049.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:14:34.164 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/620 2024-01-31T09:14:34.164 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/620 2024-01-31T09:14:34.164 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:34.170 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:34.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:34.190 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2024-01-31T09:14:34.537 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:34.547 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:34.547 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:34.894 INFO:teuthology.orchestra.run.smithi049.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:14:34.902 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/621 2024-01-31T09:14:34.902 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/621 2024-01-31T09:14:34.902 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:34.908 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:34.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:34.927 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2024-01-31T09:14:35.299 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:35.308 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:35.309 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:35.575 INFO:teuthology.orchestra.run.smithi049.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:14:35.584 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/622 2024-01-31T09:14:35.584 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/622 2024-01-31T09:14:35.584 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:35.590 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:35.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:35.609 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2024-01-31T09:14:35.976 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:35.986 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:35.987 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:36.275 INFO:teuthology.orchestra.run.smithi049.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:14:36.283 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/623 2024-01-31T09:14:36.283 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/623 2024-01-31T09:14:36.283 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:36.289 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:36.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:36.310 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2024-01-31T09:14:36.683 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:36.693 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:36.693 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:36.968 INFO:teuthology.orchestra.run.smithi049.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:14:36.976 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/624 2024-01-31T09:14:36.976 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/624 2024-01-31T09:14:36.976 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:36.982 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:37.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:37.003 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2024-01-31T09:14:37.370 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:37.380 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:37.381 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:37.649 INFO:teuthology.orchestra.run.smithi049.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:14:37.657 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/625 2024-01-31T09:14:37.657 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/625 2024-01-31T09:14:37.658 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:37.663 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:37.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:37.684 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2024-01-31T09:14:38.048 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:38.058 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:38.058 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:38.354 INFO:teuthology.orchestra.run.smithi049.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:14:38.362 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/626 2024-01-31T09:14:38.362 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/626 2024-01-31T09:14:38.362 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:38.368 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:38.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:38.423 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2024-01-31T09:14:38.787 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:38.797 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:38.798 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:39.081 INFO:teuthology.orchestra.run.smithi049.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:14:39.089 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/627 2024-01-31T09:14:39.090 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/627 2024-01-31T09:14:39.090 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:39.096 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:39.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:39.115 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2024-01-31T09:14:39.474 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:39.484 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:39.485 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:39.783 INFO:teuthology.orchestra.run.smithi049.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:14:39.791 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/628 2024-01-31T09:14:39.791 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/628 2024-01-31T09:14:39.791 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:39.797 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:39.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:39.817 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2024-01-31T09:14:40.199 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:40.209 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:40.209 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:40.522 INFO:teuthology.orchestra.run.smithi049.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:14:40.531 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/629 2024-01-31T09:14:40.531 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/629 2024-01-31T09:14:40.531 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:40.537 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:40.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:40.557 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2024-01-31T09:14:40.919 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:40.930 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:40.930 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:41.198 INFO:teuthology.orchestra.run.smithi049.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:14:41.206 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/630 2024-01-31T09:14:41.206 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/630 2024-01-31T09:14:41.206 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:41.212 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:41.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:41.234 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2024-01-31T09:14:41.593 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:41.603 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:41.603 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:41.933 INFO:teuthology.orchestra.run.smithi049.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:14:41.941 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/631 2024-01-31T09:14:41.941 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/631 2024-01-31T09:14:41.941 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:41.947 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:41.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:41.967 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2024-01-31T09:14:42.331 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:42.341 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:42.342 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:48.658 INFO:teuthology.orchestra.run.smithi049.stdout:generic/632 6s 2024-01-31T09:14:48.671 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/632 2024-01-31T09:14:48.671 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:48.677 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:48.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:48.698 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2024-01-31T09:14:49.059 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:49.069 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:49.069 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:49.774 INFO:teuthology.orchestra.run.smithi049.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/633.out.bad) 2024-01-31T09:14:49.843 INFO:teuthology.orchestra.run.smithi049.stdout: --- tests/generic/633.out 2024-01-31 05:06:00.935951317 +0000 2024-01-31T09:14:49.844 INFO:teuthology.orchestra.run.smithi049.stdout: +++ /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/633.out.bad 2024-01-31 09:14:49.737586862 +0000 2024-01-31T09:14:49.844 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -1,2 +1,5 @@ 2024-01-31T09:14:49.844 INFO:teuthology.orchestra.run.smithi049.stdout: QA output created by 633 2024-01-31T09:14:49.844 INFO:teuthology.orchestra.run.smithi049.stdout: Silence is golden 2024-01-31T09:14:49.844 INFO:teuthology.orchestra.run.smithi049.stdout: +vfstest.c: 1164: protected_symlinks - Success - failure: openat 2024-01-31T09:14:49.844 INFO:teuthology.orchestra.run.smithi049.stdout: +vfstest.c: 1171: protected_symlinks - Success - failure: wait_for_pid 2024-01-31T09:14:49.844 INFO:teuthology.orchestra.run.smithi049.stdout: +vfstest.c: 2418: run_test - Success - failure: following protected symlinks on regular mounts 2024-01-31T09:14:49.883 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/633 2024-01-31T09:14:49.883 INFO:teuthology.orchestra.run.smithi049.stdout:Failures: generic/633 2024-01-31T09:14:49.885 INFO:teuthology.orchestra.run.smithi049.stdout:Failed 1 of 1 tests 2024-01-31T09:14:49.950 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:50.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T09:14:50.010 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-01-31T09:14:50.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-01-31T09:14:50.011 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2024-01-31T09:14:50.398 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:50.409 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:50.409 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:50.686 INFO:teuthology.orchestra.run.smithi049.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:14:50.694 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/634 2024-01-31T09:14:50.694 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/634 2024-01-31T09:14:50.695 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:50.700 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:50.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:50.720 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2024-01-31T09:14:51.072 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:51.082 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:51.082 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:51.355 INFO:teuthology.orchestra.run.smithi049.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:14:51.364 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/635 2024-01-31T09:14:51.364 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/635 2024-01-31T09:14:51.364 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:51.371 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:51.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:51.391 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2024-01-31T09:14:51.747 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:51.757 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:51.757 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:52.041 INFO:teuthology.orchestra.run.smithi049.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:14:52.049 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/636 2024-01-31T09:14:52.049 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/636 2024-01-31T09:14:52.049 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:52.055 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:52.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:52.075 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2024-01-31T09:14:52.449 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:52.458 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:52.458 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:53.969 INFO:teuthology.orchestra.run.smithi049.stdout:generic/637 1s 2024-01-31T09:14:53.981 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/637 2024-01-31T09:14:53.981 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:53.987 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:54.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:54.009 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2024-01-31T09:14:54.747 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:54.757 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:54.758 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:55.159 INFO:teuthology.orchestra.run.smithi049.stdout:generic/638 1s 2024-01-31T09:14:55.171 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/638 2024-01-31T09:14:55.171 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:14:55.177 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:14:55.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:14:55.200 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2024-01-31T09:14:55.561 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:14:55.572 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:14:55.572 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:01.523 INFO:teuthology.orchestra.run.smithi049.stdout:generic/639 5s 2024-01-31T09:15:01.537 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/639 2024-01-31T09:15:01.537 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:15:01.544 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:01.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:15:01.564 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2024-01-31T09:15:01.955 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:15:01.965 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:15:01.965 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:02.408 INFO:teuthology.orchestra.run.smithi049.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:15:02.417 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/640 2024-01-31T09:15:02.417 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/640 2024-01-31T09:15:02.417 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:15:02.423 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:02.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:15:02.442 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2024-01-31T09:15:02.822 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:15:02.832 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:15:02.832 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:03.104 INFO:teuthology.orchestra.run.smithi049.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:15:03.112 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/641 2024-01-31T09:15:03.112 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/641 2024-01-31T09:15:03.112 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:15:03.118 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:03.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:15:03.138 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2024-01-31T09:15:03.506 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:15:03.515 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:15:03.516 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:03.801 INFO:teuthology.orchestra.run.smithi049.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:15:03.809 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/642 2024-01-31T09:15:03.809 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/642 2024-01-31T09:15:03.809 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:15:03.815 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:03.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:15:03.835 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2024-01-31T09:15:04.228 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:15:04.238 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:15:04.238 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:04.513 INFO:teuthology.orchestra.run.smithi049.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:15:04.521 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/643 2024-01-31T09:15:04.521 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/643 2024-01-31T09:15:04.521 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:15:04.528 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:04.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:15:04.547 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2024-01-31T09:15:04.914 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:15:05.534 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:15:05.534 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:05.534 INFO:teuthology.orchestra.run.smithi049.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2024-01-31T09:15:05.534 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/644 2024-01-31T09:15:05.534 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/644 2024-01-31T09:15:05.534 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:15:05.534 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:05.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:15:05.535 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2024-01-31T09:15:05.899 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:15:05.909 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:15:05.909 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:06.177 INFO:teuthology.orchestra.run.smithi049.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2024-01-31T09:15:06.185 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/645 2024-01-31T09:15:06.185 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/645 2024-01-31T09:15:06.185 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:15:06.191 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:06.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:15:06.211 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2024-01-31T09:15:06.562 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:15:06.572 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:15:06.573 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:06.858 INFO:teuthology.orchestra.run.smithi049.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:15:06.866 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/646 2024-01-31T09:15:06.867 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/646 2024-01-31T09:15:06.867 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:15:06.873 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:06.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:15:06.893 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2024-01-31T09:15:07.285 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:15:07.295 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:15:07.295 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:07.793 INFO:teuthology.orchestra.run.smithi049.stdout:generic/647 0s 2024-01-31T09:15:07.805 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/647 2024-01-31T09:15:07.805 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:15:07.811 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:07.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:15:07.984 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2024-01-31T09:15:08.571 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:15:08.581 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:15:08.581 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T09:15:08.875 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/648 2024-01-31T09:15:08.875 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/648 2024-01-31T09:15:08.875 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:15:08.881 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:08.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:15:08.902 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2024-01-31T09:15:09.274 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:15:09.284 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:15:09.284 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:09.686 INFO:teuthology.orchestra.run.smithi049.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T09:15:09.694 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/649 2024-01-31T09:15:09.694 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/649 2024-01-31T09:15:09.694 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T09:15:09.700 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:15:09.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T09:15:09.856 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2024-01-31T09:15:10.464 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T09:15:10.474 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T09:15:10.474 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T09:20:11.785 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:20:11.790 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:20:41.852 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:20:41.857 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:21:12.609 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:21:12.617 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:21:42.755 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:21:42.773 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:22:12.835 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:22:12.840 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:22:42.911 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:22:42.917 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:23:13.010 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:23:13.027 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:23:43.268 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:23:43.276 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:23:43.305 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T09:23:43.302+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34204) UID: 0 2024-01-31T09:23:43.306 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T09:23:43.302+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34204) UID: 0 2024-01-31T09:23:43.306 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T09:23:43.302+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34204) UID: 0 2024-01-31T09:23:43.306 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T09:23:43.302+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34204) UID: 0 2024-01-31T09:27:06.873 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:27:06.885 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:27:06.974 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T09:27:06.973+0000 7f96ce200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 447723) UID: 0 2024-01-31T09:27:06.975 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T09:27:06.973+0000 7f79d2800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 447723) UID: 0 2024-01-31T09:27:06.980 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T09:27:06.981+0000 7f91cc000640 -1 received signal: Hangup from (PID: 447723) UID: 0 2024-01-31T09:27:06.992 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T09:27:06.989+0000 7f4aaf800640 -1 Fail to open '/proc/447723/cmdline' error = (2) No such file or directory 2024-01-31T09:27:06.992 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T09:27:06.989+0000 7f4aaf800640 -1 received signal: Hangup from (PID: 447723) UID: 0 2024-01-31T09:39:39.646 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:39:39.652 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:40:09.912 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:40:09.922 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:40:40.054 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:40:40.089 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:41:10.749 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:41:10.753 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:41:40.974 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:41:41.055 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:42:11.276 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:42:11.323 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:42:42.279 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:42:42.285 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:43:12.424 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:43:12.428 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:43:42.669 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:43:42.681 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:44:12.890 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:44:12.908 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:44:43.502 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:44:43.507 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:45:13.674 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:45:13.681 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:45:13.785 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-31T09:45:13.784+0000 7fd9fae00640 -1 received signal: Hangup from (PID: 450145) UID: 0 2024-01-31T09:45:13.790 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-31T09:45:13.784+0000 7fab97400640 -1 received signal: Hangup from (PID: 450145) UID: 0 2024-01-31T09:56:19.575 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:56:19.603 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T09:56:19.738 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T09:56:19.734+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34351) UID: 0 2024-01-31T09:56:19.739 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T09:56:19.734+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34351) UID: 0 2024-01-31T09:56:19.739 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T09:56:19.734+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34351) UID: 0 2024-01-31T09:56:19.739 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T09:56:19.734+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34351) UID: 0 2024-01-31T09:56:19.746 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T09:56:19.742+0000 7f91cc000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451588) UID: 0 2024-01-31T09:56:19.759 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T09:56:19.758+0000 7f96ce200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451588) UID: 0 2024-01-31T09:56:19.778 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T09:56:19.774+0000 7f4aaf800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451588) UID: 0 2024-01-31T09:56:19.791 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T09:56:19.786+0000 7f79d2800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451588) UID: 0 2024-01-31T10:07:41.116 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:07:41.154 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:07:41.470 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T10:07:41.468+0000 7f4aaf800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 453166) UID: 0 2024-01-31T10:07:41.471 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T10:07:41.469+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34397) UID: 0 2024-01-31T10:07:41.471 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T10:07:41.469+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34397) UID: 0 2024-01-31T10:07:41.472 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T10:07:41.469+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34397) UID: 0 2024-01-31T10:07:41.472 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T10:07:41.469+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34397) UID: 0 2024-01-31T10:07:41.483 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T10:07:41.476+0000 7f79d2800640 -1 Fail to open '/proc/453166/cmdline' error = (2) No such file or directory 2024-01-31T10:07:41.483 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T10:07:41.476+0000 7f79d2800640 -1 received signal: Hangup from (PID: 453166) UID: 0 2024-01-31T10:07:41.489 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T10:07:41.468+0000 7f91cc000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 453166) UID: 0 2024-01-31T10:07:41.503 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T10:07:41.476+0000 7f96ce200640 -1 Fail to open '/proc/453166/cmdline' error = (2) No such file or directory 2024-01-31T10:07:41.503 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T10:07:41.492+0000 7f96ce200640 -1 received signal: Hangup from (PID: 453166) UID: 0 2024-01-31T10:18:39.837 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:18:39.844 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:18:39.948 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-31T10:18:39.946+0000 7fd9fae00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 454710) UID: 0 2024-01-31T10:18:39.955 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-31T10:18:39.946+0000 7fab97400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 454710) UID: 0 2024-01-31T10:30:34.504 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:30:34.513 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:31:04.745 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:31:04.755 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:31:34.964 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:31:34.968 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:32:05.210 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:32:05.215 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:32:05.424 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T10:32:05.417+0000 7f79d2800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 456509) UID: 0 2024-01-31T10:32:05.425 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T10:32:05.425+0000 7f91cc000640 -1 received signal: Hangup from (PID: 456509) UID: 0 2024-01-31T10:32:05.437 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T10:32:05.425+0000 7f4aaf800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 456509) UID: 0 2024-01-31T10:32:05.447 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T10:32:05.417+0000 7f96ce200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 456509) UID: 0 2024-01-31T10:43:56.041 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:43:56.050 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:44:26.406 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:44:26.412 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:44:56.603 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:44:56.613 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:45:26.696 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:45:26.701 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:45:56.883 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:45:56.893 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:46:27.016 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:46:27.029 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:46:57.291 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:46:57.298 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:46:57.343 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T10:46:57.338+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34584) UID: 0 2024-01-31T10:46:57.344 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T10:46:57.338+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34584) UID: 0 2024-01-31T10:46:57.344 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T10:46:57.338+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34584) UID: 0 2024-01-31T10:46:57.344 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T10:46:57.338+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34584) UID: 0 2024-01-31T10:50:19.337 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:50:19.350 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T10:50:20.849 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-31T10:50:20.843+0000 7fd9fae00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 458829) UID: 0 2024-01-31T10:50:20.856 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-31T10:50:20.847+0000 7fab97400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 458829) UID: 0 2024-01-31T10:55:40.010 INFO:teuthology.orchestra.run.smithi049.stdout:generic/650 6029s 2024-01-31T10:55:40.149 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/650 2024-01-31T10:55:40.149 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:55:40.175 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:55:40.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:55:40.215 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2024-01-31T10:55:41.794 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:55:41.839 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:55:41.839 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:55:42.995 INFO:teuthology.orchestra.run.smithi049.stdout:generic/651 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:55:43.006 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/651 2024-01-31T10:55:43.007 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/651 2024-01-31T10:55:43.007 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:55:43.022 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:55:43.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:55:43.052 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2024-01-31T10:55:44.284 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:55:44.299 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:55:44.299 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:55:45.478 INFO:teuthology.orchestra.run.smithi049.stdout:generic/652 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:55:45.518 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/652 2024-01-31T10:55:45.519 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/652 2024-01-31T10:55:45.519 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:55:45.549 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:55:45.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:55:45.653 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2024-01-31T10:55:47.189 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:55:47.244 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:55:47.244 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:55:48.272 INFO:teuthology.orchestra.run.smithi049.stdout:generic/653 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:55:48.307 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/653 2024-01-31T10:55:48.307 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/653 2024-01-31T10:55:48.311 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:55:48.318 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:55:48.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:55:48.385 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2024-01-31T10:55:49.773 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:55:49.814 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:55:49.814 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:55:50.800 INFO:teuthology.orchestra.run.smithi049.stdout:generic/654 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:55:50.814 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/654 2024-01-31T10:55:50.814 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/654 2024-01-31T10:55:50.814 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:55:50.836 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:55:50.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:55:50.936 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2024-01-31T10:55:52.340 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:55:52.365 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:55:52.365 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:55:53.421 INFO:teuthology.orchestra.run.smithi049.stdout:generic/655 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:55:53.464 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/655 2024-01-31T10:55:53.464 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/655 2024-01-31T10:55:53.464 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:55:53.483 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:55:53.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:55:53.568 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2024-01-31T10:55:54.856 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:55:54.914 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:55:54.914 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:55:56.071 INFO:teuthology.orchestra.run.smithi049.stdout:generic/656 [not run] vfstest not support by ceph-fuse 2024-01-31T10:55:56.084 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/656 2024-01-31T10:55:56.084 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/656 2024-01-31T10:55:56.084 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:55:56.093 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:55:56.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:55:56.137 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2024-01-31T10:55:57.332 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:55:57.375 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:55:57.375 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:55:58.496 INFO:teuthology.orchestra.run.smithi049.stdout:generic/657 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:55:58.535 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/657 2024-01-31T10:55:58.535 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/657 2024-01-31T10:55:58.535 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:55:58.557 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:55:58.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:55:58.606 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2024-01-31T10:55:59.995 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:56:00.044 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:56:00.044 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:01.009 INFO:teuthology.orchestra.run.smithi049.stdout:generic/658 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:56:01.040 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/658 2024-01-31T10:56:01.040 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/658 2024-01-31T10:56:01.041 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:56:01.070 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:01.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:56:01.165 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2024-01-31T10:56:02.508 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:56:02.556 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:56:02.557 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:03.594 INFO:teuthology.orchestra.run.smithi049.stdout:generic/659 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:56:03.639 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/659 2024-01-31T10:56:03.639 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/659 2024-01-31T10:56:03.640 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:56:03.672 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:03.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:56:03.762 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2024-01-31T10:56:05.445 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:56:05.490 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:56:05.491 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:06.781 INFO:teuthology.orchestra.run.smithi049.stdout:generic/660 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:56:06.811 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/660 2024-01-31T10:56:06.812 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/660 2024-01-31T10:56:06.812 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:56:06.831 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:06.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:56:06.911 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2024-01-31T10:56:08.425 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:56:08.454 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:56:08.454 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:09.381 INFO:teuthology.orchestra.run.smithi049.stdout:generic/661 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:56:09.415 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/661 2024-01-31T10:56:09.416 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/661 2024-01-31T10:56:09.416 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:56:09.438 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:09.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:56:09.474 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2024-01-31T10:56:10.663 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:56:10.715 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:56:10.715 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:11.922 INFO:teuthology.orchestra.run.smithi049.stdout:generic/662 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:56:11.962 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/662 2024-01-31T10:56:11.962 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/662 2024-01-31T10:56:11.962 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:56:11.979 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:12.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:56:12.066 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2024-01-31T10:56:13.480 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:56:13.522 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:56:13.522 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:14.688 INFO:teuthology.orchestra.run.smithi049.stdout:generic/663 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:56:14.721 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/663 2024-01-31T10:56:14.721 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/663 2024-01-31T10:56:14.723 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:56:14.763 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:14.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:56:14.871 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2024-01-31T10:56:16.099 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:56:16.142 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:56:16.142 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:17.077 INFO:teuthology.orchestra.run.smithi049.stdout:generic/664 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:56:17.106 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/664 2024-01-31T10:56:17.106 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/664 2024-01-31T10:56:17.106 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:56:17.129 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:17.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:56:17.226 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2024-01-31T10:56:18.455 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:56:18.513 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:56:18.513 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:19.586 INFO:teuthology.orchestra.run.smithi049.stdout:generic/665 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:56:19.636 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/665 2024-01-31T10:56:19.636 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/665 2024-01-31T10:56:19.636 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:56:19.673 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:19.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:56:19.752 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2024-01-31T10:56:21.249 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:56:21.305 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:56:21.306 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:22.074 INFO:teuthology.orchestra.run.smithi049.stdout:generic/666 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:56:22.105 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/666 2024-01-31T10:56:22.106 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/666 2024-01-31T10:56:22.106 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:56:22.136 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:22.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:56:22.186 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2024-01-31T10:56:23.228 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:56:23.273 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:56:23.273 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:24.406 INFO:teuthology.orchestra.run.smithi049.stdout:generic/667 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:56:24.445 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/667 2024-01-31T10:56:24.446 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/667 2024-01-31T10:56:24.446 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:56:24.464 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:24.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:56:24.530 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2024-01-31T10:56:26.023 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:56:26.063 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:56:26.063 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:27.153 INFO:teuthology.orchestra.run.smithi049.stdout:generic/668 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:56:27.184 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/668 2024-01-31T10:56:27.184 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/668 2024-01-31T10:56:27.184 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:56:27.204 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:27.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:56:27.282 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2024-01-31T10:56:28.735 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:56:28.788 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:56:28.789 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:29.905 INFO:teuthology.orchestra.run.smithi049.stdout:generic/669 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:56:29.940 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/669 2024-01-31T10:56:29.940 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/669 2024-01-31T10:56:29.940 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:56:29.950 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:29.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:56:29.999 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2024-01-31T10:56:31.323 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:56:31.368 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:56:31.368 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:32.286 INFO:teuthology.orchestra.run.smithi049.stdout:generic/670 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:56:32.304 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/670 2024-01-31T10:56:32.304 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/670 2024-01-31T10:56:32.304 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:56:32.311 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:32.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:56:32.415 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2024-01-31T10:56:33.531 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:56:33.567 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:56:33.567 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:34.718 INFO:teuthology.orchestra.run.smithi049.stdout:generic/671 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:56:34.756 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/671 2024-01-31T10:56:34.756 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/671 2024-01-31T10:56:34.756 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:56:34.786 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:34.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:56:34.855 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2024-01-31T10:56:35.841 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:56:35.881 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:56:35.881 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:36.741 INFO:teuthology.orchestra.run.smithi049.stdout:generic/672 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:56:36.779 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/672 2024-01-31T10:56:36.780 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/672 2024-01-31T10:56:36.780 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:56:36.788 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:36.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:56:36.869 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2024-01-31T10:56:38.182 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:56:38.216 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:56:38.217 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:40.398 INFO:teuthology.orchestra.run.smithi049.stdout:generic/673 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:56:40.439 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/673 2024-01-31T10:56:40.440 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/673 2024-01-31T10:56:40.440 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:56:40.468 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:40.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:56:40.535 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2024-01-31T10:56:41.961 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:56:41.982 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:56:41.982 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:43.249 INFO:teuthology.orchestra.run.smithi049.stdout:generic/674 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:56:43.285 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/674 2024-01-31T10:56:43.286 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/674 2024-01-31T10:56:43.286 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:56:43.325 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:43.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:56:43.409 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2024-01-31T10:56:44.718 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:56:44.763 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:56:44.763 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:45.944 INFO:teuthology.orchestra.run.smithi049.stdout:generic/675 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T10:56:45.958 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/675 2024-01-31T10:56:45.959 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/675 2024-01-31T10:56:45.959 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T10:56:45.990 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:46.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T10:56:46.079 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2024-01-31T10:56:47.371 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T10:56:47.389 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T10:56:47.389 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T10:56:49.581 INFO:teuthology.orchestra.run.smithi049.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.a.log.1: 2024-01-31T10:56:49.582 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: stdin: file size changed while zipping 2024-01-31T10:56:56.167 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T10:56:56.164+0000 7f4aaf800640 -1 Fail to open '/proc/469404/cmdline' error = (2) No such file or directory 2024-01-31T10:56:56.168 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T10:56:56.164+0000 7f4aaf800640 -1 received signal: Hangup from (PID: 469404) UID: 0 2024-01-31T10:56:56.168 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T10:56:56.164+0000 7f91cc000640 -1 Fail to open '/proc/469404/cmdline' error = (2) No such file or directory 2024-01-31T10:56:56.168 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T10:56:56.164+0000 7f91cc000640 -1 received signal: Hangup from (PID: 469404) UID: 0 2024-01-31T10:56:56.169 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T10:56:56.164+0000 7f79d2800640 -1 Fail to open '/proc/469404/cmdline' error = (2) No such file or directory 2024-01-31T10:56:56.169 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T10:56:56.164+0000 7f79d2800640 -1 received signal: Hangup from (PID: 469404) UID: 0 2024-01-31T10:56:56.170 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T10:56:56.164+0000 7f96ce200640 -1 Fail to open '/proc/469404/cmdline' error = (2) No such file or directory 2024-01-31T10:56:56.170 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T10:56:56.164+0000 7f96ce200640 -1 received signal: Hangup from (PID: 469404) UID: 0 2024-01-31T11:05:30.746 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T11:05:30.750 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T11:05:30.780 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T11:05:30.774+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34634) UID: 0 2024-01-31T11:05:30.780 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T11:05:30.774+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34634) UID: 0 2024-01-31T11:05:30.781 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T11:05:30.774+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34634) UID: 0 2024-01-31T11:05:30.781 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T11:05:30.774+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34634) UID: 0 2024-01-31T11:09:44.435 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T11:09:44.448 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T11:09:44.574 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T11:09:44.569+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34645) UID: 0 2024-01-31T11:09:44.575 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T11:09:44.569+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34645) UID: 0 2024-01-31T11:09:44.575 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T11:09:44.569+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34645) UID: 0 2024-01-31T11:09:44.575 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T11:09:44.569+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34645) UID: 0 2024-01-31T11:09:44.587 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-31T11:09:44.575+0000 7fd9fae00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 469446) UID: 0 2024-01-31T11:09:44.587 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-31T11:09:44.575+0000 7fab97400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 469446) UID: 0 2024-01-31T11:17:25.024 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T11:17:25.019+0000 7f91cc000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 469478) UID: 0 2024-01-31T11:17:25.025 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T11:17:25.019+0000 7f79d2800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 469478) UID: 0 2024-01-31T11:17:25.026 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T11:17:25.023+0000 7f4aaf800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 469478) UID: 0 2024-01-31T11:17:25.026 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T11:17:25.023+0000 7f96ce200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 469478) UID: 0 2024-01-31T11:26:07.434 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T11:26:07.452 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T11:26:07.486 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T11:26:07.484+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34686) UID: 0 2024-01-31T11:26:07.486 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T11:26:07.484+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34686) UID: 0 2024-01-31T11:26:07.487 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T11:26:07.484+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34686) UID: 0 2024-01-31T11:26:07.487 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T11:26:07.484+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34686) UID: 0 2024-01-31T11:26:07.785 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T11:26:07.780+0000 7f96ce200640 -1 received signal: Hangup from (PID: 469500) UID: 0 2024-01-31T11:26:07.785 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T11:26:07.780+0000 7f91cc000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 469500) UID: 0 2024-01-31T11:26:07.785 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T11:26:07.780+0000 7f79d2800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 469500) UID: 0 2024-01-31T11:26:07.798 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T11:26:07.784+0000 7f4aaf800640 -1 Fail to open '/proc/469500/cmdline' error = (2) No such file or directory 2024-01-31T11:26:07.798 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T11:26:07.784+0000 7f4aaf800640 -1 received signal: Hangup from (PID: 469500) UID: 0 2024-01-31T11:33:56.134 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T11:33:56.140 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T11:33:56.501 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-31T11:33:56.500+0000 7fd9fae00640 -1 received signal: Hangup from (PID: 469517) UID: 0 2024-01-31T11:33:56.501 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-31T11:33:56.500+0000 7fab97400640 -1 received signal: Hangup from (PID: 469517) UID: 0 2024-01-31T11:43:37.521 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T11:43:37.516+0000 7f91cc000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 469538) UID: 0 2024-01-31T11:43:37.522 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T11:43:37.516+0000 7f79d2800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 469538) UID: 0 2024-01-31T11:43:37.522 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T11:43:37.516+0000 7f4aaf800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 469538) UID: 0 2024-01-31T11:43:37.523 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T11:43:37.516+0000 7f96ce200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 469538) UID: 0 2024-01-31T11:51:17.286 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T11:51:17.291 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T11:51:17.391 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-01-31T11:51:17.387+0000 7fd9fae00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 469556) UID: 0 2024-01-31T11:51:17.391 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-01-31T11:51:17.387+0000 7fab97400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 469556) UID: 0 2024-01-31T11:58:49.191 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T11:58:49.206 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T11:58:49.239 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T11:58:49.240+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34768) UID: 0 2024-01-31T11:58:49.239 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T11:58:49.240+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34768) UID: 0 2024-01-31T11:58:49.239 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T11:58:49.240+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34768) UID: 0 2024-01-31T11:58:49.240 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T11:58:49.240+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34768) UID: 0 2024-01-31T12:02:18.670 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T12:02:18.681 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T12:02:18.888 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T12:02:18.888+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34778) UID: 0 2024-01-31T12:02:18.888 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T12:02:18.888+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34778) UID: 0 2024-01-31T12:02:18.888 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T12:02:18.888+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34778) UID: 0 2024-01-31T12:02:18.889 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T12:02:18.888+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34778) UID: 0 2024-01-31T12:05:34.123 INFO:teuthology.orchestra.run.smithi049.stdout:generic/676 4127s 2024-01-31T12:05:34.303 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/676 2024-01-31T12:05:34.303 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:05:34.314 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:05:34.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:05:34.395 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2024-01-31T12:05:36.526 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:05:36.567 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:05:36.567 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:05:37.524 INFO:teuthology.orchestra.run.smithi049.stdout:generic/677 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T12:05:37.558 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/677 2024-01-31T12:05:37.558 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/677 2024-01-31T12:05:37.558 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:05:37.578 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:05:37.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:05:37.614 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2024-01-31T12:05:38.851 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:05:38.875 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:05:38.876 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:05:40.435 INFO:teuthology.orchestra.run.smithi049.stdout:generic/678 2s 2024-01-31T12:05:40.470 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/678 2024-01-31T12:05:40.470 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:05:40.499 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:05:40.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:05:40.566 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2024-01-31T12:05:40.892 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T12:05:40.901 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T12:05:42.230 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:05:42.258 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:05:42.259 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:05:44.706 INFO:teuthology.orchestra.run.smithi049.stdout:generic/679 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T12:05:44.720 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/679 2024-01-31T12:05:44.720 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/679 2024-01-31T12:05:44.721 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:05:44.752 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:05:44.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:05:44.828 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2024-01-31T12:05:45.995 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:05:46.025 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:05:46.025 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:05:48.443 INFO:teuthology.orchestra.run.smithi049.stdout:generic/680 2s 2024-01-31T12:05:48.474 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/680 2024-01-31T12:05:48.474 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:05:48.486 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:05:48.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:05:48.521 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2024-01-31T12:05:50.069 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:05:50.086 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:05:50.086 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:05:50.924 INFO:teuthology.orchestra.run.smithi049.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-01-31T12:05:50.964 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/681 2024-01-31T12:05:50.964 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/681 2024-01-31T12:05:50.965 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:05:50.989 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:05:51.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:05:51.026 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2024-01-31T12:05:52.309 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:05:52.351 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:05:52.352 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:05:54.153 INFO:teuthology.orchestra.run.smithi049.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-01-31T12:05:54.188 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/682 2024-01-31T12:05:54.188 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/682 2024-01-31T12:05:54.188 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:05:54.218 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:05:54.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:05:54.277 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2024-01-31T12:05:55.508 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:05:55.550 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:05:55.550 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:05:56.871 INFO:teuthology.orchestra.run.smithi049.stdout:generic/683 [not run] /tmp/tmp.ULOG6qSi2atest: file alloc unit 4194304 larger than op length 65536 2024-01-31T12:05:56.881 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/683 2024-01-31T12:05:56.882 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/683 2024-01-31T12:05:56.882 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:05:56.894 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:05:56.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:05:56.967 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2024-01-31T12:05:58.172 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:05:58.204 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:05:58.205 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:04.138 INFO:teuthology.orchestra.run.smithi049.stdout:generic/684 [not run] /tmp/tmp.ULOG6qSi2atest: file alloc unit 4194304 larger than op length 65536 2024-01-31T12:06:04.178 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/684 2024-01-31T12:06:04.178 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/684 2024-01-31T12:06:04.178 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:06:04.202 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:04.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:06:04.266 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2024-01-31T12:06:05.315 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:06:05.357 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:06:05.357 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:11.083 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T12:06:11.095 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T12:06:11.131 INFO:teuthology.orchestra.run.smithi049.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-01-31T12:06:11.155 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/685 2024-01-31T12:06:11.155 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/685 2024-01-31T12:06:11.155 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:06:11.183 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:11.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:06:11.245 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2024-01-31T12:06:12.517 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:06:12.533 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:06:12.533 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:18.664 INFO:teuthology.orchestra.run.smithi049.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-01-31T12:06:18.702 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/686 2024-01-31T12:06:18.703 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/686 2024-01-31T12:06:18.703 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:06:18.730 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:18.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:06:18.773 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2024-01-31T12:06:19.909 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:06:19.930 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:06:19.930 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:25.657 INFO:teuthology.orchestra.run.smithi049.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-01-31T12:06:25.692 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/687 2024-01-31T12:06:25.692 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/687 2024-01-31T12:06:25.692 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:06:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:25.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:06:25.796 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2024-01-31T12:06:26.874 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:06:26.915 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:06:26.915 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:28.159 INFO:teuthology.orchestra.run.smithi049.stdout:generic/688 [not run] /tmp/tmp.ULOG6qSi2atest: file alloc unit 4194304 larger than op length 65536 2024-01-31T12:06:28.186 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/688 2024-01-31T12:06:28.189 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/688 2024-01-31T12:06:28.189 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:06:28.207 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:28.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:06:28.256 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2024-01-31T12:06:29.348 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:06:29.388 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:06:29.388 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:30.346 INFO:teuthology.orchestra.run.smithi049.stdout:generic/689 [not run] vfstest not support by ceph-fuse 2024-01-31T12:06:30.376 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/689 2024-01-31T12:06:30.376 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/689 2024-01-31T12:06:30.376 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:06:30.403 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:30.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:06:30.451 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2024-01-31T12:06:32.197 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:06:32.245 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:06:32.245 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:33.269 INFO:teuthology.orchestra.run.smithi049.stdout:generic/690 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T12:06:33.295 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/690 2024-01-31T12:06:33.295 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/690 2024-01-31T12:06:33.295 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:06:33.321 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:33.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:06:33.356 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2024-01-31T12:06:34.620 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:06:34.663 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:06:34.664 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:35.596 INFO:teuthology.orchestra.run.smithi049.stdout:generic/691 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T12:06:35.631 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/691 2024-01-31T12:06:35.631 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/691 2024-01-31T12:06:35.632 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:06:35.645 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:35.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:06:35.684 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2024-01-31T12:06:36.797 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:06:36.837 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:06:36.838 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:37.730 INFO:teuthology.orchestra.run.smithi049.stdout:generic/692 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T12:06:37.746 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/692 2024-01-31T12:06:37.746 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/692 2024-01-31T12:06:37.746 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:06:37.762 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:37.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:06:37.813 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2024-01-31T12:06:38.937 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:06:38.966 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:06:38.966 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:40.098 INFO:teuthology.orchestra.run.smithi049.stdout:generic/693 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T12:06:40.132 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/693 2024-01-31T12:06:40.132 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/693 2024-01-31T12:06:40.132 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:06:40.162 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:40.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:06:40.214 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2024-01-31T12:06:41.168 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T12:06:41.182 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T12:06:41.329 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:06:41.372 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:06:41.372 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:43.364 INFO:teuthology.orchestra.run.smithi049.stdout:generic/694 2s 2024-01-31T12:06:43.423 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/694 2024-01-31T12:06:43.423 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:06:43.435 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:43.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:06:43.486 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2024-01-31T12:06:44.555 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:06:44.593 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:06:44.593 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:45.600 INFO:teuthology.orchestra.run.smithi049.stdout:generic/695 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T12:06:45.630 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/695 2024-01-31T12:06:45.630 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/695 2024-01-31T12:06:45.630 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:06:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:45.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:06:45.730 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2024-01-31T12:06:46.921 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:06:46.946 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:06:46.946 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:47.834 INFO:teuthology.orchestra.run.smithi049.stdout:generic/696 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T12:06:47.859 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/696 2024-01-31T12:06:47.859 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/696 2024-01-31T12:06:47.859 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:06:47.867 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:47.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:06:47.928 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2024-01-31T12:06:49.208 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:06:49.241 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:06:49.241 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:50.309 INFO:teuthology.orchestra.run.smithi049.stdout:generic/697 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-01-31T12:06:50.335 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/697 2024-01-31T12:06:50.336 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/697 2024-01-31T12:06:50.336 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:06:50.353 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:50.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:06:50.421 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2024-01-31T12:06:51.633 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:06:51.677 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:06:51.677 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:52.558 INFO:teuthology.orchestra.run.smithi049.stdout:generic/698 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T12:06:52.593 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/698 2024-01-31T12:06:52.593 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/698 2024-01-31T12:06:52.593 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:06:52.602 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:52.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:06:52.650 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2024-01-31T12:06:53.721 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:06:53.741 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:06:53.741 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:54.823 INFO:teuthology.orchestra.run.smithi049.stdout:generic/699 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T12:06:54.855 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/699 2024-01-31T12:06:54.855 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/699 2024-01-31T12:06:54.856 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:06:54.868 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:54.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:06:54.945 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2024-01-31T12:06:56.029 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:06:56.045 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:06:56.045 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:56.844 INFO:teuthology.orchestra.run.smithi049.stdout:generic/700 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T12:06:56.876 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/700 2024-01-31T12:06:56.876 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/700 2024-01-31T12:06:56.877 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:06:56.902 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:56.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:06:56.958 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2024-01-31T12:06:58.043 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:06:58.077 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:06:58.077 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:59.705 INFO:teuthology.orchestra.run.smithi049.stdout:generic/701 1s 2024-01-31T12:06:59.747 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/701 2024-01-31T12:06:59.747 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:06:59.761 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:06:59.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:06:59.825 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2024-01-31T12:07:01.544 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:01.578 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:01.578 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:02.534 INFO:teuthology.orchestra.run.smithi049.stdout:generic/702 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T12:07:02.555 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/702 2024-01-31T12:07:02.555 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/702 2024-01-31T12:07:02.556 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:02.603 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:02.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:02.657 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2024-01-31T12:07:04.023 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:04.047 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:04.048 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:04.890 INFO:teuthology.orchestra.run.smithi049.stdout:generic/703 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T12:07:04.904 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/703 2024-01-31T12:07:04.904 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/703 2024-01-31T12:07:04.905 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:04.924 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:04.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:04.987 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2024-01-31T12:07:06.214 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:06.244 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:06.244 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:07.447 INFO:teuthology.orchestra.run.smithi049.stdout:generic/704 [not run] require ceph-fuse to be valid block disk 2024-01-31T12:07:07.478 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/704 2024-01-31T12:07:07.478 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/704 2024-01-31T12:07:07.478 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:07.506 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:07.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:07.641 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2024-01-31T12:07:08.735 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:08.778 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:08.778 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:09.647 INFO:teuthology.orchestra.run.smithi049.stdout:generic/705 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T12:07:09.676 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/705 2024-01-31T12:07:09.676 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/705 2024-01-31T12:07:09.677 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:09.694 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:09.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:09.757 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2024-01-31T12:07:10.860 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:10.895 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:10.895 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:11.315 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T12:07:11.319 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T12:07:11.354 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-01-31T12:07:11.351+0000 7f74bb400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34807) UID: 0 2024-01-31T12:07:11.354 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-01-31T12:07:11.351+0000 7fd725200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34807) UID: 0 2024-01-31T12:07:11.354 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-01-31T12:07:11.351+0000 7fc637e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34807) UID: 0 2024-01-31T12:07:11.355 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-01-31T12:07:11.351+0000 7fc34e600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 34807) UID: 0 2024-01-31T12:07:14.987 INFO:teuthology.orchestra.run.smithi049.stdout:generic/706 4s 2024-01-31T12:07:15.027 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/706 2024-01-31T12:07:15.028 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:15.043 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:15.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:15.200 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2024-01-31T12:07:16.957 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:16.994 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:16.994 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:17.883 INFO:teuthology.orchestra.run.smithi049.stdout:generic/707 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T12:07:17.921 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/707 2024-01-31T12:07:17.921 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/707 2024-01-31T12:07:17.921 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:17.938 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:17.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:17.991 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2024-01-31T12:07:19.075 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:19.091 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:19.091 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:21.298 INFO:teuthology.orchestra.run.smithi049.stdout:generic/708 2s 2024-01-31T12:07:21.342 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/708 2024-01-31T12:07:21.342 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:21.357 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:21.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:21.404 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2024-01-31T12:07:23.107 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:23.149 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:23.149 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:24.231 INFO:teuthology.orchestra.run.smithi049.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-01-31T12:07:24.261 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/709 2024-01-31T12:07:24.261 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/709 2024-01-31T12:07:24.261 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:24.281 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:24.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:24.413 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2024-01-31T12:07:26.001 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:26.024 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:26.024 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:27.090 INFO:teuthology.orchestra.run.smithi049.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-01-31T12:07:27.115 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/710 2024-01-31T12:07:27.116 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/710 2024-01-31T12:07:27.116 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:27.140 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:27.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:27.188 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2024-01-31T12:07:28.777 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:28.801 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:28.801 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:29.877 INFO:teuthology.orchestra.run.smithi049.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-01-31T12:07:29.911 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/711 2024-01-31T12:07:29.912 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/711 2024-01-31T12:07:29.912 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:29.926 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:29.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:29.965 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2024-01-31T12:07:31.614 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:31.636 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:32.720 INFO:teuthology.orchestra.run.smithi049.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-01-31T12:07:32.746 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/712 2024-01-31T12:07:32.747 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/712 2024-01-31T12:07:32.747 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:32.763 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:32.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:32.860 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2024-01-31T12:07:34.444 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:34.486 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:34.486 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:35.661 INFO:teuthology.orchestra.run.smithi049.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2024-01-31T12:07:35.688 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/713 2024-01-31T12:07:35.688 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/713 2024-01-31T12:07:35.688 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:35.702 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:35.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:35.756 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2024-01-31T12:07:37.318 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:37.347 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:37.347 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:38.468 INFO:teuthology.orchestra.run.smithi049.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-01-31T12:07:38.494 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/714 2024-01-31T12:07:38.494 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/714 2024-01-31T12:07:38.494 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:38.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:38.590 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2024-01-31T12:07:40.327 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:40.371 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:40.371 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:41.511 INFO:teuthology.orchestra.run.smithi049.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2024-01-31T12:07:41.539 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/715 2024-01-31T12:07:41.539 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/715 2024-01-31T12:07:41.539 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:41.555 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:41.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:41.604 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2024-01-31T12:07:43.208 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:43.254 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:43.254 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:44.414 INFO:teuthology.orchestra.run.smithi049.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-01-31T12:07:44.440 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/716 2024-01-31T12:07:44.440 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/716 2024-01-31T12:07:44.440 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:44.469 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:44.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:44.563 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2024-01-31T12:07:46.373 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:46.408 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:46.408 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:47.509 INFO:teuthology.orchestra.run.smithi049.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-01-31T12:07:47.527 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/717 2024-01-31T12:07:47.528 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/717 2024-01-31T12:07:47.529 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:47.548 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:47.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:47.602 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2024-01-31T12:07:49.082 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:49.116 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:49.116 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:50.343 INFO:teuthology.orchestra.run.smithi049.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-01-31T12:07:50.368 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/718 2024-01-31T12:07:50.369 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/718 2024-01-31T12:07:50.369 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:50.378 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:50.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:50.416 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2024-01-31T12:07:52.151 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:52.186 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:52.187 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:53.160 INFO:teuthology.orchestra.run.smithi049.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-01-31T12:07:53.187 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/719 2024-01-31T12:07:53.187 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/719 2024-01-31T12:07:53.188 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:53.201 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:53.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:53.386 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2024-01-31T12:07:55.005 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:55.043 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:55.043 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:56.099 INFO:teuthology.orchestra.run.smithi049.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-01-31T12:07:56.129 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/720 2024-01-31T12:07:56.129 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/720 2024-01-31T12:07:56.129 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:56.148 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:56.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:56.199 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2024-01-31T12:07:57.775 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:07:57.816 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:07:57.816 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:58.881 INFO:teuthology.orchestra.run.smithi049.stdout:generic/721 [not run] xfs_io startupdate support is missing 2024-01-31T12:07:58.909 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/721 2024-01-31T12:07:58.909 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/721 2024-01-31T12:07:58.909 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:07:58.929 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:07:58.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:07:58.975 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2024-01-31T12:08:00.080 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:08:00.116 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:08:00.116 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:01.259 INFO:teuthology.orchestra.run.smithi049.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-01-31T12:08:01.283 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/722 2024-01-31T12:08:01.283 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/722 2024-01-31T12:08:01.284 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:08:01.312 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:01.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:08:01.490 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2024-01-31T12:08:02.876 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:08:02.908 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:08:02.908 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:03.965 INFO:teuthology.orchestra.run.smithi049.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-01-31T12:08:03.984 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/723 2024-01-31T12:08:03.984 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/723 2024-01-31T12:08:03.984 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:08:04.015 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:04.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:08:04.053 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2024-01-31T12:08:05.759 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:08:05.780 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:08:05.780 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:06.868 INFO:teuthology.orchestra.run.smithi049.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-01-31T12:08:06.887 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/724 2024-01-31T12:08:06.887 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/724 2024-01-31T12:08:06.887 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:08:06.896 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:07.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:08:07.012 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2024-01-31T12:08:08.651 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:08:08.678 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:08:08.678 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:09.801 INFO:teuthology.orchestra.run.smithi049.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-01-31T12:08:09.818 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/725 2024-01-31T12:08:09.818 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/725 2024-01-31T12:08:09.818 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:08:09.836 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:10.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:08:10.023 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2024-01-31T12:08:11.515 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:08:11.547 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:08:11.548 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:13.206 INFO:teuthology.orchestra.run.smithi049.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-01-31T12:08:13.222 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/726 2024-01-31T12:08:13.222 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/726 2024-01-31T12:08:13.222 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:08:13.231 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:13.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:08:13.419 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2024-01-31T12:08:14.900 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:08:14.934 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:08:14.934 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:16.242 INFO:teuthology.orchestra.run.smithi049.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-01-31T12:08:16.274 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/727 2024-01-31T12:08:16.274 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/727 2024-01-31T12:08:16.274 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:08:16.297 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:16.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:08:16.337 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2024-01-31T12:08:17.992 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:08:18.042 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:08:18.042 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:23.404 INFO:teuthology.orchestra.run.smithi049.stdout:generic/728 5s 2024-01-31T12:08:23.456 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/728 2024-01-31T12:08:23.457 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:08:23.476 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:23.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:08:23.553 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2024-01-31T12:08:24.801 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:08:24.847 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:08:24.847 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:26.608 INFO:teuthology.orchestra.run.smithi049.stdout:generic/729 2s 2024-01-31T12:08:26.651 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/729 2024-01-31T12:08:26.651 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:08:26.676 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:26.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:08:26.793 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2024-01-31T12:08:28.476 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:08:28.502 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:08:28.502 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:29.447 INFO:teuthology.orchestra.run.smithi049.stdout:generic/730 [not run] require ceph-fuse to be valid block disk 2024-01-31T12:08:29.468 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/730 2024-01-31T12:08:29.469 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/730 2024-01-31T12:08:29.469 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:08:29.486 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:29.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:08:29.526 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2024-01-31T12:08:30.736 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:08:30.779 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:08:30.779 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:31.660 INFO:teuthology.orchestra.run.smithi049.stdout:generic/731 [not run] require ceph-fuse to be valid block disk 2024-01-31T12:08:31.679 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/731 2024-01-31T12:08:31.679 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/731 2024-01-31T12:08:31.679 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:08:31.703 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:31.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:08:31.759 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/732) 2024-01-31T12:08:32.911 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:08:32.953 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:08:32.954 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:33.834 INFO:teuthology.orchestra.run.smithi049.stdout:generic/732 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T12:08:33.848 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/732 2024-01-31T12:08:33.848 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/732 2024-01-31T12:08:33.848 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:08:33.856 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:33.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:08:33.890 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/733) 2024-01-31T12:08:35.520 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:08:35.557 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:08:35.557 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:36.477 INFO:teuthology.orchestra.run.smithi049.stdout:generic/733 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T12:08:36.511 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/733 2024-01-31T12:08:36.511 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/733 2024-01-31T12:08:36.511 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:08:36.537 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:36.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:08:36.630 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/734) 2024-01-31T12:08:37.718 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:08:37.742 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:08:37.742 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:38.866 INFO:teuthology.orchestra.run.smithi049.stdout:generic/734 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-01-31T12:08:38.880 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/734 2024-01-31T12:08:38.881 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/734 2024-01-31T12:08:38.881 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:08:38.891 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:39.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:08:39.230 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/735) 2024-01-31T12:08:40.607 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:08:40.629 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:08:40.629 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:46.106 INFO:teuthology.orchestra.run.smithi049.stdout:generic/735 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-01-31T12:08:46.127 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/735 2024-01-31T12:08:46.127 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/735 2024-01-31T12:08:46.130 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:08:46.142 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:46.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:08:46.282 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/736) 2024-01-31T12:08:47.842 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:08:47.869 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:08:47.869 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:49.135 INFO:teuthology.orchestra.run.smithi049.stdout:generic/736 - output mismatch (see /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/736.out.bad) 2024-01-31T12:08:49.150 INFO:teuthology.orchestra.run.smithi049.stdout: --- tests/generic/736.out 2024-01-31 05:06:00.951950982 +0000 2024-01-31T12:08:49.150 INFO:teuthology.orchestra.run.smithi049.stdout: +++ /tmp/tmp.MqKNGSMQ15xfstests-dev/results//generic/736.out.bad 2024-01-31 12:08:49.127122430 +0000 2024-01-31T12:08:49.150 INFO:teuthology.orchestra.run.smithi049.stdout: @@ -1,2 +1,4 @@ 2024-01-31T12:08:49.150 INFO:teuthology.orchestra.run.smithi049.stdout: QA output created by 736 2024-01-31T12:08:49.150 INFO:teuthology.orchestra.run.smithi049.stdout: +*** buffer overflow detected ***: terminated 2024-01-31T12:08:49.150 INFO:teuthology.orchestra.run.smithi049.stdout: +/tmp/tmp.MqKNGSMQ15xfstests-dev/tests/generic/736: line 32: 495089 Aborted $here/src/readdir-while-renames $target_dir 2024-01-31T12:08:49.150 INFO:teuthology.orchestra.run.smithi049.stdout: Silence is golden 2024-01-31T12:08:49.159 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/736 2024-01-31T12:08:49.159 INFO:teuthology.orchestra.run.smithi049.stdout:Failures: generic/736 2024-01-31T12:08:49.159 INFO:teuthology.orchestra.run.smithi049.stdout:Failed 1 of 1 tests 2024-01-31T12:08:49.167 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:49.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T12:08:49.228 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-01-31T12:08:49.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-01-31T12:08:49.228 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/737) 2024-01-31T12:08:50.434 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:08:50.474 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:08:50.474 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:51.357 INFO:teuthology.orchestra.run.smithi049.stdout:generic/737 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T12:08:51.424 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/737 2024-01-31T12:08:51.424 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/737 2024-01-31T12:08:51.425 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:08:51.442 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:51.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:08:51.490 DEBUG:teuthology.orchestra.run.smithi049:> (cd /tmp/tmp.MqKNGSMQ15xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/738) 2024-01-31T12:08:52.571 INFO:teuthology.orchestra.run.smithi049.stdout:FSTYP -- ceph-fuse 2024-01-31T12:08:52.626 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM -- Linux/x86_64 smithi049 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-01-31T12:08:52.626 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:53.560 INFO:teuthology.orchestra.run.smithi049.stdout:generic/738 [not run] this test requires a valid $SCRATCH_DEV 2024-01-31T12:08:53.572 INFO:teuthology.orchestra.run.smithi049.stdout:Ran: generic/738 2024-01-31T12:08:53.574 INFO:teuthology.orchestra.run.smithi049.stdout:Not run: generic/738 2024-01-31T12:08:53.574 INFO:teuthology.orchestra.run.smithi049.stdout:Passed all 1 tests 2024-01-31T12:08:53.599 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:08:53.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-01-31T12:08:53.667 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 17========================================================= 2024-01-31T12:08:53.667 DEBUG:teuthology.orchestra.run.smithi049:> sudo userdel --force --remove fsgqa 2024-01-31T12:08:53.868 INFO:teuthology.orchestra.run.smithi049.stderr:userdel: fsgqa mail spool (/var/mail/fsgqa) not found 2024-01-31T12:08:54.238 DEBUG:teuthology.orchestra.run.smithi049:> sudo userdel --force --remove 123456-fsgqa 2024-01-31T12:08:54.303 INFO:teuthology.orchestra.run.smithi049.stderr:userdel: 123456-fsgqa mail spool (/var/mail/123456-fsgqa) not found 2024-01-31T12:08:54.303 INFO:teuthology.orchestra.run.smithi049.stderr:userdel: 123456-fsgqa home directory (/home/123456-fsgqa) not found 2024-01-31T12:08:54.640 DEBUG:teuthology.orchestra.run.smithi049:> sudo groupdel fsgqa 2024-01-31T12:08:54.758 INFO:teuthology.orchestra.run.smithi049.stderr:groupdel: group 'fsgqa' does not exist 2024-01-31T12:08:54.766 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-01-31T12:08:54.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T12:08:54.767 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.MqKNGSMQ15xfstests-dev/results) 2024-01-31T12:08:54.795 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 1: cd: /home/ubuntu/cephtest/mnt.0: Permission denied 2024-01-31T12:08:54.796 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T12:08:54.796 INFO:tasks.cephfs.xfstests_dev:xfstests-dev repo contains not directory named "results". repo location: /tmp/tmp.MqKNGSMQ15xfstests-dev 2024-01-31T12:08:54.797 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf /tmp/tmp.MqKNGSMQ15xfstests-dev 2024-01-31T12:08:55.767 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-31T12:08:55.767 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-31T12:08:55.962 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-31T12:08:56.163 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-31T12:08:56.163 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T12:08:56.163 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T12:08:56.227 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354584k,nr_inodes=4088646,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275364k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=571 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275360k,nr_inodes=818840,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275364k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-01-31T12:08:56.227 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-31T12:08:56.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T12:08:56.227 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-31T12:08:56.292 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T12:08:56.292 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T12:08:56.321 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354604k,nr_inodes=4088651,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2945 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275364k,nr_inodes=818841,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-31T12:08:56.321 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-01-31T12:08:56.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T12:08:56.321 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-31T12:08:56.383 INFO:teuthology.orchestra.run.smithi195.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-01-31T12:08:56.394 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T12:08:56.394 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T12:08:56.394 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T12:08:56.408 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354584k,nr_inodes=4088646,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275364k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=571 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275360k,nr_inodes=818840,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275364k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-01-31T12:08:56.408 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-01-31T12:08:56.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T12:08:56.408 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-01-31T12:08:56.484 INFO:teuthology.orchestra.run.smithi049.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-01-31T12:08:56.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T12:08:56.487 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T12:08:56.487 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T12:08:56.499 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354604k,nr_inodes=4088651,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2945 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275364k,nr_inodes=818841,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-31T12:08:56.500 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-01-31T12:08:56.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T12:08:56.500 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-01-31T12:08:56.556 INFO:teuthology.orchestra.run.smithi195.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-01-31T12:08:56.557 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T12:08:56.557 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T12:08:58.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.698+0000 7fad97a00640 1 Processor -- start 2024-01-31T12:08:58.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.698+0000 7fad97a00640 1 -- start start 2024-01-31T12:08:58.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.706+0000 7fad97a00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fad9015e8f0 0x7fad900b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:08:58.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.706+0000 7fad97a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad900cdbb0 0x7fad900ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:08:58.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.706+0000 7fad97a00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9015ed80 con 0x7fad90143ac0 2024-01-31T12:08:58.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.706+0000 7fad97a00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad900ce540 con 0x7fad9015e8f0 2024-01-31T12:08:58.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.706+0000 7fad97a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad90071590 con 0x7fad900cdbb0 2024-01-31T12:08:58.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.706+0000 7fad95000640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fad90143ac0 0x7fad900cfc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37930/0 (socket says 172.21.15.49:37930) 2024-01-31T12:08:58.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.706+0000 7fad95000640 1 -- 172.21.15.49:0/3862546421 learned_addr learned my addr 172.21.15.49:0/3862546421 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:08:58.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.706+0000 7fad95a00640 1 --2- 172.21.15.49:0/3862546421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad900cdbb0 0x7fad900ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:08:58.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.706+0000 7fad8fe00640 1 --2- 172.21.15.49:0/3862546421 >> v2:172.21.15.49:3300/0 conn(0x7fad9015e8f0 0x7fad900b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:08:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.710+0000 7fad95a00640 1 -- 172.21.15.49:0/3862546421 >> v2:172.21.15.49:3300/0 conn(0x7fad9015e8f0 msgr2=0x7fad900b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:08:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.710+0000 7fad95a00640 1 --2- 172.21.15.49:0/3862546421 >> v2:172.21.15.49:3300/0 conn(0x7fad9015e8f0 0x7fad900b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:08:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.710+0000 7fad95a00640 1 -- 172.21.15.49:0/3862546421 >> v1:172.21.15.49:6789/0 conn(0x7fad90143ac0 legacy=0x7fad900cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:08:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.710+0000 7fad95a00640 1 -- 172.21.15.49:0/3862546421 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad900d0500 con 0x7fad900cdbb0 2024-01-31T12:08:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.710+0000 7fad8fe00640 1 --2- 172.21.15.49:0/3862546421 >> v2:172.21.15.49:3300/0 conn(0x7fad9015e8f0 0x7fad900b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T12:08:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.714+0000 7fad95a00640 1 --2- 172.21.15.49:0/3862546421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad900cdbb0 0x7fad900ce000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fad88009d90 tx=0x7fad8801c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23ff11d9edde1d97 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:08:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.718+0000 7fad8f400640 1 -- 172.21.15.49:0/3862546421 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad880a5950 con 0x7fad900cdbb0 2024-01-31T12:08:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.718+0000 7fad8f400640 1 -- 172.21.15.49:0/3862546421 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad880a5ab0 con 0x7fad900cdbb0 2024-01-31T12:08:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.718+0000 7fad8f400640 1 -- 172.21.15.49:0/3862546421 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad880a5e40 con 0x7fad900cdbb0 2024-01-31T12:08:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.722+0000 7fad97a00640 1 -- 172.21.15.49:0/3862546421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad900cdbb0 msgr2=0x7fad900ce000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:08:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.722+0000 7fad97a00640 1 --2- 172.21.15.49:0/3862546421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad900cdbb0 0x7fad900ce000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fad88009d90 tx=0x7fad8801c890 comp rx=0 tx=0).stop 2024-01-31T12:08:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.722+0000 7fad97a00640 1 -- 172.21.15.49:0/3862546421 shutdown_connections 2024-01-31T12:08:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.722+0000 7fad97a00640 1 --2- 172.21.15.49:0/3862546421 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad900cdbb0 0x7fad900ce000 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:08:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.722+0000 7fad97a00640 1 --2- 172.21.15.49:0/3862546421 >> v2:172.21.15.49:3300/0 conn(0x7fad9015e8f0 0x7fad900b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:08:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.722+0000 7fad97a00640 1 -- 172.21.15.49:0/3862546421 >> 172.21.15.49:0/3862546421 conn(0x7fad9006b880 msgr2=0x7fad9006bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:08:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.726+0000 7fad97a00640 1 -- 172.21.15.49:0/3862546421 shutdown_connections 2024-01-31T12:08:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.726+0000 7fad97a00640 1 -- 172.21.15.49:0/3862546421 wait complete. 2024-01-31T12:08:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.734+0000 7fad97a00640 1 Processor -- start 2024-01-31T12:08:58.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.734+0000 7fad97a00640 1 -- start start 2024-01-31T12:08:58.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.738+0000 7fad97a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad900cdbb0 0x7fad9015d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:08:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.738+0000 7fad97a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad90143ac0 0x7fad90162ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:08:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.738+0000 7fad97a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad9015e8f0 0x7fad901539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:08:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.738+0000 7fad97a00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9015ef10 con 0x7fad90143ac0 2024-01-31T12:08:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.738+0000 7fad97a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9015f6e0 con 0x7fad900cdbb0 2024-01-31T12:08:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.738+0000 7fad97a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9015f120 con 0x7fad9015e8f0 2024-01-31T12:08:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.738+0000 7fad95a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad9015e8f0 0x7fad901539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:08:58.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.738+0000 7fad95a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad9015e8f0 0x7fad901539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:45808/0 (socket says 172.21.15.49:45808) 2024-01-31T12:08:58.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.738+0000 7fad95a00640 1 -- 172.21.15.49:0/1810956428 learned_addr learned my addr 172.21.15.49:0/1810956428 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:08:58.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.738+0000 7fad8fe00640 1 --2- 172.21.15.49:0/1810956428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad90143ac0 0x7fad90162ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:08:58.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.738+0000 7fad95000640 1 --2- 172.21.15.49:0/1810956428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad900cdbb0 0x7fad9015d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:08:58.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.742+0000 7fad95a00640 1 -- 172.21.15.49:0/1810956428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad900cdbb0 msgr2=0x7fad9015d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:08:58.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.742+0000 7fad95a00640 1 --2- 172.21.15.49:0/1810956428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad900cdbb0 0x7fad9015d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:08:58.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.742+0000 7fad95a00640 1 -- 172.21.15.49:0/1810956428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad90143ac0 msgr2=0x7fad90162ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:08:58.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.742+0000 7fad95a00640 1 --2- 172.21.15.49:0/1810956428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad90143ac0 0x7fad90162ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:08:58.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.742+0000 7fad95a00640 1 -- 172.21.15.49:0/1810956428 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad88009a70 con 0x7fad9015e8f0 2024-01-31T12:08:58.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.742+0000 7fad95a00640 1 --2- 172.21.15.49:0/1810956428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad9015e8f0 0x7fad901539b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fad8801af40 tx=0x7fad88019630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:08:58.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.742+0000 7fad8cc00640 1 -- 172.21.15.49:0/1810956428 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad880aed90 con 0x7fad9015e8f0 2024-01-31T12:08:58.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.742+0000 7fad8cc00640 1 -- 172.21.15.49:0/1810956428 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad880b7410 con 0x7fad9015e8f0 2024-01-31T12:08:58.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.742+0000 7fad8cc00640 1 -- 172.21.15.49:0/1810956428 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad880b77a0 con 0x7fad9015e8f0 2024-01-31T12:08:58.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.742+0000 7fad97a00640 1 -- 172.21.15.49:0/1810956428 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9015f400 con 0x7fad9015e8f0 2024-01-31T12:08:58.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.746+0000 7fad97a00640 1 -- 172.21.15.49:0/1810956428 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9015cbf0 con 0x7fad9015e8f0 2024-01-31T12:08:58.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.754+0000 7fad8cc00640 1 -- 172.21.15.49:0/1810956428 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fad880b4050 con 0x7fad9015e8f0 2024-01-31T12:08:58.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.758+0000 7fad8cc00640 1 --2- 172.21.15.49:0/1810956428 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fad68066500 0x7fad680689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:08:58.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.758+0000 7fad8cc00640 1 -- 172.21.15.49:0/1810956428 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fad88123170 con 0x7fad9015e8f0 2024-01-31T12:08:58.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.770+0000 7fad95000640 1 --2- 172.21.15.49:0/1810956428 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fad68066500 0x7fad680689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:08:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.766+0000 7fad97a00640 1 -- 172.21.15.49:0/1810956428 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9015c770 con 0x7fad9015e8f0 2024-01-31T12:08:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:58.778+0000 7fad95000640 1 --2- 172.21.15.49:0/1810956428 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fad68066500 0x7fad680689c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fad80000f70 tx=0x7fad80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:08:59.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:08:59.058+0000 7fad8cc00640 1 -- 172.21.15.49:0/1810956428 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fad9015c770 con 0x7fad9015e8f0 2024-01-31T12:09:00.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.098+0000 7fad97a00640 1 -- 172.21.15.49:0/1810956428 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad9015c770 con 0x7fad9015e8f0 2024-01-31T12:09:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.138+0000 7fad8cc00640 1 -- 172.21.15.49:0/1810956428 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fad9015c770 con 0x7fad9015e8f0 2024-01-31T12:09:00.141 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:09:00.141 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5078,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3747440713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3747440713},{"type":"v1","addr":"172.21.15.195:6837","nonce":3747440713}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2835620509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2835620509},{"type":"v1","addr":"172.21.15.195:6836","nonce":2835620509}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2080191803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2080191803},{"type":"v1","addr":"172.21.15.49:6833","nonce":2080191803}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-31T05:05:51.919747+0000","modified":"2024-01-31T05:05:54.941384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5493":{"gid":5493,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6835/4235056900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4235056900},{"type":"v1","addr":"172.21.15.49:6835","nonce":4235056900}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-31T12:09:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 19 2024-01-31T12:09:00.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.142+0000 7fad97a00640 1 -- 172.21.15.49:0/1810956428 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fad68066500 msgr2=0x7fad680689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:00.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.142+0000 7fad97a00640 1 --2- 172.21.15.49:0/1810956428 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fad68066500 0x7fad680689c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fad80000f70 tx=0x7fad80009040 comp rx=0 tx=0).stop 2024-01-31T12:09:00.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.142+0000 7fad97a00640 1 -- 172.21.15.49:0/1810956428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad9015e8f0 msgr2=0x7fad901539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:00.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.142+0000 7fad97a00640 1 --2- 172.21.15.49:0/1810956428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad9015e8f0 0x7fad901539b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fad8801af40 tx=0x7fad88019630 comp rx=0 tx=0).stop 2024-01-31T12:09:00.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.142+0000 7fad97a00640 1 -- 172.21.15.49:0/1810956428 shutdown_connections 2024-01-31T12:09:00.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.142+0000 7fad97a00640 1 --2- 172.21.15.49:0/1810956428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad9015e8f0 0x7fad901539b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:00.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.142+0000 7fad97a00640 1 --2- 172.21.15.49:0/1810956428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad90143ac0 0x7fad90162ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:00.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.142+0000 7fad97a00640 1 --2- 172.21.15.49:0/1810956428 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fad68066500 0x7fad680689c0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:00.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.142+0000 7fad97a00640 1 --2- 172.21.15.49:0/1810956428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad900cdbb0 0x7fad9015d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:00.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.142+0000 7fad97a00640 1 -- 172.21.15.49:0/1810956428 >> 172.21.15.49:0/1810956428 conn(0x7fad9006b880 msgr2=0x7fad9013fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:00.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.142+0000 7fad97a00640 1 -- 172.21.15.49:0/1810956428 shutdown_connections 2024-01-31T12:09:00.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.142+0000 7fad97a00640 1 -- 172.21.15.49:0/1810956428 wait complete. 2024-01-31T12:09:00.228 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T12:09:00.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.522+0000 7ff9d3400640 1 Processor -- start 2024-01-31T12:09:00.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.522+0000 7ff9d3400640 1 -- start start 2024-01-31T12:09:00.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.530+0000 7ff9d3400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff9cc0ce930 0x7ff9cc070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:00.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.530+0000 7ff9d3400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff9cc070aa0 0x7ff9cc165380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:00.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.530+0000 7ff9d3400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9cc06c740 con 0x7ff9cc0ce550 2024-01-31T12:09:00.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.530+0000 7ff9d3400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9cc070ed0 con 0x7ff9cc0ce930 2024-01-31T12:09:00.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.530+0000 7ff9d3400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9cc1660f0 con 0x7ff9cc070aa0 2024-01-31T12:09:00.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.530+0000 7ff9d1400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff9cc070aa0 0x7ff9cc165380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:00.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.530+0000 7ff9d1400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff9cc070aa0 0x7ff9cc165380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41360/0 (socket says 172.21.15.49:41360) 2024-01-31T12:09:00.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.530+0000 7ff9d1400640 1 -- 172.21.15.49:0/2381259939 learned_addr learned my addr 172.21.15.49:0/2381259939 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:00.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.530+0000 7ff9d1400640 1 -- 172.21.15.49:0/2381259939 >> v2:172.21.15.49:3300/0 conn(0x7ff9cc0ce930 msgr2=0x7ff9cc070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:00.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.530+0000 7ff9d1400640 1 --2- 172.21.15.49:0/2381259939 >> v2:172.21.15.49:3300/0 conn(0x7ff9cc0ce930 0x7ff9cc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:00.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.534+0000 7ff9d1400640 1 -- 172.21.15.49:0/2381259939 >> v1:172.21.15.49:6789/0 conn(0x7ff9cc0ce550 legacy=0x7ff9cc144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:00.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.534+0000 7ff9d1400640 1 -- 172.21.15.49:0/2381259939 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc06c990 con 0x7ff9cc070aa0 2024-01-31T12:09:00.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.542+0000 7ff9d1400640 1 --2- 172.21.15.49:0/2381259939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9cc070aa0 0x7ff9cc165380 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc144c80 tx=0x7ff9c401c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2dd981ff8e90d80 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:00.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.542+0000 7ff9cb400640 1 -- 172.21.15.49:0/2381259939 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40a5790 con 0x7ff9cc070aa0 2024-01-31T12:09:00.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.542+0000 7ff9cb400640 1 -- 172.21.15.49:0/2381259939 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c40a58f0 con 0x7ff9cc070aa0 2024-01-31T12:09:00.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.542+0000 7ff9cb400640 1 -- 172.21.15.49:0/2381259939 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40a5c80 con 0x7ff9cc070aa0 2024-01-31T12:09:00.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.550+0000 7ff9d3400640 1 -- 172.21.15.49:0/2381259939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9cc070aa0 msgr2=0x7ff9cc165380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:00.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.550+0000 7ff9d3400640 1 --2- 172.21.15.49:0/2381259939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9cc070aa0 0x7ff9cc165380 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc144c80 tx=0x7ff9c401c8d0 comp rx=0 tx=0).stop 2024-01-31T12:09:00.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.550+0000 7ff9d3400640 1 -- 172.21.15.49:0/2381259939 shutdown_connections 2024-01-31T12:09:00.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.550+0000 7ff9d3400640 1 --2- 172.21.15.49:0/2381259939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9cc070aa0 0x7ff9cc165380 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:00.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.550+0000 7ff9d3400640 1 --2- 172.21.15.49:0/2381259939 >> v2:172.21.15.49:3300/0 conn(0x7ff9cc0ce930 0x7ff9cc070560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:00.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.550+0000 7ff9d3400640 1 -- 172.21.15.49:0/2381259939 >> 172.21.15.49:0/2381259939 conn(0x7ff9cc06ad70 msgr2=0x7ff9cc0b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:00.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.558+0000 7ff9d3400640 1 -- 172.21.15.49:0/2381259939 shutdown_connections 2024-01-31T12:09:00.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.558+0000 7ff9d3400640 1 -- 172.21.15.49:0/2381259939 wait complete. 2024-01-31T12:09:00.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.566+0000 7ff9d3400640 1 Processor -- start 2024-01-31T12:09:00.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.566+0000 7ff9d3400640 1 -- start start 2024-01-31T12:09:00.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.570+0000 7ff9d3400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9cc070aa0 0x7ff9cc157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:00.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.574+0000 7ff9d3400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9cc0ce550 0x7ff9cc143870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:00.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.574+0000 7ff9d3400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9cc0ce930 0x7ff9cc143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:00.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.574+0000 7ff9d3400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc13a160 con 0x7ff9cc070aa0 2024-01-31T12:09:00.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.574+0000 7ff9d0a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9cc070aa0 0x7ff9cc157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:00.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.574+0000 7ff9d0a00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9cc070aa0 0x7ff9cc157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54652/0 (socket says 172.21.15.49:54652) 2024-01-31T12:09:00.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.574+0000 7ff9d0a00640 1 -- 172.21.15.49:0/1942588456 learned_addr learned my addr 172.21.15.49:0/1942588456 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:00.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.574+0000 7ff9d3400640 1 -- 172.21.15.49:0/1942588456 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc158120 con 0x7ff9cc0ce550 2024-01-31T12:09:00.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.574+0000 7ff9d3400640 1 -- 172.21.15.49:0/1942588456 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc15aac0 con 0x7ff9cc0ce930 2024-01-31T12:09:00.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.574+0000 7ff9d1400640 1 --2- 172.21.15.49:0/1942588456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9cc0ce930 0x7ff9cc143db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:00.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.574+0000 7ff9cbe00640 1 --2- 172.21.15.49:0/1942588456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9cc0ce550 0x7ff9cc143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:00.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.582+0000 7ff9d1400640 1 -- 172.21.15.49:0/1942588456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9cc0ce550 msgr2=0x7ff9cc143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:00.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.582+0000 7ff9d1400640 1 --2- 172.21.15.49:0/1942588456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9cc0ce550 0x7ff9cc143870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:00.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.582+0000 7ff9d1400640 1 -- 172.21.15.49:0/1942588456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9cc070aa0 msgr2=0x7ff9cc157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:00.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.582+0000 7ff9d1400640 1 --2- 172.21.15.49:0/1942588456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9cc070aa0 0x7ff9cc157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:00.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.582+0000 7ff9d1400640 1 -- 172.21.15.49:0/1942588456 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c4009b30 con 0x7ff9cc0ce930 2024-01-31T12:09:00.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.582+0000 7ff9d1400640 1 --2- 172.21.15.49:0/1942588456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9cc0ce930 0x7ff9cc143db0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40ab000 tx=0x7ff9c4019670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:00.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.582+0000 7ff9c8c00640 1 -- 172.21.15.49:0/1942588456 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40b8670 con 0x7ff9cc0ce930 2024-01-31T12:09:00.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.582+0000 7ff9c8c00640 1 -- 172.21.15.49:0/1942588456 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c40b87d0 con 0x7ff9cc0ce930 2024-01-31T12:09:00.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.582+0000 7ff9c8c00640 1 -- 172.21.15.49:0/1942588456 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40b8b80 con 0x7ff9cc0ce930 2024-01-31T12:09:00.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.582+0000 7ff9d3400640 1 -- 172.21.15.49:0/1942588456 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9cc139aa0 con 0x7ff9cc0ce930 2024-01-31T12:09:00.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.586+0000 7ff9d3400640 1 -- 172.21.15.49:0/1942588456 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9cc157b70 con 0x7ff9cc0ce930 2024-01-31T12:09:00.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.594+0000 7ff9c8c00640 1 -- 172.21.15.49:0/1942588456 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff9c40b8ce0 con 0x7ff9cc0ce930 2024-01-31T12:09:00.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.594+0000 7ff9d3400640 1 -- 172.21.15.49:0/1942588456 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9cc13a2a0 con 0x7ff9cc0ce930 2024-01-31T12:09:00.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.598+0000 7ff9c8c00640 1 --2- 172.21.15.49:0/1942588456 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff9a40665d0 0x7ff9a4068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:00.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.598+0000 7ff9c8c00640 1 -- 172.21.15.49:0/1942588456 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff9c411f740 con 0x7ff9cc0ce930 2024-01-31T12:09:00.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.598+0000 7ff9d0a00640 1 --2- 172.21.15.49:0/1942588456 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff9a40665d0 0x7ff9a4068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:00.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.602+0000 7ff9d0a00640 1 --2- 172.21.15.49:0/1942588456 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff9a40665d0 0x7ff9a4068a90 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc1466f0 tx=0x7ff9bc0090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:00.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.614+0000 7ff9c8c00640 1 -- 172.21.15.49:0/1942588456 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff9cc13a2a0 con 0x7ff9cc0ce930 2024-01-31T12:09:00.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.878+0000 7ff9d3400640 1 -- 172.21.15.49:0/1942588456 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9cc13a2a0 con 0x7ff9cc0ce930 2024-01-31T12:09:00.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.910+0000 7ff9c8c00640 1 -- 172.21.15.49:0/1942588456 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16800 (secure 0 0 0) 0x7ff9cc13a2a0 con 0x7ff9cc0ce930 2024-01-31T12:09:00.982 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:09:00.982 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":41,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:05:59.292973+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:05:49.820131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-31T05:05:50.922571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1c","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T12:09:00.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.914+0000 7ff9d3400640 1 -- 172.21.15.49:0/1942588456 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff9a40665d0 msgr2=0x7ff9a4068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:00.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.914+0000 7ff9d3400640 1 --2- 172.21.15.49:0/1942588456 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff9a40665d0 0x7ff9a4068a90 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc1466f0 tx=0x7ff9bc0090e0 comp rx=0 tx=0).stop 2024-01-31T12:09:00.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.914+0000 7ff9d3400640 1 -- 172.21.15.49:0/1942588456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9cc0ce930 msgr2=0x7ff9cc143db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:00.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.914+0000 7ff9d3400640 1 --2- 172.21.15.49:0/1942588456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9cc0ce930 0x7ff9cc143db0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40ab000 tx=0x7ff9c4019670 comp rx=0 tx=0).stop 2024-01-31T12:09:00.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.914+0000 7ff9d3400640 1 -- 172.21.15.49:0/1942588456 shutdown_connections 2024-01-31T12:09:00.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.914+0000 7ff9d3400640 1 --2- 172.21.15.49:0/1942588456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9cc0ce930 0x7ff9cc143db0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:00.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.914+0000 7ff9d3400640 1 --2- 172.21.15.49:0/1942588456 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff9a40665d0 0x7ff9a4068a90 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:00.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.914+0000 7ff9d3400640 1 --2- 172.21.15.49:0/1942588456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9cc0ce550 0x7ff9cc143870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:00.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.914+0000 7ff9d3400640 1 --2- 172.21.15.49:0/1942588456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9cc070aa0 0x7ff9cc157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:00.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.914+0000 7ff9d3400640 1 -- 172.21.15.49:0/1942588456 >> 172.21.15.49:0/1942588456 conn(0x7ff9cc06ad70 msgr2=0x7ff9cc0b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:00.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.914+0000 7ff9d3400640 1 -- 172.21.15.49:0/1942588456 shutdown_connections 2024-01-31T12:09:00.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:00.914+0000 7ff9d3400640 1 -- 172.21.15.49:0/1942588456 wait complete. 2024-01-31T12:09:00.985 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:04.484066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:05:49.820131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:05:50.922571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-31T12:09:00.985 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T12:09:01.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.222+0000 7ff337e00640 1 Processor -- start 2024-01-31T12:09:01.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.222+0000 7ff337e00640 1 -- start start 2024-01-31T12:09:01.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.226+0000 7ff337e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff338160930 0x7ff3380cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:01.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.226+0000 7ff337e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3380d0e90 0x7ff3380cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:01.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.234+0000 7ff337e00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3380b2a10 con 0x7ff3380b2ea0 2024-01-31T12:09:01.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.234+0000 7ff337e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3380d38a0 con 0x7ff338160930 2024-01-31T12:09:01.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.234+0000 7ff337e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3380d04d0 con 0x7ff3380d0e90 2024-01-31T12:09:01.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.234+0000 7ff336000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3380d0e90 0x7ff3380cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:01.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.234+0000 7ff336000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3380d0e90 0x7ff3380cfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:45824/0 (socket says 172.21.15.49:45824) 2024-01-31T12:09:01.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.234+0000 7ff336000640 1 -- 172.21.15.49:0/569280929 learned_addr learned my addr 172.21.15.49:0/569280929 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:01.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.234+0000 7ff336a00640 1 --2- 172.21.15.49:0/569280929 >> v2:172.21.15.195:3300/0 conn(0x7ff338160930 0x7ff3380cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:01.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.234+0000 7ff336000640 1 -- 172.21.15.49:0/569280929 >> v2:172.21.15.195:3300/0 conn(0x7ff338160930 msgr2=0x7ff3380cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:01.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.234+0000 7ff336000640 1 --2- 172.21.15.49:0/569280929 >> v2:172.21.15.195:3300/0 conn(0x7ff338160930 0x7ff3380cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:01.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.234+0000 7ff336000640 1 -- 172.21.15.49:0/569280929 >> v1:172.21.15.49:6789/0 conn(0x7ff3380b2ea0 legacy=0x7ff3380b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:01.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.234+0000 7ff336000640 1 -- 172.21.15.49:0/569280929 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3380d3ab0 con 0x7ff3380d0e90 2024-01-31T12:09:01.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.246+0000 7ff336000640 1 --2- 172.21.15.49:0/569280929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3380d0e90 0x7ff3380cfc00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff320009870 tx=0x7ff32001c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca449e9594ffb7ae server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:01.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.250+0000 7ff335600640 1 -- 172.21.15.49:0/569280929 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3200ab600 con 0x7ff3380d0e90 2024-01-31T12:09:01.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.250+0000 7ff335600640 1 -- 172.21.15.49:0/569280929 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3200a7050 con 0x7ff3380d0e90 2024-01-31T12:09:01.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.250+0000 7ff335600640 1 -- 172.21.15.49:0/569280929 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3200ab980 con 0x7ff3380d0e90 2024-01-31T12:09:01.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.250+0000 7ff337e00640 1 -- 172.21.15.49:0/569280929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3380d0e90 msgr2=0x7ff3380cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:01.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.250+0000 7ff337e00640 1 --2- 172.21.15.49:0/569280929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3380d0e90 0x7ff3380cfc00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff320009870 tx=0x7ff32001c500 comp rx=0 tx=0).stop 2024-01-31T12:09:01.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.250+0000 7ff337e00640 1 -- 172.21.15.49:0/569280929 shutdown_connections 2024-01-31T12:09:01.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.250+0000 7ff337e00640 1 --2- 172.21.15.49:0/569280929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3380d0e90 0x7ff3380cfc00 secure :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff320009870 tx=0x7ff32001c500 comp rx=0 tx=0).stop 2024-01-31T12:09:01.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.250+0000 7ff337e00640 1 --2- 172.21.15.49:0/569280929 >> v2:172.21.15.195:3300/0 conn(0x7ff338160930 0x7ff3380cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:01.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.250+0000 7ff337e00640 1 -- 172.21.15.49:0/569280929 >> 172.21.15.49:0/569280929 conn(0x7ff33809c3c0 msgr2=0x7ff3380d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:01.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.254+0000 7ff337e00640 1 -- 172.21.15.49:0/569280929 shutdown_connections 2024-01-31T12:09:01.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.254+0000 7ff337e00640 1 -- 172.21.15.49:0/569280929 wait complete. 2024-01-31T12:09:01.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.258+0000 7ff337e00640 1 Processor -- start 2024-01-31T12:09:01.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.262+0000 7ff337e00640 1 -- start start 2024-01-31T12:09:01.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.262+0000 7ff337e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3380b2ea0 0x7ff33814d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:01.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.262+0000 7ff337e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff338160930 0x7ff3380b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:01.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.262+0000 7ff337e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3380b1240 0x7ff338152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:01.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.262+0000 7ff337e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3380b16d0 con 0x7ff338160930 2024-01-31T12:09:01.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.262+0000 7ff337e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3380ca180 con 0x7ff3380b1240 2024-01-31T12:09:01.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.262+0000 7ff337e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3380ca440 con 0x7ff3380b2ea0 2024-01-31T12:09:01.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.266+0000 7ff336a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3380b2ea0 0x7ff33814d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:01.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.266+0000 7ff336a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3380b2ea0 0x7ff33814d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:45834/0 (socket says 172.21.15.49:45834) 2024-01-31T12:09:01.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.266+0000 7ff336a00640 1 -- 172.21.15.49:0/473476366 learned_addr learned my addr 172.21.15.49:0/473476366 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:01.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.266+0000 7ff337400640 1 --2- 172.21.15.49:0/473476366 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3380b1240 0x7ff338152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:01.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.266+0000 7ff336a00640 1 -- 172.21.15.49:0/473476366 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3380b1240 msgr2=0x7ff338152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:01.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.266+0000 7ff336a00640 1 --2- 172.21.15.49:0/473476366 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3380b1240 0x7ff338152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:01.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.266+0000 7ff336a00640 1 -- 172.21.15.49:0/473476366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff338160930 msgr2=0x7ff3380b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:01.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.266+0000 7ff336a00640 1 --2- 172.21.15.49:0/473476366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff338160930 0x7ff3380b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:01.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.266+0000 7ff336a00640 1 -- 172.21.15.49:0/473476366 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3200094d0 con 0x7ff3380b2ea0 2024-01-31T12:09:01.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.266+0000 7ff337400640 1 --2- 172.21.15.49:0/473476366 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3380b1240 0x7ff338152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T12:09:01.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.266+0000 7ff336a00640 1 --2- 172.21.15.49:0/473476366 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3380b2ea0 0x7ff33814d570 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff32800e8a0 tx=0x7ff32800eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:01.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.266+0000 7ff32ea00640 1 -- 172.21.15.49:0/473476366 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32800c940 con 0x7ff3380b2ea0 2024-01-31T12:09:01.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.266+0000 7ff32ea00640 1 -- 172.21.15.49:0/473476366 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32800caa0 con 0x7ff3380b2ea0 2024-01-31T12:09:01.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.266+0000 7ff337e00640 1 -- 172.21.15.49:0/473476366 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff338153d50 con 0x7ff3380b2ea0 2024-01-31T12:09:01.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.270+0000 7ff32ea00640 1 -- 172.21.15.49:0/473476366 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32800ce10 con 0x7ff3380b2ea0 2024-01-31T12:09:01.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.270+0000 7ff337e00640 1 -- 172.21.15.49:0/473476366 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff338154310 con 0x7ff3380b2ea0 2024-01-31T12:09:01.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.274+0000 7ff337e00640 1 -- 172.21.15.49:0/473476366 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff338074860 con 0x7ff3380b2ea0 2024-01-31T12:09:01.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.278+0000 7ff32ea00640 1 -- 172.21.15.49:0/473476366 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff328013470 con 0x7ff3380b2ea0 2024-01-31T12:09:01.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.278+0000 7ff32ea00640 1 --2- 172.21.15.49:0/473476366 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff310066580 0x7ff310068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:01.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.278+0000 7ff32ea00640 1 -- 172.21.15.49:0/473476366 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff328083f40 con 0x7ff3380b2ea0 2024-01-31T12:09:01.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.282+0000 7ff336000640 1 --2- 172.21.15.49:0/473476366 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff310066580 0x7ff310068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:01.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.286+0000 7ff32ea00640 1 -- 172.21.15.49:0/473476366 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff3280b5590 con 0x7ff3380b2ea0 2024-01-31T12:09:01.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:01.286+0000 7ff336000640 1 --2- 172.21.15.49:0/473476366 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff310066580 0x7ff310068a40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff3200ad000 tx=0x7ff320004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:02.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.154+0000 7ff337e00640 1 -- 172.21.15.49:0/473476366 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff338157290 con 0x7ff3380b2ea0 2024-01-31T12:09:02.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.186+0000 7ff32ea00640 1 -- 172.21.15.49:0/473476366 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff3280511f0 con 0x7ff3380b2ea0 2024-01-31T12:09:02.199 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-01-31T12:09:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.206+0000 7ff337e00640 1 -- 172.21.15.49:0/473476366 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff310066580 msgr2=0x7ff310068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.206+0000 7ff337e00640 1 --2- 172.21.15.49:0/473476366 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff310066580 0x7ff310068a40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff3200ad000 tx=0x7ff320004740 comp rx=0 tx=0).stop 2024-01-31T12:09:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.206+0000 7ff337e00640 1 -- 172.21.15.49:0/473476366 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3380b2ea0 msgr2=0x7ff33814d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.206+0000 7ff337e00640 1 --2- 172.21.15.49:0/473476366 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3380b2ea0 0x7ff33814d570 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff32800e8a0 tx=0x7ff32800eca0 comp rx=0 tx=0).stop 2024-01-31T12:09:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.206+0000 7ff337e00640 1 -- 172.21.15.49:0/473476366 shutdown_connections 2024-01-31T12:09:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.206+0000 7ff337e00640 1 --2- 172.21.15.49:0/473476366 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff310066580 0x7ff310068a40 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:02.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.206+0000 7ff337e00640 1 --2- 172.21.15.49:0/473476366 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3380b1240 0x7ff338152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:02.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.206+0000 7ff337e00640 1 --2- 172.21.15.49:0/473476366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff338160930 0x7ff3380b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:02.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.206+0000 7ff337e00640 1 --2- 172.21.15.49:0/473476366 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3380b2ea0 0x7ff33814d570 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:02.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.206+0000 7ff337e00640 1 -- 172.21.15.49:0/473476366 >> 172.21.15.49:0/473476366 conn(0x7ff33809c3c0 msgr2=0x7ff33806b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:02.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.206+0000 7ff337e00640 1 -- 172.21.15.49:0/473476366 shutdown_connections 2024-01-31T12:09:02.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.206+0000 7ff337e00640 1 -- 172.21.15.49:0/473476366 wait complete. 2024-01-31T12:09:02.283 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T12:09:02.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.586+0000 7f57a0200640 1 Processor -- start 2024-01-31T12:09:02.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.586+0000 7f57a0200640 1 -- start start 2024-01-31T12:09:02.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.590+0000 7f57a0200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5798070c70 0x7f5798165380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:02.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.590+0000 7f57a0200640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579806c740 con 0x7f57980ce550 2024-01-31T12:09:02.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.590+0000 7f57a0200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57981660f0 con 0x7f57980ce930 2024-01-31T12:09:02.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.590+0000 7f57a0200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579806c990 con 0x7f5798070c70 2024-01-31T12:09:02.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.590+0000 7f579e200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5798070c70 0x7f5798165380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:02.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.590+0000 7f579d800640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f57980ce550 0x7f5798144dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:37956/0 (socket says 172.21.15.49:37956) 2024-01-31T12:09:02.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.590+0000 7f579e200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f5798070c70 0x7f5798165380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54680/0 (socket says 172.21.15.49:54680) 2024-01-31T12:09:02.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.590+0000 7f579d800640 1 -- 172.21.15.49:0/1335999789 learned_addr learned my addr 172.21.15.49:0/1335999789 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:09:02.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.590+0000 7f579e200640 1 -- 172.21.15.49:0/1335999789 >> v1:172.21.15.195:6789/0 conn(0x7f57980ce930 legacy=0x7f5798070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:02.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.590+0000 7f579e200640 1 -- 172.21.15.49:0/1335999789 >> v1:172.21.15.49:6789/0 conn(0x7f57980ce550 legacy=0x7f5798144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:02.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.590+0000 7f579e200640 1 -- 172.21.15.49:0/1335999789 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579806cc70 con 0x7f5798070c70 2024-01-31T12:09:02.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.602+0000 7f579e200640 1 --2- 172.21.15.49:0/1335999789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5798070c70 0x7f5798165380 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f57880097c0 tx=0x7f578801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47df41800538cdb server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:02.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.602+0000 7f5797e00640 1 -- 172.21.15.49:0/1335999789 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57880ac600 con 0x7f5798070c70 2024-01-31T12:09:02.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.602+0000 7f5797e00640 1 -- 172.21.15.49:0/1335999789 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57880a8050 con 0x7f5798070c70 2024-01-31T12:09:02.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.602+0000 7f5797e00640 1 -- 172.21.15.49:0/1335999789 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57880ac980 con 0x7f5798070c70 2024-01-31T12:09:02.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.602+0000 7f57a0200640 1 -- 172.21.15.49:0/1335999789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5798070c70 msgr2=0x7f5798165380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:02.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.602+0000 7f57a0200640 1 --2- 172.21.15.49:0/1335999789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5798070c70 0x7f5798165380 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f57880097c0 tx=0x7f578801c380 comp rx=0 tx=0).stop 2024-01-31T12:09:02.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.602+0000 7f57a0200640 1 -- 172.21.15.49:0/1335999789 shutdown_connections 2024-01-31T12:09:02.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.602+0000 7f57a0200640 1 --2- 172.21.15.49:0/1335999789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5798070c70 0x7f5798165380 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:02.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.602+0000 7f57a0200640 1 -- 172.21.15.49:0/1335999789 >> 172.21.15.49:0/1335999789 conn(0x7f579806ad70 msgr2=0x7f57980b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:02.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.602+0000 7f57a0200640 1 -- 172.21.15.49:0/1335999789 shutdown_connections 2024-01-31T12:09:02.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.602+0000 7f57a0200640 1 -- 172.21.15.49:0/1335999789 wait complete. 2024-01-31T12:09:02.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.610+0000 7f57a0200640 1 Processor -- start 2024-01-31T12:09:02.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.610+0000 7f57a0200640 1 -- start start 2024-01-31T12:09:02.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.614+0000 7f57a0200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5798070c70 0x7f5798144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:02.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.614+0000 7f57a0200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57980ce550 0x7f579813ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:02.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.614+0000 7f57a0200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57980ce930 0x7f57981579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:02.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.614+0000 7f57a0200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579813e300 con 0x7f57980ce930 2024-01-31T12:09:02.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.614+0000 7f57a0200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5798145920 con 0x7f5798070c70 2024-01-31T12:09:02.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.614+0000 7f57a0200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5798157ef0 con 0x7f57980ce550 2024-01-31T12:09:02.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.614+0000 7f579ce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57980ce550 0x7f579813ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:02.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.614+0000 7f579ce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57980ce550 0x7f579813ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:45850/0 (socket says 172.21.15.49:45850) 2024-01-31T12:09:02.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.614+0000 7f579ce00640 1 -- 172.21.15.49:0/3376204133 learned_addr learned my addr 172.21.15.49:0/3376204133 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:02.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.614+0000 7f579d800640 1 --2- 172.21.15.49:0/3376204133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5798070c70 0x7f5798144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:02.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.618+0000 7f579d800640 1 -- 172.21.15.49:0/3376204133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57980ce550 msgr2=0x7f579813ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:02.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.618+0000 7f579d800640 1 --2- 172.21.15.49:0/3376204133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57980ce550 0x7f579813ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:02.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.618+0000 7f579d800640 1 -- 172.21.15.49:0/3376204133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57980ce930 msgr2=0x7f57981579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:02.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.618+0000 7f579d800640 1 --2- 172.21.15.49:0/3376204133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57980ce930 0x7f57981579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:02.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.618+0000 7f579d800640 1 -- 172.21.15.49:0/3376204133 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5788009420 con 0x7f5798070c70 2024-01-31T12:09:02.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.618+0000 7f579d800640 1 --2- 172.21.15.49:0/3376204133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5798070c70 0x7f5798144c80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f579000ca70 tx=0x7f579000ce70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:02.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.618+0000 7f5795600640 1 -- 172.21.15.49:0/3376204133 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579000ab10 con 0x7f5798070c70 2024-01-31T12:09:02.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.618+0000 7f5795600640 1 -- 172.21.15.49:0/3376204133 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579000ac70 con 0x7f5798070c70 2024-01-31T12:09:02.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.618+0000 7f5795600640 1 -- 172.21.15.49:0/3376204133 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790012600 con 0x7f5798070c70 2024-01-31T12:09:02.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.622+0000 7f579ce00640 1 --2- 172.21.15.49:0/3376204133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57980ce550 0x7f579813ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T12:09:02.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.622+0000 7f57a0200640 1 -- 172.21.15.49:0/3376204133 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5798145360 con 0x7f5798070c70 2024-01-31T12:09:02.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.622+0000 7f57a0200640 1 -- 172.21.15.49:0/3376204133 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5798158fe0 con 0x7f5798070c70 2024-01-31T12:09:02.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.626+0000 7f57a0200640 1 -- 172.21.15.49:0/3376204133 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5798067c80 con 0x7f5798070c70 2024-01-31T12:09:02.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.626+0000 7f5795600640 1 -- 172.21.15.49:0/3376204133 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f5790012760 con 0x7f5798070c70 2024-01-31T12:09:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.630+0000 7f5795600640 1 --2- 172.21.15.49:0/3376204133 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5770066500 0x7f57700689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.630+0000 7f5795600640 1 -- 172.21.15.49:0/3376204133 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5790083d60 con 0x7f5798070c70 2024-01-31T12:09:02.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.630+0000 7f579ce00640 1 --2- 172.21.15.49:0/3376204133 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5770066500 0x7f57700689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:02.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.634+0000 7f579ce00640 1 --2- 172.21.15.49:0/3376204133 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5770066500 0x7f57700689c0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f5798144530 tx=0x7f5780009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:02.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:02.858+0000 7f5795600640 1 -- 172.21.15.49:0/3376204133 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f5790050f50 con 0x7f5798070c70 2024-01-31T12:09:03.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:03.698+0000 7f57a0200640 1 -- 172.21.15.49:0/3376204133 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5798158e40 con 0x7f5798070c70 2024-01-31T12:09:03.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:03.734+0000 7f5795600640 1 -- 172.21.15.49:0/3376204133 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5798158e40 con 0x7f5798070c70 2024-01-31T12:09:03.740 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-01-31T12:09:03.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:03.746+0000 7f57a0200640 1 -- 172.21.15.49:0/3376204133 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5770066500 msgr2=0x7f57700689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:03.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:03.746+0000 7f57a0200640 1 --2- 172.21.15.49:0/3376204133 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5770066500 0x7f57700689c0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f5798144530 tx=0x7f5780009040 comp rx=0 tx=0).stop 2024-01-31T12:09:03.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:03.746+0000 7f57a0200640 1 -- 172.21.15.49:0/3376204133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5798070c70 msgr2=0x7f5798144c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:03.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:03.746+0000 7f57a0200640 1 --2- 172.21.15.49:0/3376204133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5798070c70 0x7f5798144c80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f579000ca70 tx=0x7f579000ce70 comp rx=0 tx=0).stop 2024-01-31T12:09:03.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:03.750+0000 7f57a0200640 1 -- 172.21.15.49:0/3376204133 shutdown_connections 2024-01-31T12:09:03.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:03.750+0000 7f57a0200640 1 --2- 172.21.15.49:0/3376204133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57980ce930 0x7f57981579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:03.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:03.750+0000 7f57a0200640 1 --2- 172.21.15.49:0/3376204133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f57980ce550 0x7f579813ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:03.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:03.750+0000 7f57a0200640 1 --2- 172.21.15.49:0/3376204133 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f5770066500 0x7f57700689c0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:03.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:03.750+0000 7f57a0200640 1 --2- 172.21.15.49:0/3376204133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5798070c70 0x7f5798144c80 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:03.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:03.750+0000 7f57a0200640 1 -- 172.21.15.49:0/3376204133 >> 172.21.15.49:0/3376204133 conn(0x7f579806ad70 msgr2=0x7f5798070560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:03.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:03.750+0000 7f57a0200640 1 -- 172.21.15.49:0/3376204133 shutdown_connections 2024-01-31T12:09:03.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:03.750+0000 7f57a0200640 1 -- 172.21.15.49:0/3376204133 wait complete. 2024-01-31T12:09:03.820 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T12:09:04.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.382+0000 7ff706400640 1 Processor -- start 2024-01-31T12:09:04.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.382+0000 7ff706400640 1 -- start start 2024-01-31T12:09:04.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.390+0000 7ff706400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff7001505d0 0x7ff7000710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:04.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.390+0000 7ff706400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7000b3180 0x7ff70006cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:04.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.390+0000 7ff706400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff700072a50 con 0x7ff7001509b0 2024-01-31T12:09:04.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.390+0000 7ff706400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff700072770 con 0x7ff7001505d0 2024-01-31T12:09:04.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.390+0000 7ff706400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff700070600 con 0x7ff7000b3180 2024-01-31T12:09:04.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.390+0000 7ff6ffe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7000b3180 0x7ff70006cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:04.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.390+0000 7ff6ffe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7000b3180 0x7ff70006cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:45862/0 (socket says 172.21.15.49:45862) 2024-01-31T12:09:04.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.390+0000 7ff6ffe00640 1 -- 172.21.15.49:0/812223738 learned_addr learned my addr 172.21.15.49:0/812223738 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:04.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.390+0000 7ff6ff400640 1 --2- 172.21.15.49:0/812223738 >> v2:172.21.15.49:3300/0 conn(0x7ff7001505d0 0x7ff7000710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:04.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.390+0000 7ff6ffe00640 1 -- 172.21.15.49:0/812223738 >> v2:172.21.15.49:3300/0 conn(0x7ff7001505d0 msgr2=0x7ff7000710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:04.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.390+0000 7ff6ffe00640 1 --2- 172.21.15.49:0/812223738 >> v2:172.21.15.49:3300/0 conn(0x7ff7001505d0 0x7ff7000710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:04.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.390+0000 7ff6ffe00640 1 -- 172.21.15.49:0/812223738 >> v1:172.21.15.195:6789/0 conn(0x7ff7001509b0 legacy=0x7ff7000b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:04.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.390+0000 7ff6ffe00640 1 -- 172.21.15.49:0/812223738 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7000708e0 con 0x7ff7000b3180 2024-01-31T12:09:04.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.406+0000 7ff6ffe00640 1 --2- 172.21.15.49:0/812223738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7000b3180 0x7ff70006cd10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009870 tx=0x7ff6e801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=414abeb31f320250 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:04.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.406+0000 7ff6fe000640 1 -- 172.21.15.49:0/812223738 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e80ab620 con 0x7ff7000b3180 2024-01-31T12:09:04.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.406+0000 7ff6fe000640 1 -- 172.21.15.49:0/812223738 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e80ab780 con 0x7ff7000b3180 2024-01-31T12:09:04.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.406+0000 7ff6fe000640 1 -- 172.21.15.49:0/812223738 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e80abb10 con 0x7ff7000b3180 2024-01-31T12:09:04.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.406+0000 7ff706400640 1 -- 172.21.15.49:0/812223738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7000b3180 msgr2=0x7ff70006cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:04.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.406+0000 7ff706400640 1 --2- 172.21.15.49:0/812223738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7000b3180 0x7ff70006cd10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009870 tx=0x7ff6e801c510 comp rx=0 tx=0).stop 2024-01-31T12:09:04.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.410+0000 7ff706400640 1 -- 172.21.15.49:0/812223738 shutdown_connections 2024-01-31T12:09:04.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.410+0000 7ff706400640 1 --2- 172.21.15.49:0/812223738 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7000b3180 0x7ff70006cd10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:04.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.410+0000 7ff706400640 1 --2- 172.21.15.49:0/812223738 >> v2:172.21.15.49:3300/0 conn(0x7ff7001505d0 0x7ff7000710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:04.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.410+0000 7ff706400640 1 -- 172.21.15.49:0/812223738 >> 172.21.15.49:0/812223738 conn(0x7ff7000b0b60 msgr2=0x7ff7000b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:04.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.410+0000 7ff706400640 1 -- 172.21.15.49:0/812223738 shutdown_connections 2024-01-31T12:09:04.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.410+0000 7ff706400640 1 -- 172.21.15.49:0/812223738 wait complete. 2024-01-31T12:09:04.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.414+0000 7ff706400640 1 Processor -- start 2024-01-31T12:09:04.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.414+0000 7ff706400640 1 -- start start 2024-01-31T12:09:04.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.414+0000 7ff706400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7000b3180 0x7ff700138aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:04.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.414+0000 7ff706400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7001505d0 0x7ff7000a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:04.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.414+0000 7ff706400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7001509b0 0x7ff7000a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:04.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.414+0000 7ff706400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70013b290 con 0x7ff7000b3180 2024-01-31T12:09:04.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.414+0000 7ff706400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70013acd0 con 0x7ff7001509b0 2024-01-31T12:09:04.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.414+0000 7ff706400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70013afb0 con 0x7ff7001505d0 2024-01-31T12:09:04.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.414+0000 7ff6fea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7001505d0 0x7ff7000a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:04.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.414+0000 7ff6fea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7001505d0 0x7ff7000a84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:45876/0 (socket says 172.21.15.49:45876) 2024-01-31T12:09:04.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.414+0000 7ff6fea00640 1 -- 172.21.15.49:0/3629013358 learned_addr learned my addr 172.21.15.49:0/3629013358 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:04.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.414+0000 7ff6ff400640 1 --2- 172.21.15.49:0/3629013358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7000b3180 0x7ff700138aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:04.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.414+0000 7ff6fea00640 1 -- 172.21.15.49:0/3629013358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7001509b0 msgr2=0x7ff7000a89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:04.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.414+0000 7ff6fea00640 1 --2- 172.21.15.49:0/3629013358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7001509b0 0x7ff7000a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:04.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.414+0000 7ff6fea00640 1 -- 172.21.15.49:0/3629013358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7000b3180 msgr2=0x7ff700138aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:04.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.414+0000 7ff6fea00640 1 --2- 172.21.15.49:0/3629013358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7000b3180 0x7ff700138aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:04.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.414+0000 7ff6fea00640 1 -- 172.21.15.49:0/3629013358 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e80094d0 con 0x7ff7001505d0 2024-01-31T12:09:04.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.418+0000 7ff6fea00640 1 --2- 172.21.15.49:0/3629013358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7001505d0 0x7ff7000a84b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000c3c0 tx=0x7ff6f000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:04.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.418+0000 7ff6f7400640 1 -- 172.21.15.49:0/3629013358 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f00052d0 con 0x7ff7001505d0 2024-01-31T12:09:04.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.418+0000 7ff6f7400640 1 -- 172.21.15.49:0/3629013358 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f0005430 con 0x7ff7001505d0 2024-01-31T12:09:04.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.418+0000 7ff6f7400640 1 -- 172.21.15.49:0/3629013358 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0003840 con 0x7ff7001505d0 2024-01-31T12:09:04.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.418+0000 7ff706400640 1 -- 172.21.15.49:0/3629013358 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff700071830 con 0x7ff7001505d0 2024-01-31T12:09:04.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.418+0000 7ff706400640 1 -- 172.21.15.49:0/3629013358 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70014dc30 con 0x7ff7001505d0 2024-01-31T12:09:04.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.426+0000 7ff6f7400640 1 -- 172.21.15.49:0/3629013358 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff6f00039a0 con 0x7ff7001505d0 2024-01-31T12:09:04.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.430+0000 7ff706400640 1 -- 172.21.15.49:0/3629013358 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d00052a0 con 0x7ff7001505d0 2024-01-31T12:09:04.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.434+0000 7ff6f7400640 1 --2- 172.21.15.49:0/3629013358 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff6d8066500 0x7ff6d80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:04.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.434+0000 7ff6f7400640 1 -- 172.21.15.49:0/3629013358 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff6f0083490 con 0x7ff7001505d0 2024-01-31T12:09:04.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.434+0000 7ff6ff400640 1 --2- 172.21.15.49:0/3629013358 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff6d8066500 0x7ff6d80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:04.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.438+0000 7ff6ff400640 1 --2- 172.21.15.49:0/3629013358 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff6d8066500 0x7ff6d80689c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009f30 tx=0x7ff6f800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:04.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.438+0000 7ff6f7400640 1 -- 172.21.15.49:0/3629013358 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff6f0050670 con 0x7ff7001505d0 2024-01-31T12:09:04.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.718+0000 7ff706400640 1 -- 172.21.15.49:0/3629013358 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6d0005820 con 0x7ff7001505d0 2024-01-31T12:09:04.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.722+0000 7ff6f7400640 1 -- 172.21.15.49:0/3629013358 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff6f0053c90 con 0x7ff7001505d0 2024-01-31T12:09:04.730 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-01-31T12:09:04.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.730+0000 7ff706400640 1 -- 172.21.15.49:0/3629013358 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff6d8066500 msgr2=0x7ff6d80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:04.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.730+0000 7ff706400640 1 --2- 172.21.15.49:0/3629013358 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff6d8066500 0x7ff6d80689c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009f30 tx=0x7ff6f800b040 comp rx=0 tx=0).stop 2024-01-31T12:09:04.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.730+0000 7ff706400640 1 -- 172.21.15.49:0/3629013358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7001505d0 msgr2=0x7ff7000a84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:04.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.730+0000 7ff706400640 1 --2- 172.21.15.49:0/3629013358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7001505d0 0x7ff7000a84b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000c3c0 tx=0x7ff6f000c880 comp rx=0 tx=0).stop 2024-01-31T12:09:04.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.730+0000 7ff706400640 1 -- 172.21.15.49:0/3629013358 shutdown_connections 2024-01-31T12:09:04.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.730+0000 7ff706400640 1 --2- 172.21.15.49:0/3629013358 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff6d8066500 0x7ff6d80689c0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:04.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.730+0000 7ff706400640 1 --2- 172.21.15.49:0/3629013358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7001509b0 0x7ff7000a89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:04.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.730+0000 7ff706400640 1 --2- 172.21.15.49:0/3629013358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff7001505d0 0x7ff7000a84b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:04.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.730+0000 7ff706400640 1 --2- 172.21.15.49:0/3629013358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7000b3180 0x7ff700138aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:04.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.730+0000 7ff706400640 1 -- 172.21.15.49:0/3629013358 >> 172.21.15.49:0/3629013358 conn(0x7ff7000b0b60 msgr2=0x7ff7000b0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:04.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.730+0000 7ff706400640 1 -- 172.21.15.49:0/3629013358 shutdown_connections 2024-01-31T12:09:04.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:04.730+0000 7ff706400640 1 -- 172.21.15.49:0/3629013358 wait complete. 2024-01-31T12:09:04.768 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T12:09:05.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.034+0000 7f25d4600640 1 Processor -- start 2024-01-31T12:09:05.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.038+0000 7f25d4600640 1 -- start start 2024-01-31T12:09:05.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.038+0000 7f25d4600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25cc06d9f0 0x7f25cc06cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:05.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.038+0000 7f25d4600640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f25cc0715f0 0x7f25cc15de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:05.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.038+0000 7f25d4600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25cc0b2ed0 con 0x7f25cc06ddd0 2024-01-31T12:09:05.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.038+0000 7f25d4600640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25cc15d9b0 con 0x7f25cc0715f0 2024-01-31T12:09:05.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.038+0000 7f25d4600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc0b31b0 con 0x7f25cc06d9f0 2024-01-31T12:09:05.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.038+0000 7f25d1c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25cc06d9f0 0x7f25cc06cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:05.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.038+0000 7f25d1200640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f25cc06ddd0 0x7f25cc070ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:34904/0 (socket says 172.21.15.49:34904) 2024-01-31T12:09:05.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.038+0000 7f25d1200640 1 -- 172.21.15.49:0/2614448844 learned_addr learned my addr 172.21.15.49:0/2614448844 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:09:05.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.038+0000 7f25d1c00640 1 -- 172.21.15.49:0/2614448844 >> v2:172.21.15.49:3300/0 conn(0x7f25cc0715f0 msgr2=0x7f25cc15de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:05.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.038+0000 7f25d1c00640 1 --2- 172.21.15.49:0/2614448844 >> v2:172.21.15.49:3300/0 conn(0x7f25cc0715f0 0x7f25cc15de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:05.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.038+0000 7f25d1c00640 1 -- 172.21.15.49:0/2614448844 >> v1:172.21.15.195:6789/0 conn(0x7f25cc06ddd0 legacy=0x7f25cc070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:05.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.038+0000 7f25d1c00640 1 -- 172.21.15.49:0/2614448844 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc0b3490 con 0x7f25cc06d9f0 2024-01-31T12:09:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.042+0000 7f25d1c00640 1 --2- 172.21.15.49:0/2614448844 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25cc06d9f0 0x7f25cc06cc00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0097c0 tx=0x7f25bc01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=484f6b4b8addf718 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.046+0000 7f25cbe00640 1 -- 172.21.15.49:0/2614448844 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc0ac410 con 0x7f25cc06d9f0 2024-01-31T12:09:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.046+0000 7f25cbe00640 1 -- 172.21.15.49:0/2614448844 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc0ac570 con 0x7f25cc06d9f0 2024-01-31T12:09:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.046+0000 7f25cbe00640 1 -- 172.21.15.49:0/2614448844 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc0ac900 con 0x7f25cc06d9f0 2024-01-31T12:09:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.046+0000 7f25d4600640 1 -- 172.21.15.49:0/2614448844 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25cc06d9f0 msgr2=0x7f25cc06cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.046+0000 7f25d4600640 1 --2- 172.21.15.49:0/2614448844 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25cc06d9f0 0x7f25cc06cc00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0097c0 tx=0x7f25bc01c4a0 comp rx=0 tx=0).stop 2024-01-31T12:09:05.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.046+0000 7f25d4600640 1 -- 172.21.15.49:0/2614448844 shutdown_connections 2024-01-31T12:09:05.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.046+0000 7f25d4600640 1 --2- 172.21.15.49:0/2614448844 >> v2:172.21.15.49:3300/0 conn(0x7f25cc0715f0 0x7f25cc15de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:05.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.046+0000 7f25d4600640 1 --2- 172.21.15.49:0/2614448844 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25cc06d9f0 0x7f25cc06cc00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:05.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.046+0000 7f25d4600640 1 -- 172.21.15.49:0/2614448844 >> 172.21.15.49:0/2614448844 conn(0x7f25cc0b0b60 msgr2=0x7f25cc0b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:05.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.050+0000 7f25d4600640 1 -- 172.21.15.49:0/2614448844 shutdown_connections 2024-01-31T12:09:05.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.050+0000 7f25d4600640 1 -- 172.21.15.49:0/2614448844 wait complete. 2024-01-31T12:09:05.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.054+0000 7f25d4600640 1 Processor -- start 2024-01-31T12:09:05.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.054+0000 7f25d4600640 1 -- start start 2024-01-31T12:09:05.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.062+0000 7f25d4600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25cc06d9f0 0x7f25cc2064a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:05.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.062+0000 7f25d4600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25cc06ddd0 0x7f25cc0ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:05.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.062+0000 7f25d4600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25cc0715f0 0x7f25cc0ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:05.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.062+0000 7f25d4600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc2069e0 con 0x7f25cc06d9f0 2024-01-31T12:09:05.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.062+0000 7f25d4600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc2038f0 con 0x7f25cc0715f0 2024-01-31T12:09:05.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.062+0000 7f25d4600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc203bd0 con 0x7f25cc06ddd0 2024-01-31T12:09:05.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.062+0000 7f25d2600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25cc0715f0 0x7f25cc0ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:05.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.062+0000 7f25d1c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25cc06d9f0 0x7f25cc2064a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:05.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.062+0000 7f25d2600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25cc0715f0 0x7f25cc0ac710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41406/0 (socket says 172.21.15.49:41406) 2024-01-31T12:09:05.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.062+0000 7f25d2600640 1 -- 172.21.15.49:0/3338430098 learned_addr learned my addr 172.21.15.49:0/3338430098 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:05.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.062+0000 7f25d1c00640 1 -- 172.21.15.49:0/3338430098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25cc06ddd0 msgr2=0x7f25cc0ac1d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-31T12:09:05.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.062+0000 7f25d1c00640 1 --2- 172.21.15.49:0/3338430098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25cc06ddd0 0x7f25cc0ac1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:05.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.062+0000 7f25d1c00640 1 -- 172.21.15.49:0/3338430098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25cc0715f0 msgr2=0x7f25cc0ac710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:05.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.062+0000 7f25d1c00640 1 --2- 172.21.15.49:0/3338430098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25cc0715f0 0x7f25cc0ac710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:05.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.062+0000 7f25d1c00640 1 -- 172.21.15.49:0/3338430098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc009420 con 0x7f25cc06d9f0 2024-01-31T12:09:05.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.066+0000 7f25d1c00640 1 --2- 172.21.15.49:0/3338430098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25cc06d9f0 0x7f25cc2064a0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0ac000 tx=0x7f25bc019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:05.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.066+0000 7f25c9600640 1 -- 172.21.15.49:0/3338430098 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc006e20 con 0x7f25cc06d9f0 2024-01-31T12:09:05.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.070+0000 7f25c9600640 1 -- 172.21.15.49:0/3338430098 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc0b5620 con 0x7f25cc06d9f0 2024-01-31T12:09:05.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.070+0000 7f25c9600640 1 -- 172.21.15.49:0/3338430098 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc0b59d0 con 0x7f25cc06d9f0 2024-01-31T12:09:05.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.070+0000 7f25d4600640 1 -- 172.21.15.49:0/3338430098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25cc203eb0 con 0x7f25cc06d9f0 2024-01-31T12:09:05.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.070+0000 7f25d4600640 1 -- 172.21.15.49:0/3338430098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc204470 con 0x7f25cc06d9f0 2024-01-31T12:09:05.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.070+0000 7f25c9600640 1 -- 172.21.15.49:0/3338430098 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f25bc0b3040 con 0x7f25cc06d9f0 2024-01-31T12:09:05.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.074+0000 7f25c2a00640 1 -- 172.21.15.49:0/3338430098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25cc169120 con 0x7f25cc06d9f0 2024-01-31T12:09:05.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.074+0000 7f25c9600640 1 --2- 172.21.15.49:0/3338430098 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f25a4066530 0x7f25a40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:05.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.078+0000 7f25c9600640 1 -- 172.21.15.49:0/3338430098 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f25bc11ddb0 con 0x7f25cc06d9f0 2024-01-31T12:09:05.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.078+0000 7f25d1200640 1 --2- 172.21.15.49:0/3338430098 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f25a4066530 0x7f25a40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:05.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.078+0000 7f25d1200640 1 --2- 172.21.15.49:0/3338430098 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f25a4066530 0x7f25a40689f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f25cc130580 tx=0x7f25b4007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:05.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:05.418+0000 7f25c9600640 1 -- 172.21.15.49:0/3338430098 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f25bc0eae50 con 0x7f25cc06d9f0 2024-01-31T12:09:06.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.478+0000 7f25c2a00640 1 -- 172.21.15.49:0/3338430098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25cc0749c0 con 0x7f25cc06d9f0 2024-01-31T12:09:06.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.526+0000 7f25c9600640 1 -- 172.21.15.49:0/3338430098 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f25bc0b1090 con 0x7f25cc06d9f0 2024-01-31T12:09:06.531 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:09:06.531 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5078,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3747440713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3747440713},{"type":"v1","addr":"172.21.15.195:6837","nonce":3747440713}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2835620509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2835620509},{"type":"v1","addr":"172.21.15.195:6836","nonce":2835620509}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2080191803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2080191803},{"type":"v1","addr":"172.21.15.49:6833","nonce":2080191803}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-31T05:05:51.919747+0000","modified":"2024-01-31T05:05:54.941384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5493":{"gid":5493,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6835/4235056900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4235056900},{"type":"v1","addr":"172.21.15.49:6835","nonce":4235056900}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-31T12:09:06.531 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 19 2024-01-31T12:09:06.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.534+0000 7f25c2a00640 1 -- 172.21.15.49:0/3338430098 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f25a4066530 msgr2=0x7f25a40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:06.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.534+0000 7f25c2a00640 1 --2- 172.21.15.49:0/3338430098 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f25a4066530 0x7f25a40689f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f25cc130580 tx=0x7f25b4007a50 comp rx=0 tx=0).stop 2024-01-31T12:09:06.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.534+0000 7f25c2a00640 1 -- 172.21.15.49:0/3338430098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25cc06d9f0 msgr2=0x7f25cc2064a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:06.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.534+0000 7f25c2a00640 1 --2- 172.21.15.49:0/3338430098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25cc06d9f0 0x7f25cc2064a0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0ac000 tx=0x7f25bc019240 comp rx=0 tx=0).stop 2024-01-31T12:09:06.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.534+0000 7f25c2a00640 1 -- 172.21.15.49:0/3338430098 shutdown_connections 2024-01-31T12:09:06.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.534+0000 7f25c2a00640 1 --2- 172.21.15.49:0/3338430098 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f25a4066530 0x7f25a40689f0 secure :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f25cc130580 tx=0x7f25b4007a50 comp rx=0 tx=0).stop 2024-01-31T12:09:06.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.534+0000 7f25c2a00640 1 --2- 172.21.15.49:0/3338430098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25cc0715f0 0x7f25cc0ac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:06.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.534+0000 7f25c2a00640 1 --2- 172.21.15.49:0/3338430098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25cc06ddd0 0x7f25cc0ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:06.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.534+0000 7f25c2a00640 1 --2- 172.21.15.49:0/3338430098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25cc06d9f0 0x7f25cc2064a0 secure :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0ac000 tx=0x7f25bc019240 comp rx=0 tx=0).stop 2024-01-31T12:09:06.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.534+0000 7f25c2a00640 1 -- 172.21.15.49:0/3338430098 >> 172.21.15.49:0/3338430098 conn(0x7f25cc0b0b60 msgr2=0x7f25cc153900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:06.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.534+0000 7f25c2a00640 1 -- 172.21.15.49:0/3338430098 shutdown_connections 2024-01-31T12:09:06.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.538+0000 7f25c2a00640 1 -- 172.21.15.49:0/3338430098 wait complete. 2024-01-31T12:09:06.614 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T12:09:06.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.906+0000 7f6e4e600640 1 Processor -- start 2024-01-31T12:09:06.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.906+0000 7f6e4e600640 1 -- start start 2024-01-31T12:09:06.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.910+0000 7f6e4e600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6e480b3eb0 0x7f6e480cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:06.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.910+0000 7f6e4e600640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f6e480d0e90 0x7f6e480cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:06.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.910+0000 7f6e4e600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e480b2a10 con 0x7f6e48160930 2024-01-31T12:09:06.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.910+0000 7f6e4e600640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e480d38a0 con 0x7f6e480d0e90 2024-01-31T12:09:06.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.910+0000 7f6e4e600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e480d04d0 con 0x7f6e480b3eb0 2024-01-31T12:09:06.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.910+0000 7f6e47e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6e480b3eb0 0x7f6e480cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:06.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.910+0000 7f6e47e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6e480b3eb0 0x7f6e480cfdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41412/0 (socket says 172.21.15.49:41412) 2024-01-31T12:09:06.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.910+0000 7f6e47e00640 1 -- 172.21.15.49:0/3348808992 learned_addr learned my addr 172.21.15.49:0/3348808992 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:06.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.910+0000 7f6e4dc00640 1 --2- 172.21.15.49:0/3348808992 >> v2:172.21.15.49:3300/0 conn(0x7f6e480d0e90 0x7f6e480cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:06.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.910+0000 7f6e4dc00640 1 -- 172.21.15.49:0/3348808992 >> v2:172.21.15.195:3300/0 conn(0x7f6e480b3eb0 msgr2=0x7f6e480cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:06.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.910+0000 7f6e4dc00640 1 --2- 172.21.15.49:0/3348808992 >> v2:172.21.15.195:3300/0 conn(0x7f6e480b3eb0 0x7f6e480cfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:06.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.910+0000 7f6e4dc00640 1 -- 172.21.15.49:0/3348808992 >> v1:172.21.15.195:6789/0 conn(0x7f6e48160930 legacy=0x7f6e480cf6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-31T12:09:06.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.910+0000 7f6e4dc00640 1 -- 172.21.15.49:0/3348808992 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e480d3ab0 con 0x7f6e480d0e90 2024-01-31T12:09:06.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.914+0000 7f6e4dc00640 1 --2- 172.21.15.49:0/3348808992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e480d0e90 0x7f6e480cdbc0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f6e4808b970 tx=0x7f6e4001c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a00874709926ae server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:06.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.914+0000 7f6e47400640 1 -- 172.21.15.49:0/3348808992 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e400a57e0 con 0x7f6e480d0e90 2024-01-31T12:09:06.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.918+0000 7f6e47400640 1 -- 172.21.15.49:0/3348808992 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e400a5940 con 0x7f6e480d0e90 2024-01-31T12:09:06.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.918+0000 7f6e47400640 1 -- 172.21.15.49:0/3348808992 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e400a5cd0 con 0x7f6e480d0e90 2024-01-31T12:09:06.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.918+0000 7f6e4e600640 1 -- 172.21.15.49:0/3348808992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e480d0e90 msgr2=0x7f6e480cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:06.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.918+0000 7f6e4e600640 1 --2- 172.21.15.49:0/3348808992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e480d0e90 0x7f6e480cdbc0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f6e4808b970 tx=0x7f6e4001c810 comp rx=0 tx=0).stop 2024-01-31T12:09:06.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.918+0000 7f6e4e600640 1 -- 172.21.15.49:0/3348808992 shutdown_connections 2024-01-31T12:09:06.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.918+0000 7f6e4e600640 1 --2- 172.21.15.49:0/3348808992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e480d0e90 0x7f6e480cdbc0 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:06.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.918+0000 7f6e4e600640 1 --2- 172.21.15.49:0/3348808992 >> v2:172.21.15.195:3300/0 conn(0x7f6e480b3eb0 0x7f6e480cfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:06.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.918+0000 7f6e4e600640 1 -- 172.21.15.49:0/3348808992 >> 172.21.15.49:0/3348808992 conn(0x7f6e4809c3c0 msgr2=0x7f6e480d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:06.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.918+0000 7f6e4e600640 1 -- 172.21.15.49:0/3348808992 shutdown_connections 2024-01-31T12:09:06.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.918+0000 7f6e4e600640 1 -- 172.21.15.49:0/3348808992 wait complete. 2024-01-31T12:09:06.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.918+0000 7f6e4e600640 1 Processor -- start 2024-01-31T12:09:06.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.918+0000 7f6e4e600640 1 -- start start 2024-01-31T12:09:06.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.922+0000 7f6e4e600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e480b3eb0 0x7f6e480b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:06.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.922+0000 7f6e4e600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6e480d0e90 0x7f6e48155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:06.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.922+0000 7f6e4e600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6e48160930 0x7f6e48153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:06.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.922+0000 7f6e4e600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e480b7e70 con 0x7f6e480b3eb0 2024-01-31T12:09:06.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.922+0000 7f6e4e600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e480cc1e0 con 0x7f6e48160930 2024-01-31T12:09:06.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.922+0000 7f6e4e600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e480cc4c0 con 0x7f6e480d0e90 2024-01-31T12:09:06.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.922+0000 7f6e4dc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6e48160930 0x7f6e48153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:06.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.922+0000 7f6e4dc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6e48160930 0x7f6e48153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:41428/0 (socket says 172.21.15.49:41428) 2024-01-31T12:09:06.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.922+0000 7f6e4dc00640 1 -- 172.21.15.49:0/2368606781 learned_addr learned my addr 172.21.15.49:0/2368606781 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:06.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.922+0000 7f6e47e00640 1 --2- 172.21.15.49:0/2368606781 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6e480d0e90 0x7f6e48155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:06.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.922+0000 7f6e4d200640 1 --2- 172.21.15.49:0/2368606781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e480b3eb0 0x7f6e480b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:06.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.926+0000 7f6e4d200640 1 -- 172.21.15.49:0/2368606781 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6e480d0e90 msgr2=0x7f6e48155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:06.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.926+0000 7f6e4d200640 1 --2- 172.21.15.49:0/2368606781 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6e480d0e90 0x7f6e48155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:06.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.926+0000 7f6e4d200640 1 -- 172.21.15.49:0/2368606781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6e48160930 msgr2=0x7f6e48153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:06.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.926+0000 7f6e4d200640 1 --2- 172.21.15.49:0/2368606781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6e48160930 0x7f6e48153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:06.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.926+0000 7f6e4d200640 1 -- 172.21.15.49:0/2368606781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e40009a70 con 0x7f6e480b3eb0 2024-01-31T12:09:06.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.926+0000 7f6e4dc00640 1 --2- 172.21.15.49:0/2368606781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6e48160930 0x7f6e48153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T12:09:06.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.930+0000 7f6e4d200640 1 --2- 172.21.15.49:0/2368606781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e480b3eb0 0x7f6e480b7930 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000b3c0 tx=0x7f6e3000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:06.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.930+0000 7f6e44c00640 1 -- 172.21.15.49:0/2368606781 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30011830 con 0x7f6e480b3eb0 2024-01-31T12:09:06.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.930+0000 7f6e44c00640 1 -- 172.21.15.49:0/2368606781 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e300119b0 con 0x7f6e480b3eb0 2024-01-31T12:09:06.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.930+0000 7f6e44c00640 1 -- 172.21.15.49:0/2368606781 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30011d60 con 0x7f6e480b3eb0 2024-01-31T12:09:06.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.930+0000 7f6e4e600640 1 -- 172.21.15.49:0/2368606781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e480cc7a0 con 0x7f6e480b3eb0 2024-01-31T12:09:06.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.930+0000 7f6e4e600640 1 -- 172.21.15.49:0/2368606781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e480ccd60 con 0x7f6e480b3eb0 2024-01-31T12:09:06.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.938+0000 7f6e4e600640 1 -- 172.21.15.49:0/2368606781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e480ccf80 con 0x7f6e480b3eb0 2024-01-31T12:09:06.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.942+0000 7f6e44c00640 1 -- 172.21.15.49:0/2368606781 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f6e3001b460 con 0x7f6e480b3eb0 2024-01-31T12:09:06.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.954+0000 7f6e44c00640 1 --2- 172.21.15.49:0/2368606781 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6e20066550 0x7f6e20068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:06.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.954+0000 7f6e44c00640 1 -- 172.21.15.49:0/2368606781 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6e30084860 con 0x7f6e480b3eb0 2024-01-31T12:09:06.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.954+0000 7f6e47e00640 1 --2- 172.21.15.49:0/2368606781 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6e20066550 0x7f6e20068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:06.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.954+0000 7f6e47e00640 1 --2- 172.21.15.49:0/2368606781 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6e20066550 0x7f6e20068a10 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f6e48159fb0 tx=0x7f6e38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:06.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:06.970+0000 7f6e44c00640 1 -- 172.21.15.49:0/2368606781 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f6e300519f0 con 0x7f6e480b3eb0 2024-01-31T12:09:07.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:07.838+0000 7f6e4e600640 1 -- 172.21.15.49:0/2368606781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e48074860 con 0x7f6e480b3eb0 2024-01-31T12:09:07.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:07.898+0000 7f6e44c00640 1 -- 172.21.15.49:0/2368606781 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16800 (secure 0 0 0) 0x7f6e30055010 con 0x7f6e480b3eb0 2024-01-31T12:09:07.905 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:09:07.905 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":41,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:05:59.292973+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:05:49.820131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-31T05:05:50.922571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1c","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T12:09:07.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:07.906+0000 7f6e4e600640 1 -- 172.21.15.49:0/2368606781 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6e20066550 msgr2=0x7f6e20068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:07.906+0000 7f6e4e600640 1 --2- 172.21.15.49:0/2368606781 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6e20066550 0x7f6e20068a10 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f6e48159fb0 tx=0x7f6e38008040 comp rx=0 tx=0).stop 2024-01-31T12:09:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:07.906+0000 7f6e4e600640 1 -- 172.21.15.49:0/2368606781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e480b3eb0 msgr2=0x7f6e480b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:07.906+0000 7f6e4e600640 1 --2- 172.21.15.49:0/2368606781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e480b3eb0 0x7f6e480b7930 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000b3c0 tx=0x7f6e3000b880 comp rx=0 tx=0).stop 2024-01-31T12:09:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:07.910+0000 7f6e4e600640 1 -- 172.21.15.49:0/2368606781 shutdown_connections 2024-01-31T12:09:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:07.910+0000 7f6e4e600640 1 --2- 172.21.15.49:0/2368606781 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6e20066550 0x7f6e20068a10 secure :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f6e48159fb0 tx=0x7f6e38008040 comp rx=0 tx=0).stop 2024-01-31T12:09:07.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:07.910+0000 7f6e4e600640 1 --2- 172.21.15.49:0/2368606781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6e48160930 0x7f6e48153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:07.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:07.910+0000 7f6e4e600640 1 --2- 172.21.15.49:0/2368606781 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6e480d0e90 0x7f6e48155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:07.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:07.910+0000 7f6e4e600640 1 --2- 172.21.15.49:0/2368606781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e480b3eb0 0x7f6e480b7930 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:07.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:07.910+0000 7f6e4e600640 1 -- 172.21.15.49:0/2368606781 >> 172.21.15.49:0/2368606781 conn(0x7f6e4809c3c0 msgr2=0x7f6e4806b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:07.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:07.910+0000 7f6e4e600640 1 -- 172.21.15.49:0/2368606781 shutdown_connections 2024-01-31T12:09:07.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:07.910+0000 7f6e4e600640 1 -- 172.21.15.49:0/2368606781 wait complete. 2024-01-31T12:09:07.968 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-31T12:09:07.968 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T12:09:08.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.570+0000 7fd96e600640 1 Processor -- start 2024-01-31T12:09:08.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.570+0000 7fd96e600640 1 -- start start 2024-01-31T12:09:08.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.578+0000 7fd96e600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9680b21a0 0x7fd968070280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:08.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.578+0000 7fd96e600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd9680b3090 0x7fd9680707c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:08.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.578+0000 7fd96d200640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fd96814af80 0x7fd96806d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:48372/0 (socket says 172.21.15.49:48372) 2024-01-31T12:09:08.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.578+0000 7fd96d200640 1 -- 172.21.15.49:0/2673611610 learned_addr learned my addr 172.21.15.49:0/2673611610 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:09:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.582+0000 7fd96e600640 1 -- 172.21.15.49:0/2673611610 --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96806cf60 con 0x7fd96814af80 2024-01-31T12:09:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.582+0000 7fd967e00640 1 --2- 172.21.15.49:0/2673611610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9680b21a0 0x7fd968070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.582+0000 7fd96e600640 1 -- 172.21.15.49:0/2673611610 --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96814b360 con 0x7fd9680b3090 2024-01-31T12:09:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.582+0000 7fd96e600640 1 -- 172.21.15.49:0/2673611610 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96806c350 con 0x7fd9680b21a0 2024-01-31T12:09:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.582+0000 7fd96dc00640 1 --2- 172.21.15.49:0/2673611610 >> v2:172.21.15.195:3300/0 conn(0x7fd9680b3090 0x7fd9680707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.582+0000 7fd96dc00640 1 -- 172.21.15.49:0/2673611610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9680b21a0 msgr2=0x7fd968070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.582+0000 7fd96dc00640 1 --2- 172.21.15.49:0/2673611610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9680b21a0 0x7fd968070280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.582+0000 7fd96dc00640 1 -- 172.21.15.49:0/2673611610 >> v1:172.21.15.49:6789/0 conn(0x7fd96814af80 legacy=0x7fd96806d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.582+0000 7fd96dc00640 1 -- 172.21.15.49:0/2673611610 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96806c630 con 0x7fd9680b3090 2024-01-31T12:09:08.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.594+0000 7fd96dc00640 1 --2- 172.21.15.49:0/2673611610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9680b3090 0x7fd9680707c0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fd9580097c0 tx=0x7fd95801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3d6a39f71c943fa server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:08.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.598+0000 7fd967400640 1 -- 172.21.15.49:0/2673611610 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9580ab650 con 0x7fd9680b3090 2024-01-31T12:09:08.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.598+0000 7fd967400640 1 -- 172.21.15.49:0/2673611610 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9580ab7b0 con 0x7fd9680b3090 2024-01-31T12:09:08.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.598+0000 7fd967400640 1 -- 172.21.15.49:0/2673611610 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9580abb40 con 0x7fd9680b3090 2024-01-31T12:09:08.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.598+0000 7fd96e600640 1 -- 172.21.15.49:0/2673611610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9680b3090 msgr2=0x7fd9680707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:08.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.598+0000 7fd96e600640 1 --2- 172.21.15.49:0/2673611610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9680b3090 0x7fd9680707c0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fd9580097c0 tx=0x7fd95801c450 comp rx=0 tx=0).stop 2024-01-31T12:09:08.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.598+0000 7fd96e600640 1 -- 172.21.15.49:0/2673611610 shutdown_connections 2024-01-31T12:09:08.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.598+0000 7fd96e600640 1 --2- 172.21.15.49:0/2673611610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9680b3090 0x7fd9680707c0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:08.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.598+0000 7fd96e600640 1 --2- 172.21.15.49:0/2673611610 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9680b21a0 0x7fd968070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:08.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.598+0000 7fd96e600640 1 -- 172.21.15.49:0/2673611610 >> 172.21.15.49:0/2673611610 conn(0x7fd9680b0890 msgr2=0x7fd9680b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:08.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.602+0000 7fd96e600640 1 -- 172.21.15.49:0/2673611610 shutdown_connections 2024-01-31T12:09:08.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.602+0000 7fd96e600640 1 -- 172.21.15.49:0/2673611610 wait complete. 2024-01-31T12:09:08.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.602+0000 7fd96e600640 1 Processor -- start 2024-01-31T12:09:08.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.602+0000 7fd96e600640 1 -- start start 2024-01-31T12:09:08.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd96e600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9680b21a0 0x7fd96815ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:08.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd96e600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9680b3090 0x7fd968142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:08.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd96e600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd96814af80 0x7fd968143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:08.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd96e600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd968160560 con 0x7fd9680b21a0 2024-01-31T12:09:08.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd96e600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd968160130 con 0x7fd96814af80 2024-01-31T12:09:08.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd96e600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96815f520 con 0x7fd9680b3090 2024-01-31T12:09:08.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd96dc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd96814af80 0x7fd968143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:08.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd96dc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd96814af80 0x7fd968143140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:56526/0 (socket says 172.21.15.49:56526) 2024-01-31T12:09:08.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd96dc00640 1 -- 172.21.15.49:0/901850824 learned_addr learned my addr 172.21.15.49:0/901850824 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:08.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd96d200640 1 --2- 172.21.15.49:0/901850824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9680b21a0 0x7fd96815ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:08.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd96dc00640 1 -- 172.21.15.49:0/901850824 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9680b3090 msgr2=0x7fd968142c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-31T12:09:08.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd96dc00640 1 --2- 172.21.15.49:0/901850824 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9680b3090 0x7fd968142c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:08.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd96dc00640 1 -- 172.21.15.49:0/901850824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9680b21a0 msgr2=0x7fd96815ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:08.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd96dc00640 1 --2- 172.21.15.49:0/901850824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9680b21a0 0x7fd96815ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:08.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd96dc00640 1 -- 172.21.15.49:0/901850824 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd958009420 con 0x7fd96814af80 2024-01-31T12:09:08.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd96dc00640 1 --2- 172.21.15.49:0/901850824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd96814af80 0x7fd968143140 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fd9580ad040 tx=0x7fd95801ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:08.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd964c00640 1 -- 172.21.15.49:0/901850824 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9580bf610 con 0x7fd96814af80 2024-01-31T12:09:08.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd964c00640 1 -- 172.21.15.49:0/901850824 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9580bf770 con 0x7fd96814af80 2024-01-31T12:09:08.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd96e600640 1 -- 172.21.15.49:0/901850824 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96815f800 con 0x7fd96814af80 2024-01-31T12:09:08.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.606+0000 7fd964c00640 1 -- 172.21.15.49:0/901850824 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9580bfae0 con 0x7fd96814af80 2024-01-31T12:09:08.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.610+0000 7fd96e600640 1 -- 172.21.15.49:0/901850824 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96815fdc0 con 0x7fd96814af80 2024-01-31T12:09:08.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.610+0000 7fd96e600640 1 -- 172.21.15.49:0/901850824 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd968071310 con 0x7fd96814af80 2024-01-31T12:09:08.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.614+0000 7fd964c00640 1 -- 172.21.15.49:0/901850824 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fd9580bfc40 con 0x7fd96814af80 2024-01-31T12:09:08.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.618+0000 7fd964c00640 1 --2- 172.21.15.49:0/901850824 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd940066550 0x7fd940068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:08.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.618+0000 7fd964c00640 1 -- 172.21.15.49:0/901850824 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd95811f2d0 con 0x7fd96814af80 2024-01-31T12:09:08.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.618+0000 7fd964c00640 1 -- 172.21.15.49:0/901850824 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fd9580ec6e0 con 0x7fd96814af80 2024-01-31T12:09:08.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.618+0000 7fd96d200640 1 --2- 172.21.15.49:0/901850824 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd940066550 0x7fd940068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:08.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.622+0000 7fd96d200640 1 --2- 172.21.15.49:0/901850824 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd940066550 0x7fd940068a10 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd960005c10 tx=0x7fd960009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:08.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.946+0000 7fd96e600640 1 -- 172.21.15.49:0/901850824 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd968074860 con 0x7fd96814af80 2024-01-31T12:09:08.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.946+0000 7fd964c00640 1 -- 172.21.15.49:0/901850824 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fd9580efcc0 con 0x7fd96814af80 2024-01-31T12:09:08.955 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:09:08.955 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5078,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3747440713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3747440713},{"type":"v1","addr":"172.21.15.195:6837","nonce":3747440713}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2835620509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2835620509},{"type":"v1","addr":"172.21.15.195:6836","nonce":2835620509}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2080191803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2080191803},{"type":"v1","addr":"172.21.15.49:6833","nonce":2080191803}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-31T05:05:51.919747+0000","modified":"2024-01-31T05:05:54.941384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5493":{"gid":5493,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6835/4235056900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4235056900},{"type":"v1","addr":"172.21.15.49:6835","nonce":4235056900}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-31T12:09:08.955 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 19 2024-01-31T12:09:08.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.958+0000 7fd96e600640 1 -- 172.21.15.49:0/901850824 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd940066550 msgr2=0x7fd940068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:08.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.958+0000 7fd96e600640 1 --2- 172.21.15.49:0/901850824 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd940066550 0x7fd940068a10 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd960005c10 tx=0x7fd960009040 comp rx=0 tx=0).stop 2024-01-31T12:09:08.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.958+0000 7fd96e600640 1 -- 172.21.15.49:0/901850824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd96814af80 msgr2=0x7fd968143140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:08.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.958+0000 7fd96e600640 1 --2- 172.21.15.49:0/901850824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd96814af80 0x7fd968143140 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fd9580ad040 tx=0x7fd95801ac90 comp rx=0 tx=0).stop 2024-01-31T12:09:08.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.958+0000 7fd96e600640 1 -- 172.21.15.49:0/901850824 shutdown_connections 2024-01-31T12:09:08.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.958+0000 7fd96e600640 1 --2- 172.21.15.49:0/901850824 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fd940066550 0x7fd940068a10 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:08.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.958+0000 7fd96e600640 1 --2- 172.21.15.49:0/901850824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd96814af80 0x7fd968143140 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:08.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.958+0000 7fd96e600640 1 --2- 172.21.15.49:0/901850824 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9680b3090 0x7fd968142c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:08.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.958+0000 7fd96e600640 1 --2- 172.21.15.49:0/901850824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9680b21a0 0x7fd96815ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:08.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.958+0000 7fd96e600640 1 -- 172.21.15.49:0/901850824 >> 172.21.15.49:0/901850824 conn(0x7fd9680b0890 msgr2=0x7fd9680af570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:08.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.962+0000 7fd96e600640 1 -- 172.21.15.49:0/901850824 shutdown_connections 2024-01-31T12:09:08.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:08.962+0000 7fd96e600640 1 -- 172.21.15.49:0/901850824 wait complete. 2024-01-31T12:09:09.042 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T12:09:09.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.594+0000 7ff3ed200640 1 Processor -- start 2024-01-31T12:09:09.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.598+0000 7ff3ed200640 1 -- start start 2024-01-31T12:09:09.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.602+0000 7ff3ed200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff3e8160930 0x7ff3e80cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:09.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.602+0000 7ff3ed200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e80d0e90 0x7ff3e80cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:09.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.602+0000 7ff3ed200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7ff3e80b2ea0 0x7ff3e80b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:09.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.602+0000 7ff3ed200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e80d38a0 con 0x7ff3e80b2ea0 2024-01-31T12:09:09.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.602+0000 7ff3ed200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e80b2a10 con 0x7ff3e8160930 2024-01-31T12:09:09.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.602+0000 7ff3ed200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e80d04d0 con 0x7ff3e80d0e90 2024-01-31T12:09:09.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.602+0000 7ff3e7400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff3e8160930 0x7ff3e80cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:09.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.606+0000 7ff3e7400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff3e8160930 0x7ff3e80cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:56540/0 (socket says 172.21.15.49:56540) 2024-01-31T12:09:09.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.606+0000 7ff3e7400640 1 -- 172.21.15.49:0/1797092730 learned_addr learned my addr 172.21.15.49:0/1797092730 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:09.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.606+0000 7ff3e7e00640 1 --2- 172.21.15.49:0/1797092730 >> v2:172.21.15.49:3300/0 conn(0x7ff3e80b2ea0 0x7ff3e80b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:09.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.610+0000 7ff3e7400640 1 -- 172.21.15.49:0/1797092730 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e80d0e90 msgr2=0x7ff3e80cfc00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-31T12:09:09.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.610+0000 7ff3e7400640 1 --2- 172.21.15.49:0/1797092730 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e80d0e90 0x7ff3e80cfc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:09.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.610+0000 7ff3e7400640 1 -- 172.21.15.49:0/1797092730 >> v2:172.21.15.49:3300/0 conn(0x7ff3e80b2ea0 msgr2=0x7ff3e80b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:09.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.610+0000 7ff3e7400640 1 --2- 172.21.15.49:0/1797092730 >> v2:172.21.15.49:3300/0 conn(0x7ff3e80b2ea0 0x7ff3e80b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:09.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.610+0000 7ff3e7400640 1 -- 172.21.15.49:0/1797092730 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e80d3ab0 con 0x7ff3e8160930 2024-01-31T12:09:09.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.626+0000 7ff3e7400640 1 --2- 172.21.15.49:0/1797092730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e8160930 0x7ff3e80cf6c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7ff3e808d490 tx=0x7ff3e001c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1672d89fc20cd6ee server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:09.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.626+0000 7ff3e6000640 1 -- 172.21.15.49:0/1797092730 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e00a5780 con 0x7ff3e8160930 2024-01-31T12:09:09.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.626+0000 7ff3e6000640 1 -- 172.21.15.49:0/1797092730 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e00a58e0 con 0x7ff3e8160930 2024-01-31T12:09:09.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.626+0000 7ff3e6000640 1 -- 172.21.15.49:0/1797092730 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e00a5c70 con 0x7ff3e8160930 2024-01-31T12:09:09.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.626+0000 7ff3ed200640 1 -- 172.21.15.49:0/1797092730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e8160930 msgr2=0x7ff3e80cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:09.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.626+0000 7ff3ed200640 1 --2- 172.21.15.49:0/1797092730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e8160930 0x7ff3e80cf6c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7ff3e808d490 tx=0x7ff3e001c9f0 comp rx=0 tx=0).stop 2024-01-31T12:09:09.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.626+0000 7ff3ed200640 1 -- 172.21.15.49:0/1797092730 shutdown_connections 2024-01-31T12:09:09.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.626+0000 7ff3ed200640 1 --2- 172.21.15.49:0/1797092730 >> v2:172.21.15.49:3300/0 conn(0x7ff3e80b2ea0 0x7ff3e80b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:09.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.626+0000 7ff3ed200640 1 --2- 172.21.15.49:0/1797092730 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e80d0e90 0x7ff3e80cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:09.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.626+0000 7ff3ed200640 1 --2- 172.21.15.49:0/1797092730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e8160930 0x7ff3e80cf6c0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:09.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.626+0000 7ff3ed200640 1 -- 172.21.15.49:0/1797092730 >> 172.21.15.49:0/1797092730 conn(0x7ff3e809c3c0 msgr2=0x7ff3e80d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:09.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.630+0000 7ff3ed200640 1 -- 172.21.15.49:0/1797092730 shutdown_connections 2024-01-31T12:09:09.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.630+0000 7ff3ed200640 1 -- 172.21.15.49:0/1797092730 wait complete. 2024-01-31T12:09:09.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.630+0000 7ff3ed200640 1 Processor -- start 2024-01-31T12:09:09.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.634+0000 7ff3ed200640 1 -- start start 2024-01-31T12:09:09.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.638+0000 7ff3ed200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3e80b2ea0 0x7ff3e815bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:09.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.638+0000 7ff3ed200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e80d0e90 0x7ff3e814b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:09.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.642+0000 7ff3e6a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e80d0e90 0x7ff3e814b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:09.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.642+0000 7ff3e6a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e80d0e90 0x7ff3e814b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:56548/0 (socket says 172.21.15.49:56548) 2024-01-31T12:09:09.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.642+0000 7ff3e7400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3e80b2ea0 0x7ff3e815bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:09.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.642+0000 7ff3e7400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3e80b2ea0 0x7ff3e815bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58824/0 (socket says 172.21.15.49:58824) 2024-01-31T12:09:09.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.642+0000 7ff3ed200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e8160930 0x7ff3e806c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:09.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.642+0000 7ff3e6a00640 1 -- 172.21.15.49:0/2456903317 learned_addr learned my addr 172.21.15.49:0/2456903317 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:09.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.642+0000 7ff3ed200640 1 -- 172.21.15.49:0/2456903317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e814c740 con 0x7ff3e80b2ea0 2024-01-31T12:09:09.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.642+0000 7ff3ed200640 1 -- 172.21.15.49:0/2456903317 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e80afcb0 con 0x7ff3e80d0e90 2024-01-31T12:09:09.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.642+0000 7ff3ed200640 1 -- 172.21.15.49:0/2456903317 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e814c930 con 0x7ff3e8160930 2024-01-31T12:09:09.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.642+0000 7ff3e7e00640 1 --2- 172.21.15.49:0/2456903317 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e8160930 0x7ff3e806c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:09.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.642+0000 7ff3e7e00640 1 -- 172.21.15.49:0/2456903317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e80d0e90 msgr2=0x7ff3e814b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.642+0000 7ff3e7e00640 1 --2- 172.21.15.49:0/2456903317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e80d0e90 0x7ff3e814b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.642+0000 7ff3e7e00640 1 -- 172.21.15.49:0/2456903317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3e80b2ea0 msgr2=0x7ff3e815bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.642+0000 7ff3e7e00640 1 --2- 172.21.15.49:0/2456903317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3e80b2ea0 0x7ff3e815bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:09.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.642+0000 7ff3e7e00640 1 -- 172.21.15.49:0/2456903317 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e0009b30 con 0x7ff3e8160930 2024-01-31T12:09:09.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.646+0000 7ff3e7e00640 1 --2- 172.21.15.49:0/2456903317 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e8160930 0x7ff3e806c180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000e800 tx=0x7ff3d000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:09.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.646+0000 7ff3e6a00640 1 --2- 172.21.15.49:0/2456903317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e80d0e90 0x7ff3e814b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T12:09:09.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.650+0000 7ff3df400640 1 -- 172.21.15.49:0/2456903317 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d000c940 con 0x7ff3e8160930 2024-01-31T12:09:09.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.650+0000 7ff3df400640 1 -- 172.21.15.49:0/2456903317 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d000caa0 con 0x7ff3e8160930 2024-01-31T12:09:09.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.650+0000 7ff3df400640 1 -- 172.21.15.49:0/2456903317 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d000ce30 con 0x7ff3e8160930 2024-01-31T12:09:09.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.650+0000 7ff3ed200640 1 -- 172.21.15.49:0/2456903317 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e814cc10 con 0x7ff3e8160930 2024-01-31T12:09:09.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.650+0000 7ff3ed200640 1 -- 172.21.15.49:0/2456903317 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e80aff00 con 0x7ff3e8160930 2024-01-31T12:09:09.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.650+0000 7ff3ed200640 1 -- 172.21.15.49:0/2456903317 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e80b0120 con 0x7ff3e8160930 2024-01-31T12:09:09.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.658+0000 7ff3df400640 1 -- 172.21.15.49:0/2456903317 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff3d0004020 con 0x7ff3e8160930 2024-01-31T12:09:09.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.662+0000 7ff3df400640 1 --2- 172.21.15.49:0/2456903317 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff3c0066500 0x7ff3c00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:09.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.662+0000 7ff3df400640 1 -- 172.21.15.49:0/2456903317 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff3d00843e0 con 0x7ff3e8160930 2024-01-31T12:09:09.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.662+0000 7ff3e7400640 1 --2- 172.21.15.49:0/2456903317 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff3c0066500 0x7ff3c00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:09.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.662+0000 7ff3df400640 1 -- 172.21.15.49:0/2456903317 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff3d00550d0 con 0x7ff3e8160930 2024-01-31T12:09:09.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:09.666+0000 7ff3e7400640 1 --2- 172.21.15.49:0/2456903317 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff3c0066500 0x7ff3c00689c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00ae000 tx=0x7ff3e00a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:10.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:10.658+0000 7ff3ed200640 1 -- 172.21.15.49:0/2456903317 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3e8074860 con 0x7ff3e8160930 2024-01-31T12:09:10.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:10.662+0000 7ff3df400640 1 -- 172.21.15.49:0/2456903317 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4944 (secure 0 0 0) 0x7ff3d0054c60 con 0x7ff3e8160930 2024-01-31T12:09:10.671 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:09:10.672 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5078,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3747440713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3747440713},{"type":"v1","addr":"172.21.15.195:6837","nonce":3747440713}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2835620509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2835620509},{"type":"v1","addr":"172.21.15.195:6836","nonce":2835620509}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2080191803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2080191803},{"type":"v1","addr":"172.21.15.49:6833","nonce":2080191803}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-31T05:05:51.919747+0000","modified":"2024-01-31T05:05:54.941384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5493":{"gid":5493,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.49:6835/4235056900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4235056900},{"type":"v1","addr":"172.21.15.49:6835","nonce":4235056900}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-31T12:09:10.672 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 19 2024-01-31T12:09:10.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:10.670+0000 7ff3ed200640 1 -- 172.21.15.49:0/2456903317 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff3c0066500 msgr2=0x7ff3c00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:10.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:10.670+0000 7ff3ed200640 1 --2- 172.21.15.49:0/2456903317 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff3c0066500 0x7ff3c00689c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00ae000 tx=0x7ff3e00a7070 comp rx=0 tx=0).stop 2024-01-31T12:09:10.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:10.670+0000 7ff3ed200640 1 -- 172.21.15.49:0/2456903317 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e8160930 msgr2=0x7ff3e806c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:10.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:10.670+0000 7ff3ed200640 1 --2- 172.21.15.49:0/2456903317 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e8160930 0x7ff3e806c180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000e800 tx=0x7ff3d000ecc0 comp rx=0 tx=0).stop 2024-01-31T12:09:10.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:10.670+0000 7ff3ed200640 1 -- 172.21.15.49:0/2456903317 shutdown_connections 2024-01-31T12:09:10.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:10.670+0000 7ff3ed200640 1 --2- 172.21.15.49:0/2456903317 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3e8160930 0x7ff3e806c180 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:10.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:10.670+0000 7ff3ed200640 1 --2- 172.21.15.49:0/2456903317 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff3c0066500 0x7ff3c00689c0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:10.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:10.670+0000 7ff3ed200640 1 --2- 172.21.15.49:0/2456903317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3e80d0e90 0x7ff3e814b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:10.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:10.670+0000 7ff3ed200640 1 --2- 172.21.15.49:0/2456903317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3e80b2ea0 0x7ff3e815bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:10.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:10.670+0000 7ff3ed200640 1 -- 172.21.15.49:0/2456903317 >> 172.21.15.49:0/2456903317 conn(0x7ff3e809c3c0 msgr2=0x7ff3e8156ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:10.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:10.670+0000 7ff3ed200640 1 -- 172.21.15.49:0/2456903317 shutdown_connections 2024-01-31T12:09:10.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:10.670+0000 7ff3ed200640 1 -- 172.21.15.49:0/2456903317 wait complete. 2024-01-31T12:09:10.748 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T12:09:11.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.350+0000 7f7de9200640 1 Processor -- start 2024-01-31T12:09:11.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.354+0000 7f7de9200640 1 -- start start 2024-01-31T12:09:11.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.358+0000 7f7de9200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7de41590d0 0x7f7de40b5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:11.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.358+0000 7f7de9200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7de40d09e0 0x7f7de40726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:11.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.358+0000 7f7de9200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de406ad80 con 0x7f7de41594b0 2024-01-31T12:09:11.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.358+0000 7f7de9200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de4072c20 con 0x7f7de40d09e0 2024-01-31T12:09:11.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.358+0000 7f7de9200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de406aaa0 con 0x7f7de41590d0 2024-01-31T12:09:11.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.358+0000 7f7de3200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7de40d09e0 0x7f7de40726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:11.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.358+0000 7f7de1400640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f7de41594b0 0x7f7de40d02d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:40094/0 (socket says 172.21.15.49:40094) 2024-01-31T12:09:11.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.362+0000 7f7de1400640 1 -- 172.21.15.49:0/3537823065 learned_addr learned my addr 172.21.15.49:0/3537823065 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:09:11.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.362+0000 7f7de3200640 1 -- 172.21.15.49:0/3537823065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7de41590d0 msgr2=0x7f7de40b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:11.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.362+0000 7f7de1e00640 1 --2- 172.21.15.49:0/3537823065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7de41590d0 0x7f7de40b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:11.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.362+0000 7f7de0a00640 1 -- 172.21.15.49:0/3537823065 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732418280 0 0) 0x7f7de406ad80 con 0x7f7de41594b0 2024-01-31T12:09:11.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.362+0000 7f7de3200640 1 --2- 172.21.15.49:0/3537823065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7de41590d0 0x7f7de40b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:11.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.362+0000 7f7de3200640 1 -- 172.21.15.49:0/3537823065 >> v1:172.21.15.195:6789/0 conn(0x7f7de41594b0 legacy=0x7f7de40d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:11.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.362+0000 7f7de3200640 1 -- 172.21.15.49:0/3537823065 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de406b220 con 0x7f7de40d09e0 2024-01-31T12:09:11.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.362+0000 7f7de1e00640 1 --2- 172.21.15.49:0/3537823065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7de41590d0 0x7f7de40b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T12:09:11.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.378+0000 7f7de3200640 1 --2- 172.21.15.49:0/3537823065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7de40d09e0 0x7f7de40726e0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc0095f0 tx=0x7f7ddc01cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f41ca05736700de server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:11.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.378+0000 7f7de0a00640 1 -- 172.21.15.49:0/3537823065 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc0a5a50 con 0x7f7de40d09e0 2024-01-31T12:09:11.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.378+0000 7f7de0a00640 1 -- 172.21.15.49:0/3537823065 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ddc0a5bb0 con 0x7f7de40d09e0 2024-01-31T12:09:11.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.378+0000 7f7de0a00640 1 -- 172.21.15.49:0/3537823065 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc0ad440 con 0x7f7de40d09e0 2024-01-31T12:09:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.382+0000 7f7de9200640 1 -- 172.21.15.49:0/3537823065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7de40d09e0 msgr2=0x7f7de40726e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.382+0000 7f7de9200640 1 --2- 172.21.15.49:0/3537823065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7de40d09e0 0x7f7de40726e0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc0095f0 tx=0x7f7ddc01cad0 comp rx=0 tx=0).stop 2024-01-31T12:09:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.382+0000 7f7de9200640 1 -- 172.21.15.49:0/3537823065 shutdown_connections 2024-01-31T12:09:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.382+0000 7f7de9200640 1 --2- 172.21.15.49:0/3537823065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7de40d09e0 0x7f7de40726e0 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.382+0000 7f7de9200640 1 --2- 172.21.15.49:0/3537823065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7de41590d0 0x7f7de40b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.382+0000 7f7de9200640 1 -- 172.21.15.49:0/3537823065 >> 172.21.15.49:0/3537823065 conn(0x7f7de40b2350 msgr2=0x7f7de40b2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:11.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.386+0000 7f7de9200640 1 -- 172.21.15.49:0/3537823065 shutdown_connections 2024-01-31T12:09:11.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.386+0000 7f7de9200640 1 -- 172.21.15.49:0/3537823065 wait complete. 2024-01-31T12:09:11.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.398+0000 7f7de9200640 1 Processor -- start 2024-01-31T12:09:11.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.398+0000 7f7de9200640 1 -- start start 2024-01-31T12:09:11.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.402+0000 7f7de9200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7de40d09e0 0x7f7de414c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:11.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.402+0000 7f7de9200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7de41590d0 0x7f7de41fa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:11.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.402+0000 7f7de9200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7de41594b0 0x7f7de415a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:11.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.402+0000 7f7de9200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de414d160 con 0x7f7de41594b0 2024-01-31T12:09:11.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.402+0000 7f7de9200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de414d440 con 0x7f7de40d09e0 2024-01-31T12:09:11.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.402+0000 7f7de9200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de414d720 con 0x7f7de41590d0 2024-01-31T12:09:11.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.402+0000 7f7de3200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7de41594b0 0x7f7de415a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:11.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.402+0000 7f7de3200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7de41594b0 0x7f7de415a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58846/0 (socket says 172.21.15.49:58846) 2024-01-31T12:09:11.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.402+0000 7f7de3200640 1 -- 172.21.15.49:0/3407383183 learned_addr learned my addr 172.21.15.49:0/3407383183 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:11.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.402+0000 7f7de1400640 1 --2- 172.21.15.49:0/3407383183 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7de41590d0 0x7f7de41fa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:11.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.402+0000 7f7de1e00640 1 --2- 172.21.15.49:0/3407383183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7de40d09e0 0x7f7de414c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:11.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.406+0000 7f7de3200640 1 -- 172.21.15.49:0/3407383183 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7de41590d0 msgr2=0x7f7de41fa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:11.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.406+0000 7f7de3200640 1 --2- 172.21.15.49:0/3407383183 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7de41590d0 0x7f7de41fa5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:11.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.406+0000 7f7de3200640 1 -- 172.21.15.49:0/3407383183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7de40d09e0 msgr2=0x7f7de414c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:11.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.406+0000 7f7de3200640 1 --2- 172.21.15.49:0/3407383183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7de40d09e0 0x7f7de414c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:11.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.406+0000 7f7de3200640 1 -- 172.21.15.49:0/3407383183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc00c300 con 0x7f7de41594b0 2024-01-31T12:09:11.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.406+0000 7f7de1e00640 1 --2- 172.21.15.49:0/3407383183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7de40d09e0 0x7f7de414c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T12:09:11.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.406+0000 7f7de3200640 1 --2- 172.21.15.49:0/3407383183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7de41594b0 0x7f7de415a270 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc0b0040 tx=0x7f7ddc019870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:11.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.406+0000 7f7dda000640 1 -- 172.21.15.49:0/3407383183 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc0be070 con 0x7f7de41594b0 2024-01-31T12:09:11.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.406+0000 7f7de9200640 1 -- 172.21.15.49:0/3407383183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de414da00 con 0x7f7de41594b0 2024-01-31T12:09:11.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.406+0000 7f7de9200640 1 -- 172.21.15.49:0/3407383183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de414cd40 con 0x7f7de41594b0 2024-01-31T12:09:11.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.406+0000 7f7dda000640 1 -- 172.21.15.49:0/3407383183 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ddc0a5910 con 0x7f7de41594b0 2024-01-31T12:09:11.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.406+0000 7f7dda000640 1 -- 172.21.15.49:0/3407383183 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc0aee70 con 0x7f7de41594b0 2024-01-31T12:09:11.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.410+0000 7f7de9200640 1 -- 172.21.15.49:0/3407383183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de414df20 con 0x7f7de41594b0 2024-01-31T12:09:11.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.418+0000 7f7dda000640 1 -- 172.21.15.49:0/3407383183 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f7ddc0b4040 con 0x7f7de41594b0 2024-01-31T12:09:11.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.422+0000 7f7dda000640 1 --2- 172.21.15.49:0/3407383183 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7dbc066500 0x7f7dbc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:11.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.422+0000 7f7dda000640 1 -- 172.21.15.49:0/3407383183 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7ddc11ef90 con 0x7f7de41594b0 2024-01-31T12:09:11.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.422+0000 7f7de1e00640 1 --2- 172.21.15.49:0/3407383183 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7dbc066500 0x7f7dbc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:11.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.426+0000 7f7dda000640 1 -- 172.21.15.49:0/3407383183 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f7ddc11f3d0 con 0x7f7de41594b0 2024-01-31T12:09:11.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:11.426+0000 7f7de1e00640 1 --2- 172.21.15.49:0/3407383183 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7dbc066500 0x7f7dbc0689c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400af30 tx=0x7f7dd4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:12.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.286+0000 7f7de9200640 1 -- 172.21.15.49:0/3407383183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7de414df20 con 0x7f7de41594b0 2024-01-31T12:09:12.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.294+0000 7f7dda000640 1 -- 172.21.15.49:0/3407383183 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16800 (secure 0 0 0) 0x7f7de414df20 con 0x7f7de41594b0 2024-01-31T12:09:12.299 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:09:12.299 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":41,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T05:05:59.292973+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:05:49.820131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-31T05:05:50.922571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1c","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T12:09:12.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.298+0000 7f7de9200640 1 -- 172.21.15.49:0/3407383183 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7dbc066500 msgr2=0x7f7dbc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:12.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.298+0000 7f7de9200640 1 --2- 172.21.15.49:0/3407383183 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7dbc066500 0x7f7dbc0689c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400af30 tx=0x7f7dd4008040 comp rx=0 tx=0).stop 2024-01-31T12:09:12.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.298+0000 7f7de9200640 1 -- 172.21.15.49:0/3407383183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7de41594b0 msgr2=0x7f7de415a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:12.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.298+0000 7f7de9200640 1 --2- 172.21.15.49:0/3407383183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7de41594b0 0x7f7de415a270 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc0b0040 tx=0x7f7ddc019870 comp rx=0 tx=0).stop 2024-01-31T12:09:12.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.298+0000 7f7de9200640 1 -- 172.21.15.49:0/3407383183 shutdown_connections 2024-01-31T12:09:12.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.298+0000 7f7de9200640 1 --2- 172.21.15.49:0/3407383183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7de41594b0 0x7f7de415a270 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:12.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.298+0000 7f7de9200640 1 --2- 172.21.15.49:0/3407383183 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7de41590d0 0x7f7de41fa5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:12.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.298+0000 7f7de9200640 1 --2- 172.21.15.49:0/3407383183 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7dbc066500 0x7f7dbc0689c0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:12.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.298+0000 7f7de9200640 1 --2- 172.21.15.49:0/3407383183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7de40d09e0 0x7f7de414c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:12.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.298+0000 7f7de9200640 1 -- 172.21.15.49:0/3407383183 >> 172.21.15.49:0/3407383183 conn(0x7f7de40b2350 msgr2=0x7f7de406de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:12.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.298+0000 7f7de9200640 1 -- 172.21.15.49:0/3407383183 shutdown_connections 2024-01-31T12:09:12.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.298+0000 7f7de9200640 1 -- 172.21.15.49:0/3407383183 wait complete. 2024-01-31T12:09:12.374 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-31T12:09:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.666+0000 7fb3df800640 1 Processor -- start 2024-01-31T12:09:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.666+0000 7fb3df800640 1 -- start start 2024-01-31T12:09:12.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.670+0000 7fb3df800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb3d806dab0 0x7fb3d815e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:12.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.670+0000 7fb3df800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb3d80b2ea0 0x7fb3d80b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:12.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.670+0000 7fb3df800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d80b3320 con 0x7fb3d80703c0 2024-01-31T12:09:12.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.670+0000 7fb3df800640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d80b3c30 con 0x7fb3d80b2ea0 2024-01-31T12:09:12.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.670+0000 7fb3df800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d80b3eb0 con 0x7fb3d806dab0 2024-01-31T12:09:12.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.670+0000 7fb3dce00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb3d806dab0 0x7fb3d815e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:12.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.670+0000 7fb3dce00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb3d806dab0 0x7fb3d815e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:56562/0 (socket says 172.21.15.49:56562) 2024-01-31T12:09:12.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.670+0000 7fb3dce00640 1 -- 172.21.15.49:0/3044412449 learned_addr learned my addr 172.21.15.49:0/3044412449 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:12.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.670+0000 7fb3d7e00640 1 --2- 172.21.15.49:0/3044412449 >> v2:172.21.15.49:3300/0 conn(0x7fb3d80b2ea0 0x7fb3d80b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.670+0000 7fb3dce00640 1 -- 172.21.15.49:0/3044412449 >> v2:172.21.15.49:3300/0 conn(0x7fb3d80b2ea0 msgr2=0x7fb3d80b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.670+0000 7fb3dce00640 1 --2- 172.21.15.49:0/3044412449 >> v2:172.21.15.49:3300/0 conn(0x7fb3d80b2ea0 0x7fb3d80b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.670+0000 7fb3dce00640 1 -- 172.21.15.49:0/3044412449 >> v1:172.21.15.195:6789/0 conn(0x7fb3d80703c0 legacy=0x7fb3d806c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.670+0000 7fb3dce00640 1 -- 172.21.15.49:0/3044412449 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d80b20e0 con 0x7fb3d806dab0 2024-01-31T12:09:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.674+0000 7fb3dce00640 1 --2- 172.21.15.49:0/3044412449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3d806dab0 0x7fb3d815e3e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fb3d806beb0 tx=0x7fb3c801c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a163f97b4f92c14a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:12.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.678+0000 7fb3d7400640 1 -- 172.21.15.49:0/3044412449 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c80aa430 con 0x7fb3d806dab0 2024-01-31T12:09:12.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.678+0000 7fb3d7400640 1 -- 172.21.15.49:0/3044412449 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c80aa590 con 0x7fb3d806dab0 2024-01-31T12:09:12.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.678+0000 7fb3d7400640 1 -- 172.21.15.49:0/3044412449 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c80aa920 con 0x7fb3d806dab0 2024-01-31T12:09:12.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.678+0000 7fb3df800640 1 -- 172.21.15.49:0/3044412449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3d806dab0 msgr2=0x7fb3d815e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:12.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.678+0000 7fb3df800640 1 --2- 172.21.15.49:0/3044412449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3d806dab0 0x7fb3d815e3e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fb3d806beb0 tx=0x7fb3c801c4d0 comp rx=0 tx=0).stop 2024-01-31T12:09:12.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.682+0000 7fb3df800640 1 -- 172.21.15.49:0/3044412449 shutdown_connections 2024-01-31T12:09:12.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.682+0000 7fb3df800640 1 --2- 172.21.15.49:0/3044412449 >> v2:172.21.15.49:3300/0 conn(0x7fb3d80b2ea0 0x7fb3d80b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:12.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.682+0000 7fb3df800640 1 --2- 172.21.15.49:0/3044412449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3d806dab0 0x7fb3d815e3e0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:12.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.682+0000 7fb3df800640 1 -- 172.21.15.49:0/3044412449 >> 172.21.15.49:0/3044412449 conn(0x7fb3d80b09a0 msgr2=0x7fb3d80b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:12.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.682+0000 7fb3df800640 1 -- 172.21.15.49:0/3044412449 shutdown_connections 2024-01-31T12:09:12.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.682+0000 7fb3df800640 1 -- 172.21.15.49:0/3044412449 wait complete. 2024-01-31T12:09:12.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.690+0000 7fb3df800640 1 Processor -- start 2024-01-31T12:09:12.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.690+0000 7fb3df800640 1 -- start start 2024-01-31T12:09:12.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.694+0000 7fb3df800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3d806dab0 0x7fb3d815d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:12.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.694+0000 7fb3df800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb3d80703c0 0x7fb3d815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:12.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.694+0000 7fb3df800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3d80b2ea0 0x7fb3d8154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:12.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.694+0000 7fb3df800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d8161140 con 0x7fb3d80b2ea0 2024-01-31T12:09:12.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.694+0000 7fb3df800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d81600c0 con 0x7fb3d806dab0 2024-01-31T12:09:12.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.694+0000 7fb3df800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d8160380 con 0x7fb3d80703c0 2024-01-31T12:09:12.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.694+0000 7fb3dce00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3d806dab0 0x7fb3d815d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:12.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.694+0000 7fb3dce00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3d806dab0 0x7fb3d815d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:56566/0 (socket says 172.21.15.49:56566) 2024-01-31T12:09:12.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.694+0000 7fb3dce00640 1 -- 172.21.15.49:0/2955737625 learned_addr learned my addr 172.21.15.49:0/2955737625 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:12.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.698+0000 7fb3d7e00640 1 --2- 172.21.15.49:0/2955737625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb3d80703c0 0x7fb3d815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:12.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.698+0000 7fb3dd800640 1 --2- 172.21.15.49:0/2955737625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3d80b2ea0 0x7fb3d8154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.698+0000 7fb3dd800640 1 -- 172.21.15.49:0/2955737625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb3d80703c0 msgr2=0x7fb3d815c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.698+0000 7fb3dd800640 1 --2- 172.21.15.49:0/2955737625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb3d80703c0 0x7fb3d815c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.698+0000 7fb3dd800640 1 -- 172.21.15.49:0/2955737625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3d806dab0 msgr2=0x7fb3d815d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.698+0000 7fb3dd800640 1 --2- 172.21.15.49:0/2955737625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3d806dab0 0x7fb3d815d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.698+0000 7fb3dd800640 1 -- 172.21.15.49:0/2955737625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c80094d0 con 0x7fb3d80b2ea0 2024-01-31T12:09:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.698+0000 7fb3dd800640 1 --2- 172.21.15.49:0/2955737625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3d80b2ea0 0x7fb3d8154340 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fb3d000c700 tx=0x7fb3d000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:12.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.698+0000 7fb3d4c00640 1 -- 172.21.15.49:0/2955737625 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0003b80 con 0x7fb3d80b2ea0 2024-01-31T12:09:12.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.698+0000 7fb3d4c00640 1 -- 172.21.15.49:0/2955737625 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d0003ce0 con 0x7fb3d80b2ea0 2024-01-31T12:09:12.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.698+0000 7fb3d4c00640 1 -- 172.21.15.49:0/2955737625 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0005310 con 0x7fb3d80b2ea0 2024-01-31T12:09:12.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.702+0000 7fb3df800640 1 -- 172.21.15.49:0/2955737625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d8160660 con 0x7fb3d80b2ea0 2024-01-31T12:09:12.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.702+0000 7fb3df800640 1 -- 172.21.15.49:0/2955737625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d8160c20 con 0x7fb3d80b2ea0 2024-01-31T12:09:12.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.706+0000 7fb3d4c00640 1 -- 172.21.15.49:0/2955737625 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb3d0005470 con 0x7fb3d80b2ea0 2024-01-31T12:09:12.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.710+0000 7fb3d4c00640 1 --2- 172.21.15.49:0/2955737625 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb3b0066580 0x7fb3b0068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:12.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.710+0000 7fb3d4c00640 1 -- 172.21.15.49:0/2955737625 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb3d0083b20 con 0x7fb3d80b2ea0 2024-01-31T12:09:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.710+0000 7fb3df800640 1 -- 172.21.15.49:0/2955737625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d806b660 con 0x7fb3d80b2ea0 2024-01-31T12:09:12.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.714+0000 7fb3dce00640 1 --2- 172.21.15.49:0/2955737625 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb3b0066580 0x7fb3b0068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:12.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.714+0000 7fb3dce00640 1 --2- 172.21.15.49:0/2955737625 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb3b0066580 0x7fb3b0068a40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb3c801c510 tx=0x7fb3c80b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:12.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:12.722+0000 7fb3d4c00640 1 -- 172.21.15.49:0/2955737625 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fb3d0050d40 con 0x7fb3d80b2ea0 2024-01-31T12:09:13.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:13.754+0000 7fb3df800640 1 -- 172.21.15.49:0/2955737625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb3d8074860 con 0x7fb3d80b2ea0 2024-01-31T12:09:13.853 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-01-31T12:09:13.850+0000 7f297d000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-31T12:09:13.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:13.854+0000 7fb3d4c00640 1 -- 172.21.15.49:0/2955737625 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb3d0054360 con 0x7fb3d80b2ea0 2024-01-31T12:09:13.859 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-31T12:09:13.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:13.866+0000 7fb3df800640 1 -- 172.21.15.49:0/2955737625 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb3b0066580 msgr2=0x7fb3b0068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:13.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:13.866+0000 7fb3df800640 1 --2- 172.21.15.49:0/2955737625 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb3b0066580 0x7fb3b0068a40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb3c801c510 tx=0x7fb3c80b5040 comp rx=0 tx=0).stop 2024-01-31T12:09:13.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:13.866+0000 7fb3df800640 1 -- 172.21.15.49:0/2955737625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3d80b2ea0 msgr2=0x7fb3d8154340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:13.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:13.866+0000 7fb3df800640 1 --2- 172.21.15.49:0/2955737625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3d80b2ea0 0x7fb3d8154340 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fb3d000c700 tx=0x7fb3d000cbc0 comp rx=0 tx=0).stop 2024-01-31T12:09:13.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:13.866+0000 7fb3df800640 1 -- 172.21.15.49:0/2955737625 shutdown_connections 2024-01-31T12:09:13.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:13.866+0000 7fb3df800640 1 --2- 172.21.15.49:0/2955737625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3d80b2ea0 0x7fb3d8154340 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:13.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:13.866+0000 7fb3df800640 1 --2- 172.21.15.49:0/2955737625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb3d80703c0 0x7fb3d815c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:13.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:13.866+0000 7fb3df800640 1 --2- 172.21.15.49:0/2955737625 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb3b0066580 0x7fb3b0068a40 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:13.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:13.866+0000 7fb3df800640 1 --2- 172.21.15.49:0/2955737625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3d806dab0 0x7fb3d815d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:13.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:13.866+0000 7fb3df800640 1 -- 172.21.15.49:0/2955737625 >> 172.21.15.49:0/2955737625 conn(0x7fb3d80b09a0 msgr2=0x7fb3d8156680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:13.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:13.870+0000 7fb3df800640 1 -- 172.21.15.49:0/2955737625 shutdown_connections 2024-01-31T12:09:13.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:13.870+0000 7fb3df800640 1 -- 172.21.15.49:0/2955737625 wait complete. 2024-01-31T12:09:13.941 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-31T12:09:14.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.446+0000 7fe99ec00640 1 Processor -- start 2024-01-31T12:09:14.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.446+0000 7fe99ec00640 1 -- start start 2024-01-31T12:09:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe99ec00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe998160cb0 0x7fe99815d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:14.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe99ec00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe99806a770 0x7fe99806abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:14.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe997e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fe9980afe90 0x7fe99815e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:40118/0 (socket says 172.21.15.49:40118) 2024-01-31T12:09:14.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe997e00640 1 -- 172.21.15.49:0/598245091 learned_addr learned my addr 172.21.15.49:0/598245091 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:09:14.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe99ec00640 1 -- 172.21.15.49:0/598245091 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe998161220 con 0x7fe9980afe90 2024-01-31T12:09:14.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe997400640 1 --2- 172.21.15.49:0/598245091 >> v2:172.21.15.195:3300/0 conn(0x7fe998160cb0 0x7fe99815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:14.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe99ec00640 1 -- 172.21.15.49:0/598245091 --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe998157c30 con 0x7fe998160cb0 2024-01-31T12:09:14.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe99ec00640 1 -- 172.21.15.49:0/598245091 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99806b120 con 0x7fe99806a770 2024-01-31T12:09:14.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe99d600640 1 --2- 172.21.15.49:0/598245091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe99806a770 0x7fe99806abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:14.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe996a00640 1 -- 172.21.15.49:0/598245091 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744054170 0 0) 0x7fe998161220 con 0x7fe9980afe90 2024-01-31T12:09:14.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe996a00640 1 -- 172.21.15.49:0/598245091 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe978003530 con 0x7fe9980afe90 2024-01-31T12:09:14.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe996a00640 1 -- 172.21.15.49:0/598245091 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1733845634 0 0) 0x7fe978003530 con 0x7fe9980afe90 2024-01-31T12:09:14.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe996a00640 1 -- 172.21.15.49:0/598245091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe99806a770 msgr2=0x7fe99806abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:14.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe996a00640 1 --2- 172.21.15.49:0/598245091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe99806a770 0x7fe99806abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:14.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe996a00640 1 -- 172.21.15.49:0/598245091 >> v2:172.21.15.195:3300/0 conn(0x7fe998160cb0 msgr2=0x7fe99815d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:14.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe996a00640 1 --2- 172.21.15.49:0/598245091 >> v2:172.21.15.195:3300/0 conn(0x7fe998160cb0 0x7fe99815d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:14.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe996a00640 1 -- 172.21.15.49:0/598245091 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe998161500 con 0x7fe9980afe90 2024-01-31T12:09:14.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe996a00640 1 -- 172.21.15.49:0/598245091 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7fe9880016a0 con 0x7fe9980afe90 2024-01-31T12:09:14.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe997400640 1 --2- 172.21.15.49:0/598245091 >> v2:172.21.15.195:3300/0 conn(0x7fe998160cb0 0x7fe99815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T12:09:14.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe996a00640 1 -- 172.21.15.49:0/598245091 >> v1:172.21.15.195:6789/0 conn(0x7fe9980afe90 legacy=0x7fe99815e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:14.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe996a00640 1 --2- 172.21.15.49:0/598245091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9780039b0 0x7fe978003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:14.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe996a00640 1 --2- 172.21.15.49:0/598245091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe99806a770 0x7fe9780047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:14.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe996a00640 1 --2- 172.21.15.49:0/598245091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe978004d10 0x7fe978005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:14.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe996a00640 1 -- 172.21.15.49:0/598245091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99806b120 con 0x7fe9780039b0 2024-01-31T12:09:14.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe996a00640 1 -- 172.21.15.49:0/598245091 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97800b990 con 0x7fe978004d10 2024-01-31T12:09:14.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe996a00640 1 -- 172.21.15.49:0/598245091 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97800bad0 con 0x7fe99806a770 2024-01-31T12:09:14.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe997e00640 1 --2- 172.21.15.49:0/598245091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9780039b0 0x7fe978003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:14.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe99d600640 1 --2- 172.21.15.49:0/598245091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe978004d10 0x7fe978005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:14.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe997400640 1 --2- 172.21.15.49:0/598245091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe99806a770 0x7fe9780047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:14.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe997e00640 1 -- 172.21.15.49:0/598245091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe99806a770 msgr2=0x7fe9780047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:14.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe997e00640 1 --2- 172.21.15.49:0/598245091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe99806a770 0x7fe9780047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:14.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe997e00640 1 -- 172.21.15.49:0/598245091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe978004d10 msgr2=0x7fe978005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:14.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe997e00640 1 --2- 172.21.15.49:0/598245091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe978004d10 0x7fe978005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:14.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.454+0000 7fe997e00640 1 -- 172.21.15.49:0/598245091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe978003530 con 0x7fe9780039b0 2024-01-31T12:09:14.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.458+0000 7fe997400640 1 --2- 172.21.15.49:0/598245091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe99806a770 0x7fe9780047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T12:09:14.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.458+0000 7fe997e00640 1 --2- 172.21.15.49:0/598245091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9780039b0 0x7fe978003d90 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7fe988004f30 tx=0x7fe98801d1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53b2492e6d336c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:14.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.458+0000 7fe996a00640 1 -- 172.21.15.49:0/598245091 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988005ae0 con 0x7fe9780039b0 2024-01-31T12:09:14.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.458+0000 7fe996a00640 1 -- 172.21.15.49:0/598245091 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9880a8070 con 0x7fe9780039b0 2024-01-31T12:09:14.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.458+0000 7fe996a00640 1 -- 172.21.15.49:0/598245091 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988005e80 con 0x7fe9780039b0 2024-01-31T12:09:14.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.462+0000 7fe99ec00640 1 -- 172.21.15.49:0/598245091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9780039b0 msgr2=0x7fe978003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:14.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.462+0000 7fe99ec00640 1 --2- 172.21.15.49:0/598245091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9780039b0 0x7fe978003d90 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7fe988004f30 tx=0x7fe98801d1b0 comp rx=0 tx=0).stop 2024-01-31T12:09:14.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.462+0000 7fe99d600640 1 -- 172.21.15.49:0/598245091 reap_dead start 2024-01-31T12:09:14.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.462+0000 7fe99ec00640 1 -- 172.21.15.49:0/598245091 shutdown_connections 2024-01-31T12:09:14.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.462+0000 7fe99ec00640 1 -- 172.21.15.49:0/598245091 >> 172.21.15.49:0/598245091 conn(0x7fe9980b2350 msgr2=0x7fe9980b2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.462+0000 7fe99ec00640 1 -- 172.21.15.49:0/598245091 shutdown_connections 2024-01-31T12:09:14.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.462+0000 7fe99ec00640 1 -- 172.21.15.49:0/598245091 wait complete. 2024-01-31T12:09:14.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.470+0000 7fe99ec00640 1 Processor -- start 2024-01-31T12:09:14.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.470+0000 7fe99ec00640 1 -- start start 2024-01-31T12:09:14.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.474+0000 7fe99ec00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9780039b0 0x7fe99815b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:14.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.474+0000 7fe99ec00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe998165870 0x7fe998154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:14.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.474+0000 7fe99ec00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9981596c0 0x7fe998159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:14.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.474+0000 7fe99ec00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe998158f50 con 0x7fe998165870 2024-01-31T12:09:14.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.474+0000 7fe99ec00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99815bdf0 con 0x7fe9981596c0 2024-01-31T12:09:14.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.474+0000 7fe99ec00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99815c0d0 con 0x7fe9780039b0 2024-01-31T12:09:14.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.474+0000 7fe997e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9780039b0 0x7fe99815b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:14.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.474+0000 7fe997e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9780039b0 0x7fe99815b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:51944/0 (socket says 172.21.15.49:51944) 2024-01-31T12:09:14.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.474+0000 7fe997e00640 1 -- 172.21.15.49:0/4109817244 learned_addr learned my addr 172.21.15.49:0/4109817244 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:14.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.474+0000 7fe99d600640 1 --2- 172.21.15.49:0/4109817244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9981596c0 0x7fe998159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:14.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.474+0000 7fe997400640 1 --2- 172.21.15.49:0/4109817244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe998165870 0x7fe998154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:14.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.478+0000 7fe997e00640 1 -- 172.21.15.49:0/4109817244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9981596c0 msgr2=0x7fe998159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:14.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.478+0000 7fe997e00640 1 --2- 172.21.15.49:0/4109817244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9981596c0 0x7fe998159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:14.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.478+0000 7fe997e00640 1 -- 172.21.15.49:0/4109817244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe998165870 msgr2=0x7fe998154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:14.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.478+0000 7fe997e00640 1 --2- 172.21.15.49:0/4109817244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe998165870 0x7fe998154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:14.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.478+0000 7fe997e00640 1 -- 172.21.15.49:0/4109817244 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99815c3b0 con 0x7fe9780039b0 2024-01-31T12:09:14.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.478+0000 7fe99d600640 1 --2- 172.21.15.49:0/4109817244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9981596c0 0x7fe998159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T12:09:14.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.478+0000 7fe997e00640 1 --2- 172.21.15.49:0/4109817244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9780039b0 0x7fe99815b810 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe988098ac0 tx=0x7fe988019f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:14.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.478+0000 7fe98fe00640 1 -- 172.21.15.49:0/4109817244 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9880b4070 con 0x7fe9780039b0 2024-01-31T12:09:14.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.478+0000 7fe98fe00640 1 -- 172.21.15.49:0/4109817244 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe988000c90 con 0x7fe9780039b0 2024-01-31T12:09:14.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.478+0000 7fe98fe00640 1 -- 172.21.15.49:0/4109817244 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9880015c0 con 0x7fe9780039b0 2024-01-31T12:09:14.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.478+0000 7fe99ec00640 1 -- 172.21.15.49:0/4109817244 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9981591a0 con 0x7fe9780039b0 2024-01-31T12:09:14.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.478+0000 7fe99ec00640 1 -- 172.21.15.49:0/4109817244 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9981554a0 con 0x7fe9780039b0 2024-01-31T12:09:14.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.478+0000 7fe98fe00640 1 -- 172.21.15.49:0/4109817244 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fe988001880 con 0x7fe9780039b0 2024-01-31T12:09:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.482+0000 7fe99ec00640 1 -- 172.21.15.49:0/4109817244 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9981593e0 con 0x7fe9780039b0 2024-01-31T12:09:14.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.482+0000 7fe98fe00640 1 --2- 172.21.15.49:0/4109817244 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe970066500 0x7fe9700689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:14.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.482+0000 7fe98fe00640 1 -- 172.21.15.49:0/4109817244 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fe98811d520 con 0x7fe9780039b0 2024-01-31T12:09:14.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.482+0000 7fe997400640 1 --2- 172.21.15.49:0/4109817244 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe970066500 0x7fe9700689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:14.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.482+0000 7fe997400640 1 --2- 172.21.15.49:0/4109817244 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe970066500 0x7fe9700689c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe998155910 tx=0x7fe980008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:14.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:14.486+0000 7fe98fe00640 1 -- 172.21.15.49:0/4109817244 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fe9981593e0 con 0x7fe9780039b0 2024-01-31T12:09:14.612 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-01-31T12:09:15.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:15.066+0000 7fe99ec00640 1 -- 172.21.15.49:0/4109817244 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe9981593e0 con 0x7fe9780039b0 2024-01-31T12:09:15.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:15.530+0000 7fe98fe00640 1 -- 172.21.15.49:0/4109817244 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe9981593e0 con 0x7fe9780039b0 2024-01-31T12:09:15.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:15.534+0000 7fe99ec00640 1 -- 172.21.15.49:0/4109817244 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe970066500 msgr2=0x7fe9700689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:15.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:15.534+0000 7fe99ec00640 1 --2- 172.21.15.49:0/4109817244 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe970066500 0x7fe9700689c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe998155910 tx=0x7fe980008040 comp rx=0 tx=0).stop 2024-01-31T12:09:15.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:15.534+0000 7fe99ec00640 1 -- 172.21.15.49:0/4109817244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9780039b0 msgr2=0x7fe99815b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:15.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:15.534+0000 7fe99ec00640 1 --2- 172.21.15.49:0/4109817244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9780039b0 0x7fe99815b810 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe988098ac0 tx=0x7fe988019f50 comp rx=0 tx=0).stop 2024-01-31T12:09:15.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:15.534+0000 7fe99ec00640 1 -- 172.21.15.49:0/4109817244 shutdown_connections 2024-01-31T12:09:15.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:15.534+0000 7fe99ec00640 1 --2- 172.21.15.49:0/4109817244 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe970066500 0x7fe9700689c0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:15.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:15.534+0000 7fe99ec00640 1 --2- 172.21.15.49:0/4109817244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9981596c0 0x7fe998159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:15.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:15.534+0000 7fe99ec00640 1 --2- 172.21.15.49:0/4109817244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe998165870 0x7fe998154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:15.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:15.534+0000 7fe99ec00640 1 --2- 172.21.15.49:0/4109817244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe9780039b0 0x7fe99815b810 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:15.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:15.534+0000 7fe99ec00640 1 -- 172.21.15.49:0/4109817244 >> 172.21.15.49:0/4109817244 conn(0x7fe9980b2350 msgr2=0x7fe9980b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:15.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:15.534+0000 7fe99ec00640 1 -- 172.21.15.49:0/4109817244 shutdown_connections 2024-01-31T12:09:15.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:15.534+0000 7fe99ec00640 1 -- 172.21.15.49:0/4109817244 wait complete. 2024-01-31T12:09:15.590 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-31T12:09:16.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.006+0000 7f0b09600640 1 Processor -- start 2024-01-31T12:09:16.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.006+0000 7f0b09600640 1 -- start start 2024-01-31T12:09:16.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.010+0000 7f0b09600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0b0415d540 0x7f0b040cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:16.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.010+0000 7f0b09600640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0b0406c290 0x7f0b040cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:16.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.010+0000 7f0b09600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b040cef80 con 0x7f0b040cb9f0 2024-01-31T12:09:16.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.010+0000 7f0b09600640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b0406cae0 con 0x7f0b0406c290 2024-01-31T12:09:16.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.010+0000 7f0b09600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b040cf1b0 con 0x7f0b0415d540 2024-01-31T12:09:16.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.010+0000 7f0b02a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0b0415d540 0x7f0b040cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:16.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.010+0000 7f0b03400640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f0b040cb9f0 0x7f0b040cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:40142/0 (socket says 172.21.15.49:40142) 2024-01-31T12:09:16.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.010+0000 7f0b03400640 1 -- 172.21.15.49:0/2566760457 learned_addr learned my addr 172.21.15.49:0/2566760457 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:09:16.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.010+0000 7f0b02000640 1 --2- 172.21.15.49:0/2566760457 >> v2:172.21.15.49:3300/0 conn(0x7f0b0406c290 0x7f0b040cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:16.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.010+0000 7f0b01600640 1 -- 172.21.15.49:0/2566760457 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496403466 0 0) 0x7f0b040cef80 con 0x7f0b040cb9f0 2024-01-31T12:09:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.010+0000 7f0b01600640 1 -- 172.21.15.49:0/2566760457 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ae4003530 con 0x7f0b040cb9f0 2024-01-31T12:09:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.010+0000 7f0b02a00640 1 -- 172.21.15.49:0/2566760457 >> v2:172.21.15.49:3300/0 conn(0x7f0b0406c290 msgr2=0x7f0b040cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.010+0000 7f0b02a00640 1 --2- 172.21.15.49:0/2566760457 >> v2:172.21.15.49:3300/0 conn(0x7f0b0406c290 0x7f0b040cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.010+0000 7f0b02a00640 1 -- 172.21.15.49:0/2566760457 >> v1:172.21.15.195:6789/0 conn(0x7f0b040cb9f0 legacy=0x7f0b040cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:16.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.010+0000 7f0b02a00640 1 -- 172.21.15.49:0/2566760457 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b040cf490 con 0x7f0b0415d540 2024-01-31T12:09:16.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.018+0000 7f0b02a00640 1 --2- 172.21.15.49:0/2566760457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b0415d540 0x7f0b040cff70 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0b04071f60 tx=0x7f0afc01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb84bbf42090464f server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:16.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.018+0000 7f0b01600640 1 -- 172.21.15.49:0/2566760457 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc0a58b0 con 0x7f0b0415d540 2024-01-31T12:09:16.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.018+0000 7f0b01600640 1 -- 172.21.15.49:0/2566760457 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0afc0a5a10 con 0x7f0b0415d540 2024-01-31T12:09:16.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.018+0000 7f0b01600640 1 -- 172.21.15.49:0/2566760457 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc0a5da0 con 0x7f0b0415d540 2024-01-31T12:09:16.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.018+0000 7f0b09600640 1 -- 172.21.15.49:0/2566760457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b0415d540 msgr2=0x7f0b040cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:16.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.018+0000 7f0b09600640 1 --2- 172.21.15.49:0/2566760457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b0415d540 0x7f0b040cff70 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0b04071f60 tx=0x7f0afc01c8e0 comp rx=0 tx=0).stop 2024-01-31T12:09:16.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.022+0000 7f0b09600640 1 -- 172.21.15.49:0/2566760457 shutdown_connections 2024-01-31T12:09:16.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.022+0000 7f0b09600640 1 --2- 172.21.15.49:0/2566760457 >> v2:172.21.15.49:3300/0 conn(0x7f0b0406c290 0x7f0b040cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:16.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.022+0000 7f0b09600640 1 --2- 172.21.15.49:0/2566760457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b0415d540 0x7f0b040cff70 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:16.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.022+0000 7f0b09600640 1 -- 172.21.15.49:0/2566760457 >> 172.21.15.49:0/2566760457 conn(0x7f0b040d0e60 msgr2=0x7f0b040d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:16.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.022+0000 7f0b09600640 1 -- 172.21.15.49:0/2566760457 shutdown_connections 2024-01-31T12:09:16.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.022+0000 7f0b09600640 1 -- 172.21.15.49:0/2566760457 wait complete. 2024-01-31T12:09:16.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.026+0000 7f0b09600640 1 Processor -- start 2024-01-31T12:09:16.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.026+0000 7f0b09600640 1 -- start start 2024-01-31T12:09:16.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.026+0000 7f0b09600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b0406c290 0x7f0b040c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.026+0000 7f0b09600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b040cb9f0 0x7f0b04154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.026+0000 7f0b09600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b0415d540 0x7f0b04154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.026+0000 7f0b09600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b04155aa0 con 0x7f0b040cb9f0 2024-01-31T12:09:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.026+0000 7f0b09600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0415a900 con 0x7f0b0415d540 2024-01-31T12:09:16.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.026+0000 7f0b09600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b041536a0 con 0x7f0b0406c290 2024-01-31T12:09:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.030+0000 7f0b02a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b0406c290 0x7f0b040c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.030+0000 7f0b02a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b0406c290 0x7f0b040c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:51968/0 (socket says 172.21.15.49:51968) 2024-01-31T12:09:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.030+0000 7f0b02000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b040cb9f0 0x7f0b04154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.030+0000 7f0b03400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b0415d540 0x7f0b04154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.030+0000 7f0b02a00640 1 -- 172.21.15.49:0/1187349094 learned_addr learned my addr 172.21.15.49:0/1187349094 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.030+0000 7f0b02a00640 1 -- 172.21.15.49:0/1187349094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b0415d540 msgr2=0x7f0b04154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:16.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.030+0000 7f0b02a00640 1 --2- 172.21.15.49:0/1187349094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b0415d540 0x7f0b04154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:16.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.030+0000 7f0b02a00640 1 -- 172.21.15.49:0/1187349094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b040cb9f0 msgr2=0x7f0b04154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:16.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.030+0000 7f0b02a00640 1 --2- 172.21.15.49:0/1187349094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b040cb9f0 0x7f0b04154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:16.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.030+0000 7f0b02a00640 1 -- 172.21.15.49:0/1187349094 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc009a70 con 0x7f0b0406c290 2024-01-31T12:09:16.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.030+0000 7f0b02a00640 1 --2- 172.21.15.49:0/1187349094 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b0406c290 0x7f0b040c8ec0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0afc0194f0 tx=0x7f0afc019680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:16.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.030+0000 7f0afaa00640 1 -- 172.21.15.49:0/1187349094 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc0b9860 con 0x7f0b0406c290 2024-01-31T12:09:16.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.030+0000 7f0afaa00640 1 -- 172.21.15.49:0/1187349094 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0afc0b99c0 con 0x7f0b0406c290 2024-01-31T12:09:16.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.030+0000 7f0afaa00640 1 -- 172.21.15.49:0/1187349094 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc0b9d50 con 0x7f0b0406c290 2024-01-31T12:09:16.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.030+0000 7f0b09600640 1 -- 172.21.15.49:0/1187349094 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b04155200 con 0x7f0b0406c290 2024-01-31T12:09:16.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.030+0000 7f0b09600640 1 -- 172.21.15.49:0/1187349094 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b041557c0 con 0x7f0b0406c290 2024-01-31T12:09:16.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.034+0000 7f0b09600640 1 -- 172.21.15.49:0/1187349094 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b040ce880 con 0x7f0b0406c290 2024-01-31T12:09:16.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.038+0000 7f0afaa00640 1 -- 172.21.15.49:0/1187349094 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f0afc0c4460 con 0x7f0b0406c290 2024-01-31T12:09:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.038+0000 7f0afaa00640 1 --2- 172.21.15.49:0/1187349094 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0adc066500 0x7f0adc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:16.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.038+0000 7f0b02000640 1 --2- 172.21.15.49:0/1187349094 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0adc066500 0x7f0adc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:16.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.038+0000 7f0afaa00640 1 -- 172.21.15.49:0/1187349094 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f0afc11f2b0 con 0x7f0b0406c290 2024-01-31T12:09:16.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.042+0000 7f0b02000640 1 --2- 172.21.15.49:0/1187349094 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0adc066500 0x7f0adc0689c0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0b040c5000 tx=0x7f0aec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:16.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.042+0000 7f0afaa00640 1 -- 172.21.15.49:0/1187349094 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f0afc0ec3d0 con 0x7f0b0406c290 2024-01-31T12:09:16.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.522+0000 7f0b09600640 1 -- 172.21.15.49:0/1187349094 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0b0415a6d0 con 0x7f0b0406c290 2024-01-31T12:09:16.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.634+0000 7f0afaa00640 1 -- 172.21.15.49:0/1187349094 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0b0415a6d0 con 0x7f0b0406c290 2024-01-31T12:09:16.639 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-01-31T12:09:16.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.638+0000 7f0b09600640 1 -- 172.21.15.49:0/1187349094 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0adc066500 msgr2=0x7f0adc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:16.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.638+0000 7f0b09600640 1 --2- 172.21.15.49:0/1187349094 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0adc066500 0x7f0adc0689c0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0b040c5000 tx=0x7f0aec008040 comp rx=0 tx=0).stop 2024-01-31T12:09:16.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.638+0000 7f0b09600640 1 -- 172.21.15.49:0/1187349094 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b0406c290 msgr2=0x7f0b040c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:16.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.638+0000 7f0b09600640 1 --2- 172.21.15.49:0/1187349094 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b0406c290 0x7f0b040c8ec0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0afc0194f0 tx=0x7f0afc019680 comp rx=0 tx=0).stop 2024-01-31T12:09:16.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.642+0000 7f0b09600640 1 -- 172.21.15.49:0/1187349094 shutdown_connections 2024-01-31T12:09:16.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.642+0000 7f0b09600640 1 --2- 172.21.15.49:0/1187349094 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0adc066500 0x7f0adc0689c0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:16.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.642+0000 7f0b09600640 1 --2- 172.21.15.49:0/1187349094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b0415d540 0x7f0b04154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:16.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.642+0000 7f0b09600640 1 --2- 172.21.15.49:0/1187349094 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b040cb9f0 0x7f0b04154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:16.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.642+0000 7f0b09600640 1 --2- 172.21.15.49:0/1187349094 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b0406c290 0x7f0b040c8ec0 secure :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0afc0194f0 tx=0x7f0afc019680 comp rx=0 tx=0).stop 2024-01-31T12:09:16.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.642+0000 7f0b09600640 1 -- 172.21.15.49:0/1187349094 >> 172.21.15.49:0/1187349094 conn(0x7f0b040d0e60 msgr2=0x7f0b0406eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:16.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.642+0000 7f0b09600640 1 -- 172.21.15.49:0/1187349094 shutdown_connections 2024-01-31T12:09:16.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:16.642+0000 7f0b09600640 1 -- 172.21.15.49:0/1187349094 wait complete. 2024-01-31T12:09:16.677 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-31T12:09:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.266+0000 7f0358e00640 1 Processor -- start 2024-01-31T12:09:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.266+0000 7f0358e00640 1 -- start start 2024-01-31T12:09:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.274+0000 7f0358e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0354070660 0x7f0354070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.274+0000 7f0358e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f03540ac050 0x7f03540ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.274+0000 7f0358e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0354071000 con 0x7f0354159790 2024-01-31T12:09:17.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.274+0000 7f0358e00640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0354159b70 con 0x7f0354070660 2024-01-31T12:09:17.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.274+0000 7f0358e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03540b2750 con 0x7f03540ac050 2024-01-31T12:09:17.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.274+0000 7f0351e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f0354159790 0x7f03540b37c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:40156/0 (socket says 172.21.15.49:40156) 2024-01-31T12:09:17.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.274+0000 7f0351e00640 1 -- 172.21.15.49:0/2777652029 learned_addr learned my addr 172.21.15.49:0/2777652029 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:09:17.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.274+0000 7f0352800640 1 --2- 172.21.15.49:0/2777652029 >> v2:172.21.15.195:3300/0 conn(0x7f03540ac050 0x7f03540ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:17.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.274+0000 7f0351400640 1 --2- 172.21.15.49:0/2777652029 >> v2:172.21.15.49:3300/0 conn(0x7f0354070660 0x7f0354070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:17.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.274+0000 7f0352800640 1 -- 172.21.15.49:0/2777652029 >> v2:172.21.15.49:3300/0 conn(0x7f0354070660 msgr2=0x7f0354070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:17.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.274+0000 7f0350a00640 1 -- 172.21.15.49:0/2777652029 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679948241 0 0) 0x7f0354071000 con 0x7f0354159790 2024-01-31T12:09:17.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.274+0000 7f0352800640 1 --2- 172.21.15.49:0/2777652029 >> v2:172.21.15.49:3300/0 conn(0x7f0354070660 0x7f0354070ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:17.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.274+0000 7f0352800640 1 -- 172.21.15.49:0/2777652029 >> v1:172.21.15.195:6789/0 conn(0x7f0354159790 legacy=0x7f03540b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:17.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.274+0000 7f0352800640 1 -- 172.21.15.49:0/2777652029 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03540b2a30 con 0x7f03540ac050 2024-01-31T12:09:17.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.274+0000 7f0351400640 1 --2- 172.21.15.49:0/2777652029 >> v2:172.21.15.49:3300/0 conn(0x7f0354070660 0x7f0354070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T12:09:17.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.278+0000 7f0352800640 1 --2- 172.21.15.49:0/2777652029 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03540ac050 0x7f03540ac4c0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f03540b1690 tx=0x7f033c01d800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b932a42672bf550 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:17.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.278+0000 7f0350a00640 1 -- 172.21.15.49:0/2777652029 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c0a6830 con 0x7f03540ac050 2024-01-31T12:09:17.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.278+0000 7f0350a00640 1 -- 172.21.15.49:0/2777652029 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c0a6990 con 0x7f03540ac050 2024-01-31T12:09:17.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.278+0000 7f0350a00640 1 -- 172.21.15.49:0/2777652029 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c0a6d20 con 0x7f03540ac050 2024-01-31T12:09:17.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.278+0000 7f0358e00640 1 -- 172.21.15.49:0/2777652029 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03540ac050 msgr2=0x7f03540ac4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:17.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.278+0000 7f0358e00640 1 --2- 172.21.15.49:0/2777652029 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03540ac050 0x7f03540ac4c0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f03540b1690 tx=0x7f033c01d800 comp rx=0 tx=0).stop 2024-01-31T12:09:17.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.278+0000 7f0358e00640 1 -- 172.21.15.49:0/2777652029 shutdown_connections 2024-01-31T12:09:17.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.278+0000 7f0358e00640 1 --2- 172.21.15.49:0/2777652029 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03540ac050 0x7f03540ac4c0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:17.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.278+0000 7f0358e00640 1 --2- 172.21.15.49:0/2777652029 >> v2:172.21.15.49:3300/0 conn(0x7f0354070660 0x7f0354070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:17.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.278+0000 7f0358e00640 1 -- 172.21.15.49:0/2777652029 >> 172.21.15.49:0/2777652029 conn(0x7f03540b09a0 msgr2=0x7f03540b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:17.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.278+0000 7f0358e00640 1 -- 172.21.15.49:0/2777652029 shutdown_connections 2024-01-31T12:09:17.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.278+0000 7f0358e00640 1 -- 172.21.15.49:0/2777652029 wait complete. 2024-01-31T12:09:17.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.286+0000 7f0358e00640 1 Processor -- start 2024-01-31T12:09:17.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.286+0000 7f0358e00640 1 -- start start 2024-01-31T12:09:17.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.290+0000 7f0358e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0354070660 0x7f035414cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:17.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.290+0000 7f0358e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03540ac050 0x7f03541441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:17.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.290+0000 7f0358e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0354159790 0x7f0354144fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:17.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.290+0000 7f0358e00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03540cdd10 con 0x7f0354159790 2024-01-31T12:09:17.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.290+0000 7f0358e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03540ccc70 con 0x7f0354070660 2024-01-31T12:09:17.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.290+0000 7f0358e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03540ccf50 con 0x7f03540ac050 2024-01-31T12:09:17.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.290+0000 7f0351e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0354070660 0x7f035414cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:17.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.290+0000 7f0351e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0354070660 0x7f035414cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:56660/0 (socket says 172.21.15.49:56660) 2024-01-31T12:09:17.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.290+0000 7f0351e00640 1 -- 172.21.15.49:0/110416773 learned_addr learned my addr 172.21.15.49:0/110416773 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:17.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.290+0000 7f0351400640 1 --2- 172.21.15.49:0/110416773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03540ac050 0x7f03541441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:17.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.290+0000 7f0352800640 1 --2- 172.21.15.49:0/110416773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0354159790 0x7f0354144fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:17.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.290+0000 7f0351e00640 1 -- 172.21.15.49:0/110416773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03540ac050 msgr2=0x7f03541441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:17.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.290+0000 7f0351e00640 1 --2- 172.21.15.49:0/110416773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03540ac050 0x7f03541441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:17.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.290+0000 7f0351e00640 1 -- 172.21.15.49:0/110416773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0354159790 msgr2=0x7f0354144fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:17.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.290+0000 7f0351e00640 1 --2- 172.21.15.49:0/110416773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0354159790 0x7f0354144fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:17.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.290+0000 7f0351e00640 1 -- 172.21.15.49:0/110416773 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c00a5c0 con 0x7f0354070660 2024-01-31T12:09:17.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.290+0000 7f0352800640 1 --2- 172.21.15.49:0/110416773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0354159790 0x7f0354144fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T12:09:17.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.294+0000 7f0351e00640 1 --2- 172.21.15.49:0/110416773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0354070660 0x7f035414cc50 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f034c00c780 tx=0x7f034c00cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:17.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.294+0000 7f034a000640 1 -- 172.21.15.49:0/110416773 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c00ce90 con 0x7f0354070660 2024-01-31T12:09:17.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.294+0000 7f034a000640 1 -- 172.21.15.49:0/110416773 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034c00a640 con 0x7f0354070660 2024-01-31T12:09:17.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.294+0000 7f0358e00640 1 -- 172.21.15.49:0/110416773 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03540cd230 con 0x7f0354070660 2024-01-31T12:09:17.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.294+0000 7f034a000640 1 -- 172.21.15.49:0/110416773 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c00aa70 con 0x7f0354070660 2024-01-31T12:09:17.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.294+0000 7f0358e00640 1 -- 172.21.15.49:0/110416773 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03540cd7f0 con 0x7f0354070660 2024-01-31T12:09:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.298+0000 7f0358e00640 1 -- 172.21.15.49:0/110416773 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03540cda10 con 0x7f0354070660 2024-01-31T12:09:17.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.298+0000 7f034a000640 1 -- 172.21.15.49:0/110416773 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f034c00abd0 con 0x7f0354070660 2024-01-31T12:09:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.298+0000 7f034a000640 1 --2- 172.21.15.49:0/110416773 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f032c066530 0x7f032c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.298+0000 7f034a000640 1 -- 172.21.15.49:0/110416773 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f034c083520 con 0x7f0354070660 2024-01-31T12:09:17.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.302+0000 7f0351400640 1 --2- 172.21.15.49:0/110416773 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f032c066530 0x7f032c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:17.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.302+0000 7f0351400640 1 --2- 172.21.15.49:0/110416773 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f032c066530 0x7f032c0689f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f035414d450 tx=0x7f0344008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:17.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.306+0000 7f034a000640 1 -- 172.21.15.49:0/110416773 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f034c050900 con 0x7f0354070660 2024-01-31T12:09:17.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:17.902+0000 7f0358e00640 1 -- 172.21.15.49:0/110416773 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0354074860 con 0x7f0354070660 2024-01-31T12:09:18.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:18.650+0000 7f034a000640 1 -- 172.21.15.49:0/110416773 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) v1 ==== 169+0+0 (secure 0 0 0) 0x7f034c053f20 con 0x7f0354070660 2024-01-31T12:09:18.653 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-01-31T12:09:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:18.658+0000 7f0358e00640 1 -- 172.21.15.49:0/110416773 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f032c066530 msgr2=0x7f032c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:18.658+0000 7f0358e00640 1 --2- 172.21.15.49:0/110416773 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f032c066530 0x7f032c0689f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f035414d450 tx=0x7f0344008040 comp rx=0 tx=0).stop 2024-01-31T12:09:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:18.658+0000 7f0358e00640 1 -- 172.21.15.49:0/110416773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0354070660 msgr2=0x7f035414cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:18.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:18.658+0000 7f0358e00640 1 --2- 172.21.15.49:0/110416773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0354070660 0x7f035414cc50 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f034c00c780 tx=0x7f034c00cc40 comp rx=0 tx=0).stop 2024-01-31T12:09:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:18.662+0000 7f0358e00640 1 -- 172.21.15.49:0/110416773 shutdown_connections 2024-01-31T12:09:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:18.662+0000 7f0358e00640 1 --2- 172.21.15.49:0/110416773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0354159790 0x7f0354144fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:18.662+0000 7f0358e00640 1 --2- 172.21.15.49:0/110416773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f03540ac050 0x7f03541441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:18.662+0000 7f0358e00640 1 --2- 172.21.15.49:0/110416773 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f032c066530 0x7f032c0689f0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:18.662+0000 7f0358e00640 1 --2- 172.21.15.49:0/110416773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0354070660 0x7f035414cc50 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:18.662+0000 7f0358e00640 1 -- 172.21.15.49:0/110416773 >> 172.21.15.49:0/110416773 conn(0x7f03540b09a0 msgr2=0x7f0354157da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:18.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:18.662+0000 7f0358e00640 1 -- 172.21.15.49:0/110416773 shutdown_connections 2024-01-31T12:09:18.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:18.662+0000 7f0358e00640 1 -- 172.21.15.49:0/110416773 wait complete. 2024-01-31T12:09:18.777 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-31T12:09:19.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.362+0000 7fb40a400640 1 Processor -- start 2024-01-31T12:09:19.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.366+0000 7fb40a400640 1 -- start start 2024-01-31T12:09:19.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.370+0000 7fb40a400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb40415a210 0x7fb4040717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:19.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.374+0000 7fb40a400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fb4040cdcd0 0x7fb4040cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:19.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.374+0000 7fb40a400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb40406eb80 con 0x7fb4040cb960 2024-01-31T12:09:19.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.374+0000 7fb40a400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4040cca00 con 0x7fb4040cdcd0 2024-01-31T12:09:19.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.374+0000 7fb40a400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb404071d20 con 0x7fb40415a210 2024-01-31T12:09:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.374+0000 7fb403400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb40415a210 0x7fb4040717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.374+0000 7fb402a00640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fb4040cb960 0x7fb4040cd5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:53468/0 (socket says 172.21.15.49:53468) 2024-01-31T12:09:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.374+0000 7fb402a00640 1 -- 172.21.15.49:0/3521885165 learned_addr learned my addr 172.21.15.49:0/3521885165 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:09:19.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.374+0000 7fb403e00640 1 --2- 172.21.15.49:0/3521885165 >> v2:172.21.15.49:3300/0 conn(0x7fb4040cdcd0 0x7fb4040cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:19.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.374+0000 7fb403e00640 1 -- 172.21.15.49:0/3521885165 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb40415a210 msgr2=0x7fb4040717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:19.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.374+0000 7fb403e00640 1 --2- 172.21.15.49:0/3521885165 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb40415a210 0x7fb4040717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:19.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.374+0000 7fb403e00640 1 -- 172.21.15.49:0/3521885165 >> v1:172.21.15.49:6789/0 conn(0x7fb4040cb960 legacy=0x7fb4040cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:19.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.374+0000 7fb403e00640 1 -- 172.21.15.49:0/3521885165 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4040cbdf0 con 0x7fb4040cdcd0 2024-01-31T12:09:19.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.378+0000 7fb403e00640 1 --2- 172.21.15.49:0/3521885165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4040cdcd0 0x7fb4040cf6c0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009d90 tx=0x7fb3fc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbcf8f79806ebbc server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:19.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.378+0000 7fb402000640 1 -- 172.21.15.49:0/3521885165 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc0a58f0 con 0x7fb4040cdcd0 2024-01-31T12:09:19.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.382+0000 7fb402000640 1 -- 172.21.15.49:0/3521885165 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc0a5a50 con 0x7fb4040cdcd0 2024-01-31T12:09:19.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.382+0000 7fb402000640 1 -- 172.21.15.49:0/3521885165 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc0a5de0 con 0x7fb4040cdcd0 2024-01-31T12:09:19.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.382+0000 7fb40a400640 1 -- 172.21.15.49:0/3521885165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4040cdcd0 msgr2=0x7fb4040cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:19.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.382+0000 7fb40a400640 1 --2- 172.21.15.49:0/3521885165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4040cdcd0 0x7fb4040cf6c0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009d90 tx=0x7fb3fc01c920 comp rx=0 tx=0).stop 2024-01-31T12:09:19.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.382+0000 7fb40a400640 1 -- 172.21.15.49:0/3521885165 shutdown_connections 2024-01-31T12:09:19.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.382+0000 7fb40a400640 1 --2- 172.21.15.49:0/3521885165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4040cdcd0 0x7fb4040cf6c0 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:19.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.382+0000 7fb40a400640 1 --2- 172.21.15.49:0/3521885165 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb40415a210 0x7fb4040717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:19.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.382+0000 7fb40a400640 1 -- 172.21.15.49:0/3521885165 >> 172.21.15.49:0/3521885165 conn(0x7fb40406a770 msgr2=0x7fb40406ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:19.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.382+0000 7fb40a400640 1 -- 172.21.15.49:0/3521885165 shutdown_connections 2024-01-31T12:09:19.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.382+0000 7fb40a400640 1 -- 172.21.15.49:0/3521885165 wait complete. 2024-01-31T12:09:19.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.386+0000 7fb40a400640 1 Processor -- start 2024-01-31T12:09:19.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.386+0000 7fb40a400640 1 -- start start 2024-01-31T12:09:19.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.386+0000 7fb40a400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4040cdcd0 0x7fb40415dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:19.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.386+0000 7fb40a400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb40415a210 0x7fb40415f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:19.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.386+0000 7fb40a400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb404143220 0x7fb404151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:19.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.386+0000 7fb40a400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4041511f0 con 0x7fb4040cdcd0 2024-01-31T12:09:19.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.386+0000 7fb40a400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4041fdfb0 con 0x7fb40415a210 2024-01-31T12:09:19.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.386+0000 7fb40a400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb404150570 con 0x7fb404143220 2024-01-31T12:09:19.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.386+0000 7fb403400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4040cdcd0 0x7fb40415dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:19.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.386+0000 7fb403400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4040cdcd0 0x7fb40415dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37670/0 (socket says 172.21.15.49:37670) 2024-01-31T12:09:19.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.386+0000 7fb403400640 1 -- 172.21.15.49:0/3268629494 learned_addr learned my addr 172.21.15.49:0/3268629494 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:19.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.390+0000 7fb403e00640 1 --2- 172.21.15.49:0/3268629494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb404143220 0x7fb404151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.390+0000 7fb403400640 1 -- 172.21.15.49:0/3268629494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb404143220 msgr2=0x7fb404151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.390+0000 7fb403400640 1 --2- 172.21.15.49:0/3268629494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb404143220 0x7fb404151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.390+0000 7fb403400640 1 -- 172.21.15.49:0/3268629494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb40415a210 msgr2=0x7fb40415f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.390+0000 7fb403400640 1 --2- 172.21.15.49:0/3268629494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb40415a210 0x7fb40415f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.390+0000 7fb403400640 1 -- 172.21.15.49:0/3268629494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3fc009a70 con 0x7fb4040cdcd0 2024-01-31T12:09:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.390+0000 7fb403400640 1 --2- 172.21.15.49:0/3268629494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4040cdcd0 0x7fb40415dae0 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec00e870 tx=0x7fb3ec00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.390+0000 7fb3fb400640 1 -- 172.21.15.49:0/3268629494 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec00eec0 con 0x7fb4040cdcd0 2024-01-31T12:09:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.390+0000 7fb40a400640 1 -- 172.21.15.49:0/3268629494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb404150850 con 0x7fb4040cdcd0 2024-01-31T12:09:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.390+0000 7fb40a400640 1 -- 172.21.15.49:0/3268629494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb404150e10 con 0x7fb4040cdcd0 2024-01-31T12:09:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.390+0000 7fb3fb400640 1 -- 172.21.15.49:0/3268629494 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec00c940 con 0x7fb4040cdcd0 2024-01-31T12:09:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.394+0000 7fb40a400640 1 -- 172.21.15.49:0/3268629494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d40052a0 con 0x7fb4040cdcd0 2024-01-31T12:09:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.394+0000 7fb3fb400640 1 -- 172.21.15.49:0/3268629494 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec00ccb0 con 0x7fb4040cdcd0 2024-01-31T12:09:19.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.406+0000 7fb3fb400640 1 -- 172.21.15.49:0/3268629494 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fb3ec013470 con 0x7fb4040cdcd0 2024-01-31T12:09:19.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.410+0000 7fb3fb400640 1 --2- 172.21.15.49:0/3268629494 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb3dc066530 0x7fb3dc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:19.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.414+0000 7fb3fb400640 1 -- 172.21.15.49:0/3268629494 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fb3ec084520 con 0x7fb4040cdcd0 2024-01-31T12:09:19.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.414+0000 7fb402a00640 1 --2- 172.21.15.49:0/3268629494 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb3dc066530 0x7fb3dc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:19.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.418+0000 7fb402a00640 1 --2- 172.21.15.49:0/3268629494 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb3dc066530 0x7fb3dc0689f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb4040af060 tx=0x7fb3f4007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:19.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.422+0000 7fb3fb400640 1 -- 172.21.15.49:0/3268629494 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fb3ec051a30 con 0x7fb4040cdcd0 2024-01-31T12:09:19.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.658+0000 7fb40a400640 1 -- 172.21.15.49:0/3268629494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb3d4005820 con 0x7fb4040cdcd0 2024-01-31T12:09:19.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.706+0000 7fb3fb400640 1 -- 172.21.15.49:0/3268629494 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb3ec055050 con 0x7fb4040cdcd0 2024-01-31T12:09:19.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.710+0000 7fb40a400640 1 -- 172.21.15.49:0/3268629494 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb3dc066530 msgr2=0x7fb3dc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:19.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.710+0000 7fb40a400640 1 --2- 172.21.15.49:0/3268629494 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb3dc066530 0x7fb3dc0689f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb4040af060 tx=0x7fb3f4007a50 comp rx=0 tx=0).stop 2024-01-31T12:09:19.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.714+0000 7fb40a400640 1 -- 172.21.15.49:0/3268629494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4040cdcd0 msgr2=0x7fb40415dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:19.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.714+0000 7fb40a400640 1 --2- 172.21.15.49:0/3268629494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4040cdcd0 0x7fb40415dae0 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec00e870 tx=0x7fb3ec00ec70 comp rx=0 tx=0).stop 2024-01-31T12:09:19.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.714+0000 7fb40a400640 1 -- 172.21.15.49:0/3268629494 shutdown_connections 2024-01-31T12:09:19.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.714+0000 7fb40a400640 1 --2- 172.21.15.49:0/3268629494 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb404143220 0x7fb404151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:19.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.714+0000 7fb40a400640 1 --2- 172.21.15.49:0/3268629494 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fb3dc066530 0x7fb3dc0689f0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:19.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.714+0000 7fb40a400640 1 --2- 172.21.15.49:0/3268629494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb40415a210 0x7fb40415f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:19.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.714+0000 7fb40a400640 1 --2- 172.21.15.49:0/3268629494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4040cdcd0 0x7fb40415dae0 secure :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec00e870 tx=0x7fb3ec00ec70 comp rx=0 tx=0).stop 2024-01-31T12:09:19.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.714+0000 7fb40a400640 1 -- 172.21.15.49:0/3268629494 >> 172.21.15.49:0/3268629494 conn(0x7fb40406a770 msgr2=0x7fb404155e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:19.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.714+0000 7fb40a400640 1 -- 172.21.15.49:0/3268629494 shutdown_connections 2024-01-31T12:09:19.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:19.714+0000 7fb40a400640 1 -- 172.21.15.49:0/3268629494 wait complete. 2024-01-31T12:09:19.782 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-01-31T12:09:20.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.322+0000 7f917be00640 1 Processor -- start 2024-01-31T12:09:20.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.322+0000 7f917be00640 1 -- start start 2024-01-31T12:09:20.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.330+0000 7f917be00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f917c161850 0x7f917c0cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:20.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.330+0000 7f917aa00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f917c161850 0x7f917c0cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:20.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.330+0000 7f917aa00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f917c161850 0x7f917c0cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:55296/0 (socket says 172.21.15.49:55296) 2024-01-31T12:09:20.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.330+0000 7f917be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f917c06e840 0x7f917c0cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:20.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.334+0000 7f917be00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917c161c30 con 0x7f917c073400 2024-01-31T12:09:20.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.334+0000 7f917be00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917c15e690 con 0x7f917c161850 2024-01-31T12:09:20.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.334+0000 7f917be00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c157b70 con 0x7f917c06e840 2024-01-31T12:09:20.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.334+0000 7f917aa00640 1 -- 172.21.15.49:0/1418283066 learned_addr learned my addr 172.21.15.49:0/1418283066 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:20.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.334+0000 7f9179600640 1 -- 172.21.15.49:0/1418283066 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 703063105 0 0) 0x7f917c161c30 con 0x7f917c073400 2024-01-31T12:09:20.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.338+0000 7f9179600640 1 -- 172.21.15.49:0/1418283066 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f915c003530 con 0x7f917c073400 2024-01-31T12:09:20.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.338+0000 7f9179600640 1 -- 172.21.15.49:0/1418283066 <== mon.0 v1:172.21.15.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 352579639 0 0) 0x7f915c003530 con 0x7f917c073400 2024-01-31T12:09:20.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.338+0000 7f9179600640 1 -- 172.21.15.49:0/1418283066 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f917c06e840 msgr2=0x7f917c0cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:20.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.338+0000 7f917a000640 1 --2- 172.21.15.49:0/1418283066 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f917c06e840 0x7f917c0cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:20.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.338+0000 7f9179600640 1 --2- 172.21.15.49:0/1418283066 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f917c06e840 0x7f917c0cf6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:20.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.338+0000 7f9179600640 1 -- 172.21.15.49:0/1418283066 >> v2:172.21.15.195:3300/0 conn(0x7f917c161850 msgr2=0x7f917c0cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:20.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.338+0000 7f9179600640 1 --2- 172.21.15.49:0/1418283066 >> v2:172.21.15.195:3300/0 conn(0x7f917c161850 0x7f917c0cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:20.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.338+0000 7f9179600640 1 -- 172.21.15.49:0/1418283066 --> v1:172.21.15.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c070dd0 con 0x7f917c073400 2024-01-31T12:09:20.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.338+0000 7f9179600640 1 -- 172.21.15.49:0/1418283066 <== mon.0 v1:172.21.15.49:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7f9174001a00 con 0x7f917c073400 2024-01-31T12:09:20.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.338+0000 7f9179600640 1 -- 172.21.15.49:0/1418283066 >> v1:172.21.15.49:6789/0 conn(0x7f917c073400 legacy=0x7f917c06d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:20.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.338+0000 7f9179600640 1 --2- 172.21.15.49:0/1418283066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f915c003980 0x7f915c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:20.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.338+0000 7f9179600640 1 --2- 172.21.15.49:0/1418283066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f915c004370 0x7f915c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:20.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.338+0000 7f9179600640 1 --2- 172.21.15.49:0/1418283066 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f915c005050 0x7f915c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:20.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.338+0000 7f9179600640 1 -- 172.21.15.49:0/1418283066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c15e690 con 0x7f915c004370 2024-01-31T12:09:20.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.338+0000 7f9179600640 1 -- 172.21.15.49:0/1418283066 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c157b70 con 0x7f915c003980 2024-01-31T12:09:20.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.338+0000 7f9179600640 1 -- 172.21.15.49:0/1418283066 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915c00bfb0 con 0x7f915c005050 2024-01-31T12:09:20.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.338+0000 7f917a000640 1 --2- 172.21.15.49:0/1418283066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f915c004370 0x7f915c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:20.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.338+0000 7f917aa00640 1 --2- 172.21.15.49:0/1418283066 >> v2:172.21.15.195:3300/0 conn(0x7f917c161850 0x7f917c0cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T12:09:20.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.338+0000 7f917b400640 1 --2- 172.21.15.49:0/1418283066 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f915c005050 0x7f915c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:20.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.342+0000 7f917a000640 1 -- 172.21.15.49:0/1418283066 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f915c005050 msgr2=0x7f915c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:20.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.342+0000 7f917a000640 1 --2- 172.21.15.49:0/1418283066 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f915c005050 0x7f915c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:20.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.342+0000 7f917a000640 1 -- 172.21.15.49:0/1418283066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f915c003980 msgr2=0x7f915c003da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-31T12:09:20.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.342+0000 7f917aa00640 1 --2- 172.21.15.49:0/1418283066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f915c003980 0x7f915c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:20.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.342+0000 7f917a000640 1 --2- 172.21.15.49:0/1418283066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f915c003980 0x7f915c003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:20.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.342+0000 7f917a000640 1 -- 172.21.15.49:0/1418283066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c070dd0 con 0x7f915c004370 2024-01-31T12:09:20.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.358+0000 7f917a000640 1 --2- 172.21.15.49:0/1418283066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f915c004370 0x7f915c004850 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f917c0cfff0 tx=0x7f916401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d4f466089f9200 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:20.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.358+0000 7f9179600640 1 -- 172.21.15.49:0/1418283066 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640ac600 con 0x7f915c004370 2024-01-31T12:09:20.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.358+0000 7f9179600640 1 -- 172.21.15.49:0/1418283066 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91640a8050 con 0x7f915c004370 2024-01-31T12:09:20.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.358+0000 7f9179600640 1 -- 172.21.15.49:0/1418283066 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640ac9e0 con 0x7f915c004370 2024-01-31T12:09:20.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.358+0000 7f917be00640 1 -- 172.21.15.49:0/1418283066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f915c004370 msgr2=0x7f915c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:20.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.358+0000 7f917be00640 1 --2- 172.21.15.49:0/1418283066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f915c004370 0x7f915c004850 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f917c0cfff0 tx=0x7f916401c450 comp rx=0 tx=0).stop 2024-01-31T12:09:20.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.358+0000 7f917b400640 1 -- 172.21.15.49:0/1418283066 reap_dead start 2024-01-31T12:09:20.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.358+0000 7f917be00640 1 -- 172.21.15.49:0/1418283066 shutdown_connections 2024-01-31T12:09:20.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.358+0000 7f917be00640 1 -- 172.21.15.49:0/1418283066 >> 172.21.15.49:0/1418283066 conn(0x7f917c0668d0 msgr2=0x7f917c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:20.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.358+0000 7f917be00640 1 -- 172.21.15.49:0/1418283066 shutdown_connections 2024-01-31T12:09:20.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.358+0000 7f917be00640 1 -- 172.21.15.49:0/1418283066 wait complete. 2024-01-31T12:09:20.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.366+0000 7f917be00640 1 Processor -- start 2024-01-31T12:09:20.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.366+0000 7f917be00640 1 -- start start 2024-01-31T12:09:20.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.370+0000 7f917be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f915c004370 0x7f917c14f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:20.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.370+0000 7f917be00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f917c152170 0x7f917c1525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:20.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.370+0000 7f917be00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f917c155f70 0x7f917c1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:20.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.370+0000 7f917be00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c152c10 con 0x7f917c155f70 2024-01-31T12:09:20.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.370+0000 7f917be00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c1f28e0 con 0x7f917c152170 2024-01-31T12:09:20.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.370+0000 7f917be00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c156930 con 0x7f915c004370 2024-01-31T12:09:20.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.370+0000 7f917aa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f915c004370 0x7f917c14f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:20.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.370+0000 7f917aa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f915c004370 0x7f917c14f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:40504/0 (socket says 172.21.15.49:40504) 2024-01-31T12:09:20.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.370+0000 7f917aa00640 1 -- 172.21.15.49:0/1534612741 learned_addr learned my addr 172.21.15.49:0/1534612741 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:20.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.370+0000 7f917a000640 1 --2- 172.21.15.49:0/1534612741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f917c152170 0x7f917c1525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:20.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.374+0000 7f917aa00640 1 -- 172.21.15.49:0/1534612741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f917c152170 msgr2=0x7f917c1525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:20.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.374+0000 7f917aa00640 1 --2- 172.21.15.49:0/1534612741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f917c152170 0x7f917c1525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:20.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.374+0000 7f917aa00640 1 -- 172.21.15.49:0/1534612741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f917c155f70 msgr2=0x7f917c1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:20.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.374+0000 7f917aa00640 1 --2- 172.21.15.49:0/1534612741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f917c155f70 0x7f917c1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:20.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.374+0000 7f917aa00640 1 -- 172.21.15.49:0/1534612741 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c1f2af0 con 0x7f915c004370 2024-01-31T12:09:20.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.374+0000 7f917aa00640 1 --2- 172.21.15.49:0/1534612741 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f915c004370 0x7f917c14f000 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f916c010a00 tx=0x7f916c010ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:20.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.374+0000 7f9173400640 1 -- 172.21.15.49:0/1534612741 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c00ebc0 con 0x7f915c004370 2024-01-31T12:09:20.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.374+0000 7f9173400640 1 -- 172.21.15.49:0/1534612741 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c00ed20 con 0x7f915c004370 2024-01-31T12:09:20.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.374+0000 7f917be00640 1 -- 172.21.15.49:0/1534612741 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917c1f2dd0 con 0x7f915c004370 2024-01-31T12:09:20.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.374+0000 7f917be00640 1 -- 172.21.15.49:0/1534612741 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917c1f3390 con 0x7f915c004370 2024-01-31T12:09:20.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.378+0000 7f9173400640 1 -- 172.21.15.49:0/1534612741 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c01c600 con 0x7f915c004370 2024-01-31T12:09:20.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.382+0000 7f917be00640 1 -- 172.21.15.49:0/1534612741 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917c1f35b0 con 0x7f915c004370 2024-01-31T12:09:20.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.382+0000 7f9173400640 1 -- 172.21.15.49:0/1534612741 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f916c01c760 con 0x7f915c004370 2024-01-31T12:09:20.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.386+0000 7f9173400640 1 --2- 172.21.15.49:0/1534612741 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9154066580 0x7f9154068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:20.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.386+0000 7f9173400640 1 -- 172.21.15.49:0/1534612741 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f916c0842a0 con 0x7f915c004370 2024-01-31T12:09:20.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.386+0000 7f917a000640 1 --2- 172.21.15.49:0/1534612741 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9154066580 0x7f9154068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:20.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.390+0000 7f917a000640 1 --2- 172.21.15.49:0/1534612741 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9154066580 0x7f9154068a40 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f917c0b2240 tx=0x7f91640046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:20.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:20.398+0000 7f9173400640 1 -- 172.21.15.49:0/1534612741 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f916c051750 con 0x7f915c004370 2024-01-31T12:09:21.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:21.470+0000 7f917be00640 1 -- 172.21.15.49:0/1534612741 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f917c0677d0 con 0x7f915c004370 2024-01-31T12:09:21.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:21.726+0000 7f9173400640 1 -- 172.21.15.49:0/1534612741 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v12843) v1 ==== 144+0+0 (secure 0 0 0) 0x7f916c054d70 con 0x7f915c004370 2024-01-31T12:09:21.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:21.742+0000 7f917be00640 1 -- 172.21.15.49:0/1534612741 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9154066580 msgr2=0x7f9154068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:21.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:21.742+0000 7f917be00640 1 --2- 172.21.15.49:0/1534612741 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9154066580 0x7f9154068a40 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f917c0b2240 tx=0x7f91640046d0 comp rx=0 tx=0).stop 2024-01-31T12:09:21.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:21.742+0000 7f917be00640 1 -- 172.21.15.49:0/1534612741 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f915c004370 msgr2=0x7f917c14f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:21.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:21.742+0000 7f917be00640 1 --2- 172.21.15.49:0/1534612741 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f915c004370 0x7f917c14f000 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f916c010a00 tx=0x7f916c010ec0 comp rx=0 tx=0).stop 2024-01-31T12:09:21.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:21.742+0000 7f917be00640 1 -- 172.21.15.49:0/1534612741 shutdown_connections 2024-01-31T12:09:21.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:21.742+0000 7f917be00640 1 --2- 172.21.15.49:0/1534612741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f917c155f70 0x7f917c1563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:21.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:21.742+0000 7f917be00640 1 --2- 172.21.15.49:0/1534612741 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9154066580 0x7f9154068a40 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:21.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:21.742+0000 7f917be00640 1 --2- 172.21.15.49:0/1534612741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f917c152170 0x7f917c1525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:21.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:21.742+0000 7f917be00640 1 --2- 172.21.15.49:0/1534612741 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f915c004370 0x7f917c14f000 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:21.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:21.742+0000 7f917be00640 1 -- 172.21.15.49:0/1534612741 >> 172.21.15.49:0/1534612741 conn(0x7f917c0668d0 msgr2=0x7f917c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:21.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:21.750+0000 7f917be00640 1 -- 172.21.15.49:0/1534612741 shutdown_connections 2024-01-31T12:09:21.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:21.750+0000 7f917be00640 1 -- 172.21.15.49:0/1534612741 wait complete. 2024-01-31T12:09:21.897 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2024-01-31T12:09:21.897 INFO:tasks.cephfs_test_runner: 2024-01-31T12:09:21.897 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-31T12:09:21.897 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-01-31T12:09:21.897 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-31T12:09:21.898 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-31T12:09:21.898 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-01-31T12:09:21.898 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-01-31T12:09:21.898 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-01-31T12:09:21.898 INFO:tasks.cephfs_test_runner:AssertionError: 17 != 0 2024-01-31T12:09:21.898 INFO:tasks.cephfs_test_runner: 2024-01-31T12:09:21.898 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-31T12:09:21.898 INFO:tasks.cephfs_test_runner:Ran 1 test in 25453.330s 2024-01-31T12:09:21.898 INFO:tasks.cephfs_test_runner: 2024-01-31T12:09:21.898 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-01-31T12:09:21.898 INFO:tasks.cephfs_test_runner: 2024-01-31T12:09:21.898 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-31T12:09:21.898 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-01-31T12:09:21.898 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-31T12:09:21.898 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-31T12:09:21.898 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-01-31T12:09:21.898 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-01-31T12:09:21.899 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-01-31T12:09:21.899 INFO:tasks.cephfs_test_runner:AssertionError: 17 != 0 2024-01-31T12:09:21.899 INFO:tasks.cephfs_test_runner: 2024-01-31T12:09:21.899 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs_test_runner.py", line 211, in task RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-01-31T12:09:22.129 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=21bd76ff615d44acb861ec82052920ba Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/cephfs_test_runner.py", line 211, in task RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-01-31T12:09:22.132 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-01-31T12:09:22.142 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-01-31T12:09:22.150 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-01-31T12:09:22.150 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T12:09:22.150 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T12:09:22.222 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354584k,nr_inodes=4088646,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275364k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=571 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275360k,nr_inodes=818840,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275364k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-01-31T12:09:22.223 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-01-31T12:09:22.223 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T12:09:22.327 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354584k,nr_inodes=4088646,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275364k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=571 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275360k,nr_inodes=818840,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275364k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-01-31T12:09:22.327 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T12:09:22.328 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T12:09:22.337 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354604k,nr_inodes=4088651,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2945 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275364k,nr_inodes=818841,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-31T12:09:22.337 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-31T12:09:22.337 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T12:09:22.386 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354604k,nr_inodes=4088651,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2945 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275364k,nr_inodes=818841,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-01-31T12:09:22.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T12:09:22.387 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-01-31T12:09:22.440 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-31T12:09:22.440 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-31T12:09:22.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T12:09:22.442 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-31T12:09:22.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T12:09:22.651 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-31T12:09:22.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T12:09:22.780 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-01-31T12:09:23.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T12:09:23.116 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-01-31T12:09:23.125 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-31T12:09:23.125 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-01-31T12:09:23.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T12:09:23.126 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-31T12:09:23.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T12:09:23.191 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-31T12:09:23.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T12:09:23.256 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-01-31T12:09:23.429 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-31T12:09:23.438 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-31T12:09:23.438 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-31T12:09:23.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.938+0000 7f5299400640 1 Processor -- start 2024-01-31T12:09:23.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.942+0000 7f5299400640 1 -- start start 2024-01-31T12:09:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.946+0000 7f5299400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f529406d3d0 0x7f52940ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.946+0000 7f5299400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52940ce560 0x7f5294070490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.950+0000 7f5298a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52940ce560 0x7f5294070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:23.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.950+0000 7f5298a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52940ce560 0x7f5294070490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:40510/0 (socket says 172.21.15.49:40510) 2024-01-31T12:09:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.950+0000 7f5293e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f529406e370 0x7f52940b3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:46158/0 (socket says 172.21.15.49:46158) 2024-01-31T12:09:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.950+0000 7f5299400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52940b2330 con 0x7f529406e370 2024-01-31T12:09:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.950+0000 7f5299400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52940b2eb0 con 0x7f529406d3d0 2024-01-31T12:09:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.950+0000 7f5299400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52940b2860 con 0x7f52940ce560 2024-01-31T12:09:23.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.950+0000 7f5298a00640 1 -- 172.21.15.49:0/3532065637 learned_addr learned my addr 172.21.15.49:0/3532065637 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:23.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.954+0000 7f5298a00640 1 -- 172.21.15.49:0/3532065637 >> v2:172.21.15.195:3300/0 conn(0x7f529406d3d0 msgr2=0x7f52940ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:23.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.954+0000 7f5298a00640 1 --2- 172.21.15.49:0/3532065637 >> v2:172.21.15.195:3300/0 conn(0x7f529406d3d0 0x7f52940ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:23.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.954+0000 7f5298a00640 1 -- 172.21.15.49:0/3532065637 >> v1:172.21.15.195:6789/0 conn(0x7f529406e370 legacy=0x7f52940b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:23.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.962+0000 7f5298a00640 1 -- 172.21.15.49:0/3532065637 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52940b2b40 con 0x7f52940ce560 2024-01-31T12:09:23.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.982+0000 7f5298a00640 1 --2- 172.21.15.49:0/3532065637 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52940ce560 0x7f5294070490 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5284009870 tx=0x7f528401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=186466376d544d37 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:23.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.986+0000 7f5292a00640 1 -- 172.21.15.49:0/3532065637 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52840ab600 con 0x7f52940ce560 2024-01-31T12:09:23.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.986+0000 7f5292a00640 1 -- 172.21.15.49:0/3532065637 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52840a7050 con 0x7f52940ce560 2024-01-31T12:09:23.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.986+0000 7f5292a00640 1 -- 172.21.15.49:0/3532065637 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52840ab980 con 0x7f52940ce560 2024-01-31T12:09:23.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.990+0000 7f5299400640 1 -- 172.21.15.49:0/3532065637 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52940ce560 msgr2=0x7f5294070490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:23.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.990+0000 7f5299400640 1 --2- 172.21.15.49:0/3532065637 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52940ce560 0x7f5294070490 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5284009870 tx=0x7f528401c470 comp rx=0 tx=0).stop 2024-01-31T12:09:23.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.998+0000 7f5299400640 1 -- 172.21.15.49:0/3532065637 shutdown_connections 2024-01-31T12:09:23.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.998+0000 7f5299400640 1 --2- 172.21.15.49:0/3532065637 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52940ce560 0x7f5294070490 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:23.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.998+0000 7f5299400640 1 --2- 172.21.15.49:0/3532065637 >> v2:172.21.15.195:3300/0 conn(0x7f529406d3d0 0x7f52940ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:23.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:23.998+0000 7f5299400640 1 -- 172.21.15.49:0/3532065637 >> 172.21.15.49:0/3532065637 conn(0x7f52940b0890 msgr2=0x7f52940b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:24.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.002+0000 7f5299400640 1 -- 172.21.15.49:0/3532065637 shutdown_connections 2024-01-31T12:09:24.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.002+0000 7f5299400640 1 -- 172.21.15.49:0/3532065637 wait complete. 2024-01-31T12:09:24.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.014+0000 7f5299400640 1 Processor -- start 2024-01-31T12:09:24.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.014+0000 7f5299400640 1 -- start start 2024-01-31T12:09:24.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.018+0000 7f5299400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529406d3d0 0x7f529414bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:24.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.018+0000 7f5299400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f529406e370 0x7f5294151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:24.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.018+0000 7f5293e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529406d3d0 0x7f529414bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:24.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.022+0000 7f5293e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529406d3d0 0x7f529414bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:40512/0 (socket says 172.21.15.49:40512) 2024-01-31T12:09:24.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.022+0000 7f5293e00640 1 -- 172.21.15.49:0/2846082502 learned_addr learned my addr 172.21.15.49:0/2846082502 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:24.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.022+0000 7f5299400640 1 --2- 172.21.15.49:0/2846082502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52940ce560 0x7f5294158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:24.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.022+0000 7f5299400640 1 -- 172.21.15.49:0/2846082502 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5294154e10 con 0x7f52940ce560 2024-01-31T12:09:24.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.022+0000 7f5299400640 1 -- 172.21.15.49:0/2846082502 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5294154200 con 0x7f529406e370 2024-01-31T12:09:24.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.022+0000 7f5299400640 1 -- 172.21.15.49:0/2846082502 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52941544e0 con 0x7f529406d3d0 2024-01-31T12:09:24.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.022+0000 7f5293e00640 1 -- 172.21.15.49:0/2846082502 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f529406e370 msgr2=0x7f5294151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:24.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.022+0000 7f5293e00640 1 --2- 172.21.15.49:0/2846082502 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f529406e370 0x7f5294151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:24.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.022+0000 7f5293e00640 1 -- 172.21.15.49:0/2846082502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52940ce560 msgr2=0x7f5294158660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-31T12:09:24.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.022+0000 7f5293e00640 1 --2- 172.21.15.49:0/2846082502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52940ce560 0x7f5294158660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:24.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.022+0000 7f5293e00640 1 -- 172.21.15.49:0/2846082502 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52840094d0 con 0x7f529406d3d0 2024-01-31T12:09:24.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.026+0000 7f5293e00640 1 --2- 172.21.15.49:0/2846082502 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529406d3d0 0x7f529414bc50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f527c00c460 tx=0x7f527c00c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:24.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.026+0000 7f528be00640 1 -- 172.21.15.49:0/2846082502 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c007480 con 0x7f529406d3d0 2024-01-31T12:09:24.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.026+0000 7f528be00640 1 -- 172.21.15.49:0/2846082502 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c0075e0 con 0x7f529406d3d0 2024-01-31T12:09:24.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.026+0000 7f5299400640 1 -- 172.21.15.49:0/2846082502 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52941547c0 con 0x7f529406d3d0 2024-01-31T12:09:24.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.026+0000 7f528be00640 1 -- 172.21.15.49:0/2846082502 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c007480 con 0x7f529406d3d0 2024-01-31T12:09:24.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.030+0000 7f5299400640 1 -- 172.21.15.49:0/2846082502 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529414c190 con 0x7f529406d3d0 2024-01-31T12:09:24.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.038+0000 7f528be00640 1 -- 172.21.15.49:0/2846082502 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f527c005820 con 0x7f529406d3d0 2024-01-31T12:09:24.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.042+0000 7f528be00640 1 --2- 172.21.15.49:0/2846082502 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f526c066590 0x7f526c068a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:24.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.042+0000 7f5299400640 1 -- 172.21.15.49:0/2846082502 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52940b06a0 con 0x7f529406d3d0 2024-01-31T12:09:24.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.042+0000 7f5293400640 1 --2- 172.21.15.49:0/2846082502 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f526c066590 0x7f526c068a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:24.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.046+0000 7f528be00640 1 -- 172.21.15.49:0/2846082502 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f527c0543f0 con 0x7f529406d3d0 2024-01-31T12:09:24.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.046+0000 7f5293400640 1 --2- 172.21.15.49:0/2846082502 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f526c066590 0x7f526c068a50 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f52940b1c60 tx=0x7f528c009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:24.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.054+0000 7f528be00640 1 -- 172.21.15.49:0/2846082502 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f527c017080 con 0x7f529406d3d0 2024-01-31T12:09:24.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:24.362+0000 7f5299400640 1 -- 172.21.15.49:0/2846082502 --> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5294154650 con 0x7f526c066590 2024-01-31T12:09:26.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.070+0000 7f528be00640 1 -- 172.21.15.49:0/2846082502 <== mgr.4100 v2:172.21.15.195:6832/3035808172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49686 (secure 0 0 0) 0x7f5294154650 con 0x7f526c066590 2024-01-31T12:09:26.071 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:09:26.072 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-31T12:09:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.074+0000 7f5299400640 1 -- 172.21.15.49:0/2846082502 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f526c066590 msgr2=0x7f526c068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.074+0000 7f5299400640 1 --2- 172.21.15.49:0/2846082502 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f526c066590 0x7f526c068a50 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f52940b1c60 tx=0x7f528c009250 comp rx=0 tx=0).stop 2024-01-31T12:09:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.074+0000 7f5299400640 1 -- 172.21.15.49:0/2846082502 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529406d3d0 msgr2=0x7f529414bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:26.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.074+0000 7f5299400640 1 --2- 172.21.15.49:0/2846082502 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529406d3d0 0x7f529414bc50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f527c00c460 tx=0x7f527c00c920 comp rx=0 tx=0).stop 2024-01-31T12:09:26.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.074+0000 7f5299400640 1 -- 172.21.15.49:0/2846082502 shutdown_connections 2024-01-31T12:09:26.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.074+0000 7f5299400640 1 --2- 172.21.15.49:0/2846082502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52940ce560 0x7f5294158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:26.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.074+0000 7f5299400640 1 --2- 172.21.15.49:0/2846082502 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f526c066590 0x7f526c068a50 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:26.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.074+0000 7f5299400640 1 --2- 172.21.15.49:0/2846082502 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f529406e370 0x7f5294151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:26.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.074+0000 7f5299400640 1 --2- 172.21.15.49:0/2846082502 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f529406d3d0 0x7f529414bc50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:26.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.074+0000 7f5299400640 1 -- 172.21.15.49:0/2846082502 >> 172.21.15.49:0/2846082502 conn(0x7f52940b0890 msgr2=0x7f5294159710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:26.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.074+0000 7f5299400640 1 -- 172.21.15.49:0/2846082502 shutdown_connections 2024-01-31T12:09:26.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.074+0000 7f5299400640 1 -- 172.21.15.49:0/2846082502 wait complete. 2024-01-31T12:09:26.103 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":12794,"stamp":"2024-01-31T12:09:23.368991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":145,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":30321872,"kb_used_data":17646924,"kb_used_omap":3047,"kb_used_meta":12473112,"kb_avail":724652848,"statfs":{"total":773094113280,"available":742044516352,"internally_reserved":0,"allocated":18070450176,"data_stored":18029785715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3120248,"internal_metadata":12772467592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":359,"apply_latency_ms":359,"commit_latency_ns":359000000,"apply_latency_ns":359000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-24642250994,"num_objects":-23340,"num_object_clones":0,"num_object_copies":-46680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23340,"num_whiteouts":0,"num_read":-1833196,"num_read_kb":-128930718,"num_write":-7583528,"num_write_kb":-167682859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1521,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.005624"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":425,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-01-31T12:09:17.423205+0000","last_change":"2024-01-31T05:04:05.699222+0000","last_active":"2024-01-31T12:09:17.423205+0000","last_peered":"2024-01-31T12:09:17.423205+0000","last_clean":"2024-01-31T12:09:17.423205+0000","last_became_active":"2024-01-31T05:04:05.698239+0000","last_became_peered":"2024-01-31T05:04:05.698239+0000","last_unstale":"2024-01-31T12:09:17.423205+0000","last_undegraded":"2024-01-31T12:09:17.423205+0000","last_fullsized":"2024-01-31T12:09:17.423205+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_clean_scrub_stamp":"2024-01-31T05:04:04.484734+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:05:13.736598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834579952,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4904808,"kb_used_data":3336352,"kb_used_omap":157,"kb_used_meta":1568290,"kb_avail":89467032,"statfs":{"total":96636764160,"available":91614240768,"internally_reserved":0,"allocated":3416424448,"data_stored":3408767781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":161111,"internal_metadata":1605929641},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:34 2024","interfaces":[{"interface":"back","average":{"1min":4.8369999999999997,"5min":2.3380000000000001,"15min":1.8819999999999999},"min":{"1min":0.39500000000000002,"5min":0.34899999999999998,"15min":0.33700000000000002},"max":{"1min":50.472000000000001,"5min":50.472000000000001,"15min":50.472000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":6.3970000000000002,"5min":2.875,"15min":2.085},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":64.932000000000002,"5min":64.932000000000002,"15min":64.932000000000002},"last":1.0289999999999999}]},{"osd":1,"last update":"Wed Jan 31 12:08:34 2024","interfaces":[{"interface":"back","average":{"1min":2.4129999999999998,"5min":1.508,"15min":1.7769999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.377},"max":{"1min":15.550000000000001,"5min":15.550000000000001,"15min":18.547999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":3.0800000000000001,"5min":1.6679999999999999,"15min":1.744},"min":{"1min":0.433,"5min":0.433,"15min":0.34799999999999998},"max":{"1min":14.384,"5min":14.384,"15min":14.384},"last":0.755}]},{"osd":2,"last update":"Wed Jan 31 12:09:18 2024","interfaces":[{"interface":"back","average":{"1min":2.8439999999999999,"5min":1.8700000000000001,"15min":2.0059999999999998},"min":{"1min":0.54400000000000004,"5min":0.47599999999999998,"15min":0.45200000000000001},"max":{"1min":19.978000000000002,"5min":19.978000000000002,"15min":19.978000000000002},"last":0.77900000000000003},{"interface":"front","average":{"1min":2.6299999999999999,"5min":2.5209999999999999,"15min":2.1389999999999998},"min":{"1min":0.75700000000000001,"5min":0.44500000000000001,"15min":0.41799999999999998},"max":{"1min":6.8049999999999997,"5min":65.054000000000002,"15min":65.054000000000002},"last":1.052}]},{"osd":3,"last update":"Wed Jan 31 12:08:34 2024","interfaces":[{"interface":"back","average":{"1min":2.8159999999999998,"5min":1.827,"15min":1.8500000000000001},"min":{"1min":0.57699999999999996,"5min":0.45200000000000001,"15min":0.435},"max":{"1min":13.285,"5min":13.285,"15min":13.285},"last":0.79300000000000004},{"interface":"front","average":{"1min":5.9560000000000004,"5min":2.5089999999999999,"15min":1.9850000000000001},"min":{"1min":0.55900000000000005,"5min":0.46899999999999997,"15min":0.44},"max":{"1min":65.019000000000005,"5min":65.019000000000005,"15min":65.019000000000005},"last":0.70399999999999996}]},{"osd":4,"last update":"Wed Jan 31 12:08:34 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":0.77100000000000002,"15min":0.66900000000000004},"min":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.32100000000000001},"max":{"1min":6.1760000000000002,"5min":6.1760000000000002,"15min":6.1760000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":1.615,"5min":0.94999999999999996,"15min":0.73999999999999999},"min":{"1min":0.42399999999999999,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":9.7100000000000009,"5min":9.7100000000000009,"15min":9.7100000000000009},"last":0.45800000000000002}]},{"osd":5,"last update":"Wed Jan 31 12:08:34 2024","interfaces":[{"interface":"back","average":{"1min":5.0090000000000003,"5min":1.663,"15min":0.97499999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.35699999999999998},"max":{"1min":64.986999999999995,"5min":64.986999999999995,"15min":64.986999999999995},"last":0.434},{"interface":"front","average":{"1min":5.048,"5min":1.617,"15min":1.0229999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.36799999999999999},"max":{"1min":64.644000000000005,"5min":64.644000000000005,"15min":64.644000000000005},"last":0.52400000000000002}]},{"osd":6,"last update":"Wed Jan 31 12:08:34 2024","interfaces":[{"interface":"back","average":{"1min":1.677,"5min":0.997,"15min":0.89000000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.40999999999999998},"max":{"1min":15.616,"5min":15.616,"15min":15.616},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.071,"15min":0.85399999999999998},"min":{"1min":0.46600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":9.6329999999999991,"5min":11.195,"15min":11.195},"last":0.49299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834579953,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1469656,"kb_used_data":13324,"kb_used_omap":156,"kb_used_meta":1456163,"kb_avail":92902184,"statfs":{"total":96636764160,"available":95131836416,"internally_reserved":0,"allocated":13643776,"data_stored":13312621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":160451,"internal_metadata":1491111229},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:55 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.7989999999999999,"15min":1.7989999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.312},"max":{"1min":4.6580000000000004,"5min":31.861000000000001,"15min":54.527000000000001},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.5489999999999999,"15min":1.7649999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.34000000000000002},"max":{"1min":4.7140000000000004,"5min":5.71,"15min":54.466999999999999},"last":1.327}]},{"osd":1,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.478,"15min":1.8360000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":4.048,"5min":19.844999999999999,"15min":28.239000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.488,"5min":1.8620000000000001,"15min":1.9299999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.38400000000000001},"max":{"1min":4.1689999999999996,"5min":13.847,"15min":28.364000000000001},"last":1.0049999999999999}]},{"osd":2,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":2.052,"15min":1.9750000000000001},"min":{"1min":0.60499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.8490000000000002,"5min":27.777999999999999,"15min":27.783999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.9670000000000001,"5min":3.1899999999999999,"15min":2.3079999999999998},"min":{"1min":0.68600000000000005,"5min":0.46100000000000002,"15min":0.436},"max":{"1min":7.6669999999999998,"5min":159.67400000000001,"15min":159.67400000000001},"last":0.83799999999999997}]},{"osd":3,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.4419999999999999,"15min":1.8069999999999999},"min":{"1min":0.67300000000000004,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":2.194,"5min":8.1300000000000008,"15min":32.295999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.319,"5min":2.1890000000000001,"15min":2.1139999999999999},"min":{"1min":0.64700000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.71,"5min":27.905000000000001,"15min":33.198},"last":0.77200000000000002}]},{"osd":4,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.73699999999999999,"15min":0.71399999999999997},"min":{"1min":0.40600000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.946,"5min":16.628,"15min":16.628},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.70899999999999996},"min":{"1min":0.39300000000000002,"5min":0.378,"15min":0.36899999999999999},"max":{"1min":1.5600000000000001,"5min":4.8460000000000001,"15min":4.8460000000000001},"last":0.70399999999999996}]},{"osd":5,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.83399999999999996,"15min":0.87},"min":{"1min":0.45300000000000001,"5min":0.35399999999999998,"15min":0.33600000000000002},"max":{"1min":0.95199999999999996,"5min":19.120999999999999,"15min":36.438000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.86699999999999999,"15min":0.90100000000000002},"min":{"1min":0.42199999999999999,"5min":0.41199999999999998,"15min":0.372},"max":{"1min":2.056,"5min":23.087,"15min":31.077999999999999},"last":0.68100000000000005}]},{"osd":7,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65200000000000002,"15min":0.73999999999999999},"min":{"1min":0.46200000000000002,"5min":0.45000000000000001,"15min":0.33800000000000002},"max":{"1min":1.4990000000000001,"5min":1.613,"15min":4.3499999999999996},"last":0.752},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.92600000000000005,"15min":0.82799999999999996},"min":{"1min":0.498,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.077,"5min":20.317,"15min":20.317},"last":0.46999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834579952,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3763752,"kb_used_data":2685300,"kb_used_omap":757,"kb_used_meta":1039370,"kb_avail":90608088,"statfs":{"total":96636764160,"available":92782682112,"internally_reserved":0,"allocated":2749747200,"data_stored":2743804035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":775603,"internal_metadata":1064315469},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:23 2024","interfaces":[{"interface":"back","average":{"1min":3.5179999999999998,"5min":5.2800000000000002,"15min":2.7749999999999999},"min":{"1min":0.41199999999999998,"5min":0.35499999999999998,"15min":0.29699999999999999},"max":{"1min":33.741999999999997,"5min":281.83499999999998,"15min":281.83499999999998},"last":31.5},{"interface":"front","average":{"1min":3.4390000000000001,"5min":5.1180000000000003,"15min":2.8610000000000002},"min":{"1min":0.434,"5min":0.37,"15min":0.34300000000000003},"max":{"1min":35.189,"5min":277.49700000000001,"15min":277.49700000000001},"last":31.524999999999999}]},{"osd":1,"last update":"Wed Jan 31 12:08:23 2024","interfaces":[{"interface":"back","average":{"1min":4.7939999999999996,"5min":2.21,"15min":1.915},"min":{"1min":0.61299999999999999,"5min":0.372,"15min":0.372},"max":{"1min":18.466000000000001,"5min":18.466000000000001,"15min":18.466000000000001},"last":24.248000000000001},{"interface":"front","average":{"1min":3.375,"5min":2.1890000000000001,"15min":1.9430000000000001},"min":{"1min":0.45400000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":16.378,"5min":16.378,"15min":16.378},"last":32.128999999999998}]},{"osd":2,"last update":"Wed Jan 31 12:08:23 2024","interfaces":[{"interface":"back","average":{"1min":2.738,"5min":5.101,"15min":3.5},"min":{"1min":0.66300000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":11.99,"5min":279.86399999999998,"15min":279.86399999999998},"last":36},{"interface":"front","average":{"1min":3.8119999999999998,"5min":5.2359999999999998,"15min":3.5979999999999999},"min":{"1min":0.60499999999999998,"5min":0.50700000000000001,"15min":0.40999999999999998},"max":{"1min":23.905999999999999,"5min":279.15699999999998,"15min":279.15699999999998},"last":35.978999999999999}]},{"osd":3,"last update":"Wed Jan 31 12:08:23 2024","interfaces":[{"interface":"back","average":{"1min":3.0779999999999998,"5min":2.0790000000000002,"15min":2.4590000000000001},"min":{"1min":0.58799999999999997,"5min":0.51900000000000002,"15min":0.435},"max":{"1min":21.428000000000001,"5min":21.428000000000001,"15min":160.709},"last":32.176000000000002},{"interface":"front","average":{"1min":2.4329999999999998,"5min":2.0259999999999998,"15min":2.5790000000000002},"min":{"1min":0.79200000000000004,"5min":0.57899999999999996,"15min":0.46300000000000002},"max":{"1min":11.933999999999999,"5min":11.933999999999999,"15min":162.26599999999999},"last":35.912999999999997}]},{"osd":4,"last update":"Wed Jan 31 12:08:23 2024","interfaces":[{"interface":"back","average":{"1min":1.766,"5min":0.93200000000000005,"15min":0.69899999999999995},"min":{"1min":0.372,"5min":0.317,"15min":0.317},"max":{"1min":12.068,"5min":12.068,"15min":12.068},"last":32.652999999999999},{"interface":"front","average":{"1min":1.849,"5min":0.89500000000000002,"15min":0.73999999999999999},"min":{"1min":0.435,"5min":0.36299999999999999,"15min":0.33200000000000002},"max":{"1min":16.329000000000001,"5min":16.329000000000001,"15min":16.329000000000001},"last":32.247}]},{"osd":6,"last update":"Wed Jan 31 12:08:23 2024","interfaces":[{"interface":"back","average":{"1min":2.351,"5min":1.0189999999999999,"15min":0.77100000000000002},"min":{"1min":0.42199999999999999,"5min":0.35799999999999998,"15min":0.34100000000000003},"max":{"1min":15.819000000000001,"5min":15.819000000000001,"15min":15.819000000000001},"last":35.957999999999998},{"interface":"front","average":{"1min":1.6279999999999999,"5min":0.94099999999999995,"15min":0.75800000000000001},"min":{"1min":0.48799999999999999,"5min":0.40100000000000002,"15min":0.38},"max":{"1min":12.109999999999999,"5min":12.109999999999999,"15min":12.109999999999999},"last":36.444000000000003}]},{"osd":7,"last update":"Wed Jan 31 12:08:23 2024","interfaces":[{"interface":"back","average":{"1min":3.2360000000000002,"5min":1.264,"15min":0.90300000000000002},"min":{"1min":0.45700000000000002,"5min":0.38100000000000001,"15min":0.375},"max":{"1min":39.918999999999997,"5min":39.918999999999997,"15min":39.918999999999997},"last":32.799999999999997},{"interface":"front","average":{"1min":3.2410000000000001,"5min":1.2589999999999999,"15min":0.90700000000000003},"min":{"1min":0.54900000000000004,"5min":0.44800000000000001,"15min":0.42599999999999999},"max":{"1min":39.860999999999997,"5min":39.860999999999997,"15min":39.860999999999997},"last":36.073999999999998}]}]},{"osd":4,"up_from":13,"seq":55834579952,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4354600,"kb_used_data":2632220,"kb_used_omap":549,"kb_used_meta":1721818,"kb_avail":90017240,"statfs":{"total":96636764160,"available":92177653760,"internally_reserved":0,"allocated":2695393280,"data_stored":2689299404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":562466,"internal_metadata":1763142366},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.242,"15min":2.0920000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36299999999999999},"max":{"1min":5.7450000000000001,"5min":14.096,"15min":158.78200000000001},"last":0.624},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.4750000000000001,"15min":2.2029999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.33900000000000002},"max":{"1min":5.5800000000000001,"5min":5.5800000000000001,"15min":158.45400000000001},"last":0.74099999999999999}]},{"osd":1,"last update":"Wed Jan 31 12:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":2.028,"15min":2.2949999999999999},"min":{"1min":0.54000000000000004,"5min":0.42199999999999999,"15min":0.38100000000000001},"max":{"1min":3.5779999999999998,"5min":11.077999999999999,"15min":158.959},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.9630000000000001,"15min":2.3980000000000001},"min":{"1min":0.58999999999999997,"5min":0.50700000000000001,"15min":0.35199999999999998},"max":{"1min":4.5620000000000003,"5min":9.2490000000000006,"15min":158.69200000000001},"last":0.78800000000000003}]},{"osd":2,"last update":"Wed Jan 31 12:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":2.0910000000000002,"15min":2.3700000000000001},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.5920000000000001,"5min":7.8890000000000002,"15min":158.232},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.718,"5min":1.984,"15min":2.3759999999999999},"min":{"1min":0.623,"5min":0.44700000000000001,"15min":0.438},"max":{"1min":4.0979999999999999,"5min":12.132999999999999,"15min":157.76300000000001},"last":0.71099999999999997}]},{"osd":3,"last update":"Wed Jan 31 12:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.9399999999999999,"5min":1.891,"15min":2.3330000000000002},"min":{"1min":0.69899999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.5590000000000002,"5min":6.5949999999999998,"15min":155.27799999999999},"last":1.071},{"interface":"front","average":{"1min":1.716,"5min":1.5760000000000001,"15min":2.2719999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":4.8029999999999999,"5min":8.8300000000000001,"15min":156.81700000000001},"last":1}]},{"osd":5,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.79600000000000004,"15min":0.67800000000000005},"min":{"1min":0.42399999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.93500000000000005,"5min":9.1120000000000001,"15min":9.1120000000000001},"last":0.437},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72699999999999998,"15min":0.69299999999999995},"min":{"1min":0.53700000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91100000000000003,"5min":4.3959999999999999,"15min":4.6840000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.81799999999999995,"15min":0.73299999999999998},"min":{"1min":0.46200000000000002,"5min":0.379,"15min":0.35699999999999998},"max":{"1min":3.294,"5min":7.7930000000000001,"15min":7.7930000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.82099999999999995,"15min":0.72199999999999998},"min":{"1min":0.51300000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.2929999999999999,"5min":11.791,"15min":11.791},"last":0.55500000000000005}]},{"osd":7,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79000000000000004,"15min":0.73299999999999998},"min":{"1min":0.502,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.5840000000000001,"5min":4.0919999999999996,"15min":5.5869999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.878,"15min":0.78900000000000003},"min":{"1min":0.504,"5min":0.41399999999999998,"15min":0.38800000000000001},"max":{"1min":3.395,"5min":7.8449999999999998,"15min":7.8449999999999998},"last":0.68400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834579899,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4261056,"kb_used_data":2562520,"kb_used_omap":532,"kb_used_meta":1668843,"kb_avail":90110784,"statfs":{"total":96636764160,"available":92273442816,"internally_reserved":0,"allocated":2624020480,"data_stored":2618104852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":545051,"internal_metadata":1708895973},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":88,"apply_latency_ms":88,"commit_latency_ns":88000000,"apply_latency_ns":88000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":4.0439999999999996,"5min":5.9880000000000004,"15min":4.0800000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.28000000000000003},"max":{"1min":14.579000000000001,"5min":273.40300000000002,"15min":273.40300000000002},"last":0.89400000000000002},{"interface":"front","average":{"1min":2.4500000000000002,"5min":5.8250000000000002,"15min":4.2130000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":8.2390000000000008,"5min":278.26600000000002,"15min":278.26600000000002},"last":0.79500000000000004}]},{"osd":1,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":2.6299999999999999,"5min":2.653,"15min":3.1669999999999998},"min":{"1min":0.73199999999999998,"5min":0.55500000000000005,"15min":0.42499999999999999},"max":{"1min":5.6299999999999999,"5min":8.9390000000000001,"15min":13.497},"last":11.002000000000001},{"interface":"front","average":{"1min":3.633,"5min":2.8919999999999999,"15min":3.2919999999999998},"min":{"1min":0.93000000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":7.0149999999999997,"5min":7.9969999999999999,"15min":12.76},"last":12.151}]},{"osd":2,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":2.2370000000000001,"5min":5.9370000000000003,"15min":4.1760000000000002},"min":{"1min":0.629,"5min":0.629,"15min":0.38500000000000001},"max":{"1min":7.6799999999999997,"5min":278.33300000000003,"15min":278.33300000000003},"last":12.004},{"interface":"front","average":{"1min":4.6050000000000004,"5min":6.5,"15min":4.4459999999999997},"min":{"1min":0.85999999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":14.929,"5min":273.27100000000002,"15min":273.27100000000002},"last":12.099}]},{"osd":4,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.9179999999999999,"5min":2.194,"15min":2.536},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.47499999999999998},"max":{"1min":5.8150000000000004,"5min":7.4550000000000001,"15min":9.7460000000000004},"last":1.546},{"interface":"front","average":{"1min":2.2080000000000002,"5min":2.1749999999999998,"15min":2.391},"min":{"1min":0.88200000000000001,"5min":0.59999999999999998,"15min":0.502},"max":{"1min":5.6239999999999997,"5min":6.2089999999999996,"15min":13.093},"last":1.9399999999999999}]},{"osd":5,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":2.653,"5min":2.3149999999999999,"15min":2.77},"min":{"1min":0.89900000000000002,"5min":0.627,"15min":0.52100000000000002},"max":{"1min":11.385,"5min":11.385,"15min":55.942999999999998},"last":1.8169999999999999},{"interface":"front","average":{"1min":2.9900000000000002,"5min":2.5179999999999998,"15min":2.7709999999999999},"min":{"1min":0.52700000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":6.7130000000000001,"5min":7.556,"15min":56.850999999999999},"last":1.879}]},{"osd":6,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":3.706,"5min":2.657,"15min":2.7120000000000002},"min":{"1min":0.59699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":14.464,"5min":14.464,"15min":14.464},"last":1.234},{"interface":"front","average":{"1min":2.012,"5min":2.3570000000000002,"15min":2.718},"min":{"1min":0.67000000000000004,"5min":0.61099999999999999,"15min":0.51300000000000001},"max":{"1min":5.8739999999999997,"5min":9.5690000000000008,"15min":9.6989999999999998},"last":1.5049999999999999}]},{"osd":7,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":2.8039999999999998,"5min":2.5539999999999998,"15min":3.0950000000000002},"min":{"1min":0.76000000000000001,"5min":0.65600000000000003,"15min":0.56399999999999995},"max":{"1min":17.34,"5min":17.34,"15min":55.713999999999999},"last":12.066000000000001},{"interface":"front","average":{"1min":3.1160000000000001,"5min":2.5950000000000002,"15min":2.9279999999999999},"min":{"1min":1.044,"5min":0.61699999999999999,"15min":0.58699999999999997},"max":{"1min":17.274000000000001,"5min":17.274000000000001,"15min":55.619},"last":11.148999999999999}]}]},{"osd":2,"up_from":13,"seq":55834579907,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5106512,"kb_used_data":3328132,"kb_used_omap":168,"kb_used_meta":1778199,"kb_avail":89265328,"statfs":{"total":96636764160,"available":91407695872,"internally_reserved":0,"allocated":3408007168,"data_stored":3400511120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":173049,"internal_metadata":1820875783},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":4.5140000000000002,"5min":2.7429999999999999,"15min":2.972},"min":{"1min":0.55500000000000005,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":26.771000000000001,"5min":26.771000000000001,"15min":26.771000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":3.923,"5min":3.0449999999999999,"15min":3.1269999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.41499999999999998},"max":{"1min":14.548999999999999,"5min":14.548999999999999,"15min":14.548999999999999},"last":1.5880000000000001}]},{"osd":1,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":3.202,"5min":3.7440000000000002,"15min":3.3359999999999999},"min":{"1min":0.438,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":7.8220000000000001,"5min":48.207999999999998,"15min":48.207999999999998},"last":1.5169999999999999},{"interface":"front","average":{"1min":4.6189999999999998,"5min":4.0439999999999996,"15min":3.6749999999999998},"min":{"1min":0.624,"5min":0.60899999999999999,"15min":0.35799999999999998},"max":{"1min":23.408000000000001,"5min":49.024999999999999,"15min":49.024999999999999},"last":1.4570000000000001}]},{"osd":3,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":5.9969999999999999,"5min":4.0460000000000003,"15min":3.7519999999999998},"min":{"1min":0.75,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":35.802,"5min":35.802,"15min":35.802},"last":0.84599999999999997},{"interface":"front","average":{"1min":5.0519999999999996,"5min":4.5519999999999996,"15min":3.944},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.47299999999999998},"max":{"1min":30.472999999999999,"5min":48.682000000000002,"15min":48.682000000000002},"last":1.3580000000000001}]},{"osd":4,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":4.585,"5min":3.0030000000000001,"15min":2.7410000000000001},"min":{"1min":0.63700000000000001,"5min":0.54300000000000004,"15min":0.50700000000000001},"max":{"1min":33.631,"5min":33.631,"15min":33.631},"last":1.2949999999999999},{"interface":"front","average":{"1min":4.1829999999999998,"5min":2.9620000000000002,"15min":2.847},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":33.277000000000001,"5min":33.277000000000001,"15min":33.277000000000001},"last":1.248}]},{"osd":5,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":6.665,"5min":3.512,"15min":3.0139999999999998},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.55000000000000004},"max":{"1min":44.935000000000002,"5min":44.935000000000002,"15min":44.935000000000002},"last":1.1559999999999999},{"interface":"front","average":{"1min":4.835,"5min":3.077,"15min":2.98},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":44.590000000000003,"5min":44.590000000000003,"15min":44.590000000000003},"last":1.087}]},{"osd":6,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":3.9449999999999998,"5min":2.6739999999999999,"15min":2.5979999999999999},"min":{"1min":0.83499999999999996,"5min":0.66200000000000003,"15min":0.60099999999999998},"max":{"1min":26.259,"5min":26.259,"15min":26.259},"last":0.98899999999999999},{"interface":"front","average":{"1min":3.601,"5min":3.0329999999999999,"15min":2.98},"min":{"1min":0.71499999999999997,"5min":0.70799999999999996,"15min":0.56899999999999995},"max":{"1min":12.18,"5min":13.839,"15min":19.888999999999999},"last":1.2230000000000001}]},{"osd":7,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":2.7730000000000001,"5min":2.6509999999999998,"15min":2.6389999999999998},"min":{"1min":0.89800000000000002,"5min":0.69199999999999995,"15min":0.56799999999999995},"max":{"1min":7.7130000000000001,"5min":11.544,"15min":11.81},"last":1.0649999999999999},{"interface":"front","average":{"1min":3.7349999999999999,"5min":3.105,"15min":3.1230000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":23.294,"5min":23.294,"15min":23.294},"last":1.393}]}]},{"osd":1,"up_from":13,"seq":55834579917,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3899628,"kb_used_data":2432224,"kb_used_omap":400,"kb_used_meta":1466991,"kb_avail":90472212,"statfs":{"total":96636764160,"available":92643545088,"internally_reserved":0,"allocated":2490597376,"data_stored":2484951142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":410545,"internal_metadata":1502198863},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.532,"5min":2.9990000000000001,"15min":3.2010000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":6.5759999999999996,"5min":17.189,"15min":115.23699999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":2.4079999999999999,"5min":2.7799999999999998,"15min":3.3940000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.32600000000000001},"max":{"1min":5.4299999999999997,"5min":9.3670000000000009,"15min":114.834},"last":0.99199999999999999}]},{"osd":2,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.976,"5min":3.2810000000000001,"15min":3.3079999999999998},"min":{"1min":0.64000000000000001,"5min":0.621,"15min":0.40799999999999997},"max":{"1min":7.274,"5min":13.641,"15min":22.890000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":2.581,"5min":3.476,"15min":3.359},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":6.6879999999999997,"5min":17.297000000000001,"15min":17.297000000000001},"last":1.5129999999999999}]},{"osd":3,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.758,"5min":3.6819999999999999,"15min":3.569},"min":{"1min":0.503,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":7.6760000000000002,"5min":18.832999999999998,"15min":18.832999999999998},"last":1.9319999999999999},{"interface":"front","average":{"1min":3.4860000000000002,"5min":3.605,"15min":3.456},"min":{"1min":0.85699999999999998,"5min":0.52300000000000002,"15min":0.438},"max":{"1min":7.1639999999999997,"5min":26.114999999999998,"15min":26.114999999999998},"last":1.1259999999999999}]},{"osd":4,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.4689999999999999,"5min":2.6120000000000001,"15min":2.5259999999999998},"min":{"1min":0.625,"5min":0.61199999999999999,"15min":0.48299999999999998},"max":{"1min":6.7069999999999999,"5min":9.0830000000000002,"15min":10.266999999999999},"last":1.1699999999999999},{"interface":"front","average":{"1min":2.4590000000000001,"5min":2.5009999999999999,"15min":2.343},"min":{"1min":0.71399999999999997,"5min":0.56899999999999995,"15min":0.50700000000000001},"max":{"1min":7.3979999999999997,"5min":13.512,"15min":22.774000000000001},"last":1.4039999999999999}]},{"osd":5,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.5139999999999998,"5min":2.569,"15min":2.4009999999999998},"min":{"1min":0.75800000000000001,"5min":0.64200000000000002,"15min":0.51200000000000001},"max":{"1min":7.5039999999999996,"5min":13.734999999999999,"15min":13.734999999999999},"last":1.3169999999999999},{"interface":"front","average":{"1min":2.2639999999999998,"5min":2.7730000000000001,"15min":2.5339999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":7.3760000000000003,"5min":17.056999999999999,"15min":17.056999999999999},"last":1.6930000000000001}]},{"osd":6,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.7269999999999999,"5min":2.903,"15min":2.6880000000000002},"min":{"1min":0.80600000000000005,"5min":0.68600000000000005,"15min":0.52600000000000002},"max":{"1min":6.8289999999999997,"5min":12.571999999999999,"15min":12.571999999999999},"last":1.4750000000000001},{"interface":"front","average":{"1min":2.9769999999999999,"5min":2.8559999999999999,"15min":2.589},"min":{"1min":0.79000000000000004,"5min":0.61399999999999999,"15min":0.54600000000000004},"max":{"1min":8.5289999999999999,"5min":13.827999999999999,"15min":13.827999999999999},"last":1.6060000000000001}]},{"osd":7,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.464,"5min":3.1589999999999998,"15min":2.7170000000000001},"min":{"1min":0.77400000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":7.5510000000000002,"5min":18.960999999999999,"15min":18.960999999999999},"last":1.8160000000000001},{"interface":"front","average":{"1min":2.6419999999999999,"5min":3.2050000000000001,"15min":2.919},"min":{"1min":0.89600000000000002,"5min":0.64900000000000002,"15min":0.53900000000000003},"max":{"1min":6.9320000000000004,"5min":24.904,"15min":24.904},"last":1.3460000000000001}]}]},{"osd":0,"up_from":13,"seq":55834579912,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2561860,"kb_used_data":656852,"kb_used_omap":324,"kb_used_meta":1773435,"kb_avail":91809980,"statfs":{"total":96636764160,"available":94013419520,"internally_reserved":0,"allocated":672616448,"data_stored":671034760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":331972,"internal_metadata":1815998268},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":91,"apply_latency_ms":91,"commit_latency_ns":91000000,"apply_latency_ns":91000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":4.492,"5min":3.2429999999999999,"15min":3.1539999999999999},"min":{"1min":0.747,"5min":0.58699999999999997,"15min":0.48499999999999999},"max":{"1min":25.902000000000001,"5min":25.902000000000001,"15min":25.902000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":4.1260000000000003,"5min":3.125,"15min":3.1150000000000002},"min":{"1min":0.98899999999999999,"5min":0.55800000000000005,"15min":0.30499999999999999},"max":{"1min":26.027999999999999,"5min":26.027999999999999,"15min":26.027999999999999},"last":1.2589999999999999}]},{"osd":2,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":4.4299999999999997,"5min":3.4180000000000001,"15min":3.3399999999999999},"min":{"1min":0.67200000000000004,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":18.809999999999999,"5min":24.140999999999998,"15min":25.704999999999998},"last":1.048},{"interface":"front","average":{"1min":3.8660000000000001,"5min":3.3639999999999999,"15min":3.2280000000000002},"min":{"1min":0.68200000000000005,"5min":0.68100000000000005,"15min":0.504},"max":{"1min":16.922000000000001,"5min":17.381,"15min":25.126000000000001},"last":1.502}]},{"osd":3,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":3.5259999999999998,"5min":3.7450000000000001,"15min":3.4550000000000001},"min":{"1min":0.60699999999999998,"5min":0.52800000000000002,"15min":0.39700000000000002},"max":{"1min":10.241,"5min":32.636000000000003,"15min":32.636000000000003},"last":0.79500000000000004},{"interface":"front","average":{"1min":4.7069999999999999,"5min":3.8660000000000001,"15min":3.7839999999999998},"min":{"1min":0.97899999999999998,"5min":0.56599999999999995,"15min":0.51200000000000001},"max":{"1min":18.385999999999999,"5min":26.202000000000002,"15min":26.202000000000002},"last":1.456}]},{"osd":4,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":2.1000000000000001,"5min":2.375,"15min":2.3799999999999999},"min":{"1min":0.876,"5min":0.70199999999999996,"15min":0.54300000000000004},"max":{"1min":5.3929999999999998,"5min":13.472,"15min":13.472},"last":0.98799999999999999},{"interface":"front","average":{"1min":3.2839999999999998,"5min":2.6429999999999998,"15min":2.3809999999999998},"min":{"1min":0.82199999999999995,"5min":0.60299999999999998,"15min":0.49199999999999999},"max":{"1min":9.9039999999999999,"5min":28.151,"15min":28.151},"last":0.75600000000000001}]},{"osd":5,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":3.0430000000000001,"5min":2.726,"15min":2.7229999999999999},"min":{"1min":0.999,"5min":0.67300000000000004,"15min":0.46600000000000003},"max":{"1min":8.1099999999999994,"5min":16.670000000000002,"15min":25.186},"last":1.177},{"interface":"front","average":{"1min":2.6989999999999998,"5min":2.6829999999999998,"15min":2.6150000000000002},"min":{"1min":0.93700000000000006,"5min":0.69799999999999995,"15min":0.57099999999999995},"max":{"1min":9.1289999999999996,"5min":11.199,"15min":25.013000000000002},"last":1.1339999999999999}]},{"osd":6,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":3.3700000000000001,"5min":2.8650000000000002,"15min":2.4980000000000002},"min":{"1min":0.79500000000000004,"5min":0.72499999999999998,"15min":0.53600000000000003},"max":{"1min":10.036,"5min":27.925999999999998,"15min":27.925999999999998},"last":331.28199999999998},{"interface":"front","average":{"1min":3.7170000000000001,"5min":2.9649999999999999,"15min":2.8849999999999998},"min":{"1min":1.1220000000000001,"5min":0.71199999999999997,"15min":0.55500000000000005},"max":{"1min":16.567,"5min":19.242999999999999,"15min":25.300000000000001},"last":330.95100000000002}]},{"osd":7,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":3.3050000000000002,"5min":3.2549999999999999,"15min":2.9199999999999999},"min":{"1min":1.046,"5min":0.77900000000000003,"15min":0.58899999999999997},"max":{"1min":17.152999999999999,"5min":53.951000000000001,"15min":53.951000000000001},"last":1.365},{"interface":"front","average":{"1min":3.407,"5min":3.202,"15min":2.7490000000000001},"min":{"1min":0.89400000000000002,"5min":0.65400000000000003,"15min":0.57199999999999995},"max":{"1min":10.141999999999999,"5min":28.053000000000001,"15min":28.053000000000001},"last":0.93400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-31T12:09:26.104 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-31T12:09:26.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.506+0000 7f9a62600640 1 Processor -- start 2024-01-31T12:09:26.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.506+0000 7f9a62600640 1 -- start start 2024-01-31T12:09:26.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.510+0000 7f9a62600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9a5c0cdf10 0x7f9a5c06f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:26.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.510+0000 7f9a62600640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5c0cfd80 con 0x7f9a5c161790 2024-01-31T12:09:26.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.510+0000 7f9a62600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5c0cf450 con 0x7f9a5c0d0210 2024-01-31T12:09:26.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.510+0000 7f9a62600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5c0ce2f0 con 0x7f9a5c0cdf10 2024-01-31T12:09:26.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.510+0000 7f9a61200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9a5c0cdf10 0x7f9a5c06f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:26.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.510+0000 7f9a61200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9a5c0cdf10 0x7f9a5c06f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:55330/0 (socket says 172.21.15.49:55330) 2024-01-31T12:09:26.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.510+0000 7f9a61200640 1 -- 172.21.15.49:0/682213171 learned_addr learned my addr 172.21.15.49:0/682213171 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:26.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.510+0000 7f9a5be00640 1 --1- 172.21.15.49:0/682213171 >> v1:172.21.15.195:6789/0 conn(0x7f9a5c0d0210 0x7f9a5c161080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:46174/0 (socket says 172.21.15.49:46174) 2024-01-31T12:09:26.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.510+0000 7f9a61200640 1 -- 172.21.15.49:0/682213171 >> v1:172.21.15.195:6789/0 conn(0x7f9a5c0d0210 legacy=0x7f9a5c161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:26.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.510+0000 7f9a61200640 1 -- 172.21.15.49:0/682213171 >> v1:172.21.15.49:6789/0 conn(0x7f9a5c161790 legacy=0x7f9a5c1673b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:26.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.510+0000 7f9a61200640 1 -- 172.21.15.49:0/682213171 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c0cf730 con 0x7f9a5c0cdf10 2024-01-31T12:09:26.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.518+0000 7f9a61200640 1 --2- 172.21.15.49:0/682213171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a5c0cdf10 0x7f9a5c06f270 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f9a44009870 tx=0x7f9a4401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4d7a86fe18cf52 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:26.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.518+0000 7f9a5b400640 1 -- 172.21.15.49:0/682213171 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a440a6040 con 0x7f9a5c0cdf10 2024-01-31T12:09:26.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.518+0000 7f9a5b400640 1 -- 172.21.15.49:0/682213171 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a440aa600 con 0x7f9a5c0cdf10 2024-01-31T12:09:26.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.518+0000 7f9a5b400640 1 -- 172.21.15.49:0/682213171 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a440aa990 con 0x7f9a5c0cdf10 2024-01-31T12:09:26.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.522+0000 7f9a62600640 1 -- 172.21.15.49:0/682213171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a5c0cdf10 msgr2=0x7f9a5c06f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:26.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.522+0000 7f9a62600640 1 --2- 172.21.15.49:0/682213171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a5c0cdf10 0x7f9a5c06f270 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f9a44009870 tx=0x7f9a4401c480 comp rx=0 tx=0).stop 2024-01-31T12:09:26.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.522+0000 7f9a62600640 1 -- 172.21.15.49:0/682213171 shutdown_connections 2024-01-31T12:09:26.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.522+0000 7f9a62600640 1 --2- 172.21.15.49:0/682213171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a5c0cdf10 0x7f9a5c06f270 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:26.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.522+0000 7f9a62600640 1 -- 172.21.15.49:0/682213171 >> 172.21.15.49:0/682213171 conn(0x7f9a5c0d0ec0 msgr2=0x7f9a5c0d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.522+0000 7f9a62600640 1 -- 172.21.15.49:0/682213171 shutdown_connections 2024-01-31T12:09:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.522+0000 7f9a62600640 1 -- 172.21.15.49:0/682213171 wait complete. 2024-01-31T12:09:26.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.526+0000 7f9a62600640 1 Processor -- start 2024-01-31T12:09:26.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.526+0000 7f9a62600640 1 -- start start 2024-01-31T12:09:26.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.530+0000 7f9a62600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a5c0cdf10 0x7f9a5c15b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:26.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.530+0000 7f9a62600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a5c0d0210 0x7f9a5c1608c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:26.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.530+0000 7f9a62600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a5c161790 0x7f9a5c160e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:26.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.530+0000 7f9a62600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c14e4d0 con 0x7f9a5c0d0210 2024-01-31T12:09:26.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.530+0000 7f9a62600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c15dce0 con 0x7f9a5c161790 2024-01-31T12:09:26.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.530+0000 7f9a62600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c15dfc0 con 0x7f9a5c0cdf10 2024-01-31T12:09:26.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.530+0000 7f9a61200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a5c0cdf10 0x7f9a5c15b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:26.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.530+0000 7f9a5be00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a5c0d0210 0x7f9a5c1608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:26.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.530+0000 7f9a61200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a5c0cdf10 0x7f9a5c15b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:40514/0 (socket says 172.21.15.49:40514) 2024-01-31T12:09:26.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.530+0000 7f9a61200640 1 -- 172.21.15.49:0/645696342 learned_addr learned my addr 172.21.15.49:0/645696342 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:26.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.530+0000 7f9a61c00640 1 --2- 172.21.15.49:0/645696342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a5c161790 0x7f9a5c160e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:26.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.530+0000 7f9a61200640 1 -- 172.21.15.49:0/645696342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a5c161790 msgr2=0x7f9a5c160e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:26.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.530+0000 7f9a61200640 1 --2- 172.21.15.49:0/645696342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a5c161790 0x7f9a5c160e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:26.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.530+0000 7f9a61200640 1 -- 172.21.15.49:0/645696342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a5c0d0210 msgr2=0x7f9a5c1608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:26.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.530+0000 7f9a61200640 1 --2- 172.21.15.49:0/645696342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a5c0d0210 0x7f9a5c1608c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:26.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.530+0000 7f9a61200640 1 -- 172.21.15.49:0/645696342 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a440094d0 con 0x7f9a5c0cdf10 2024-01-31T12:09:26.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.530+0000 7f9a5be00640 1 --2- 172.21.15.49:0/645696342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a5c0d0210 0x7f9a5c1608c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T12:09:26.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.550+0000 7f9a61200640 1 --2- 172.21.15.49:0/645696342 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a5c0cdf10 0x7f9a5c15b400 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9a44019090 tx=0x7f9a4401acc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:26.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.550+0000 7f9a58c00640 1 -- 172.21.15.49:0/645696342 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a440b3800 con 0x7f9a5c0cdf10 2024-01-31T12:09:26.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.550+0000 7f9a58c00640 1 -- 172.21.15.49:0/645696342 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a440b3960 con 0x7f9a5c0cdf10 2024-01-31T12:09:26.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.550+0000 7f9a58c00640 1 -- 172.21.15.49:0/645696342 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a440b3cd0 con 0x7f9a5c0cdf10 2024-01-31T12:09:26.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.550+0000 7f9a62600640 1 -- 172.21.15.49:0/645696342 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5c14e6e0 con 0x7f9a5c0cdf10 2024-01-31T12:09:26.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.550+0000 7f9a62600640 1 -- 172.21.15.49:0/645696342 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5c15b940 con 0x7f9a5c0cdf10 2024-01-31T12:09:26.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.550+0000 7f9a52000640 1 -- 172.21.15.49:0/645696342 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5c15e180 con 0x7f9a5c0cdf10 2024-01-31T12:09:26.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.562+0000 7f9a58c00640 1 -- 172.21.15.49:0/645696342 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f9a440c63e0 con 0x7f9a5c0cdf10 2024-01-31T12:09:26.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.566+0000 7f9a58c00640 1 --2- 172.21.15.49:0/645696342 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9a34066550 0x7f9a34068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:26.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.566+0000 7f9a58c00640 1 -- 172.21.15.49:0/645696342 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f9a4411e690 con 0x7f9a5c0cdf10 2024-01-31T12:09:26.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.566+0000 7f9a5be00640 1 --2- 172.21.15.49:0/645696342 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9a34066550 0x7f9a34068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:26.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.570+0000 7f9a5be00640 1 --2- 172.21.15.49:0/645696342 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9a34066550 0x7f9a34068a10 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c140ad0 tx=0x7f9a54001640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:26.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:26.590+0000 7f9a58c00640 1 -- 172.21.15.49:0/645696342 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f9a440ebb80 con 0x7f9a5c0cdf10 2024-01-31T12:09:27.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.062+0000 7f9a52000640 1 -- 172.21.15.49:0/645696342 --> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a5c14eb90 con 0x7f9a34066550 2024-01-31T12:09:27.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.066+0000 7f9a58c00640 1 -- 172.21.15.49:0/645696342 <== mgr.4100 v2:172.21.15.195:6832/3035808172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49685 (secure 0 0 0) 0x7f9a5c14eb90 con 0x7f9a34066550 2024-01-31T12:09:27.066 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:09:27.066 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-31T12:09:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.070+0000 7f9a52000640 1 -- 172.21.15.49:0/645696342 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9a34066550 msgr2=0x7f9a34068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.070+0000 7f9a52000640 1 --2- 172.21.15.49:0/645696342 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9a34066550 0x7f9a34068a10 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c140ad0 tx=0x7f9a54001640 comp rx=0 tx=0).stop 2024-01-31T12:09:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.070+0000 7f9a52000640 1 -- 172.21.15.49:0/645696342 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a5c0cdf10 msgr2=0x7f9a5c15b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.070+0000 7f9a52000640 1 --2- 172.21.15.49:0/645696342 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a5c0cdf10 0x7f9a5c15b400 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9a44019090 tx=0x7f9a4401acc0 comp rx=0 tx=0).stop 2024-01-31T12:09:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.070+0000 7f9a52000640 1 -- 172.21.15.49:0/645696342 shutdown_connections 2024-01-31T12:09:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.070+0000 7f9a52000640 1 --2- 172.21.15.49:0/645696342 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9a34066550 0x7f9a34068a10 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.070+0000 7f9a52000640 1 --2- 172.21.15.49:0/645696342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a5c161790 0x7f9a5c160e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:27.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.070+0000 7f9a52000640 1 --2- 172.21.15.49:0/645696342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a5c0d0210 0x7f9a5c1608c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.070+0000 7f9a52000640 1 --2- 172.21.15.49:0/645696342 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9a5c0cdf10 0x7f9a5c15b400 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.070+0000 7f9a52000640 1 -- 172.21.15.49:0/645696342 >> 172.21.15.49:0/645696342 conn(0x7f9a5c0d0ec0 msgr2=0x7f9a5c0c7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.070+0000 7f9a52000640 1 -- 172.21.15.49:0/645696342 shutdown_connections 2024-01-31T12:09:27.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.070+0000 7f9a52000640 1 -- 172.21.15.49:0/645696342 wait complete. 2024-01-31T12:09:27.120 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":12795,"stamp":"2024-01-31T12:09:25.975505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":24399308,"kb_used_data":11679948,"kb_used_omap":3047,"kb_used_meta":12517528,"kb_avail":730575412,"statfs":{"total":773094113280,"available":748109221888,"internally_reserved":0,"allocated":11960266752,"data_stored":11932759626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3120248,"internal_metadata":12817949576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":425,"apply_latency_ms":425,"commit_latency_ns":425000000,"apply_latency_ns":425000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-24375366698,"num_objects":-21746,"num_object_clones":0,"num_object_copies":-43492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-21746,"num_whiteouts":0,"num_read":-1824062,"num_read_kb":-128909254,"num_write":-6590200,"num_write_kb":-163420426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.336813"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":427,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-01-31T12:09:19.757297+0000","last_change":"2024-01-31T05:04:05.699222+0000","last_active":"2024-01-31T12:09:19.757297+0000","last_peered":"2024-01-31T12:09:19.757297+0000","last_clean":"2024-01-31T12:09:19.757297+0000","last_became_active":"2024-01-31T05:04:05.698239+0000","last_became_peered":"2024-01-31T05:04:05.698239+0000","last_unstale":"2024-01-31T12:09:19.757297+0000","last_undegraded":"2024-01-31T12:09:19.757297+0000","last_fullsized":"2024-01-31T12:09:19.757297+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_clean_scrub_stamp":"2024-01-31T05:04:04.484734+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:05:13.736598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834579953,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1591752,"kb_used_data":1088,"kb_used_omap":157,"kb_used_meta":1590498,"kb_avail":92780088,"statfs":{"total":96636764160,"available":95006810112,"internally_reserved":0,"allocated":1114112,"data_stored":815732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":161111,"internal_metadata":1628670633},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":73,"apply_latency_ms":73,"commit_latency_ns":73000000,"apply_latency_ns":73000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:34 2024","interfaces":[{"interface":"back","average":{"1min":4.8369999999999997,"5min":2.3380000000000001,"15min":1.8819999999999999},"min":{"1min":0.39500000000000002,"5min":0.34899999999999998,"15min":0.33700000000000002},"max":{"1min":50.472000000000001,"5min":50.472000000000001,"15min":50.472000000000001},"last":8.4930000000000003},{"interface":"front","average":{"1min":6.3970000000000002,"5min":2.875,"15min":2.085},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":64.932000000000002,"5min":64.932000000000002,"15min":64.932000000000002},"last":8.5199999999999996}]},{"osd":1,"last update":"Wed Jan 31 12:08:34 2024","interfaces":[{"interface":"back","average":{"1min":2.4129999999999998,"5min":1.508,"15min":1.7769999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.377},"max":{"1min":15.550000000000001,"5min":15.550000000000001,"15min":18.547999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":3.0800000000000001,"5min":1.6679999999999999,"15min":1.744},"min":{"1min":0.433,"5min":0.433,"15min":0.34799999999999998},"max":{"1min":14.384,"5min":14.384,"15min":14.384},"last":8.0169999999999995}]},{"osd":2,"last update":"Wed Jan 31 12:09:18 2024","interfaces":[{"interface":"back","average":{"1min":2.8439999999999999,"5min":1.8700000000000001,"15min":2.0059999999999998},"min":{"1min":0.54400000000000004,"5min":0.47599999999999998,"15min":0.45200000000000001},"max":{"1min":19.978000000000002,"5min":19.978000000000002,"15min":19.978000000000002},"last":8.8219999999999992},{"interface":"front","average":{"1min":2.6299999999999999,"5min":2.5209999999999999,"15min":2.1389999999999998},"min":{"1min":0.75700000000000001,"5min":0.44500000000000001,"15min":0.41799999999999998},"max":{"1min":6.8049999999999997,"5min":65.054000000000002,"15min":65.054000000000002},"last":7.742}]},{"osd":3,"last update":"Wed Jan 31 12:08:34 2024","interfaces":[{"interface":"back","average":{"1min":2.8159999999999998,"5min":1.827,"15min":1.8500000000000001},"min":{"1min":0.57699999999999996,"5min":0.45200000000000001,"15min":0.435},"max":{"1min":13.285,"5min":13.285,"15min":13.285},"last":7.7279999999999998},{"interface":"front","average":{"1min":5.9560000000000004,"5min":2.5089999999999999,"15min":1.9850000000000001},"min":{"1min":0.55900000000000005,"5min":0.46899999999999997,"15min":0.44},"max":{"1min":65.019000000000005,"5min":65.019000000000005,"15min":65.019000000000005},"last":36.966999999999999}]},{"osd":4,"last update":"Wed Jan 31 12:08:34 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":0.77100000000000002,"15min":0.66900000000000004},"min":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.32100000000000001},"max":{"1min":6.1760000000000002,"5min":6.1760000000000002,"15min":6.1760000000000002},"last":0.505},{"interface":"front","average":{"1min":1.615,"5min":0.94999999999999996,"15min":0.73999999999999999},"min":{"1min":0.42399999999999999,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":9.7100000000000009,"5min":9.7100000000000009,"15min":9.7100000000000009},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed Jan 31 12:08:34 2024","interfaces":[{"interface":"back","average":{"1min":5.0090000000000003,"5min":1.663,"15min":0.97499999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.35699999999999998},"max":{"1min":64.986999999999995,"5min":64.986999999999995,"15min":64.986999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":5.048,"5min":1.617,"15min":1.0229999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.36799999999999999},"max":{"1min":64.644000000000005,"5min":64.644000000000005,"15min":64.644000000000005},"last":0.53700000000000003}]},{"osd":6,"last update":"Wed Jan 31 12:08:34 2024","interfaces":[{"interface":"back","average":{"1min":1.677,"5min":0.997,"15min":0.89000000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.40999999999999998},"max":{"1min":15.616,"5min":15.616,"15min":15.616},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.071,"15min":0.85399999999999998},"min":{"1min":0.46600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":9.6329999999999991,"5min":11.195,"15min":11.195},"last":0.52300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834579953,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1469656,"kb_used_data":13324,"kb_used_omap":156,"kb_used_meta":1456163,"kb_avail":92902184,"statfs":{"total":96636764160,"available":95131836416,"internally_reserved":0,"allocated":13643776,"data_stored":13312621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":160451,"internal_metadata":1491111229},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:55 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.7989999999999999,"15min":1.7989999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.312},"max":{"1min":4.6580000000000004,"5min":31.861000000000001,"15min":54.527000000000001},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.5489999999999999,"15min":1.7649999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.34000000000000002},"max":{"1min":4.7140000000000004,"5min":5.71,"15min":54.466999999999999},"last":1.327}]},{"osd":1,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.478,"15min":1.8360000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":4.048,"5min":19.844999999999999,"15min":28.239000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.488,"5min":1.8620000000000001,"15min":1.9299999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.38400000000000001},"max":{"1min":4.1689999999999996,"5min":13.847,"15min":28.364000000000001},"last":1.0049999999999999}]},{"osd":2,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":2.052,"15min":1.9750000000000001},"min":{"1min":0.60499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.8490000000000002,"5min":27.777999999999999,"15min":27.783999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.9670000000000001,"5min":3.1899999999999999,"15min":2.3079999999999998},"min":{"1min":0.68600000000000005,"5min":0.46100000000000002,"15min":0.436},"max":{"1min":7.6669999999999998,"5min":159.67400000000001,"15min":159.67400000000001},"last":0.83799999999999997}]},{"osd":3,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.4419999999999999,"15min":1.8069999999999999},"min":{"1min":0.67300000000000004,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":2.194,"5min":8.1300000000000008,"15min":32.295999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.319,"5min":2.1890000000000001,"15min":2.1139999999999999},"min":{"1min":0.64700000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.71,"5min":27.905000000000001,"15min":33.198},"last":0.77200000000000002}]},{"osd":4,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.73699999999999999,"15min":0.71399999999999997},"min":{"1min":0.40600000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.946,"5min":16.628,"15min":16.628},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.70899999999999996},"min":{"1min":0.39300000000000002,"5min":0.378,"15min":0.36899999999999999},"max":{"1min":1.5600000000000001,"5min":4.8460000000000001,"15min":4.8460000000000001},"last":0.70399999999999996}]},{"osd":5,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.83399999999999996,"15min":0.87},"min":{"1min":0.45300000000000001,"5min":0.35399999999999998,"15min":0.33600000000000002},"max":{"1min":0.95199999999999996,"5min":19.120999999999999,"15min":36.438000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.86699999999999999,"15min":0.90100000000000002},"min":{"1min":0.42199999999999999,"5min":0.41199999999999998,"15min":0.372},"max":{"1min":2.056,"5min":23.087,"15min":31.077999999999999},"last":0.68100000000000005}]},{"osd":7,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65200000000000002,"15min":0.73999999999999999},"min":{"1min":0.46200000000000002,"5min":0.45000000000000001,"15min":0.33800000000000002},"max":{"1min":1.4990000000000001,"5min":1.613,"15min":4.3499999999999996},"last":0.752},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.92600000000000005,"15min":0.82799999999999996},"min":{"1min":0.498,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.077,"5min":20.317,"15min":20.317},"last":0.46999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834579952,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3763752,"kb_used_data":2685300,"kb_used_omap":757,"kb_used_meta":1039370,"kb_avail":90608088,"statfs":{"total":96636764160,"available":92782682112,"internally_reserved":0,"allocated":2749747200,"data_stored":2743804035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":775603,"internal_metadata":1064315469},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:23 2024","interfaces":[{"interface":"back","average":{"1min":3.5179999999999998,"5min":5.2800000000000002,"15min":2.7749999999999999},"min":{"1min":0.41199999999999998,"5min":0.35499999999999998,"15min":0.29699999999999999},"max":{"1min":33.741999999999997,"5min":281.83499999999998,"15min":281.83499999999998},"last":31.5},{"interface":"front","average":{"1min":3.4390000000000001,"5min":5.1180000000000003,"15min":2.8610000000000002},"min":{"1min":0.434,"5min":0.37,"15min":0.34300000000000003},"max":{"1min":35.189,"5min":277.49700000000001,"15min":277.49700000000001},"last":31.524999999999999}]},{"osd":1,"last update":"Wed Jan 31 12:08:23 2024","interfaces":[{"interface":"back","average":{"1min":4.7939999999999996,"5min":2.21,"15min":1.915},"min":{"1min":0.61299999999999999,"5min":0.372,"15min":0.372},"max":{"1min":18.466000000000001,"5min":18.466000000000001,"15min":18.466000000000001},"last":24.248000000000001},{"interface":"front","average":{"1min":3.375,"5min":2.1890000000000001,"15min":1.9430000000000001},"min":{"1min":0.45400000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":16.378,"5min":16.378,"15min":16.378},"last":32.128999999999998}]},{"osd":2,"last update":"Wed Jan 31 12:08:23 2024","interfaces":[{"interface":"back","average":{"1min":2.738,"5min":5.101,"15min":3.5},"min":{"1min":0.66300000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":11.99,"5min":279.86399999999998,"15min":279.86399999999998},"last":36},{"interface":"front","average":{"1min":3.8119999999999998,"5min":5.2359999999999998,"15min":3.5979999999999999},"min":{"1min":0.60499999999999998,"5min":0.50700000000000001,"15min":0.40999999999999998},"max":{"1min":23.905999999999999,"5min":279.15699999999998,"15min":279.15699999999998},"last":35.978999999999999}]},{"osd":3,"last update":"Wed Jan 31 12:08:23 2024","interfaces":[{"interface":"back","average":{"1min":3.0779999999999998,"5min":2.0790000000000002,"15min":2.4590000000000001},"min":{"1min":0.58799999999999997,"5min":0.51900000000000002,"15min":0.435},"max":{"1min":21.428000000000001,"5min":21.428000000000001,"15min":160.709},"last":32.176000000000002},{"interface":"front","average":{"1min":2.4329999999999998,"5min":2.0259999999999998,"15min":2.5790000000000002},"min":{"1min":0.79200000000000004,"5min":0.57899999999999996,"15min":0.46300000000000002},"max":{"1min":11.933999999999999,"5min":11.933999999999999,"15min":162.26599999999999},"last":35.912999999999997}]},{"osd":4,"last update":"Wed Jan 31 12:08:23 2024","interfaces":[{"interface":"back","average":{"1min":1.766,"5min":0.93200000000000005,"15min":0.69899999999999995},"min":{"1min":0.372,"5min":0.317,"15min":0.317},"max":{"1min":12.068,"5min":12.068,"15min":12.068},"last":32.652999999999999},{"interface":"front","average":{"1min":1.849,"5min":0.89500000000000002,"15min":0.73999999999999999},"min":{"1min":0.435,"5min":0.36299999999999999,"15min":0.33200000000000002},"max":{"1min":16.329000000000001,"5min":16.329000000000001,"15min":16.329000000000001},"last":32.247}]},{"osd":6,"last update":"Wed Jan 31 12:08:23 2024","interfaces":[{"interface":"back","average":{"1min":2.351,"5min":1.0189999999999999,"15min":0.77100000000000002},"min":{"1min":0.42199999999999999,"5min":0.35799999999999998,"15min":0.34100000000000003},"max":{"1min":15.819000000000001,"5min":15.819000000000001,"15min":15.819000000000001},"last":35.957999999999998},{"interface":"front","average":{"1min":1.6279999999999999,"5min":0.94099999999999995,"15min":0.75800000000000001},"min":{"1min":0.48799999999999999,"5min":0.40100000000000002,"15min":0.38},"max":{"1min":12.109999999999999,"5min":12.109999999999999,"15min":12.109999999999999},"last":36.444000000000003}]},{"osd":7,"last update":"Wed Jan 31 12:08:23 2024","interfaces":[{"interface":"back","average":{"1min":3.2360000000000002,"5min":1.264,"15min":0.90300000000000002},"min":{"1min":0.45700000000000002,"5min":0.38100000000000001,"15min":0.375},"max":{"1min":39.918999999999997,"5min":39.918999999999997,"15min":39.918999999999997},"last":32.799999999999997},{"interface":"front","average":{"1min":3.2410000000000001,"5min":1.2589999999999999,"15min":0.90700000000000003},"min":{"1min":0.54900000000000004,"5min":0.44800000000000001,"15min":0.42599999999999999},"max":{"1min":39.860999999999997,"5min":39.860999999999997,"15min":39.860999999999997},"last":36.073999999999998}]}]},{"osd":4,"up_from":13,"seq":55834579953,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1745092,"kb_used_data":508,"kb_used_omap":549,"kb_used_meta":1744026,"kb_avail":92626748,"statfs":{"total":96636764160,"available":94849789952,"internally_reserved":0,"allocated":520192,"data_stored":225364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":562466,"internal_metadata":1785883358},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.242,"15min":2.0920000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36299999999999999},"max":{"1min":5.7450000000000001,"5min":14.096,"15min":158.78200000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.4750000000000001,"15min":2.2029999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.33900000000000002},"max":{"1min":5.5800000000000001,"5min":5.5800000000000001,"15min":158.45400000000001},"last":0.65800000000000003}]},{"osd":1,"last update":"Wed Jan 31 12:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":2.028,"15min":2.2949999999999999},"min":{"1min":0.54000000000000004,"5min":0.42199999999999999,"15min":0.38100000000000001},"max":{"1min":3.5779999999999998,"5min":11.077999999999999,"15min":158.959},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.9630000000000001,"15min":2.3980000000000001},"min":{"1min":0.58999999999999997,"5min":0.50700000000000001,"15min":0.35199999999999998},"max":{"1min":4.5620000000000003,"5min":9.2490000000000006,"15min":158.69200000000001},"last":0.77900000000000003}]},{"osd":2,"last update":"Wed Jan 31 12:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":2.0910000000000002,"15min":2.3700000000000001},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.5920000000000001,"5min":7.8890000000000002,"15min":158.232},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.718,"5min":1.984,"15min":2.3759999999999999},"min":{"1min":0.623,"5min":0.44700000000000001,"15min":0.438},"max":{"1min":4.0979999999999999,"5min":12.132999999999999,"15min":157.76300000000001},"last":0.875}]},{"osd":3,"last update":"Wed Jan 31 12:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.9399999999999999,"5min":1.891,"15min":2.3330000000000002},"min":{"1min":0.69899999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.5590000000000002,"5min":6.5949999999999998,"15min":155.27799999999999},"last":9.2680000000000007},{"interface":"front","average":{"1min":1.716,"5min":1.5760000000000001,"15min":2.2719999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":4.8029999999999999,"5min":8.8300000000000001,"15min":156.81700000000001},"last":9.093}]},{"osd":5,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.79600000000000004,"15min":0.67800000000000005},"min":{"1min":0.42399999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.93500000000000005,"5min":9.1120000000000001,"15min":9.1120000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72699999999999998,"15min":0.69299999999999995},"min":{"1min":0.53700000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91100000000000003,"5min":4.3959999999999999,"15min":4.6840000000000002},"last":0.53600000000000003}]},{"osd":6,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.81799999999999995,"15min":0.73299999999999998},"min":{"1min":0.46200000000000002,"5min":0.379,"15min":0.35699999999999998},"max":{"1min":3.294,"5min":7.7930000000000001,"15min":7.7930000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.82099999999999995,"15min":0.72199999999999998},"min":{"1min":0.51300000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.2929999999999999,"5min":11.791,"15min":11.791},"last":0.64200000000000002}]},{"osd":7,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79000000000000004,"15min":0.73299999999999998},"min":{"1min":0.502,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.5840000000000001,"5min":4.0919999999999996,"15min":5.5869999999999997},"last":0.498},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.878,"15min":0.78900000000000003},"min":{"1min":0.504,"5min":0.41399999999999998,"15min":0.38800000000000001},"max":{"1min":3.395,"5min":7.8449999999999998,"15min":7.8449999999999998},"last":0.51900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834579899,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4261056,"kb_used_data":2562520,"kb_used_omap":532,"kb_used_meta":1668843,"kb_avail":90110784,"statfs":{"total":96636764160,"available":92273442816,"internally_reserved":0,"allocated":2624020480,"data_stored":2618104852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":545051,"internal_metadata":1708895973},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":88,"apply_latency_ms":88,"commit_latency_ns":88000000,"apply_latency_ns":88000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":4.0439999999999996,"5min":5.9880000000000004,"15min":4.0800000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.28000000000000003},"max":{"1min":14.579000000000001,"5min":273.40300000000002,"15min":273.40300000000002},"last":0.89400000000000002},{"interface":"front","average":{"1min":2.4500000000000002,"5min":5.8250000000000002,"15min":4.2130000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":8.2390000000000008,"5min":278.26600000000002,"15min":278.26600000000002},"last":0.79500000000000004}]},{"osd":1,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":2.6299999999999999,"5min":2.653,"15min":3.1669999999999998},"min":{"1min":0.73199999999999998,"5min":0.55500000000000005,"15min":0.42499999999999999},"max":{"1min":5.6299999999999999,"5min":8.9390000000000001,"15min":13.497},"last":11.002000000000001},{"interface":"front","average":{"1min":3.633,"5min":2.8919999999999999,"15min":3.2919999999999998},"min":{"1min":0.93000000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":7.0149999999999997,"5min":7.9969999999999999,"15min":12.76},"last":12.151}]},{"osd":2,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":2.2370000000000001,"5min":5.9370000000000003,"15min":4.1760000000000002},"min":{"1min":0.629,"5min":0.629,"15min":0.38500000000000001},"max":{"1min":7.6799999999999997,"5min":278.33300000000003,"15min":278.33300000000003},"last":12.004},{"interface":"front","average":{"1min":4.6050000000000004,"5min":6.5,"15min":4.4459999999999997},"min":{"1min":0.85999999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":14.929,"5min":273.27100000000002,"15min":273.27100000000002},"last":12.099}]},{"osd":4,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.9179999999999999,"5min":2.194,"15min":2.536},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.47499999999999998},"max":{"1min":5.8150000000000004,"5min":7.4550000000000001,"15min":9.7460000000000004},"last":1.546},{"interface":"front","average":{"1min":2.2080000000000002,"5min":2.1749999999999998,"15min":2.391},"min":{"1min":0.88200000000000001,"5min":0.59999999999999998,"15min":0.502},"max":{"1min":5.6239999999999997,"5min":6.2089999999999996,"15min":13.093},"last":1.9399999999999999}]},{"osd":5,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":2.653,"5min":2.3149999999999999,"15min":2.77},"min":{"1min":0.89900000000000002,"5min":0.627,"15min":0.52100000000000002},"max":{"1min":11.385,"5min":11.385,"15min":55.942999999999998},"last":1.8169999999999999},{"interface":"front","average":{"1min":2.9900000000000002,"5min":2.5179999999999998,"15min":2.7709999999999999},"min":{"1min":0.52700000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":6.7130000000000001,"5min":7.556,"15min":56.850999999999999},"last":1.879}]},{"osd":6,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":3.706,"5min":2.657,"15min":2.7120000000000002},"min":{"1min":0.59699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":14.464,"5min":14.464,"15min":14.464},"last":1.234},{"interface":"front","average":{"1min":2.012,"5min":2.3570000000000002,"15min":2.718},"min":{"1min":0.67000000000000004,"5min":0.61099999999999999,"15min":0.51300000000000001},"max":{"1min":5.8739999999999997,"5min":9.5690000000000008,"15min":9.6989999999999998},"last":1.5049999999999999}]},{"osd":7,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":2.8039999999999998,"5min":2.5539999999999998,"15min":3.0950000000000002},"min":{"1min":0.76000000000000001,"5min":0.65600000000000003,"15min":0.56399999999999995},"max":{"1min":17.34,"5min":17.34,"15min":55.713999999999999},"last":12.066000000000001},{"interface":"front","average":{"1min":3.1160000000000001,"5min":2.5950000000000002,"15min":2.9279999999999999},"min":{"1min":1.044,"5min":0.61699999999999999,"15min":0.58699999999999997},"max":{"1min":17.274000000000001,"5min":17.274000000000001,"15min":55.619},"last":11.148999999999999}]}]},{"osd":2,"up_from":13,"seq":55834579907,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5106512,"kb_used_data":3328132,"kb_used_omap":168,"kb_used_meta":1778199,"kb_avail":89265328,"statfs":{"total":96636764160,"available":91407695872,"internally_reserved":0,"allocated":3408007168,"data_stored":3400511120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":173049,"internal_metadata":1820875783},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":4.5140000000000002,"5min":2.7429999999999999,"15min":2.972},"min":{"1min":0.55500000000000005,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":26.771000000000001,"5min":26.771000000000001,"15min":26.771000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":3.923,"5min":3.0449999999999999,"15min":3.1269999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.41499999999999998},"max":{"1min":14.548999999999999,"5min":14.548999999999999,"15min":14.548999999999999},"last":1.5880000000000001}]},{"osd":1,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":3.202,"5min":3.7440000000000002,"15min":3.3359999999999999},"min":{"1min":0.438,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":7.8220000000000001,"5min":48.207999999999998,"15min":48.207999999999998},"last":1.5169999999999999},{"interface":"front","average":{"1min":4.6189999999999998,"5min":4.0439999999999996,"15min":3.6749999999999998},"min":{"1min":0.624,"5min":0.60899999999999999,"15min":0.35799999999999998},"max":{"1min":23.408000000000001,"5min":49.024999999999999,"15min":49.024999999999999},"last":1.4570000000000001}]},{"osd":3,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":5.9969999999999999,"5min":4.0460000000000003,"15min":3.7519999999999998},"min":{"1min":0.75,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":35.802,"5min":35.802,"15min":35.802},"last":0.84599999999999997},{"interface":"front","average":{"1min":5.0519999999999996,"5min":4.5519999999999996,"15min":3.944},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.47299999999999998},"max":{"1min":30.472999999999999,"5min":48.682000000000002,"15min":48.682000000000002},"last":1.3580000000000001}]},{"osd":4,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":4.585,"5min":3.0030000000000001,"15min":2.7410000000000001},"min":{"1min":0.63700000000000001,"5min":0.54300000000000004,"15min":0.50700000000000001},"max":{"1min":33.631,"5min":33.631,"15min":33.631},"last":1.2949999999999999},{"interface":"front","average":{"1min":4.1829999999999998,"5min":2.9620000000000002,"15min":2.847},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":33.277000000000001,"5min":33.277000000000001,"15min":33.277000000000001},"last":1.248}]},{"osd":5,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":6.665,"5min":3.512,"15min":3.0139999999999998},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.55000000000000004},"max":{"1min":44.935000000000002,"5min":44.935000000000002,"15min":44.935000000000002},"last":1.1559999999999999},{"interface":"front","average":{"1min":4.835,"5min":3.077,"15min":2.98},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":44.590000000000003,"5min":44.590000000000003,"15min":44.590000000000003},"last":1.087}]},{"osd":6,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":3.9449999999999998,"5min":2.6739999999999999,"15min":2.5979999999999999},"min":{"1min":0.83499999999999996,"5min":0.66200000000000003,"15min":0.60099999999999998},"max":{"1min":26.259,"5min":26.259,"15min":26.259},"last":0.98899999999999999},{"interface":"front","average":{"1min":3.601,"5min":3.0329999999999999,"15min":2.98},"min":{"1min":0.71499999999999997,"5min":0.70799999999999996,"15min":0.56899999999999995},"max":{"1min":12.18,"5min":13.839,"15min":19.888999999999999},"last":1.2230000000000001}]},{"osd":7,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":2.7730000000000001,"5min":2.6509999999999998,"15min":2.6389999999999998},"min":{"1min":0.89800000000000002,"5min":0.69199999999999995,"15min":0.56799999999999995},"max":{"1min":7.7130000000000001,"5min":11.544,"15min":11.81},"last":1.0649999999999999},{"interface":"front","average":{"1min":3.7349999999999999,"5min":3.105,"15min":3.1230000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":23.294,"5min":23.294,"15min":23.294},"last":1.393}]}]},{"osd":1,"up_from":13,"seq":55834579917,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3899628,"kb_used_data":2432224,"kb_used_omap":400,"kb_used_meta":1466991,"kb_avail":90472212,"statfs":{"total":96636764160,"available":92643545088,"internally_reserved":0,"allocated":2490597376,"data_stored":2484951142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":410545,"internal_metadata":1502198863},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.532,"5min":2.9990000000000001,"15min":3.2010000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":6.5759999999999996,"5min":17.189,"15min":115.23699999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":2.4079999999999999,"5min":2.7799999999999998,"15min":3.3940000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.32600000000000001},"max":{"1min":5.4299999999999997,"5min":9.3670000000000009,"15min":114.834},"last":0.99199999999999999}]},{"osd":2,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.976,"5min":3.2810000000000001,"15min":3.3079999999999998},"min":{"1min":0.64000000000000001,"5min":0.621,"15min":0.40799999999999997},"max":{"1min":7.274,"5min":13.641,"15min":22.890000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":2.581,"5min":3.476,"15min":3.359},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":6.6879999999999997,"5min":17.297000000000001,"15min":17.297000000000001},"last":1.5129999999999999}]},{"osd":3,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.758,"5min":3.6819999999999999,"15min":3.569},"min":{"1min":0.503,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":7.6760000000000002,"5min":18.832999999999998,"15min":18.832999999999998},"last":1.9319999999999999},{"interface":"front","average":{"1min":3.4860000000000002,"5min":3.605,"15min":3.456},"min":{"1min":0.85699999999999998,"5min":0.52300000000000002,"15min":0.438},"max":{"1min":7.1639999999999997,"5min":26.114999999999998,"15min":26.114999999999998},"last":1.1259999999999999}]},{"osd":4,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.4689999999999999,"5min":2.6120000000000001,"15min":2.5259999999999998},"min":{"1min":0.625,"5min":0.61199999999999999,"15min":0.48299999999999998},"max":{"1min":6.7069999999999999,"5min":9.0830000000000002,"15min":10.266999999999999},"last":1.1699999999999999},{"interface":"front","average":{"1min":2.4590000000000001,"5min":2.5009999999999999,"15min":2.343},"min":{"1min":0.71399999999999997,"5min":0.56899999999999995,"15min":0.50700000000000001},"max":{"1min":7.3979999999999997,"5min":13.512,"15min":22.774000000000001},"last":1.4039999999999999}]},{"osd":5,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.5139999999999998,"5min":2.569,"15min":2.4009999999999998},"min":{"1min":0.75800000000000001,"5min":0.64200000000000002,"15min":0.51200000000000001},"max":{"1min":7.5039999999999996,"5min":13.734999999999999,"15min":13.734999999999999},"last":1.3169999999999999},{"interface":"front","average":{"1min":2.2639999999999998,"5min":2.7730000000000001,"15min":2.5339999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":7.3760000000000003,"5min":17.056999999999999,"15min":17.056999999999999},"last":1.6930000000000001}]},{"osd":6,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.7269999999999999,"5min":2.903,"15min":2.6880000000000002},"min":{"1min":0.80600000000000005,"5min":0.68600000000000005,"15min":0.52600000000000002},"max":{"1min":6.8289999999999997,"5min":12.571999999999999,"15min":12.571999999999999},"last":1.4750000000000001},{"interface":"front","average":{"1min":2.9769999999999999,"5min":2.8559999999999999,"15min":2.589},"min":{"1min":0.79000000000000004,"5min":0.61399999999999999,"15min":0.54600000000000004},"max":{"1min":8.5289999999999999,"5min":13.827999999999999,"15min":13.827999999999999},"last":1.6060000000000001}]},{"osd":7,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.464,"5min":3.1589999999999998,"15min":2.7170000000000001},"min":{"1min":0.77400000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":7.5510000000000002,"5min":18.960999999999999,"15min":18.960999999999999},"last":1.8160000000000001},{"interface":"front","average":{"1min":2.6419999999999999,"5min":3.2050000000000001,"15min":2.919},"min":{"1min":0.89600000000000002,"5min":0.64900000000000002,"15min":0.53900000000000003},"max":{"1min":6.9320000000000004,"5min":24.904,"15min":24.904},"last":1.3460000000000001}]}]},{"osd":0,"up_from":13,"seq":55834579912,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2561860,"kb_used_data":656852,"kb_used_omap":324,"kb_used_meta":1773435,"kb_avail":91809980,"statfs":{"total":96636764160,"available":94013419520,"internally_reserved":0,"allocated":672616448,"data_stored":671034760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":331972,"internal_metadata":1815998268},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":91,"apply_latency_ms":91,"commit_latency_ns":91000000,"apply_latency_ns":91000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":4.492,"5min":3.2429999999999999,"15min":3.1539999999999999},"min":{"1min":0.747,"5min":0.58699999999999997,"15min":0.48499999999999999},"max":{"1min":25.902000000000001,"5min":25.902000000000001,"15min":25.902000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":4.1260000000000003,"5min":3.125,"15min":3.1150000000000002},"min":{"1min":0.98899999999999999,"5min":0.55800000000000005,"15min":0.30499999999999999},"max":{"1min":26.027999999999999,"5min":26.027999999999999,"15min":26.027999999999999},"last":1.2589999999999999}]},{"osd":2,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":4.4299999999999997,"5min":3.4180000000000001,"15min":3.3399999999999999},"min":{"1min":0.67200000000000004,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":18.809999999999999,"5min":24.140999999999998,"15min":25.704999999999998},"last":1.048},{"interface":"front","average":{"1min":3.8660000000000001,"5min":3.3639999999999999,"15min":3.2280000000000002},"min":{"1min":0.68200000000000005,"5min":0.68100000000000005,"15min":0.504},"max":{"1min":16.922000000000001,"5min":17.381,"15min":25.126000000000001},"last":1.502}]},{"osd":3,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":3.5259999999999998,"5min":3.7450000000000001,"15min":3.4550000000000001},"min":{"1min":0.60699999999999998,"5min":0.52800000000000002,"15min":0.39700000000000002},"max":{"1min":10.241,"5min":32.636000000000003,"15min":32.636000000000003},"last":0.79500000000000004},{"interface":"front","average":{"1min":4.7069999999999999,"5min":3.8660000000000001,"15min":3.7839999999999998},"min":{"1min":0.97899999999999998,"5min":0.56599999999999995,"15min":0.51200000000000001},"max":{"1min":18.385999999999999,"5min":26.202000000000002,"15min":26.202000000000002},"last":1.456}]},{"osd":4,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":2.1000000000000001,"5min":2.375,"15min":2.3799999999999999},"min":{"1min":0.876,"5min":0.70199999999999996,"15min":0.54300000000000004},"max":{"1min":5.3929999999999998,"5min":13.472,"15min":13.472},"last":0.98799999999999999},{"interface":"front","average":{"1min":3.2839999999999998,"5min":2.6429999999999998,"15min":2.3809999999999998},"min":{"1min":0.82199999999999995,"5min":0.60299999999999998,"15min":0.49199999999999999},"max":{"1min":9.9039999999999999,"5min":28.151,"15min":28.151},"last":0.75600000000000001}]},{"osd":5,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":3.0430000000000001,"5min":2.726,"15min":2.7229999999999999},"min":{"1min":0.999,"5min":0.67300000000000004,"15min":0.46600000000000003},"max":{"1min":8.1099999999999994,"5min":16.670000000000002,"15min":25.186},"last":1.177},{"interface":"front","average":{"1min":2.6989999999999998,"5min":2.6829999999999998,"15min":2.6150000000000002},"min":{"1min":0.93700000000000006,"5min":0.69799999999999995,"15min":0.57099999999999995},"max":{"1min":9.1289999999999996,"5min":11.199,"15min":25.013000000000002},"last":1.1339999999999999}]},{"osd":6,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":3.3700000000000001,"5min":2.8650000000000002,"15min":2.4980000000000002},"min":{"1min":0.79500000000000004,"5min":0.72499999999999998,"15min":0.53600000000000003},"max":{"1min":10.036,"5min":27.925999999999998,"15min":27.925999999999998},"last":331.28199999999998},{"interface":"front","average":{"1min":3.7170000000000001,"5min":2.9649999999999999,"15min":2.8849999999999998},"min":{"1min":1.1220000000000001,"5min":0.71199999999999997,"15min":0.55500000000000005},"max":{"1min":16.567,"5min":19.242999999999999,"15min":25.300000000000001},"last":330.95100000000002}]},{"osd":7,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":3.3050000000000002,"5min":3.2549999999999999,"15min":2.9199999999999999},"min":{"1min":1.046,"5min":0.77900000000000003,"15min":0.58899999999999997},"max":{"1min":17.152999999999999,"5min":53.951000000000001,"15min":53.951000000000001},"last":1.365},{"interface":"front","average":{"1min":3.407,"5min":3.202,"15min":2.7490000000000001},"min":{"1min":0.89400000000000002,"5min":0.65400000000000003,"15min":0.57199999999999995},"max":{"1min":10.141999999999999,"5min":28.053000000000001,"15min":28.053000000000001},"last":0.93400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-31T12:09:27.122 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-31T12:09:27.122 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-31T12:09:27.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.530+0000 7f974f800640 1 Processor -- start 2024-01-31T12:09:27.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.530+0000 7f974f800640 1 -- start start 2024-01-31T12:09:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.534+0000 7f974f800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f974815e7e0 0x7f97480b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.534+0000 7f974f800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f97480cf670 0x7f97480cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:27.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.534+0000 7f974f800640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97480c67f0 con 0x7f97480c63d0 2024-01-31T12:09:27.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.534+0000 7f974f800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97480d1d40 con 0x7f97480cf670 2024-01-31T12:09:27.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.534+0000 7f974f800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97480c6ab0 con 0x7f974815e7e0 2024-01-31T12:09:27.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.534+0000 7f974ce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f974815e7e0 0x7f97480b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:27.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.534+0000 7f974ce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f974815e7e0 0x7f97480b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:40530/0 (socket says 172.21.15.49:40530) 2024-01-31T12:09:27.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.534+0000 7f974ce00640 1 -- 172.21.15.49:0/2512953157 learned_addr learned my addr 172.21.15.49:0/2512953157 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:27.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.534+0000 7f974d800640 1 --2- 172.21.15.49:0/2512953157 >> v2:172.21.15.195:3300/0 conn(0x7f97480cf670 0x7f97480cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:27.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.534+0000 7f974ce00640 1 -- 172.21.15.49:0/2512953157 >> v2:172.21.15.195:3300/0 conn(0x7f97480cf670 msgr2=0x7f97480cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:27.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.534+0000 7f974ce00640 1 --2- 172.21.15.49:0/2512953157 >> v2:172.21.15.195:3300/0 conn(0x7f97480cf670 0x7f97480cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:27.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.534+0000 7f974ce00640 1 -- 172.21.15.49:0/2512953157 >> v1:172.21.15.49:6789/0 conn(0x7f97480c63d0 legacy=0x7f97480cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:27.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.534+0000 7f974ce00640 1 -- 172.21.15.49:0/2512953157 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97480c6d90 con 0x7f974815e7e0 2024-01-31T12:09:27.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.534+0000 7f974d800640 1 --2- 172.21.15.49:0/2512953157 >> v2:172.21.15.195:3300/0 conn(0x7f97480cf670 0x7f97480cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T12:09:27.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.538+0000 7f974ce00640 1 --2- 172.21.15.49:0/2512953157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f974815e7e0 0x7f97480b2370 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9738009870 tx=0x7f973801ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=850a82f1560d80ac server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.538+0000 7f9747400640 1 -- 172.21.15.49:0/2512953157 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97380a8a30 con 0x7f974815e7e0 2024-01-31T12:09:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.538+0000 7f9747400640 1 -- 172.21.15.49:0/2512953157 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97380a8b90 con 0x7f974815e7e0 2024-01-31T12:09:27.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.538+0000 7f9747400640 1 -- 172.21.15.49:0/2512953157 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97380b0440 con 0x7f974815e7e0 2024-01-31T12:09:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.542+0000 7f974f800640 1 -- 172.21.15.49:0/2512953157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f974815e7e0 msgr2=0x7f97480b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:27.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.542+0000 7f974f800640 1 --2- 172.21.15.49:0/2512953157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f974815e7e0 0x7f97480b2370 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9738009870 tx=0x7f973801ed30 comp rx=0 tx=0).stop 2024-01-31T12:09:27.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.542+0000 7f974f800640 1 -- 172.21.15.49:0/2512953157 shutdown_connections 2024-01-31T12:09:27.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.542+0000 7f974f800640 1 --2- 172.21.15.49:0/2512953157 >> v2:172.21.15.195:3300/0 conn(0x7f97480cf670 0x7f97480cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:27.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.542+0000 7f974f800640 1 --2- 172.21.15.49:0/2512953157 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f974815e7e0 0x7f97480b2370 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:27.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.542+0000 7f974f800640 1 -- 172.21.15.49:0/2512953157 >> 172.21.15.49:0/2512953157 conn(0x7f97480d0e60 msgr2=0x7f97480d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:27.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.542+0000 7f974f800640 1 -- 172.21.15.49:0/2512953157 shutdown_connections 2024-01-31T12:09:27.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.542+0000 7f974f800640 1 -- 172.21.15.49:0/2512953157 wait complete. 2024-01-31T12:09:27.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.546+0000 7f974f800640 1 Processor -- start 2024-01-31T12:09:27.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.546+0000 7f974f800640 1 -- start start 2024-01-31T12:09:27.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.550+0000 7f974f800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97480c63d0 0x7f97481f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:27.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.550+0000 7f974f800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97480cf670 0x7f97480b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:27.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.550+0000 7f974f800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f974815e7e0 0x7f974815cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.550+0000 7f974f800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97480b5d00 con 0x7f974815e7e0 2024-01-31T12:09:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.550+0000 7f974f800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97480b5fc0 con 0x7f97480c63d0 2024-01-31T12:09:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.550+0000 7f974f800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97480b62a0 con 0x7f97480cf670 2024-01-31T12:09:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.550+0000 7f974ce00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97480c63d0 0x7f97481f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.550+0000 7f974ce00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97480c63d0 0x7f97481f70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:55364/0 (socket says 172.21.15.49:55364) 2024-01-31T12:09:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.550+0000 7f974ce00640 1 -- 172.21.15.49:0/692303604 learned_addr learned my addr 172.21.15.49:0/692303604 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.550+0000 7f9747e00640 1 --2- 172.21.15.49:0/692303604 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97480cf670 0x7f97480b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.550+0000 7f974d800640 1 --2- 172.21.15.49:0/692303604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f974815e7e0 0x7f974815cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.550+0000 7f974ce00640 1 -- 172.21.15.49:0/692303604 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97480cf670 msgr2=0x7f97480b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.550+0000 7f974ce00640 1 --2- 172.21.15.49:0/692303604 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97480cf670 0x7f97480b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.550+0000 7f974ce00640 1 -- 172.21.15.49:0/692303604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f974815e7e0 msgr2=0x7f974815cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.550+0000 7f974ce00640 1 --2- 172.21.15.49:0/692303604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f974815e7e0 0x7f974815cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.550+0000 7f974ce00640 1 -- 172.21.15.49:0/692303604 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97380094d0 con 0x7f97480c63d0 2024-01-31T12:09:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.550+0000 7f974ce00640 1 --2- 172.21.15.49:0/692303604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97480c63d0 0x7f97481f70b0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f973801b940 tx=0x7f973801bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:27.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.554+0000 7f9744c00640 1 -- 172.21.15.49:0/692303604 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97380be070 con 0x7f97480c63d0 2024-01-31T12:09:27.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.554+0000 7f9744c00640 1 -- 172.21.15.49:0/692303604 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97380b1b90 con 0x7f97480c63d0 2024-01-31T12:09:27.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.554+0000 7f974f800640 1 -- 172.21.15.49:0/692303604 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97480b6580 con 0x7f97480c63d0 2024-01-31T12:09:27.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.554+0000 7f9744c00640 1 -- 172.21.15.49:0/692303604 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97380b9440 con 0x7f97480c63d0 2024-01-31T12:09:27.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.554+0000 7f974f800640 1 -- 172.21.15.49:0/692303604 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97480b6b40 con 0x7f97480c63d0 2024-01-31T12:09:27.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.554+0000 7f974f800640 1 -- 172.21.15.49:0/692303604 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9748074860 con 0x7f97480c63d0 2024-01-31T12:09:27.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.554+0000 7f9744c00640 1 -- 172.21.15.49:0/692303604 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f97380b7070 con 0x7f97480c63d0 2024-01-31T12:09:27.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.558+0000 7f9744c00640 1 --2- 172.21.15.49:0/692303604 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9720066500 0x7f97200689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:27.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.558+0000 7f9744c00640 1 -- 172.21.15.49:0/692303604 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f9738120f80 con 0x7f97480c63d0 2024-01-31T12:09:27.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.558+0000 7f9747e00640 1 --2- 172.21.15.49:0/692303604 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9720066500 0x7f97200689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:27.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.558+0000 7f9747e00640 1 --2- 172.21.15.49:0/692303604 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9720066500 0x7f97200689c0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f97481f4090 tx=0x7f9730009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:27.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:27.566+0000 7f9744c00640 1 -- 172.21.15.49:0/692303604 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f97380ee480 con 0x7f97480c63d0 2024-01-31T12:09:28.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.034+0000 7f974f800640 1 -- 172.21.15.49:0/692303604 --> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f97480c7630 con 0x7f9720066500 2024-01-31T12:09:28.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.038+0000 7f9744c00640 1 -- 172.21.15.49:0/692303604 <== mgr.4100 v2:172.21.15.195:6832/3035808172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49557 (secure 0 0 0) 0x7f97300013b0 con 0x7f9720066500 2024-01-31T12:09:28.037 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:09:28.038 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-31T12:09:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.042+0000 7f974f800640 1 -- 172.21.15.49:0/692303604 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9720066500 msgr2=0x7f97200689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.042+0000 7f974f800640 1 --2- 172.21.15.49:0/692303604 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9720066500 0x7f97200689c0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f97481f4090 tx=0x7f9730009040 comp rx=0 tx=0).stop 2024-01-31T12:09:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.042+0000 7f974f800640 1 -- 172.21.15.49:0/692303604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97480c63d0 msgr2=0x7f97481f70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.042+0000 7f974f800640 1 --2- 172.21.15.49:0/692303604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97480c63d0 0x7f97481f70b0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f973801b940 tx=0x7f973801bad0 comp rx=0 tx=0).stop 2024-01-31T12:09:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.042+0000 7f974f800640 1 -- 172.21.15.49:0/692303604 shutdown_connections 2024-01-31T12:09:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.042+0000 7f974f800640 1 --2- 172.21.15.49:0/692303604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f974815e7e0 0x7f974815cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.042+0000 7f974f800640 1 --2- 172.21.15.49:0/692303604 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f97480cf670 0x7f97480b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.042+0000 7f974f800640 1 --2- 172.21.15.49:0/692303604 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f9720066500 0x7f97200689c0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.042+0000 7f974f800640 1 --2- 172.21.15.49:0/692303604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97480c63d0 0x7f97481f70b0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.042+0000 7f974f800640 1 -- 172.21.15.49:0/692303604 >> 172.21.15.49:0/692303604 conn(0x7f97480d0e60 msgr2=0x7f974806b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.042+0000 7f974f800640 1 -- 172.21.15.49:0/692303604 shutdown_connections 2024-01-31T12:09:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.042+0000 7f974f800640 1 -- 172.21.15.49:0/692303604 wait complete. 2024-01-31T12:09:28.092 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":12796,"stamp":"2024-01-31T12:09:27.975792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":39,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":12638012,"kb_used_data":22968,"kb_used_omap":3047,"kb_used_meta":12611928,"kb_avail":742336708,"statfs":{"total":773094113280,"available":760152788992,"internally_reserved":0,"allocated":23519232,"data_stored":21125263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3120248,"internal_metadata":12914615176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1581,"apply_latency_ms":1581,"commit_latency_ns":1581000000,"apply_latency_ns":1581000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-24374629418,"num_objects":-21745,"num_object_clones":0,"num_object_copies":-43490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-21745,"num_whiteouts":0,"num_read":-1824062,"num_read_kb":-128909254,"num_write":-6590201,"num_write_kb":-163420426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.611987"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":427,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-01-31T12:09:19.757297+0000","last_change":"2024-01-31T05:04:05.699222+0000","last_active":"2024-01-31T12:09:19.757297+0000","last_peered":"2024-01-31T12:09:19.757297+0000","last_clean":"2024-01-31T12:09:19.757297+0000","last_became_active":"2024-01-31T05:04:05.698239+0000","last_became_peered":"2024-01-31T05:04:05.698239+0000","last_unstale":"2024-01-31T12:09:19.757297+0000","last_undegraded":"2024-01-31T12:09:19.757297+0000","last_fullsized":"2024-01-31T12:09:19.757297+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_clean_scrub_stamp":"2024-01-31T05:04:04.484734+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:05:13.736598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834579953,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1591752,"kb_used_data":1088,"kb_used_omap":157,"kb_used_meta":1590498,"kb_avail":92780088,"statfs":{"total":96636764160,"available":95006810112,"internally_reserved":0,"allocated":1114112,"data_stored":815732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":161111,"internal_metadata":1628670633},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":73,"apply_latency_ms":73,"commit_latency_ns":73000000,"apply_latency_ns":73000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:34 2024","interfaces":[{"interface":"back","average":{"1min":4.8369999999999997,"5min":2.3380000000000001,"15min":1.8819999999999999},"min":{"1min":0.39500000000000002,"5min":0.34899999999999998,"15min":0.33700000000000002},"max":{"1min":50.472000000000001,"5min":50.472000000000001,"15min":50.472000000000001},"last":8.4930000000000003},{"interface":"front","average":{"1min":6.3970000000000002,"5min":2.875,"15min":2.085},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":64.932000000000002,"5min":64.932000000000002,"15min":64.932000000000002},"last":8.5199999999999996}]},{"osd":1,"last update":"Wed Jan 31 12:08:34 2024","interfaces":[{"interface":"back","average":{"1min":2.4129999999999998,"5min":1.508,"15min":1.7769999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.377},"max":{"1min":15.550000000000001,"5min":15.550000000000001,"15min":18.547999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":3.0800000000000001,"5min":1.6679999999999999,"15min":1.744},"min":{"1min":0.433,"5min":0.433,"15min":0.34799999999999998},"max":{"1min":14.384,"5min":14.384,"15min":14.384},"last":8.0169999999999995}]},{"osd":2,"last update":"Wed Jan 31 12:09:18 2024","interfaces":[{"interface":"back","average":{"1min":2.8439999999999999,"5min":1.8700000000000001,"15min":2.0059999999999998},"min":{"1min":0.54400000000000004,"5min":0.47599999999999998,"15min":0.45200000000000001},"max":{"1min":19.978000000000002,"5min":19.978000000000002,"15min":19.978000000000002},"last":8.8219999999999992},{"interface":"front","average":{"1min":2.6299999999999999,"5min":2.5209999999999999,"15min":2.1389999999999998},"min":{"1min":0.75700000000000001,"5min":0.44500000000000001,"15min":0.41799999999999998},"max":{"1min":6.8049999999999997,"5min":65.054000000000002,"15min":65.054000000000002},"last":7.742}]},{"osd":3,"last update":"Wed Jan 31 12:08:34 2024","interfaces":[{"interface":"back","average":{"1min":2.8159999999999998,"5min":1.827,"15min":1.8500000000000001},"min":{"1min":0.57699999999999996,"5min":0.45200000000000001,"15min":0.435},"max":{"1min":13.285,"5min":13.285,"15min":13.285},"last":7.7279999999999998},{"interface":"front","average":{"1min":5.9560000000000004,"5min":2.5089999999999999,"15min":1.9850000000000001},"min":{"1min":0.55900000000000005,"5min":0.46899999999999997,"15min":0.44},"max":{"1min":65.019000000000005,"5min":65.019000000000005,"15min":65.019000000000005},"last":36.966999999999999}]},{"osd":4,"last update":"Wed Jan 31 12:08:34 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":0.77100000000000002,"15min":0.66900000000000004},"min":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.32100000000000001},"max":{"1min":6.1760000000000002,"5min":6.1760000000000002,"15min":6.1760000000000002},"last":0.505},{"interface":"front","average":{"1min":1.615,"5min":0.94999999999999996,"15min":0.73999999999999999},"min":{"1min":0.42399999999999999,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":9.7100000000000009,"5min":9.7100000000000009,"15min":9.7100000000000009},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed Jan 31 12:08:34 2024","interfaces":[{"interface":"back","average":{"1min":5.0090000000000003,"5min":1.663,"15min":0.97499999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.35699999999999998},"max":{"1min":64.986999999999995,"5min":64.986999999999995,"15min":64.986999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":5.048,"5min":1.617,"15min":1.0229999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.36799999999999999},"max":{"1min":64.644000000000005,"5min":64.644000000000005,"15min":64.644000000000005},"last":0.53700000000000003}]},{"osd":6,"last update":"Wed Jan 31 12:08:34 2024","interfaces":[{"interface":"back","average":{"1min":1.677,"5min":0.997,"15min":0.89000000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.40999999999999998},"max":{"1min":15.616,"5min":15.616,"15min":15.616},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.071,"15min":0.85399999999999998},"min":{"1min":0.46600000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":9.6329999999999991,"5min":11.195,"15min":11.195},"last":0.52300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834579954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1474888,"kb_used_data":508,"kb_used_omap":156,"kb_used_meta":1474211,"kb_avail":92896952,"statfs":{"total":96636764160,"available":95126478848,"internally_reserved":0,"allocated":520192,"data_stored":225364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":160451,"internal_metadata":1509592381},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":577,"apply_latency_ms":577,"commit_latency_ns":577000000,"apply_latency_ns":577000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:55 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.7989999999999999,"15min":1.7989999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.312},"max":{"1min":4.6580000000000004,"5min":31.861000000000001,"15min":54.527000000000001},"last":4.9160000000000004},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.5489999999999999,"15min":1.7649999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.34000000000000002},"max":{"1min":4.7140000000000004,"5min":5.71,"15min":54.466999999999999},"last":4.96}]},{"osd":1,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.478,"15min":1.8360000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":4.048,"5min":19.844999999999999,"15min":28.239000000000001},"last":3.4159999999999999},{"interface":"front","average":{"1min":1.488,"5min":1.8620000000000001,"15min":1.9299999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.38400000000000001},"max":{"1min":4.1689999999999996,"5min":13.847,"15min":28.364000000000001},"last":14.305}]},{"osd":2,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":2.052,"15min":1.9750000000000001},"min":{"1min":0.60499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.8490000000000002,"5min":27.777999999999999,"15min":27.783999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.9670000000000001,"5min":3.1899999999999999,"15min":2.3079999999999998},"min":{"1min":0.68600000000000005,"5min":0.46100000000000002,"15min":0.436},"max":{"1min":7.6669999999999998,"5min":159.67400000000001,"15min":159.67400000000001},"last":13.955}]},{"osd":3,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.4419999999999999,"15min":1.8069999999999999},"min":{"1min":0.67300000000000004,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":2.194,"5min":8.1300000000000008,"15min":32.295999999999999},"last":29.422999999999998},{"interface":"front","average":{"1min":1.319,"5min":2.1890000000000001,"15min":2.1139999999999999},"min":{"1min":0.64700000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.71,"5min":27.905000000000001,"15min":33.198},"last":13.331}]},{"osd":4,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.73699999999999999,"15min":0.71399999999999997},"min":{"1min":0.40600000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.946,"5min":16.628,"15min":16.628},"last":3.339},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.70899999999999996},"min":{"1min":0.39300000000000002,"5min":0.378,"15min":0.36899999999999999},"max":{"1min":1.5600000000000001,"5min":4.8460000000000001,"15min":4.8460000000000001},"last":3.4609999999999999}]},{"osd":5,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.83399999999999996,"15min":0.87},"min":{"1min":0.45300000000000001,"5min":0.35399999999999998,"15min":0.33600000000000002},"max":{"1min":0.95199999999999996,"5min":19.120999999999999,"15min":36.438000000000002},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.86699999999999999,"15min":0.90100000000000002},"min":{"1min":0.42199999999999999,"5min":0.41199999999999998,"15min":0.372},"max":{"1min":2.056,"5min":23.087,"15min":31.077999999999999},"last":3.379}]},{"osd":7,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65200000000000002,"15min":0.73999999999999999},"min":{"1min":0.46200000000000002,"5min":0.45000000000000001,"15min":0.33800000000000002},"max":{"1min":1.4990000000000001,"5min":1.613,"15min":4.3499999999999996},"last":3.6669999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.92600000000000005,"15min":0.82799999999999996},"min":{"1min":0.498,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.077,"5min":20.317,"15min":20.317},"last":0.63300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834579953,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1058692,"kb_used_data":508,"kb_used_omap":757,"kb_used_meta":1057418,"kb_avail":93313148,"statfs":{"total":96636764160,"available":95552663552,"internally_reserved":0,"allocated":520192,"data_stored":225364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":775603,"internal_metadata":1082796621},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":94,"apply_latency_ms":94,"commit_latency_ns":94000000,"apply_latency_ns":94000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":2.98,"5min":2.2890000000000001,"15min":2.8660000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.29699999999999999},"max":{"1min":31.5,"5min":33.741999999999997,"15min":281.83499999999998},"last":1.0669999999999999},{"interface":"front","average":{"1min":3.581,"5min":2.339,"15min":3.004},"min":{"1min":0.69999999999999996,"5min":0.37,"15min":0.34300000000000003},"max":{"1min":31.524999999999999,"5min":35.189,"15min":277.49700000000001},"last":4.8140000000000001}]},{"osd":1,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":4.3179999999999996,"5min":2.7189999999999999,"15min":2.085},"min":{"1min":0.44600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":34.063000000000002,"5min":34.063000000000002,"15min":34.063000000000002},"last":0.72599999999999998},{"interface":"front","average":{"1min":3.2160000000000002,"5min":2.5459999999999998,"15min":2.0489999999999999},"min":{"1min":0.60899999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":32.128999999999998,"5min":32.128999999999998,"15min":32.128999999999998},"last":0.75700000000000001}]},{"osd":2,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":4.0780000000000003,"5min":2.431,"15min":3.6080000000000001},"min":{"1min":0.57199999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":36,"5min":36,"15min":279.86399999999998},"last":2.3140000000000001},{"interface":"front","average":{"1min":3.7650000000000001,"5min":2.4769999999999999,"15min":3.7229999999999999},"min":{"1min":0.56699999999999995,"5min":0.50700000000000001,"15min":0.40999999999999998},"max":{"1min":35.978999999999999,"5min":35.978999999999999,"15min":279.15699999999998},"last":1.415}]},{"osd":3,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":3.0739999999999998,"5min":2.3490000000000002,"15min":2.4940000000000002},"min":{"1min":0.59799999999999998,"5min":0.51900000000000002,"15min":0.435},"max":{"1min":32.176000000000002,"5min":32.176000000000002,"15min":160.709},"last":0.70699999999999996},{"interface":"front","average":{"1min":4.0700000000000003,"5min":2.4129999999999998,"15min":2.7120000000000002},"min":{"1min":0.82199999999999995,"5min":0.60499999999999998,"15min":0.46300000000000002},"max":{"1min":35.912999999999997,"5min":35.912999999999997,"15min":162.26599999999999},"last":0.82199999999999995}]},{"osd":4,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":2.25,"5min":1.2130000000000001,"15min":0.81299999999999994},"min":{"1min":0.40000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":32.652999999999999,"5min":32.652999999999999,"15min":32.652999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":2.431,"5min":1.246,"15min":0.86099999999999999},"min":{"1min":0.434,"5min":0.36299999999999999,"15min":0.33200000000000002},"max":{"1min":32.247,"5min":32.247,"15min":32.247},"last":0.53700000000000003}]},{"osd":6,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":2.7069999999999999,"5min":1.411,"15min":0.91300000000000003},"min":{"1min":0.47199999999999998,"5min":0.35799999999999998,"15min":0.34100000000000003},"max":{"1min":35.957999999999998,"5min":35.957999999999998,"15min":35.957999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":2.5720000000000001,"5min":1.2669999999999999,"15min":0.88800000000000001},"min":{"1min":0.47699999999999998,"5min":0.40200000000000002,"15min":0.38},"max":{"1min":36.444000000000003,"5min":36.444000000000003,"15min":36.444000000000003},"last":0.628}]},{"osd":7,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":2.8140000000000001,"5min":1.667,"15min":1.0429999999999999},"min":{"1min":0.44900000000000001,"5min":0.42599999999999999,"15min":0.375},"max":{"1min":32.799999999999997,"5min":39.918999999999997,"15min":39.918999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":2.964,"5min":1.6890000000000001,"15min":1.0569999999999999},"min":{"1min":0.53700000000000003,"5min":0.44800000000000001,"15min":0.42599999999999999},"max":{"1min":36.073999999999998,"5min":39.860999999999997,"15min":39.860999999999997},"last":0.56100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834579953,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1745092,"kb_used_data":508,"kb_used_omap":549,"kb_used_meta":1744026,"kb_avail":92626748,"statfs":{"total":96636764160,"available":94849789952,"internally_reserved":0,"allocated":520192,"data_stored":225364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":562466,"internal_metadata":1785883358},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.242,"15min":2.0920000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36299999999999999},"max":{"1min":5.7450000000000001,"5min":14.096,"15min":158.78200000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.4750000000000001,"15min":2.2029999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.33900000000000002},"max":{"1min":5.5800000000000001,"5min":5.5800000000000001,"15min":158.45400000000001},"last":0.65800000000000003}]},{"osd":1,"last update":"Wed Jan 31 12:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":2.028,"15min":2.2949999999999999},"min":{"1min":0.54000000000000004,"5min":0.42199999999999999,"15min":0.38100000000000001},"max":{"1min":3.5779999999999998,"5min":11.077999999999999,"15min":158.959},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.9630000000000001,"15min":2.3980000000000001},"min":{"1min":0.58999999999999997,"5min":0.50700000000000001,"15min":0.35199999999999998},"max":{"1min":4.5620000000000003,"5min":9.2490000000000006,"15min":158.69200000000001},"last":0.77900000000000003}]},{"osd":2,"last update":"Wed Jan 31 12:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":2.0910000000000002,"15min":2.3700000000000001},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.5920000000000001,"5min":7.8890000000000002,"15min":158.232},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.718,"5min":1.984,"15min":2.3759999999999999},"min":{"1min":0.623,"5min":0.44700000000000001,"15min":0.438},"max":{"1min":4.0979999999999999,"5min":12.132999999999999,"15min":157.76300000000001},"last":0.875}]},{"osd":3,"last update":"Wed Jan 31 12:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.9399999999999999,"5min":1.891,"15min":2.3330000000000002},"min":{"1min":0.69899999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.5590000000000002,"5min":6.5949999999999998,"15min":155.27799999999999},"last":9.2680000000000007},{"interface":"front","average":{"1min":1.716,"5min":1.5760000000000001,"15min":2.2719999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":4.8029999999999999,"5min":8.8300000000000001,"15min":156.81700000000001},"last":9.093}]},{"osd":5,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.79600000000000004,"15min":0.67800000000000005},"min":{"1min":0.42399999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.93500000000000005,"5min":9.1120000000000001,"15min":9.1120000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72699999999999998,"15min":0.69299999999999995},"min":{"1min":0.53700000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91100000000000003,"5min":4.3959999999999999,"15min":4.6840000000000002},"last":0.53600000000000003}]},{"osd":6,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.81799999999999995,"15min":0.73299999999999998},"min":{"1min":0.46200000000000002,"5min":0.379,"15min":0.35699999999999998},"max":{"1min":3.294,"5min":7.7930000000000001,"15min":7.7930000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.82099999999999995,"15min":0.72199999999999998},"min":{"1min":0.51300000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.2929999999999999,"5min":11.791,"15min":11.791},"last":0.64200000000000002}]},{"osd":7,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79000000000000004,"15min":0.73299999999999998},"min":{"1min":0.502,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.5840000000000001,"5min":4.0919999999999996,"15min":5.5869999999999997},"last":0.498},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.878,"15min":0.78900000000000003},"min":{"1min":0.504,"5min":0.41399999999999998,"15min":0.38800000000000001},"max":{"1min":3.395,"5min":7.8449999999999998,"15min":7.8449999999999998},"last":0.51900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834579900,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1692100,"kb_used_data":508,"kb_used_omap":532,"kb_used_meta":1691051,"kb_avail":92679740,"statfs":{"total":96636764160,"available":94904053760,"internally_reserved":0,"allocated":520192,"data_stored":225364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":545051,"internal_metadata":1731636965},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":181,"apply_latency_ms":181,"commit_latency_ns":181000000,"apply_latency_ns":181000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":4.0439999999999996,"5min":5.9880000000000004,"15min":4.0800000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.28000000000000003},"max":{"1min":14.579000000000001,"5min":273.40300000000002,"15min":273.40300000000002},"last":0.89400000000000002},{"interface":"front","average":{"1min":2.4500000000000002,"5min":5.8250000000000002,"15min":4.2130000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":8.2390000000000008,"5min":278.26600000000002,"15min":278.26600000000002},"last":0.79500000000000004}]},{"osd":1,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":2.6299999999999999,"5min":2.653,"15min":3.1669999999999998},"min":{"1min":0.73199999999999998,"5min":0.55500000000000005,"15min":0.42499999999999999},"max":{"1min":5.6299999999999999,"5min":8.9390000000000001,"15min":13.497},"last":11.002000000000001},{"interface":"front","average":{"1min":3.633,"5min":2.8919999999999999,"15min":3.2919999999999998},"min":{"1min":0.93000000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":7.0149999999999997,"5min":7.9969999999999999,"15min":12.76},"last":12.151}]},{"osd":2,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":2.2370000000000001,"5min":5.9370000000000003,"15min":4.1760000000000002},"min":{"1min":0.629,"5min":0.629,"15min":0.38500000000000001},"max":{"1min":7.6799999999999997,"5min":278.33300000000003,"15min":278.33300000000003},"last":12.004},{"interface":"front","average":{"1min":4.6050000000000004,"5min":6.5,"15min":4.4459999999999997},"min":{"1min":0.85999999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":14.929,"5min":273.27100000000002,"15min":273.27100000000002},"last":12.099}]},{"osd":4,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":1.9179999999999999,"5min":2.194,"15min":2.536},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.47499999999999998},"max":{"1min":5.8150000000000004,"5min":7.4550000000000001,"15min":9.7460000000000004},"last":1.546},{"interface":"front","average":{"1min":2.2080000000000002,"5min":2.1749999999999998,"15min":2.391},"min":{"1min":0.88200000000000001,"5min":0.59999999999999998,"15min":0.502},"max":{"1min":5.6239999999999997,"5min":6.2089999999999996,"15min":13.093},"last":1.9399999999999999}]},{"osd":5,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":2.653,"5min":2.3149999999999999,"15min":2.77},"min":{"1min":0.89900000000000002,"5min":0.627,"15min":0.52100000000000002},"max":{"1min":11.385,"5min":11.385,"15min":55.942999999999998},"last":1.8169999999999999},{"interface":"front","average":{"1min":2.9900000000000002,"5min":2.5179999999999998,"15min":2.7709999999999999},"min":{"1min":0.52700000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":6.7130000000000001,"5min":7.556,"15min":56.850999999999999},"last":1.879}]},{"osd":6,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":3.706,"5min":2.657,"15min":2.7120000000000002},"min":{"1min":0.59699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":14.464,"5min":14.464,"15min":14.464},"last":1.234},{"interface":"front","average":{"1min":2.012,"5min":2.3570000000000002,"15min":2.718},"min":{"1min":0.67000000000000004,"5min":0.61099999999999999,"15min":0.51300000000000001},"max":{"1min":5.8739999999999997,"5min":9.5690000000000008,"15min":9.6989999999999998},"last":1.5049999999999999}]},{"osd":7,"last update":"Wed Jan 31 12:08:36 2024","interfaces":[{"interface":"back","average":{"1min":2.8039999999999998,"5min":2.5539999999999998,"15min":3.0950000000000002},"min":{"1min":0.76000000000000001,"5min":0.65600000000000003,"15min":0.56399999999999995},"max":{"1min":17.34,"5min":17.34,"15min":55.713999999999999},"last":12.066000000000001},{"interface":"front","average":{"1min":3.1160000000000001,"5min":2.5950000000000002,"15min":2.9279999999999999},"min":{"1min":1.044,"5min":0.61699999999999999,"15min":0.58699999999999997},"max":{"1min":17.274000000000001,"5min":17.274000000000001,"15min":55.619},"last":11.148999999999999}]}]},{"osd":2,"up_from":13,"seq":55834579908,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1814676,"kb_used_data":18252,"kb_used_omap":168,"kb_used_meta":1796247,"kb_avail":92557164,"statfs":{"total":96636764160,"available":94778535936,"internally_reserved":0,"allocated":18690048,"data_stored":18366979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":173049,"internal_metadata":1839356935},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":165,"apply_latency_ms":165,"commit_latency_ns":165000000,"apply_latency_ns":165000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":4.5140000000000002,"5min":2.7429999999999999,"15min":2.972},"min":{"1min":0.55500000000000005,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":26.771000000000001,"5min":26.771000000000001,"15min":26.771000000000001},"last":15.228999999999999},{"interface":"front","average":{"1min":3.923,"5min":3.0449999999999999,"15min":3.1269999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.41499999999999998},"max":{"1min":14.548999999999999,"5min":14.548999999999999,"15min":14.548999999999999},"last":16.814}]},{"osd":1,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":3.202,"5min":3.7440000000000002,"15min":3.3359999999999999},"min":{"1min":0.438,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":7.8220000000000001,"5min":48.207999999999998,"15min":48.207999999999998},"last":15.632999999999999},{"interface":"front","average":{"1min":4.6189999999999998,"5min":4.0439999999999996,"15min":3.6749999999999998},"min":{"1min":0.624,"5min":0.60899999999999999,"15min":0.35799999999999998},"max":{"1min":23.408000000000001,"5min":49.024999999999999,"15min":49.024999999999999},"last":16.350999999999999}]},{"osd":3,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":5.9969999999999999,"5min":4.0460000000000003,"15min":3.7519999999999998},"min":{"1min":0.75,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":35.802,"5min":35.802,"15min":35.802},"last":16.614000000000001},{"interface":"front","average":{"1min":5.0519999999999996,"5min":4.5519999999999996,"15min":3.944},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.47299999999999998},"max":{"1min":30.472999999999999,"5min":48.682000000000002,"15min":48.682000000000002},"last":16.440000000000001}]},{"osd":4,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":4.585,"5min":3.0030000000000001,"15min":2.7410000000000001},"min":{"1min":0.63700000000000001,"5min":0.54300000000000004,"15min":0.50700000000000001},"max":{"1min":33.631,"5min":33.631,"15min":33.631},"last":16.234000000000002},{"interface":"front","average":{"1min":4.1829999999999998,"5min":2.9620000000000002,"15min":2.847},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":33.277000000000001,"5min":33.277000000000001,"15min":33.277000000000001},"last":15.958}]},{"osd":5,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":6.665,"5min":3.512,"15min":3.0139999999999998},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.55000000000000004},"max":{"1min":44.935000000000002,"5min":44.935000000000002,"15min":44.935000000000002},"last":15.901},{"interface":"front","average":{"1min":4.835,"5min":3.077,"15min":2.98},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":44.590000000000003,"5min":44.590000000000003,"15min":44.590000000000003},"last":16.09}]},{"osd":6,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":3.9449999999999998,"5min":2.6739999999999999,"15min":2.5979999999999999},"min":{"1min":0.83499999999999996,"5min":0.66200000000000003,"15min":0.60099999999999998},"max":{"1min":26.259,"5min":26.259,"15min":26.259},"last":15.836},{"interface":"front","average":{"1min":3.601,"5min":3.0329999999999999,"15min":2.98},"min":{"1min":0.71499999999999997,"5min":0.70799999999999996,"15min":0.56899999999999995},"max":{"1min":12.18,"5min":13.839,"15min":19.888999999999999},"last":16.553000000000001}]},{"osd":7,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":2.7730000000000001,"5min":2.6509999999999998,"15min":2.6389999999999998},"min":{"1min":0.89800000000000002,"5min":0.69199999999999995,"15min":0.56799999999999995},"max":{"1min":7.7130000000000001,"5min":11.544,"15min":11.81},"last":16.206},{"interface":"front","average":{"1min":3.7349999999999999,"5min":3.105,"15min":3.1230000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":23.294,"5min":23.294,"15min":23.294},"last":17.050000000000001}]}]},{"osd":1,"up_from":13,"seq":55834579918,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1485956,"kb_used_data":508,"kb_used_omap":400,"kb_used_meta":1485039,"kb_avail":92885884,"statfs":{"total":96636764160,"available":95115145216,"internally_reserved":0,"allocated":520192,"data_stored":225364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":410545,"internal_metadata":1520680015},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":144,"apply_latency_ms":144,"commit_latency_ns":144000000,"apply_latency_ns":144000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.532,"5min":2.9990000000000001,"15min":3.2010000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":6.5759999999999996,"5min":17.189,"15min":115.23699999999999},"last":3.8010000000000002},{"interface":"front","average":{"1min":2.4079999999999999,"5min":2.7799999999999998,"15min":3.3940000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.32600000000000001},"max":{"1min":5.4299999999999997,"5min":9.3670000000000009,"15min":114.834},"last":1.613}]},{"osd":2,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.976,"5min":3.2810000000000001,"15min":3.3079999999999998},"min":{"1min":0.64000000000000001,"5min":0.621,"15min":0.40799999999999997},"max":{"1min":7.274,"5min":13.641,"15min":22.890000000000001},"last":2.2679999999999998},{"interface":"front","average":{"1min":2.581,"5min":3.476,"15min":3.359},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":6.6879999999999997,"5min":17.297000000000001,"15min":17.297000000000001},"last":4.0279999999999996}]},{"osd":3,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.758,"5min":3.6819999999999999,"15min":3.569},"min":{"1min":0.503,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":7.6760000000000002,"5min":18.832999999999998,"15min":18.832999999999998},"last":22.298999999999999},{"interface":"front","average":{"1min":3.4860000000000002,"5min":3.605,"15min":3.456},"min":{"1min":0.85699999999999998,"5min":0.52300000000000002,"15min":0.438},"max":{"1min":7.1639999999999997,"5min":26.114999999999998,"15min":26.114999999999998},"last":22.460999999999999}]},{"osd":4,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.4689999999999999,"5min":2.6120000000000001,"15min":2.5259999999999998},"min":{"1min":0.625,"5min":0.61199999999999999,"15min":0.48299999999999998},"max":{"1min":6.7069999999999999,"5min":9.0830000000000002,"15min":10.266999999999999},"last":3.1989999999999998},{"interface":"front","average":{"1min":2.4590000000000001,"5min":2.5009999999999999,"15min":2.343},"min":{"1min":0.71399999999999997,"5min":0.56899999999999995,"15min":0.50700000000000001},"max":{"1min":7.3979999999999997,"5min":13.512,"15min":22.774000000000001},"last":1.98}]},{"osd":5,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.5139999999999998,"5min":2.569,"15min":2.4009999999999998},"min":{"1min":0.75800000000000001,"5min":0.64200000000000002,"15min":0.51200000000000001},"max":{"1min":7.5039999999999996,"5min":13.734999999999999,"15min":13.734999999999999},"last":2.0960000000000001},{"interface":"front","average":{"1min":2.2639999999999998,"5min":2.7730000000000001,"15min":2.5339999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":7.3760000000000003,"5min":17.056999999999999,"15min":17.056999999999999},"last":4.1840000000000002}]},{"osd":6,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.7269999999999999,"5min":2.903,"15min":2.6880000000000002},"min":{"1min":0.80600000000000005,"5min":0.68600000000000005,"15min":0.52600000000000002},"max":{"1min":6.8289999999999997,"5min":12.571999999999999,"15min":12.571999999999999},"last":3.335},{"interface":"front","average":{"1min":2.9769999999999999,"5min":2.8559999999999999,"15min":2.589},"min":{"1min":0.79000000000000004,"5min":0.61399999999999999,"15min":0.54600000000000004},"max":{"1min":8.5289999999999999,"5min":13.827999999999999,"15min":13.827999999999999},"last":3.6970000000000001}]},{"osd":7,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.464,"5min":3.1589999999999998,"15min":2.7170000000000001},"min":{"1min":0.77400000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":7.5510000000000002,"5min":18.960999999999999,"15min":18.960999999999999},"last":4.2910000000000004},{"interface":"front","average":{"1min":2.6419999999999999,"5min":3.2050000000000001,"15min":2.919},"min":{"1min":0.89600000000000002,"5min":0.64900000000000002,"15min":0.53900000000000003},"max":{"1min":6.9320000000000004,"5min":24.904,"15min":24.904},"last":3.444}]}]},{"osd":0,"up_from":13,"seq":55834579913,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1774856,"kb_used_data":1088,"kb_used_omap":324,"kb_used_meta":1773435,"kb_avail":92596984,"statfs":{"total":96636764160,"available":94819311616,"internally_reserved":0,"allocated":1114112,"data_stored":815732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":331972,"internal_metadata":1815998268},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":303,"apply_latency_ms":303,"commit_latency_ns":303000000,"apply_latency_ns":303000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":4.492,"5min":3.2429999999999999,"15min":3.1539999999999999},"min":{"1min":0.747,"5min":0.58699999999999997,"15min":0.48499999999999999},"max":{"1min":25.902000000000001,"5min":25.902000000000001,"15min":25.902000000000001},"last":7.2800000000000002},{"interface":"front","average":{"1min":4.1260000000000003,"5min":3.125,"15min":3.1150000000000002},"min":{"1min":0.98899999999999999,"5min":0.55800000000000005,"15min":0.30499999999999999},"max":{"1min":26.027999999999999,"5min":26.027999999999999,"15min":26.027999999999999},"last":9.2210000000000001}]},{"osd":2,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":4.4299999999999997,"5min":3.4180000000000001,"15min":3.3399999999999999},"min":{"1min":0.67200000000000004,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":18.809999999999999,"5min":24.140999999999998,"15min":25.704999999999998},"last":8.2420000000000009},{"interface":"front","average":{"1min":3.8660000000000001,"5min":3.3639999999999999,"15min":3.2280000000000002},"min":{"1min":0.68200000000000005,"5min":0.68100000000000005,"15min":0.504},"max":{"1min":16.922000000000001,"5min":17.381,"15min":25.126000000000001},"last":8.0549999999999997}]},{"osd":3,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":3.5259999999999998,"5min":3.7450000000000001,"15min":3.4550000000000001},"min":{"1min":0.60699999999999998,"5min":0.52800000000000002,"15min":0.39700000000000002},"max":{"1min":10.241,"5min":32.636000000000003,"15min":32.636000000000003},"last":14.25},{"interface":"front","average":{"1min":4.7069999999999999,"5min":3.8660000000000001,"15min":3.7839999999999998},"min":{"1min":0.97899999999999998,"5min":0.56599999999999995,"15min":0.51200000000000001},"max":{"1min":18.385999999999999,"5min":26.202000000000002,"15min":26.202000000000002},"last":8.7279999999999998}]},{"osd":4,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":2.1000000000000001,"5min":2.375,"15min":2.3799999999999999},"min":{"1min":0.876,"5min":0.70199999999999996,"15min":0.54300000000000004},"max":{"1min":5.3929999999999998,"5min":13.472,"15min":13.472},"last":8.1880000000000006},{"interface":"front","average":{"1min":3.2839999999999998,"5min":2.6429999999999998,"15min":2.3809999999999998},"min":{"1min":0.82199999999999995,"5min":0.60299999999999998,"15min":0.49199999999999999},"max":{"1min":9.9039999999999999,"5min":28.151,"15min":28.151},"last":7.8710000000000004}]},{"osd":5,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":3.0430000000000001,"5min":2.726,"15min":2.7229999999999999},"min":{"1min":0.999,"5min":0.67300000000000004,"15min":0.46600000000000003},"max":{"1min":8.1099999999999994,"5min":16.670000000000002,"15min":25.186},"last":7.5540000000000003},{"interface":"front","average":{"1min":2.6989999999999998,"5min":2.6829999999999998,"15min":2.6150000000000002},"min":{"1min":0.93700000000000006,"5min":0.69799999999999995,"15min":0.57099999999999995},"max":{"1min":9.1289999999999996,"5min":11.199,"15min":25.013000000000002},"last":8.3140000000000001}]},{"osd":6,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":3.3700000000000001,"5min":2.8650000000000002,"15min":2.4980000000000002},"min":{"1min":0.79500000000000004,"5min":0.72499999999999998,"15min":0.53600000000000003},"max":{"1min":10.036,"5min":27.925999999999998,"15min":27.925999999999998},"last":7.8179999999999996},{"interface":"front","average":{"1min":3.7170000000000001,"5min":2.9649999999999999,"15min":2.8849999999999998},"min":{"1min":1.1220000000000001,"5min":0.71199999999999997,"15min":0.55500000000000005},"max":{"1min":16.567,"5min":19.242999999999999,"15min":25.300000000000001},"last":7.681}]},{"osd":7,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":3.3050000000000002,"5min":3.2549999999999999,"15min":2.9199999999999999},"min":{"1min":1.046,"5min":0.77900000000000003,"15min":0.58899999999999997},"max":{"1min":17.152999999999999,"5min":53.951000000000001,"15min":53.951000000000001},"last":8.4320000000000004},{"interface":"front","average":{"1min":3.407,"5min":3.202,"15min":2.7490000000000001},"min":{"1min":0.89400000000000002,"5min":0.65400000000000003,"15min":0.57199999999999995},"max":{"1min":10.141999999999999,"5min":28.053000000000001,"15min":28.053000000000001},"last":14.141999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-31T12:09:28.093 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T12:09:28.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.498+0000 7fc9d0400640 1 Processor -- start 2024-01-31T12:09:28.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.498+0000 7fc9d0400640 1 -- start start 2024-01-31T12:09:28.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.502+0000 7fc9d0400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc9c806f530 0x7fc9c80cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:28.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.502+0000 7fc9d0400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c80cafe0 con 0x7fc9c81579f0 2024-01-31T12:09:28.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.502+0000 7fc9d0400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c80ca3f0 con 0x7fc9c8071b90 2024-01-31T12:09:28.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.502+0000 7fc9d0400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c8157dd0 con 0x7fc9c806f530 2024-01-31T12:09:28.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.502+0000 7fc9cd000640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fc9c8071b90 0x7fc9c80cb6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:48728/0 (socket says 172.21.15.49:48728) 2024-01-31T12:09:28.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.502+0000 7fc9cd000640 1 -- 172.21.15.49:0/2006933108 learned_addr learned my addr 172.21.15.49:0/2006933108 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:09:28.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.502+0000 7fc9ce400640 1 --2- 172.21.15.49:0/2006933108 >> v2:172.21.15.195:3300/0 conn(0x7fc9c806f530 0x7fc9c80cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:28.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.506+0000 7fc9c7e00640 1 -- 172.21.15.49:0/2006933108 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793329107 0 0) 0x7fc9c80ca3f0 con 0x7fc9c8071b90 2024-01-31T12:09:28.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.506+0000 7fc9c7e00640 1 -- 172.21.15.49:0/2006933108 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9a8003530 con 0x7fc9c8071b90 2024-01-31T12:09:28.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.506+0000 7fc9ce400640 1 -- 172.21.15.49:0/2006933108 >> v1:172.21.15.195:6789/0 conn(0x7fc9c8071b90 legacy=0x7fc9c80cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:28.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.506+0000 7fc9ce400640 1 -- 172.21.15.49:0/2006933108 >> v1:172.21.15.49:6789/0 conn(0x7fc9c81579f0 legacy=0x7fc9c8071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:28.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.506+0000 7fc9ce400640 1 -- 172.21.15.49:0/2006933108 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c80ca6b0 con 0x7fc9c806f530 2024-01-31T12:09:28.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.514+0000 7fc9ce400640 1 --2- 172.21.15.49:0/2006933108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c806f530 0x7fc9c80cbdb0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80ca5e0 tx=0x7fc9b801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=180e2314b00a3d66 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:28.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.514+0000 7fc9c7e00640 1 -- 172.21.15.49:0/2006933108 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80a6040 con 0x7fc9c806f530 2024-01-31T12:09:28.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.514+0000 7fc9c7e00640 1 -- 172.21.15.49:0/2006933108 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b80aa600 con 0x7fc9c806f530 2024-01-31T12:09:28.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.514+0000 7fc9c7e00640 1 -- 172.21.15.49:0/2006933108 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80aa990 con 0x7fc9c806f530 2024-01-31T12:09:28.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.514+0000 7fc9d0400640 1 -- 172.21.15.49:0/2006933108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c806f530 msgr2=0x7fc9c80cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:28.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.514+0000 7fc9d0400640 1 --2- 172.21.15.49:0/2006933108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c806f530 0x7fc9c80cbdb0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80ca5e0 tx=0x7fc9b801c480 comp rx=0 tx=0).stop 2024-01-31T12:09:28.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.514+0000 7fc9d0400640 1 -- 172.21.15.49:0/2006933108 shutdown_connections 2024-01-31T12:09:28.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.514+0000 7fc9d0400640 1 --2- 172.21.15.49:0/2006933108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c806f530 0x7fc9c80cbdb0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:28.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.514+0000 7fc9d0400640 1 -- 172.21.15.49:0/2006933108 >> 172.21.15.49:0/2006933108 conn(0x7fc9c80cfda0 msgr2=0x7fc9c80d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:28.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.514+0000 7fc9d0400640 1 -- 172.21.15.49:0/2006933108 shutdown_connections 2024-01-31T12:09:28.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.514+0000 7fc9d0400640 1 -- 172.21.15.49:0/2006933108 wait complete. 2024-01-31T12:09:28.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.522+0000 7fc9d0400640 1 Processor -- start 2024-01-31T12:09:28.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.522+0000 7fc9d0400640 1 -- start start 2024-01-31T12:09:28.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.522+0000 7fc9d0400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c806f530 0x7fc9c80c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:28.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.522+0000 7fc9d0400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c8071b90 0x7fc9c80c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:28.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.522+0000 7fc9d0400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9c81579f0 0x7fc9c80c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:28.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.522+0000 7fc9d0400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80c40e0 con 0x7fc9c806f530 2024-01-31T12:09:28.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.522+0000 7fc9d0400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80c31b0 con 0x7fc9c8071b90 2024-01-31T12:09:28.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.522+0000 7fc9d0400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80c6550 con 0x7fc9c81579f0 2024-01-31T12:09:28.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.526+0000 7fc9cda00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c806f530 0x7fc9c80c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:28.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.526+0000 7fc9cd000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c8071b90 0x7fc9c80c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:28.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.526+0000 7fc9cd000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c8071b90 0x7fc9c80c2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:38950/0 (socket says 172.21.15.49:38950) 2024-01-31T12:09:28.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.526+0000 7fc9cd000640 1 -- 172.21.15.49:0/3736442467 learned_addr learned my addr 172.21.15.49:0/3736442467 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:28.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.526+0000 7fc9ce400640 1 --2- 172.21.15.49:0/3736442467 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9c81579f0 0x7fc9c80c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:28.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.526+0000 7fc9cd000640 1 -- 172.21.15.49:0/3736442467 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9c81579f0 msgr2=0x7fc9c80c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:28.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.526+0000 7fc9cd000640 1 --2- 172.21.15.49:0/3736442467 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9c81579f0 0x7fc9c80c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:28.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.526+0000 7fc9cd000640 1 -- 172.21.15.49:0/3736442467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c806f530 msgr2=0x7fc9c80c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:28.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.526+0000 7fc9cd000640 1 --2- 172.21.15.49:0/3736442467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c806f530 0x7fc9c80c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:28.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.526+0000 7fc9cd000640 1 -- 172.21.15.49:0/3736442467 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b8009420 con 0x7fc9c8071b90 2024-01-31T12:09:28.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.526+0000 7fc9ce400640 1 --2- 172.21.15.49:0/3736442467 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9c81579f0 0x7fc9c80c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T12:09:28.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.526+0000 7fc9cd000640 1 --2- 172.21.15.49:0/3736442467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c8071b90 0x7fc9c80c2c70 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000cbc0 tx=0x7fc9c000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:28.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.526+0000 7fc9c5600640 1 -- 172.21.15.49:0/3736442467 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000ad40 con 0x7fc9c8071b90 2024-01-31T12:09:28.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.526+0000 7fc9c5600640 1 -- 172.21.15.49:0/3736442467 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c0012400 con 0x7fc9c8071b90 2024-01-31T12:09:28.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.526+0000 7fc9c5600640 1 -- 172.21.15.49:0/3736442467 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000aea0 con 0x7fc9c8071b90 2024-01-31T12:09:28.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.526+0000 7fc9d0400640 1 -- 172.21.15.49:0/3736442467 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c80c42f0 con 0x7fc9c8071b90 2024-01-31T12:09:28.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.526+0000 7fc9d0400640 1 -- 172.21.15.49:0/3736442467 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c80c48b0 con 0x7fc9c8071b90 2024-01-31T12:09:28.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.526+0000 7fc9d0400640 1 -- 172.21.15.49:0/3736442467 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c80c3320 con 0x7fc9c8071b90 2024-01-31T12:09:28.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.530+0000 7fc9c5600640 1 -- 172.21.15.49:0/3736442467 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fc9c0007070 con 0x7fc9c8071b90 2024-01-31T12:09:28.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.534+0000 7fc9c5600640 1 --2- 172.21.15.49:0/3736442467 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc9a0066500 0x7fc9a00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:28.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.534+0000 7fc9c5600640 1 -- 172.21.15.49:0/3736442467 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc9c0083d10 con 0x7fc9c8071b90 2024-01-31T12:09:28.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.534+0000 7fc9cda00640 1 --2- 172.21.15.49:0/3736442467 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc9a0066500 0x7fc9a00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:28.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.534+0000 7fc9cda00640 1 --2- 172.21.15.49:0/3736442467 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc9a0066500 0x7fc9a00689c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0001770 tx=0x7fc9b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:28.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.538+0000 7fc9c5600640 1 -- 172.21.15.49:0/3736442467 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fc9c0089020 con 0x7fc9c8071b90 2024-01-31T12:09:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.706+0000 7fc9d0400640 1 -- 172.21.15.49:0/3736442467 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9c814ad50 con 0x7fc9c8071b90 2024-01-31T12:09:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.710+0000 7fc9c5600640 1 -- 172.21.15.49:0/3736442467 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+13168 (secure 0 0 0) 0x7fc9c0017090 con 0x7fc9c8071b90 2024-01-31T12:09:28.710 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:09:28.710 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":44,"fsid":"3d27a9c0-c28e-4304-958f-ef21a88f4ab5","created":"2024-01-31T05:03:51.474664+0000","modified":"2024-01-31T12:09:18.644721+0000","last_up_change":"2024-01-31T05:04:03.190292+0000","last_in_change":"2024-01-31T05:03:54.032746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:04.484066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90693ba8-1d6e-48a5-a1e8-a4b15d70038f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6801","nonce":3804147802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6803","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6804","nonce":3804147802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6811","nonce":3804147802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3804147802},{"type":"v1","addr":"172.21.15.49:6808","nonce":3804147802}]},"public_addr":"172.21.15.49:6801/3804147802","cluster_addr":"172.21.15.49:6804/3804147802","heartbeat_back_addr":"172.21.15.49:6811/3804147802","heartbeat_front_addr":"172.21.15.49:6808/3804147802","state":["exists","up"]},{"osd":1,"uuid":"2b5d75dc-9b9a-4640-b966-c46e98849877","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6825","nonce":659898319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6827","nonce":659898319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6831","nonce":659898319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":659898319},{"type":"v1","addr":"172.21.15.49:6829","nonce":659898319}]},"public_addr":"172.21.15.49:6825/659898319","cluster_addr":"172.21.15.49:6827/659898319","heartbeat_back_addr":"172.21.15.49:6831/659898319","heartbeat_front_addr":"172.21.15.49:6829/659898319","state":["exists","up"]},{"osd":2,"uuid":"e856a6de-31fb-49e3-a1a3-3466b082d382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6817","nonce":1521900239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6819","nonce":1521900239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6823","nonce":1521900239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":1521900239},{"type":"v1","addr":"172.21.15.49:6821","nonce":1521900239}]},"public_addr":"172.21.15.49:6817/1521900239","cluster_addr":"172.21.15.49:6819/1521900239","heartbeat_back_addr":"172.21.15.49:6823/1521900239","heartbeat_front_addr":"172.21.15.49:6821/1521900239","state":["exists","up"]},{"osd":3,"uuid":"3f50e95f-4597-42eb-98be-b6d8ab4d21c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6805","nonce":571126940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6807","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6810","nonce":571126940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6815","nonce":571126940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":571126940},{"type":"v1","addr":"172.21.15.49:6813","nonce":571126940}]},"public_addr":"172.21.15.49:6805/571126940","cluster_addr":"172.21.15.49:6810/571126940","heartbeat_back_addr":"172.21.15.49:6815/571126940","heartbeat_front_addr":"172.21.15.49:6813/571126940","state":["exists","up"]},{"osd":4,"uuid":"fd4f0aa2-91d0-417e-9ef6-264932a2f796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6825","nonce":2275458030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6827","nonce":2275458030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6831","nonce":2275458030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2275458030},{"type":"v1","addr":"172.21.15.195:6829","nonce":2275458030}]},"public_addr":"172.21.15.195:6825/2275458030","cluster_addr":"172.21.15.195:6827/2275458030","heartbeat_back_addr":"172.21.15.195:6831/2275458030","heartbeat_front_addr":"172.21.15.195:6829/2275458030","state":["exists","up"]},{"osd":5,"uuid":"1db1184e-4b43-4add-ba72-7da0fe4c549e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6801","nonce":578985434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6803","nonce":578985434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6807","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6810","nonce":578985434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":578985434},{"type":"v1","addr":"172.21.15.195:6805","nonce":578985434}]},"public_addr":"172.21.15.195:6801/578985434","cluster_addr":"172.21.15.195:6803/578985434","heartbeat_back_addr":"172.21.15.195:6810/578985434","heartbeat_front_addr":"172.21.15.195:6805/578985434","state":["exists","up"]},{"osd":6,"uuid":"bf8ae0f1-81cc-494e-aa41-55a500276942","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6808","nonce":2294396668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6814","nonce":2294396668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6822","nonce":2294396668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2294396668},{"type":"v1","addr":"172.21.15.195:6818","nonce":2294396668}]},"public_addr":"172.21.15.195:6808/2294396668","cluster_addr":"172.21.15.195:6814/2294396668","heartbeat_back_addr":"172.21.15.195:6822/2294396668","heartbeat_front_addr":"172.21.15.195:6818/2294396668","state":["exists","up"]},{"osd":7,"uuid":"1bafefb2-47d4-4989-912f-44c50633498f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6809","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6811","nonce":1947167273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6813","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6815","nonce":1947167273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6823","nonce":1947167273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":1947167273},{"type":"v1","addr":"172.21.15.195:6819","nonce":1947167273}]},"public_addr":"172.21.15.195:6811/1947167273","cluster_addr":"172.21.15.195:6815/1947167273","heartbeat_back_addr":"172.21.15.195:6823/1947167273","heartbeat_front_addr":"172.21.15.195:6819/1947167273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.771423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.577756+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.707894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.681906+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.965964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.657175+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:59.911183+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6835/4235056900":"2024-02-01T12:09:13.774553+0000","172.21.15.49:6834/4235056900":"2024-02-01T12:09:13.774553+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T12:09:28.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.710+0000 7fc9d0400640 1 -- 172.21.15.49:0/3736442467 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc9a0066500 msgr2=0x7fc9a00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:28.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.710+0000 7fc9d0400640 1 --2- 172.21.15.49:0/3736442467 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc9a0066500 0x7fc9a00689c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0001770 tx=0x7fc9b0009040 comp rx=0 tx=0).stop 2024-01-31T12:09:28.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.710+0000 7fc9d0400640 1 -- 172.21.15.49:0/3736442467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c8071b90 msgr2=0x7fc9c80c2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:28.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.710+0000 7fc9d0400640 1 --2- 172.21.15.49:0/3736442467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c8071b90 0x7fc9c80c2c70 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000cbc0 tx=0x7fc9c000a430 comp rx=0 tx=0).stop 2024-01-31T12:09:28.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.714+0000 7fc9d0400640 1 -- 172.21.15.49:0/3736442467 shutdown_connections 2024-01-31T12:09:28.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.714+0000 7fc9d0400640 1 --2- 172.21.15.49:0/3736442467 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9c81579f0 0x7fc9c80c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:28.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.714+0000 7fc9d0400640 1 --2- 172.21.15.49:0/3736442467 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc9a0066500 0x7fc9a00689c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:28.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.714+0000 7fc9d0400640 1 --2- 172.21.15.49:0/3736442467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c8071b90 0x7fc9c80c2c70 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:28.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.714+0000 7fc9d0400640 1 --2- 172.21.15.49:0/3736442467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9c806f530 0x7fc9c80c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:28.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.714+0000 7fc9d0400640 1 -- 172.21.15.49:0/3736442467 >> 172.21.15.49:0/3736442467 conn(0x7fc9c80cfda0 msgr2=0x7fc9c814e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:28.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.714+0000 7fc9d0400640 1 -- 172.21.15.49:0/3736442467 shutdown_connections 2024-01-31T12:09:28.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:28.714+0000 7fc9d0400640 1 -- 172.21.15.49:0/3736442467 wait complete. 2024-01-31T12:09:29.738 INFO:tasks.ceph:Scrubbing osd.0 2024-01-31T12:09:29.738 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-31T12:09:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.162+0000 7f45e1000640 1 Processor -- start 2024-01-31T12:09:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.162+0000 7f45e1000640 1 -- start start 2024-01-31T12:09:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45e1000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f45dc0cf670 0x7f45dc0b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45e1000640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45dc0c6800 con 0x7f45dc0c63d0 2024-01-31T12:09:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45e1000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45dc0c6ab0 con 0x7f45dc15e7e0 2024-01-31T12:09:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45e1000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45dc0d1d40 con 0x7f45dc0cf670 2024-01-31T12:09:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d9e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f45dc15e7e0 0x7f45dc0cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:48740/0 (socket says 172.21.15.49:48740) 2024-01-31T12:09:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d9e00640 1 -- 172.21.15.49:0/3352327813 learned_addr learned my addr 172.21.15.49:0/3352327813 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:09:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d9400640 1 --2- 172.21.15.49:0/3352327813 >> v2:172.21.15.49:3300/0 conn(0x7f45dc0cf670 0x7f45dc0b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:30.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d8a00640 1 -- 172.21.15.49:0/3352327813 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1401280438 0 0) 0x7f45dc0c6ab0 con 0x7f45dc15e7e0 2024-01-31T12:09:30.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d8a00640 1 -- 172.21.15.49:0/3352327813 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45bc003530 con 0x7f45dc15e7e0 2024-01-31T12:09:30.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d8a00640 1 -- 172.21.15.49:0/3352327813 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3743138760 0 0) 0x7f45dc0c6800 con 0x7f45dc0c63d0 2024-01-31T12:09:30.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d8a00640 1 -- 172.21.15.49:0/3352327813 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45dc0c6ab0 con 0x7f45dc0c63d0 2024-01-31T12:09:30.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d8a00640 1 -- 172.21.15.49:0/3352327813 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4053824744 0 0) 0x7f45bc003530 con 0x7f45dc15e7e0 2024-01-31T12:09:30.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d8a00640 1 -- 172.21.15.49:0/3352327813 >> v2:172.21.15.49:3300/0 conn(0x7f45dc0cf670 msgr2=0x7f45dc0b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:30.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d8a00640 1 --2- 172.21.15.49:0/3352327813 >> v2:172.21.15.49:3300/0 conn(0x7f45dc0cf670 0x7f45dc0b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:30.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d8a00640 1 -- 172.21.15.49:0/3352327813 >> v1:172.21.15.49:6789/0 conn(0x7f45dc0c63d0 legacy=0x7f45dc0cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:30.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d8a00640 1 -- 172.21.15.49:0/3352327813 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc0c6d90 con 0x7f45dc15e7e0 2024-01-31T12:09:30.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d8a00640 1 -- 172.21.15.49:0/3352327813 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7f45cc001680 con 0x7f45dc15e7e0 2024-01-31T12:09:30.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d8a00640 1 -- 172.21.15.49:0/3352327813 >> v1:172.21.15.195:6789/0 conn(0x7f45dc15e7e0 legacy=0x7f45dc0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:30.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d8a00640 1 --2- 172.21.15.49:0/3352327813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45bc003b60 0x7f45bc003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:30.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d8a00640 1 --2- 172.21.15.49:0/3352327813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45bc0047d0 0x7f45bc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:30.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d8a00640 1 --2- 172.21.15.49:0/3352327813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45bc0051e0 0x7f45bc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:30.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d8a00640 1 -- 172.21.15.49:0/3352327813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0d1d40 con 0x7f45bc0051e0 2024-01-31T12:09:30.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d8a00640 1 -- 172.21.15.49:0/3352327813 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc00c060 con 0x7f45bc0047d0 2024-01-31T12:09:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d8a00640 1 -- 172.21.15.49:0/3352327813 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc00c220 con 0x7f45bc003b60 2024-01-31T12:09:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45da800640 1 --2- 172.21.15.49:0/3352327813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45bc0051e0 0x7f45bc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.166+0000 7f45d9400640 1 --2- 172.21.15.49:0/3352327813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45bc0047d0 0x7f45bc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.170+0000 7f45d9e00640 1 --2- 172.21.15.49:0/3352327813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45bc003b60 0x7f45bc003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.170+0000 7f45d9e00640 1 -- 172.21.15.49:0/3352327813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45bc0047d0 msgr2=0x7f45bc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.170+0000 7f45d9e00640 1 --2- 172.21.15.49:0/3352327813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45bc0047d0 0x7f45bc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.170+0000 7f45d9e00640 1 -- 172.21.15.49:0/3352327813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45bc0051e0 msgr2=0x7f45bc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.170+0000 7f45d9e00640 1 --2- 172.21.15.49:0/3352327813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45bc0051e0 0x7f45bc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:30.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.170+0000 7f45d9e00640 1 -- 172.21.15.49:0/3352327813 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc003530 con 0x7f45bc003b60 2024-01-31T12:09:30.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.170+0000 7f45da800640 1 --2- 172.21.15.49:0/3352327813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45bc0051e0 0x7f45bc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T12:09:30.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.170+0000 7f45da800640 1 -- 172.21.15.49:0/3352327813 reap_dead start 2024-01-31T12:09:30.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.170+0000 7f45d9e00640 1 --2- 172.21.15.49:0/3352327813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45bc003b60 0x7f45bc003f60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f45cc007fb0 tx=0x7f45cc01cb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f079cb15d624bf2a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:30.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.174+0000 7f45d8a00640 1 -- 172.21.15.49:0/3352327813 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc005ae0 con 0x7f45bc003b60 2024-01-31T12:09:30.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.174+0000 7f45d8a00640 1 -- 172.21.15.49:0/3352327813 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45cc005c60 con 0x7f45bc003b60 2024-01-31T12:09:30.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.174+0000 7f45d8a00640 1 -- 172.21.15.49:0/3352327813 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0a5a60 con 0x7f45bc003b60 2024-01-31T12:09:30.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.174+0000 7f45e1000640 1 -- 172.21.15.49:0/3352327813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45bc003b60 msgr2=0x7f45bc003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:30.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.174+0000 7f45e1000640 1 --2- 172.21.15.49:0/3352327813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45bc003b60 0x7f45bc003f60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f45cc007fb0 tx=0x7f45cc01cb20 comp rx=0 tx=0).stop 2024-01-31T12:09:30.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.174+0000 7f45e1000640 1 -- 172.21.15.49:0/3352327813 shutdown_connections 2024-01-31T12:09:30.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.174+0000 7f45e1000640 1 --2- 172.21.15.49:0/3352327813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45bc003b60 0x7f45bc003f60 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:30.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.174+0000 7f45e1000640 1 -- 172.21.15.49:0/3352327813 >> 172.21.15.49:0/3352327813 conn(0x7f45dc0d0e60 msgr2=0x7f45dc0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:30.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.174+0000 7f45e1000640 1 -- 172.21.15.49:0/3352327813 shutdown_connections 2024-01-31T12:09:30.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.174+0000 7f45e1000640 1 -- 172.21.15.49:0/3352327813 wait complete. 2024-01-31T12:09:30.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.178+0000 7f45e1000640 1 Processor -- start 2024-01-31T12:09:30.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.178+0000 7f45e1000640 1 -- start start 2024-01-31T12:09:30.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45e1000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45bc003b60 0x7f45dc09e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:30.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45e1000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45dc158f20 0x7f45dc0ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:30.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45e1000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45dc0ca790 0x7f45dc1f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:30.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45e1000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0c8720 con 0x7f45bc003b60 2024-01-31T12:09:30.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45e1000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0cac10 con 0x7f45dc0ca790 2024-01-31T12:09:30.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45e1000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc06c850 con 0x7f45dc158f20 2024-01-31T12:09:30.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45d9e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45bc003b60 0x7f45dc09e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:30.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45d9e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45bc003b60 0x7f45dc09e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60678/0 (socket says 172.21.15.49:60678) 2024-01-31T12:09:30.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45d9e00640 1 -- 172.21.15.49:0/3723791312 learned_addr learned my addr 172.21.15.49:0/3723791312 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:30.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45da800640 1 --2- 172.21.15.49:0/3723791312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45dc0ca790 0x7f45dc1f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:30.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45d9400640 1 --2- 172.21.15.49:0/3723791312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45dc158f20 0x7f45dc0ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:30.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45d9e00640 1 -- 172.21.15.49:0/3723791312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45dc158f20 msgr2=0x7f45dc0ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:30.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45d9e00640 1 --2- 172.21.15.49:0/3723791312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45dc158f20 0x7f45dc0ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:30.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45d9e00640 1 -- 172.21.15.49:0/3723791312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45dc0ca790 msgr2=0x7f45dc1f6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:30.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45d9e00640 1 --2- 172.21.15.49:0/3723791312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45dc0ca790 0x7f45dc1f6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:30.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45d9e00640 1 -- 172.21.15.49:0/3723791312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc1f2bf0 con 0x7f45bc003b60 2024-01-31T12:09:30.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45d9e00640 1 --2- 172.21.15.49:0/3723791312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45bc003b60 0x7f45dc09e620 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f45cc007fb0 tx=0x7f45bc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:30.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45d2000640 1 -- 172.21.15.49:0/3723791312 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0b4070 con 0x7f45bc003b60 2024-01-31T12:09:30.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45d2000640 1 -- 172.21.15.49:0/3723791312 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45cc0a5820 con 0x7f45bc003b60 2024-01-31T12:09:30.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45d2000640 1 -- 172.21.15.49:0/3723791312 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0a5bb0 con 0x7f45bc003b60 2024-01-31T12:09:30.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45e1000640 1 -- 172.21.15.49:0/3723791312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45dc09eb60 con 0x7f45bc003b60 2024-01-31T12:09:30.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.182+0000 7f45e1000640 1 -- 172.21.15.49:0/3723791312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45dc0c8060 con 0x7f45bc003b60 2024-01-31T12:09:30.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.186+0000 7f45e1000640 1 -- 172.21.15.49:0/3723791312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f45dc0c7630 con 0x7f45bc003b60 2024-01-31T12:09:30.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.186+0000 7f45d2000640 1 -- 172.21.15.49:0/3723791312 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f45cc0a5d10 con 0x7f45bc003b60 2024-01-31T12:09:30.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.190+0000 7f45d2000640 1 --2- 172.21.15.49:0/3723791312 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f45b4066500 0x7f45b40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:30.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.190+0000 7f45d2000640 1 -- 172.21.15.49:0/3723791312 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f45cc11dbe0 con 0x7f45bc003b60 2024-01-31T12:09:30.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.190+0000 7f45d9400640 1 --2- 172.21.15.49:0/3723791312 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f45b4066500 0x7f45b40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:30.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.190+0000 7f45d2000640 1 --2- 172.21.15.49:0/3723791312 >> [v2:172.21.15.49:6800/3804147802,v1:172.21.15.49:6801/3804147802] conn(0x7f45b406c800 0x7f45b406ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:30.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.190+0000 7f45d2000640 1 -- 172.21.15.49:0/3723791312 --> [v2:172.21.15.49:6800/3804147802,v1:172.21.15.49:6801/3804147802] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45b406f310 con 0x7f45b406c800 2024-01-31T12:09:30.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.190+0000 7f45d2000640 1 -- 172.21.15.49:0/3723791312 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45cc1222a0 con 0x7f45bc003b60 2024-01-31T12:09:30.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.190+0000 7f45da800640 1 --2- 172.21.15.49:0/3723791312 >> [v2:172.21.15.49:6800/3804147802,v1:172.21.15.49:6801/3804147802] conn(0x7f45b406c800 0x7f45b406ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:30.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.190+0000 7f45d9400640 1 --2- 172.21.15.49:0/3723791312 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f45b4066500 0x7f45b40689c0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f45dc0b6e40 tx=0x7f45c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:30.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.190+0000 7f45da800640 1 --2- 172.21.15.49:0/3723791312 >> [v2:172.21.15.49:6800/3804147802,v1:172.21.15.49:6801/3804147802] conn(0x7f45b406c800 0x7f45b406ec40 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:30.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.325+0000 7f45d2000640 1 -- 172.21.15.49:0/3723791312 <== osd.0 v2:172.21.15.49:6800/3804147802 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f45b406f310 con 0x7f45b406c800 2024-01-31T12:09:30.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.365+0000 7f45e1000640 1 -- 172.21.15.49:0/3723791312 --> [v2:172.21.15.49:6800/3804147802,v1:172.21.15.49:6801/3804147802] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f45dc0c7350 con 0x7f45b406c800 2024-01-31T12:09:30.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.389+0000 7f45d2000640 1 -- 172.21.15.49:0/3723791312 <== osd.0 v2:172.21.15.49:6800/3804147802 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f45d4003980 con 0x7f45b406c800 2024-01-31T12:09:30.390 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-31T12:09:30.390 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-31T12:09:30.390 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-31T12:09:30.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.389+0000 7f45e1000640 1 -- 172.21.15.49:0/3723791312 >> [v2:172.21.15.49:6800/3804147802,v1:172.21.15.49:6801/3804147802] conn(0x7f45b406c800 msgr2=0x7f45b406ec40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:30.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.389+0000 7f45e1000640 1 --2- 172.21.15.49:0/3723791312 >> [v2:172.21.15.49:6800/3804147802,v1:172.21.15.49:6801/3804147802] conn(0x7f45b406c800 0x7f45b406ec40 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:30.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.389+0000 7f45e1000640 1 -- 172.21.15.49:0/3723791312 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f45b4066500 msgr2=0x7f45b40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:30.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.389+0000 7f45e1000640 1 --2- 172.21.15.49:0/3723791312 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f45b4066500 0x7f45b40689c0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f45dc0b6e40 tx=0x7f45c4008040 comp rx=0 tx=0).stop 2024-01-31T12:09:30.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.389+0000 7f45e1000640 1 -- 172.21.15.49:0/3723791312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45bc003b60 msgr2=0x7f45dc09e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:30.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.389+0000 7f45e1000640 1 --2- 172.21.15.49:0/3723791312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45bc003b60 0x7f45dc09e620 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f45cc007fb0 tx=0x7f45bc005800 comp rx=0 tx=0).stop 2024-01-31T12:09:30.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.389+0000 7f45da800640 1 -- 172.21.15.49:0/3723791312 reap_dead start 2024-01-31T12:09:30.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.389+0000 7f45e1000640 1 -- 172.21.15.49:0/3723791312 shutdown_connections 2024-01-31T12:09:30.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.389+0000 7f45e1000640 1 -- 172.21.15.49:0/3723791312 >> 172.21.15.49:0/3723791312 conn(0x7f45dc0d0e60 msgr2=0x7f45dc15a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:30.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.389+0000 7f45e1000640 1 -- 172.21.15.49:0/3723791312 shutdown_connections 2024-01-31T12:09:30.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.393+0000 7f45e1000640 1 -- 172.21.15.49:0/3723791312 wait complete. 2024-01-31T12:09:30.443 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-31T12:09:30.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.849+0000 7f7c0d000640 1 Processor -- start 2024-01-31T12:09:30.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.853+0000 7f7c0d000640 1 -- start start 2024-01-31T12:09:30.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.853+0000 7f7c0d000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f7c080ae9a0 0x7f7c0815eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:30.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.853+0000 7f7c0d000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c080cbf70 0x7f7c080cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:30.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.853+0000 7f7c0d000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7c080cf400 0x7f7c080cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:30.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.853+0000 7f7c0d000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c080cfd90 con 0x7f7c080ae9a0 2024-01-31T12:09:30.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.853+0000 7f7c0d000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0815b4e0 con 0x7f7c080cf400 2024-01-31T12:09:30.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.853+0000 7f7c0d000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c08070f80 con 0x7f7c080cbf70 2024-01-31T12:09:30.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.857+0000 7f7bfd200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c080cbf70 0x7f7c080cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:30.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.857+0000 7f7bfd200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c080cbf70 0x7f7c080cc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:57464/0 (socket says 172.21.15.49:57464) 2024-01-31T12:09:30.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.857+0000 7f7bfd200640 1 -- 172.21.15.49:0/2539291671 learned_addr learned my addr 172.21.15.49:0/2539291671 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:30.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.857+0000 7f7c05e00640 1 --2- 172.21.15.49:0/2539291671 >> v2:172.21.15.49:3300/0 conn(0x7f7c080ae9a0 0x7f7c0815eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:30.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.857+0000 7f7c06800640 1 --2- 172.21.15.49:0/2539291671 >> v2:172.21.15.195:3300/0 conn(0x7f7c080cf400 0x7f7c080cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:30.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.857+0000 7f7bfd200640 1 -- 172.21.15.49:0/2539291671 >> v2:172.21.15.195:3300/0 conn(0x7f7c080cf400 msgr2=0x7f7c080cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:30.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.857+0000 7f7bfd200640 1 --2- 172.21.15.49:0/2539291671 >> v2:172.21.15.195:3300/0 conn(0x7f7c080cf400 0x7f7c080cf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:30.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.857+0000 7f7bfd200640 1 -- 172.21.15.49:0/2539291671 >> v2:172.21.15.49:3300/0 conn(0x7f7c080ae9a0 msgr2=0x7f7c0815eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:30.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.857+0000 7f7bfd200640 1 --2- 172.21.15.49:0/2539291671 >> v2:172.21.15.49:3300/0 conn(0x7f7c080ae9a0 0x7f7c0815eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:30.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.857+0000 7f7bfd200640 1 -- 172.21.15.49:0/2539291671 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c08071260 con 0x7f7c080cbf70 2024-01-31T12:09:30.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.857+0000 7f7c05e00640 1 --2- 172.21.15.49:0/2539291671 >> v2:172.21.15.49:3300/0 conn(0x7f7c080ae9a0 0x7f7c0815eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T12:09:30.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.857+0000 7f7c06800640 1 --2- 172.21.15.49:0/2539291671 >> v2:172.21.15.195:3300/0 conn(0x7f7c080cf400 0x7f7c080cf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T12:09:30.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.861+0000 7f7bfd200640 1 --2- 172.21.15.49:0/2539291671 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c080cbf70 0x7f7c080cc3b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7c0806dee0 tx=0x7f7bf001c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f6e735f1af9a730 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:30.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.861+0000 7f7c05400640 1 -- 172.21.15.49:0/2539291671 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf00ac410 con 0x7f7c080cbf70 2024-01-31T12:09:30.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.861+0000 7f7c05400640 1 -- 172.21.15.49:0/2539291671 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf00ac570 con 0x7f7c080cbf70 2024-01-31T12:09:30.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.861+0000 7f7c05400640 1 -- 172.21.15.49:0/2539291671 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf00ac900 con 0x7f7c080cbf70 2024-01-31T12:09:30.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.861+0000 7f7c0d000640 1 -- 172.21.15.49:0/2539291671 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c080cbf70 msgr2=0x7f7c080cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:30.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.861+0000 7f7c0d000640 1 --2- 172.21.15.49:0/2539291671 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c080cbf70 0x7f7c080cc3b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7c0806dee0 tx=0x7f7bf001c500 comp rx=0 tx=0).stop 2024-01-31T12:09:30.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.861+0000 7f7c0d000640 1 -- 172.21.15.49:0/2539291671 shutdown_connections 2024-01-31T12:09:30.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.861+0000 7f7c0d000640 1 --2- 172.21.15.49:0/2539291671 >> v2:172.21.15.195:3300/0 conn(0x7f7c080cf400 0x7f7c080cf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:30.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.861+0000 7f7c0d000640 1 --2- 172.21.15.49:0/2539291671 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c080cbf70 0x7f7c080cc3b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:30.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.861+0000 7f7c0d000640 1 --2- 172.21.15.49:0/2539291671 >> v2:172.21.15.49:3300/0 conn(0x7f7c080ae9a0 0x7f7c0815eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:30.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.861+0000 7f7c0d000640 1 -- 172.21.15.49:0/2539291671 >> 172.21.15.49:0/2539291671 conn(0x7f7c080668d0 msgr2=0x7f7c0806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:30.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.861+0000 7f7c0d000640 1 -- 172.21.15.49:0/2539291671 shutdown_connections 2024-01-31T12:09:30.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.861+0000 7f7c0d000640 1 -- 172.21.15.49:0/2539291671 wait complete. 2024-01-31T12:09:30.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.865+0000 7f7c0d000640 1 Processor -- start 2024-01-31T12:09:30.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.865+0000 7f7c0d000640 1 -- start start 2024-01-31T12:09:30.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.869+0000 7f7c0d000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c080ae9a0 0x7f7c080b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:30.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.869+0000 7f7c0d000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c080cbf70 0x7f7c08149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:30.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.869+0000 7f7c0d000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c080cf400 0x7f7c08154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:30.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.869+0000 7f7c0d000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c081495a0 con 0x7f7c080ae9a0 2024-01-31T12:09:30.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.869+0000 7f7c0d000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0814ea60 con 0x7f7c080cbf70 2024-01-31T12:09:30.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.869+0000 7f7c0d000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0814e780 con 0x7f7c080cf400 2024-01-31T12:09:30.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.869+0000 7f7bfd200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c080cbf70 0x7f7c08149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:30.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.869+0000 7f7c05e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c080ae9a0 0x7f7c080b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:30.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.869+0000 7f7bfd200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c080cbf70 0x7f7c08149060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:39000/0 (socket says 172.21.15.49:39000) 2024-01-31T12:09:30.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.869+0000 7f7bfd200640 1 -- 172.21.15.49:0/1935872271 learned_addr learned my addr 172.21.15.49:0/1935872271 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:30.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.869+0000 7f7c06800640 1 --2- 172.21.15.49:0/1935872271 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c080cf400 0x7f7c08154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:30.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.869+0000 7f7bfd200640 1 -- 172.21.15.49:0/1935872271 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c080cf400 msgr2=0x7f7c08154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:30.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.869+0000 7f7bfd200640 1 --2- 172.21.15.49:0/1935872271 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c080cf400 0x7f7c08154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:30.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.869+0000 7f7bfd200640 1 -- 172.21.15.49:0/1935872271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c080ae9a0 msgr2=0x7f7c080b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:30.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.869+0000 7f7bfd200640 1 --2- 172.21.15.49:0/1935872271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c080ae9a0 0x7f7c080b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:30.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.869+0000 7f7bfd200640 1 -- 172.21.15.49:0/1935872271 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf00094d0 con 0x7f7c080cbf70 2024-01-31T12:09:30.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.873+0000 7f7bfd200640 1 --2- 172.21.15.49:0/1935872271 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c080cbf70 0x7f7c08149060 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f7bf001abb0 tx=0x7f7bf00192a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:30.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.873+0000 7f7bfea00640 1 -- 172.21.15.49:0/1935872271 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf00ac410 con 0x7f7c080cbf70 2024-01-31T12:09:30.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.873+0000 7f7bfea00640 1 -- 172.21.15.49:0/1935872271 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf00b65f0 con 0x7f7c080cbf70 2024-01-31T12:09:30.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.873+0000 7f7bfea00640 1 -- 172.21.15.49:0/1935872271 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf00b69c0 con 0x7f7c080cbf70 2024-01-31T12:09:30.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.873+0000 7f7c0d000640 1 -- 172.21.15.49:0/1935872271 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c08159130 con 0x7f7c080cbf70 2024-01-31T12:09:30.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.873+0000 7f7c0d000640 1 -- 172.21.15.49:0/1935872271 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c081596f0 con 0x7f7c080cbf70 2024-01-31T12:09:30.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.877+0000 7f7c0d000640 1 -- 172.21.15.49:0/1935872271 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c080cf200 con 0x7f7c080cbf70 2024-01-31T12:09:30.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.877+0000 7f7bfea00640 1 -- 172.21.15.49:0/1935872271 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f7bf00b6b20 con 0x7f7c080cbf70 2024-01-31T12:09:30.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.877+0000 7f7bfea00640 1 --2- 172.21.15.49:0/1935872271 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7be0066500 0x7f7be00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:30.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.877+0000 7f7bfea00640 1 -- 172.21.15.49:0/1935872271 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7bf011e830 con 0x7f7c080cbf70 2024-01-31T12:09:30.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.877+0000 7f7c05e00640 1 --2- 172.21.15.49:0/1935872271 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7be0066500 0x7f7be00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:30.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.881+0000 7f7c05e00640 1 --2- 172.21.15.49:0/1935872271 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7be0066500 0x7f7be00689c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800d620 tx=0x7f7bf8007810 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:30.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:30.889+0000 7f7bfea00640 1 -- 172.21.15.49:0/1935872271 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f7bf00ebd10 con 0x7f7c080cbf70 2024-01-31T12:09:31.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.365+0000 7f7c0d000640 1 -- 172.21.15.49:0/1935872271 --> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c080b4600 con 0x7f7be0066500 2024-01-31T12:09:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.365+0000 7f7bfea00640 1 -- 172.21.15.49:0/1935872271 <== mgr.4100 v2:172.21.15.195:6832/3035808172 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7c080b4600 con 0x7f7be0066500 2024-01-31T12:09:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 0 to deep-scrub 2024-01-31T12:09:31.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.369+0000 7f7c0d000640 1 -- 172.21.15.49:0/1935872271 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7be0066500 msgr2=0x7f7be00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:31.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.369+0000 7f7c0d000640 1 --2- 172.21.15.49:0/1935872271 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7be0066500 0x7f7be00689c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800d620 tx=0x7f7bf8007810 comp rx=0 tx=0).stop 2024-01-31T12:09:31.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.369+0000 7f7c0d000640 1 -- 172.21.15.49:0/1935872271 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c080cbf70 msgr2=0x7f7c08149060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:31.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.369+0000 7f7c0d000640 1 --2- 172.21.15.49:0/1935872271 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c080cbf70 0x7f7c08149060 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f7bf001abb0 tx=0x7f7bf00192a0 comp rx=0 tx=0).stop 2024-01-31T12:09:31.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.369+0000 7f7c0d000640 1 -- 172.21.15.49:0/1935872271 shutdown_connections 2024-01-31T12:09:31.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.369+0000 7f7c0d000640 1 --2- 172.21.15.49:0/1935872271 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c080cf400 0x7f7c08154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:31.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.369+0000 7f7c0d000640 1 --2- 172.21.15.49:0/1935872271 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f7be0066500 0x7f7be00689c0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:31.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.369+0000 7f7c0d000640 1 --2- 172.21.15.49:0/1935872271 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c080cbf70 0x7f7c08149060 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:31.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.369+0000 7f7c0d000640 1 --2- 172.21.15.49:0/1935872271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c080ae9a0 0x7f7c080b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:31.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.369+0000 7f7c0d000640 1 -- 172.21.15.49:0/1935872271 >> 172.21.15.49:0/1935872271 conn(0x7f7c080668d0 msgr2=0x7f7c0806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:31.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.369+0000 7f7c0d000640 1 -- 172.21.15.49:0/1935872271 shutdown_connections 2024-01-31T12:09:31.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.369+0000 7f7c0d000640 1 -- 172.21.15.49:0/1935872271 wait complete. 2024-01-31T12:09:31.421 INFO:tasks.ceph:Scrubbing osd.1 2024-01-31T12:09:31.422 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-31T12:09:31.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.841+0000 7fc5e1400640 1 Processor -- start 2024-01-31T12:09:31.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.841+0000 7fc5e1400640 1 -- start start 2024-01-31T12:09:31.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.845+0000 7fc5e1400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc5dc15e7e0 0x7fc5dc0b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:31.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.845+0000 7fc5e1400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc5dc0c63d0 0x7fc5dc0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:31.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.845+0000 7fc5e1400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5dc0cf4a0 0x7fc5dc0c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:31.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.845+0000 7fc5e1400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5dc0d1d40 con 0x7fc5dc0c63d0 2024-01-31T12:09:31.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.845+0000 7fc5e1400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5dc0cf910 con 0x7fc5dc15e7e0 2024-01-31T12:09:31.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.845+0000 7fc5e1400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0c67f0 con 0x7fc5dc0cf4a0 2024-01-31T12:09:31.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.845+0000 7fc5d9e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc5dc0c63d0 0x7fc5dc0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:31.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.845+0000 7fc5db200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5dc0cf4a0 0x7fc5dc0c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:31.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.845+0000 7fc5da800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc5dc15e7e0 0x7fc5dc0b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:31.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.845+0000 7fc5db200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5dc0cf4a0 0x7fc5dc0c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:57480/0 (socket says 172.21.15.49:57480) 2024-01-31T12:09:31.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.845+0000 7fc5db200640 1 -- 172.21.15.49:0/2138966869 learned_addr learned my addr 172.21.15.49:0/2138966869 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:31.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.845+0000 7fc5d9e00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fc5dc0c63d0 0x7fc5dc0cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60696/0 (socket says 172.21.15.49:60696) 2024-01-31T12:09:31.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.845+0000 7fc5db200640 1 -- 172.21.15.49:0/2138966869 >> v2:172.21.15.195:3300/0 conn(0x7fc5dc15e7e0 msgr2=0x7fc5dc0b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:31.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.845+0000 7fc5db200640 1 --2- 172.21.15.49:0/2138966869 >> v2:172.21.15.195:3300/0 conn(0x7fc5dc15e7e0 0x7fc5dc0b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:31.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.845+0000 7fc5db200640 1 -- 172.21.15.49:0/2138966869 >> v2:172.21.15.49:3300/0 conn(0x7fc5dc0c63d0 msgr2=0x7fc5dc0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:31.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.845+0000 7fc5db200640 1 --2- 172.21.15.49:0/2138966869 >> v2:172.21.15.49:3300/0 conn(0x7fc5dc0c63d0 0x7fc5dc0cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:31.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.845+0000 7fc5db200640 1 -- 172.21.15.49:0/2138966869 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc0c6ab0 con 0x7fc5dc0cf4a0 2024-01-31T12:09:31.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.853+0000 7fc5db200640 1 --2- 172.21.15.49:0/2138966869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5dc0cf4a0 0x7fc5dc0c49b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc066fb0 tx=0x7fc5d401f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56d8d7e7112afd74 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:31.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.853+0000 7fc5d9400640 1 -- 172.21.15.49:0/2138966869 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40af400 con 0x7fc5dc0cf4a0 2024-01-31T12:09:31.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.853+0000 7fc5d9400640 1 -- 172.21.15.49:0/2138966869 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d40ab050 con 0x7fc5dc0cf4a0 2024-01-31T12:09:31.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.853+0000 7fc5d9400640 1 -- 172.21.15.49:0/2138966869 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40af780 con 0x7fc5dc0cf4a0 2024-01-31T12:09:31.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.857+0000 7fc5e1400640 1 -- 172.21.15.49:0/2138966869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5dc0cf4a0 msgr2=0x7fc5dc0c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:31.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.857+0000 7fc5e1400640 1 --2- 172.21.15.49:0/2138966869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5dc0cf4a0 0x7fc5dc0c49b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc066fb0 tx=0x7fc5d401f1c0 comp rx=0 tx=0).stop 2024-01-31T12:09:31.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.857+0000 7fc5e1400640 1 -- 172.21.15.49:0/2138966869 shutdown_connections 2024-01-31T12:09:31.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.857+0000 7fc5e1400640 1 --2- 172.21.15.49:0/2138966869 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5dc0cf4a0 0x7fc5dc0c49b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:31.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.857+0000 7fc5e1400640 1 --2- 172.21.15.49:0/2138966869 >> v2:172.21.15.49:3300/0 conn(0x7fc5dc0c63d0 0x7fc5dc0cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:31.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.857+0000 7fc5e1400640 1 --2- 172.21.15.49:0/2138966869 >> v2:172.21.15.195:3300/0 conn(0x7fc5dc15e7e0 0x7fc5dc0b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:31.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.857+0000 7fc5e1400640 1 -- 172.21.15.49:0/2138966869 >> 172.21.15.49:0/2138966869 conn(0x7fc5dc0d0e60 msgr2=0x7fc5dc0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:31.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.857+0000 7fc5e1400640 1 -- 172.21.15.49:0/2138966869 shutdown_connections 2024-01-31T12:09:31.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.857+0000 7fc5e1400640 1 -- 172.21.15.49:0/2138966869 wait complete. 2024-01-31T12:09:31.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.861+0000 7fc5e1400640 1 Processor -- start 2024-01-31T12:09:31.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.861+0000 7fc5e1400640 1 -- start start 2024-01-31T12:09:31.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.865+0000 7fc5e1400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5dc0c63d0 0x7fc5dc0b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:31.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.865+0000 7fc5e1400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5dc0cf4a0 0x7fc5dc0ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:31.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.865+0000 7fc5e1400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5dc15e7e0 0x7fc5dc0b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:31.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.865+0000 7fc5e1400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0b4b20 con 0x7fc5dc0c63d0 2024-01-31T12:09:31.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.865+0000 7fc5e1400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0b6770 con 0x7fc5dc15e7e0 2024-01-31T12:09:31.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.865+0000 7fc5e1400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0cad80 con 0x7fc5dc0cf4a0 2024-01-31T12:09:31.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.865+0000 7fc5d9e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5dc0cf4a0 0x7fc5dc0ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:31.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.865+0000 7fc5da800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5dc0c63d0 0x7fc5dc0b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:31.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.865+0000 7fc5db200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5dc15e7e0 0x7fc5dc0b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:31.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.865+0000 7fc5d9e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5dc0cf4a0 0x7fc5dc0ca840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:57484/0 (socket says 172.21.15.49:57484) 2024-01-31T12:09:31.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.865+0000 7fc5d9e00640 1 -- 172.21.15.49:0/1367457291 learned_addr learned my addr 172.21.15.49:0/1367457291 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:31.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.865+0000 7fc5d9e00640 1 -- 172.21.15.49:0/1367457291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5dc15e7e0 msgr2=0x7fc5dc0b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:31.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.865+0000 7fc5d9e00640 1 --2- 172.21.15.49:0/1367457291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5dc15e7e0 0x7fc5dc0b5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:31.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.865+0000 7fc5d9e00640 1 -- 172.21.15.49:0/1367457291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5dc0c63d0 msgr2=0x7fc5dc0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:31.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.865+0000 7fc5d9e00640 1 --2- 172.21.15.49:0/1367457291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5dc0c63d0 0x7fc5dc0b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:31.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.865+0000 7fc5d9e00640 1 -- 172.21.15.49:0/1367457291 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d4009b30 con 0x7fc5dc0cf4a0 2024-01-31T12:09:31.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.865+0000 7fc5da800640 1 --2- 172.21.15.49:0/1367457291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5dc0c63d0 0x7fc5dc0b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T12:09:31.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.865+0000 7fc5d9e00640 1 --2- 172.21.15.49:0/1367457291 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5dc0cf4a0 0x7fc5dc0ca840 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400e8a0 tx=0x7fc5c400eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:31.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.869+0000 7fc5d2a00640 1 -- 172.21.15.49:0/1367457291 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4009510 con 0x7fc5dc0cf4a0 2024-01-31T12:09:31.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.869+0000 7fc5d2a00640 1 -- 172.21.15.49:0/1367457291 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c400c940 con 0x7fc5dc0cf4a0 2024-01-31T12:09:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.869+0000 7fc5d2a00640 1 -- 172.21.15.49:0/1367457291 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c400ccb0 con 0x7fc5dc0cf4a0 2024-01-31T12:09:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.869+0000 7fc5e1400640 1 -- 172.21.15.49:0/1367457291 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5dc0c9a80 con 0x7fc5dc0cf4a0 2024-01-31T12:09:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.869+0000 7fc5e1400640 1 -- 172.21.15.49:0/1367457291 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5dc0ca040 con 0x7fc5dc0cf4a0 2024-01-31T12:09:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.869+0000 7fc5e1400640 1 -- 172.21.15.49:0/1367457291 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc5dc0c7350 con 0x7fc5dc0cf4a0 2024-01-31T12:09:31.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.873+0000 7fc5d2a00640 1 -- 172.21.15.49:0/1367457291 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fc5c4013470 con 0x7fc5dc0cf4a0 2024-01-31T12:09:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.873+0000 7fc5d2a00640 1 --2- 172.21.15.49:0/1367457291 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc5b4066500 0x7fc5b40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.873+0000 7fc5d2a00640 1 -- 172.21.15.49:0/1367457291 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc5c4083dc0 con 0x7fc5dc0cf4a0 2024-01-31T12:09:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.873+0000 7fc5da800640 1 --2- 172.21.15.49:0/1367457291 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc5b4066500 0x7fc5b40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.877+0000 7fc5d2a00640 1 --2- 172.21.15.49:0/1367457291 >> [v2:172.21.15.49:6824/659898319,v1:172.21.15.49:6825/659898319] conn(0x7fc5b406c800 0x7fc5b406ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.877+0000 7fc5d2a00640 1 -- 172.21.15.49:0/1367457291 --> [v2:172.21.15.49:6824/659898319,v1:172.21.15.49:6825/659898319] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc5b406f310 con 0x7fc5b406c800 2024-01-31T12:09:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.877+0000 7fc5d2a00640 1 -- 172.21.15.49:0/1367457291 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5c40863a0 con 0x7fc5dc0cf4a0 2024-01-31T12:09:31.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.877+0000 7fc5db200640 1 --2- 172.21.15.49:0/1367457291 >> [v2:172.21.15.49:6824/659898319,v1:172.21.15.49:6825/659898319] conn(0x7fc5b406c800 0x7fc5b406ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:31.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.877+0000 7fc5da800640 1 --2- 172.21.15.49:0/1367457291 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc5b4066500 0x7fc5b40689c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc1f65e0 tx=0x7fc5cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:31.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.877+0000 7fc5db200640 1 --2- 172.21.15.49:0/1367457291 >> [v2:172.21.15.49:6824/659898319,v1:172.21.15.49:6825/659898319] conn(0x7fc5b406c800 0x7fc5b406ec40 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:31.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:31.985+0000 7fc5d2a00640 1 -- 172.21.15.49:0/1367457291 <== osd.1 v2:172.21.15.49:6824/659898319 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc5b406f310 con 0x7fc5b406c800 2024-01-31T12:09:32.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.001+0000 7fc5e1400640 1 -- 172.21.15.49:0/1367457291 --> [v2:172.21.15.49:6824/659898319,v1:172.21.15.49:6825/659898319] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc5dc0c7070 con 0x7fc5b406c800 2024-01-31T12:09:32.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.005+0000 7fc5d2a00640 1 -- 172.21.15.49:0/1367457291 <== osd.1 v2:172.21.15.49:6824/659898319 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc5d40091f0 con 0x7fc5b406c800 2024-01-31T12:09:32.005 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-31T12:09:32.005 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-31T12:09:32.005 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-31T12:09:32.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.005+0000 7fc5e1400640 1 -- 172.21.15.49:0/1367457291 >> [v2:172.21.15.49:6824/659898319,v1:172.21.15.49:6825/659898319] conn(0x7fc5b406c800 msgr2=0x7fc5b406ec40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:32.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.005+0000 7fc5e1400640 1 --2- 172.21.15.49:0/1367457291 >> [v2:172.21.15.49:6824/659898319,v1:172.21.15.49:6825/659898319] conn(0x7fc5b406c800 0x7fc5b406ec40 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:32.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.005+0000 7fc5e1400640 1 -- 172.21.15.49:0/1367457291 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc5b4066500 msgr2=0x7fc5b40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:32.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.005+0000 7fc5e1400640 1 --2- 172.21.15.49:0/1367457291 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc5b4066500 0x7fc5b40689c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc1f65e0 tx=0x7fc5cc008040 comp rx=0 tx=0).stop 2024-01-31T12:09:32.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.005+0000 7fc5e1400640 1 -- 172.21.15.49:0/1367457291 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5dc0cf4a0 msgr2=0x7fc5dc0ca840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:32.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.005+0000 7fc5e1400640 1 --2- 172.21.15.49:0/1367457291 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5dc0cf4a0 0x7fc5dc0ca840 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400e8a0 tx=0x7fc5c400eca0 comp rx=0 tx=0).stop 2024-01-31T12:09:32.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.005+0000 7fc5db200640 1 -- 172.21.15.49:0/1367457291 reap_dead start 2024-01-31T12:09:32.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.005+0000 7fc5e1400640 1 -- 172.21.15.49:0/1367457291 shutdown_connections 2024-01-31T12:09:32.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.005+0000 7fc5e1400640 1 -- 172.21.15.49:0/1367457291 >> 172.21.15.49:0/1367457291 conn(0x7fc5dc0d0e60 msgr2=0x7fc5dc0b1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:32.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.005+0000 7fc5e1400640 1 -- 172.21.15.49:0/1367457291 shutdown_connections 2024-01-31T12:09:32.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.005+0000 7fc5e1400640 1 -- 172.21.15.49:0/1367457291 wait complete. 2024-01-31T12:09:32.039 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-31T12:09:32.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.449+0000 7fe92be00640 1 Processor -- start 2024-01-31T12:09:32.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.453+0000 7fe92be00640 1 -- start start 2024-01-31T12:09:32.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.453+0000 7fe92be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe92c0b3eb0 0x7fe92c0cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:32.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.453+0000 7fe92be00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92c0b2a10 con 0x7fe92c0d0e90 2024-01-31T12:09:32.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe92be00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92c0d04d0 con 0x7fe92c160930 2024-01-31T12:09:32.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe92be00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c0d38a0 con 0x7fe92c0b3eb0 2024-01-31T12:09:32.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe92aa00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fe92c160930 0x7fe92c0cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:48746/0 (socket says 172.21.15.49:48746) 2024-01-31T12:09:32.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe92aa00640 1 -- 172.21.15.49:0/23166689 learned_addr learned my addr 172.21.15.49:0/23166689 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:09:32.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe92a000640 1 --2- 172.21.15.49:0/23166689 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe92c0b3eb0 0x7fe92c0cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:32.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe929600640 1 -- 172.21.15.49:0/23166689 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726770009 0 0) 0x7fe92c0d04d0 con 0x7fe92c160930 2024-01-31T12:09:32.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe929600640 1 -- 172.21.15.49:0/23166689 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe90c003530 con 0x7fe92c160930 2024-01-31T12:09:32.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe929600640 1 -- 172.21.15.49:0/23166689 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484421576 0 0) 0x7fe92c0b2a10 con 0x7fe92c0d0e90 2024-01-31T12:09:32.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe929600640 1 -- 172.21.15.49:0/23166689 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe92c0d04d0 con 0x7fe92c0d0e90 2024-01-31T12:09:32.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe929600640 1 -- 172.21.15.49:0/23166689 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 946687066 0 0) 0x7fe90c003530 con 0x7fe92c160930 2024-01-31T12:09:32.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe929600640 1 -- 172.21.15.49:0/23166689 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe92c0b3eb0 msgr2=0x7fe92c0cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:32.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe929600640 1 --2- 172.21.15.49:0/23166689 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe92c0b3eb0 0x7fe92c0cfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:32.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe929600640 1 -- 172.21.15.49:0/23166689 >> v1:172.21.15.49:6789/0 conn(0x7fe92c0d0e90 legacy=0x7fe92c0cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:32.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe929600640 1 -- 172.21.15.49:0/23166689 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c0d3ab0 con 0x7fe92c160930 2024-01-31T12:09:32.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe929600640 1 -- 172.21.15.49:0/23166689 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7fe91c001680 con 0x7fe92c160930 2024-01-31T12:09:32.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe92a000640 1 --2- 172.21.15.49:0/23166689 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe92c0b3eb0 0x7fe92c0cfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T12:09:32.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe929600640 1 -- 172.21.15.49:0/23166689 >> v1:172.21.15.195:6789/0 conn(0x7fe92c160930 legacy=0x7fe92c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:32.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe929600640 1 --2- 172.21.15.49:0/23166689 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe92c0b3eb0 0x7fe90c003b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:32.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe929600640 1 --2- 172.21.15.49:0/23166689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90c0040a0 0x7fe90c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:32.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe929600640 1 --2- 172.21.15.49:0/23166689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe90c004d10 0x7fe90c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:32.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe929600640 1 -- 172.21.15.49:0/23166689 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c0d38a0 con 0x7fe90c0040a0 2024-01-31T12:09:32.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe929600640 1 -- 172.21.15.49:0/23166689 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c00ba70 con 0x7fe90c004d10 2024-01-31T12:09:32.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe929600640 1 -- 172.21.15.49:0/23166689 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c00bc30 con 0x7fe92c0b3eb0 2024-01-31T12:09:32.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe92aa00640 1 --2- 172.21.15.49:0/23166689 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe92c0b3eb0 0x7fe90c003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:32.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe92b400640 1 --2- 172.21.15.49:0/23166689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe90c004d10 0x7fe90c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:32.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe92a000640 1 --2- 172.21.15.49:0/23166689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90c0040a0 0x7fe90c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:32.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe92b400640 1 -- 172.21.15.49:0/23166689 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe92c0b3eb0 msgr2=0x7fe90c003b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:32.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe92b400640 1 --2- 172.21.15.49:0/23166689 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe92c0b3eb0 0x7fe90c003b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:32.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe92b400640 1 -- 172.21.15.49:0/23166689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90c0040a0 msgr2=0x7fe90c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:32.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe92b400640 1 --2- 172.21.15.49:0/23166689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90c0040a0 0x7fe90c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:32.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe92b400640 1 -- 172.21.15.49:0/23166689 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe914009420 con 0x7fe90c004d10 2024-01-31T12:09:32.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.457+0000 7fe92a000640 1 --2- 172.21.15.49:0/23166689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90c0040a0 0x7fe90c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T12:09:32.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.461+0000 7fe92b400640 1 --2- 172.21.15.49:0/23166689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe90c004d10 0x7fe90c005190 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fe924001fd0 tx=0x7fe92401f050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbb9ccf1779833c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:32.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.461+0000 7fe929600640 1 -- 172.21.15.49:0/23166689 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9240a8c70 con 0x7fe90c004d10 2024-01-31T12:09:32.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.461+0000 7fe929600640 1 -- 172.21.15.49:0/23166689 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9240a8df0 con 0x7fe90c004d10 2024-01-31T12:09:32.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.461+0000 7fe929600640 1 -- 172.21.15.49:0/23166689 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe924003bc0 con 0x7fe90c004d10 2024-01-31T12:09:32.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.465+0000 7fe92be00640 1 -- 172.21.15.49:0/23166689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe90c004d10 msgr2=0x7fe90c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:32.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.465+0000 7fe92be00640 1 --2- 172.21.15.49:0/23166689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe90c004d10 0x7fe90c005190 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fe924001fd0 tx=0x7fe92401f050 comp rx=0 tx=0).stop 2024-01-31T12:09:32.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.465+0000 7fe92b400640 1 -- 172.21.15.49:0/23166689 reap_dead start 2024-01-31T12:09:32.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.465+0000 7fe92be00640 1 -- 172.21.15.49:0/23166689 shutdown_connections 2024-01-31T12:09:32.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.465+0000 7fe92be00640 1 -- 172.21.15.49:0/23166689 >> 172.21.15.49:0/23166689 conn(0x7fe92c09c3c0 msgr2=0x7fe92c0d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:32.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.465+0000 7fe92be00640 1 -- 172.21.15.49:0/23166689 shutdown_connections 2024-01-31T12:09:32.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.465+0000 7fe92be00640 1 -- 172.21.15.49:0/23166689 wait complete. 2024-01-31T12:09:32.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.469+0000 7fe92be00640 1 Processor -- start 2024-01-31T12:09:32.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.469+0000 7fe92be00640 1 -- start start 2024-01-31T12:09:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe92be00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90c004d10 0x7fe92c1f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe92be00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe92c0b77f0 0x7fe92c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe92be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe92c0b55c0 0x7fe92c06c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe92be00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c0b7c80 con 0x7fe90c004d10 2024-01-31T12:09:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe92be00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c0b7f60 con 0x7fe92c0b77f0 2024-01-31T12:09:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe92be00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c0b8240 con 0x7fe92c0b55c0 2024-01-31T12:09:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe92a000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe92c0b77f0 0x7fe92c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:32.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe92a000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe92c0b77f0 0x7fe92c0b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:39028/0 (socket says 172.21.15.49:39028) 2024-01-31T12:09:32.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe92a000640 1 -- 172.21.15.49:0/717991260 learned_addr learned my addr 172.21.15.49:0/717991260 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:32.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe92aa00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90c004d10 0x7fe92c1f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:32.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe92b400640 1 --2- 172.21.15.49:0/717991260 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe92c0b55c0 0x7fe92c06c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:32.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe92a000640 1 -- 172.21.15.49:0/717991260 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe92c0b55c0 msgr2=0x7fe92c06c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:32.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe92a000640 1 --2- 172.21.15.49:0/717991260 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe92c0b55c0 0x7fe92c06c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:32.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe92a000640 1 -- 172.21.15.49:0/717991260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90c004d10 msgr2=0x7fe92c1f21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:32.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe92a000640 1 --2- 172.21.15.49:0/717991260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90c004d10 0x7fe92c1f21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:32.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe92a000640 1 -- 172.21.15.49:0/717991260 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c0b8520 con 0x7fe92c0b77f0 2024-01-31T12:09:32.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe92aa00640 1 --2- 172.21.15.49:0/717991260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90c004d10 0x7fe92c1f21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T12:09:32.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe92a000640 1 --2- 172.21.15.49:0/717991260 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe92c0b77f0 0x7fe92c0b5080 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fe9140118d0 tx=0x7fe914011d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:32.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe922a00640 1 -- 172.21.15.49:0/717991260 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91400fbd0 con 0x7fe92c0b77f0 2024-01-31T12:09:32.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe922a00640 1 -- 172.21.15.49:0/717991260 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91400fd30 con 0x7fe92c0b77f0 2024-01-31T12:09:32.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe922a00640 1 -- 172.21.15.49:0/717991260 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe914015660 con 0x7fe92c0b77f0 2024-01-31T12:09:32.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.473+0000 7fe92be00640 1 -- 172.21.15.49:0/717991260 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92c1f2720 con 0x7fe92c0b77f0 2024-01-31T12:09:32.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.477+0000 7fe92be00640 1 -- 172.21.15.49:0/717991260 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92c06cd10 con 0x7fe92c0b77f0 2024-01-31T12:09:32.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.477+0000 7fe92be00640 1 -- 172.21.15.49:0/717991260 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92c150080 con 0x7fe92c0b77f0 2024-01-31T12:09:32.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.481+0000 7fe922a00640 1 -- 172.21.15.49:0/717991260 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fe9140157c0 con 0x7fe92c0b77f0 2024-01-31T12:09:32.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.481+0000 7fe922a00640 1 --2- 172.21.15.49:0/717991260 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe904066500 0x7fe9040689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:32.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.481+0000 7fe922a00640 1 -- 172.21.15.49:0/717991260 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe914084760 con 0x7fe92c0b77f0 2024-01-31T12:09:32.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.481+0000 7fe92aa00640 1 --2- 172.21.15.49:0/717991260 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe904066500 0x7fe9040689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:32.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.485+0000 7fe92aa00640 1 --2- 172.21.15.49:0/717991260 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe904066500 0x7fe9040689c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe91c001ec0 tx=0x7fe91c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:32.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:32.485+0000 7fe922a00640 1 -- 172.21.15.49:0/717991260 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fe914051bb0 con 0x7fe92c0b77f0 2024-01-31T12:09:33.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.029+0000 7fe92be00640 1 -- 172.21.15.49:0/717991260 --> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe92c0cfdd0 con 0x7fe904066500 2024-01-31T12:09:33.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.029+0000 7fe922a00640 1 -- 172.21.15.49:0/717991260 <== mgr.4100 v2:172.21.15.195:6832/3035808172 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe91c001600 con 0x7fe904066500 2024-01-31T12:09:33.031 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 1 to deep-scrub 2024-01-31T12:09:33.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.033+0000 7fe92be00640 1 -- 172.21.15.49:0/717991260 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe904066500 msgr2=0x7fe9040689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:33.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.033+0000 7fe92be00640 1 --2- 172.21.15.49:0/717991260 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe904066500 0x7fe9040689c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe91c001ec0 tx=0x7fe91c009040 comp rx=0 tx=0).stop 2024-01-31T12:09:33.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.033+0000 7fe92be00640 1 -- 172.21.15.49:0/717991260 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe92c0b77f0 msgr2=0x7fe92c0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:33.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.033+0000 7fe92be00640 1 --2- 172.21.15.49:0/717991260 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe92c0b77f0 0x7fe92c0b5080 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fe9140118d0 tx=0x7fe914011d90 comp rx=0 tx=0).stop 2024-01-31T12:09:33.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.033+0000 7fe92be00640 1 -- 172.21.15.49:0/717991260 shutdown_connections 2024-01-31T12:09:33.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.033+0000 7fe92be00640 1 --2- 172.21.15.49:0/717991260 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe92c0b55c0 0x7fe92c06c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:33.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.033+0000 7fe92be00640 1 --2- 172.21.15.49:0/717991260 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fe904066500 0x7fe9040689c0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:33.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.033+0000 7fe92be00640 1 --2- 172.21.15.49:0/717991260 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe92c0b77f0 0x7fe92c0b5080 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:33.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.033+0000 7fe92be00640 1 --2- 172.21.15.49:0/717991260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe90c004d10 0x7fe92c1f21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:33.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.033+0000 7fe92be00640 1 -- 172.21.15.49:0/717991260 >> 172.21.15.49:0/717991260 conn(0x7fe92c09c3c0 msgr2=0x7fe92c06b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:33.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.033+0000 7fe92be00640 1 -- 172.21.15.49:0/717991260 shutdown_connections 2024-01-31T12:09:33.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.033+0000 7fe92be00640 1 -- 172.21.15.49:0/717991260 wait complete. 2024-01-31T12:09:33.081 INFO:tasks.ceph:Scrubbing osd.2 2024-01-31T12:09:33.081 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-31T12:09:33.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.465+0000 7f66af200640 1 Processor -- start 2024-01-31T12:09:33.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.465+0000 7f66af200640 1 -- start start 2024-01-31T12:09:33.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.469+0000 7f66af200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f66a8161700 0x7f66a806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:33.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.469+0000 7f66af200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f66a806d000 0x7f66a806e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:33.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.469+0000 7f66af200640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a80d19e0 con 0x7f66a806eb90 2024-01-31T12:09:33.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.469+0000 7f66af200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a80d1cc0 con 0x7f66a8161700 2024-01-31T12:09:33.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.469+0000 7f66af200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a80b0310 con 0x7f66a806d000 2024-01-31T12:09:33.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.469+0000 7f66ad400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f66a806d000 0x7f66a806e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:33.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.469+0000 7f66ade00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f66a8161700 0x7f66a806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:33.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.469+0000 7f66ad400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f66a806d000 0x7f66a806e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:39032/0 (socket says 172.21.15.49:39032) 2024-01-31T12:09:33.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.469+0000 7f66ad400640 1 -- 172.21.15.49:0/468972038 learned_addr learned my addr 172.21.15.49:0/468972038 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.473+0000 7f66ad400640 1 -- 172.21.15.49:0/468972038 >> v2:172.21.15.49:3300/0 conn(0x7f66a8161700 msgr2=0x7f66a806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.473+0000 7f66ad400640 1 --2- 172.21.15.49:0/468972038 >> v2:172.21.15.49:3300/0 conn(0x7f66a8161700 0x7f66a806d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.473+0000 7f66ad400640 1 -- 172.21.15.49:0/468972038 >> v1:172.21.15.49:6789/0 conn(0x7f66a806eb90 legacy=0x7f66a80c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.473+0000 7f66ad400640 1 -- 172.21.15.49:0/468972038 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a80b05f0 con 0x7f66a806d000 2024-01-31T12:09:33.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.481+0000 7f66ad400640 1 --2- 172.21.15.49:0/468972038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66a806d000 0x7f66a806e650 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f66a8071e40 tx=0x7f669001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e105ea01927821e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:33.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.481+0000 7f66aca00640 1 -- 172.21.15.49:0/468972038 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66900aa430 con 0x7f66a806d000 2024-01-31T12:09:33.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.481+0000 7f66aca00640 1 -- 172.21.15.49:0/468972038 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66900aa590 con 0x7f66a806d000 2024-01-31T12:09:33.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.481+0000 7f66aca00640 1 -- 172.21.15.49:0/468972038 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66900aa920 con 0x7f66a806d000 2024-01-31T12:09:33.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.481+0000 7f66af200640 1 -- 172.21.15.49:0/468972038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66a806d000 msgr2=0x7f66a806e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:33.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.481+0000 7f66af200640 1 --2- 172.21.15.49:0/468972038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66a806d000 0x7f66a806e650 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f66a8071e40 tx=0x7f669001c4d0 comp rx=0 tx=0).stop 2024-01-31T12:09:33.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.481+0000 7f66af200640 1 -- 172.21.15.49:0/468972038 shutdown_connections 2024-01-31T12:09:33.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.481+0000 7f66af200640 1 --2- 172.21.15.49:0/468972038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66a806d000 0x7f66a806e650 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:33.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.481+0000 7f66af200640 1 --2- 172.21.15.49:0/468972038 >> v2:172.21.15.49:3300/0 conn(0x7f66a8161700 0x7f66a806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:33.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.481+0000 7f66af200640 1 -- 172.21.15.49:0/468972038 >> 172.21.15.49:0/468972038 conn(0x7f66a80d0ec0 msgr2=0x7f66a80d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:33.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.481+0000 7f66af200640 1 -- 172.21.15.49:0/468972038 shutdown_connections 2024-01-31T12:09:33.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.485+0000 7f66af200640 1 -- 172.21.15.49:0/468972038 wait complete. 2024-01-31T12:09:33.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.489+0000 7f66af200640 1 Processor -- start 2024-01-31T12:09:33.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.489+0000 7f66af200640 1 -- start start 2024-01-31T12:09:33.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.493+0000 7f66af200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66a806d000 0x7f66a80c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:33.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.493+0000 7f66af200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66a806eb90 0x7f66a81524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:33.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.493+0000 7f66af200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f66a8161700 0x7f66a81516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:33.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.493+0000 7f66af200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80c7640 con 0x7f66a806d000 2024-01-31T12:09:33.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.493+0000 7f66af200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80c65a0 con 0x7f66a806eb90 2024-01-31T12:09:33.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.493+0000 7f66af200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80c6880 con 0x7f66a8161700 2024-01-31T12:09:33.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.493+0000 7f66ade00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66a806d000 0x7f66a80c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:33.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.493+0000 7f66ad400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66a806eb90 0x7f66a81524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:33.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.493+0000 7f66ad400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66a806eb90 0x7f66a81524c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:39048/0 (socket says 172.21.15.49:39048) 2024-01-31T12:09:33.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.493+0000 7f66ad400640 1 -- 172.21.15.49:0/729756681 learned_addr learned my addr 172.21.15.49:0/729756681 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:33.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.493+0000 7f66ae800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f66a8161700 0x7f66a81516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:33.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.493+0000 7f66ad400640 1 -- 172.21.15.49:0/729756681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f66a8161700 msgr2=0x7f66a81516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:33.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.493+0000 7f66ad400640 1 --2- 172.21.15.49:0/729756681 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f66a8161700 0x7f66a81516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:33.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.493+0000 7f66ad400640 1 -- 172.21.15.49:0/729756681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66a806d000 msgr2=0x7f66a80c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:33.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.493+0000 7f66ad400640 1 --2- 172.21.15.49:0/729756681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66a806d000 0x7f66a80c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:33.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.493+0000 7f66ad400640 1 -- 172.21.15.49:0/729756681 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66900094d0 con 0x7f66a806eb90 2024-01-31T12:09:33.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.493+0000 7f66ade00640 1 --2- 172.21.15.49:0/729756681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66a806d000 0x7f66a80c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T12:09:33.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.493+0000 7f66ad400640 1 --2- 172.21.15.49:0/729756681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66a806eb90 0x7f66a81524c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f66900190e0 tx=0x7f669001ad10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:33.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.497+0000 7f66a6000640 1 -- 172.21.15.49:0/729756681 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66900aa430 con 0x7f66a806eb90 2024-01-31T12:09:33.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.497+0000 7f66a6000640 1 -- 172.21.15.49:0/729756681 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66900b3820 con 0x7f66a806eb90 2024-01-31T12:09:33.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.497+0000 7f66af200640 1 -- 172.21.15.49:0/729756681 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a80c6b60 con 0x7f66a806eb90 2024-01-31T12:09:33.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.497+0000 7f66a6000640 1 -- 172.21.15.49:0/729756681 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66900b3bd0 con 0x7f66a806eb90 2024-01-31T12:09:33.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.497+0000 7f66af200640 1 -- 172.21.15.49:0/729756681 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a80c7120 con 0x7f66a806eb90 2024-01-31T12:09:33.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.497+0000 7f66af200640 1 -- 172.21.15.49:0/729756681 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f66a80c45a0 con 0x7f66a806eb90 2024-01-31T12:09:33.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.501+0000 7f66a6000640 1 -- 172.21.15.49:0/729756681 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f66900b3d30 con 0x7f66a806eb90 2024-01-31T12:09:33.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.501+0000 7f66a6000640 1 --2- 172.21.15.49:0/729756681 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6680066500 0x7f66800689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:33.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.501+0000 7f66a6000640 1 -- 172.21.15.49:0/729756681 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f669011e150 con 0x7f66a806eb90 2024-01-31T12:09:33.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.501+0000 7f66ade00640 1 --2- 172.21.15.49:0/729756681 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6680066500 0x7f66800689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:33.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.501+0000 7f66a6000640 1 --2- 172.21.15.49:0/729756681 >> [v2:172.21.15.49:6816/1521900239,v1:172.21.15.49:6817/1521900239] conn(0x7f668006c800 0x7f668006ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:33.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.505+0000 7f66a6000640 1 -- 172.21.15.49:0/729756681 --> [v2:172.21.15.49:6816/1521900239,v1:172.21.15.49:6817/1521900239] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f668006f310 con 0x7f668006c800 2024-01-31T12:09:33.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.505+0000 7f66a6000640 1 -- 172.21.15.49:0/729756681 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6690120730 con 0x7f66a806eb90 2024-01-31T12:09:33.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.505+0000 7f66ade00640 1 --2- 172.21.15.49:0/729756681 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6680066500 0x7f66800689c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f6698009b10 tx=0x7f6698008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:33.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.505+0000 7f66ae800640 1 --2- 172.21.15.49:0/729756681 >> [v2:172.21.15.49:6816/1521900239,v1:172.21.15.49:6817/1521900239] conn(0x7f668006c800 0x7f668006ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:33.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:33.505+0000 7f66ae800640 1 --2- 172.21.15.49:0/729756681 >> [v2:172.21.15.49:6816/1521900239,v1:172.21.15.49:6817/1521900239] conn(0x7f668006c800 0x7f668006ec40 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:35.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.377+0000 7f66a6000640 1 -- 172.21.15.49:0/729756681 <== osd.2 v2:172.21.15.49:6816/1521900239 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f668006f310 con 0x7f668006c800 2024-01-31T12:09:35.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.417+0000 7f66af200640 1 -- 172.21.15.49:0/729756681 --> [v2:172.21.15.49:6816/1521900239,v1:172.21.15.49:6817/1521900239] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f66a80c7310 con 0x7f668006c800 2024-01-31T12:09:35.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.457+0000 7f66a6000640 1 -- 172.21.15.49:0/729756681 <== osd.2 v2:172.21.15.49:6816/1521900239 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f66a80c7310 con 0x7f668006c800 2024-01-31T12:09:35.459 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-31T12:09:35.459 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-31T12:09:35.459 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-31T12:09:35.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.457+0000 7f66af200640 1 -- 172.21.15.49:0/729756681 >> [v2:172.21.15.49:6816/1521900239,v1:172.21.15.49:6817/1521900239] conn(0x7f668006c800 msgr2=0x7f668006ec40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.461+0000 7f66af200640 1 --2- 172.21.15.49:0/729756681 >> [v2:172.21.15.49:6816/1521900239,v1:172.21.15.49:6817/1521900239] conn(0x7f668006c800 0x7f668006ec40 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.461+0000 7f66af200640 1 -- 172.21.15.49:0/729756681 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6680066500 msgr2=0x7f66800689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.461+0000 7f66af200640 1 --2- 172.21.15.49:0/729756681 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f6680066500 0x7f66800689c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f6698009b10 tx=0x7f6698008040 comp rx=0 tx=0).stop 2024-01-31T12:09:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.461+0000 7f66af200640 1 -- 172.21.15.49:0/729756681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66a806eb90 msgr2=0x7f66a81524c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.461+0000 7f66af200640 1 --2- 172.21.15.49:0/729756681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66a806eb90 0x7f66a81524c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f66900190e0 tx=0x7f669001ad10 comp rx=0 tx=0).stop 2024-01-31T12:09:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.461+0000 7f66ae800640 1 -- 172.21.15.49:0/729756681 reap_dead start 2024-01-31T12:09:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.461+0000 7f66af200640 1 -- 172.21.15.49:0/729756681 shutdown_connections 2024-01-31T12:09:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.461+0000 7f66af200640 1 -- 172.21.15.49:0/729756681 >> 172.21.15.49:0/729756681 conn(0x7f66a80d0ec0 msgr2=0x7f66a80d12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.461+0000 7f66af200640 1 -- 172.21.15.49:0/729756681 shutdown_connections 2024-01-31T12:09:35.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.461+0000 7f66af200640 1 -- 172.21.15.49:0/729756681 wait complete. 2024-01-31T12:09:35.507 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-31T12:09:35.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.917+0000 7ff356000640 1 Processor -- start 2024-01-31T12:09:35.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.917+0000 7ff356000640 1 -- start start 2024-01-31T12:09:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.921+0000 7ff356000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff35015ae90 0x7ff350072000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.921+0000 7ff356000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff35015de30 0x7ff35006ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.921+0000 7ff356000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3500cb140 con 0x7ff35006a770 2024-01-31T12:09:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.921+0000 7ff356000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3500af490 con 0x7ff35015ae90 2024-01-31T12:09:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.921+0000 7ff356000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35006b140 con 0x7ff35015de30 2024-01-31T12:09:35.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.921+0000 7ff34ea00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7ff35006a770 0x7ff35015d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:48748/0 (socket says 172.21.15.49:48748) 2024-01-31T12:09:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.921+0000 7ff34ea00640 1 -- 172.21.15.49:0/1277468442 learned_addr learned my addr 172.21.15.49:0/1277468442 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:09:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.921+0000 7ff34f400640 1 --2- 172.21.15.49:0/1277468442 >> v2:172.21.15.195:3300/0 conn(0x7ff35015ae90 0x7ff350072000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.921+0000 7ff34fe00640 1 --2- 172.21.15.49:0/1277468442 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff35015de30 0x7ff35006ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.921+0000 7ff34e000640 1 -- 172.21.15.49:0/1277468442 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284678986 0 0) 0x7ff340001120 con 0x7ff35006a770 2024-01-31T12:09:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.921+0000 7ff34e000640 1 -- 172.21.15.49:0/1277468442 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff330003530 con 0x7ff35006a770 2024-01-31T12:09:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.921+0000 7ff34f400640 1 -- 172.21.15.49:0/1277468442 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff35015de30 msgr2=0x7ff35006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.921+0000 7ff34f400640 1 --2- 172.21.15.49:0/1277468442 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff35015de30 0x7ff35006ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.921+0000 7ff34e000640 1 -- 172.21.15.49:0/1277468442 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3348419327 0 0) 0x7ff330003530 con 0x7ff35006a770 2024-01-31T12:09:35.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.921+0000 7ff34f400640 1 -- 172.21.15.49:0/1277468442 >> v1:172.21.15.195:6789/0 conn(0x7ff35006a770 legacy=0x7ff35015d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:35.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.921+0000 7ff34f400640 1 -- 172.21.15.49:0/1277468442 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35015e3a0 con 0x7ff35015ae90 2024-01-31T12:09:35.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.929+0000 7ff34f400640 1 --2- 172.21.15.49:0/1277468442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff35015ae90 0x7ff350072000 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7ff3380097c0 tx=0x7ff33801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc828729c8e9654a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:35.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.929+0000 7ff34e000640 1 -- 172.21.15.49:0/1277468442 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff340001810 con 0x7ff35015ae90 2024-01-31T12:09:35.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.929+0000 7ff34e000640 1 -- 172.21.15.49:0/1277468442 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3380a7050 con 0x7ff35015ae90 2024-01-31T12:09:35.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.929+0000 7ff34e000640 1 -- 172.21.15.49:0/1277468442 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3380ab620 con 0x7ff35015ae90 2024-01-31T12:09:35.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.933+0000 7ff356000640 1 -- 172.21.15.49:0/1277468442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff35015ae90 msgr2=0x7ff350072000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:35.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.933+0000 7ff356000640 1 --2- 172.21.15.49:0/1277468442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff35015ae90 0x7ff350072000 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7ff3380097c0 tx=0x7ff33801c3a0 comp rx=0 tx=0).stop 2024-01-31T12:09:35.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.933+0000 7ff356000640 1 -- 172.21.15.49:0/1277468442 shutdown_connections 2024-01-31T12:09:35.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.933+0000 7ff356000640 1 --2- 172.21.15.49:0/1277468442 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff35015de30 0x7ff35006ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:35.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.933+0000 7ff356000640 1 --2- 172.21.15.49:0/1277468442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff35015ae90 0x7ff350072000 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:35.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.933+0000 7ff356000640 1 -- 172.21.15.49:0/1277468442 >> 172.21.15.49:0/1277468442 conn(0x7ff3500cfda0 msgr2=0x7ff3500d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:35.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.933+0000 7ff356000640 1 -- 172.21.15.49:0/1277468442 shutdown_connections 2024-01-31T12:09:35.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.933+0000 7ff356000640 1 -- 172.21.15.49:0/1277468442 wait complete. 2024-01-31T12:09:35.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.937+0000 7ff356000640 1 Processor -- start 2024-01-31T12:09:35.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.937+0000 7ff356000640 1 -- start start 2024-01-31T12:09:35.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.941+0000 7ff356000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff35006a770 0x7ff3500c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:35.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.941+0000 7ff356000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff35015ae90 0x7ff3500b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:35.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.941+0000 7ff356000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff35015de30 0x7ff3500af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:35.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.941+0000 7ff356000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3500c7500 con 0x7ff35015ae90 2024-01-31T12:09:35.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.941+0000 7ff356000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3500ad5f0 con 0x7ff35006a770 2024-01-31T12:09:35.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.941+0000 7ff356000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3500c96f0 con 0x7ff35015de30 2024-01-31T12:09:35.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.941+0000 7ff34f400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff35006a770 0x7ff3500c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:35.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.941+0000 7ff34f400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff35006a770 0x7ff3500c6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:39062/0 (socket says 172.21.15.49:39062) 2024-01-31T12:09:35.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.941+0000 7ff34f400640 1 -- 172.21.15.49:0/3102214412 learned_addr learned my addr 172.21.15.49:0/3102214412 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:35.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.941+0000 7ff34fe00640 1 --2- 172.21.15.49:0/3102214412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff35015de30 0x7ff3500af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:35.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.941+0000 7ff34ea00640 1 --2- 172.21.15.49:0/3102214412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff35015ae90 0x7ff3500b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:35.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.941+0000 7ff34f400640 1 -- 172.21.15.49:0/3102214412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff35015de30 msgr2=0x7ff3500af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:35.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.941+0000 7ff34f400640 1 --2- 172.21.15.49:0/3102214412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff35015de30 0x7ff3500af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:35.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.941+0000 7ff34f400640 1 -- 172.21.15.49:0/3102214412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff35015ae90 msgr2=0x7ff3500b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:35.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.941+0000 7ff34f400640 1 --2- 172.21.15.49:0/3102214412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff35015ae90 0x7ff3500b21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:35.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.941+0000 7ff34f400640 1 -- 172.21.15.49:0/3102214412 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff338009420 con 0x7ff35006a770 2024-01-31T12:09:35.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.941+0000 7ff34f400640 1 --2- 172.21.15.49:0/3102214412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff35006a770 0x7ff3500c6e70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7ff338019fd0 tx=0x7ff338019140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:35.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.945+0000 7ff347400640 1 -- 172.21.15.49:0/3102214412 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3380b4400 con 0x7ff35006a770 2024-01-31T12:09:35.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.945+0000 7ff347400640 1 -- 172.21.15.49:0/3102214412 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3380b4560 con 0x7ff35006a770 2024-01-31T12:09:35.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.945+0000 7ff347400640 1 -- 172.21.15.49:0/3102214412 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3380b4910 con 0x7ff35006a770 2024-01-31T12:09:35.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.945+0000 7ff356000640 1 -- 172.21.15.49:0/3102214412 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3500c99d0 con 0x7ff35006a770 2024-01-31T12:09:35.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.945+0000 7ff356000640 1 -- 172.21.15.49:0/3102214412 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3500c8ca0 con 0x7ff35006a770 2024-01-31T12:09:35.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.945+0000 7ff356000640 1 -- 172.21.15.49:0/3102214412 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff350074860 con 0x7ff35006a770 2024-01-31T12:09:35.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.949+0000 7ff347400640 1 -- 172.21.15.49:0/3102214412 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7ff3380b2040 con 0x7ff35006a770 2024-01-31T12:09:35.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.949+0000 7ff347400640 1 --2- 172.21.15.49:0/3102214412 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff328066550 0x7ff328068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:35.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.949+0000 7ff347400640 1 -- 172.21.15.49:0/3102214412 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff33811d6b0 con 0x7ff35006a770 2024-01-31T12:09:35.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.953+0000 7ff34ea00640 1 --2- 172.21.15.49:0/3102214412 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff328066550 0x7ff328068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:35.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.953+0000 7ff34ea00640 1 --2- 172.21.15.49:0/3102214412 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff328066550 0x7ff328068a10 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff3501584d0 tx=0x7ff340009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:35.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:35.953+0000 7ff347400640 1 -- 172.21.15.49:0/3102214412 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7ff3380eaaf0 con 0x7ff35006a770 2024-01-31T12:09:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.437+0000 7ff356000640 1 -- 172.21.15.49:0/3102214412 --> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff350071ae0 con 0x7ff328066550 2024-01-31T12:09:36.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.437+0000 7ff347400640 1 -- 172.21.15.49:0/3102214412 <== mgr.4100 v2:172.21.15.195:6832/3035808172 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff340007e00 con 0x7ff328066550 2024-01-31T12:09:36.437 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 2 to deep-scrub 2024-01-31T12:09:36.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.441+0000 7ff356000640 1 -- 172.21.15.49:0/3102214412 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff328066550 msgr2=0x7ff328068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:36.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.441+0000 7ff356000640 1 --2- 172.21.15.49:0/3102214412 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff328066550 0x7ff328068a10 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff3501584d0 tx=0x7ff340009040 comp rx=0 tx=0).stop 2024-01-31T12:09:36.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.441+0000 7ff356000640 1 -- 172.21.15.49:0/3102214412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff35006a770 msgr2=0x7ff3500c6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:36.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.441+0000 7ff356000640 1 --2- 172.21.15.49:0/3102214412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff35006a770 0x7ff3500c6e70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7ff338019fd0 tx=0x7ff338019140 comp rx=0 tx=0).stop 2024-01-31T12:09:36.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.441+0000 7ff356000640 1 -- 172.21.15.49:0/3102214412 shutdown_connections 2024-01-31T12:09:36.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.441+0000 7ff356000640 1 --2- 172.21.15.49:0/3102214412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff35015de30 0x7ff3500af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:36.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.441+0000 7ff356000640 1 --2- 172.21.15.49:0/3102214412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff35015ae90 0x7ff3500b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:36.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.441+0000 7ff356000640 1 --2- 172.21.15.49:0/3102214412 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7ff328066550 0x7ff328068a10 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:36.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.441+0000 7ff356000640 1 --2- 172.21.15.49:0/3102214412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff35006a770 0x7ff3500c6e70 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:36.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.441+0000 7ff356000640 1 -- 172.21.15.49:0/3102214412 >> 172.21.15.49:0/3102214412 conn(0x7ff3500cfda0 msgr2=0x7ff3500d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:36.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.441+0000 7ff356000640 1 -- 172.21.15.49:0/3102214412 shutdown_connections 2024-01-31T12:09:36.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.441+0000 7ff356000640 1 -- 172.21.15.49:0/3102214412 wait complete. 2024-01-31T12:09:36.496 INFO:tasks.ceph:Scrubbing osd.3 2024-01-31T12:09:36.497 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-31T12:09:36.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.917+0000 7f26cb800640 1 Processor -- start 2024-01-31T12:09:36.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.917+0000 7f26cb800640 1 -- start start 2024-01-31T12:09:36.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.921+0000 7f26cb800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c40cf9b0 0x7f26c4161aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:36.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.921+0000 7f26cb800640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c406ddb0 con 0x7f26c406e580 2024-01-31T12:09:36.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.921+0000 7f26cb800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c406d1a0 con 0x7f26c41616c0 2024-01-31T12:09:36.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.921+0000 7f26cb800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c406d480 con 0x7f26c40cf9b0 2024-01-31T12:09:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.921+0000 7f26c3e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c40cf9b0 0x7f26c4161aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.921+0000 7f26c8e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f26c41616c0 0x7f26c40cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:48764/0 (socket says 172.21.15.49:48764) 2024-01-31T12:09:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.921+0000 7f26c3e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c40cf9b0 0x7f26c4161aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:57556/0 (socket says 172.21.15.49:57556) 2024-01-31T12:09:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.921+0000 7f26c8e00640 1 -- 172.21.15.49:0/168415739 learned_addr learned my addr 172.21.15.49:0/168415739 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:09:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.921+0000 7f26c3e00640 1 -- 172.21.15.49:0/168415739 >> v1:172.21.15.195:6789/0 conn(0x7f26c41616c0 legacy=0x7f26c40cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.921+0000 7f26c3e00640 1 -- 172.21.15.49:0/168415739 >> v1:172.21.15.49:6789/0 conn(0x7f26c406e580 legacy=0x7f26c41652a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:36.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.921+0000 7f26c3e00640 1 -- 172.21.15.49:0/168415739 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c406d760 con 0x7f26c40cf9b0 2024-01-31T12:09:36.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.933+0000 7f26c3e00640 1 --2- 172.21.15.49:0/168415739 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c40cf9b0 0x7f26c4161aa0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f26ac0097f0 tx=0x7f26ac01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b2b7b5d7ab4dbd3 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:36.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.933+0000 7f26c3400640 1 -- 172.21.15.49:0/168415739 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c406cef0 con 0x7f26c40cf9b0 2024-01-31T12:09:36.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.933+0000 7f26c3400640 1 -- 172.21.15.49:0/168415739 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ac0a7050 con 0x7f26c40cf9b0 2024-01-31T12:09:36.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.933+0000 7f26c3400640 1 -- 172.21.15.49:0/168415739 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac0ab820 con 0x7f26c40cf9b0 2024-01-31T12:09:36.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.933+0000 7f26cb800640 1 -- 172.21.15.49:0/168415739 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c40cf9b0 msgr2=0x7f26c4161aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:36.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.933+0000 7f26cb800640 1 --2- 172.21.15.49:0/168415739 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c40cf9b0 0x7f26c4161aa0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f26ac0097f0 tx=0x7f26ac01c3f0 comp rx=0 tx=0).stop 2024-01-31T12:09:36.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.933+0000 7f26cb800640 1 -- 172.21.15.49:0/168415739 shutdown_connections 2024-01-31T12:09:36.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.933+0000 7f26cb800640 1 --2- 172.21.15.49:0/168415739 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c40cf9b0 0x7f26c4161aa0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:36.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.933+0000 7f26cb800640 1 -- 172.21.15.49:0/168415739 >> 172.21.15.49:0/168415739 conn(0x7f26c40668d0 msgr2=0x7f26c406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:36.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.933+0000 7f26cb800640 1 -- 172.21.15.49:0/168415739 shutdown_connections 2024-01-31T12:09:36.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.933+0000 7f26cb800640 1 -- 172.21.15.49:0/168415739 wait complete. 2024-01-31T12:09:36.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.937+0000 7f26cb800640 1 Processor -- start 2024-01-31T12:09:36.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.941+0000 7f26cb800640 1 -- start start 2024-01-31T12:09:36.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.941+0000 7f26cb800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26c406e580 0x7f26c414d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:36.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.941+0000 7f26cb800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c40cf9b0 0x7f26c414aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:36.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.941+0000 7f26cb800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26c41616c0 0x7f26c414e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:36.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.941+0000 7f26cb800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c414af50 con 0x7f26c41616c0 2024-01-31T12:09:36.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.941+0000 7f26cb800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c40cbe60 con 0x7f26c406e580 2024-01-31T12:09:36.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.941+0000 7f26cb800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c4154c10 con 0x7f26c40cf9b0 2024-01-31T12:09:36.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.941+0000 7f26c3e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c40cf9b0 0x7f26c414aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:36.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.941+0000 7f26c8e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26c406e580 0x7f26c414d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:36.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.941+0000 7f26c3e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c40cf9b0 0x7f26c414aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:57562/0 (socket says 172.21.15.49:57562) 2024-01-31T12:09:36.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.941+0000 7f26c3e00640 1 -- 172.21.15.49:0/2472473337 learned_addr learned my addr 172.21.15.49:0/2472473337 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:36.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.941+0000 7f26c9800640 1 --2- 172.21.15.49:0/2472473337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26c41616c0 0x7f26c414e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:36.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.945+0000 7f26c3e00640 1 -- 172.21.15.49:0/2472473337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26c406e580 msgr2=0x7f26c414d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.945+0000 7f26c3e00640 1 --2- 172.21.15.49:0/2472473337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26c406e580 0x7f26c414d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.945+0000 7f26c3e00640 1 -- 172.21.15.49:0/2472473337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26c41616c0 msgr2=0x7f26c414e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.945+0000 7f26c3e00640 1 --2- 172.21.15.49:0/2472473337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26c41616c0 0x7f26c414e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.945+0000 7f26c3e00640 1 -- 172.21.15.49:0/2472473337 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac009420 con 0x7f26c40cf9b0 2024-01-31T12:09:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.945+0000 7f26c9800640 1 --2- 172.21.15.49:0/2472473337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26c41616c0 0x7f26c414e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T12:09:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.945+0000 7f26c8e00640 1 --2- 172.21.15.49:0/2472473337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26c406e580 0x7f26c414d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T12:09:36.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.945+0000 7f26c3e00640 1 --2- 172.21.15.49:0/2472473337 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c40cf9b0 0x7f26c414aa10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f26ac01a020 tx=0x7f26ac019190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:36.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.945+0000 7f26c0c00640 1 -- 172.21.15.49:0/2472473337 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac0b48d0 con 0x7f26c40cf9b0 2024-01-31T12:09:36.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.945+0000 7f26c0c00640 1 -- 172.21.15.49:0/2472473337 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ac0b4a30 con 0x7f26c40cf9b0 2024-01-31T12:09:36.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.945+0000 7f26c0c00640 1 -- 172.21.15.49:0/2472473337 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac0b4dc0 con 0x7f26c40cf9b0 2024-01-31T12:09:36.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.945+0000 7f26cb800640 1 -- 172.21.15.49:0/2472473337 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c40cc100 con 0x7f26c40cf9b0 2024-01-31T12:09:36.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.945+0000 7f26cb800640 1 -- 172.21.15.49:0/2472473337 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c40cc3e0 con 0x7f26c40cf9b0 2024-01-31T12:09:36.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.949+0000 7f26c0c00640 1 -- 172.21.15.49:0/2472473337 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f26ac0b2040 con 0x7f26c40cf9b0 2024-01-31T12:09:36.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.949+0000 7f26cb800640 1 -- 172.21.15.49:0/2472473337 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f26c40cc5d0 con 0x7f26c40cf9b0 2024-01-31T12:09:36.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.949+0000 7f26c0c00640 1 --2- 172.21.15.49:0/2472473337 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f269c066550 0x7f269c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:36.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.949+0000 7f26c0c00640 1 -- 172.21.15.49:0/2472473337 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f26ac11de90 con 0x7f26c40cf9b0 2024-01-31T12:09:36.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.949+0000 7f26c8e00640 1 --2- 172.21.15.49:0/2472473337 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f269c066550 0x7f269c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:36.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.949+0000 7f26c0c00640 1 --2- 172.21.15.49:0/2472473337 >> [v2:172.21.15.49:6802/571126940,v1:172.21.15.49:6805/571126940] conn(0x7f269c06c850 0x7f269c06ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:36.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.949+0000 7f26c0c00640 1 -- 172.21.15.49:0/2472473337 --> [v2:172.21.15.49:6802/571126940,v1:172.21.15.49:6805/571126940] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f269c06f360 con 0x7f269c06c850 2024-01-31T12:09:36.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.949+0000 7f26c0c00640 1 -- 172.21.15.49:0/2472473337 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26ac120470 con 0x7f26c40cf9b0 2024-01-31T12:09:36.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.953+0000 7f26c9800640 1 --2- 172.21.15.49:0/2472473337 >> [v2:172.21.15.49:6802/571126940,v1:172.21.15.49:6805/571126940] conn(0x7f269c06c850 0x7f269c06ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:36.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.953+0000 7f26c8e00640 1 --2- 172.21.15.49:0/2472473337 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f269c066550 0x7f269c068a10 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f26b4005890 tx=0x7f26b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:36.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:36.953+0000 7f26c9800640 1 --2- 172.21.15.49:0/2472473337 >> [v2:172.21.15.49:6802/571126940,v1:172.21.15.49:6805/571126940] conn(0x7f269c06c850 0x7f269c06ec90 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:37.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.053+0000 7f26c0c00640 1 -- 172.21.15.49:0/2472473337 <== osd.3 v2:172.21.15.49:6802/571126940 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f269c06f360 con 0x7f269c06c850 2024-01-31T12:09:37.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.093+0000 7f26cb800640 1 -- 172.21.15.49:0/2472473337 --> [v2:172.21.15.49:6802/571126940,v1:172.21.15.49:6805/571126940] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f26c4074860 con 0x7f269c06c850 2024-01-31T12:09:37.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.097+0000 7f26c0c00640 1 -- 172.21.15.49:0/2472473337 <== osd.3 v2:172.21.15.49:6802/571126940 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f26c4074860 con 0x7f269c06c850 2024-01-31T12:09:37.097 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-31T12:09:37.097 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-31T12:09:37.097 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-31T12:09:37.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.097+0000 7f26cb800640 1 -- 172.21.15.49:0/2472473337 >> [v2:172.21.15.49:6802/571126940,v1:172.21.15.49:6805/571126940] conn(0x7f269c06c850 msgr2=0x7f269c06ec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:37.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.097+0000 7f26cb800640 1 --2- 172.21.15.49:0/2472473337 >> [v2:172.21.15.49:6802/571126940,v1:172.21.15.49:6805/571126940] conn(0x7f269c06c850 0x7f269c06ec90 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:37.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.097+0000 7f26cb800640 1 -- 172.21.15.49:0/2472473337 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f269c066550 msgr2=0x7f269c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:37.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.097+0000 7f26cb800640 1 --2- 172.21.15.49:0/2472473337 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f269c066550 0x7f269c068a10 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f26b4005890 tx=0x7f26b4009040 comp rx=0 tx=0).stop 2024-01-31T12:09:37.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.097+0000 7f26cb800640 1 -- 172.21.15.49:0/2472473337 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c40cf9b0 msgr2=0x7f26c414aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:37.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.097+0000 7f26cb800640 1 --2- 172.21.15.49:0/2472473337 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f26c40cf9b0 0x7f26c414aa10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f26ac01a020 tx=0x7f26ac019190 comp rx=0 tx=0).stop 2024-01-31T12:09:37.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.097+0000 7f26c9800640 1 -- 172.21.15.49:0/2472473337 reap_dead start 2024-01-31T12:09:37.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.097+0000 7f26cb800640 1 -- 172.21.15.49:0/2472473337 shutdown_connections 2024-01-31T12:09:37.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.097+0000 7f26cb800640 1 -- 172.21.15.49:0/2472473337 >> 172.21.15.49:0/2472473337 conn(0x7f26c40668d0 msgr2=0x7f26c40b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:37.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.097+0000 7f26cb800640 1 -- 172.21.15.49:0/2472473337 shutdown_connections 2024-01-31T12:09:37.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.097+0000 7f26cb800640 1 -- 172.21.15.49:0/2472473337 wait complete. 2024-01-31T12:09:37.147 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-31T12:09:37.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.561+0000 7fa2e9200640 1 Processor -- start 2024-01-31T12:09:37.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.561+0000 7fa2e9200640 1 -- start start 2024-01-31T12:09:37.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.565+0000 7fa2e9200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2e415b560 0x7fa2e406d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:37.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.565+0000 7fa2e9200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fa2e40cbe00 0x7fa2e40cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:37.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.565+0000 7fa2e9200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e415b9c0 con 0x7fa2e40ae9a0 2024-01-31T12:09:37.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.565+0000 7fa2e9200640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e406dae0 con 0x7fa2e40cbe00 2024-01-31T12:09:37.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.565+0000 7fa2e9200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e40cc7b0 con 0x7fa2e415b560 2024-01-31T12:09:37.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.565+0000 7fa2e1400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2e415b560 0x7fa2e406d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:37.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.565+0000 7fa2e1400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2e415b560 0x7fa2e406d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:57570/0 (socket says 172.21.15.49:57570) 2024-01-31T12:09:37.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.565+0000 7fa2e1400640 1 -- 172.21.15.49:0/435192049 learned_addr learned my addr 172.21.15.49:0/435192049 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:37.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.565+0000 7fa2e1e00640 1 --1- 172.21.15.49:0/435192049 >> v1:172.21.15.195:6789/0 conn(0x7fa2e40ae9a0 0x7fa2e40cdcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:48780/0 (socket says 172.21.15.49:48780) 2024-01-31T12:09:37.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.565+0000 7fa2e2800640 1 --2- 172.21.15.49:0/435192049 >> v2:172.21.15.49:3300/0 conn(0x7fa2e40cbe00 0x7fa2e40cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:37.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.565+0000 7fa2e1400640 1 -- 172.21.15.49:0/435192049 >> v2:172.21.15.49:3300/0 conn(0x7fa2e40cbe00 msgr2=0x7fa2e40cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:37.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.565+0000 7fa2e1400640 1 --2- 172.21.15.49:0/435192049 >> v2:172.21.15.49:3300/0 conn(0x7fa2e40cbe00 0x7fa2e40cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:37.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.565+0000 7fa2e1400640 1 -- 172.21.15.49:0/435192049 >> v1:172.21.15.195:6789/0 conn(0x7fa2e40ae9a0 legacy=0x7fa2e40cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:37.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.565+0000 7fa2e1400640 1 -- 172.21.15.49:0/435192049 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e415ebf0 con 0x7fa2e415b560 2024-01-31T12:09:37.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.569+0000 7fa2e1400640 1 --2- 172.21.15.49:0/435192049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2e415b560 0x7fa2e406d5a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009870 tx=0x7fa2cc01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10d887e22c204042 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:37.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.569+0000 7fa2e0a00640 1 -- 172.21.15.49:0/435192049 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc0a9400 con 0x7fa2e415b560 2024-01-31T12:09:37.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.569+0000 7fa2e0a00640 1 -- 172.21.15.49:0/435192049 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc0a9560 con 0x7fa2e415b560 2024-01-31T12:09:37.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.569+0000 7fa2e0a00640 1 -- 172.21.15.49:0/435192049 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc0a98f0 con 0x7fa2e415b560 2024-01-31T12:09:37.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.573+0000 7fa2e9200640 1 -- 172.21.15.49:0/435192049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2e415b560 msgr2=0x7fa2e406d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:37.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.573+0000 7fa2e9200640 1 --2- 172.21.15.49:0/435192049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2e415b560 0x7fa2e406d5a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009870 tx=0x7fa2cc01c540 comp rx=0 tx=0).stop 2024-01-31T12:09:37.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.573+0000 7fa2e9200640 1 -- 172.21.15.49:0/435192049 shutdown_connections 2024-01-31T12:09:37.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.573+0000 7fa2e9200640 1 --2- 172.21.15.49:0/435192049 >> v2:172.21.15.49:3300/0 conn(0x7fa2e40cbe00 0x7fa2e40cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:37.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.573+0000 7fa2e9200640 1 --2- 172.21.15.49:0/435192049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2e415b560 0x7fa2e406d5a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:37.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.573+0000 7fa2e9200640 1 -- 172.21.15.49:0/435192049 >> 172.21.15.49:0/435192049 conn(0x7fa2e40668d0 msgr2=0x7fa2e406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:37.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.573+0000 7fa2e9200640 1 -- 172.21.15.49:0/435192049 shutdown_connections 2024-01-31T12:09:37.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.573+0000 7fa2e9200640 1 -- 172.21.15.49:0/435192049 wait complete. 2024-01-31T12:09:37.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.577+0000 7fa2e9200640 1 Processor -- start 2024-01-31T12:09:37.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.577+0000 7fa2e9200640 1 -- start start 2024-01-31T12:09:37.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e9200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2e40ae9a0 0x7fa2e4132560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:37.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e9200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2e40cbe00 0x7fa2e4130c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:37.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e9200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2e415b560 0x7fa2e4149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:37.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e9200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4132140 con 0x7fa2e40ae9a0 2024-01-31T12:09:37.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e9200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4132aa0 con 0x7fa2e40cbe00 2024-01-31T12:09:37.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e9200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e41314c0 con 0x7fa2e415b560 2024-01-31T12:09:37.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e1e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2e40ae9a0 0x7fa2e4132560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:37.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e1e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2e40ae9a0 0x7fa2e4132560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60780/0 (socket says 172.21.15.49:60780) 2024-01-31T12:09:37.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e1e00640 1 -- 172.21.15.49:0/3486085538 learned_addr learned my addr 172.21.15.49:0/3486085538 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:37.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e1400640 1 --2- 172.21.15.49:0/3486085538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2e40cbe00 0x7fa2e4130c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:37.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e2800640 1 --2- 172.21.15.49:0/3486085538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2e415b560 0x7fa2e4149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:37.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e1e00640 1 -- 172.21.15.49:0/3486085538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2e415b560 msgr2=0x7fa2e4149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:37.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e1e00640 1 --2- 172.21.15.49:0/3486085538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2e415b560 0x7fa2e4149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:37.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e1e00640 1 -- 172.21.15.49:0/3486085538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2e40cbe00 msgr2=0x7fa2e4130c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:37.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e1e00640 1 --2- 172.21.15.49:0/3486085538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2e40cbe00 0x7fa2e4130c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:37.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e1e00640 1 -- 172.21.15.49:0/3486085538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc0094d0 con 0x7fa2e40ae9a0 2024-01-31T12:09:37.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e2800640 1 --2- 172.21.15.49:0/3486085538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2e415b560 0x7fa2e4149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T12:09:37.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e1e00640 1 --2- 172.21.15.49:0/3486085538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2e40ae9a0 0x7fa2e4132560 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400c370 tx=0x7fa2d400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:37.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2da000640 1 -- 172.21.15.49:0/3486085538 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d40074e0 con 0x7fa2e40ae9a0 2024-01-31T12:09:37.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2da000640 1 -- 172.21.15.49:0/3486085538 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d4007640 con 0x7fa2e40ae9a0 2024-01-31T12:09:37.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2da000640 1 -- 172.21.15.49:0/3486085538 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4004a30 con 0x7fa2e40ae9a0 2024-01-31T12:09:37.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e9200640 1 -- 172.21.15.49:0/3486085538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e41317a0 con 0x7fa2e40ae9a0 2024-01-31T12:09:37.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.581+0000 7fa2e9200640 1 -- 172.21.15.49:0/3486085538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e4131d60 con 0x7fa2e40ae9a0 2024-01-31T12:09:37.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.585+0000 7fa2e9200640 1 -- 172.21.15.49:0/3486085538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e4132280 con 0x7fa2e40ae9a0 2024-01-31T12:09:37.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.585+0000 7fa2da000640 1 -- 172.21.15.49:0/3486085538 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fa2d4004b90 con 0x7fa2e40ae9a0 2024-01-31T12:09:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.589+0000 7fa2da000640 1 --2- 172.21.15.49:0/3486085538 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa2bc066500 0x7fa2bc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:37.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.589+0000 7fa2da000640 1 -- 172.21.15.49:0/3486085538 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa2d4083510 con 0x7fa2e40ae9a0 2024-01-31T12:09:37.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.589+0000 7fa2e1400640 1 --2- 172.21.15.49:0/3486085538 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa2bc066500 0x7fa2bc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:37.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.589+0000 7fa2e1400640 1 --2- 172.21.15.49:0/3486085538 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa2bc066500 0x7fa2bc0689c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009870 tx=0x7fa2cc0b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:37.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.601+0000 7fa2da000640 1 -- 172.21.15.49:0/3486085538 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fa2e4132280 con 0x7fa2e40ae9a0 2024-01-31T12:09:37.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.769+0000 7fa2e9200640 1 -- 172.21.15.49:0/3486085538 --> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2e4068320 con 0x7fa2bc066500 2024-01-31T12:09:37.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.769+0000 7fa2da000640 1 -- 172.21.15.49:0/3486085538 <== mgr.4100 v2:172.21.15.195:6832/3035808172 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa2e4068320 con 0x7fa2bc066500 2024-01-31T12:09:37.770 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 3 to deep-scrub 2024-01-31T12:09:37.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.773+0000 7fa2e9200640 1 -- 172.21.15.49:0/3486085538 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa2bc066500 msgr2=0x7fa2bc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:37.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.773+0000 7fa2e9200640 1 --2- 172.21.15.49:0/3486085538 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa2bc066500 0x7fa2bc0689c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009870 tx=0x7fa2cc0b3040 comp rx=0 tx=0).stop 2024-01-31T12:09:37.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.773+0000 7fa2e9200640 1 -- 172.21.15.49:0/3486085538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2e40ae9a0 msgr2=0x7fa2e4132560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:37.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.773+0000 7fa2e9200640 1 --2- 172.21.15.49:0/3486085538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2e40ae9a0 0x7fa2e4132560 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400c370 tx=0x7fa2d400c830 comp rx=0 tx=0).stop 2024-01-31T12:09:37.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.773+0000 7fa2e9200640 1 -- 172.21.15.49:0/3486085538 shutdown_connections 2024-01-31T12:09:37.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.773+0000 7fa2e9200640 1 --2- 172.21.15.49:0/3486085538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2e415b560 0x7fa2e4149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:37.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.773+0000 7fa2e9200640 1 --2- 172.21.15.49:0/3486085538 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fa2bc066500 0x7fa2bc0689c0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:37.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.773+0000 7fa2e9200640 1 --2- 172.21.15.49:0/3486085538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2e40cbe00 0x7fa2e4130c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:37.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.773+0000 7fa2e9200640 1 --2- 172.21.15.49:0/3486085538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2e40ae9a0 0x7fa2e4132560 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:37.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.773+0000 7fa2e9200640 1 -- 172.21.15.49:0/3486085538 >> 172.21.15.49:0/3486085538 conn(0x7fa2e40668d0 msgr2=0x7fa2e40ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:37.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.773+0000 7fa2e9200640 1 -- 172.21.15.49:0/3486085538 shutdown_connections 2024-01-31T12:09:37.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:37.773+0000 7fa2e9200640 1 -- 172.21.15.49:0/3486085538 wait complete. 2024-01-31T12:09:37.799 INFO:tasks.ceph:Scrubbing osd.4 2024-01-31T12:09:37.800 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-31T12:09:38.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.009+0000 7fbf9f200640 1 Processor -- start 2024-01-31T12:09:38.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.009+0000 7fbf9f200640 1 -- start start 2024-01-31T12:09:38.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.013+0000 7fbf9f200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf9815d540 0x7fbf980cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:38.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.013+0000 7fbf9f200640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf980cef80 con 0x7fbf9806c290 2024-01-31T12:09:38.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.013+0000 7fbf9f200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9806cae0 con 0x7fbf980cbbc0 2024-01-31T12:09:38.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.013+0000 7fbf9f200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf980cf1b0 con 0x7fbf9815d540 2024-01-31T12:09:38.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.013+0000 7fbf97e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf9815d540 0x7fbf980cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:38.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.013+0000 7fbf9d200640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fbf980cbbc0 0x7fbf9815d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:48792/0 (socket says 172.21.15.49:48792) 2024-01-31T12:09:38.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.013+0000 7fbf9d200640 1 -- 172.21.15.49:0/1203951351 learned_addr learned my addr 172.21.15.49:0/1203951351 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:09:38.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.013+0000 7fbf96a00640 1 -- 172.21.15.49:0/1203951351 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052725230 0 0) 0x7fbf9806cae0 con 0x7fbf980cbbc0 2024-01-31T12:09:38.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.013+0000 7fbf96a00640 1 -- 172.21.15.49:0/1203951351 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf78003530 con 0x7fbf980cbbc0 2024-01-31T12:09:38.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.013+0000 7fbf97e00640 1 -- 172.21.15.49:0/1203951351 >> v1:172.21.15.195:6789/0 conn(0x7fbf980cbbc0 legacy=0x7fbf9815d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:38.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.013+0000 7fbf97e00640 1 -- 172.21.15.49:0/1203951351 >> v1:172.21.15.49:6789/0 conn(0x7fbf9806c290 legacy=0x7fbf980cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:38.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.013+0000 7fbf97e00640 1 -- 172.21.15.49:0/1203951351 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf980cf490 con 0x7fbf9815d540 2024-01-31T12:09:38.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.021+0000 7fbf97e00640 1 --2- 172.21.15.49:0/1203951351 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf9815d540 0x7fbf980cff70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbf880097f0 tx=0x7fbf8801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fe2a1ae90416713 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:38.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.021+0000 7fbf96a00640 1 -- 172.21.15.49:0/1203951351 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf880aa5f0 con 0x7fbf9815d540 2024-01-31T12:09:38.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.021+0000 7fbf96a00640 1 -- 172.21.15.49:0/1203951351 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf880aa750 con 0x7fbf9815d540 2024-01-31T12:09:38.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.021+0000 7fbf96a00640 1 -- 172.21.15.49:0/1203951351 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf880aaae0 con 0x7fbf9815d540 2024-01-31T12:09:38.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.025+0000 7fbf9f200640 1 -- 172.21.15.49:0/1203951351 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf9815d540 msgr2=0x7fbf980cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:38.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.025+0000 7fbf9f200640 1 --2- 172.21.15.49:0/1203951351 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf9815d540 0x7fbf980cff70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbf880097f0 tx=0x7fbf8801c490 comp rx=0 tx=0).stop 2024-01-31T12:09:38.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.025+0000 7fbf9f200640 1 -- 172.21.15.49:0/1203951351 shutdown_connections 2024-01-31T12:09:38.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.025+0000 7fbf9f200640 1 --2- 172.21.15.49:0/1203951351 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf9815d540 0x7fbf980cff70 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:38.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.025+0000 7fbf9f200640 1 -- 172.21.15.49:0/1203951351 >> 172.21.15.49:0/1203951351 conn(0x7fbf980d0e60 msgr2=0x7fbf980d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:38.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.025+0000 7fbf9f200640 1 -- 172.21.15.49:0/1203951351 shutdown_connections 2024-01-31T12:09:38.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.025+0000 7fbf9f200640 1 -- 172.21.15.49:0/1203951351 wait complete. 2024-01-31T12:09:38.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf9f200640 1 Processor -- start 2024-01-31T12:09:38.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf9f200640 1 -- start start 2024-01-31T12:09:38.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf9f200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf9806c290 0x7fbf980b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:38.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf9f200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf980cbbc0 0x7fbf98157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:38.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf9f200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf9815d540 0x7fbf980ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:38.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf9f200640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9815b0d0 con 0x7fbf9815d540 2024-01-31T12:09:38.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf9f200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf980b6910 con 0x7fbf980cbbc0 2024-01-31T12:09:38.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf9f200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf98159c80 con 0x7fbf9806c290 2024-01-31T12:09:38.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf9d200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf9815d540 0x7fbf980ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:38.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf97e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf9806c290 0x7fbf980b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:38.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf97400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf980cbbc0 0x7fbf98157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:38.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf97e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf9806c290 0x7fbf980b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:57606/0 (socket says 172.21.15.49:57606) 2024-01-31T12:09:38.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf97e00640 1 -- 172.21.15.49:0/1983088016 learned_addr learned my addr 172.21.15.49:0/1983088016 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:38.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf9d200640 1 -- 172.21.15.49:0/1983088016 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf9806c290 msgr2=0x7fbf980b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:38.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf9d200640 1 --2- 172.21.15.49:0/1983088016 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf9806c290 0x7fbf980b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:38.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf9d200640 1 -- 172.21.15.49:0/1983088016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf980cbbc0 msgr2=0x7fbf98157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:38.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf9d200640 1 --2- 172.21.15.49:0/1983088016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf980cbbc0 0x7fbf98157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:38.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf9d200640 1 -- 172.21.15.49:0/1983088016 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf88009420 con 0x7fbf9815d540 2024-01-31T12:09:38.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf97e00640 1 --2- 172.21.15.49:0/1983088016 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf9806c290 0x7fbf980b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T12:09:38.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf9d200640 1 --2- 172.21.15.49:0/1983088016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf9815d540 0x7fbf980ca1a0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7fbf9000ca70 tx=0x7fbf9000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:38.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.029+0000 7fbf8fe00640 1 -- 172.21.15.49:0/1983088016 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9000ab10 con 0x7fbf9815d540 2024-01-31T12:09:38.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.033+0000 7fbf9f200640 1 -- 172.21.15.49:0/1983088016 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf98159f60 con 0x7fbf9815d540 2024-01-31T12:09:38.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.033+0000 7fbf8fe00640 1 -- 172.21.15.49:0/1983088016 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9000ac70 con 0x7fbf9815d540 2024-01-31T12:09:38.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.033+0000 7fbf8fe00640 1 -- 172.21.15.49:0/1983088016 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf90012400 con 0x7fbf9815d540 2024-01-31T12:09:38.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.033+0000 7fbf9f200640 1 -- 172.21.15.49:0/1983088016 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9815ad60 con 0x7fbf9815d540 2024-01-31T12:09:38.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.033+0000 7fbf9f200640 1 -- 172.21.15.49:0/1983088016 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbf9815e840 con 0x7fbf9815d540 2024-01-31T12:09:38.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.037+0000 7fbf8fe00640 1 -- 172.21.15.49:0/1983088016 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fbf90007070 con 0x7fbf9815d540 2024-01-31T12:09:38.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.041+0000 7fbf8fe00640 1 --2- 172.21.15.49:0/1983088016 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbf70066500 0x7fbf700689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:38.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.041+0000 7fbf8fe00640 1 -- 172.21.15.49:0/1983088016 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fbf90083a90 con 0x7fbf9815d540 2024-01-31T12:09:38.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.041+0000 7fbf97e00640 1 --2- 172.21.15.49:0/1983088016 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbf70066500 0x7fbf700689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:38.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.041+0000 7fbf8fe00640 1 --2- 172.21.15.49:0/1983088016 >> [v2:172.21.15.195:6824/2275458030,v1:172.21.15.195:6825/2275458030] conn(0x7fbf7006c800 0x7fbf7006ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:38.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.041+0000 7fbf8fe00640 1 -- 172.21.15.49:0/1983088016 --> [v2:172.21.15.195:6824/2275458030,v1:172.21.15.195:6825/2275458030] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbf7006f310 con 0x7fbf7006c800 2024-01-31T12:09:38.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.041+0000 7fbf8fe00640 1 -- 172.21.15.49:0/1983088016 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf900882a0 con 0x7fbf9815d540 2024-01-31T12:09:38.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.041+0000 7fbf97400640 1 --2- 172.21.15.49:0/1983088016 >> [v2:172.21.15.195:6824/2275458030,v1:172.21.15.195:6825/2275458030] conn(0x7fbf7006c800 0x7fbf7006ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:38.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.041+0000 7fbf97e00640 1 --2- 172.21.15.49:0/1983088016 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbf70066500 0x7fbf700689c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fbf880097f0 tx=0x7fbf880a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:38.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.041+0000 7fbf97400640 1 --2- 172.21.15.49:0/1983088016 >> [v2:172.21.15.195:6824/2275458030,v1:172.21.15.195:6825/2275458030] conn(0x7fbf7006c800 0x7fbf7006ec40 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:38.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.117+0000 7fbf8fe00640 1 -- 172.21.15.49:0/1983088016 <== osd.4 v2:172.21.15.195:6824/2275458030 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbf7006f310 con 0x7fbf7006c800 2024-01-31T12:09:38.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.153+0000 7fbf9f200640 1 -- 172.21.15.49:0/1983088016 --> [v2:172.21.15.195:6824/2275458030,v1:172.21.15.195:6825/2275458030] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbf98074860 con 0x7fbf7006c800 2024-01-31T12:09:38.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.165+0000 7fbf8fe00640 1 -- 172.21.15.49:0/1983088016 <== osd.4 v2:172.21.15.195:6824/2275458030 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbf98074860 con 0x7fbf7006c800 2024-01-31T12:09:38.164 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-31T12:09:38.164 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-31T12:09:38.164 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-31T12:09:38.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.165+0000 7fbf9f200640 1 -- 172.21.15.49:0/1983088016 >> [v2:172.21.15.195:6824/2275458030,v1:172.21.15.195:6825/2275458030] conn(0x7fbf7006c800 msgr2=0x7fbf7006ec40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:38.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.165+0000 7fbf9f200640 1 --2- 172.21.15.49:0/1983088016 >> [v2:172.21.15.195:6824/2275458030,v1:172.21.15.195:6825/2275458030] conn(0x7fbf7006c800 0x7fbf7006ec40 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:38.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.165+0000 7fbf9f200640 1 -- 172.21.15.49:0/1983088016 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbf70066500 msgr2=0x7fbf700689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:38.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.165+0000 7fbf9f200640 1 --2- 172.21.15.49:0/1983088016 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fbf70066500 0x7fbf700689c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fbf880097f0 tx=0x7fbf880a7000 comp rx=0 tx=0).stop 2024-01-31T12:09:38.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.165+0000 7fbf9f200640 1 -- 172.21.15.49:0/1983088016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf9815d540 msgr2=0x7fbf980ca1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:38.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.165+0000 7fbf9f200640 1 --2- 172.21.15.49:0/1983088016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf9815d540 0x7fbf980ca1a0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7fbf9000ca70 tx=0x7fbf9000cf30 comp rx=0 tx=0).stop 2024-01-31T12:09:38.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.165+0000 7fbf9d200640 1 -- 172.21.15.49:0/1983088016 reap_dead start 2024-01-31T12:09:38.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.165+0000 7fbf9f200640 1 -- 172.21.15.49:0/1983088016 shutdown_connections 2024-01-31T12:09:38.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.165+0000 7fbf9f200640 1 -- 172.21.15.49:0/1983088016 >> 172.21.15.49:0/1983088016 conn(0x7fbf980d0e60 msgr2=0x7fbf9806e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:38.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.165+0000 7fbf9f200640 1 -- 172.21.15.49:0/1983088016 shutdown_connections 2024-01-31T12:09:38.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.165+0000 7fbf9f200640 1 -- 172.21.15.49:0/1983088016 wait complete. 2024-01-31T12:09:38.211 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-31T12:09:38.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.621+0000 7f46f4400640 1 Processor -- start 2024-01-31T12:09:38.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.625+0000 7f46f4400640 1 -- start start 2024-01-31T12:09:38.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.625+0000 7f46f4400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46ec15e7e0 0x7f46ec0b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:38.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.625+0000 7f46f4400640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46ec0c63d0 0x7f46ec0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:38.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.625+0000 7f46f4400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ec0c67f0 con 0x7f46ec0cf4a0 2024-01-31T12:09:38.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.625+0000 7f46f4400640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ec0d1d40 con 0x7f46ec0c63d0 2024-01-31T12:09:38.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.625+0000 7f46f4400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0cf930 con 0x7f46ec15e7e0 2024-01-31T12:09:38.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.625+0000 7f46f1000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46ec0c63d0 0x7f46ec0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:38.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.625+0000 7f46f1a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46ec15e7e0 0x7f46ec0b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:38.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.625+0000 7f46f1000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f46ec0c63d0 0x7f46ec0cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41822/0 (socket says 172.21.15.49:41822) 2024-01-31T12:09:38.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.625+0000 7f46f2400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7f46ec0cf4a0 0x7f46ec0c49b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51452/0 (socket says 172.21.15.49:51452) 2024-01-31T12:09:38.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.625+0000 7f46f1a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46ec15e7e0 0x7f46ec0b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:57926/0 (socket says 172.21.15.49:57926) 2024-01-31T12:09:38.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.625+0000 7f46f1000640 1 -- 172.21.15.49:0/781314425 learned_addr learned my addr 172.21.15.49:0/781314425 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:38.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.625+0000 7f46f1a00640 1 -- 172.21.15.49:0/781314425 >> v2:172.21.15.49:3300/0 conn(0x7f46ec0c63d0 msgr2=0x7f46ec0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:38.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.625+0000 7f46f1a00640 1 --2- 172.21.15.49:0/781314425 >> v2:172.21.15.49:3300/0 conn(0x7f46ec0c63d0 0x7f46ec0cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:38.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.625+0000 7f46f1a00640 1 -- 172.21.15.49:0/781314425 >> v1:172.21.15.49:6789/0 conn(0x7f46ec0cf4a0 legacy=0x7f46ec0c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:38.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.625+0000 7f46f1a00640 1 -- 172.21.15.49:0/781314425 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec0c6ab0 con 0x7f46ec15e7e0 2024-01-31T12:09:38.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.625+0000 7f46f1000640 1 --2- 172.21.15.49:0/781314425 >> v2:172.21.15.49:3300/0 conn(0x7f46ec0c63d0 0x7f46ec0cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T12:09:38.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.633+0000 7f46f1a00640 1 --2- 172.21.15.49:0/781314425 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46ec15e7e0 0x7f46ec0b2370 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0097c0 tx=0x7f46dc01ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d223c7608d616b6f server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:38.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.633+0000 7f46ebe00640 1 -- 172.21.15.49:0/781314425 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc0a8970 con 0x7f46ec15e7e0 2024-01-31T12:09:38.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.633+0000 7f46ebe00640 1 -- 172.21.15.49:0/781314425 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc0a8ad0 con 0x7f46ec15e7e0 2024-01-31T12:09:38.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.637+0000 7f46ebe00640 1 -- 172.21.15.49:0/781314425 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc0a8e60 con 0x7f46ec15e7e0 2024-01-31T12:09:38.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.637+0000 7f46f4400640 1 -- 172.21.15.49:0/781314425 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46ec15e7e0 msgr2=0x7f46ec0b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:38.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.637+0000 7f46f4400640 1 --2- 172.21.15.49:0/781314425 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46ec15e7e0 0x7f46ec0b2370 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0097c0 tx=0x7f46dc01ec70 comp rx=0 tx=0).stop 2024-01-31T12:09:38.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.637+0000 7f46f4400640 1 -- 172.21.15.49:0/781314425 shutdown_connections 2024-01-31T12:09:38.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.637+0000 7f46f4400640 1 --2- 172.21.15.49:0/781314425 >> v2:172.21.15.49:3300/0 conn(0x7f46ec0c63d0 0x7f46ec0cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:38.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.637+0000 7f46f4400640 1 --2- 172.21.15.49:0/781314425 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46ec15e7e0 0x7f46ec0b2370 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:38.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.637+0000 7f46f4400640 1 -- 172.21.15.49:0/781314425 >> 172.21.15.49:0/781314425 conn(0x7f46ec0d0e60 msgr2=0x7f46ec0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:38.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.637+0000 7f46f4400640 1 -- 172.21.15.49:0/781314425 shutdown_connections 2024-01-31T12:09:38.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.637+0000 7f46f4400640 1 -- 172.21.15.49:0/781314425 wait complete. 2024-01-31T12:09:38.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.641+0000 7f46f4400640 1 Processor -- start 2024-01-31T12:09:38.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.641+0000 7f46f4400640 1 -- start start 2024-01-31T12:09:38.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.645+0000 7f46f4400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46ec0c63d0 0x7f46ec0c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:38.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.645+0000 7f46f4400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46ec0cf4a0 0x7f46ec153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:38.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.645+0000 7f46f4400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46ec15e7e0 0x7f46ec153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:38.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.645+0000 7f46f4400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0b4ac0 con 0x7f46ec15e7e0 2024-01-31T12:09:38.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.645+0000 7f46f4400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0b4da0 con 0x7f46ec0cf4a0 2024-01-31T12:09:38.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.645+0000 7f46f4400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0b5080 con 0x7f46ec0c63d0 2024-01-31T12:09:38.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.645+0000 7f46f1a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46ec0c63d0 0x7f46ec0c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:38.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.645+0000 7f46f1a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46ec0c63d0 0x7f46ec0c9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:57930/0 (socket says 172.21.15.49:57930) 2024-01-31T12:09:38.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.645+0000 7f46f1a00640 1 -- 172.21.15.49:0/3070590479 learned_addr learned my addr 172.21.15.49:0/3070590479 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:38.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.645+0000 7f46f1000640 1 --2- 172.21.15.49:0/3070590479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46ec0cf4a0 0x7f46ec153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:38.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.645+0000 7f46f2400640 1 --2- 172.21.15.49:0/3070590479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46ec15e7e0 0x7f46ec153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:38.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.645+0000 7f46f1a00640 1 -- 172.21.15.49:0/3070590479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46ec0cf4a0 msgr2=0x7f46ec153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:38.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.645+0000 7f46f1a00640 1 --2- 172.21.15.49:0/3070590479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46ec0cf4a0 0x7f46ec153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:38.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.645+0000 7f46f1a00640 1 -- 172.21.15.49:0/3070590479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46ec15e7e0 msgr2=0x7f46ec153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:38.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.645+0000 7f46f1a00640 1 --2- 172.21.15.49:0/3070590479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46ec15e7e0 0x7f46ec153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:38.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.645+0000 7f46f1a00640 1 -- 172.21.15.49:0/3070590479 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d40094d0 con 0x7f46ec0c63d0 2024-01-31T12:09:38.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.645+0000 7f46f2400640 1 --2- 172.21.15.49:0/3070590479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46ec15e7e0 0x7f46ec153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T12:09:38.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.649+0000 7f46f1a00640 1 --2- 172.21.15.49:0/3070590479 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46ec0c63d0 0x7f46ec0c9f90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0b3040 tx=0x7f46dc01ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:38.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.649+0000 7f46e9600640 1 -- 172.21.15.49:0/3070590479 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc0b9630 con 0x7f46ec0c63d0 2024-01-31T12:09:38.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.649+0000 7f46e9600640 1 -- 172.21.15.49:0/3070590479 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc0b97b0 con 0x7f46ec0c63d0 2024-01-31T12:09:38.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.649+0000 7f46e9600640 1 -- 172.21.15.49:0/3070590479 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc0b9b60 con 0x7f46ec0c63d0 2024-01-31T12:09:38.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.649+0000 7f46f4400640 1 -- 172.21.15.49:0/3070590479 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46dc009420 con 0x7f46ec0c63d0 2024-01-31T12:09:38.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.649+0000 7f46f4400640 1 -- 172.21.15.49:0/3070590479 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ec0b5640 con 0x7f46ec0c63d0 2024-01-31T12:09:38.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.649+0000 7f46f4400640 1 -- 172.21.15.49:0/3070590479 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ec0b4ee0 con 0x7f46ec0c63d0 2024-01-31T12:09:38.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.653+0000 7f46e9600640 1 -- 172.21.15.49:0/3070590479 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f46dc0b7040 con 0x7f46ec0c63d0 2024-01-31T12:09:38.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.653+0000 7f46e9600640 1 --2- 172.21.15.49:0/3070590479 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f46c4066530 0x7f46c40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:38.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.653+0000 7f46e9600640 1 -- 172.21.15.49:0/3070590479 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f46dc121bb0 con 0x7f46ec0c63d0 2024-01-31T12:09:38.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.653+0000 7f46f1000640 1 --2- 172.21.15.49:0/3070590479 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f46c4066530 0x7f46c40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:38.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.657+0000 7f46f1000640 1 --2- 172.21.15.49:0/3070590479 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f46c4066530 0x7f46c40689f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f46ec070530 tx=0x7f46d4009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:38.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:38.657+0000 7f46e9600640 1 -- 172.21.15.49:0/3070590479 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f46ec0b4ee0 con 0x7f46ec0c63d0 2024-01-31T12:09:39.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.141+0000 7f46f4400640 1 -- 172.21.15.49:0/3070590479 --> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f46ec0c7350 con 0x7f46c4066530 2024-01-31T12:09:39.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.141+0000 7f46e9600640 1 -- 172.21.15.49:0/3070590479 <== mgr.4100 v2:172.21.15.195:6832/3035808172 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f46d40098c0 con 0x7f46c4066530 2024-01-31T12:09:39.141 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 4 to deep-scrub 2024-01-31T12:09:39.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.145+0000 7f46f4400640 1 -- 172.21.15.49:0/3070590479 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f46c4066530 msgr2=0x7f46c40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:39.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.145+0000 7f46f4400640 1 --2- 172.21.15.49:0/3070590479 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f46c4066530 0x7f46c40689f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f46ec070530 tx=0x7f46d4009240 comp rx=0 tx=0).stop 2024-01-31T12:09:39.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.145+0000 7f46f4400640 1 -- 172.21.15.49:0/3070590479 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46ec0c63d0 msgr2=0x7f46ec0c9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:39.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.145+0000 7f46f4400640 1 --2- 172.21.15.49:0/3070590479 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46ec0c63d0 0x7f46ec0c9f90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0b3040 tx=0x7f46dc01ba10 comp rx=0 tx=0).stop 2024-01-31T12:09:39.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.145+0000 7f46f4400640 1 -- 172.21.15.49:0/3070590479 shutdown_connections 2024-01-31T12:09:39.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.145+0000 7f46f4400640 1 --2- 172.21.15.49:0/3070590479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46ec15e7e0 0x7f46ec153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:39.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.145+0000 7f46f4400640 1 --2- 172.21.15.49:0/3070590479 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f46c4066530 0x7f46c40689f0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:39.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.145+0000 7f46f4400640 1 --2- 172.21.15.49:0/3070590479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46ec0cf4a0 0x7f46ec153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:39.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.145+0000 7f46f4400640 1 --2- 172.21.15.49:0/3070590479 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f46ec0c63d0 0x7f46ec0c9f90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:39.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.145+0000 7f46f4400640 1 -- 172.21.15.49:0/3070590479 >> 172.21.15.49:0/3070590479 conn(0x7f46ec0d0e60 msgr2=0x7f46ec0c4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:39.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.145+0000 7f46f4400640 1 -- 172.21.15.49:0/3070590479 shutdown_connections 2024-01-31T12:09:39.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.145+0000 7f46f4400640 1 -- 172.21.15.49:0/3070590479 wait complete. 2024-01-31T12:09:39.199 INFO:tasks.ceph:Scrubbing osd.5 2024-01-31T12:09:39.200 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-31T12:09:39.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.621+0000 7f560b000640 1 Processor -- start 2024-01-31T12:09:39.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.621+0000 7f560b000640 1 -- start start 2024-01-31T12:09:39.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.625+0000 7f560b000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56040cf670 0x7f56040b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:39.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.625+0000 7f560b000640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56040c6860 con 0x7f56040c63d0 2024-01-31T12:09:39.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.625+0000 7f560b000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56040c6ab0 con 0x7f560415e7e0 2024-01-31T12:09:39.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.625+0000 7f560b000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56040d1d40 con 0x7f56040cf670 2024-01-31T12:09:39.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.625+0000 7f5603e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f560415e7e0 0x7f56040cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:36480/0 (socket says 172.21.15.49:36480) 2024-01-31T12:09:39.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.625+0000 7f5603e00640 1 -- 172.21.15.49:0/4076297474 learned_addr learned my addr 172.21.15.49:0/4076297474 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:09:39.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.625+0000 7f5603400640 1 --2- 172.21.15.49:0/4076297474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56040cf670 0x7f56040b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:39.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.625+0000 7f5602a00640 1 -- 172.21.15.49:0/4076297474 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451251961 0 0) 0x7f56040c6ab0 con 0x7f560415e7e0 2024-01-31T12:09:39.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5602a00640 1 -- 172.21.15.49:0/4076297474 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e4003530 con 0x7f560415e7e0 2024-01-31T12:09:39.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5602a00640 1 -- 172.21.15.49:0/4076297474 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110126327 0 0) 0x7f56040c6860 con 0x7f56040c63d0 2024-01-31T12:09:39.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5602a00640 1 -- 172.21.15.49:0/4076297474 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56040c6ab0 con 0x7f56040c63d0 2024-01-31T12:09:39.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5602a00640 1 -- 172.21.15.49:0/4076297474 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2136152979 0 0) 0x7f55e4003530 con 0x7f560415e7e0 2024-01-31T12:09:39.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5602a00640 1 -- 172.21.15.49:0/4076297474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56040cf670 msgr2=0x7f56040b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:39.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5602a00640 1 --2- 172.21.15.49:0/4076297474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56040cf670 0x7f56040b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:39.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5602a00640 1 -- 172.21.15.49:0/4076297474 >> v1:172.21.15.49:6789/0 conn(0x7f56040c63d0 legacy=0x7f56040cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:39.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5602a00640 1 -- 172.21.15.49:0/4076297474 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56040c6d90 con 0x7f560415e7e0 2024-01-31T12:09:39.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5602a00640 1 -- 172.21.15.49:0/4076297474 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1639815202 0 0) 0x7f55f4001680 con 0x7f560415e7e0 2024-01-31T12:09:39.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5603400640 1 --2- 172.21.15.49:0/4076297474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56040cf670 0x7f56040b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T12:09:39.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5602a00640 1 -- 172.21.15.49:0/4076297474 >> v1:172.21.15.195:6789/0 conn(0x7f560415e7e0 legacy=0x7f56040cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:39.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5602a00640 1 --2- 172.21.15.49:0/4076297474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55e4003b10 0x7f55e4003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:39.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5602a00640 1 --2- 172.21.15.49:0/4076297474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e40047d0 0x7f55e4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:39.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5602a00640 1 --2- 172.21.15.49:0/4076297474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56040cf670 0x7f55e4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:39.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5602a00640 1 -- 172.21.15.49:0/4076297474 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56040d1d40 con 0x7f55e40047d0 2024-01-31T12:09:39.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5602a00640 1 -- 172.21.15.49:0/4076297474 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e400ba40 con 0x7f55e4003b10 2024-01-31T12:09:39.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5602a00640 1 -- 172.21.15.49:0/4076297474 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e400bbb0 con 0x7f56040cf670 2024-01-31T12:09:39.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5603400640 1 --2- 172.21.15.49:0/4076297474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e40047d0 0x7f55e4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:39.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5603e00640 1 --2- 172.21.15.49:0/4076297474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55e4003b10 0x7f55e4003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:39.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5609000640 1 --2- 172.21.15.49:0/4076297474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56040cf670 0x7f55e4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:39.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5603e00640 1 -- 172.21.15.49:0/4076297474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56040cf670 msgr2=0x7f55e4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:39.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5603e00640 1 --2- 172.21.15.49:0/4076297474 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56040cf670 0x7f55e4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:39.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5603e00640 1 -- 172.21.15.49:0/4076297474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e40047d0 msgr2=0x7f55e4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:39.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5603e00640 1 --2- 172.21.15.49:0/4076297474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e40047d0 0x7f55e4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:39.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.629+0000 7f5603e00640 1 -- 172.21.15.49:0/4076297474 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec009420 con 0x7f55e4003b10 2024-01-31T12:09:39.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.633+0000 7f5603e00640 1 --2- 172.21.15.49:0/4076297474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55e4003b10 0x7f55e4003f10 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f55f4001ec0 tx=0x7f55f401f210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=638647fe7ba9b966 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:39.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.633+0000 7f5602a00640 1 -- 172.21.15.49:0/4076297474 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f40a8e30 con 0x7f55e4003b10 2024-01-31T12:09:39.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.633+0000 7f5602a00640 1 -- 172.21.15.49:0/4076297474 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f40058e0 con 0x7f55e4003b10 2024-01-31T12:09:39.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.633+0000 7f5602a00640 1 -- 172.21.15.49:0/4076297474 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f4005cb0 con 0x7f55e4003b10 2024-01-31T12:09:39.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.633+0000 7f560b000640 1 -- 172.21.15.49:0/4076297474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55e4003b10 msgr2=0x7f55e4003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:39.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.633+0000 7f560b000640 1 --2- 172.21.15.49:0/4076297474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55e4003b10 0x7f55e4003f10 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f55f4001ec0 tx=0x7f55f401f210 comp rx=0 tx=0).stop 2024-01-31T12:09:39.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.633+0000 7f5609000640 1 -- 172.21.15.49:0/4076297474 reap_dead start 2024-01-31T12:09:39.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.633+0000 7f560b000640 1 -- 172.21.15.49:0/4076297474 shutdown_connections 2024-01-31T12:09:39.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.633+0000 7f560b000640 1 -- 172.21.15.49:0/4076297474 >> 172.21.15.49:0/4076297474 conn(0x7f56040d0e60 msgr2=0x7f56040d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:39.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.637+0000 7f560b000640 1 -- 172.21.15.49:0/4076297474 shutdown_connections 2024-01-31T12:09:39.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.637+0000 7f560b000640 1 -- 172.21.15.49:0/4076297474 wait complete. 2024-01-31T12:09:39.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.641+0000 7f560b000640 1 Processor -- start 2024-01-31T12:09:39.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.641+0000 7f560b000640 1 -- start start 2024-01-31T12:09:39.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f560b000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e4003b10 0x7f560415a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:39.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f560b000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56041f3e10 0x7f560406bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:39.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f560b000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f560406c500 0x7f56041f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:39.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f560b000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560406c9b0 con 0x7f55e4003b10 2024-01-31T12:09:39.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f560b000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56041f3c20 con 0x7f560406c500 2024-01-31T12:09:39.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f560b000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56040c9590 con 0x7f56041f3e10 2024-01-31T12:09:39.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f5603e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e4003b10 0x7f560415a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:39.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f5603e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e4003b10 0x7f560415a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41838/0 (socket says 172.21.15.49:41838) 2024-01-31T12:09:39.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f5603e00640 1 -- 172.21.15.49:0/1965662274 learned_addr learned my addr 172.21.15.49:0/1965662274 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:39.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f5603400640 1 --2- 172.21.15.49:0/1965662274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56041f3e10 0x7f560406bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:39.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f5603e00640 1 -- 172.21.15.49:0/1965662274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56041f3e10 msgr2=0x7f560406bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:39.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f5603e00640 1 --2- 172.21.15.49:0/1965662274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56041f3e10 0x7f560406bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:39.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f5603e00640 1 -- 172.21.15.49:0/1965662274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f560406c500 msgr2=0x7f56041f2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:39.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f5609000640 1 --2- 172.21.15.49:0/1965662274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f560406c500 0x7f56041f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:39.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f5603e00640 1 --2- 172.21.15.49:0/1965662274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f560406c500 0x7f56041f2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:39.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f5603e00640 1 -- 172.21.15.49:0/1965662274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56040c9870 con 0x7f55e4003b10 2024-01-31T12:09:39.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f5603400640 1 --2- 172.21.15.49:0/1965662274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56041f3e10 0x7f560406bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T12:09:39.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f5609000640 1 --2- 172.21.15.49:0/1965662274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f560406c500 0x7f56041f2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T12:09:39.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f5603e00640 1 --2- 172.21.15.49:0/1965662274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e4003b10 0x7f560415a3f0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f55f4001ec0 tx=0x7f55e4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:39.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f55fbe00640 1 -- 172.21.15.49:0/1965662274 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f40b7070 con 0x7f55e4003b10 2024-01-31T12:09:39.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f55fbe00640 1 -- 172.21.15.49:0/1965662274 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f4001480 con 0x7f55e4003b10 2024-01-31T12:09:39.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f560b000640 1 -- 172.21.15.49:0/1965662274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56040c9b50 con 0x7f55e4003b10 2024-01-31T12:09:39.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f55fbe00640 1 -- 172.21.15.49:0/1965662274 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f4007290 con 0x7f55e4003b10 2024-01-31T12:09:39.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.645+0000 7f560b000640 1 -- 172.21.15.49:0/1965662274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560415a930 con 0x7f55e4003b10 2024-01-31T12:09:39.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.649+0000 7f560b000640 1 -- 172.21.15.49:0/1965662274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f56040c7630 con 0x7f55e4003b10 2024-01-31T12:09:39.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.665+0000 7f55fbe00640 1 -- 172.21.15.49:0/1965662274 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f55f40073f0 con 0x7f55e4003b10 2024-01-31T12:09:39.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.665+0000 7f55fbe00640 1 --2- 172.21.15.49:0/1965662274 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f55dc066530 0x7f55dc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:39.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.665+0000 7f55fbe00640 1 -- 172.21.15.49:0/1965662274 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f55f41212f0 con 0x7f55e4003b10 2024-01-31T12:09:39.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.665+0000 7f5603400640 1 --2- 172.21.15.49:0/1965662274 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f55dc066530 0x7f55dc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:39.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.665+0000 7f55fbe00640 1 --2- 172.21.15.49:0/1965662274 >> [v2:172.21.15.195:6800/578985434,v1:172.21.15.195:6801/578985434] conn(0x7f55dc06c830 0x7f55dc06ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:39.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.665+0000 7f55fbe00640 1 -- 172.21.15.49:0/1965662274 --> [v2:172.21.15.195:6800/578985434,v1:172.21.15.195:6801/578985434] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f55dc06f340 con 0x7f55dc06c830 2024-01-31T12:09:39.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.665+0000 7f55fbe00640 1 -- 172.21.15.49:0/1965662274 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55f41216a0 con 0x7f55e4003b10 2024-01-31T12:09:39.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.669+0000 7f5609000640 1 --2- 172.21.15.49:0/1965662274 >> [v2:172.21.15.195:6800/578985434,v1:172.21.15.195:6801/578985434] conn(0x7f55dc06c830 0x7f55dc06ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:39.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.669+0000 7f5603400640 1 --2- 172.21.15.49:0/1965662274 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f55dc066530 0x7f55dc0689f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f56041f61a0 tx=0x7f55ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:39.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.669+0000 7f5609000640 1 --2- 172.21.15.49:0/1965662274 >> [v2:172.21.15.195:6800/578985434,v1:172.21.15.195:6801/578985434] conn(0x7f55dc06c830 0x7f55dc06ec70 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:39.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.785+0000 7f55fbe00640 1 -- 172.21.15.49:0/1965662274 <== osd.5 v2:172.21.15.195:6800/578985434 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f55dc06f340 con 0x7f55dc06c830 2024-01-31T12:09:39.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.825+0000 7f560b000640 1 -- 172.21.15.49:0/1965662274 --> [v2:172.21.15.195:6800/578985434,v1:172.21.15.195:6801/578985434] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f56040c7350 con 0x7f55dc06c830 2024-01-31T12:09:39.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.837+0000 7f55fbe00640 1 -- 172.21.15.49:0/1965662274 <== osd.5 v2:172.21.15.195:6800/578985434 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f55fc00d040 con 0x7f55dc06c830 2024-01-31T12:09:39.837 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-31T12:09:39.837 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-31T12:09:39.838 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-31T12:09:39.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.837+0000 7f560b000640 1 -- 172.21.15.49:0/1965662274 >> [v2:172.21.15.195:6800/578985434,v1:172.21.15.195:6801/578985434] conn(0x7f55dc06c830 msgr2=0x7f55dc06ec70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:39.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.837+0000 7f560b000640 1 --2- 172.21.15.49:0/1965662274 >> [v2:172.21.15.195:6800/578985434,v1:172.21.15.195:6801/578985434] conn(0x7f55dc06c830 0x7f55dc06ec70 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:39.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.837+0000 7f560b000640 1 -- 172.21.15.49:0/1965662274 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f55dc066530 msgr2=0x7f55dc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:39.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.837+0000 7f560b000640 1 --2- 172.21.15.49:0/1965662274 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f55dc066530 0x7f55dc0689f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f56041f61a0 tx=0x7f55ec008040 comp rx=0 tx=0).stop 2024-01-31T12:09:39.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.837+0000 7f560b000640 1 -- 172.21.15.49:0/1965662274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e4003b10 msgr2=0x7f560415a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:39.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.837+0000 7f560b000640 1 --2- 172.21.15.49:0/1965662274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55e4003b10 0x7f560415a3f0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f55f4001ec0 tx=0x7f55e4005800 comp rx=0 tx=0).stop 2024-01-31T12:09:39.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.837+0000 7f5609000640 1 -- 172.21.15.49:0/1965662274 reap_dead start 2024-01-31T12:09:39.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.837+0000 7f560b000640 1 -- 172.21.15.49:0/1965662274 shutdown_connections 2024-01-31T12:09:39.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.837+0000 7f560b000640 1 -- 172.21.15.49:0/1965662274 >> 172.21.15.49:0/1965662274 conn(0x7f56040d0e60 msgr2=0x7f56040cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:39.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.837+0000 7f560b000640 1 -- 172.21.15.49:0/1965662274 shutdown_connections 2024-01-31T12:09:39.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:39.837+0000 7f560b000640 1 -- 172.21.15.49:0/1965662274 wait complete. 2024-01-31T12:09:39.888 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-31T12:09:40.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.301+0000 7fcc4c000640 1 Processor -- start 2024-01-31T12:09:40.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.301+0000 7fcc4c000640 1 -- start start 2024-01-31T12:09:40.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.305+0000 7fcc4c000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc441579c0 0x7fcc4415ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:40.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.305+0000 7fcc4c000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcc4406cbc0 0x7fcc44070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:40.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.305+0000 7fcc4c000640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc44071550 con 0x7fcc44071100 2024-01-31T12:09:40.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.305+0000 7fcc4c000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc44157da0 con 0x7fcc4406cbc0 2024-01-31T12:09:40.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.305+0000 7fcc4c000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4406d180 con 0x7fcc441579c0 2024-01-31T12:09:40.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.305+0000 7fcc49600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc441579c0 0x7fcc4415ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:40.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.305+0000 7fcc4a000640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fcc44071100 0x7fcc4415d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51460/0 (socket says 172.21.15.49:51460) 2024-01-31T12:09:40.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.305+0000 7fcc4a000640 1 -- 172.21.15.49:0/492750826 learned_addr learned my addr 172.21.15.49:0/492750826 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:09:40.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.305+0000 7fcc48c00640 1 --2- 172.21.15.49:0/492750826 >> v2:172.21.15.49:3300/0 conn(0x7fcc4406cbc0 0x7fcc44070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:40.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.305+0000 7fcc49600640 1 -- 172.21.15.49:0/492750826 >> v2:172.21.15.49:3300/0 conn(0x7fcc4406cbc0 msgr2=0x7fcc44070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:40.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.305+0000 7fcc43e00640 1 -- 172.21.15.49:0/492750826 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295427022 0 0) 0x7fcc34001120 con 0x7fcc44071100 2024-01-31T12:09:40.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.305+0000 7fcc49600640 1 --2- 172.21.15.49:0/492750826 >> v2:172.21.15.49:3300/0 conn(0x7fcc4406cbc0 0x7fcc44070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:40.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.305+0000 7fcc49600640 1 -- 172.21.15.49:0/492750826 >> v1:172.21.15.49:6789/0 conn(0x7fcc44071100 legacy=0x7fcc4415d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:40.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.305+0000 7fcc49600640 1 -- 172.21.15.49:0/492750826 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4406d460 con 0x7fcc441579c0 2024-01-31T12:09:40.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.313+0000 7fcc49600640 1 --2- 172.21.15.49:0/492750826 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc441579c0 0x7fcc4415ae50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0097c0 tx=0x7fcc2c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=900fd6093f1cd8ea server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:40.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.313+0000 7fcc43e00640 1 -- 172.21.15.49:0/492750826 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c0ad640 con 0x7fcc441579c0 2024-01-31T12:09:40.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.313+0000 7fcc43e00640 1 -- 172.21.15.49:0/492750826 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2c0ad7a0 con 0x7fcc441579c0 2024-01-31T12:09:40.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.313+0000 7fcc43e00640 1 -- 172.21.15.49:0/492750826 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c0adb30 con 0x7fcc441579c0 2024-01-31T12:09:40.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.317+0000 7fcc4c000640 1 -- 172.21.15.49:0/492750826 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc441579c0 msgr2=0x7fcc4415ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:40.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.317+0000 7fcc4c000640 1 --2- 172.21.15.49:0/492750826 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc441579c0 0x7fcc4415ae50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0097c0 tx=0x7fcc2c01c480 comp rx=0 tx=0).stop 2024-01-31T12:09:40.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.317+0000 7fcc4c000640 1 -- 172.21.15.49:0/492750826 shutdown_connections 2024-01-31T12:09:40.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.317+0000 7fcc4c000640 1 --2- 172.21.15.49:0/492750826 >> v2:172.21.15.49:3300/0 conn(0x7fcc4406cbc0 0x7fcc44070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:40.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.317+0000 7fcc4c000640 1 --2- 172.21.15.49:0/492750826 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc441579c0 0x7fcc4415ae50 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:40.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.317+0000 7fcc4c000640 1 -- 172.21.15.49:0/492750826 >> 172.21.15.49:0/492750826 conn(0x7fcc440668d0 msgr2=0x7fcc4406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:40.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.317+0000 7fcc4c000640 1 -- 172.21.15.49:0/492750826 shutdown_connections 2024-01-31T12:09:40.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.317+0000 7fcc4c000640 1 -- 172.21.15.49:0/492750826 wait complete. 2024-01-31T12:09:40.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.321+0000 7fcc4c000640 1 Processor -- start 2024-01-31T12:09:40.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.321+0000 7fcc4c000640 1 -- start start 2024-01-31T12:09:40.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc4c000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc4406cbc0 0x7fcc440afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:40.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc4c000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc44071100 0x7fcc44152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:40.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc4c000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc441579c0 0x7fcc440b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:40.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc4c000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440b0100 con 0x7fcc44071100 2024-01-31T12:09:40.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc4c000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440b1250 con 0x7fcc441579c0 2024-01-31T12:09:40.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc4c000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440b1530 con 0x7fcc4406cbc0 2024-01-31T12:09:40.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc4a000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc441579c0 0x7fcc440b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:40.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc4a000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc441579c0 0x7fcc440b07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:42830/0 (socket says 172.21.15.49:42830) 2024-01-31T12:09:40.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc4a000640 1 -- 172.21.15.49:0/1902656424 learned_addr learned my addr 172.21.15.49:0/1902656424 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:40.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc49600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc4406cbc0 0x7fcc440afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:40.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc48c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc44071100 0x7fcc44152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:40.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc4a000640 1 -- 172.21.15.49:0/1902656424 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc4406cbc0 msgr2=0x7fcc440afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:40.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc4a000640 1 --2- 172.21.15.49:0/1902656424 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc4406cbc0 0x7fcc440afbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc4a000640 1 -- 172.21.15.49:0/1902656424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc44071100 msgr2=0x7fcc44152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc4a000640 1 --2- 172.21.15.49:0/1902656424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc44071100 0x7fcc44152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc4a000640 1 -- 172.21.15.49:0/1902656424 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2c009420 con 0x7fcc441579c0 2024-01-31T12:09:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc48c00640 1 --2- 172.21.15.49:0/1902656424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc44071100 0x7fcc44152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T12:09:40.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc4a000640 1 --2- 172.21.15.49:0/1902656424 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc441579c0 0x7fcc440b07d0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400c7b0 tx=0x7fcc3400cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:40.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc41600640 1 -- 172.21.15.49:0/1902656424 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc340072d0 con 0x7fcc441579c0 2024-01-31T12:09:40.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc41600640 1 -- 172.21.15.49:0/1902656424 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc34007430 con 0x7fcc441579c0 2024-01-31T12:09:40.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc41600640 1 -- 172.21.15.49:0/1902656424 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc34001d20 con 0x7fcc441579c0 2024-01-31T12:09:40.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc4c000640 1 -- 172.21.15.49:0/1902656424 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc440af0e0 con 0x7fcc441579c0 2024-01-31T12:09:40.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.325+0000 7fcc4c000640 1 -- 172.21.15.49:0/1902656424 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc440af6a0 con 0x7fcc441579c0 2024-01-31T12:09:40.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.329+0000 7fcc4c000640 1 -- 172.21.15.49:0/1902656424 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc440b2310 con 0x7fcc441579c0 2024-01-31T12:09:40.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.329+0000 7fcc41600640 1 -- 172.21.15.49:0/1902656424 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fcc340047f0 con 0x7fcc441579c0 2024-01-31T12:09:40.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.333+0000 7fcc41600640 1 --2- 172.21.15.49:0/1902656424 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcc1c066500 0x7fcc1c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:40.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.333+0000 7fcc41600640 1 -- 172.21.15.49:0/1902656424 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fcc34082ee0 con 0x7fcc441579c0 2024-01-31T12:09:40.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.333+0000 7fcc49600640 1 --2- 172.21.15.49:0/1902656424 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcc1c066500 0x7fcc1c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:40.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.333+0000 7fcc49600640 1 --2- 172.21.15.49:0/1902656424 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcc1c066500 0x7fcc1c0689c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0af000 tx=0x7fcc2c0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:40.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.337+0000 7fcc41600640 1 -- 172.21.15.49:0/1902656424 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fcc340503e0 con 0x7fcc441579c0 2024-01-31T12:09:40.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.821+0000 7fcc4c000640 1 -- 172.21.15.49:0/1902656424 --> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc44071550 con 0x7fcc1c066500 2024-01-31T12:09:40.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.821+0000 7fcc41600640 1 -- 172.21.15.49:0/1902656424 <== mgr.4100 v2:172.21.15.195:6832/3035808172 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcc44071550 con 0x7fcc1c066500 2024-01-31T12:09:40.822 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 5 to deep-scrub 2024-01-31T12:09:40.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.825+0000 7fcc4c000640 1 -- 172.21.15.49:0/1902656424 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcc1c066500 msgr2=0x7fcc1c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:40.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.825+0000 7fcc4c000640 1 --2- 172.21.15.49:0/1902656424 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcc1c066500 0x7fcc1c0689c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0af000 tx=0x7fcc2c0a7070 comp rx=0 tx=0).stop 2024-01-31T12:09:40.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.825+0000 7fcc4c000640 1 -- 172.21.15.49:0/1902656424 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc441579c0 msgr2=0x7fcc440b07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:40.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.825+0000 7fcc4c000640 1 --2- 172.21.15.49:0/1902656424 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc441579c0 0x7fcc440b07d0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400c7b0 tx=0x7fcc3400cc70 comp rx=0 tx=0).stop 2024-01-31T12:09:40.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.825+0000 7fcc4c000640 1 -- 172.21.15.49:0/1902656424 shutdown_connections 2024-01-31T12:09:40.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.825+0000 7fcc4c000640 1 --2- 172.21.15.49:0/1902656424 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcc1c066500 0x7fcc1c0689c0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:40.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.825+0000 7fcc4c000640 1 --2- 172.21.15.49:0/1902656424 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc441579c0 0x7fcc440b07d0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:40.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.825+0000 7fcc4c000640 1 --2- 172.21.15.49:0/1902656424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc44071100 0x7fcc44152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:40.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.825+0000 7fcc4c000640 1 --2- 172.21.15.49:0/1902656424 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc4406cbc0 0x7fcc440afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:40.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.825+0000 7fcc4c000640 1 -- 172.21.15.49:0/1902656424 >> 172.21.15.49:0/1902656424 conn(0x7fcc440668d0 msgr2=0x7fcc440cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:40.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.825+0000 7fcc4c000640 1 -- 172.21.15.49:0/1902656424 shutdown_connections 2024-01-31T12:09:40.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:40.825+0000 7fcc4c000640 1 -- 172.21.15.49:0/1902656424 wait complete. 2024-01-31T12:09:40.879 INFO:tasks.ceph:Scrubbing osd.6 2024-01-31T12:09:40.879 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-31T12:09:41.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.301+0000 7f8610000640 1 Processor -- start 2024-01-31T12:09:41.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.301+0000 7f8610000640 1 -- start start 2024-01-31T12:09:41.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.305+0000 7f8610000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86080c3e30 0x7f86080b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:41.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.305+0000 7f8610000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f86080c4210 0x7f86080cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:41.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.305+0000 7f8610000640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86080b0da0 con 0x7f86080d1980 2024-01-31T12:09:41.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.305+0000 7f8610000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860806c060 con 0x7f86080c4210 2024-01-31T12:09:41.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.305+0000 7f8610000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86080b0470 con 0x7f86080c3e30 2024-01-31T12:09:41.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.305+0000 7f860e000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f86080c4210 0x7f86080cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:41.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.305+0000 7f860e000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f86080c4210 0x7f86080cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:42838/0 (socket says 172.21.15.49:42838) 2024-01-31T12:09:41.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.305+0000 7f860e000640 1 -- 172.21.15.49:0/2422035415 learned_addr learned my addr 172.21.15.49:0/2422035415 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:41.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.305+0000 7f860d600640 1 --2- 172.21.15.49:0/2422035415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86080c3e30 0x7f86080b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:41.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.305+0000 7f860e000640 1 -- 172.21.15.49:0/2422035415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86080c3e30 msgr2=0x7f86080b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:41.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.305+0000 7f860e000640 1 --2- 172.21.15.49:0/2422035415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86080c3e30 0x7f86080b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:41.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.305+0000 7f860e000640 1 -- 172.21.15.49:0/2422035415 >> v1:172.21.15.49:6789/0 conn(0x7f86080d1980 legacy=0x7f860806b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:41.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.305+0000 7f860e000640 1 -- 172.21.15.49:0/2422035415 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86080b0750 con 0x7f86080c4210 2024-01-31T12:09:41.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.309+0000 7f860e000640 1 --2- 172.21.15.49:0/2422035415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86080c4210 0x7f86080cb4b0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009e50 tx=0x7f85f801c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc54f07c07a059ed server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:41.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.309+0000 7f8607e00640 1 -- 172.21.15.49:0/2422035415 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86080cc200 con 0x7f86080c4210 2024-01-31T12:09:41.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.309+0000 7f8607e00640 1 -- 172.21.15.49:0/2422035415 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f80a56a0 con 0x7f86080c4210 2024-01-31T12:09:41.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.309+0000 7f8607e00640 1 -- 172.21.15.49:0/2422035415 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f80a5a30 con 0x7f86080c4210 2024-01-31T12:09:41.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.309+0000 7f8610000640 1 -- 172.21.15.49:0/2422035415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86080c4210 msgr2=0x7f86080cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:41.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.309+0000 7f8610000640 1 --2- 172.21.15.49:0/2422035415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86080c4210 0x7f86080cb4b0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009e50 tx=0x7f85f801c9d0 comp rx=0 tx=0).stop 2024-01-31T12:09:41.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.309+0000 7f8610000640 1 -- 172.21.15.49:0/2422035415 shutdown_connections 2024-01-31T12:09:41.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.309+0000 7f8610000640 1 --2- 172.21.15.49:0/2422035415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86080c4210 0x7f86080cb4b0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:41.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.309+0000 7f8610000640 1 --2- 172.21.15.49:0/2422035415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86080c3e30 0x7f86080b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:41.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.309+0000 7f8610000640 1 -- 172.21.15.49:0/2422035415 >> 172.21.15.49:0/2422035415 conn(0x7f86080d0e60 msgr2=0x7f86080d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:41.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.309+0000 7f8610000640 1 -- 172.21.15.49:0/2422035415 shutdown_connections 2024-01-31T12:09:41.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.309+0000 7f8610000640 1 -- 172.21.15.49:0/2422035415 wait complete. 2024-01-31T12:09:41.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.313+0000 7f8610000640 1 Processor -- start 2024-01-31T12:09:41.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.317+0000 7f8610000640 1 -- start start 2024-01-31T12:09:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.317+0000 7f8610000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86080c3e30 0x7f86080af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.317+0000 7f8610000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86080c4210 0x7f86080ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.317+0000 7f8610000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86080d1980 0x7f86080ced30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.317+0000 7f8610000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8608155c30 con 0x7f86080d1980 2024-01-31T12:09:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.317+0000 7f8610000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8608155290 con 0x7f86080c3e30 2024-01-31T12:09:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.317+0000 7f8610000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8608155570 con 0x7f86080c4210 2024-01-31T12:09:41.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.317+0000 7f860d600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86080c3e30 0x7f86080af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:41.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.317+0000 7f860d600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86080c3e30 0x7f86080af6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:42850/0 (socket says 172.21.15.49:42850) 2024-01-31T12:09:41.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.317+0000 7f860cc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86080c4210 0x7f86080ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:41.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.317+0000 7f860d600640 1 -- 172.21.15.49:0/1256759145 learned_addr learned my addr 172.21.15.49:0/1256759145 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:41.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.317+0000 7f860e000640 1 --2- 172.21.15.49:0/1256759145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86080d1980 0x7f86080ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:41.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.321+0000 7f860d600640 1 -- 172.21.15.49:0/1256759145 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86080c4210 msgr2=0x7f86080ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:41.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.321+0000 7f860d600640 1 --2- 172.21.15.49:0/1256759145 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86080c4210 0x7f86080ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:41.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.321+0000 7f860d600640 1 -- 172.21.15.49:0/1256759145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86080d1980 msgr2=0x7f86080ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:41.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.321+0000 7f860d600640 1 --2- 172.21.15.49:0/1256759145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86080d1980 0x7f86080ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:41.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.321+0000 7f860d600640 1 -- 172.21.15.49:0/1256759145 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f8009b30 con 0x7f86080c3e30 2024-01-31T12:09:41.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.321+0000 7f860cc00640 1 --2- 172.21.15.49:0/1256759145 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86080c4210 0x7f86080ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T12:09:41.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.321+0000 7f860d600640 1 --2- 172.21.15.49:0/1256759145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86080c3e30 0x7f86080af6c0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f85f000d5f0 tx=0x7f85f000dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:41.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.321+0000 7f8605600640 1 -- 172.21.15.49:0/1256759145 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f00125f0 con 0x7f86080c3e30 2024-01-31T12:09:41.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.321+0000 7f8605600640 1 -- 172.21.15.49:0/1256759145 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f0012750 con 0x7f86080c3e30 2024-01-31T12:09:41.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.321+0000 7f8605600640 1 -- 172.21.15.49:0/1256759145 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0012ae0 con 0x7f86080c3e30 2024-01-31T12:09:41.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.321+0000 7f8610000640 1 -- 172.21.15.49:0/1256759145 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8608155850 con 0x7f86080c3e30 2024-01-31T12:09:41.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.321+0000 7f8610000640 1 -- 172.21.15.49:0/1256759145 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86080afc00 con 0x7f86080c3e30 2024-01-31T12:09:41.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.325+0000 7f8610000640 1 -- 172.21.15.49:0/1256759145 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8608074860 con 0x7f86080c3e30 2024-01-31T12:09:41.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.325+0000 7f8605600640 1 -- 172.21.15.49:0/1256759145 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f85f0012c40 con 0x7f86080c3e30 2024-01-31T12:09:41.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.329+0000 7f8605600640 1 --2- 172.21.15.49:0/1256759145 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f85e0066550 0x7f85e0068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:41.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.329+0000 7f8605600640 1 -- 172.21.15.49:0/1256759145 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f85f0083ef0 con 0x7f86080c3e30 2024-01-31T12:09:41.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.329+0000 7f860cc00640 1 --2- 172.21.15.49:0/1256759145 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f85e0066550 0x7f85e0068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:41.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.329+0000 7f8605600640 1 --2- 172.21.15.49:0/1256759145 >> [v2:172.21.15.195:6806/2294396668,v1:172.21.15.195:6808/2294396668] conn(0x7f85e006c850 0x7f85e006ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:41.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.329+0000 7f8605600640 1 -- 172.21.15.49:0/1256759145 --> [v2:172.21.15.195:6806/2294396668,v1:172.21.15.195:6808/2294396668] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f85e006f360 con 0x7f85e006c850 2024-01-31T12:09:41.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.329+0000 7f8605600640 1 -- 172.21.15.49:0/1256759145 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85f0086600 con 0x7f86080c3e30 2024-01-31T12:09:41.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.329+0000 7f860e000640 1 --2- 172.21.15.49:0/1256759145 >> [v2:172.21.15.195:6806/2294396668,v1:172.21.15.195:6808/2294396668] conn(0x7f85e006c850 0x7f85e006ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.329+0000 7f860cc00640 1 --2- 172.21.15.49:0/1256759145 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f85e0066550 0x7f85e0068a10 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f8608152140 tx=0x7f8600007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:41.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.329+0000 7f860e000640 1 --2- 172.21.15.49:0/1256759145 >> [v2:172.21.15.195:6806/2294396668,v1:172.21.15.195:6808/2294396668] conn(0x7f85e006c850 0x7f85e006ec90 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:41.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.457+0000 7f8605600640 1 -- 172.21.15.49:0/1256759145 <== osd.6 v2:172.21.15.195:6806/2294396668 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f85e006f360 con 0x7f85e006c850 2024-01-31T12:09:41.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.497+0000 7f8610000640 1 -- 172.21.15.49:0/1256759145 --> [v2:172.21.15.195:6806/2294396668,v1:172.21.15.195:6808/2294396668] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f86081553d0 con 0x7f85e006c850 2024-01-31T12:09:41.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.509+0000 7f8605600640 1 -- 172.21.15.49:0/1256759145 <== osd.6 v2:172.21.15.195:6806/2294396668 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f86081553d0 con 0x7f85e006c850 2024-01-31T12:09:41.509 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-31T12:09:41.509 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-31T12:09:41.509 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-31T12:09:41.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.509+0000 7f8610000640 1 -- 172.21.15.49:0/1256759145 >> [v2:172.21.15.195:6806/2294396668,v1:172.21.15.195:6808/2294396668] conn(0x7f85e006c850 msgr2=0x7f85e006ec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:41.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.509+0000 7f8610000640 1 --2- 172.21.15.49:0/1256759145 >> [v2:172.21.15.195:6806/2294396668,v1:172.21.15.195:6808/2294396668] conn(0x7f85e006c850 0x7f85e006ec90 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:41.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.509+0000 7f8610000640 1 -- 172.21.15.49:0/1256759145 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f85e0066550 msgr2=0x7f85e0068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:41.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.509+0000 7f8610000640 1 --2- 172.21.15.49:0/1256759145 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f85e0066550 0x7f85e0068a10 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f8608152140 tx=0x7f8600007e40 comp rx=0 tx=0).stop 2024-01-31T12:09:41.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.509+0000 7f8610000640 1 -- 172.21.15.49:0/1256759145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86080c3e30 msgr2=0x7f86080af6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:41.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.509+0000 7f8610000640 1 --2- 172.21.15.49:0/1256759145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86080c3e30 0x7f86080af6c0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f85f000d5f0 tx=0x7f85f000dab0 comp rx=0 tx=0).stop 2024-01-31T12:09:41.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.509+0000 7f860e000640 1 -- 172.21.15.49:0/1256759145 reap_dead start 2024-01-31T12:09:41.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.509+0000 7f8610000640 1 -- 172.21.15.49:0/1256759145 shutdown_connections 2024-01-31T12:09:41.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.509+0000 7f8610000640 1 -- 172.21.15.49:0/1256759145 >> 172.21.15.49:0/1256759145 conn(0x7f86080d0e60 msgr2=0x7f86080cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:41.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.509+0000 7f8610000640 1 -- 172.21.15.49:0/1256759145 shutdown_connections 2024-01-31T12:09:41.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.509+0000 7f8610000640 1 -- 172.21.15.49:0/1256759145 wait complete. 2024-01-31T12:09:41.560 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-31T12:09:41.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.969+0000 7f1de6000640 1 Processor -- start 2024-01-31T12:09:41.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.969+0000 7f1de6000640 1 -- start start 2024-01-31T12:09:41.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.973+0000 7f1de6000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1de006fe70 0x7f1de006e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:41.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.973+0000 7f1de6000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1de00703c0 0x7f1de006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:41.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.973+0000 7f1de6000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de00d1e00 con 0x7f1de015e770 2024-01-31T12:09:41.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.973+0000 7f1de6000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de006fcc0 con 0x7f1de00703c0 2024-01-31T12:09:41.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.973+0000 7f1de6000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de006f6a0 con 0x7f1de006fe70 2024-01-31T12:09:41.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.973+0000 7f1ddea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1de006fe70 0x7f1de006e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:41.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.973+0000 7f1ddea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1de006fe70 0x7f1de006e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:58008/0 (socket says 172.21.15.49:58008) 2024-01-31T12:09:41.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.973+0000 7f1ddea00640 1 -- 172.21.15.49:0/1017452534 learned_addr learned my addr 172.21.15.49:0/1017452534 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:41.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.973+0000 7f1ddfe00640 1 --2- 172.21.15.49:0/1017452534 >> v2:172.21.15.195:3300/0 conn(0x7f1de00703c0 0x7f1de006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:41.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.973+0000 7f1ddea00640 1 -- 172.21.15.49:0/1017452534 >> v2:172.21.15.195:3300/0 conn(0x7f1de00703c0 msgr2=0x7f1de006eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:41.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.973+0000 7f1ddea00640 1 --2- 172.21.15.49:0/1017452534 >> v2:172.21.15.195:3300/0 conn(0x7f1de00703c0 0x7f1de006eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:41.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.973+0000 7f1ddea00640 1 -- 172.21.15.49:0/1017452534 >> v1:172.21.15.195:6789/0 conn(0x7f1de015e770 legacy=0x7f1de00cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:41.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.973+0000 7f1ddea00640 1 -- 172.21.15.49:0/1017452534 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de00cf220 con 0x7f1de006fe70 2024-01-31T12:09:41.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.977+0000 7f1ddea00640 1 --2- 172.21.15.49:0/1017452534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1de006fe70 0x7f1de006e5f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8009870 tx=0x7f1dc801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72f00be38f7a9867 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:41.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.977+0000 7f1dde000640 1 -- 172.21.15.49:0/1017452534 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80ab600 con 0x7f1de006fe70 2024-01-31T12:09:41.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.977+0000 7f1dde000640 1 -- 172.21.15.49:0/1017452534 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc80a7050 con 0x7f1de006fe70 2024-01-31T12:09:41.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.977+0000 7f1dde000640 1 -- 172.21.15.49:0/1017452534 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80ab980 con 0x7f1de006fe70 2024-01-31T12:09:41.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.977+0000 7f1de6000640 1 -- 172.21.15.49:0/1017452534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1de006fe70 msgr2=0x7f1de006e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:41.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.977+0000 7f1de6000640 1 --2- 172.21.15.49:0/1017452534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1de006fe70 0x7f1de006e5f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8009870 tx=0x7f1dc801c540 comp rx=0 tx=0).stop 2024-01-31T12:09:41.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.981+0000 7f1de6000640 1 -- 172.21.15.49:0/1017452534 shutdown_connections 2024-01-31T12:09:41.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.981+0000 7f1de6000640 1 --2- 172.21.15.49:0/1017452534 >> v2:172.21.15.195:3300/0 conn(0x7f1de00703c0 0x7f1de006eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:41.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.981+0000 7f1de6000640 1 --2- 172.21.15.49:0/1017452534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1de006fe70 0x7f1de006e5f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:41.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.981+0000 7f1de6000640 1 -- 172.21.15.49:0/1017452534 >> 172.21.15.49:0/1017452534 conn(0x7f1de00d0e60 msgr2=0x7f1de00d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:41.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.981+0000 7f1de6000640 1 -- 172.21.15.49:0/1017452534 shutdown_connections 2024-01-31T12:09:41.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.981+0000 7f1de6000640 1 -- 172.21.15.49:0/1017452534 wait complete. 2024-01-31T12:09:41.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.985+0000 7f1de6000640 1 Processor -- start 2024-01-31T12:09:41.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.985+0000 7f1de6000640 1 -- start start 2024-01-31T12:09:41.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1de6000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1de006fe70 0x7f1de014cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:41.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1de6000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1de00703c0 0x7f1de015c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:41.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1de6000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1de015e770 0x7f1de006be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:41.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1de6000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de015c070 con 0x7f1de00703c0 2024-01-31T12:09:41.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1de6000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de015b460 con 0x7f1de015e770 2024-01-31T12:09:41.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1de6000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de015b740 con 0x7f1de006fe70 2024-01-31T12:09:41.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1ddea00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1de00703c0 0x7f1de015c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:41.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1ddf400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1de006fe70 0x7f1de014cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:41.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1ddea00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1de00703c0 0x7f1de015c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41866/0 (socket says 172.21.15.49:41866) 2024-01-31T12:09:41.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1ddf400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1de006fe70 0x7f1de014cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:58016/0 (socket says 172.21.15.49:58016) 2024-01-31T12:09:41.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1ddea00640 1 -- 172.21.15.49:0/986907162 learned_addr learned my addr 172.21.15.49:0/986907162 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:41.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1ddfe00640 1 --2- 172.21.15.49:0/986907162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1de015e770 0x7f1de006be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:41.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1ddea00640 1 -- 172.21.15.49:0/986907162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1de006fe70 msgr2=0x7f1de014cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:41.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1ddea00640 1 --2- 172.21.15.49:0/986907162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1de006fe70 0x7f1de014cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:41.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1ddea00640 1 -- 172.21.15.49:0/986907162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1de015e770 msgr2=0x7f1de006be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:41.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1ddea00640 1 --2- 172.21.15.49:0/986907162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1de015e770 0x7f1de006be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:41.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1ddea00640 1 -- 172.21.15.49:0/986907162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc80094d0 con 0x7f1de00703c0 2024-01-31T12:09:41.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1ddf400640 1 --2- 172.21.15.49:0/986907162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1de006fe70 0x7f1de014cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T12:09:41.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1ddfe00640 1 --2- 172.21.15.49:0/986907162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1de015e770 0x7f1de006be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T12:09:41.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1ddea00640 1 --2- 172.21.15.49:0/986907162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1de00703c0 0x7f1de015c5a0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f1dc801abf0 tx=0x7f1dc80192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:41.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1dd7400640 1 -- 172.21.15.49:0/986907162 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80b6640 con 0x7f1de00703c0 2024-01-31T12:09:41.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1dd7400640 1 -- 172.21.15.49:0/986907162 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc80b67c0 con 0x7f1de00703c0 2024-01-31T12:09:41.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1dd7400640 1 -- 172.21.15.49:0/986907162 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80b6b70 con 0x7f1de00703c0 2024-01-31T12:09:41.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1de6000640 1 -- 172.21.15.49:0/986907162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de015ba20 con 0x7f1de00703c0 2024-01-31T12:09:41.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.989+0000 7f1de6000640 1 -- 172.21.15.49:0/986907162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de014d4c0 con 0x7f1de00703c0 2024-01-31T12:09:41.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.993+0000 7f1de6000640 1 -- 172.21.15.49:0/986907162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de015bed0 con 0x7f1de00703c0 2024-01-31T12:09:41.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.993+0000 7f1dd7400640 1 -- 172.21.15.49:0/986907162 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f1dc80b2040 con 0x7f1de00703c0 2024-01-31T12:09:41.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.993+0000 7f1dd7400640 1 --2- 172.21.15.49:0/986907162 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1db8066500 0x7f1db80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:41.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.993+0000 7f1dd7400640 1 -- 172.21.15.49:0/986907162 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1dc811d3c0 con 0x7f1de00703c0 2024-01-31T12:09:41.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.993+0000 7f1ddf400640 1 --2- 172.21.15.49:0/986907162 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1db8066500 0x7f1db80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:41.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:41.997+0000 7f1ddf400640 1 --2- 172.21.15.49:0/986907162 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1db8066500 0x7f1db80689c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1de006cb40 tx=0x7f1dd0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:42.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.009+0000 7f1dd7400640 1 -- 172.21.15.49:0/986907162 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f1de015bed0 con 0x7f1de00703c0 2024-01-31T12:09:42.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.481+0000 7f1de6000640 1 -- 172.21.15.49:0/986907162 --> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f1de00afde0 con 0x7f1db8066500 2024-01-31T12:09:42.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.485+0000 7f1dd7400640 1 -- 172.21.15.49:0/986907162 <== mgr.4100 v2:172.21.15.195:6832/3035808172 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1dd000fe00 con 0x7f1db8066500 2024-01-31T12:09:42.485 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 6 to deep-scrub 2024-01-31T12:09:42.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.489+0000 7f1de6000640 1 -- 172.21.15.49:0/986907162 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1db8066500 msgr2=0x7f1db80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:42.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.489+0000 7f1de6000640 1 --2- 172.21.15.49:0/986907162 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1db8066500 0x7f1db80689c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1de006cb40 tx=0x7f1dd0009040 comp rx=0 tx=0).stop 2024-01-31T12:09:42.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.489+0000 7f1de6000640 1 -- 172.21.15.49:0/986907162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1de00703c0 msgr2=0x7f1de015c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:42.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.489+0000 7f1de6000640 1 --2- 172.21.15.49:0/986907162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1de00703c0 0x7f1de015c5a0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f1dc801abf0 tx=0x7f1dc80192e0 comp rx=0 tx=0).stop 2024-01-31T12:09:42.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.489+0000 7f1de6000640 1 -- 172.21.15.49:0/986907162 shutdown_connections 2024-01-31T12:09:42.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.489+0000 7f1de6000640 1 --2- 172.21.15.49:0/986907162 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f1db8066500 0x7f1db80689c0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:42.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.489+0000 7f1de6000640 1 --2- 172.21.15.49:0/986907162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1de015e770 0x7f1de006be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:42.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.489+0000 7f1de6000640 1 --2- 172.21.15.49:0/986907162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1de00703c0 0x7f1de015c5a0 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:42.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.489+0000 7f1de6000640 1 --2- 172.21.15.49:0/986907162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1de006fe70 0x7f1de014cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:42.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.489+0000 7f1de6000640 1 -- 172.21.15.49:0/986907162 >> 172.21.15.49:0/986907162 conn(0x7f1de00d0e60 msgr2=0x7f1de006e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:42.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.489+0000 7f1de6000640 1 -- 172.21.15.49:0/986907162 shutdown_connections 2024-01-31T12:09:42.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.489+0000 7f1de6000640 1 -- 172.21.15.49:0/986907162 wait complete. 2024-01-31T12:09:42.541 INFO:tasks.ceph:Scrubbing osd.7 2024-01-31T12:09:42.541 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-31T12:09:42.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.961+0000 7f8e1b800640 1 Processor -- start 2024-01-31T12:09:42.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.961+0000 7f8e1b800640 1 -- start start 2024-01-31T12:09:42.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.965+0000 7f8e1b800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8e1415d540 0x7f8e140cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:42.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.965+0000 7f8e1b800640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f8e1406c290 0x7f8e140cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:42.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.965+0000 7f8e1b800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e140cb9f0 0x7f8e140cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:42.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.965+0000 7f8e1b800640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e140cef80 con 0x7f8e1406c290 2024-01-31T12:09:42.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.965+0000 7f8e1b800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1406cae0 con 0x7f8e1415d540 2024-01-31T12:09:42.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.965+0000 7f8e1b800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e140cf1b0 con 0x7f8e140cb9f0 2024-01-31T12:09:42.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.965+0000 7f8e18e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8e1415d540 0x7f8e140cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:42.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.965+0000 7f8e18e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8e1415d540 0x7f8e140cff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:42868/0 (socket says 172.21.15.49:42868) 2024-01-31T12:09:42.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.965+0000 7f8e18e00640 1 -- 172.21.15.49:0/3842181631 learned_addr learned my addr 172.21.15.49:0/3842181631 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:42.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.965+0000 7f8e19800640 1 --2- 172.21.15.49:0/3842181631 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e140cb9f0 0x7f8e140cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:42.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.965+0000 7f8e13e00640 1 --2- 172.21.15.49:0/3842181631 >> v2:172.21.15.49:3300/0 conn(0x7f8e1406c290 0x7f8e140cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:42.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.965+0000 7f8e18e00640 1 -- 172.21.15.49:0/3842181631 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e140cb9f0 msgr2=0x7f8e140cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:42.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.965+0000 7f8e18e00640 1 --2- 172.21.15.49:0/3842181631 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e140cb9f0 0x7f8e140cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:42.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.965+0000 7f8e18e00640 1 -- 172.21.15.49:0/3842181631 >> v2:172.21.15.49:3300/0 conn(0x7f8e1406c290 msgr2=0x7f8e140cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:42.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.965+0000 7f8e18e00640 1 --2- 172.21.15.49:0/3842181631 >> v2:172.21.15.49:3300/0 conn(0x7f8e1406c290 0x7f8e140cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:42.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.965+0000 7f8e18e00640 1 -- 172.21.15.49:0/3842181631 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e140cf490 con 0x7f8e1415d540 2024-01-31T12:09:42.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.965+0000 7f8e13e00640 1 --2- 172.21.15.49:0/3842181631 >> v2:172.21.15.49:3300/0 conn(0x7f8e1406c290 0x7f8e140cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T12:09:42.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.969+0000 7f8e18e00640 1 --2- 172.21.15.49:0/3842181631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1415d540 0x7f8e140cff70 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f8e14071f60 tx=0x7f8e0401c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37f32db49caf505d server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:42.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.969+0000 7f8e13400640 1 -- 172.21.15.49:0/3842181631 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e040aa5f0 con 0x7f8e1415d540 2024-01-31T12:09:42.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.969+0000 7f8e13400640 1 -- 172.21.15.49:0/3842181631 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e040aa750 con 0x7f8e1415d540 2024-01-31T12:09:42.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.969+0000 7f8e13400640 1 -- 172.21.15.49:0/3842181631 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e040aaae0 con 0x7f8e1415d540 2024-01-31T12:09:42.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.973+0000 7f8e1b800640 1 -- 172.21.15.49:0/3842181631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1415d540 msgr2=0x7f8e140cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:42.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.973+0000 7f8e1b800640 1 --2- 172.21.15.49:0/3842181631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1415d540 0x7f8e140cff70 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f8e14071f60 tx=0x7f8e0401c4d0 comp rx=0 tx=0).stop 2024-01-31T12:09:42.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.973+0000 7f8e1b800640 1 -- 172.21.15.49:0/3842181631 shutdown_connections 2024-01-31T12:09:42.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.973+0000 7f8e1b800640 1 --2- 172.21.15.49:0/3842181631 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e140cb9f0 0x7f8e140cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:42.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.973+0000 7f8e1b800640 1 --2- 172.21.15.49:0/3842181631 >> v2:172.21.15.49:3300/0 conn(0x7f8e1406c290 0x7f8e140cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:42.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.973+0000 7f8e1b800640 1 --2- 172.21.15.49:0/3842181631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1415d540 0x7f8e140cff70 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:42.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.973+0000 7f8e1b800640 1 -- 172.21.15.49:0/3842181631 >> 172.21.15.49:0/3842181631 conn(0x7f8e140d0e60 msgr2=0x7f8e140d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:42.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.973+0000 7f8e1b800640 1 -- 172.21.15.49:0/3842181631 shutdown_connections 2024-01-31T12:09:42.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.973+0000 7f8e1b800640 1 -- 172.21.15.49:0/3842181631 wait complete. 2024-01-31T12:09:42.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.977+0000 7f8e1b800640 1 Processor -- start 2024-01-31T12:09:42.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.977+0000 7f8e1b800640 1 -- start start 2024-01-31T12:09:42.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e1b800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e1406c290 0x7f8e141544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:42.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e1b800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e140cb9f0 0x7f8e1415d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:42.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e1b800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1415d540 0x7f8e1415de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:42.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e1b800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e140c4500 con 0x7f8e1406c290 2024-01-31T12:09:42.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e1b800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1415a010 con 0x7f8e1415d540 2024-01-31T12:09:42.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e1b800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e140c4220 con 0x7f8e140cb9f0 2024-01-31T12:09:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e18e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e1406c290 0x7f8e141544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e18e00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e1406c290 0x7f8e141544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41896/0 (socket says 172.21.15.49:41896) 2024-01-31T12:09:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e18e00640 1 -- 172.21.15.49:0/287565485 learned_addr learned my addr 172.21.15.49:0/287565485 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:42.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e13e00640 1 --2- 172.21.15.49:0/287565485 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e140cb9f0 0x7f8e1415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e19800640 1 --2- 172.21.15.49:0/287565485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1415d540 0x7f8e1415de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e18e00640 1 -- 172.21.15.49:0/287565485 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e140cb9f0 msgr2=0x7f8e1415d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e18e00640 1 --2- 172.21.15.49:0/287565485 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e140cb9f0 0x7f8e1415d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e18e00640 1 -- 172.21.15.49:0/287565485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1415d540 msgr2=0x7f8e1415de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e18e00640 1 --2- 172.21.15.49:0/287565485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1415d540 0x7f8e1415de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e18e00640 1 -- 172.21.15.49:0/287565485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e040094d0 con 0x7f8e1406c290 2024-01-31T12:09:42.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e18e00640 1 --2- 172.21.15.49:0/287565485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e1406c290 0x7f8e141544a0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f8e040ac040 tx=0x7f8e0401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:42.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e10c00640 1 -- 172.21.15.49:0/287565485 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e040bd5f0 con 0x7f8e1406c290 2024-01-31T12:09:42.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e10c00640 1 -- 172.21.15.49:0/287565485 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e040bd750 con 0x7f8e1406c290 2024-01-31T12:09:42.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e10c00640 1 -- 172.21.15.49:0/287565485 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e040bdb00 con 0x7f8e1406c290 2024-01-31T12:09:42.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e1b800640 1 -- 172.21.15.49:0/287565485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e140c8060 con 0x7f8e1406c290 2024-01-31T12:09:42.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.981+0000 7f8e1b800640 1 -- 172.21.15.49:0/287565485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e141549e0 con 0x7f8e1406c290 2024-01-31T12:09:42.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.985+0000 7f8e1b800640 1 -- 172.21.15.49:0/287565485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e140c4390 con 0x7f8e1406c290 2024-01-31T12:09:42.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.985+0000 7f8e10c00640 1 -- 172.21.15.49:0/287565485 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f8e040b3600 con 0x7f8e1406c290 2024-01-31T12:09:42.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.989+0000 7f8e10c00640 1 --2- 172.21.15.49:0/287565485 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8dec066530 0x7f8dec0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:42.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.989+0000 7f8e10c00640 1 -- 172.21.15.49:0/287565485 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8e040a7070 con 0x7f8e1406c290 2024-01-31T12:09:42.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.989+0000 7f8e13e00640 1 --2- 172.21.15.49:0/287565485 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8dec066530 0x7f8dec0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:42.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.989+0000 7f8e10c00640 1 --2- 172.21.15.49:0/287565485 >> [v2:172.21.15.195:6809/1947167273,v1:172.21.15.195:6811/1947167273] conn(0x7f8dec06c830 0x7f8dec06ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:42.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.989+0000 7f8e10c00640 1 -- 172.21.15.49:0/287565485 --> [v2:172.21.15.195:6809/1947167273,v1:172.21.15.195:6811/1947167273] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8dec06f340 con 0x7f8dec06c830 2024-01-31T12:09:42.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.989+0000 7f8e10c00640 1 -- 172.21.15.49:0/287565485 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e0411f400 con 0x7f8e1406c290 2024-01-31T12:09:42.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.989+0000 7f8e19800640 1 --2- 172.21.15.49:0/287565485 >> [v2:172.21.15.195:6809/1947167273,v1:172.21.15.195:6811/1947167273] conn(0x7f8dec06c830 0x7f8dec06ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:42.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.989+0000 7f8e13e00640 1 --2- 172.21.15.49:0/287565485 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8dec066530 0x7f8dec0689f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8e14070610 tx=0x7f8dfc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:42.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:42.993+0000 7f8e19800640 1 --2- 172.21.15.49:0/287565485 >> [v2:172.21.15.195:6809/1947167273,v1:172.21.15.195:6811/1947167273] conn(0x7f8dec06c830 0x7f8dec06ec70 crc :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:43.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.109+0000 7f8e10c00640 1 -- 172.21.15.49:0/287565485 <== osd.7 v2:172.21.15.195:6809/1947167273 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8dec06f340 con 0x7f8dec06c830 2024-01-31T12:09:43.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.145+0000 7f8e1b800640 1 -- 172.21.15.49:0/287565485 --> [v2:172.21.15.195:6809/1947167273,v1:172.21.15.195:6811/1947167273] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8e1406c880 con 0x7f8dec06c830 2024-01-31T12:09:43.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.165+0000 7f8e10c00640 1 -- 172.21.15.49:0/287565485 <== osd.7 v2:172.21.15.195:6809/1947167273 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8e0c0083a0 con 0x7f8dec06c830 2024-01-31T12:09:43.166 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-01-31T12:09:43.166 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-31T12:09:43.166 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-01-31T12:09:43.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.165+0000 7f8e1b800640 1 -- 172.21.15.49:0/287565485 >> [v2:172.21.15.195:6809/1947167273,v1:172.21.15.195:6811/1947167273] conn(0x7f8dec06c830 msgr2=0x7f8dec06ec70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:43.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.165+0000 7f8e1b800640 1 --2- 172.21.15.49:0/287565485 >> [v2:172.21.15.195:6809/1947167273,v1:172.21.15.195:6811/1947167273] conn(0x7f8dec06c830 0x7f8dec06ec70 crc :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:43.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.165+0000 7f8e1b800640 1 -- 172.21.15.49:0/287565485 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8dec066530 msgr2=0x7f8dec0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:43.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.165+0000 7f8e1b800640 1 --2- 172.21.15.49:0/287565485 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8dec066530 0x7f8dec0689f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8e14070610 tx=0x7f8dfc008040 comp rx=0 tx=0).stop 2024-01-31T12:09:43.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.165+0000 7f8e1b800640 1 -- 172.21.15.49:0/287565485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e1406c290 msgr2=0x7f8e141544a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:43.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.165+0000 7f8e1b800640 1 --2- 172.21.15.49:0/287565485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e1406c290 0x7f8e141544a0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f8e040ac040 tx=0x7f8e0401ad10 comp rx=0 tx=0).stop 2024-01-31T12:09:43.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.165+0000 7f8e19800640 1 -- 172.21.15.49:0/287565485 reap_dead start 2024-01-31T12:09:43.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.165+0000 7f8e1b800640 1 -- 172.21.15.49:0/287565485 shutdown_connections 2024-01-31T12:09:43.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.165+0000 7f8e1b800640 1 -- 172.21.15.49:0/287565485 >> 172.21.15.49:0/287565485 conn(0x7f8e140d0e60 msgr2=0x7f8e1415c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:43.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.165+0000 7f8e1b800640 1 -- 172.21.15.49:0/287565485 shutdown_connections 2024-01-31T12:09:43.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.169+0000 7f8e1b800640 1 -- 172.21.15.49:0/287565485 wait complete. 2024-01-31T12:09:43.216 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-31T12:09:43.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.613+0000 7fc152800640 1 Processor -- start 2024-01-31T12:09:43.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.613+0000 7fc152800640 1 -- start start 2024-01-31T12:09:43.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.617+0000 7fc152800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc14c0b3680 0x7fc14c0b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:43.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.617+0000 7fc152800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc14c0cec20 0x7fc14c06d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:43.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.617+0000 7fc152800640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14c0b2ad0 con 0x7fc14c159610 2024-01-31T12:09:43.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.617+0000 7fc152800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14c15d1c0 con 0x7fc14c0cec20 2024-01-31T12:09:43.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.617+0000 7fc152800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c15d4a0 con 0x7fc14c0b3680 2024-01-31T12:09:43.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.617+0000 7fc14b400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fc14c159610 0x7fc14c0b2f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51480/0 (socket says 172.21.15.49:51480) 2024-01-31T12:09:43.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.617+0000 7fc14b400640 1 -- 172.21.15.49:0/2874753698 learned_addr learned my addr 172.21.15.49:0/2874753698 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:09:43.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.617+0000 7fc14be00640 1 --2- 172.21.15.49:0/2874753698 >> v2:172.21.15.195:3300/0 conn(0x7fc14c0cec20 0x7fc14c06d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:43.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.617+0000 7fc14aa00640 1 --2- 172.21.15.49:0/2874753698 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc14c0b3680 0x7fc14c0b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:43.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.617+0000 7fc14a000640 1 -- 172.21.15.49:0/2874753698 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523156971 0 0) 0x7fc14c0b2ad0 con 0x7fc14c159610 2024-01-31T12:09:43.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.617+0000 7fc14a000640 1 -- 172.21.15.49:0/2874753698 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc12c005740 con 0x7fc14c159610 2024-01-31T12:09:43.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.617+0000 7fc14be00640 1 -- 172.21.15.49:0/2874753698 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc14c0b3680 msgr2=0x7fc14c0b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:09:43.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.617+0000 7fc14be00640 1 --2- 172.21.15.49:0/2874753698 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc14c0b3680 0x7fc14c0b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:43.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.617+0000 7fc14be00640 1 -- 172.21.15.49:0/2874753698 >> v1:172.21.15.49:6789/0 conn(0x7fc14c159610 legacy=0x7fc14c0b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:43.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.617+0000 7fc14be00640 1 -- 172.21.15.49:0/2874753698 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c15d780 con 0x7fc14c0cec20 2024-01-31T12:09:43.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.617+0000 7fc14aa00640 1 --2- 172.21.15.49:0/2874753698 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc14c0b3680 0x7fc14c0b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T12:09:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.625+0000 7fc14be00640 1 --2- 172.21.15.49:0/2874753698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc14c0cec20 0x7fc14c06d320 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0097c0 tx=0x7fc13c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3416314e69a666a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.625+0000 7fc14a000640 1 -- 172.21.15.49:0/2874753698 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c0ac410 con 0x7fc14c0cec20 2024-01-31T12:09:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.625+0000 7fc14a000640 1 -- 172.21.15.49:0/2874753698 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c0ac570 con 0x7fc14c0cec20 2024-01-31T12:09:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.625+0000 7fc14a000640 1 -- 172.21.15.49:0/2874753698 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c0ac900 con 0x7fc14c0cec20 2024-01-31T12:09:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.629+0000 7fc152800640 1 -- 172.21.15.49:0/2874753698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc14c0cec20 msgr2=0x7fc14c06d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:43.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.629+0000 7fc152800640 1 --2- 172.21.15.49:0/2874753698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc14c0cec20 0x7fc14c06d320 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0097c0 tx=0x7fc13c01c450 comp rx=0 tx=0).stop 2024-01-31T12:09:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.629+0000 7fc152800640 1 -- 172.21.15.49:0/2874753698 shutdown_connections 2024-01-31T12:09:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.629+0000 7fc152800640 1 --2- 172.21.15.49:0/2874753698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc14c0cec20 0x7fc14c06d320 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.629+0000 7fc152800640 1 --2- 172.21.15.49:0/2874753698 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc14c0b3680 0x7fc14c0b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:43.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.629+0000 7fc152800640 1 -- 172.21.15.49:0/2874753698 >> 172.21.15.49:0/2874753698 conn(0x7fc14c0668d0 msgr2=0x7fc14c0b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:43.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.629+0000 7fc152800640 1 -- 172.21.15.49:0/2874753698 shutdown_connections 2024-01-31T12:09:43.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.629+0000 7fc152800640 1 -- 172.21.15.49:0/2874753698 wait complete. 2024-01-31T12:09:43.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.633+0000 7fc152800640 1 Processor -- start 2024-01-31T12:09:43.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.633+0000 7fc152800640 1 -- start start 2024-01-31T12:09:43.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.637+0000 7fc152800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc14c0b3680 0x7fc14c0ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:43.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.637+0000 7fc152800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc14c0cec20 0x7fc14c15b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:43.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.637+0000 7fc152800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc14c159610 0x7fc14c159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:43.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.637+0000 7fc152800640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c15a180 con 0x7fc14c0cec20 2024-01-31T12:09:43.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.637+0000 7fc152800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c15a400 con 0x7fc14c159610 2024-01-31T12:09:43.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.637+0000 7fc152800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c15a6e0 con 0x7fc14c0b3680 2024-01-31T12:09:43.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.637+0000 7fc14b400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc14c0b3680 0x7fc14c0ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:43.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.637+0000 7fc14b400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc14c0b3680 0x7fc14c0ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.49:58068/0 (socket says 172.21.15.49:58068) 2024-01-31T12:09:43.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.637+0000 7fc14b400640 1 -- 172.21.15.49:0/3500782185 learned_addr learned my addr 172.21.15.49:0/3500782185 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:43.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.637+0000 7fc14be00640 1 --2- 172.21.15.49:0/3500782185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc14c159610 0x7fc14c159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:43.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.637+0000 7fc14aa00640 1 --2- 172.21.15.49:0/3500782185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc14c0cec20 0x7fc14c15b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:43.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.637+0000 7fc14b400640 1 -- 172.21.15.49:0/3500782185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc14c159610 msgr2=0x7fc14c159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.637+0000 7fc14b400640 1 --2- 172.21.15.49:0/3500782185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc14c159610 0x7fc14c159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.637+0000 7fc14b400640 1 -- 172.21.15.49:0/3500782185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc14c0cec20 msgr2=0x7fc14c15b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.637+0000 7fc14b400640 1 --2- 172.21.15.49:0/3500782185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc14c0cec20 0x7fc14c15b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.637+0000 7fc14b400640 1 -- 172.21.15.49:0/3500782185 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc134009420 con 0x7fc14c0b3680 2024-01-31T12:09:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.637+0000 7fc14aa00640 1 --2- 172.21.15.49:0/3500782185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc14c0cec20 0x7fc14c15b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T12:09:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.637+0000 7fc14b400640 1 --2- 172.21.15.49:0/3500782185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc14c0b3680 0x7fc14c0ce4d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc14400caa0 tx=0x7fc14400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.641+0000 7fc143400640 1 -- 172.21.15.49:0/3500782185 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14400ac00 con 0x7fc14c0b3680 2024-01-31T12:09:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.641+0000 7fc143400640 1 -- 172.21.15.49:0/3500782185 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14400ad60 con 0x7fc14c0b3680 2024-01-31T12:09:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.641+0000 7fc152800640 1 -- 172.21.15.49:0/3500782185 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc13c009420 con 0x7fc14c0b3680 2024-01-31T12:09:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.641+0000 7fc143400640 1 -- 172.21.15.49:0/3500782185 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc144012620 con 0x7fc14c0b3680 2024-01-31T12:09:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.641+0000 7fc152800640 1 -- 172.21.15.49:0/3500782185 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14c15e100 con 0x7fc14c0b3680 2024-01-31T12:09:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.641+0000 7fc143400640 1 -- 172.21.15.49:0/3500782185 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fc144007070 con 0x7fc14c0b3680 2024-01-31T12:09:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.641+0000 7fc152800640 1 -- 172.21.15.49:0/3500782185 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14c074860 con 0x7fc14c0b3680 2024-01-31T12:09:43.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.645+0000 7fc143400640 1 --2- 172.21.15.49:0/3500782185 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc124066550 0x7fc124068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:43.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.645+0000 7fc143400640 1 -- 172.21.15.49:0/3500782185 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc144083c60 con 0x7fc14c0b3680 2024-01-31T12:09:43.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.645+0000 7fc14aa00640 1 --2- 172.21.15.49:0/3500782185 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc124066550 0x7fc124068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:43.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.645+0000 7fc14aa00640 1 --2- 172.21.15.49:0/3500782185 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc124066550 0x7fc124068a10 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc14c1f4d70 tx=0x7fc134008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:43.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:43.649+0000 7fc143400640 1 -- 172.21.15.49:0/3500782185 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fc144051150 con 0x7fc14c0b3680 2024-01-31T12:09:44.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.125+0000 7fc152800640 1 -- 172.21.15.49:0/3500782185 --> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fc14c0cf290 con 0x7fc124066550 2024-01-31T12:09:44.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.125+0000 7fc143400640 1 -- 172.21.15.49:0/3500782185 <== mgr.4100 v2:172.21.15.195:6832/3035808172 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc14c0cf290 con 0x7fc124066550 2024-01-31T12:09:44.126 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 7 to deep-scrub 2024-01-31T12:09:44.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.129+0000 7fc152800640 1 -- 172.21.15.49:0/3500782185 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc124066550 msgr2=0x7fc124068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:44.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.129+0000 7fc152800640 1 --2- 172.21.15.49:0/3500782185 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc124066550 0x7fc124068a10 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc14c1f4d70 tx=0x7fc134008040 comp rx=0 tx=0).stop 2024-01-31T12:09:44.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.129+0000 7fc152800640 1 -- 172.21.15.49:0/3500782185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc14c0b3680 msgr2=0x7fc14c0ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:44.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.129+0000 7fc152800640 1 --2- 172.21.15.49:0/3500782185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc14c0b3680 0x7fc14c0ce4d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc14400caa0 tx=0x7fc14400cf60 comp rx=0 tx=0).stop 2024-01-31T12:09:44.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.129+0000 7fc152800640 1 -- 172.21.15.49:0/3500782185 shutdown_connections 2024-01-31T12:09:44.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.129+0000 7fc152800640 1 --2- 172.21.15.49:0/3500782185 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fc124066550 0x7fc124068a10 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:44.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.129+0000 7fc152800640 1 --2- 172.21.15.49:0/3500782185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc14c159610 0x7fc14c159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:44.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.129+0000 7fc152800640 1 --2- 172.21.15.49:0/3500782185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc14c0cec20 0x7fc14c15b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:44.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.129+0000 7fc152800640 1 --2- 172.21.15.49:0/3500782185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc14c0b3680 0x7fc14c0ce4d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:44.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.129+0000 7fc152800640 1 -- 172.21.15.49:0/3500782185 >> 172.21.15.49:0/3500782185 conn(0x7fc14c0668d0 msgr2=0x7fc14c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:44.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.129+0000 7fc152800640 1 -- 172.21.15.49:0/3500782185 shutdown_connections 2024-01-31T12:09:44.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.129+0000 7fc152800640 1 -- 172.21.15.49:0/3500782185 wait complete. 2024-01-31T12:09:44.183 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-31T12:09:44.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.585+0000 7fab50c00640 1 Processor -- start 2024-01-31T12:09:44.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.585+0000 7fab50c00640 1 -- start start 2024-01-31T12:09:44.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.589+0000 7fab50c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fab4c0b1230 0x7fab4c0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:44.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.589+0000 7fab50c00640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4c0b16c0 con 0x7fab4c0d1980 2024-01-31T12:09:44.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.589+0000 7fab50c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4c0b0da0 con 0x7fab4c0c3e30 2024-01-31T12:09:44.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.589+0000 7fab50c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4c06c060 con 0x7fab4c0b1230 2024-01-31T12:09:44.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.589+0000 7fab49400640 1 --1- >> v1:172.21.15.49:6789/0 conn(0x7fab4c0d1980 0x7fab4c0c4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.49:6789/0 says I am v1:172.21.15.49:51484/0 (socket says 172.21.15.49:51484) 2024-01-31T12:09:44.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.593+0000 7fab49400640 1 -- 172.21.15.49:0/3603450520 learned_addr learned my addr 172.21.15.49:0/3603450520 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:09:44.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.593+0000 7fab4a800640 1 --2- 172.21.15.49:0/3603450520 >> v2:172.21.15.195:3300/0 conn(0x7fab4c0b1230 0x7fab4c0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:44.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.593+0000 7fab48a00640 1 -- 172.21.15.49:0/3603450520 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136268411 0 0) 0x7fab4c0b0da0 con 0x7fab4c0c3e30 2024-01-31T12:09:44.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.593+0000 7fab48a00640 1 -- 172.21.15.49:0/3603450520 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab2c003530 con 0x7fab4c0c3e30 2024-01-31T12:09:44.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.593+0000 7fab48a00640 1 -- 172.21.15.49:0/3603450520 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332864511 0 0) 0x7fab4c0b16c0 con 0x7fab4c0d1980 2024-01-31T12:09:44.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.593+0000 7fab4a800640 1 -- 172.21.15.49:0/3603450520 >> v1:172.21.15.195:6789/0 conn(0x7fab4c0c3e30 legacy=0x7fab4c06b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:44.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.593+0000 7fab4a800640 1 -- 172.21.15.49:0/3603450520 >> v1:172.21.15.49:6789/0 conn(0x7fab4c0d1980 legacy=0x7fab4c0c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:44.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.593+0000 7fab4a800640 1 -- 172.21.15.49:0/3603450520 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c0b0470 con 0x7fab4c0b1230 2024-01-31T12:09:44.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.601+0000 7fab4a800640 1 --2- 172.21.15.49:0/3603450520 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab4c0b1230 0x7fab4c0cb4b0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fab44009d90 tx=0x7fab4401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=409ac079dd3d676 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:44.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.601+0000 7fab48a00640 1 -- 172.21.15.49:0/3603450520 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c0cc200 con 0x7fab4c0b1230 2024-01-31T12:09:44.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.601+0000 7fab48a00640 1 -- 172.21.15.49:0/3603450520 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab440a5900 con 0x7fab4c0b1230 2024-01-31T12:09:44.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.601+0000 7fab48a00640 1 -- 172.21.15.49:0/3603450520 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab440a5c90 con 0x7fab4c0b1230 2024-01-31T12:09:44.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.601+0000 7fab50c00640 1 -- 172.21.15.49:0/3603450520 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab4c0b1230 msgr2=0x7fab4c0cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:44.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.601+0000 7fab50c00640 1 --2- 172.21.15.49:0/3603450520 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab4c0b1230 0x7fab4c0cb4b0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fab44009d90 tx=0x7fab4401c950 comp rx=0 tx=0).stop 2024-01-31T12:09:44.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.605+0000 7fab50c00640 1 -- 172.21.15.49:0/3603450520 shutdown_connections 2024-01-31T12:09:44.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.605+0000 7fab50c00640 1 --2- 172.21.15.49:0/3603450520 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab4c0b1230 0x7fab4c0cb4b0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:44.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.605+0000 7fab50c00640 1 -- 172.21.15.49:0/3603450520 >> 172.21.15.49:0/3603450520 conn(0x7fab4c0d0e60 msgr2=0x7fab4c0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:44.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.605+0000 7fab50c00640 1 -- 172.21.15.49:0/3603450520 shutdown_connections 2024-01-31T12:09:44.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.605+0000 7fab50c00640 1 -- 172.21.15.49:0/3603450520 wait complete. 2024-01-31T12:09:44.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.609+0000 7fab50c00640 1 Processor -- start 2024-01-31T12:09:44.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.609+0000 7fab50c00640 1 -- start start 2024-01-31T12:09:44.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.609+0000 7fab50c00640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab4c0b1230 0x7fab4c157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:44.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.609+0000 7fab50c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab4c0c3e30 0x7fab4c0ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:44.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.609+0000 7fab50c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab4c0d1980 0x7fab4c15a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:44.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.609+0000 7fab50c00640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0afa90 con 0x7fab4c0b1230 2024-01-31T12:09:44.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.609+0000 7fab50c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0aee10 con 0x7fab4c0c3e30 2024-01-31T12:09:44.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.609+0000 7fab50c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0af0f0 con 0x7fab4c0d1980 2024-01-31T12:09:44.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.609+0000 7fab49400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab4c0c3e30 0x7fab4c0ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:44.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.613+0000 7fab49400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab4c0c3e30 0x7fab4c0ae570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:42920/0 (socket says 172.21.15.49:42920) 2024-01-31T12:09:44.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.613+0000 7fab49400640 1 -- 172.21.15.49:0/335090634 learned_addr learned my addr 172.21.15.49:0/335090634 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:09:44.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.613+0000 7fab4a800640 1 --2- 172.21.15.49:0/335090634 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab4c0d1980 0x7fab4c15a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:44.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.613+0000 7fab49e00640 1 --2- 172.21.15.49:0/335090634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab4c0b1230 0x7fab4c157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:44.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.613+0000 7fab49400640 1 -- 172.21.15.49:0/335090634 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab4c0d1980 msgr2=0x7fab4c15a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:44.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.613+0000 7fab49400640 1 --2- 172.21.15.49:0/335090634 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab4c0d1980 0x7fab4c15a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:44.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.613+0000 7fab49400640 1 -- 172.21.15.49:0/335090634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab4c0b1230 msgr2=0x7fab4c157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:44.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.613+0000 7fab49400640 1 --2- 172.21.15.49:0/335090634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab4c0b1230 0x7fab4c157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:44.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.613+0000 7fab49400640 1 -- 172.21.15.49:0/335090634 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab44009a70 con 0x7fab4c0c3e30 2024-01-31T12:09:44.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.613+0000 7fab49400640 1 --2- 172.21.15.49:0/335090634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab4c0c3e30 0x7fab4c0ae570 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fab340011f0 tx=0x7fab3400c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:44.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.613+0000 7fab42000640 1 -- 172.21.15.49:0/335090634 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340074e0 con 0x7fab4c0c3e30 2024-01-31T12:09:44.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.613+0000 7fab42000640 1 -- 172.21.15.49:0/335090634 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab34007640 con 0x7fab4c0c3e30 2024-01-31T12:09:44.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.613+0000 7fab42000640 1 -- 172.21.15.49:0/335090634 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34004a10 con 0x7fab4c0c3e30 2024-01-31T12:09:44.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.613+0000 7fab50c00640 1 -- 172.21.15.49:0/335090634 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4c0af3d0 con 0x7fab4c0c3e30 2024-01-31T12:09:44.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.613+0000 7fab50c00640 1 -- 172.21.15.49:0/335090634 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4c158150 con 0x7fab4c0c3e30 2024-01-31T12:09:44.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.613+0000 7fab42000640 1 -- 172.21.15.49:0/335090634 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fab34004b70 con 0x7fab4c0c3e30 2024-01-31T12:09:44.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.617+0000 7fab50c00640 1 -- 172.21.15.49:0/335090634 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4c074860 con 0x7fab4c0c3e30 2024-01-31T12:09:44.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.617+0000 7fab42000640 1 --2- 172.21.15.49:0/335090634 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fab24066500 0x7fab240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:09:44.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.617+0000 7fab42000640 1 -- 172.21.15.49:0/335090634 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fab34082fd0 con 0x7fab4c0c3e30 2024-01-31T12:09:44.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.617+0000 7fab49e00640 1 --2- 172.21.15.49:0/335090634 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fab24066500 0x7fab240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:09:44.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.617+0000 7fab49e00640 1 --2- 172.21.15.49:0/335090634 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fab24066500 0x7fab240689c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fab3c007fd0 tx=0x7fab3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:09:44.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:44.625+0000 7fab42000640 1 -- 172.21.15.49:0/335090634 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fab34050420 con 0x7fab4c0c3e30 2024-01-31T12:09:45.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:45.097+0000 7fab50c00640 1 -- 172.21.15.49:0/335090634 --> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab4c067060 con 0x7fab24066500 2024-01-31T12:09:45.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:45.101+0000 7fab42000640 1 -- 172.21.15.49:0/335090634 <== mgr.4100 v2:172.21.15.195:6832/3035808172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49346 (secure 0 0 0) 0x7fab4c067060 con 0x7fab24066500 2024-01-31T12:09:45.105 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:09:45.105 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-31T12:09:45.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:45.105+0000 7fab50c00640 1 -- 172.21.15.49:0/335090634 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fab24066500 msgr2=0x7fab240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:45.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:45.105+0000 7fab50c00640 1 --2- 172.21.15.49:0/335090634 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fab24066500 0x7fab240689c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fab3c007fd0 tx=0x7fab3c009040 comp rx=0 tx=0).stop 2024-01-31T12:09:45.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:45.105+0000 7fab50c00640 1 -- 172.21.15.49:0/335090634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab4c0c3e30 msgr2=0x7fab4c0ae570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:09:45.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:45.105+0000 7fab50c00640 1 --2- 172.21.15.49:0/335090634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab4c0c3e30 0x7fab4c0ae570 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fab340011f0 tx=0x7fab3400c9b0 comp rx=0 tx=0).stop 2024-01-31T12:09:45.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:45.105+0000 7fab50c00640 1 -- 172.21.15.49:0/335090634 shutdown_connections 2024-01-31T12:09:45.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:45.105+0000 7fab50c00640 1 --2- 172.21.15.49:0/335090634 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab4c0d1980 0x7fab4c15a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:45.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:45.105+0000 7fab50c00640 1 --2- 172.21.15.49:0/335090634 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fab24066500 0x7fab240689c0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:45.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:45.105+0000 7fab50c00640 1 --2- 172.21.15.49:0/335090634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab4c0c3e30 0x7fab4c0ae570 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:45.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:45.105+0000 7fab50c00640 1 --2- 172.21.15.49:0/335090634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab4c0b1230 0x7fab4c157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:09:45.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:45.105+0000 7fab50c00640 1 -- 172.21.15.49:0/335090634 >> 172.21.15.49:0/335090634 conn(0x7fab4c0d0e60 msgr2=0x7fab4c0b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:09:45.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:45.105+0000 7fab50c00640 1 -- 172.21.15.49:0/335090634 shutdown_connections 2024-01-31T12:09:45.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:09:45.105+0000 7fab50c00640 1 -- 172.21.15.49:0/335090634 wait complete. 2024-01-31T12:09:45.138 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":12804,"stamp":"2024-01-31T12:09:43.978195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12620268,"kb_used_data":5224,"kb_used_omap":3047,"kb_used_meta":12611928,"kb_avail":742354452,"statfs":{"total":773094113280,"available":760170958848,"internally_reserved":0,"allocated":5349376,"data_stored":2983648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3120248,"internal_metadata":12914615176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001788"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":427,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-01-31T12:09:19.757297+0000","last_change":"2024-01-31T05:04:05.699222+0000","last_active":"2024-01-31T12:09:19.757297+0000","last_peered":"2024-01-31T12:09:19.757297+0000","last_clean":"2024-01-31T12:09:19.757297+0000","last_became_active":"2024-01-31T05:04:05.698239+0000","last_became_peered":"2024-01-31T05:04:05.698239+0000","last_unstale":"2024-01-31T12:09:19.757297+0000","last_undegraded":"2024-01-31T12:09:19.757297+0000","last_fullsized":"2024-01-31T12:09:19.757297+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:04.484734+0000","last_clean_scrub_stamp":"2024-01-31T05:04:04.484734+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:05:13.736598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834579956,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1591752,"kb_used_data":1088,"kb_used_omap":157,"kb_used_meta":1590498,"kb_avail":92780088,"statfs":{"total":96636764160,"available":95006810112,"internally_reserved":0,"allocated":1114112,"data_stored":815732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":161111,"internal_metadata":1628670633},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:09:34 2024","interfaces":[{"interface":"back","average":{"1min":2.2280000000000002,"5min":2.2949999999999999,"15min":1.9419999999999999},"min":{"1min":0.47999999999999998,"5min":0.34899999999999998,"15min":0.33700000000000002},"max":{"1min":8.9740000000000002,"5min":50.472000000000001,"15min":50.472000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":2.7240000000000002,"5min":2.8599999999999999,"15min":2.1749999999999998},"min":{"1min":0.63300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":9.0449999999999999,"5min":64.932000000000002,"15min":64.932000000000002},"last":0.93200000000000005}]},{"osd":1,"last update":"Wed Jan 31 12:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.619,"15min":1.8009999999999999},"min":{"1min":0.54700000000000004,"5min":0.43099999999999999,"15min":0.377},"max":{"1min":5.29,"5min":15.550000000000001,"15min":18.547999999999998},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.5600000000000001,"5min":1.712,"15min":1.762},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.34799999999999998},"max":{"1min":8.0169999999999995,"5min":14.384,"15min":14.384},"last":0.83899999999999997}]},{"osd":2,"last update":"Wed Jan 31 12:09:18 2024","interfaces":[{"interface":"back","average":{"1min":2.8439999999999999,"5min":1.8700000000000001,"15min":2.0059999999999998},"min":{"1min":0.54400000000000004,"5min":0.47599999999999998,"15min":0.45200000000000001},"max":{"1min":19.978000000000002,"5min":19.978000000000002,"15min":19.978000000000002},"last":0.89800000000000002},{"interface":"front","average":{"1min":2.6299999999999999,"5min":2.5209999999999999,"15min":2.1389999999999998},"min":{"1min":0.75700000000000001,"5min":0.44500000000000001,"15min":0.41799999999999998},"max":{"1min":6.8049999999999997,"5min":65.054000000000002,"15min":65.054000000000002},"last":0.72699999999999998}]},{"osd":3,"last update":"Wed Jan 31 12:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.7490000000000001,"5min":1.9390000000000001,"15min":1.839},"min":{"1min":0.53500000000000003,"5min":0.45200000000000001,"15min":0.435},"max":{"1min":7.7279999999999998,"5min":13.285,"15min":13.285},"last":0.77100000000000002},{"interface":"front","average":{"1min":3.9470000000000001,"5min":2.96,"15min":2.1190000000000002},"min":{"1min":0.56699999999999995,"5min":0.46899999999999997,"15min":0.44},"max":{"1min":36.966999999999999,"5min":65.019000000000005,"15min":65.019000000000005},"last":1.0840000000000001}]},{"osd":4,"last update":"Wed Jan 31 12:09:34 2024","interfaces":[{"interface":"back","average":{"1min":4.6929999999999996,"5min":1.575,"15min":0.94199999999999995},"min":{"1min":0.40300000000000002,"5min":0.34399999999999997,"15min":0.32100000000000001},"max":{"1min":73.091999999999999,"5min":73.091999999999999,"15min":73.091999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":4.3710000000000004,"5min":1.647,"15min":0.98899999999999999},"min":{"1min":0.42199999999999999,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":72.986999999999995,"5min":72.986999999999995,"15min":72.986999999999995},"last":0.42299999999999999}]},{"osd":5,"last update":"Wed Jan 31 12:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.788,"15min":1.032},"min":{"1min":0.42299999999999999,"5min":0.40600000000000003,"15min":0.35699999999999998},"max":{"1min":5.7960000000000003,"5min":64.986999999999995,"15min":64.986999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.6970000000000001,"15min":1.056},"min":{"1min":0.45100000000000001,"5min":0.441,"15min":0.36799999999999999},"max":{"1min":5.125,"5min":64.644000000000005,"15min":64.644000000000005},"last":0.5}]},{"osd":6,"last update":"Wed Jan 31 12:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.137,"15min":0.94099999999999995},"min":{"1min":0.53600000000000003,"5min":0.44700000000000001,"15min":0.40999999999999998},"max":{"1min":8,"5min":15.616,"15min":15.616},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.0580000000000001,"15min":0.85999999999999999},"min":{"1min":0.49299999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.7200000000000002,"5min":11.195,"15min":11.195},"last":0.54900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834579957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1474888,"kb_used_data":508,"kb_used_omap":156,"kb_used_meta":1474211,"kb_avail":92896952,"statfs":{"total":96636764160,"available":95126478848,"internally_reserved":0,"allocated":520192,"data_stored":225364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":160451,"internal_metadata":1509592381},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:55 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.7989999999999999,"15min":1.7989999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.312},"max":{"1min":4.6580000000000004,"5min":31.861000000000001,"15min":54.527000000000001},"last":1.046},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.5489999999999999,"15min":1.7649999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.34000000000000002},"max":{"1min":4.7140000000000004,"5min":5.71,"15min":54.466999999999999},"last":1.075}]},{"osd":1,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.478,"15min":1.8360000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":4.048,"5min":19.844999999999999,"15min":28.239000000000001},"last":0.875},{"interface":"front","average":{"1min":1.488,"5min":1.8620000000000001,"15min":1.9299999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.38400000000000001},"max":{"1min":4.1689999999999996,"5min":13.847,"15min":28.364000000000001},"last":0.70099999999999996}]},{"osd":2,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":2.052,"15min":1.9750000000000001},"min":{"1min":0.60499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.8490000000000002,"5min":27.777999999999999,"15min":27.783999999999999},"last":1.014},{"interface":"front","average":{"1min":1.9670000000000001,"5min":3.1899999999999999,"15min":2.3079999999999998},"min":{"1min":0.68600000000000005,"5min":0.46100000000000002,"15min":0.436},"max":{"1min":7.6669999999999998,"5min":159.67400000000001,"15min":159.67400000000001},"last":0.69199999999999995}]},{"osd":3,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.4419999999999999,"15min":1.8069999999999999},"min":{"1min":0.67300000000000004,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":2.194,"5min":8.1300000000000008,"15min":32.295999999999999},"last":0.629},{"interface":"front","average":{"1min":1.319,"5min":2.1890000000000001,"15min":2.1139999999999999},"min":{"1min":0.64700000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.71,"5min":27.905000000000001,"15min":33.198},"last":0.752}]},{"osd":4,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.73699999999999999,"15min":0.71399999999999997},"min":{"1min":0.40600000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.946,"5min":16.628,"15min":16.628},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.70899999999999996},"min":{"1min":0.39300000000000002,"5min":0.378,"15min":0.36899999999999999},"max":{"1min":1.5600000000000001,"5min":4.8460000000000001,"15min":4.8460000000000001},"last":0.46999999999999997}]},{"osd":5,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.83399999999999996,"15min":0.87},"min":{"1min":0.45300000000000001,"5min":0.35399999999999998,"15min":0.33600000000000002},"max":{"1min":0.95199999999999996,"5min":19.120999999999999,"15min":36.438000000000002},"last":0.496},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.86699999999999999,"15min":0.90100000000000002},"min":{"1min":0.42199999999999999,"5min":0.41199999999999998,"15min":0.372},"max":{"1min":2.056,"5min":23.087,"15min":31.077999999999999},"last":0.54000000000000004}]},{"osd":7,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65200000000000002,"15min":0.73999999999999999},"min":{"1min":0.46200000000000002,"5min":0.45000000000000001,"15min":0.33800000000000002},"max":{"1min":1.4990000000000001,"5min":1.613,"15min":4.3499999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.92600000000000005,"15min":0.82799999999999996},"min":{"1min":0.498,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.077,"5min":20.317,"15min":20.317},"last":0.56299999999999994}]}]},{"osd":5,"up_from":13,"seq":55834579956,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1058692,"kb_used_data":508,"kb_used_omap":757,"kb_used_meta":1057418,"kb_avail":93313148,"statfs":{"total":96636764160,"available":95552663552,"internally_reserved":0,"allocated":520192,"data_stored":225364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":775603,"internal_metadata":1082796621},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":2.98,"5min":2.2890000000000001,"15min":2.8660000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.29699999999999999},"max":{"1min":31.5,"5min":33.741999999999997,"15min":281.83499999999998},"last":0.94899999999999995},{"interface":"front","average":{"1min":3.581,"5min":2.339,"15min":3.004},"min":{"1min":0.69999999999999996,"5min":0.37,"15min":0.34300000000000003},"max":{"1min":31.524999999999999,"5min":35.189,"15min":277.49700000000001},"last":0.97099999999999997}]},{"osd":1,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":4.3179999999999996,"5min":2.7189999999999999,"15min":2.085},"min":{"1min":0.44600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":34.063000000000002,"5min":34.063000000000002,"15min":34.063000000000002},"last":0.76700000000000002},{"interface":"front","average":{"1min":3.2160000000000002,"5min":2.5459999999999998,"15min":2.0489999999999999},"min":{"1min":0.60899999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":32.128999999999998,"5min":32.128999999999998,"15min":32.128999999999998},"last":1.1639999999999999}]},{"osd":2,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":4.0780000000000003,"5min":2.431,"15min":3.6080000000000001},"min":{"1min":0.57199999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":36,"5min":36,"15min":279.86399999999998},"last":0.75},{"interface":"front","average":{"1min":3.7650000000000001,"5min":2.4769999999999999,"15min":3.7229999999999999},"min":{"1min":0.56699999999999995,"5min":0.50700000000000001,"15min":0.40999999999999998},"max":{"1min":35.978999999999999,"5min":35.978999999999999,"15min":279.15699999999998},"last":1.0369999999999999}]},{"osd":3,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":3.0739999999999998,"5min":2.3490000000000002,"15min":2.4940000000000002},"min":{"1min":0.59799999999999998,"5min":0.51900000000000002,"15min":0.435},"max":{"1min":32.176000000000002,"5min":32.176000000000002,"15min":160.709},"last":0.78800000000000003},{"interface":"front","average":{"1min":4.0700000000000003,"5min":2.4129999999999998,"15min":2.7120000000000002},"min":{"1min":0.82199999999999995,"5min":0.60499999999999998,"15min":0.46300000000000002},"max":{"1min":35.912999999999997,"5min":35.912999999999997,"15min":162.26599999999999},"last":0.71299999999999997}]},{"osd":4,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":2.25,"5min":1.2130000000000001,"15min":0.81299999999999994},"min":{"1min":0.40000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":32.652999999999999,"5min":32.652999999999999,"15min":32.652999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":2.431,"5min":1.246,"15min":0.86099999999999999},"min":{"1min":0.434,"5min":0.36299999999999999,"15min":0.33200000000000002},"max":{"1min":32.247,"5min":32.247,"15min":32.247},"last":0.52200000000000002}]},{"osd":6,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":2.7069999999999999,"5min":1.411,"15min":0.91300000000000003},"min":{"1min":0.47199999999999998,"5min":0.35799999999999998,"15min":0.34100000000000003},"max":{"1min":35.957999999999998,"5min":35.957999999999998,"15min":35.957999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":2.5720000000000001,"5min":1.2669999999999999,"15min":0.88800000000000001},"min":{"1min":0.47699999999999998,"5min":0.40200000000000002,"15min":0.38},"max":{"1min":36.444000000000003,"5min":36.444000000000003,"15min":36.444000000000003},"last":0.5}]},{"osd":7,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":2.8140000000000001,"5min":1.667,"15min":1.0429999999999999},"min":{"1min":0.44900000000000001,"5min":0.42599999999999999,"15min":0.375},"max":{"1min":32.799999999999997,"5min":39.918999999999997,"15min":39.918999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":2.964,"5min":1.6890000000000001,"15min":1.0569999999999999},"min":{"1min":0.53700000000000003,"5min":0.44800000000000001,"15min":0.42599999999999999},"max":{"1min":36.073999999999998,"5min":39.860999999999997,"15min":39.860999999999997},"last":0.64500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834579956,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1745092,"kb_used_data":508,"kb_used_omap":549,"kb_used_meta":1744026,"kb_avail":92626748,"statfs":{"total":96636764160,"available":94849789952,"internally_reserved":0,"allocated":520192,"data_stored":225364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":562466,"internal_metadata":1785883358},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.242,"15min":2.0920000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36299999999999999},"max":{"1min":5.7450000000000001,"5min":14.096,"15min":158.78200000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.4750000000000001,"15min":2.2029999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.33900000000000002},"max":{"1min":5.5800000000000001,"5min":5.5800000000000001,"15min":158.45400000000001},"last":0.66200000000000003}]},{"osd":1,"last update":"Wed Jan 31 12:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":2.028,"15min":2.2949999999999999},"min":{"1min":0.54000000000000004,"5min":0.42199999999999999,"15min":0.38100000000000001},"max":{"1min":3.5779999999999998,"5min":11.077999999999999,"15min":158.959},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.9630000000000001,"15min":2.3980000000000001},"min":{"1min":0.58999999999999997,"5min":0.50700000000000001,"15min":0.35199999999999998},"max":{"1min":4.5620000000000003,"5min":9.2490000000000006,"15min":158.69200000000001},"last":0.5}]},{"osd":2,"last update":"Wed Jan 31 12:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":2.0910000000000002,"15min":2.3700000000000001},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.5920000000000001,"5min":7.8890000000000002,"15min":158.232},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.718,"5min":1.984,"15min":2.3759999999999999},"min":{"1min":0.623,"5min":0.44700000000000001,"15min":0.438},"max":{"1min":4.0979999999999999,"5min":12.132999999999999,"15min":157.76300000000001},"last":0.76800000000000002}]},{"osd":3,"last update":"Wed Jan 31 12:08:41 2024","interfaces":[{"interface":"back","average":{"1min":1.9399999999999999,"5min":1.891,"15min":2.3330000000000002},"min":{"1min":0.69899999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.5590000000000002,"5min":6.5949999999999998,"15min":155.27799999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.716,"5min":1.5760000000000001,"15min":2.2719999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":4.8029999999999999,"5min":8.8300000000000001,"15min":156.81700000000001},"last":0.72899999999999998}]},{"osd":5,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.79600000000000004,"15min":0.67800000000000005},"min":{"1min":0.42399999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.93500000000000005,"5min":9.1120000000000001,"15min":9.1120000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72699999999999998,"15min":0.69299999999999995},"min":{"1min":0.53700000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91100000000000003,"5min":4.3959999999999999,"15min":4.6840000000000002},"last":0.61799999999999999}]},{"osd":6,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.81799999999999995,"15min":0.73299999999999998},"min":{"1min":0.46200000000000002,"5min":0.379,"15min":0.35699999999999998},"max":{"1min":3.294,"5min":7.7930000000000001,"15min":7.7930000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.82099999999999995,"15min":0.72199999999999998},"min":{"1min":0.51300000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.2929999999999999,"5min":11.791,"15min":11.791},"last":0.63600000000000001}]},{"osd":7,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79000000000000004,"15min":0.73299999999999998},"min":{"1min":0.502,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.5840000000000001,"5min":4.0919999999999996,"15min":5.5869999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.878,"15min":0.78900000000000003},"min":{"1min":0.504,"5min":0.41399999999999998,"15min":0.38800000000000001},"max":{"1min":3.395,"5min":7.8449999999999998,"15min":7.8449999999999998},"last":0.59999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834579903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1692100,"kb_used_data":508,"kb_used_omap":532,"kb_used_meta":1691051,"kb_avail":92679740,"statfs":{"total":96636764160,"available":94904053760,"internally_reserved":0,"allocated":520192,"data_stored":225364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":545051,"internal_metadata":1731636965},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":2.5960000000000001,"5min":2.7749999999999999,"15min":4.0369999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.28000000000000003},"max":{"1min":12.754,"5min":14.579000000000001,"15min":273.40300000000002},"last":1.7529999999999999},{"interface":"front","average":{"1min":2.5880000000000001,"5min":2.5899999999999999,"15min":4.1310000000000002},"min":{"1min":0.52500000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":13.122999999999999,"5min":13.122999999999999,"15min":278.26600000000002},"last":1.5880000000000001}]},{"osd":1,"last update":"Wed Jan 31 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":2.746,"5min":2.7970000000000002,"15min":3.1110000000000002},"min":{"1min":0.69599999999999995,"5min":0.58699999999999997,"15min":0.437},"max":{"1min":11.002000000000001,"5min":11.002000000000001,"15min":12.739000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":2.742,"5min":3.0659999999999998,"15min":3.2109999999999999},"min":{"1min":0.80500000000000005,"5min":0.58499999999999996,"15min":0.46100000000000002},"max":{"1min":12.151,"5min":12.151,"15min":12.592000000000001},"last":1.881}]},{"osd":2,"last update":"Wed Jan 31 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":2.3199999999999998,"5min":2.6819999999999999,"15min":4.0460000000000003},"min":{"1min":0.753,"5min":0.629,"15min":0.38500000000000001},"max":{"1min":12.004,"5min":12.004,"15min":278.33300000000003},"last":0.92300000000000004},{"interface":"front","average":{"1min":9.4600000000000009,"5min":4.6440000000000001,"15min":4.8339999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.44400000000000001},"max":{"1min":141.08199999999999,"5min":141.08199999999999,"15min":273.27100000000002},"last":1.4259999999999999}]},{"osd":4,"last update":"Wed Jan 31 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":1.6160000000000001,"5min":2.0710000000000002,"15min":2.423},"min":{"1min":0.77700000000000002,"5min":0.53400000000000003,"15min":0.47499999999999998},"max":{"1min":4.2910000000000004,"5min":7.4550000000000001,"15min":9.7460000000000004},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.6220000000000001,"5min":2.1589999999999998,"15min":2.29},"min":{"1min":0.69699999999999995,"5min":0.69499999999999995,"15min":0.502},"max":{"1min":3.4369999999999998,"5min":6.2089999999999996,"15min":10.071999999999999},"last":1.056}]},{"osd":5,"last update":"Wed Jan 31 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":1.726,"5min":2.3330000000000002,"15min":2.6659999999999999},"min":{"1min":0.877,"5min":0.627,"15min":0.52100000000000002},"max":{"1min":3.4809999999999999,"5min":11.385,"15min":55.942999999999998},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.609,"5min":2.4489999999999998,"15min":2.6840000000000002},"min":{"1min":0.59599999999999997,"5min":0.52700000000000002,"15min":0.49199999999999999},"max":{"1min":4.2569999999999997,"5min":7.556,"15min":56.850999999999999},"last":1.236}]},{"osd":6,"last update":"Wed Jan 31 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":1.679,"5min":2.6030000000000002,"15min":2.617},"min":{"1min":0.67100000000000004,"5min":0.59699999999999998,"15min":0.52400000000000002},"max":{"1min":4.5250000000000004,"5min":14.464,"15min":14.464},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.6180000000000001,"5min":2.226,"15min":2.597},"min":{"1min":0.745,"5min":0.61899999999999999,"15min":0.51300000000000001},"max":{"1min":4.3339999999999996,"5min":9.5690000000000008,"15min":9.6989999999999998},"last":1.498}]},{"osd":7,"last update":"Wed Jan 31 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":2.2330000000000001,"5min":2.492,"15min":3.004},"min":{"1min":0.79900000000000004,"5min":0.71399999999999997,"15min":0.56399999999999995},"max":{"1min":12.066000000000001,"5min":17.34,"15min":55.713999999999999},"last":1.369},{"interface":"front","average":{"1min":2.2589999999999999,"5min":2.613,"15min":2.8500000000000001},"min":{"1min":0.85199999999999998,"5min":0.66400000000000003,"15min":0.58699999999999997},"max":{"1min":11.148999999999999,"5min":17.274000000000001,"15min":55.619},"last":1.325}]}]},{"osd":2,"up_from":13,"seq":55834579911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1796932,"kb_used_data":508,"kb_used_omap":168,"kb_used_meta":1796247,"kb_avail":92574908,"statfs":{"total":96636764160,"available":94796705792,"internally_reserved":0,"allocated":520192,"data_stored":225364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":173049,"internal_metadata":1839356935},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":4.5140000000000002,"5min":2.7429999999999999,"15min":2.972},"min":{"1min":0.55500000000000005,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":26.771000000000001,"5min":26.771000000000001,"15min":26.771000000000001},"last":20.994},{"interface":"front","average":{"1min":3.923,"5min":3.0449999999999999,"15min":3.1269999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.41499999999999998},"max":{"1min":14.548999999999999,"5min":14.548999999999999,"15min":14.548999999999999},"last":21.100999999999999}]},{"osd":1,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":3.202,"5min":3.7440000000000002,"15min":3.3359999999999999},"min":{"1min":0.438,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":7.8220000000000001,"5min":48.207999999999998,"15min":48.207999999999998},"last":21.402999999999999},{"interface":"front","average":{"1min":4.6189999999999998,"5min":4.0439999999999996,"15min":3.6749999999999998},"min":{"1min":0.624,"5min":0.60899999999999999,"15min":0.35799999999999998},"max":{"1min":23.408000000000001,"5min":49.024999999999999,"15min":49.024999999999999},"last":21.178999999999998}]},{"osd":3,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":5.9969999999999999,"5min":4.0460000000000003,"15min":3.7519999999999998},"min":{"1min":0.75,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":35.802,"5min":35.802,"15min":35.802},"last":21.925000000000001},{"interface":"front","average":{"1min":5.0519999999999996,"5min":4.5519999999999996,"15min":3.944},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.47299999999999998},"max":{"1min":30.472999999999999,"5min":48.682000000000002,"15min":48.682000000000002},"last":21.986000000000001}]},{"osd":4,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":4.585,"5min":3.0030000000000001,"15min":2.7410000000000001},"min":{"1min":0.63700000000000001,"5min":0.54300000000000004,"15min":0.50700000000000001},"max":{"1min":33.631,"5min":33.631,"15min":33.631},"last":21.620000000000001},{"interface":"front","average":{"1min":4.1829999999999998,"5min":2.9620000000000002,"15min":2.847},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":33.277000000000001,"5min":33.277000000000001,"15min":33.277000000000001},"last":21.803000000000001}]},{"osd":5,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":6.665,"5min":3.512,"15min":3.0139999999999998},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.55000000000000004},"max":{"1min":44.935000000000002,"5min":44.935000000000002,"15min":44.935000000000002},"last":21.678999999999998},{"interface":"front","average":{"1min":4.835,"5min":3.077,"15min":2.98},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":44.590000000000003,"5min":44.590000000000003,"15min":44.590000000000003},"last":21.847999999999999}]},{"osd":6,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":3.9449999999999998,"5min":2.6739999999999999,"15min":2.5979999999999999},"min":{"1min":0.83499999999999996,"5min":0.66200000000000003,"15min":0.60099999999999998},"max":{"1min":26.259,"5min":26.259,"15min":26.259},"last":21.57},{"interface":"front","average":{"1min":3.601,"5min":3.0329999999999999,"15min":2.98},"min":{"1min":0.71499999999999997,"5min":0.70799999999999996,"15min":0.56899999999999995},"max":{"1min":12.18,"5min":13.839,"15min":19.888999999999999},"last":21.731000000000002}]},{"osd":7,"last update":"Wed Jan 31 12:08:51 2024","interfaces":[{"interface":"back","average":{"1min":2.7730000000000001,"5min":2.6509999999999998,"15min":2.6389999999999998},"min":{"1min":0.89800000000000002,"5min":0.69199999999999995,"15min":0.56799999999999995},"max":{"1min":7.7130000000000001,"5min":11.544,"15min":11.81},"last":21.748000000000001},{"interface":"front","average":{"1min":3.7349999999999999,"5min":3.105,"15min":3.1230000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":23.294,"5min":23.294,"15min":23.294},"last":21.702000000000002}]}]},{"osd":1,"up_from":13,"seq":55834579921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1485956,"kb_used_data":508,"kb_used_omap":400,"kb_used_meta":1485039,"kb_avail":92885884,"statfs":{"total":96636764160,"available":95115145216,"internally_reserved":0,"allocated":520192,"data_stored":225364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":410545,"internal_metadata":1520680015},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.532,"5min":2.9990000000000001,"15min":3.2010000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":6.5759999999999996,"5min":17.189,"15min":115.23699999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":2.4079999999999999,"5min":2.7799999999999998,"15min":3.3940000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.32600000000000001},"max":{"1min":5.4299999999999997,"5min":9.3670000000000009,"15min":114.834},"last":0.89200000000000002}]},{"osd":2,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.976,"5min":3.2810000000000001,"15min":3.3079999999999998},"min":{"1min":0.64000000000000001,"5min":0.621,"15min":0.40799999999999997},"max":{"1min":7.274,"5min":13.641,"15min":22.890000000000001},"last":39.143999999999998},{"interface":"front","average":{"1min":2.581,"5min":3.476,"15min":3.359},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":6.6879999999999997,"5min":17.297000000000001,"15min":17.297000000000001},"last":38.912999999999997}]},{"osd":3,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.758,"5min":3.6819999999999999,"15min":3.569},"min":{"1min":0.503,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":7.6760000000000002,"5min":18.832999999999998,"15min":18.832999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":3.4860000000000002,"5min":3.605,"15min":3.456},"min":{"1min":0.85699999999999998,"5min":0.52300000000000002,"15min":0.438},"max":{"1min":7.1639999999999997,"5min":26.114999999999998,"15min":26.114999999999998},"last":1.1259999999999999}]},{"osd":4,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.4689999999999999,"5min":2.6120000000000001,"15min":2.5259999999999998},"min":{"1min":0.625,"5min":0.61199999999999999,"15min":0.48299999999999998},"max":{"1min":6.7069999999999999,"5min":9.0830000000000002,"15min":10.266999999999999},"last":1.083},{"interface":"front","average":{"1min":2.4590000000000001,"5min":2.5009999999999999,"15min":2.343},"min":{"1min":0.71399999999999997,"5min":0.56899999999999995,"15min":0.50700000000000001},"max":{"1min":7.3979999999999997,"5min":13.512,"15min":22.774000000000001},"last":1.024}]},{"osd":5,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.5139999999999998,"5min":2.569,"15min":2.4009999999999998},"min":{"1min":0.75800000000000001,"5min":0.64200000000000002,"15min":0.51200000000000001},"max":{"1min":7.5039999999999996,"5min":13.734999999999999,"15min":13.734999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":2.2639999999999998,"5min":2.7730000000000001,"15min":2.5339999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":7.3760000000000003,"5min":17.056999999999999,"15min":17.056999999999999},"last":1.4419999999999999}]},{"osd":6,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.7269999999999999,"5min":2.903,"15min":2.6880000000000002},"min":{"1min":0.80600000000000005,"5min":0.68600000000000005,"15min":0.52600000000000002},"max":{"1min":6.8289999999999997,"5min":12.571999999999999,"15min":12.571999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":2.9769999999999999,"5min":2.8559999999999999,"15min":2.589},"min":{"1min":0.79000000000000004,"5min":0.61399999999999999,"15min":0.54600000000000004},"max":{"1min":8.5289999999999999,"5min":13.827999999999999,"15min":13.827999999999999},"last":1.3320000000000001}]},{"osd":7,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.464,"5min":3.1589999999999998,"15min":2.7170000000000001},"min":{"1min":0.77400000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":7.5510000000000002,"5min":18.960999999999999,"15min":18.960999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":2.6419999999999999,"5min":3.2050000000000001,"15min":2.919},"min":{"1min":0.89600000000000002,"5min":0.64900000000000002,"15min":0.53900000000000003},"max":{"1min":6.9320000000000004,"5min":24.904,"15min":24.904},"last":1.3899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834579916,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1774856,"kb_used_data":1088,"kb_used_omap":324,"kb_used_meta":1773435,"kb_avail":92596984,"statfs":{"total":96636764160,"available":94819311616,"internally_reserved":0,"allocated":1114112,"data_stored":815732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":331972,"internal_metadata":1815998268},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":4.492,"5min":3.2429999999999999,"15min":3.1539999999999999},"min":{"1min":0.747,"5min":0.58699999999999997,"15min":0.48499999999999999},"max":{"1min":25.902000000000001,"5min":25.902000000000001,"15min":25.902000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":4.1260000000000003,"5min":3.125,"15min":3.1150000000000002},"min":{"1min":0.98899999999999999,"5min":0.55800000000000005,"15min":0.30499999999999999},"max":{"1min":26.027999999999999,"5min":26.027999999999999,"15min":26.027999999999999},"last":1.228}]},{"osd":2,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":4.4299999999999997,"5min":3.4180000000000001,"15min":3.3399999999999999},"min":{"1min":0.67200000000000004,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":18.809999999999999,"5min":24.140999999999998,"15min":25.704999999999998},"last":1.319},{"interface":"front","average":{"1min":3.8660000000000001,"5min":3.3639999999999999,"15min":3.2280000000000002},"min":{"1min":0.68200000000000005,"5min":0.68100000000000005,"15min":0.504},"max":{"1min":16.922000000000001,"5min":17.381,"15min":25.126000000000001},"last":1.4279999999999999}]},{"osd":3,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":3.5259999999999998,"5min":3.7450000000000001,"15min":3.4550000000000001},"min":{"1min":0.60699999999999998,"5min":0.52800000000000002,"15min":0.39700000000000002},"max":{"1min":10.241,"5min":32.636000000000003,"15min":32.636000000000003},"last":1.494},{"interface":"front","average":{"1min":4.7069999999999999,"5min":3.8660000000000001,"15min":3.7839999999999998},"min":{"1min":0.97899999999999998,"5min":0.56599999999999995,"15min":0.51200000000000001},"max":{"1min":18.385999999999999,"5min":26.202000000000002,"15min":26.202000000000002},"last":1.391}]},{"osd":4,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":2.1000000000000001,"5min":2.375,"15min":2.3799999999999999},"min":{"1min":0.876,"5min":0.70199999999999996,"15min":0.54300000000000004},"max":{"1min":5.3929999999999998,"5min":13.472,"15min":13.472},"last":1.0880000000000001},{"interface":"front","average":{"1min":3.2839999999999998,"5min":2.6429999999999998,"15min":2.3809999999999998},"min":{"1min":0.82199999999999995,"5min":0.60299999999999998,"15min":0.49199999999999999},"max":{"1min":9.9039999999999999,"5min":28.151,"15min":28.151},"last":1.333}]},{"osd":5,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":3.0430000000000001,"5min":2.726,"15min":2.7229999999999999},"min":{"1min":0.999,"5min":0.67300000000000004,"15min":0.46600000000000003},"max":{"1min":8.1099999999999994,"5min":16.670000000000002,"15min":25.186},"last":1.28},{"interface":"front","average":{"1min":2.6989999999999998,"5min":2.6829999999999998,"15min":2.6150000000000002},"min":{"1min":0.93700000000000006,"5min":0.69799999999999995,"15min":0.57099999999999995},"max":{"1min":9.1289999999999996,"5min":11.199,"15min":25.013000000000002},"last":1.913}]},{"osd":6,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":3.3700000000000001,"5min":2.8650000000000002,"15min":2.4980000000000002},"min":{"1min":0.79500000000000004,"5min":0.72499999999999998,"15min":0.53600000000000003},"max":{"1min":10.036,"5min":27.925999999999998,"15min":27.925999999999998},"last":1.7450000000000001},{"interface":"front","average":{"1min":3.7170000000000001,"5min":2.9649999999999999,"15min":2.8849999999999998},"min":{"1min":1.1220000000000001,"5min":0.71199999999999997,"15min":0.55500000000000005},"max":{"1min":16.567,"5min":19.242999999999999,"15min":25.300000000000001},"last":1.548}]},{"osd":7,"last update":"Wed Jan 31 12:08:58 2024","interfaces":[{"interface":"back","average":{"1min":3.3050000000000002,"5min":3.2549999999999999,"15min":2.9199999999999999},"min":{"1min":1.046,"5min":0.77900000000000003,"15min":0.58899999999999997},"max":{"1min":17.152999999999999,"5min":53.951000000000001,"15min":53.951000000000001},"last":2.0499999999999998},{"interface":"front","average":{"1min":3.407,"5min":3.202,"15min":2.7490000000000001},"min":{"1min":0.89400000000000002,"5min":0.65400000000000003,"15min":0.57199999999999995},"max":{"1min":10.141999999999999,"5min":28.053000000000001,"15min":28.053000000000001},"last":1.9610000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-31T12:09:45.146 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-01-31T05:04:04.484734+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=31, tm_hour=5, tm_min=4, tm_sec=4, tm_wday=2, tm_yday=31, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=31, tm_hour=12, tm_min=9, tm_sec=28, tm_wday=2, tm_yday=31, tm_isdst=0) 2024-01-31T12:09:45.146 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-31T12:10:05.147 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-31T12:10:05.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.357+0000 7f0df5000640 1 Processor -- start 2024-01-31T12:10:05.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.357+0000 7f0df5000640 1 -- start start 2024-01-31T12:10:05.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.361+0000 7f0df5000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0df0161620 0x7f0df006a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:10:05.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.361+0000 7f0df5000640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0df0165090 0x7f0df006acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:10:05.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.361+0000 7f0df5000640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df00b3a90 con 0x7f0df00b5260 2024-01-31T12:10:05.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.361+0000 7f0df5000640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df00b3d70 con 0x7f0df0165090 2024-01-31T12:10:05.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.361+0000 7f0df5000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df00b4050 con 0x7f0df0161620 2024-01-31T12:10:05.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.361+0000 7f0def200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0df0165090 0x7f0df006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:10:05.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.365+0000 7f0dede00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0df0161620 0x7f0df006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:10:05.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.365+0000 7f0def200640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7f0df0165090 0x7f0df006acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36308/0 (socket says 172.21.15.49:36308) 2024-01-31T12:10:05.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.365+0000 7f0def200640 1 -- 172.21.15.49:0/708657235 learned_addr learned my addr 172.21.15.49:0/708657235 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:10:05.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.365+0000 7f0def200640 1 -- 172.21.15.49:0/708657235 >> v2:172.21.15.195:3300/0 conn(0x7f0df0161620 msgr2=0x7f0df006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:10:05.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.365+0000 7f0def200640 1 --2- 172.21.15.49:0/708657235 >> v2:172.21.15.195:3300/0 conn(0x7f0df0161620 0x7f0df006a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:05.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.365+0000 7f0def200640 1 -- 172.21.15.49:0/708657235 >> v1:172.21.15.49:6789/0 conn(0x7f0df00b5260 legacy=0x7f0df0071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:10:05.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.365+0000 7f0def200640 1 -- 172.21.15.49:0/708657235 --> v2:172.21.15.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df00b4330 con 0x7f0df0165090 2024-01-31T12:10:05.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.373+0000 7f0def200640 1 --2- 172.21.15.49:0/708657235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0df0165090 0x7f0df006acb0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f0df00b33f0 tx=0x7f0de801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960cbabbe33e93cd server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:10:05.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.373+0000 7f0deca00640 1 -- 172.21.15.49:0/708657235 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de80a5620 con 0x7f0df0165090 2024-01-31T12:10:05.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.373+0000 7f0deca00640 1 -- 172.21.15.49:0/708657235 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de80a5780 con 0x7f0df0165090 2024-01-31T12:10:05.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.373+0000 7f0deca00640 1 -- 172.21.15.49:0/708657235 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de80a5b10 con 0x7f0df0165090 2024-01-31T12:10:05.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.373+0000 7f0df5000640 1 -- 172.21.15.49:0/708657235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0df0165090 msgr2=0x7f0df006acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:10:05.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.373+0000 7f0df5000640 1 --2- 172.21.15.49:0/708657235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0df0165090 0x7f0df006acb0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f0df00b33f0 tx=0x7f0de801c940 comp rx=0 tx=0).stop 2024-01-31T12:10:05.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.373+0000 7f0df5000640 1 -- 172.21.15.49:0/708657235 shutdown_connections 2024-01-31T12:10:05.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.373+0000 7f0df5000640 1 --2- 172.21.15.49:0/708657235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0df0165090 0x7f0df006acb0 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:05.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.373+0000 7f0df5000640 1 --2- 172.21.15.49:0/708657235 >> v2:172.21.15.195:3300/0 conn(0x7f0df0161620 0x7f0df006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:05.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.373+0000 7f0df5000640 1 -- 172.21.15.49:0/708657235 >> 172.21.15.49:0/708657235 conn(0x7f0df00b2350 msgr2=0x7f0df00b2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:10:05.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.377+0000 7f0df5000640 1 -- 172.21.15.49:0/708657235 shutdown_connections 2024-01-31T12:10:05.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.377+0000 7f0df5000640 1 -- 172.21.15.49:0/708657235 wait complete. 2024-01-31T12:10:05.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.381+0000 7f0df5000640 1 Processor -- start 2024-01-31T12:10:05.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.381+0000 7f0df5000640 1 -- start start 2024-01-31T12:10:05.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.381+0000 7f0df5000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0df00b5260 0x7f0df0159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:10:05.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.381+0000 7f0df5000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0df0161620 0x7f0df0151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:10:05.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.381+0000 7f0df5000640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0df0165090 0x7f0df015f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:10:05.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.381+0000 7f0df5000640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df01530d0 con 0x7f0df0165090 2024-01-31T12:10:05.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.381+0000 7f0df5000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df01533b0 con 0x7f0df0161620 2024-01-31T12:10:05.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.381+0000 7f0df5000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df0153690 con 0x7f0df00b5260 2024-01-31T12:10:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.381+0000 7f0def200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0df0165090 0x7f0df015f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:10:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.381+0000 7f0ded400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0df0161620 0x7f0df0151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:10:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.385+0000 7f0dede00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0df00b5260 0x7f0df0159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:10:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.385+0000 7f0def200640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0df0165090 0x7f0df015f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36312/0 (socket says 172.21.15.49:36312) 2024-01-31T12:10:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.385+0000 7f0def200640 1 -- 172.21.15.49:0/2241836668 learned_addr learned my addr 172.21.15.49:0/2241836668 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:10:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.385+0000 7f0dede00640 1 -- 172.21.15.49:0/2241836668 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0df0161620 msgr2=0x7f0df0151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:10:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.385+0000 7f0dede00640 1 --2- 172.21.15.49:0/2241836668 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0df0161620 0x7f0df0151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:05.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.385+0000 7f0dede00640 1 -- 172.21.15.49:0/2241836668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0df0165090 msgr2=0x7f0df015f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:10:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.385+0000 7f0dede00640 1 --2- 172.21.15.49:0/2241836668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0df0165090 0x7f0df015f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.385+0000 7f0dede00640 1 -- 172.21.15.49:0/2241836668 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de8009b30 con 0x7f0df00b5260 2024-01-31T12:10:05.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.385+0000 7f0dede00640 1 --2- 172.21.15.49:0/2241836668 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0df00b5260 0x7f0df0159b40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0de000e870 tx=0x7f0de000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:10:05.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.385+0000 7f0de6000640 1 -- 172.21.15.49:0/2241836668 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de00095d0 con 0x7f0df00b5260 2024-01-31T12:10:05.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.385+0000 7f0de6000640 1 -- 172.21.15.49:0/2241836668 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de000c940 con 0x7f0df00b5260 2024-01-31T12:10:05.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.385+0000 7f0de6000640 1 -- 172.21.15.49:0/2241836668 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de000ccb0 con 0x7f0df00b5260 2024-01-31T12:10:05.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.385+0000 7f0df5000640 1 -- 172.21.15.49:0/2241836668 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df0153970 con 0x7f0df00b5260 2024-01-31T12:10:05.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.385+0000 7f0df5000640 1 -- 172.21.15.49:0/2241836668 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df015a250 con 0x7f0df00b5260 2024-01-31T12:10:05.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.389+0000 7f0df5000640 1 -- 172.21.15.49:0/2241836668 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df015f4d0 con 0x7f0df00b5260 2024-01-31T12:10:05.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.389+0000 7f0de6000640 1 -- 172.21.15.49:0/2241836668 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f0de0013470 con 0x7f0df00b5260 2024-01-31T12:10:05.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.393+0000 7f0de6000640 1 --2- 172.21.15.49:0/2241836668 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0dc8066550 0x7f0dc8068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:10:05.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.393+0000 7f0de6000640 1 -- 172.21.15.49:0/2241836668 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f0de0083dc0 con 0x7f0df00b5260 2024-01-31T12:10:05.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.393+0000 7f0ded400640 1 --2- 172.21.15.49:0/2241836668 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0dc8066550 0x7f0dc8068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:10:05.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.393+0000 7f0ded400640 1 --2- 172.21.15.49:0/2241836668 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0dc8066550 0x7f0dc8068a10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f0df00af5d0 tx=0x7f0dd8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:10:05.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.397+0000 7f0de6000640 1 -- 172.21.15.49:0/2241836668 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f0de0051340 con 0x7f0df00b5260 2024-01-31T12:10:05.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.557+0000 7f0df5000640 1 -- 172.21.15.49:0/2241836668 --> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0df006f3b0 con 0x7f0dc8066550 2024-01-31T12:10:05.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.561+0000 7f0de6000640 1 -- 172.21.15.49:0/2241836668 <== mgr.4100 v2:172.21.15.195:6832/3035808172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49428 (secure 0 0 0) 0x7f0df006f3b0 con 0x7f0dc8066550 2024-01-31T12:10:05.563 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:10:05.563 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-01-31T12:10:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.565+0000 7f0df5000640 1 -- 172.21.15.49:0/2241836668 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0dc8066550 msgr2=0x7f0dc8068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:10:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.565+0000 7f0df5000640 1 --2- 172.21.15.49:0/2241836668 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0dc8066550 0x7f0dc8068a10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f0df00af5d0 tx=0x7f0dd8009040 comp rx=0 tx=0).stop 2024-01-31T12:10:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.565+0000 7f0df5000640 1 -- 172.21.15.49:0/2241836668 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0df00b5260 msgr2=0x7f0df0159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:10:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.565+0000 7f0df5000640 1 --2- 172.21.15.49:0/2241836668 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0df00b5260 0x7f0df0159b40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0de000e870 tx=0x7f0de000ed30 comp rx=0 tx=0).stop 2024-01-31T12:10:05.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.565+0000 7f0df5000640 1 -- 172.21.15.49:0/2241836668 shutdown_connections 2024-01-31T12:10:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.565+0000 7f0df5000640 1 --2- 172.21.15.49:0/2241836668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0df0165090 0x7f0df015f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.565+0000 7f0df5000640 1 --2- 172.21.15.49:0/2241836668 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f0dc8066550 0x7f0dc8068a10 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.565+0000 7f0df5000640 1 --2- 172.21.15.49:0/2241836668 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0df0161620 0x7f0df0151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.565+0000 7f0df5000640 1 --2- 172.21.15.49:0/2241836668 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0df00b5260 0x7f0df0159b40 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.565+0000 7f0df5000640 1 -- 172.21.15.49:0/2241836668 >> 172.21.15.49:0/2241836668 conn(0x7f0df00b2350 msgr2=0x7f0df0154830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:10:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.565+0000 7f0df5000640 1 -- 172.21.15.49:0/2241836668 shutdown_connections 2024-01-31T12:10:05.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:05.565+0000 7f0df5000640 1 -- 172.21.15.49:0/2241836668 wait complete. 2024-01-31T12:10:05.615 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":12814,"stamp":"2024-01-31T12:10:03.981708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12620268,"kb_used_data":5224,"kb_used_omap":3047,"kb_used_meta":12611928,"kb_avail":742354452,"statfs":{"total":773094113280,"available":760170958848,"internally_reserved":0,"allocated":5349376,"data_stored":2983648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3120248,"internal_metadata":12914615176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002269"},"pg_stats":[{"pgid":"1.0","version":"44'119","reported_seq":438,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-01-31T12:09:44.829687+0000","last_change":"2024-01-31T12:09:44.829737+0000","last_active":"2024-01-31T12:09:44.829687+0000","last_peered":"2024-01-31T12:09:44.829687+0000","last_clean":"2024-01-31T12:09:44.829687+0000","last_became_active":"2024-01-31T05:04:05.698239+0000","last_became_peered":"2024-01-31T05:04:05.698239+0000","last_unstale":"2024-01-31T12:09:44.829687+0000","last_undegraded":"2024-01-31T12:09:44.829687+0000","last_fullsized":"2024-01-31T12:09:44.829687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'119","last_scrub_stamp":"2024-01-31T12:09:44.829610+0000","last_deep_scrub":"44'119","last_deep_scrub_stamp":"2024-01-31T12:09:44.829610+0000","last_clean_scrub_stamp":"2024-01-31T12:09:44.829610+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:10:36.726903+0000","scrub_duration":339,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834579960,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1591752,"kb_used_data":1088,"kb_used_omap":157,"kb_used_meta":1590498,"kb_avail":92780088,"statfs":{"total":96636764160,"available":95006810112,"internally_reserved":0,"allocated":1114112,"data_stored":815732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":161111,"internal_metadata":1628670633},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:09:34 2024","interfaces":[{"interface":"back","average":{"1min":2.2280000000000002,"5min":2.2949999999999999,"15min":1.9419999999999999},"min":{"1min":0.47999999999999998,"5min":0.34899999999999998,"15min":0.33700000000000002},"max":{"1min":8.9740000000000002,"5min":50.472000000000001,"15min":50.472000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":2.7240000000000002,"5min":2.8599999999999999,"15min":2.1749999999999998},"min":{"1min":0.63300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":9.0449999999999999,"5min":64.932000000000002,"15min":64.932000000000002},"last":0.99199999999999999}]},{"osd":1,"last update":"Wed Jan 31 12:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.619,"15min":1.8009999999999999},"min":{"1min":0.54700000000000004,"5min":0.43099999999999999,"15min":0.377},"max":{"1min":5.29,"5min":15.550000000000001,"15min":18.547999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.5600000000000001,"5min":1.712,"15min":1.762},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.34799999999999998},"max":{"1min":8.0169999999999995,"5min":14.384,"15min":14.384},"last":0.95299999999999996}]},{"osd":2,"last update":"Wed Jan 31 12:09:18 2024","interfaces":[{"interface":"back","average":{"1min":2.8439999999999999,"5min":1.8700000000000001,"15min":2.0059999999999998},"min":{"1min":0.54400000000000004,"5min":0.47599999999999998,"15min":0.45200000000000001},"max":{"1min":19.978000000000002,"5min":19.978000000000002,"15min":19.978000000000002},"last":0.78500000000000003},{"interface":"front","average":{"1min":2.6299999999999999,"5min":2.5209999999999999,"15min":2.1389999999999998},"min":{"1min":0.75700000000000001,"5min":0.44500000000000001,"15min":0.41799999999999998},"max":{"1min":6.8049999999999997,"5min":65.054000000000002,"15min":65.054000000000002},"last":0.93400000000000005}]},{"osd":3,"last update":"Wed Jan 31 12:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.7490000000000001,"5min":1.9390000000000001,"15min":1.839},"min":{"1min":0.53500000000000003,"5min":0.45200000000000001,"15min":0.435},"max":{"1min":7.7279999999999998,"5min":13.285,"15min":13.285},"last":0.79900000000000004},{"interface":"front","average":{"1min":3.9470000000000001,"5min":2.96,"15min":2.1190000000000002},"min":{"1min":0.56699999999999995,"5min":0.46899999999999997,"15min":0.44},"max":{"1min":36.966999999999999,"5min":65.019000000000005,"15min":65.019000000000005},"last":1.1120000000000001}]},{"osd":4,"last update":"Wed Jan 31 12:09:34 2024","interfaces":[{"interface":"back","average":{"1min":4.6929999999999996,"5min":1.575,"15min":0.94199999999999995},"min":{"1min":0.40300000000000002,"5min":0.34399999999999997,"15min":0.32100000000000001},"max":{"1min":73.091999999999999,"5min":73.091999999999999,"15min":73.091999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":4.3710000000000004,"5min":1.647,"15min":0.98899999999999999},"min":{"1min":0.42199999999999999,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":72.986999999999995,"5min":72.986999999999995,"15min":72.986999999999995},"last":0.62}]},{"osd":5,"last update":"Wed Jan 31 12:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.788,"15min":1.032},"min":{"1min":0.42299999999999999,"5min":0.40600000000000003,"15min":0.35699999999999998},"max":{"1min":5.7960000000000003,"5min":64.986999999999995,"15min":64.986999999999995},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.6970000000000001,"15min":1.056},"min":{"1min":0.45100000000000001,"5min":0.441,"15min":0.36799999999999999},"max":{"1min":5.125,"5min":64.644000000000005,"15min":64.644000000000005},"last":0.63600000000000001}]},{"osd":6,"last update":"Wed Jan 31 12:09:34 2024","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.137,"15min":0.94099999999999995},"min":{"1min":0.53600000000000003,"5min":0.44700000000000001,"15min":0.40999999999999998},"max":{"1min":8,"5min":15.616,"15min":15.616},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.0580000000000001,"15min":0.85999999999999999},"min":{"1min":0.49299999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.7200000000000002,"5min":11.195,"15min":11.195},"last":0.67100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834579961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1474888,"kb_used_data":508,"kb_used_omap":156,"kb_used_meta":1474211,"kb_avail":92896952,"statfs":{"total":96636764160,"available":95126478848,"internally_reserved":0,"allocated":520192,"data_stored":225364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":160451,"internal_metadata":1509592381},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:09:55 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.7270000000000001,"15min":1.778},"min":{"1min":0.47599999999999998,"5min":0.37,"15min":0.312},"max":{"1min":4.9160000000000004,"5min":31.861000000000001,"15min":54.527000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.4730000000000001,"15min":1.726},"min":{"1min":0.52500000000000002,"5min":0.44900000000000001,"15min":0.34000000000000002},"max":{"1min":4.96,"5min":5.71,"15min":54.466999999999999},"last":0.93600000000000005}]},{"osd":1,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.478,"15min":1.8360000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":4.048,"5min":19.844999999999999,"15min":28.239000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.8620000000000001,"15min":1.9299999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.38400000000000001},"max":{"1min":4.1689999999999996,"5min":13.847,"15min":28.364000000000001},"last":0.83899999999999997}]},{"osd":2,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":2.052,"15min":1.9750000000000001},"min":{"1min":0.60499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.8490000000000002,"5min":27.777999999999999,"15min":27.783999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.9670000000000001,"5min":3.1899999999999999,"15min":2.3079999999999998},"min":{"1min":0.68600000000000005,"5min":0.46100000000000002,"15min":0.436},"max":{"1min":7.6669999999999998,"5min":159.67400000000001,"15min":159.67400000000001},"last":0.95699999999999996}]},{"osd":3,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.4419999999999999,"15min":1.8069999999999999},"min":{"1min":0.67300000000000004,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":2.194,"5min":8.1300000000000008,"15min":32.295999999999999},"last":1.054},{"interface":"front","average":{"1min":1.319,"5min":2.1890000000000001,"15min":2.1139999999999999},"min":{"1min":0.64700000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.71,"5min":27.905000000000001,"15min":33.198},"last":0.91300000000000003}]},{"osd":4,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.73699999999999999,"15min":0.71399999999999997},"min":{"1min":0.40600000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.946,"5min":16.628,"15min":16.628},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.70899999999999996},"min":{"1min":0.39300000000000002,"5min":0.378,"15min":0.36899999999999999},"max":{"1min":1.5600000000000001,"5min":4.8460000000000001,"15min":4.8460000000000001},"last":0.77500000000000002}]},{"osd":5,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.83399999999999996,"15min":0.87},"min":{"1min":0.45300000000000001,"5min":0.35399999999999998,"15min":0.33600000000000002},"max":{"1min":0.95199999999999996,"5min":19.120999999999999,"15min":36.438000000000002},"last":0.749},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.86699999999999999,"15min":0.90100000000000002},"min":{"1min":0.42199999999999999,"5min":0.41199999999999998,"15min":0.372},"max":{"1min":2.056,"5min":23.087,"15min":31.077999999999999},"last":0.80600000000000005}]},{"osd":7,"last update":"Wed Jan 31 12:09:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65200000000000002,"15min":0.73999999999999999},"min":{"1min":0.46200000000000002,"5min":0.45000000000000001,"15min":0.33800000000000002},"max":{"1min":1.4990000000000001,"5min":1.613,"15min":4.3499999999999996},"last":0.871},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.92600000000000005,"15min":0.82799999999999996},"min":{"1min":0.498,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.077,"5min":20.317,"15min":20.317},"last":0.69299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834579960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1058692,"kb_used_data":508,"kb_used_omap":757,"kb_used_meta":1057418,"kb_avail":93313148,"statfs":{"total":96636764160,"available":95552663552,"internally_reserved":0,"allocated":520192,"data_stored":225364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":775603,"internal_metadata":1082796621},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":2.98,"5min":2.2890000000000001,"15min":2.8660000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.29699999999999999},"max":{"1min":31.5,"5min":33.741999999999997,"15min":281.83499999999998},"last":0.86599999999999999},{"interface":"front","average":{"1min":3.581,"5min":2.339,"15min":3.004},"min":{"1min":0.69999999999999996,"5min":0.37,"15min":0.34300000000000003},"max":{"1min":31.524999999999999,"5min":35.189,"15min":277.49700000000001},"last":1.0269999999999999}]},{"osd":1,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":4.3179999999999996,"5min":2.7189999999999999,"15min":2.085},"min":{"1min":0.44600000000000001,"5min":0.372,"15min":0.372},"max":{"1min":34.063000000000002,"5min":34.063000000000002,"15min":34.063000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":3.2160000000000002,"5min":2.5459999999999998,"15min":2.0489999999999999},"min":{"1min":0.60899999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":32.128999999999998,"5min":32.128999999999998,"15min":32.128999999999998},"last":0.83899999999999997}]},{"osd":2,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":4.0780000000000003,"5min":2.431,"15min":3.6080000000000001},"min":{"1min":0.57199999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":36,"5min":36,"15min":279.86399999999998},"last":0.98199999999999998},{"interface":"front","average":{"1min":3.7650000000000001,"5min":2.4769999999999999,"15min":3.7229999999999999},"min":{"1min":0.56699999999999995,"5min":0.50700000000000001,"15min":0.40999999999999998},"max":{"1min":35.978999999999999,"5min":35.978999999999999,"15min":279.15699999999998},"last":0.81699999999999995}]},{"osd":3,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":3.0739999999999998,"5min":2.3490000000000002,"15min":2.4940000000000002},"min":{"1min":0.59799999999999998,"5min":0.51900000000000002,"15min":0.435},"max":{"1min":32.176000000000002,"5min":32.176000000000002,"15min":160.709},"last":1.175},{"interface":"front","average":{"1min":4.0700000000000003,"5min":2.4129999999999998,"15min":2.7120000000000002},"min":{"1min":0.82199999999999995,"5min":0.60499999999999998,"15min":0.46300000000000002},"max":{"1min":35.912999999999997,"5min":35.912999999999997,"15min":162.26599999999999},"last":0.92600000000000005}]},{"osd":4,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":2.25,"5min":1.2130000000000001,"15min":0.81299999999999994},"min":{"1min":0.40000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":32.652999999999999,"5min":32.652999999999999,"15min":32.652999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":2.431,"5min":1.246,"15min":0.86099999999999999},"min":{"1min":0.434,"5min":0.36299999999999999,"15min":0.33200000000000002},"max":{"1min":32.247,"5min":32.247,"15min":32.247},"last":0.66100000000000003}]},{"osd":6,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":2.7069999999999999,"5min":1.411,"15min":0.91300000000000003},"min":{"1min":0.47199999999999998,"5min":0.35799999999999998,"15min":0.34100000000000003},"max":{"1min":35.957999999999998,"5min":35.957999999999998,"15min":35.957999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":2.5720000000000001,"5min":1.2669999999999999,"15min":0.88800000000000001},"min":{"1min":0.47699999999999998,"5min":0.40200000000000002,"15min":0.38},"max":{"1min":36.444000000000003,"5min":36.444000000000003,"15min":36.444000000000003},"last":0.75}]},{"osd":7,"last update":"Wed Jan 31 12:09:23 2024","interfaces":[{"interface":"back","average":{"1min":2.8140000000000001,"5min":1.667,"15min":1.0429999999999999},"min":{"1min":0.44900000000000001,"5min":0.42599999999999999,"15min":0.375},"max":{"1min":32.799999999999997,"5min":39.918999999999997,"15min":39.918999999999997},"last":0.79500000000000004},{"interface":"front","average":{"1min":2.964,"5min":1.6890000000000001,"15min":1.0569999999999999},"min":{"1min":0.53700000000000003,"5min":0.44800000000000001,"15min":0.42599999999999999},"max":{"1min":36.073999999999998,"5min":39.860999999999997,"15min":39.860999999999997},"last":0.68300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834579960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1745092,"kb_used_data":508,"kb_used_omap":549,"kb_used_meta":1744026,"kb_avail":92626748,"statfs":{"total":96636764160,"available":94849789952,"internally_reserved":0,"allocated":520192,"data_stored":225364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":562466,"internal_metadata":1785883358},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.242,"15min":2.0920000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36299999999999999},"max":{"1min":5.7450000000000001,"5min":14.096,"15min":158.78200000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.4750000000000001,"15min":2.2029999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.33900000000000002},"max":{"1min":5.5800000000000001,"5min":5.5800000000000001,"15min":158.45400000000001},"last":1.032}]},{"osd":1,"last update":"Wed Jan 31 12:09:44 2024","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.7150000000000001,"15min":2.2629999999999999},"min":{"1min":0.58999999999999997,"5min":0.42199999999999999,"15min":0.38100000000000001},"max":{"1min":5.4749999999999996,"5min":7.9909999999999997,"15min":158.959},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.871,"15min":2.403},"min":{"1min":0.5,"5min":0.5,"15min":0.35199999999999998},"max":{"1min":4.1559999999999997,"5min":9.2490000000000006,"15min":158.69200000000001},"last":1.198}]},{"osd":2,"last update":"Wed Jan 31 12:09:44 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.9019999999999999,"15min":2.3530000000000002},"min":{"1min":0.66800000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":6.875,"5min":7.8890000000000002,"15min":158.232},"last":0.80900000000000005},{"interface":"front","average":{"1min":7.1989999999999998,"5min":2.903,"15min":2.7469999999999999},"min":{"1min":0.496,"5min":0.44700000000000001,"15min":0.438},"max":{"1min":113.776,"5min":113.776,"15min":157.76300000000001},"last":0.84999999999999998}]},{"osd":3,"last update":"Wed Jan 31 12:09:44 2024","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":1.8440000000000001,"15min":2.3340000000000001},"min":{"1min":0.60299999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":9.2680000000000007,"5min":9.2680000000000007,"15min":155.27799999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.823,"5min":1.5840000000000001,"15min":2.246},"min":{"1min":0.52200000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":9.093,"5min":9.093,"15min":156.81700000000001},"last":1.0569999999999999}]},{"osd":5,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.79600000000000004,"15min":0.67800000000000005},"min":{"1min":0.42399999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.93500000000000005,"5min":9.1120000000000001,"15min":9.1120000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72699999999999998,"15min":0.69299999999999995},"min":{"1min":0.53700000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91100000000000003,"5min":4.3959999999999999,"15min":4.6840000000000002},"last":0.79100000000000004}]},{"osd":6,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.81799999999999995,"15min":0.73299999999999998},"min":{"1min":0.46200000000000002,"5min":0.379,"15min":0.35699999999999998},"max":{"1min":3.294,"5min":7.7930000000000001,"15min":7.7930000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.82099999999999995,"15min":0.72199999999999998},"min":{"1min":0.51300000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.2929999999999999,"5min":11.791,"15min":11.791},"last":0.69399999999999995}]},{"osd":7,"last update":"Wed Jan 31 12:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79000000000000004,"15min":0.73299999999999998},"min":{"1min":0.502,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.5840000000000001,"5min":4.0919999999999996,"15min":5.5869999999999997},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.878,"15min":0.78900000000000003},"min":{"1min":0.504,"5min":0.41399999999999998,"15min":0.38800000000000001},"max":{"1min":3.395,"5min":7.8449999999999998,"15min":7.8449999999999998},"last":0.752}]}]},{"osd":3,"up_from":13,"seq":55834579907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1692100,"kb_used_data":508,"kb_used_omap":532,"kb_used_meta":1691051,"kb_avail":92679740,"statfs":{"total":96636764160,"available":94904053760,"internally_reserved":0,"allocated":520192,"data_stored":225364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":545051,"internal_metadata":1731636965},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":2.5960000000000001,"5min":2.7749999999999999,"15min":4.0369999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.28000000000000003},"max":{"1min":12.754,"5min":14.579000000000001,"15min":273.40300000000002},"last":1.276},{"interface":"front","average":{"1min":2.5880000000000001,"5min":2.5899999999999999,"15min":4.1310000000000002},"min":{"1min":0.52500000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":13.122999999999999,"5min":13.122999999999999,"15min":278.26600000000002},"last":1.069}]},{"osd":1,"last update":"Wed Jan 31 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":2.746,"5min":2.7970000000000002,"15min":3.1110000000000002},"min":{"1min":0.69599999999999995,"5min":0.58699999999999997,"15min":0.437},"max":{"1min":11.002000000000001,"5min":11.002000000000001,"15min":12.739000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":2.742,"5min":3.0659999999999998,"15min":3.2109999999999999},"min":{"1min":0.80500000000000005,"5min":0.58499999999999996,"15min":0.46100000000000002},"max":{"1min":12.151,"5min":12.151,"15min":12.592000000000001},"last":0.92600000000000005}]},{"osd":2,"last update":"Wed Jan 31 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":2.3199999999999998,"5min":2.6819999999999999,"15min":4.0460000000000003},"min":{"1min":0.753,"5min":0.629,"15min":0.38500000000000001},"max":{"1min":12.004,"5min":12.004,"15min":278.33300000000003},"last":1.2430000000000001},{"interface":"front","average":{"1min":9.4600000000000009,"5min":4.6440000000000001,"15min":4.8339999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.44400000000000001},"max":{"1min":141.08199999999999,"5min":141.08199999999999,"15min":273.27100000000002},"last":1.04}]},{"osd":4,"last update":"Wed Jan 31 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":1.6160000000000001,"5min":2.0710000000000002,"15min":2.423},"min":{"1min":0.77700000000000002,"5min":0.53400000000000003,"15min":0.47499999999999998},"max":{"1min":4.2910000000000004,"5min":7.4550000000000001,"15min":9.7460000000000004},"last":1.113},{"interface":"front","average":{"1min":1.6220000000000001,"5min":2.1589999999999998,"15min":2.29},"min":{"1min":0.69699999999999995,"5min":0.69499999999999995,"15min":0.502},"max":{"1min":3.4369999999999998,"5min":6.2089999999999996,"15min":10.071999999999999},"last":1.335}]},{"osd":5,"last update":"Wed Jan 31 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":1.726,"5min":2.3330000000000002,"15min":2.6659999999999999},"min":{"1min":0.877,"5min":0.627,"15min":0.52100000000000002},"max":{"1min":3.4809999999999999,"5min":11.385,"15min":55.942999999999998},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.609,"5min":2.4489999999999998,"15min":2.6840000000000002},"min":{"1min":0.59599999999999997,"5min":0.52700000000000002,"15min":0.49199999999999999},"max":{"1min":4.2569999999999997,"5min":7.556,"15min":56.850999999999999},"last":1.1859999999999999}]},{"osd":6,"last update":"Wed Jan 31 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":1.679,"5min":2.6030000000000002,"15min":2.617},"min":{"1min":0.67100000000000004,"5min":0.59699999999999998,"15min":0.52400000000000002},"max":{"1min":4.5250000000000004,"5min":14.464,"15min":14.464},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.6180000000000001,"5min":2.226,"15min":2.597},"min":{"1min":0.745,"5min":0.61899999999999999,"15min":0.51300000000000001},"max":{"1min":4.3339999999999996,"5min":9.5690000000000008,"15min":9.6989999999999998},"last":0.96899999999999997}]},{"osd":7,"last update":"Wed Jan 31 12:09:36 2024","interfaces":[{"interface":"back","average":{"1min":2.2330000000000001,"5min":2.492,"15min":3.004},"min":{"1min":0.79900000000000004,"5min":0.71399999999999997,"15min":0.56399999999999995},"max":{"1min":12.066000000000001,"5min":17.34,"15min":55.713999999999999},"last":1.3089999999999999},{"interface":"front","average":{"1min":2.2589999999999999,"5min":2.613,"15min":2.8500000000000001},"min":{"1min":0.85199999999999998,"5min":0.66400000000000003,"15min":0.58699999999999997},"max":{"1min":11.148999999999999,"5min":17.274000000000001,"15min":55.619},"last":1.2210000000000001}]}]},{"osd":2,"up_from":13,"seq":55834579915,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1796932,"kb_used_data":508,"kb_used_omap":168,"kb_used_meta":1796247,"kb_avail":92574908,"statfs":{"total":96636764160,"available":94796705792,"internally_reserved":0,"allocated":520192,"data_stored":225364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":173049,"internal_metadata":1839356935},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:09:53 2024","interfaces":[{"interface":"back","average":{"1min":3.766,"5min":2.8719999999999999,"15min":2.9510000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":20.994,"5min":26.771000000000001,"15min":26.771000000000001},"last":1},{"interface":"front","average":{"1min":4.5720000000000001,"5min":3.383,"15min":3.1850000000000001},"min":{"1min":0.89100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":21.100999999999999,"5min":21.100999999999999,"15min":21.100999999999999},"last":1.3799999999999999}]},{"osd":1,"last update":"Wed Jan 31 12:09:53 2024","interfaces":[{"interface":"back","average":{"1min":3.9529999999999998,"5min":3.9180000000000001,"15min":3.343},"min":{"1min":0.69799999999999995,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":21.402999999999999,"5min":48.207999999999998,"15min":48.207999999999998},"last":0.84299999999999997},{"interface":"front","average":{"1min":4.0339999999999998,"5min":4.1900000000000004,"15min":3.7080000000000002},"min":{"1min":0.874,"5min":0.624,"15min":0.35799999999999998},"max":{"1min":21.178999999999998,"5min":49.024999999999999,"15min":49.024999999999999},"last":0.88200000000000001}]},{"osd":3,"last update":"Wed Jan 31 12:09:53 2024","interfaces":[{"interface":"back","average":{"1min":3.742,"5min":4.2610000000000001,"15min":3.7280000000000002},"min":{"1min":0.84599999999999997,"5min":0.69099999999999995,"15min":0.57399999999999995},"max":{"1min":21.925000000000001,"5min":35.802,"15min":35.802},"last":1.0489999999999999},{"interface":"front","average":{"1min":3.8460000000000001,"5min":4.6760000000000002,"15min":3.9489999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.47299999999999998},"max":{"1min":21.986000000000001,"5min":48.682000000000002,"15min":48.682000000000002},"last":1.131}]},{"osd":4,"last update":"Wed Jan 31 12:09:53 2024","interfaces":[{"interface":"back","average":{"1min":3.52,"5min":3.2029999999999998,"15min":2.8109999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.50700000000000001},"max":{"1min":21.620000000000001,"5min":33.631,"15min":33.631},"last":1.1839999999999999},{"interface":"front","average":{"1min":4.3620000000000001,"5min":3.2999999999999998,"15min":2.9249999999999998},"min":{"1min":0.73899999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":21.803000000000001,"5min":33.277000000000001,"15min":33.277000000000001},"last":1.4710000000000001}]},{"osd":5,"last update":"Wed Jan 31 12:09:53 2024","interfaces":[{"interface":"back","average":{"1min":3.6930000000000001,"5min":3.7160000000000002,"15min":3.085},"min":{"1min":1.1220000000000001,"5min":0.67500000000000004,"15min":0.55000000000000004},"max":{"1min":21.678999999999998,"5min":44.935000000000002,"15min":44.935000000000002},"last":1.329},{"interface":"front","average":{"1min":4.452,"5min":3.4580000000000002,"15min":3.0699999999999998},"min":{"1min":0.95199999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":21.847999999999999,"5min":44.590000000000003,"15min":44.590000000000003},"last":1.5309999999999999}]},{"osd":6,"last update":"Wed Jan 31 12:09:53 2024","interfaces":[{"interface":"back","average":{"1min":3.4289999999999998,"5min":2.8239999999999998,"15min":2.637},"min":{"1min":0.67100000000000004,"5min":0.66200000000000003,"15min":0.60099999999999998},"max":{"1min":21.57,"5min":26.259,"15min":26.259},"last":1.3500000000000001},{"interface":"front","average":{"1min":3.7429999999999999,"5min":3.2349999999999999,"15min":3.0379999999999998},"min":{"1min":0.78700000000000003,"5min":0.71499999999999997,"15min":0.56899999999999995},"max":{"1min":21.731000000000002,"5min":21.731000000000002,"15min":21.731000000000002},"last":1.4199999999999999}]},{"osd":7,"last update":"Wed Jan 31 12:09:53 2024","interfaces":[{"interface":"back","average":{"1min":3.4990000000000001,"5min":2.7970000000000002,"15min":2.6760000000000002},"min":{"1min":0.71999999999999997,"5min":0.69199999999999995,"15min":0.56799999999999995},"max":{"1min":21.748000000000001,"5min":21.748000000000001,"15min":21.748000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":4.5640000000000001,"5min":3.472,"15min":3.2189999999999999},"min":{"1min":1.032,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":21.702000000000002,"5min":23.294,"15min":23.294},"last":1.603}]}]},{"osd":1,"up_from":13,"seq":55834579925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1485956,"kb_used_data":508,"kb_used_omap":400,"kb_used_meta":1485039,"kb_avail":92885884,"statfs":{"total":96636764160,"available":95115145216,"internally_reserved":0,"allocated":520192,"data_stored":225364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":410545,"internal_metadata":1520680015},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.532,"5min":2.9990000000000001,"15min":3.2010000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":6.5759999999999996,"5min":17.189,"15min":115.23699999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":2.4079999999999999,"5min":2.7799999999999998,"15min":3.3940000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.32600000000000001},"max":{"1min":5.4299999999999997,"5min":9.3670000000000009,"15min":114.834},"last":0.84299999999999997}]},{"osd":2,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.976,"5min":3.2810000000000001,"15min":3.3079999999999998},"min":{"1min":0.64000000000000001,"5min":0.621,"15min":0.40799999999999997},"max":{"1min":7.274,"5min":13.641,"15min":22.890000000000001},"last":1.044},{"interface":"front","average":{"1min":2.581,"5min":3.476,"15min":3.359},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":6.6879999999999997,"5min":17.297000000000001,"15min":17.297000000000001},"last":0.92700000000000005}]},{"osd":3,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.758,"5min":3.6819999999999999,"15min":3.569},"min":{"1min":0.503,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":7.6760000000000002,"5min":18.832999999999998,"15min":18.832999999999998},"last":0.95899999999999996},{"interface":"front","average":{"1min":3.4860000000000002,"5min":3.605,"15min":3.456},"min":{"1min":0.85699999999999998,"5min":0.52300000000000002,"15min":0.438},"max":{"1min":7.1639999999999997,"5min":26.114999999999998,"15min":26.114999999999998},"last":1.2769999999999999}]},{"osd":4,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.4689999999999999,"5min":2.6120000000000001,"15min":2.5259999999999998},"min":{"1min":0.625,"5min":0.61199999999999999,"15min":0.48299999999999998},"max":{"1min":6.7069999999999999,"5min":9.0830000000000002,"15min":10.266999999999999},"last":1.4059999999999999},{"interface":"front","average":{"1min":2.4590000000000001,"5min":2.5009999999999999,"15min":2.343},"min":{"1min":0.71399999999999997,"5min":0.56899999999999995,"15min":0.50700000000000001},"max":{"1min":7.3979999999999997,"5min":13.512,"15min":22.774000000000001},"last":1.3300000000000001}]},{"osd":5,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.5139999999999998,"5min":2.569,"15min":2.4009999999999998},"min":{"1min":0.75800000000000001,"5min":0.64200000000000002,"15min":0.51200000000000001},"max":{"1min":7.5039999999999996,"5min":13.734999999999999,"15min":13.734999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":2.2639999999999998,"5min":2.7730000000000001,"15min":2.5339999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":7.3760000000000003,"5min":17.056999999999999,"15min":17.056999999999999},"last":1.2490000000000001}]},{"osd":6,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.7269999999999999,"5min":2.903,"15min":2.6880000000000002},"min":{"1min":0.80600000000000005,"5min":0.68600000000000005,"15min":0.52600000000000002},"max":{"1min":6.8289999999999997,"5min":12.571999999999999,"15min":12.571999999999999},"last":1.482},{"interface":"front","average":{"1min":2.9769999999999999,"5min":2.8559999999999999,"15min":2.589},"min":{"1min":0.79000000000000004,"5min":0.61399999999999999,"15min":0.54600000000000004},"max":{"1min":8.5289999999999999,"5min":13.827999999999999,"15min":13.827999999999999},"last":1.4530000000000001}]},{"osd":7,"last update":"Wed Jan 31 12:09:08 2024","interfaces":[{"interface":"back","average":{"1min":2.464,"5min":3.1589999999999998,"15min":2.7170000000000001},"min":{"1min":0.77400000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":7.5510000000000002,"5min":18.960999999999999,"15min":18.960999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":2.6419999999999999,"5min":3.2050000000000001,"15min":2.919},"min":{"1min":0.89600000000000002,"5min":0.64900000000000002,"15min":0.53900000000000003},"max":{"1min":6.9320000000000004,"5min":24.904,"15min":24.904},"last":1.55}]}]},{"osd":0,"up_from":13,"seq":55834579920,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1774856,"kb_used_data":1088,"kb_used_omap":324,"kb_used_meta":1773435,"kb_avail":92596984,"statfs":{"total":96636764160,"available":94819311616,"internally_reserved":0,"allocated":1114112,"data_stored":815732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":331972,"internal_metadata":1815998268},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 31 12:09:58 2024","interfaces":[{"interface":"back","average":{"1min":1.7909999999999999,"5min":3.0369999999999999,"15min":3.0499999999999998},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.48499999999999999},"max":{"1min":7.2800000000000002,"5min":25.902000000000001,"15min":25.902000000000001},"last":1.129},{"interface":"front","average":{"1min":1.9099999999999999,"5min":3.0739999999999998,"15min":2.984},"min":{"1min":0.872,"5min":0.70099999999999996,"15min":0.30499999999999999},"max":{"1min":9.2210000000000001,"5min":26.027999999999999,"15min":26.027999999999999},"last":1.3169999999999999}]},{"osd":2,"last update":"Wed Jan 31 12:09:58 2024","interfaces":[{"interface":"back","average":{"1min":12.851000000000001,"5min":5.4139999999999997,"15min":3.96},"min":{"1min":0.67200000000000004,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":220.91300000000001,"5min":220.91300000000001,"15min":220.91300000000001},"last":1.55},{"interface":"front","average":{"1min":1.8979999999999999,"5min":3.0489999999999999,"15min":3.0880000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.504},"max":{"1min":8.0549999999999997,"5min":17.381,"15min":25.126000000000001},"last":1.046}]},{"osd":3,"last update":"Wed Jan 31 12:09:58 2024","interfaces":[{"interface":"back","average":{"1min":2.9700000000000002,"5min":3.6299999999999999,"15min":3.3940000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.39700000000000002},"max":{"1min":15.401,"5min":32.636000000000003,"15min":32.636000000000003},"last":1.621},{"interface":"front","average":{"1min":2.5139999999999998,"5min":3.6859999999999999,"15min":3.7090000000000001},"min":{"1min":1.0429999999999999,"5min":0.56599999999999995,"15min":0.51200000000000001},"max":{"1min":8.7279999999999998,"5min":26.202000000000002,"15min":26.202000000000002},"last":1.7689999999999999}]},{"osd":4,"last update":"Wed Jan 31 12:09:58 2024","interfaces":[{"interface":"back","average":{"1min":1.7509999999999999,"5min":2.2330000000000001,"15min":2.2949999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.54300000000000004},"max":{"1min":8.1880000000000006,"5min":13.472,"15min":13.472},"last":1.45},{"interface":"front","average":{"1min":1.9359999999999999,"5min":2.5489999999999999,"15min":2.367},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.49199999999999999},"max":{"1min":7.8710000000000004,"5min":28.151,"15min":28.151},"last":1.103}]},{"osd":5,"last update":"Wed Jan 31 12:09:58 2024","interfaces":[{"interface":"back","average":{"1min":1.8839999999999999,"5min":2.508,"15min":2.6400000000000001},"min":{"1min":0.872,"5min":0.67300000000000004,"15min":0.46600000000000003},"max":{"1min":7.5540000000000003,"5min":16.670000000000002,"15min":25.186},"last":1.9359999999999999},{"interface":"front","average":{"1min":1.9930000000000001,"5min":2.544,"15min":2.5299999999999998},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.57099999999999995},"max":{"1min":8.3140000000000001,"5min":11.199,"15min":25.013000000000002},"last":1.5229999999999999}]},{"osd":6,"last update":"Wed Jan 31 12:09:58 2024","interfaces":[{"interface":"back","average":{"1min":18.699000000000002,"5min":6.0519999999999996,"15min":3.593},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.53600000000000003},"max":{"1min":331.28199999999998,"5min":331.28199999999998,"15min":331.28199999999998},"last":1.4850000000000001},{"interface":"front","average":{"1min":18.466999999999999,"5min":6.0300000000000002,"15min":3.8969999999999998},"min":{"1min":0.79100000000000004,"5min":0.71899999999999997,"15min":0.55500000000000005},"max":{"1min":330.95100000000002,"5min":330.95100000000002,"15min":330.95100000000002},"last":2.0249999999999999}]},{"osd":7,"last update":"Wed Jan 31 12:09:58 2024","interfaces":[{"interface":"back","average":{"1min":2.1019999999999999,"5min":3.145,"15min":2.8380000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.58899999999999997},"max":{"1min":8.4320000000000004,"5min":53.951000000000001,"15min":53.951000000000001},"last":1.5960000000000001},{"interface":"front","average":{"1min":2.4940000000000002,"5min":3.101,"15min":2.7570000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":14.141999999999999,"5min":28.053000000000001,"15min":28.053000000000001},"last":1.698}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-31T12:10:05.617 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-31T12:10:06.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.009+0000 7f86c5400640 1 Processor -- start 2024-01-31T12:10:06.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.013+0000 7f86c5400640 1 -- start start 2024-01-31T12:10:06.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.013+0000 7f86c5400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f86c00cf670 0x7f86c00b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:10:06.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.013+0000 7f86c5400640 1 -- --> v1:172.21.15.49:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c00c6800 con 0x7f86c00c63d0 2024-01-31T12:10:06.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.013+0000 7f86c5400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c00c6ab0 con 0x7f86c015e7e0 2024-01-31T12:10:06.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.013+0000 7f86c5400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c00d1d40 con 0x7f86c00cf670 2024-01-31T12:10:06.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.017+0000 7f86be800640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f86c015e7e0 0x7f86c00cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:41284/0 (socket says 172.21.15.49:41284) 2024-01-31T12:10:06.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.017+0000 7f86be800640 1 -- 172.21.15.49:0/4291178904 learned_addr learned my addr 172.21.15.49:0/4291178904 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:10:06.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.017+0000 7f86bde00640 1 --2- 172.21.15.49:0/4291178904 >> v2:172.21.15.195:3300/0 conn(0x7f86c00cf670 0x7f86c00b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:10:06.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.017+0000 7f86bd400640 1 -- 172.21.15.49:0/4291178904 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350214347 0 0) 0x7f86c00c6ab0 con 0x7f86c015e7e0 2024-01-31T12:10:06.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.017+0000 7f86bd400640 1 -- 172.21.15.49:0/4291178904 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86a0003530 con 0x7f86c015e7e0 2024-01-31T12:10:06.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.017+0000 7f86bd400640 1 -- 172.21.15.49:0/4291178904 <== mon.0 v1:172.21.15.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253007402 0 0) 0x7f86c00c6800 con 0x7f86c00c63d0 2024-01-31T12:10:06.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.017+0000 7f86bd400640 1 -- 172.21.15.49:0/4291178904 --> v1:172.21.15.49:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86c00c6ab0 con 0x7f86c00c63d0 2024-01-31T12:10:06.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.017+0000 7f86bde00640 1 -- 172.21.15.49:0/4291178904 >> v1:172.21.15.195:6789/0 conn(0x7f86c015e7e0 legacy=0x7f86c00cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:10:06.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.017+0000 7f86bde00640 1 -- 172.21.15.49:0/4291178904 >> v1:172.21.15.49:6789/0 conn(0x7f86c00c63d0 legacy=0x7f86c00cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:10:06.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.017+0000 7f86bde00640 1 -- 172.21.15.49:0/4291178904 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c00c6d90 con 0x7f86c00cf670 2024-01-31T12:10:06.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.025+0000 7f86bde00640 1 --2- 172.21.15.49:0/4291178904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86c00cf670 0x7f86c00b2370 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f86a80097c0 tx=0x7f86a801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf97281b3b3a7c2a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:10:06.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.029+0000 7f86bd400640 1 -- 172.21.15.49:0/4291178904 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a80a8970 con 0x7f86c00cf670 2024-01-31T12:10:06.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.029+0000 7f86bd400640 1 -- 172.21.15.49:0/4291178904 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a80a8ad0 con 0x7f86c00cf670 2024-01-31T12:10:06.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.029+0000 7f86bd400640 1 -- 172.21.15.49:0/4291178904 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a80a8e60 con 0x7f86c00cf670 2024-01-31T12:10:06.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.029+0000 7f86c5400640 1 -- 172.21.15.49:0/4291178904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86c00cf670 msgr2=0x7f86c00b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:10:06.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.029+0000 7f86c5400640 1 --2- 172.21.15.49:0/4291178904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86c00cf670 0x7f86c00b2370 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f86a80097c0 tx=0x7f86a801ec70 comp rx=0 tx=0).stop 2024-01-31T12:10:06.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.029+0000 7f86c5400640 1 -- 172.21.15.49:0/4291178904 shutdown_connections 2024-01-31T12:10:06.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.029+0000 7f86c5400640 1 --2- 172.21.15.49:0/4291178904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86c00cf670 0x7f86c00b2370 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:06.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.029+0000 7f86c5400640 1 -- 172.21.15.49:0/4291178904 >> 172.21.15.49:0/4291178904 conn(0x7f86c00d0e60 msgr2=0x7f86c00d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:10:06.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.029+0000 7f86c5400640 1 -- 172.21.15.49:0/4291178904 shutdown_connections 2024-01-31T12:10:06.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.029+0000 7f86c5400640 1 -- 172.21.15.49:0/4291178904 wait complete. 2024-01-31T12:10:06.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.033+0000 7f86c5400640 1 Processor -- start 2024-01-31T12:10:06.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.033+0000 7f86c5400640 1 -- start start 2024-01-31T12:10:06.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.037+0000 7f86c5400640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86c00c63d0 0x7f86c009e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:10:06.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.037+0000 7f86c5400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86c00cf670 0x7f86c00b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:10:06.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.037+0000 7f86c5400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86c015e7e0 0x7f86c00b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:10:06.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.037+0000 7f86c5400640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c014a5c0 con 0x7f86c00c63d0 2024-01-31T12:10:06.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.037+0000 7f86c5400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c00b1790 con 0x7f86c015e7e0 2024-01-31T12:10:06.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.037+0000 7f86c5400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c00aed10 con 0x7f86c00cf670 2024-01-31T12:10:06.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.037+0000 7f86be800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86c00c63d0 0x7f86c009e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:10:06.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.037+0000 7f86be800640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86c00c63d0 0x7f86c009e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36322/0 (socket says 172.21.15.49:36322) 2024-01-31T12:10:06.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.037+0000 7f86be800640 1 -- 172.21.15.49:0/3009020410 learned_addr learned my addr 172.21.15.49:0/3009020410 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:10:06.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.037+0000 7f86bde00640 1 --2- 172.21.15.49:0/3009020410 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86c00cf670 0x7f86c00b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:10:06.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.037+0000 7f86bf200640 1 --2- 172.21.15.49:0/3009020410 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86c015e7e0 0x7f86c00b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:10:06.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.037+0000 7f86be800640 1 -- 172.21.15.49:0/3009020410 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86c00cf670 msgr2=0x7f86c00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:10:06.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.037+0000 7f86be800640 1 --2- 172.21.15.49:0/3009020410 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86c00cf670 0x7f86c00b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:06.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.037+0000 7f86be800640 1 -- 172.21.15.49:0/3009020410 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86c015e7e0 msgr2=0x7f86c00b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:10:06.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.037+0000 7f86be800640 1 --2- 172.21.15.49:0/3009020410 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86c015e7e0 0x7f86c00b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:06.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.037+0000 7f86be800640 1 -- 172.21.15.49:0/3009020410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a8009420 con 0x7f86c00c63d0 2024-01-31T12:10:06.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.037+0000 7f86bf200640 1 --2- 172.21.15.49:0/3009020410 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86c015e7e0 0x7f86c00b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T12:10:06.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.041+0000 7f86be800640 1 --2- 172.21.15.49:0/3009020410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86c00c63d0 0x7f86c009e740 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f86b000c4f0 tx=0x7f86b000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:10:06.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.041+0000 7f86b6a00640 1 -- 172.21.15.49:0/3009020410 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0005cf0 con 0x7f86c00c63d0 2024-01-31T12:10:06.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.041+0000 7f86b6a00640 1 -- 172.21.15.49:0/3009020410 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b0005e50 con 0x7f86c00c63d0 2024-01-31T12:10:06.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.041+0000 7f86b6a00640 1 -- 172.21.15.49:0/3009020410 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0007270 con 0x7f86c00c63d0 2024-01-31T12:10:06.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.041+0000 7f86c5400640 1 -- 172.21.15.49:0/3009020410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c009ec80 con 0x7f86c00c63d0 2024-01-31T12:10:06.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.041+0000 7f86c5400640 1 -- 172.21.15.49:0/3009020410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c0149f00 con 0x7f86c00c63d0 2024-01-31T12:10:06.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.041+0000 7f86b6a00640 1 -- 172.21.15.49:0/3009020410 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7f86b00073d0 con 0x7f86c00c63d0 2024-01-31T12:10:06.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.041+0000 7f86c5400640 1 -- 172.21.15.49:0/3009020410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c00c4380 con 0x7f86c00c63d0 2024-01-31T12:10:06.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.045+0000 7f86b6a00640 1 --2- 172.21.15.49:0/3009020410 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8698066500 0x7f86980689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:10:06.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.045+0000 7f86b6a00640 1 -- 172.21.15.49:0/3009020410 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f86b0083350 con 0x7f86c00c63d0 2024-01-31T12:10:06.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.049+0000 7f86bde00640 1 --2- 172.21.15.49:0/3009020410 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8698066500 0x7f86980689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:10:06.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.049+0000 7f86bde00640 1 --2- 172.21.15.49:0/3009020410 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8698066500 0x7f86980689c0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f86a80b2000 tx=0x7f86a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:10:06.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.061+0000 7f86b6a00640 1 -- 172.21.15.49:0/3009020410 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7f86b0050730 con 0x7f86c00c63d0 2024-01-31T12:10:06.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.529+0000 7f86c5400640 1 -- 172.21.15.49:0/3009020410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f86c0149d60 con 0x7f86c00c63d0 2024-01-31T12:10:06.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.537+0000 7f86b6a00640 1 -- 172.21.15.49:0/3009020410 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f86c0149d60 con 0x7f86c00c63d0 2024-01-31T12:10:06.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.537+0000 7f86b6a00640 1 -- 172.21.15.49:0/3009020410 <== mon.0 v2:172.21.15.49:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f86b0050730 con 0x7f86c00c63d0 2024-01-31T12:10:06.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.541+0000 7f86c5400640 1 -- 172.21.15.49:0/3009020410 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8698066500 msgr2=0x7f86980689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:10:06.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.541+0000 7f86c5400640 1 --2- 172.21.15.49:0/3009020410 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8698066500 0x7f86980689c0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f86a80b2000 tx=0x7f86a8008040 comp rx=0 tx=0).stop 2024-01-31T12:10:06.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.541+0000 7f86c5400640 1 -- 172.21.15.49:0/3009020410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86c00c63d0 msgr2=0x7f86c009e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:10:06.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.541+0000 7f86c5400640 1 --2- 172.21.15.49:0/3009020410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86c00c63d0 0x7f86c009e740 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f86b000c4f0 tx=0x7f86b000c9b0 comp rx=0 tx=0).stop 2024-01-31T12:10:06.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.541+0000 7f86c5400640 1 -- 172.21.15.49:0/3009020410 shutdown_connections 2024-01-31T12:10:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.541+0000 7f86c5400640 1 --2- 172.21.15.49:0/3009020410 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7f8698066500 0x7f86980689c0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.541+0000 7f86c5400640 1 --2- 172.21.15.49:0/3009020410 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86c015e7e0 0x7f86c00b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.541+0000 7f86c5400640 1 --2- 172.21.15.49:0/3009020410 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f86c00cf670 0x7f86c00b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.541+0000 7f86c5400640 1 --2- 172.21.15.49:0/3009020410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86c00c63d0 0x7f86c009e740 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.541+0000 7f86c5400640 1 -- 172.21.15.49:0/3009020410 >> 172.21.15.49:0/3009020410 conn(0x7f86c00d0e60 msgr2=0x7f86c015b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:10:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.541+0000 7f86c5400640 1 -- 172.21.15.49:0/3009020410 shutdown_connections 2024-01-31T12:10:06.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:06.541+0000 7f86c5400640 1 -- 172.21.15.49:0/3009020410 wait complete. 2024-01-31T12:10:06.593 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-31T12:10:06.594 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T12:10:07.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.001+0000 7fcd67600640 1 Processor -- start 2024-01-31T12:10:07.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.001+0000 7fcd67600640 1 -- start start 2024-01-31T12:10:07.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.005+0000 7fcd67600640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd600cf3d0 0x7fcd6006a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:10:07.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.005+0000 7fcd67600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcd60162540 0x7fcd60165110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:10:07.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.005+0000 7fcd67600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd6006b110 con 0x7fcd6006acb0 2024-01-31T12:10:07.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.005+0000 7fcd67600640 1 -- --> v2:172.21.15.49:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd60162950 con 0x7fcd600cf3d0 2024-01-31T12:10:07.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.005+0000 7fcd67600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd600723c0 con 0x7fcd60162540 2024-01-31T12:10:07.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.005+0000 7fcd64c00640 1 --2- >> v2:172.21.15.49:3300/0 conn(0x7fcd600cf3d0 0x7fcd6006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:10:07.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.005+0000 7fcd65600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcd60162540 0x7fcd60165110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:10:07.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.005+0000 7fcd5fe00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fcd6006acb0 0x7fcd60161e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.49:41292/0 (socket says 172.21.15.49:41292) 2024-01-31T12:10:07.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.005+0000 7fcd5fe00640 1 -- 172.21.15.49:0/2774588306 learned_addr learned my addr 172.21.15.49:0/2774588306 (peer_addr_for_me v1:172.21.15.49:0/0) 2024-01-31T12:10:07.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.005+0000 7fcd65600640 1 -- 172.21.15.49:0/2774588306 >> v2:172.21.15.49:3300/0 conn(0x7fcd600cf3d0 msgr2=0x7fcd6006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T12:10:07.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.005+0000 7fcd65600640 1 --2- 172.21.15.49:0/2774588306 >> v2:172.21.15.49:3300/0 conn(0x7fcd600cf3d0 0x7fcd6006a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:07.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.005+0000 7fcd5f400640 1 -- 172.21.15.49:0/2774588306 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650624300 0 0) 0x7fcd6006b110 con 0x7fcd6006acb0 2024-01-31T12:10:07.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.005+0000 7fcd65600640 1 -- 172.21.15.49:0/2774588306 >> v1:172.21.15.195:6789/0 conn(0x7fcd6006acb0 legacy=0x7fcd60161e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:10:07.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.005+0000 7fcd65600640 1 -- 172.21.15.49:0/2774588306 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd60071600 con 0x7fcd60162540 2024-01-31T12:10:07.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.013+0000 7fcd65600640 1 --2- 172.21.15.49:0/2774588306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd60162540 0x7fcd60165110 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fcd600ca380 tx=0x7fcd5001c1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f53f167aacc13e41 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:10:07.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.013+0000 7fcd5f400640 1 -- 172.21.15.49:0/2774588306 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500ab600 con 0x7fcd60162540 2024-01-31T12:10:07.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.013+0000 7fcd5f400640 1 -- 172.21.15.49:0/2774588306 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcd500a7050 con 0x7fcd60162540 2024-01-31T12:10:07.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.013+0000 7fcd5f400640 1 -- 172.21.15.49:0/2774588306 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500ab9a0 con 0x7fcd60162540 2024-01-31T12:10:07.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.017+0000 7fcd67600640 1 -- 172.21.15.49:0/2774588306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd60162540 msgr2=0x7fcd60165110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:10:07.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.017+0000 7fcd67600640 1 --2- 172.21.15.49:0/2774588306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd60162540 0x7fcd60165110 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fcd600ca380 tx=0x7fcd5001c1a0 comp rx=0 tx=0).stop 2024-01-31T12:10:07.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.017+0000 7fcd67600640 1 -- 172.21.15.49:0/2774588306 shutdown_connections 2024-01-31T12:10:07.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.017+0000 7fcd67600640 1 --2- 172.21.15.49:0/2774588306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd60162540 0x7fcd60165110 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:07.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.017+0000 7fcd67600640 1 --2- 172.21.15.49:0/2774588306 >> v2:172.21.15.49:3300/0 conn(0x7fcd600cf3d0 0x7fcd6006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:07.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.017+0000 7fcd67600640 1 -- 172.21.15.49:0/2774588306 >> 172.21.15.49:0/2774588306 conn(0x7fcd600cfda0 msgr2=0x7fcd600d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:10:07.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.017+0000 7fcd67600640 1 -- 172.21.15.49:0/2774588306 shutdown_connections 2024-01-31T12:10:07.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.017+0000 7fcd67600640 1 -- 172.21.15.49:0/2774588306 wait complete. 2024-01-31T12:10:07.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.021+0000 7fcd67600640 1 Processor -- start 2024-01-31T12:10:07.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.021+0000 7fcd67600640 1 -- start start 2024-01-31T12:10:07.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd67600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd6006acb0 0x7fcd60164710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:10:07.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd67600640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd600cf3d0 0x7fcd60155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:10:07.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd67600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd60162540 0x7fcd600c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:10:07.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd67600640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd60155c80 con 0x7fcd600cf3d0 2024-01-31T12:10:07.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd67600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd60156bf0 con 0x7fcd6006acb0 2024-01-31T12:10:07.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd67600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd600b2950 con 0x7fcd60162540 2024-01-31T12:10:07.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd64c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd6006acb0 0x7fcd60164710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:10:07.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd64c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd6006acb0 0x7fcd60164710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.49:34892/0 (socket says 172.21.15.49:34892) 2024-01-31T12:10:07.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd64c00640 1 -- 172.21.15.49:0/3011826070 learned_addr learned my addr 172.21.15.49:0/3011826070 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-01-31T12:10:07.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd65600640 1 --2- 172.21.15.49:0/3011826070 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd60162540 0x7fcd600c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:10:07.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd5fe00640 1 --2- 172.21.15.49:0/3011826070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd600cf3d0 0x7fcd60155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:10:07.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd64c00640 1 -- 172.21.15.49:0/3011826070 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd60162540 msgr2=0x7fcd600c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:10:07.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd64c00640 1 --2- 172.21.15.49:0/3011826070 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd60162540 0x7fcd600c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:07.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd64c00640 1 -- 172.21.15.49:0/3011826070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd600cf3d0 msgr2=0x7fcd60155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:10:07.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd64c00640 1 --2- 172.21.15.49:0/3011826070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd600cf3d0 0x7fcd60155740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:07.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd64c00640 1 -- 172.21.15.49:0/3011826070 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd50009420 con 0x7fcd6006acb0 2024-01-31T12:10:07.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd64c00640 1 --2- 172.21.15.49:0/3011826070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd6006acb0 0x7fcd60164710 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800efc0 tx=0x7fcd5800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:10:07.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd5cc00640 1 -- 172.21.15.49:0/3011826070 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58014480 con 0x7fcd6006acb0 2024-01-31T12:10:07.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd5cc00640 1 -- 172.21.15.49:0/3011826070 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcd5800f040 con 0x7fcd6006acb0 2024-01-31T12:10:07.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd5cc00640 1 -- 172.21.15.49:0/3011826070 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58014820 con 0x7fcd6006acb0 2024-01-31T12:10:07.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd67600640 1 -- 172.21.15.49:0/3011826070 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd60155fe0 con 0x7fcd6006acb0 2024-01-31T12:10:07.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.025+0000 7fcd67600640 1 -- 172.21.15.49:0/3011826070 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd601565a0 con 0x7fcd6006acb0 2024-01-31T12:10:07.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.029+0000 7fcd5cc00640 1 -- 172.21.15.49:0/3011826070 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 85827+0+0 (secure 0 0 0) 0x7fcd58014980 con 0x7fcd6006acb0 2024-01-31T12:10:07.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.029+0000 7fcd67600640 1 -- 172.21.15.49:0/3011826070 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd60074860 con 0x7fcd6006acb0 2024-01-31T12:10:07.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.032+0000 7fcd5cc00640 1 --2- 172.21.15.49:0/3011826070 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcd38066530 0x7fcd380689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T12:10:07.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.032+0000 7fcd5cc00640 1 -- 172.21.15.49:0/3011826070 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fcd58084d10 con 0x7fcd6006acb0 2024-01-31T12:10:07.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.032+0000 7fcd5fe00640 1 --2- 172.21.15.49:0/3011826070 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcd38066530 0x7fcd380689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T12:10:07.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.032+0000 7fcd5fe00640 1 --2- 172.21.15.49:0/3011826070 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcd38066530 0x7fcd380689f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fcd601fd980 tx=0x7fcd48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T12:10:07.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.036+0000 7fcd5cc00640 1 -- 172.21.15.49:0/3011826070 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173432 (secure 0 0 0) 0x7fcd5808a020 con 0x7fcd6006acb0 2024-01-31T12:10:07.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.608+0000 7fcd67600640 1 -- 172.21.15.49:0/3011826070 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd600b5950 con 0x7fcd6006acb0 2024-01-31T12:10:07.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.608+0000 7fcd5cc00640 1 -- 172.21.15.49:0/3011826070 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3702 (secure 0 0 0) 0x7fcd58055ad0 con 0x7fcd6006acb0 2024-01-31T12:10:07.609 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-31T12:10:07.609 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5078,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/3747440713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6835","nonce":3747440713},{"type":"v1","addr":"172.21.15.195:6837","nonce":3747440713}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6836/2835620509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":2835620509},{"type":"v1","addr":"172.21.15.195:6836","nonce":2835620509}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2080191803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2080191803},{"type":"v1","addr":"172.21.15.49:6833","nonce":2080191803}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":9781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/388163851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":388163851},{"type":"v1","addr":"172.21.15.49:6835","nonce":388163851}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[]} 2024-01-31T12:10:07.609 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-01-31T12:10:07.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.612+0000 7fcd67600640 1 -- 172.21.15.49:0/3011826070 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcd38066530 msgr2=0x7fcd380689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:10:07.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.612+0000 7fcd67600640 1 --2- 172.21.15.49:0/3011826070 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcd38066530 0x7fcd380689f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fcd601fd980 tx=0x7fcd48009040 comp rx=0 tx=0).stop 2024-01-31T12:10:07.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.612+0000 7fcd67600640 1 -- 172.21.15.49:0/3011826070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd6006acb0 msgr2=0x7fcd60164710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T12:10:07.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.612+0000 7fcd67600640 1 --2- 172.21.15.49:0/3011826070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd6006acb0 0x7fcd60164710 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800efc0 tx=0x7fcd5800c490 comp rx=0 tx=0).stop 2024-01-31T12:10:07.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.612+0000 7fcd67600640 1 -- 172.21.15.49:0/3011826070 shutdown_connections 2024-01-31T12:10:07.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.612+0000 7fcd67600640 1 --2- 172.21.15.49:0/3011826070 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcd60162540 0x7fcd600c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:07.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.612+0000 7fcd67600640 1 --2- 172.21.15.49:0/3011826070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd600cf3d0 0x7fcd60155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:07.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.612+0000 7fcd67600640 1 --2- 172.21.15.49:0/3011826070 >> [v2:172.21.15.195:6832/3035808172,v1:172.21.15.195:6833/3035808172] conn(0x7fcd38066530 0x7fcd380689f0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:07.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.612+0000 7fcd67600640 1 --2- 172.21.15.49:0/3011826070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd6006acb0 0x7fcd60164710 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T12:10:07.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.612+0000 7fcd67600640 1 -- 172.21.15.49:0/3011826070 >> 172.21.15.49:0/3011826070 conn(0x7fcd600cfda0 msgr2=0x7fcd6015faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T12:10:07.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.612+0000 7fcd67600640 1 -- 172.21.15.49:0/3011826070 shutdown_connections 2024-01-31T12:10:07.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-01-31T12:10:07.612+0000 7fcd67600640 1 -- 172.21.15.49:0/3011826070 wait complete. 2024-01-31T12:10:07.666 DEBUG:tasks.cephfs.filesystem:already dead... 2024-01-31T12:10:07.667 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-31T12:10:07.667 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-31T12:10:07.667 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T12:10:13.510 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-01-31T12:10:13.769 INFO:tasks.ceph.mds.a:Stopped 2024-01-31T12:10:13.770 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-31T12:10:13.770 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T12:10:19.871 INFO:tasks.ceph.mds.c:Stopped 2024-01-31T12:10:19.872 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-31T12:10:19.872 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T12:10:19.889 INFO:tasks.ceph.mds.b:Stopped 2024-01-31T12:10:19.889 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-31T12:10:19.889 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T12:10:20.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-01-31T12:10:20.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-01-31T12:10:24.515 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T12:10:24.519 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-31T12:10:24.601 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-01-31T12:10:24.600+0000 7f96ce200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 497050) UID: 0 2024-01-31T12:10:24.601 INFO:tasks.ceph.osd.3.smithi049.stderr:2024-01-31T12:10:24.600+0000 7f79d2800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 497050) UID: 0 2024-01-31T12:10:24.601 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-01-31T12:10:24.600+0000 7f91cc000640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 497050) UID: 0 2024-01-31T12:10:24.602 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-01-31T12:10:24.600+0000 7f4aaf800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 497050) UID: 0 2024-01-31T12:10:25.991 INFO:tasks.ceph.mds.d:Stopped 2024-01-31T12:10:25.992 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-31T12:10:25.992 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-31T12:10:25.992 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T12:10:26.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-01-31T12:10:32.094 INFO:tasks.ceph.osd.0:Stopped 2024-01-31T12:10:32.095 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-31T12:10:32.095 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T12:10:32.543 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-01-31T12:10:38.197 INFO:tasks.ceph.osd.1:Stopped 2024-01-31T12:10:38.198 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-31T12:10:38.198 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T12:10:38.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-01-31T12:10:38.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-01-31T12:10:44.300 INFO:tasks.ceph.osd.2:Stopped 2024-01-31T12:10:44.301 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-31T12:10:44.301 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T12:10:44.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-01-31T12:10:44.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-01-31T12:10:50.403 INFO:tasks.ceph.osd.3:Stopped 2024-01-31T12:10:50.404 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-31T12:10:50.404 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T12:10:50.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-01-31T12:10:50.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-01-31T12:10:56.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-01-31T12:10:56.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-01-31T12:10:56.506 INFO:tasks.ceph.osd.4:Stopped 2024-01-31T12:10:56.506 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-31T12:10:56.506 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T12:11:02.084 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-01-31T12:11:02.084 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-01-31T12:11:02.608 INFO:tasks.ceph.osd.5:Stopped 2024-01-31T12:11:02.609 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-31T12:11:02.609 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T12:11:07.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-01-31T12:11:07.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-01-31T12:11:08.711 INFO:tasks.ceph.osd.6:Stopped 2024-01-31T12:11:08.712 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-31T12:11:08.712 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T12:11:13.194 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-01-31T12:11:13.194 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-01-31T12:11:14.813 INFO:tasks.ceph.osd.7:Stopped 2024-01-31T12:11:14.814 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-31T12:11:14.814 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-31T12:11:14.814 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T12:11:18.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-01-31T12:11:18.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-01-31T12:11:20.916 INFO:tasks.ceph.mgr.y:Stopped 2024-01-31T12:11:20.916 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-31T12:11:20.916 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T12:11:23.900 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-01-31T12:11:23.901 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-01-31T12:11:27.018 INFO:tasks.ceph.mgr.x:Stopped 2024-01-31T12:11:27.019 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-31T12:11:27.019 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-31T12:11:27.020 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T12:11:29.204 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-01-31T12:11:34.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-01-31T12:11:39.223 INFO:tasks.ceph.mon.a:Stopped 2024-01-31T12:11:39.224 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-31T12:11:39.224 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T12:11:39.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-01-31T12:11:44.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-01-31T12:11:45.326 INFO:tasks.ceph.mon.b:Stopped 2024-01-31T12:11:45.326 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-31T12:11:45.326 INFO:teuthology.orchestra.run:waiting for 300 2024-01-31T12:11:49.712 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-01-31T12:11:49.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-01-31T12:11:51.428 INFO:tasks.ceph.mon.c:Stopped 2024-01-31T12:11:51.429 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-31T12:11:51.429 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-01-31T12:11:51.569 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi049.front.sepia.ceph.com 2024-01-31T12:11:51.570 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-31T12:11:52.150 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi049.front.sepia.ceph.com 2024-01-31T12:11:52.150 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-31T12:11:52.856 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi049.front.sepia.ceph.com 2024-01-31T12:11:52.856 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-31T12:11:53.319 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi049.front.sepia.ceph.com 2024-01-31T12:11:53.319 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-31T12:11:53.743 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi195.front.sepia.ceph.com 2024-01-31T12:11:53.744 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-31T12:11:54.289 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi195.front.sepia.ceph.com 2024-01-31T12:11:54.289 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-31T12:11:54.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-01-31T12:11:54.856 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi195.front.sepia.ceph.com 2024-01-31T12:11:54.857 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-31T12:11:55.336 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi195.front.sepia.ceph.com 2024-01-31T12:11:55.336 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-31T12:11:55.763 INFO:tasks.ceph:Archiving mon data... 2024-01-31T12:11:55.765 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539483/data/mon.a.tgz 2024-01-31T12:11:55.765 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2024-01-31T12:11:55.784 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.o2FLxvYtJ6 2024-01-31T12:11:55.784 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.o2FLxvYtJ6 2024-01-31T12:11:56.162 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.o2FLxvYtJ6 2024-01-31T12:11:56.299 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.o2FLxvYtJ6 is 557KB 2024-01-31T12:11:56.382 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.o2FLxvYtJ6 2024-01-31T12:11:56.400 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539483/data/mon.b.tgz 2024-01-31T12:11:56.401 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-01-31T12:11:56.409 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.ptlVPTmp6r 2024-01-31T12:11:56.410 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ptlVPTmp6r 2024-01-31T12:11:56.568 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.ptlVPTmp6r 2024-01-31T12:11:56.687 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.ptlVPTmp6r is 564KB 2024-01-31T12:11:56.757 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.ptlVPTmp6r 2024-01-31T12:11:56.765 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539483/data/mon.c.tgz 2024-01-31T12:11:56.765 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-01-31T12:11:56.813 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.PhSxih627N 2024-01-31T12:11:56.814 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.PhSxih627N 2024-01-31T12:11:56.956 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.PhSxih627N 2024-01-31T12:11:57.030 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.PhSxih627N is 564KB 2024-01-31T12:11:57.097 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.PhSxih627N 2024-01-31T12:11:57.105 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-31T12:11:57.106 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-31T12:11:57.110 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-31T12:11:57.250 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-31T12:11:57.267 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-31T12:11:57.268 INFO:tasks.ceph:Archiving crash dumps... 2024-01-31T12:11:57.270 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539483/remote/smithi049/crash 2024-01-31T12:11:57.270 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-31T12:11:57.343 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539483/remote/smithi195/crash 2024-01-31T12:11:57.344 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-31T12:11:57.375 INFO:tasks.ceph:Shutting down logrotate 2024-01-31T12:17:28.977 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-31T12:17:29.128 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-31T12:17:29.293 INFO:tasks.ceph:Compressing logs... 2024-01-31T12:17:29.294 DEBUG:teuthology.orchestra.run.smithi049:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-31T12:17:29.299 DEBUG:teuthology.orchestra.run.smithi195:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-31T12:17:29.343 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27218.log 2024-01-31T12:17:29.343 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27362.log 2024-01-31T12:17:29.345 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.27218.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-01-31T12:17:29.346 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.27362.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-01-31T12:17:29.346 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27386.log 2024-01-31T12:17:29.347 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-01-31T12:17:29.348 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.27386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27314.log 2024-01-31T12:17:29.350 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-01-31T12:17:29.351 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.27314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27242.log 2024-01-31T12:17:29.352 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-31T12:17:29.353 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27266.log 2024-01-31T12:17:29.355 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-01-31T12:17:29.356 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-31T12:17:29.357 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-01-31T12:17:29.358 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27338.log 2024-01-31T12:17:29.360 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.31873.log 2024-01-31T12:17:29.361 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-01-31T12:17:29.362 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-01-31T12:17:29.364 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33304.log 2024-01-31T12:17:29.364 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27290.log 2024-01-31T12:17:29.365 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.31761.log 2024-01-31T12:17:29.366 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-01-31T12:17:29.372 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.27242.log: /var/log/ceph/ceph.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.27218.log.gz 2024-01-31T12:17:29.372 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.27266.log: /var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mds.d.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.27314.log.gz 2024-01-31T12:17:29.372 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.27338.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27362.log.gz 2024-01-31T12:17:29.373 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.3.31873.log: /var/log/ceph/ceph-mds.b.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27386.log.gz 2024-01-31T12:17:29.377 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.27290.log: /var/log/ceph/ceph-client.1.31761.log: /var/log/ceph/ceph-osd.4.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27242.log.gz 2024-01-31T12:17:29.380 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302310.log 2024-01-31T12:17:29.382 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408954.log 2024-01-31T12:17:29.384 INFO:teuthology.orchestra.run.smithi195.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.27266.log.gz 2024-01-31T12:17:29.385 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.302310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227838.log 2024-01-31T12:17:29.386 INFO:teuthology.orchestra.run.smithi195.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.27338.log.gz 2024-01-31T12:17:29.387 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.408954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32128.log 2024-01-31T12:17:29.387 INFO:teuthology.orchestra.run.smithi195.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.27290.log.gz 2024-01-31T12:17:29.389 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.227838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401356.log 2024-01-31T12:17:29.391 INFO:teuthology.orchestra.run.smithi049.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.302310.log.gz 2024-01-31T12:17:29.392 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352040.log 2024-01-31T12:17:29.394 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.401356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225825.log 2024-01-31T12:17:29.396 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.352040.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32128.log.gz 2024-01-31T12:17:29.397 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88438.log 2024-01-31T12:17:29.399 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.225825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429731.log 2024-01-31T12:17:29.400 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33304.log.gz 2024-01-31T12:17:29.402 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.88438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382214.log 2024-01-31T12:17:29.402 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.352040.log.gz 2024-01-31T12:17:29.403 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496893.log 2024-01-31T12:17:29.404 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.429731.log: /var/log/ceph/ceph-client.admin.382214.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.227838.log.gz 2024-01-31T12:17:29.406 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32840.log 2024-01-31T12:17:29.407 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187216.log 2024-01-31T12:17:29.409 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496893.log: /var/log/ceph/ceph-client.admin.32840.log: 88.9% 81.1% -- replaced with /var/log/ceph/ceph-client.admin.496893.log.gz 2024-01-31T12:17:29.409 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.401356.log.gz 2024-01-31T12:17:29.411 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496737.log 2024-01-31T12:17:29.412 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.187216.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.429731.log.gz 2024-01-31T12:17:29.413 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496257.log 2024-01-31T12:17:29.414 INFO:teuthology.orchestra.run.smithi049.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.408954.log.gz 2024-01-31T12:17:29.415 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5/var/log/ceph/ceph-client.admin.496737.log: --verbose -- /var/log/ceph/ceph-client.admin.377335.log 2024-01-31T12:17:29.416 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496257.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.496257.log.gz 2024-01-31T12:17:29.416 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.496737.log.gz 2024-01-31T12:17:29.417 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331931.log 2024-01-31T12:17:29.419 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363591.log 2024-01-31T12:17:29.419 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.377335.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.225825.log.gz 2024-01-31T12:17:29.420 INFO:teuthology.orchestra.run.smithi195.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-31T12:17:29.421 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.331931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383358.log 2024-01-31T12:17:29.422 INFO:teuthology.orchestra.run.smithi049.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.382214.log.gz 2024-01-31T12:17:29.423 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.363591.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32840.log.gz 2024-01-31T12:17:29.424 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491444.log 2024-01-31T12:17:29.425 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163884.log 2024-01-31T12:17:29.426 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.383358.log: /var/log/ceph/ceph-client.admin.491444.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.491444.log.gz 2024-01-31T12:17:29.428 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210622.log 2024-01-31T12:17:29.428 INFO:teuthology.orchestra.run.smithi049.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.377335.log.gz 2024-01-31T12:17:29.429 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33514.log 2024-01-31T12:17:29.432 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.163884.log: /var/log/ceph/ceph-client.admin.210622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108576.log 2024-01-31T12:17:29.435 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363543.log 2024-01-31T12:17:29.435 INFO:teuthology.orchestra.run.smithi195.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.1.31761.log.gz 2024-01-31T12:17:29.436 INFO:teuthology.orchestra.run.smithi195.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.3.31873.log.gz 2024-01-31T12:17:29.437 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.108576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330047.log 2024-01-31T12:17:29.440 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.363543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177828.log 2024-01-31T12:17:29.440 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.108576.log.gz 2024-01-31T12:17:29.442 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.330047.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33514.log.gz 2024-01-31T12:17:29.442 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32024.log 2024-01-31T12:17:29.445 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.177828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125528.log 2024-01-31T12:17:29.447 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32024.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.210622.log.gz 2024-01-31T12:17:29.448 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492742.log 2024-01-31T12:17:29.450 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.125528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191727.log 2024-01-31T12:17:29.451 INFO:teuthology.orchestra.run.smithi049.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.187216.log.gz 2024-01-31T12:17:29.451 INFO:teuthology.orchestra.run.smithi049.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.177828.log.gz 2024-01-31T12:17:29.453 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.492742.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32024.log.gz 2024-01-31T12:17:29.453 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155675.log 2024-01-31T12:17:29.456 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.191727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236452.log 2024-01-31T12:17:29.457 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496841.log 2024-01-31T12:17:29.460 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.155675.log: /var/log/ceph/ceph-client.admin.236452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292101.log 2024-01-31T12:17:29.461 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355486.log 2024-01-31T12:17:29.462 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496841.log: /var/log/ceph/ceph-client.admin.292101.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.496841.log.gz 2024-01-31T12:17:29.464 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221729.log 2024-01-31T12:17:29.465 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134161.log 2024-01-31T12:17:29.468 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.355486.log: /var/log/ceph/ceph-client.admin.221729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411481.log 2024-01-31T12:17:29.469 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.134161.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.292101.log.gz 2024-01-31T12:17:29.470 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154459.log 2024-01-31T12:17:29.473 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.411481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461045.log 2024-01-31T12:17:29.474 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.154459.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.221729.log.gz 2024-01-31T12:17:29.476 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325008.log 2024-01-31T12:17:29.476 INFO:teuthology.orchestra.run.smithi049.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.155675.log.gz 2024-01-31T12:17:29.477 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242612.log 2024-01-31T12:17:29.478 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.461045.log: /var/log/ceph/ceph-client.admin.325008.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.191727.log.gz 2024-01-31T12:17:29.479 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.325008.log.gz 2024-01-31T12:17:29.480 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77471.log 2024-01-31T12:17:29.483 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.242612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217785.log 2024-01-31T12:17:29.485 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465074.log 2024-01-31T12:17:29.487 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34056.log 2024-01-31T12:17:29.490 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.217785.log: /var/log/ceph/ceph-client.admin.465074.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.492742.log.gz 2024-01-31T12:17:29.490 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.77471.log.gz 2024-01-31T12:17:29.491 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317829.log 2024-01-31T12:17:29.492 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34056.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.236452.log.gz 2024-01-31T12:17:29.493 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181094.log 2024-01-31T12:17:29.494 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.242612.log.gz 2024-01-31T12:17:29.496 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.317829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248920.log 2024-01-31T12:17:29.497 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.355486.log.gz 2024-01-31T12:17:29.498 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.181094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369176.log 2024-01-31T12:17:29.501 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96583.log 2024-01-31T12:17:29.502 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.248920.log: /var/log/ceph/ceph-client.admin.369176.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.461045.log.gz 2024-01-31T12:17:29.502 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34056.log.gz 2024-01-31T12:17:29.503 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167983.log 2024-01-31T12:17:29.505 INFO:teuthology.orchestra.run.smithi049.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.369176.log.gz 2024-01-31T12:17:29.506 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.96583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482911.log 2024-01-31T12:17:29.507 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250240.log 2024-01-31T12:17:29.508 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.167983.log: /var/log/ceph/ceph-client.admin.482911.log: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.248920.log.gz 2024-01-31T12:17:29.510 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204885.log 2024-01-31T12:17:29.513 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.250240.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.134161.log.gz 2024-01-31T12:17:29.513 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357949.log 2024-01-31T12:17:29.515 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.204885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425557.log 2024-01-31T12:17:29.517 INFO:teuthology.orchestra.run.smithi049.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.317829.log.gz 2024-01-31T12:17:29.518 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.357949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434333.log 2024-01-31T12:17:29.519 INFO:teuthology.orchestra.run.smithi049.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.167983.log.gz 2024-01-31T12:17:29.521 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.425557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238864.log 2024-01-31T12:17:29.522 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.411481.log.gz 2024-01-31T12:17:29.524 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.434333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306416.log 2024-01-31T12:17:29.525 INFO:teuthology.orchestra.run.smithi049.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.96583.log.gz 2024-01-31T12:17:29.527 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.238864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214920.log 2024-01-31T12:17:29.530 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.306416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468308.log 2024-01-31T12:17:29.531 INFO:teuthology.orchestra.run.smithi049.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.482911.log.gz 2024-01-31T12:17:29.531 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.204885.log.gz 2024-01-31T12:17:29.533 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.214920.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-01-31T12:17:29.533 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.434333.log.gz 2024-01-31T12:17:29.535 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.468308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367119.log 2024-01-31T12:17:29.537 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384010.log 2024-01-31T12:17:29.538 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.425557.log.gz 2024-01-31T12:17:29.538 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.367119.log: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.238864.log.gz 2024-01-31T12:17:29.540 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370834.log 2024-01-31T12:17:29.541 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454925.log 2024-01-31T12:17:29.542 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.384010.log: /var/log/ceph/ceph-client.admin.370834.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.154459.log.gz 2024-01-31T12:17:29.544 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419325.log 2024-01-31T12:17:29.546 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.454925.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.367119.log.gz 2024-01-31T12:17:29.546 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178272.log 2024-01-31T12:17:29.548 INFO:teuthology.orchestra.run.smithi049.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.465074.log.gz 2024-01-31T12:17:29.549 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.419325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155268.log 2024-01-31T12:17:29.550 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196401.log 2024-01-31T12:17:29.552 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.178272.log: /var/log/ceph/ceph-client.admin.155268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223786.log 2024-01-31T12:17:29.553 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.196401.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.384010.log.gz 2024-01-31T12:17:29.554 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107714.log 2024-01-31T12:17:29.557 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.223786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365873.log 2024-01-31T12:17:29.558 INFO:teuthology.orchestra.run.smithi049.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.155268.log.gz 2024-01-31T12:17:29.559 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88429.log 2024-01-31T12:17:29.560 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107714.log: /var/log/ceph/ceph-client.admin.365873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451108.log 2024-01-31T12:17:29.562 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.88429.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.196401.log.gz 2024-01-31T12:17:29.563 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126391.log 2024-01-31T12:17:29.565 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.451108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480849.log 2024-01-31T12:17:29.567 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192725.log 2024-01-31T12:17:29.567 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.480849.log: /var/log/ceph/ceph-client.admin.126391.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.330047.log.gz 2024-01-31T12:17:29.568 INFO:teuthology.orchestra.run.smithi049.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.480849.log.gz 2024-01-31T12:17:29.569 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36221.log 2024-01-31T12:17:29.570 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.370834.log.gz 2024-01-31T12:17:29.572 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.192725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32602.log 2024-01-31T12:17:29.573 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496153.log 2024-01-31T12:17:29.575 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36221.log: /var/log/ceph/ceph-client.admin.32602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355075.log 2024-01-31T12:17:29.575 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496153.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.496153.log.gz 2024-01-31T12:17:29.575 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36221.log.gz 2024-01-31T12:17:29.577 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478353.log 2024-01-31T12:17:29.580 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.355075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469145.log 2024-01-31T12:17:29.581 INFO:teuthology.orchestra.run.smithi049.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.355075.log.gz 2024-01-31T12:17:29.583 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.478353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433931.log 2024-01-31T12:17:29.585 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.469145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406416.log 2024-01-31T12:17:29.585 INFO:teuthology.orchestra.run.smithi049.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.126391.log.gz 2024-01-31T12:17:29.586 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.433931.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.306416.log.gz 2024-01-31T12:17:29.587 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251452.log 2024-01-31T12:17:29.588 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.406416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485049.log 2024-01-31T12:17:29.589 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.251452.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32602.log.gz 2024-01-31T12:17:29.590 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.107714.log.gz 2024-01-31T12:17:29.590 INFO:teuthology.orchestra.run.smithi049.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.478353.log.gz 2024-01-31T12:17:29.591 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306021.log 2024-01-31T12:17:29.591 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.433931.log.gz 2024-01-31T12:17:29.594 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.485049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37213.log 2024-01-31T12:17:29.596 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.306021.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.178272.log.gz 2024-01-31T12:17:29.597 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458787.log 2024-01-31T12:17:29.598 INFO:teuthology.orchestra.run.smithi049.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.419325.log.gz 2024-01-31T12:17:29.599 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.37213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381820.log 2024-01-31T12:17:29.601 INFO:teuthology.orchestra.run.smithi049.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.469145.log.gz 2024-01-31T12:17:29.601 INFO:teuthology.orchestra.run.smithi049.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.485049.log.gz 2024-01-31T12:17:29.602 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.458787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324588.log 2024-01-31T12:17:29.603 INFO:teuthology.orchestra.run.smithi049.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.365873.log.gz 2024-01-31T12:17:29.604 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462660.log 2024-01-31T12:17:29.604 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.381820.log: /var/log/ceph/ceph-client.admin.324588.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.468308.log.gz 2024-01-31T12:17:29.606 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.406416.log.gz 2024-01-31T12:17:29.606 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476586.log 2024-01-31T12:17:29.609 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.462660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307633.log 2024-01-31T12:17:29.610 INFO:teuthology.orchestra.run.smithi049.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.37213.log.gz 2024-01-31T12:17:29.611 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95770.log 2024-01-31T12:17:29.613 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.476586.log: /var/log/ceph/ceph-client.admin.307633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209378.log 2024-01-31T12:17:29.613 INFO:teuthology.orchestra.run.smithi049.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.476586.log.gz 2024-01-31T12:17:29.614 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.306021.log.gz 2024-01-31T12:17:29.615 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108108.log 2024-01-31T12:17:29.617 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95770.log: /var/log/ceph/ceph-client.admin.209378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170937.log 2024-01-31T12:17:29.620 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.108108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207754.log 2024-01-31T12:17:29.621 INFO:teuthology.orchestra.run.smithi049.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.462660.log.gz 2024-01-31T12:17:29.623 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.170937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200634.log 2024-01-31T12:17:29.623 INFO:teuthology.orchestra.run.smithi049.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.324588.log.gz 2024-01-31T12:17:29.626 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.207754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467885.log 2024-01-31T12:17:29.627 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90823.log 2024-01-31T12:17:29.630 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488024.log 2024-01-31T12:17:29.632 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223341.log 2024-01-31T12:17:29.634 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206102.log 2024-01-31T12:17:29.637 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307230.log 2024-01-31T12:17:29.639 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78703.log 2024-01-31T12:17:29.640 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374048.log 2024-01-31T12:17:29.643 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101026.log 2024-01-31T12:17:29.644 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.467885.log: 81.3%/var/log/ceph/ceph-client.admin.200634.log: -- replaced with /var/log/ceph/ceph-client.admin.207754.log.gz 2024-01-31T12:17:29.644 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.209378.log.gz 2024-01-31T12:17:29.644 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.217785.log.gz 2024-01-31T12:17:29.645 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76100.log 2024-01-31T12:17:29.646 INFO:teuthology.orchestra.run.smithi049.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.223786.log.gz 2024-01-31T12:17:29.646 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.488024.log: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.170937.log.gz 2024-01-31T12:17:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.307230.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.181094.log.gz 2024-01-31T12:17:29.647 INFO:teuthology.orchestra.run.smithi049.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.192725.log.gz 2024-01-31T12:17:29.647 INFO:teuthology.orchestra.run.smithi049.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.454925.log.gz 2024-01-31T12:17:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.374048.log: /var/log/ceph/ceph-client.admin.223341.log: /var/log/ceph/ceph-client.admin.78703.log: /var/log/ceph/ceph-client.admin.90823.log: /var/log/ceph/ceph-client.admin.206102.log: /var/log/ceph/ceph-client.admin.101026.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.488024.log.gz 2024-01-31T12:17:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103916.log 2024-01-31T12:17:29.649 INFO:teuthology.orchestra.run.smithi049.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.88429.log.gz 2024-01-31T12:17:29.650 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.95770.log.gz 2024-01-31T12:17:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241743.log 2024-01-31T12:17:29.653 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83581.log 2024-01-31T12:17:29.654 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.103916.log: /var/log/ceph/ceph-client.admin.241743.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.467885.log.gz 2024-01-31T12:17:29.654 INFO:teuthology.orchestra.run.smithi049.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.241743.log.gz 2024-01-31T12:17:29.656 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480447.log 2024-01-31T12:17:29.658 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444378.log 2024-01-31T12:17:29.660 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184721.log 2024-01-31T12:17:29.661 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.480447.log: /var/log/ceph/ceph-client.admin.444378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96995.log 2024-01-31T12:17:29.662 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.184721.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.480447.log.gz 2024-01-31T12:17:29.662 INFO:teuthology.orchestra.run.smithi049.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.83581.log.gz 2024-01-31T12:17:29.663 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225418.log 2024-01-31T12:17:29.663 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.96995.log: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.90823.log.gz 2024-01-31T12:17:29.664 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83188.log 2024-01-31T12:17:29.666 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.225418.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.96995.log.gz 2024-01-31T12:17:29.667 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321528.log 2024-01-31T12:17:29.668 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206897.log 2024-01-31T12:17:29.669 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83188.log: /var/log/ceph/ceph-client.admin.321528.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.444378.log.gz 2024-01-31T12:17:29.669 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.101026.log.gz 2024-01-31T12:17:29.670 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231081.log 2024-01-31T12:17:29.671 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42122.log 2024-01-31T12:17:29.672 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.231081.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.83188.log.gz 2024-01-31T12:17:29.673 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.206897.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.307230.log.gz 2024-01-31T12:17:29.674 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469154.log 2024-01-31T12:17:29.675 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.184721.log.gz 2024-01-31T12:17:29.676 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411079.log 2024-01-31T12:17:29.678 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.469154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496945.log 2024-01-31T12:17:29.680 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.411079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330504.log 2024-01-31T12:17:29.682 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98597.log 2024-01-31T12:17:29.683 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.496945.log.gz 2024-01-31T12:17:29.684 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418913.log 2024-01-31T12:17:29.686 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.330504.log: /var/log/ceph/ceph-client.admin.98597.log: 90.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.307633.log.gz -5 2024-01-31T12:17:29.686 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.299082.log 2024-01-31T12:17:29.686 INFO:teuthology.orchestra.run.smithi049.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.206897.log.gz 2024-01-31T12:17:29.688 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.418913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423073.log 2024-01-31T12:17:29.690 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.299082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447285.log 2024-01-31T12:17:29.692 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.423073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461440.log 2024-01-31T12:17:29.692 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.225418.log.gz 2024-01-31T12:17:29.694 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.447285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362073.log 2024-01-31T12:17:29.696 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.461440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474066.log 2024-01-31T12:17:29.698 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.362073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171803.log 2024-01-31T12:17:29.698 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.381820.log.gz 2024-01-31T12:17:29.700 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.474066.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-01-31T12:17:29.700 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.374048.log.gz 2024-01-31T12:17:29.701 INFO:teuthology.orchestra.run.smithi049.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.98597.log.gz 2024-01-31T12:17:29.702 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.171803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219004.log 2024-01-31T12:17:29.704 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311364.log 2024-01-31T12:17:29.705 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318690.log 2024-01-31T12:17:29.706 INFO:teuthology.orchestra.run.smithi049.stderr: 89.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-01-31T12:17:29.707 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.311364.log: /var/log/ceph/ceph-client.admin.219004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495666.log 2024-01-31T12:17:29.710 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.318690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36728.log 2024-01-31T12:17:29.712 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.495666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433127.log 2024-01-31T12:17:29.712 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.495666.log.gz 2024-01-31T12:17:29.713 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107307.log 2024-01-31T12:17:29.713 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.433127.log: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.108108.log.gz 2024-01-31T12:17:29.715 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319903.log 2024-01-31T12:17:29.717 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249846.log 2024-01-31T12:17:29.719 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.319903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325864.log 2024-01-31T12:17:29.721 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.249846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378151.log 2024-01-31T12:17:29.721 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.78703.log.gz 2024-01-31T12:17:29.723 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.325864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304796.log 2024-01-31T12:17:29.725 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.378151.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.418913.log.gz 2024-01-31T12:17:29.725 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444387.log 2024-01-31T12:17:29.726 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.304796.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.321528.log.gz 2024-01-31T12:17:29.728 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34879.log 2024-01-31T12:17:29.728 INFO:teuthology.orchestra.run.smithi049.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.447285.log.gz 2024-01-31T12:17:29.729 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.444387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438039.log 2024-01-31T12:17:29.731 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34879.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42122.log.gz 2024-01-31T12:17:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459425.log 2024-01-31T12:17:29.734 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326266.log 2024-01-31T12:17:29.736 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.438039.log: /var/log/ceph/ceph-client.admin.459425.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.325864.log.gz 2024-01-31T12:17:29.737 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496231.log 2024-01-31T12:17:29.739 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453691.log 2024-01-31T12:17:29.739 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.326266.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.362073.log.gz 2024-01-31T12:17:29.740 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496231.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.496231.log.gz 2024-01-31T12:17:29.742 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202051.log 2024-01-31T12:17:29.745 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.453691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358637.log 2024-01-31T12:17:29.747 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.202051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492320.log 2024-01-31T12:17:29.747 INFO:teuthology.orchestra.run.smithi049.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.200634.log.gz 2024-01-31T12:17:29.748 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.206102.log.gz 2024-01-31T12:17:29.750 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.358637.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.318690.log.gz 2024-01-31T12:17:29.750 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299091.log 2024-01-31T12:17:29.751 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.304796.log.gz 2024-01-31T12:17:29.752 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.492320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422487.log 2024-01-31T12:17:29.752 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.299091.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.492320.log.gz 2024-01-31T12:17:29.754 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289171.log 2024-01-31T12:17:29.755 INFO:teuthology.orchestra.run.smithi049.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.231081.log.gz 2024-01-31T12:17:29.756 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.107307.log.gz 2024-01-31T12:17:29.757 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.422487.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36728.log.gz 2024-01-31T12:17:29.758 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480438.log 2024-01-31T12:17:29.758 INFO:teuthology.orchestra.run.smithi049.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.453691.log.gz 2024-01-31T12:17:29.760 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.289171.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.319903.log.gz 2024-01-31T12:17:29.761 INFO:teuthology.orchestra.run.smithi049.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.330504.log.gz 2024-01-31T12:17:29.762 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407620.log 2024-01-31T12:17:29.763 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.480438.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.311364.log.gz 2024-01-31T12:17:29.765 INFO:teuthology.orchestra.run.smithi049.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.480438.log.gz 2024-01-31T12:17:29.765 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474492.log 2024-01-31T12:17:29.766 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.407620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440284.log 2024-01-31T12:17:29.767 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.474492.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.474492.log.gz 2024-01-31T12:17:29.769 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.433127.log.gz 2024-01-31T12:17:29.769 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35088.log 2024-01-31T12:17:29.769 INFO:teuthology.orchestra.run.smithi049.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.438039.log.gz 2024-01-31T12:17:29.770 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.440284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379366.log 2024-01-31T12:17:29.772 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35088.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.461440.log.gz 2024-01-31T12:17:29.773 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163422.log 2024-01-31T12:17:29.775 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.379366.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34879.log.gz 2024-01-31T12:17:29.776 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33278.log 2024-01-31T12:17:29.776 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35088.log.gz 2024-01-31T12:17:29.778 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.163422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482902.log 2024-01-31T12:17:29.779 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479577.log 2024-01-31T12:17:29.780 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.482902.log: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.482902.log.gz 2024-01-31T12:17:29.781 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.411079.log.gz 2024-01-31T12:17:29.782 INFO:teuthology.orchestra.run.smithi049.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.299082.log.gz 2024-01-31T12:17:29.782 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223332.log 2024-01-31T12:17:29.784 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92065.log 2024-01-31T12:17:29.784 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.479577.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.326266.log.gz 2024-01-31T12:17:29.785 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.223332.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33278.log.gz 2024-01-31T12:17:29.786 INFO:teuthology.orchestra.run.smithi049.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.459425.log.gz 2024-01-31T12:17:29.787 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421565.log 2024-01-31T12:17:29.787 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.479577.log.gz 2024-01-31T12:17:29.788 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.407620.log.gz 2024-01-31T12:17:29.789 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300698.log 2024-01-31T12:17:29.790 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.92065.log: /var/log/ceph/ceph-client.admin.421565.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.422487.log.gz 2024-01-31T12:17:29.791 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303990.log 2024-01-31T12:17:29.793 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.300698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386453.log 2024-01-31T12:17:29.794 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.358637.log.gz 2024-01-31T12:17:29.796 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.303990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160835.log 2024-01-31T12:17:29.796 INFO:teuthology.orchestra.run.smithi049.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.440284.log.gz 2024-01-31T12:17:29.798 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.423073.log.gz 2024-01-31T12:17:29.798 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.386453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421970.log 2024-01-31T12:17:29.801 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.160835.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.421565.log.gz 2024-01-31T12:17:29.801 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289982.log 2024-01-31T12:17:29.802 INFO:teuthology.orchestra.run.smithi049.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.378151.log.gz 2024-01-31T12:17:29.803 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.421970.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.379366.log.gz 2024-01-31T12:17:29.804 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303584.log 2024-01-31T12:17:29.805 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.300698.log.gz 2024-01-31T12:17:29.806 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475350.log 2024-01-31T12:17:29.808 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.289982.log: /var/log/ceph/ceph-client.admin.303584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434324.log 2024-01-31T12:17:29.808 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.92065.log.gz 2024-01-31T12:17:29.808 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.475350.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.475350.log.gz 2024-01-31T12:17:29.810 INFO:teuthology.orchestra.run.smithi049.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.289171.log.gz 2024-01-31T12:17:29.811 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.299091.log.gz 2024-01-31T12:17:29.811 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431435.log 2024-01-31T12:17:29.812 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388515.log 2024-01-31T12:17:29.815 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.434324.log: /var/log/ceph/ceph-client.admin.431435.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.251452.log.gz 2024-01-31T12:17:29.815 INFO:teuthology.orchestra.run.smithi049.stderr:gzip 81.5% -- replaced with /var/log/ceph/ceph-client.admin.250240.log.gz -5 2024-01-31T12:17:29.815 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.425548.log 2024-01-31T12:17:29.817 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388723.log 2024-01-31T12:17:29.818 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.388515.log: /var/log/ceph/ceph-client.admin.425548.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.303584.log.gz 2024-01-31T12:17:29.818 INFO:teuthology.orchestra.run.smithi049.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.219004.log.gz 2024-01-31T12:17:29.818 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.303990.log.gz 2024-01-31T12:17:29.819 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.249846.log.gz 2024-01-31T12:17:29.820 INFO:teuthology.orchestra.run.smithi049.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.434324.log.gz 2024-01-31T12:17:29.820 INFO:teuthology.orchestra.run.smithi049.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.171803.log.gz 2024-01-31T12:17:29.821 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202042.log 2024-01-31T12:17:29.822 INFO:teuthology.orchestra.run.smithi049.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.431435.log.gz 2024-01-31T12:17:29.822 INFO:teuthology.orchestra.run.smithi049.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.214920.log.gz 2024-01-31T12:17:29.825 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.388723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374463.log 2024-01-31T12:17:29.825 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.388723.log.gz 2024-01-31T12:17:29.826 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.202042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136785.log 2024-01-31T12:17:29.828 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.374463.log: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.374463.log.gz 2024-01-31T12:17:29.829 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238471.log 2024-01-31T12:17:29.832 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359529.log 2024-01-31T12:17:29.833 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421098.log 2024-01-31T12:17:29.835 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.359529.log: /var/log/ceph/ceph-client.admin.238471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466283.log 2024-01-31T12:17:29.837 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.421098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34853.log 2024-01-31T12:17:29.840 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.466283.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.238471.log.gz 2024-01-31T12:17:29.840 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388108.log 2024-01-31T12:17:29.841 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.421098.log.gz 2024-01-31T12:17:29.841 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493556.log 2024-01-31T12:17:29.844 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.388108.log: /var/log/ceph/ceph-client.admin.34853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458778.log 2024-01-31T12:17:29.847 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.493556.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.493556.log.gz 2024-01-31T12:17:29.847 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188080.log 2024-01-31T12:17:29.849 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.458778.log: /var/log/ceph/ceph-client.admin.89998.log 2024-01-31T12:17:29.851 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.188080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170105.log 2024-01-31T12:17:29.852 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302717.log 2024-01-31T12:17:29.854 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.170105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31968.log 2024-01-31T12:17:29.857 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.302717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283110.log 2024-01-31T12:17:29.859 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419316.log 2024-01-31T12:17:29.862 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.283110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389139.log 2024-01-31T12:17:29.862 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.359529.log.gz 2024-01-31T12:17:29.863 INFO:teuthology.orchestra.run.smithi049.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.188080.log.gz 2024-01-31T12:17:29.865 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.419316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173535.log 2024-01-31T12:17:29.866 INFO:teuthology.orchestra.run.smithi049.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.466283.log.gz 2024-01-31T12:17:29.867 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168379.log 2024-01-31T12:17:29.868 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.389139.log: /var/log/ceph/ceph-client.admin.173535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106066.log 2024-01-31T12:17:29.870 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.168379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198904.log 2024-01-31T12:17:29.870 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106066.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.386453.log.gz 2024-01-31T12:17:29.872 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188924.log 2024-01-31T12:17:29.873 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.198904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219398.log 2024-01-31T12:17:29.874 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.188924.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.106066.log.gz 2024-01-31T12:17:29.875 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363688.log 2024-01-31T12:17:29.878 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.219398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400059.log 2024-01-31T12:17:29.878 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.202042.log.gz 2024-01-31T12:17:29.880 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.363688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233227.log 2024-01-31T12:17:29.880 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.400059.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.202051.log.gz 2024-01-31T12:17:29.880 INFO:teuthology.orchestra.run.smithi049.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.170105.log.gz 2024-01-31T12:17:29.881 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247620.log 2024-01-31T12:17:29.884 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.233227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37109.log 2024-01-31T12:17:29.885 INFO:teuthology.orchestra.run.smithi049.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.160835.log.gz 2024-01-31T12:17:29.886 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.136785.log.gz 2024-01-31T12:17:29.886 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289973.log 2024-01-31T12:17:29.889 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.247620.log: /var/log/ceph/ceph-client.admin.37109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211456.log 2024-01-31T12:17:29.891 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.289973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365475.log 2024-01-31T12:17:29.891 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.211456.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.419316.log.gz 2024-01-31T12:17:29.893 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399242.log 2024-01-31T12:17:29.893 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.389139.log.gz 2024-01-31T12:17:29.894 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.365475.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.425548.log.gz 2024-01-31T12:17:29.895 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471485.log 2024-01-31T12:17:29.896 INFO:teuthology.orchestra.run.smithi049.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.458778.log.gz 2024-01-31T12:17:29.898 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.399242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291195.log 2024-01-31T12:17:29.900 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.471485.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.471485.log.gz 2024-01-31T12:17:29.901 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129269.log 2024-01-31T12:17:29.904 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.291195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252274.log 2024-01-31T12:17:29.906 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212844.log 2024-01-31T12:17:29.907 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.252274.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.388515.log.gz 2024-01-31T12:17:29.909 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397634.log 2024-01-31T12:17:29.912 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.212844.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.388108.log.gz 2024-01-31T12:17:29.912 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317399.log 2024-01-31T12:17:29.915 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.397634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238873.log 2024-01-31T12:17:29.918 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.317399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172664.log 2024-01-31T12:17:29.920 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.238873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251461.log 2024-01-31T12:17:29.922 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182292.log 2024-01-31T12:17:29.924 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.172664.log: /var/log/ceph/ceph-client.admin.251461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443115.log 2024-01-31T12:17:29.926 INFO:teuthology.orchestra.run.smithi049.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.31968.log.gz 2024-01-31T12:17:29.927 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.182292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497024.log 2024-01-31T12:17:29.928 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203258.log 2024-01-31T12:17:29.929 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.443115.log: /var/log/ceph/ceph-client.admin.497024.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.497024.log.gz 2024-01-31T12:17:29.931 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201102.log 2024-01-31T12:17:29.933 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.203258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198013.log 2024-01-31T12:17:29.934 INFO:teuthology.orchestra.run.smithi049.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.400059.log.gz 2024-01-31T12:17:29.935 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.201102.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37109.log.gz 2024-01-31T12:17:29.936 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.238873.log.gz 2024-01-31T12:17:29.937 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100612.log 2024-01-31T12:17:29.938 INFO:teuthology.orchestra.run.smithi049.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.89998.log.gz 2024-01-31T12:17:29.939 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459434.log 2024-01-31T12:17:29.942 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.198013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222526.log 2024-01-31T12:17:29.942 INFO:teuthology.orchestra.run.smithi049.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.247620.log.gz 2024-01-31T12:17:29.943 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.459434.log: /var/log/ceph/ceph-client.admin.100612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308048.log 2024-01-31T12:17:29.946 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.222526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288357.log 2024-01-31T12:17:29.946 INFO:teuthology.orchestra.run.smithi049.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.219398.log.gz 2024-01-31T12:17:29.947 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92056.log 2024-01-31T12:17:29.949 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.308048.log: /var/log/ceph/ceph-client.admin.288357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247212.log 2024-01-31T12:17:29.950 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.92056.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.365475.log.gz 2024-01-31T12:17:29.951 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.168379.log.gz 2024-01-31T12:17:29.951 INFO:teuthology.orchestra.run.smithi049.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.283110.log.gz 2024-01-31T12:17:29.951 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420229.log 2024-01-31T12:17:29.952 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.247212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156927.log 2024-01-31T12:17:29.953 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.420229.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.188924.log.gz 2024-01-31T12:17:29.955 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37318.log 2024-01-31T12:17:29.956 INFO:teuthology.orchestra.run.smithi049.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.129269.log.gz 2024-01-31T12:17:29.957 INFO:teuthology.orchestra.run.smithi049.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.233227.log.gz 2024-01-31T12:17:29.958 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.156927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282701.log 2024-01-31T12:17:29.961 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.37318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189326.log 2024-01-31T12:17:29.963 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.282701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494845.log 2024-01-31T12:17:29.964 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.189326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33488.log 2024-01-31T12:17:29.967 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.494845.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.399242.log.gz 2024-01-31T12:17:29.968 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312200.log 2024-01-31T12:17:29.969 INFO:teuthology.orchestra.run.smithi049.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.494845.log.gz 2024-01-31T12:17:29.969 INFO:teuthology.orchestra.run.smithi049.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.172664.log.gz 2024-01-31T12:17:29.969 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.308048.log.gz 2024-01-31T12:17:29.970 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33488.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.459434.log.gz 2024-01-31T12:17:29.971 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413154.log 2024-01-31T12:17:29.972 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.312200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177397.log 2024-01-31T12:17:29.975 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.413154.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.222526.log.gz 2024-01-31T12:17:29.975 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81919.log 2024-01-31T12:17:29.976 INFO:teuthology.orchestra.run.smithi049.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.212844.log.gz 2024-01-31T12:17:29.976 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.177397.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.251461.log.gz 2024-01-31T12:17:29.977 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154870.log 2024-01-31T12:17:29.979 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349478.log 2024-01-31T12:17:29.980 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.189326.log.gz 2024-01-31T12:17:29.980 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.182292.log.gz 2024-01-31T12:17:29.981 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.154870.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.203258.log.gz 2024-01-31T12:17:29.981 INFO:teuthology.orchestra.run.smithi049.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.100612.log.gz 2024-01-31T12:17:29.982 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459030.log 2024-01-31T12:17:29.984 INFO:teuthology.orchestra.run.smithi049.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.363688.log.gz 2024-01-31T12:17:29.985 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.349478.log: gzip 81.4% -- replaced with /var/log/ceph/ceph-client.admin.81919.log.gz 2024-01-31T12:17:29.985 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.137732.log 2024-01-31T12:17:29.986 INFO:teuthology.orchestra.run.smithi049.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.92056.log.gz 2024-01-31T12:17:29.986 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33488.log.gz 2024-01-31T12:17:29.987 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.459030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231904.log 2024-01-31T12:17:29.987 INFO:teuthology.orchestra.run.smithi049.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.247212.log.gz 2024-01-31T12:17:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.137732.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.282701.log.gz 2024-01-31T12:17:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313604.log 2024-01-31T12:17:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.231904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203653.log 2024-01-31T12:17:29.994 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.313604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239275.log 2024-01-31T12:17:29.997 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.203653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488015.log 2024-01-31T12:17:30.000 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.239275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32641.log 2024-01-31T12:17:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.488015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353024.log 2024-01-31T12:17:30.003 INFO:teuthology.orchestra.run.smithi049.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.488015.log.gz 2024-01-31T12:17:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417674.log 2024-01-31T12:17:30.006 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.353024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32498.log 2024-01-31T12:17:30.009 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.417674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407629.log 2024-01-31T12:17:30.012 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250652.log 2024-01-31T12:17:30.015 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.407629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175246.log 2024-01-31T12:17:30.018 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.250652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102242.log 2024-01-31T12:17:30.020 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.175246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195195.log 2024-01-31T12:17:30.023 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.102242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350328.log 2024-01-31T12:17:30.024 INFO:teuthology.orchestra.run.smithi049.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.211456.log.gz 2024-01-31T12:17:30.024 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.420229.log.gz 2024-01-31T12:17:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.195195.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.413154.log.gz 2024-01-31T12:17:30.026 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181085.log 2024-01-31T12:17:30.028 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.350328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202454.log 2024-01-31T12:17:30.031 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.181085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304393.log 2024-01-31T12:17:30.032 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.202454.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.397634.log.gz 2024-01-31T12:17:30.032 INFO:teuthology.orchestra.run.smithi049.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.417674.log.gz 2024-01-31T12:17:30.033 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351566.log 2024-01-31T12:17:30.033 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.304393.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.349478.log.gz 2024-01-31T12:17:30.034 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.317399.log.gz 2024-01-31T12:17:30.035 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198450.log 2024-01-31T12:17:30.037 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.351566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421556.log 2024-01-31T12:17:30.040 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.198450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210178.log 2024-01-31T12:17:30.040 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.231904.log.gz 2024-01-31T12:17:30.041 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.421556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470187.log 2024-01-31T12:17:30.042 INFO:teuthology.orchestra.run.smithi049.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.288357.log.gz 2024-01-31T12:17:30.042 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.210178.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.181085.log.gz 2024-01-31T12:17:30.043 INFO:teuthology.orchestra.run.smithi049.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.137732.log.gz 2024-01-31T12:17:30.044 INFO:teuthology.orchestra.run.smithi049.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.177397.log.gz 2024-01-31T12:17:30.045 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251868.log 2024-01-31T12:17:30.047 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164409.log 2024-01-31T12:17:30.047 INFO:teuthology.orchestra.run.smithi049.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.459030.log.gz 2024-01-31T12:17:30.048 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.251868.log: /var/log/ceph/ceph-client.admin.470187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126792.log 2024-01-31T12:17:30.051 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.164409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439820.log 2024-01-31T12:17:30.053 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.126792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399233.log 2024-01-31T12:17:30.054 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.439820.log: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.203653.log.gz 2024-01-31T12:17:30.055 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289572.log 2024-01-31T12:17:30.055 INFO:teuthology.orchestra.run.smithi049.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.175246.log.gz 2024-01-31T12:17:30.058 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.399233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249837.log 2024-01-31T12:17:30.058 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.154870.log.gz 2024-01-31T12:17:30.059 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.289572.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.470187.log.gz 2024-01-31T12:17:30.060 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161265.log 2024-01-31T12:17:30.062 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.249837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32207.log 2024-01-31T12:17:30.063 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.202454.log.gz 2024-01-31T12:17:30.063 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163413.log 2024-01-31T12:17:30.066 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.161265.log: /var/log/ceph/ceph-client.admin.32207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34905.log 2024-01-31T12:17:30.069 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.163413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471494.log 2024-01-31T12:17:30.070 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490555.log 2024-01-31T12:17:30.072 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34905.log: /var/log/ceph/ceph-client.admin.471494.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.471494.log.gz 2024-01-31T12:17:30.073 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32864.log 2024-01-31T12:17:30.074 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.490555.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.421556.log.gz 2024-01-31T12:17:30.074 INFO:teuthology.orchestra.run.smithi049.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.490555.log.gz 2024-01-31T12:17:30.075 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.239275.log.gz 2024-01-31T12:17:30.077 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162544.log 2024-01-31T12:17:30.077 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.173535.log.gz 2024-01-31T12:17:30.078 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197602.log 2024-01-31T12:17:30.079 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.162544.log: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.304393.log.gz 2024-01-31T12:17:30.080 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.399233.log.gz 2024-01-31T12:17:30.081 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465880.log 2024-01-31T12:17:30.083 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474501.log 2024-01-31T12:17:30.085 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.465880.log: /var/log/ceph/ceph-client.admin.197602.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.439820.log.gz 2024-01-31T12:17:30.087 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74685.log 2024-01-31T12:17:30.089 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199336.log 2024-01-31T12:17:30.092 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74685.log: /var/log/ceph/ceph-client.admin.474501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452455.log 2024-01-31T12:17:30.094 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290788.log 2024-01-31T12:17:30.094 INFO:teuthology.orchestra.run.smithi049.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.161265.log.gz 2024-01-31T12:17:30.095 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.199336.log: /var/log/ceph/ceph-client.admin.452455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315340.log 2024-01-31T12:17:30.096 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.290788.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.474501.log.gz 2024-01-31T12:17:30.098 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496023.log 2024-01-31T12:17:30.100 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420220.log 2024-01-31T12:17:30.100 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.315340.log: /var/log/ceph/ceph-client.admin.496023.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.496023.log.gz 2024-01-31T12:17:30.102 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419752.log 2024-01-31T12:17:30.103 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.302717.log.gz 2024-01-31T12:17:30.105 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.420220.log: gzip 90.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.312200.log.gz 2024-01-31T12:17:30.105 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35591.log 2024-01-31T12:17:30.106 INFO:teuthology.orchestra.run.smithi049.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.249837.log.gz 2024-01-31T12:17:30.106 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.313604.log.gz 2024-01-31T12:17:30.107 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.419752.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.251868.log.gz 2024-01-31T12:17:30.108 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463054.log 2024-01-31T12:17:30.110 INFO:teuthology.orchestra.run.smithi049.stderr:gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34853.log.gz -5 2024-01-31T12:17:30.110 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.464662.log 2024-01-31T12:17:30.112 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.463054.log: /var/log/ceph/ceph-client.admin.35591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137492.log 2024-01-31T12:17:30.112 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.464662.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.223332.log.gz 2024-01-31T12:17:30.114 INFO:teuthology.orchestra.run.smithi049.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.289973.log.gz 2024-01-31T12:17:30.115 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.291195.log.gz 2024-01-31T12:17:30.115 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182703.log 2024-01-31T12:17:30.116 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.137492.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32864.log.gz 2024-01-31T12:17:30.116 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.289982.log.gz 2024-01-31T12:17:30.116 INFO:teuthology.orchestra.run.smithi049.stderr:gzip 80.8% -- replaced with /var/log/ceph/ceph-client.admin.126792.log.gz -5 2024-01-31T12:17:30.116 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.441093.log 2024-01-31T12:17:30.118 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.182703.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.102242.log.gz 2024-01-31T12:17:30.119 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36552.log 2024-01-31T12:17:30.122 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.441093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436354.log 2024-01-31T12:17:30.124 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32641.log.gz 2024-01-31T12:17:30.124 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314938.log 2024-01-31T12:17:30.127 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36552.log: /var/log/ceph/ceph-client.admin.436354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281894.log 2024-01-31T12:17:30.128 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.314938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36950.log 2024-01-31T12:17:30.129 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.281894.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.436354.log.gz 2024-01-31T12:17:30.130 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.195195.log.gz 2024-01-31T12:17:30.131 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75274.log 2024-01-31T12:17:30.134 INFO:teuthology.orchestra.run.smithi049.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.419752.log.gz 2024-01-31T12:17:30.134 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36950.log: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.420220.log.gz 2024-01-31T12:17:30.134 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375686.log 2024-01-31T12:17:30.135 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75274.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.74685.log.gz 2024-01-31T12:17:30.137 INFO:teuthology.orchestra.run.smithi049.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.464662.log.gz 2024-01-31T12:17:30.137 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389949.log 2024-01-31T12:17:30.140 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.375686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485040.log 2024-01-31T12:17:30.141 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.182703.log.gz 2024-01-31T12:17:30.143 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.389949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204483.log 2024-01-31T12:17:30.143 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.315340.log.gz 2024-01-31T12:17:30.144 INFO:teuthology.orchestra.run.smithi049.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.463054.log.gz 2024-01-31T12:17:30.145 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.485040.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.353024.log.gz 2024-01-31T12:17:30.146 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296279.log 2024-01-31T12:17:30.146 INFO:teuthology.orchestra.run.smithi049.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.485040.log.gz 2024-01-31T12:17:30.149 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.204483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81511.log 2024-01-31T12:17:30.151 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.296279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427609.log 2024-01-31T12:17:30.154 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89989.log 2024-01-31T12:17:30.157 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.427609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430586.log 2024-01-31T12:17:30.159 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183904.log 2024-01-31T12:17:30.162 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.430586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495675.log 2024-01-31T12:17:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.183904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34794.log 2024-01-31T12:17:30.167 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.495675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491000.log 2024-01-31T12:17:30.169 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34794.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.495675.log.gz 2024-01-31T12:17:30.171 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307221.log 2024-01-31T12:17:30.173 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.491000.log: gzip 80.5% -- replaced with /var/log/ceph/ceph-client.admin.491000.log.gz -5 2024-01-31T12:17:30.174 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.424282.log 2024-01-31T12:17:30.177 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.307221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411472.log 2024-01-31T12:17:30.177 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.75274.log.gz 2024-01-31T12:17:30.177 INFO:teuthology.orchestra.run.smithi049.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.89989.log.gz 2024-01-31T12:17:30.180 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.424282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186365.log 2024-01-31T12:17:30.180 INFO:teuthology.orchestra.run.smithi049.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.465880.log.gz 2024-01-31T12:17:30.182 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36552.log.gz 2024-01-31T12:17:30.183 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.411472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303999.log 2024-01-31T12:17:30.183 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.281894.log.gz 2024-01-31T12:17:30.185 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.186365.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36950.log.gz 2024-01-31T12:17:30.185 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155684.log 2024-01-31T12:17:30.186 INFO:teuthology.orchestra.run.smithi049.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.375686.log.gz 2024-01-31T12:17:30.189 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.303999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475768.log 2024-01-31T12:17:30.190 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32498.log.gz 2024-01-31T12:17:30.190 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.314938.log.gz 2024-01-31T12:17:30.191 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.427609.log.gz 2024-01-31T12:17:30.192 INFO:teuthology.orchestra.run.smithi195.stderr: 94.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-31T12:17:30.192 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.155684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128456.log 2024-01-31T12:17:30.194 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.475768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355895.log 2024-01-31T12:17:30.196 INFO:teuthology.orchestra.run.smithi049.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.475768.log.gz 2024-01-31T12:17:30.197 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347824.log 2024-01-31T12:17:30.198 INFO:teuthology.orchestra.run.smithi049.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.474066.log.gz 2024-01-31T12:17:30.200 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.355895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286749.log 2024-01-31T12:17:30.201 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405196.log 2024-01-31T12:17:30.203 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.347824.log: /var/log/ceph/ceph-client.admin.286749.log: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.156927.log.gz 2024-01-31T12:17:30.203 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478759.log 2024-01-31T12:17:30.204 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.405196.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.430586.log.gz 2024-01-31T12:17:30.204 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.155684.log.gz 2024-01-31T12:17:30.205 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190923.log 2024-01-31T12:17:30.206 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.478759.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.478759.log.gz 2024-01-31T12:17:30.208 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472289.log 2024-01-31T12:17:30.211 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.190923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193538.log 2024-01-31T12:17:30.212 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.472289.log: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.421970.log.gz 2024-01-31T12:17:30.213 INFO:teuthology.orchestra.run.smithi049.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.307221.log.gz 2024-01-31T12:17:30.213 INFO:teuthology.orchestra.run.smithi049.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.472289.log.gz 2024-01-31T12:17:30.215 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418503.log 2024-01-31T12:17:30.217 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose 90.1% -- -- replaced with /var/log/ceph/ceph-client.admin.424282.log.gz 2024-01-31T12:17:30.217 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.483347.log 2024-01-31T12:17:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.193538.log: /var/log/ceph/ceph-client.admin.418503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99411.log 2024-01-31T12:17:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441897.log 2024-01-31T12:17:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.483347.log: /var/log/ceph/ceph-client.admin.99411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33054.log 2024-01-31T12:17:30.226 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.441897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228652.log 2024-01-31T12:17:30.228 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33054.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-01-31T12:17:30.230 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.228652.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.483347.log.gz 2024-01-31T12:17:30.230 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177837.log 2024-01-31T12:17:30.230 INFO:teuthology.orchestra.run.smithi049.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.250652.log.gz 2024-01-31T12:17:30.232 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325411.log 2024-01-31T12:17:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.177837.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.389949.log.gz 2024-01-31T12:17:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160844.log 2024-01-31T12:17:30.236 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.325411.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.163413.log.gz 2024-01-31T12:17:30.236 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373240.log 2024-01-31T12:17:30.238 INFO:teuthology.orchestra.run.smithi049.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.204483.log.gz 2024-01-31T12:17:30.239 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459021.log 2024-01-31T12:17:30.239 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.160844.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.355895.log.gz 2024-01-31T12:17:30.239 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34611.log 2024-01-31T12:17:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.459021.log: /var/log/ceph/ceph-client.admin.373240.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.183904.log.gz 2024-01-31T12:17:30.242 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135053.log 2024-01-31T12:17:30.243 INFO:teuthology.orchestra.run.smithi049.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.197602.log.gz 2024-01-31T12:17:30.243 INFO:teuthology.orchestra.run.smithi049.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.210178.log.gz 2024-01-31T12:17:30.243 INFO:teuthology.orchestra.run.smithi049.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.199336.log.gz 2024-01-31T12:17:30.244 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190521.log 2024-01-31T12:17:30.245 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34611.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33054.log.gz 2024-01-31T12:17:30.245 INFO:teuthology.orchestra.run.smithi049.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.128456.log.gz 2024-01-31T12:17:30.247 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389547.log 2024-01-31T12:17:30.248 INFO:teuthology.orchestra.run.smithi049.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.0.37318.log.gz 2024-01-31T12:17:30.248 INFO:teuthology.orchestra.run.smithi049.stderr: 92.8% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.443115.log.gz 2024-01-31T12:17:30.248 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.228652.log.gz 2024-01-31T12:17:30.248 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35591.log.gz 2024-01-31T12:17:30.249 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.190521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32233.log 2024-01-31T12:17:30.252 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287950.log 2024-01-31T12:17:30.253 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.389547.log: /var/log/ceph/ceph-client.admin.32233.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.193538.log.gz 2024-01-31T12:17:30.254 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31438.log 2024-01-31T12:17:30.256 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.287950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32654.log 2024-01-31T12:17:30.258 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188491.log 2024-01-31T12:17:30.258 INFO:teuthology.orchestra.run.smithi049.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.81511.log.gz 2024-01-31T12:17:30.260 INFO:teuthology.orchestra.run.smithi195.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-01-31T12:17:30.261 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32654.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.389547.log.gz 2024-01-31T12:17:30.261 INFO:teuthology.orchestra.run.smithi049.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.137492.log.gz 2024-01-31T12:17:30.261 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.418503.log.gz 2024-01-31T12:17:30.261 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.459021.log.gz 2024-01-31T12:17:30.262 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 90.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.303999.log.gz /var/log/ceph/ceph-client.admin.286346.log 2024-01-31T12:17:30.262 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-31T12:17:30.263 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.188491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83983.log 2024-01-31T12:17:30.265 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.286346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34931.log 2024-01-31T12:17:30.266 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314929.log 2024-01-31T12:17:30.268 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34931.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.350328.log.gz 2024-01-31T12:17:30.268 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.190521.log.gz 2024-01-31T12:17:30.270 INFO:teuthology.orchestra.run.smithi049.stderr:gzip 84.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.351566.log.gz --verbose -- 2024-01-31T12:17:30.270 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.160405.log 2024-01-31T12:17:30.270 INFO:teuthology.orchestra.run.smithi049.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.190923.log.gz 2024-01-31T12:17:30.270 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.286346.log.gz 2024-01-31T12:17:30.270 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.287950.log.gz 2024-01-31T12:17:30.272 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.314929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103058.log 2024-01-31T12:17:30.275 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.160405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462651.log 2024-01-31T12:17:30.277 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.103058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466274.log 2024-01-31T12:17:30.279 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386859.log 2024-01-31T12:17:30.280 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.462651.log: /var/log/ceph/ceph-client.admin.466274.log: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.289572.log.gz 2024-01-31T12:17:30.280 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.290788.log.gz 2024-01-31T12:17:30.281 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283517.log 2024-01-31T12:17:30.283 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.386859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284326.log 2024-01-31T12:17:30.285 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76589.log 2024-01-31T12:17:30.287 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.283517.log: /var/log/ceph/ceph-client.admin.284326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154052.log 2024-01-31T12:17:30.288 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402703.log 2024-01-31T12:17:30.289 INFO:teuthology.orchestra.run.smithi049.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.411472.log.gz 2024-01-31T12:17:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.154052.log: /var/log/ceph/ceph-client.admin.76589.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.296279.log.gz 2024-01-31T12:17:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32851.log 2024-01-31T12:17:30.292 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.99411.log.gz 2024-01-31T12:17:30.292 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185527.log 2024-01-31T12:17:30.294 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32851.log: /var/log/ceph/ceph-client.admin.402703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105212.log 2024-01-31T12:17:30.296 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.185527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97791.log 2024-01-31T12:17:30.298 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.105212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402292.log 2024-01-31T12:17:30.299 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.347824.log.gz 2024-01-31T12:17:30.301 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33382.log 2024-01-31T12:17:30.301 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.97791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34143.log 2024-01-31T12:17:30.303 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33382.log: /var/log/ceph/ceph-client.admin.402292.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.441093.log.gz 2024-01-31T12:17:30.304 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483773.log 2024-01-31T12:17:30.304 INFO:teuthology.orchestra.run.smithi049.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32851.log.gz 2024-01-31T12:17:30.305 INFO:teuthology.orchestra.run.smithi049.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.441897.log.gz 2024-01-31T12:17:30.305 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31438.log.gz 2024-01-31T12:17:30.306 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32446.log 2024-01-31T12:17:30.307 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34143.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32654.log.gz 2024-01-31T12:17:30.307 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138564.log 2024-01-31T12:17:30.308 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.483773.log: /var/log/ceph/ceph-client.admin.32446.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33382.log.gz 2024-01-31T12:17:30.309 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481246.log 2024-01-31T12:17:30.310 INFO:teuthology.orchestra.run.smithi049.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.83983.log.gz 2024-01-31T12:17:30.310 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32259.log 2024-01-31T12:17:30.311 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.481246.log: /var/log/ceph/ceph-client.admin.138564.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.105212.log.gz 2024-01-31T12:17:30.312 INFO:teuthology.orchestra.run.smithi049.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.481246.log.gz 2024-01-31T12:17:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92870.log 2024-01-31T12:17:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386031.log 2024-01-31T12:17:30.317 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.92870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441495.log 2024-01-31T12:17:30.317 INFO:teuthology.orchestra.run.smithi049.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.483773.log.gz 2024-01-31T12:17:30.318 INFO:teuthology.orchestra.run.smithi049.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.314929.log.gz 2024-01-31T12:17:30.319 INFO:teuthology.orchestra.run.smithi049.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.402292.log.gz 2024-01-31T12:17:30.319 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201607.log 2024-01-31T12:17:30.320 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.386031.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.466274.log.gz 2024-01-31T12:17:30.321 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.441495.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.462651.log.gz 2024-01-31T12:17:30.322 INFO:teuthology.orchestra.run.smithi049.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.283517.log.gz 2024-01-31T12:17:30.322 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.402703.log.gz 2024-01-31T12:17:30.322 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34429.log 2024-01-31T12:17:30.324 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34611.log.gz 2024-01-31T12:17:30.324 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354243.log 2024-01-31T12:17:30.325 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.201607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214929.log 2024-01-31T12:17:30.329 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.354243.log: /var/log/ceph/ceph-client.admin.34429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479162.log 2024-01-31T12:17:30.329 INFO:teuthology.orchestra.run.smithi049.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.386859.log.gz 2024-01-31T12:17:30.329 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252265.log 2024-01-31T12:17:30.330 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.479162.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.479162.log.gz 2024-01-31T12:17:30.332 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.214929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35935.log 2024-01-31T12:17:30.333 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477943.log 2024-01-31T12:17:30.335 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.252265.log: /var/log/ceph/ceph-client.admin.35935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321921.log 2024-01-31T12:17:30.337 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.477943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222938.log 2024-01-31T12:17:30.339 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160011.log 2024-01-31T12:17:30.340 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.222938.log: /var/log/ceph/ceph-client.admin.321921.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.477943.log.gz 2024-01-31T12:17:30.340 INFO:teuthology.orchestra.run.smithi049.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.186365.log.gz 2024-01-31T12:17:30.341 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292534.log 2024-01-31T12:17:30.343 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.160011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356288.log 2024-01-31T12:17:30.346 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.292534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489288.log 2024-01-31T12:17:30.346 INFO:teuthology.orchestra.run.smithi049.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.154052.log.gz 2024-01-31T12:17:30.347 INFO:teuthology.orchestra.run.smithi049.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.160405.log.gz 2024-01-31T12:17:30.347 INFO:teuthology.orchestra.run.smithi049.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.138564.log.gz 2024-01-31T12:17:30.348 INFO:teuthology.orchestra.run.smithi049.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.252265.log.gz 2024-01-31T12:17:30.348 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.356288.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.160011.log.gz 2024-01-31T12:17:30.349 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438842.log 2024-01-31T12:17:30.350 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.185527.log.gz 2024-01-31T12:17:30.351 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194793.log 2024-01-31T12:17:30.352 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.489288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108117.log 2024-01-31T12:17:30.355 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.194793.log: /var/log/ceph/ceph-client.admin.438842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94121.log 2024-01-31T12:17:30.356 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34247.log 2024-01-31T12:17:30.359 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94121.log: /var/log/ceph/ceph-client.admin.108117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378968.log 2024-01-31T12:17:30.360 INFO:teuthology.orchestra.run.smithi049.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.489288.log.gz 2024-01-31T12:17:30.362 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34247.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-01-31T12:17:30.364 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306819.log 2024-01-31T12:17:30.365 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.378968.log: /var/log/ceph/ceph-mon.a.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.284326.log.gz 2024-01-31T12:17:30.366 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193127.log 2024-01-31T12:17:30.367 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.286749.log.gz 2024-01-31T12:17:30.369 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.306819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135972.log 2024-01-31T12:17:30.371 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.193127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464671.log 2024-01-31T12:17:30.373 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442310.log 2024-01-31T12:17:30.375 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135972.log: /var/log/ceph/ceph-client.admin.464671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329590.log 2024-01-31T12:17:30.378 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.442310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172673.log 2024-01-31T12:17:30.381 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.329590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106892.log 2024-01-31T12:17:30.383 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.172673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170544.log 2024-01-31T12:17:30.386 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485466.log 2024-01-31T12:17:30.387 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.170544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389940.log 2024-01-31T12:17:30.388 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31612.log 2024-01-31T12:17:30.390 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.485466.log: /var/log/ceph/ceph-client.admin.389940.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.485466.log.gz 2024-01-31T12:17:30.391 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37263.log 2024-01-31T12:17:30.393 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317838.log 2024-01-31T12:17:30.395 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.37263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201598.log 2024-01-31T12:17:30.398 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.317838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36598.log 2024-01-31T12:17:30.399 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362475.log 2024-01-31T12:17:30.401 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.201598.log: /var/log/ceph/ceph-client.admin.36598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428426.log 2024-01-31T12:17:30.404 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.362475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229869.log 2024-01-31T12:17:30.406 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.428426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33044.log 2024-01-31T12:17:30.409 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.229869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134559.log 2024-01-31T12:17:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33044.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.97791.log.gzgzip 2024-01-31T12:17:30.411 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.316996.log 2024-01-31T12:17:30.414 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.134559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489714.log 2024-01-31T12:17:30.414 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.356288.log.gz 2024-01-31T12:17:30.415 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.441495.log.gz 2024-01-31T12:17:30.416 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.316996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301895.log 2024-01-31T12:17:30.419 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.489714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35644.log 2024-01-31T12:17:30.421 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453701.log 2024-01-31T12:17:30.422 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35644.log: /var/log/ceph/ceph-client.admin.301895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431041.log 2024-01-31T12:17:30.425 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.453701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35036.log 2024-01-31T12:17:30.425 INFO:teuthology.orchestra.run.smithi049.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.489714.log.gz 2024-01-31T12:17:30.428 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.431041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240946.log 2024-01-31T12:17:30.431 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234031.log 2024-01-31T12:17:30.432 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32207.log.gz 2024-01-31T12:17:30.432 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.240946.log: /var/log/ceph/ceph-client.admin.296270.log 2024-01-31T12:17:30.433 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32233.log.gz 2024-01-31T12:17:30.433 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32259.log.gz 2024-01-31T12:17:30.434 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.234031.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34143.log.gz 2024-01-31T12:17:30.434 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34931.log.gz 2024-01-31T12:17:30.435 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34905.log.gz -- replaced with /var/log/ceph/ceph-client.admin.34247.log.gz 2024-01-31T12:17:30.435 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-31T12:17:30.435 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34794.log.gz 2024-01-31T12:17:30.435 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33044.log.gz 2024-01-31T12:17:30.436 INFO:teuthology.orchestra.run.smithi049.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35935.log.gz 2024-01-31T12:17:30.436 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127206.log 2024-01-31T12:17:30.437 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.194793.log.gz 2024-01-31T12:17:30.440 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34429.log.gz 2024-01-31T12:17:30.440 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.296270.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32446.log.gz 2024-01-31T12:17:30.440 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100217.log 2024-01-31T12:17:30.441 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372433.log 2024-01-31T12:17:30.441 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.127206.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35644.log.gz 2024-01-31T12:17:30.443 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.100217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166664.log 2024-01-31T12:17:30.443 INFO:teuthology.orchestra.run.smithi049.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.296270.log.gz 2024-01-31T12:17:30.444 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.372433.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.135053.log.gz 2024-01-31T12:17:30.444 INFO:teuthology.orchestra.run.smithi049.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.292534.log.gz 2024-01-31T12:17:30.444 INFO:teuthology.orchestra.run.smithi049.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.321921.log.gz 2024-01-31T12:17:30.444 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% 90.2% -- replaced with /var/log/ceph/ceph-client.admin.306819.log.gz 2024-01-31T12:17:30.445 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.316996.log.gz 2024-01-31T12:17:30.445 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159572.log 2024-01-31T12:17:30.446 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.389940.log.gz 2024-01-31T12:17:30.446 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431846.log 2024-01-31T12:17:30.447 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.159572.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.378968.log.gz 2024-01-31T12:17:30.448 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.166664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283919.log 2024-01-31T12:17:30.451 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.431846.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.405196.log.gz 2024-01-31T12:17:30.451 INFO:teuthology.orchestra.run.smithi049.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.438842.log.gz 2024-01-31T12:17:30.451 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.240946.log.gz 2024-01-31T12:17:30.451 INFO:teuthology.orchestra.run.smithi049.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.442310.log.gz 2024-01-31T12:17:30.451 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.431041.log.gz 2024-01-31T12:17:30.452 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94959.log 2024-01-31T12:17:30.452 INFO:teuthology.orchestra.run.smithi049.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.464671.log.gz 2024-01-31T12:17:30.452 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.201598.log.gz 2024-01-31T12:17:30.453 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432246.log 2024-01-31T12:17:30.454 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.283919.log: /var/log/ceph/ceph-client.admin.94959.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.222938.log.gz 2024-01-31T12:17:30.454 INFO:teuthology.orchestra.run.smithi049.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.234031.log.gz 2024-01-31T12:17:30.455 INFO:teuthology.orchestra.run.smithi049.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.159572.log.gz 2024-01-31T12:17:30.455 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.135972.log.gz 2024-01-31T12:17:30.456 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206504.log 2024-01-31T12:17:30.456 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162110.log 2024-01-31T12:17:30.457 INFO:teuthology.orchestra.run.smithi049.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.386031.log.gz 2024-01-31T12:17:30.458 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.206504.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.170544.log.gz 2024-01-31T12:17:30.460 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.432246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470613.log 2024-01-31T12:17:30.462 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.162110.log: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.354243.log.gz 2024-01-31T12:17:30.462 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353416.log 2024-01-31T12:17:30.463 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.470613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423869.log 2024-01-31T12:17:30.464 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.470613.log.gz 2024-01-31T12:17:30.464 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181899.log 2024-01-31T12:17:30.466 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.423869.log: /var/log/ceph/ceph-client.admin.353416.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.92870.log.gz 2024-01-31T12:17:30.467 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425961.log 2024-01-31T12:17:30.469 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.181899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486316.log 2024-01-31T12:17:30.470 INFO:teuthology.orchestra.run.smithi195.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-01-31T12:17:30.471 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.425961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436757.log 2024-01-31T12:17:30.473 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.486316.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.188491.log.gz 2024-01-31T12:17:30.473 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200211.log 2024-01-31T12:17:30.474 INFO:teuthology.orchestra.run.smithi049.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.486316.log.gz 2024-01-31T12:17:30.475 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.436757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193940.log 2024-01-31T12:17:30.478 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.200211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461036.log 2024-01-31T12:17:30.478 INFO:teuthology.orchestra.run.smithi049.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.177837.log.gz 2024-01-31T12:17:30.480 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.193940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496580.log 2024-01-31T12:17:30.482 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.461036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183913.log 2024-01-31T12:17:30.485 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36039.log 2024-01-31T12:17:30.485 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.496580.log.gz 2024-01-31T12:17:30.486 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487590.log 2024-01-31T12:17:30.489 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.183913.log: /var/log/ceph/ceph-client.admin.36039.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.166664.log.gz 2024-01-31T12:17:30.489 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105221.log 2024-01-31T12:17:30.491 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.487590.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.373240.log.gz 2024-01-31T12:17:30.492 INFO:teuthology.orchestra.run.smithi049.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.487590.log.gz 2024-01-31T12:17:30.492 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233629.log 2024-01-31T12:17:30.493 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387670.log 2024-01-31T12:17:30.496 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.105221.log: /var/log/ceph/ceph-client.admin.233629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378959.log 2024-01-31T12:17:30.496 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.193127.log.gz 2024-01-31T12:17:30.498 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.387670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89174.log 2024-01-31T12:17:30.500 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433922.log 2024-01-31T12:17:30.502 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.378959.log: /var/log/ceph/ceph-client.admin.89174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126382.log 2024-01-31T12:17:30.504 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34455.log 2024-01-31T12:17:30.506 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.126382.log: /var/log/ceph/ceph-client.admin.433922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352622.log 2024-01-31T12:17:30.507 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34455.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36598.log.gz 2024-01-31T12:17:30.508 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.134559.log.gz 2024-01-31T12:17:30.508 INFO:teuthology.orchestra.run.smithi049.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37263.log.gz 2024-01-31T12:17:30.508 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108969.log 2024-01-31T12:17:30.511 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.352622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137178.log 2024-01-31T12:17:30.514 INFO:teuthology.orchestra.run.smithi049.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.127206.log.gz 2024-01-31T12:17:30.514 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.193940.log.gz 2024-01-31T12:17:30.514 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35355.log 2024-01-31T12:17:30.514 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.108969.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.301895.log.gz 2024-01-31T12:17:30.514 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34533.log 2024-01-31T12:17:30.516 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35355.log: /var/log/ceph/ceph-client.admin.137178.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.229869.log.gz 2024-01-31T12:17:30.517 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493970.log 2024-01-31T12:17:30.519 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231895.log 2024-01-31T12:17:30.521 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.493970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291612.log 2024-01-31T12:17:30.522 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301502.log 2024-01-31T12:17:30.523 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.231895.log: /var/log/ceph/ceph-client.admin.291612.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.425961.log.gz 2024-01-31T12:17:30.525 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34767.log 2024-01-31T12:17:30.525 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.423869.log.gz 2024-01-31T12:17:30.525 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.433922.log.gz 2024-01-31T12:17:30.527 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.301502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482073.log 2024-01-31T12:17:30.528 INFO:teuthology.orchestra.run.smithi049.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.436757.log.gz 2024-01-31T12:17:30.529 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.431846.log.gz 2024-01-31T12:17:30.529 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34767.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.432246.log.gz 2024-01-31T12:17:30.530 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318271.log 2024-01-31T12:17:30.532 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.482073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91654.log 2024-01-31T12:17:30.533 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.461036.log.gz 2024-01-31T12:17:30.534 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.318271.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.493970.log.gz 2024-01-31T12:17:30.535 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90832.log 2024-01-31T12:17:30.538 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.91654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366280.log 2024-01-31T12:17:30.541 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36091.log 2024-01-31T12:17:30.543 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.366280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32420.log 2024-01-31T12:17:30.544 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.428426.log.gz 2024-01-31T12:17:30.544 INFO:teuthology.orchestra.run.smithi049.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.137178.log.gz 2024-01-31T12:17:30.546 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426363.log 2024-01-31T12:17:30.549 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221720.log 2024-01-31T12:17:30.552 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.426363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92861.log 2024-01-31T12:17:30.552 INFO:teuthology.orchestra.run.smithi049.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.172673.log.gz 2024-01-31T12:17:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.221720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162535.log 2024-01-31T12:17:30.556 INFO:teuthology.orchestra.run.smithi049.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.407629.log.gz 2024-01-31T12:17:30.557 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.92861.log: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.482073.log.gz 2024-01-31T12:17:30.557 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316581.log 2024-01-31T12:17:30.559 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33356.log 2024-01-31T12:17:30.560 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.162535.log: /var/log/ceph/ceph-client.admin.316581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365466.log 2024-01-31T12:17:30.561 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33356.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.353416.log.gz 2024-01-31T12:17:30.561 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.100217.log.gz 2024-01-31T12:17:30.563 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127612.log 2024-01-31T12:17:30.566 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.365466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83590.log 2024-01-31T12:17:30.568 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.127612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295031.log 2024-01-31T12:17:30.571 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36247.log 2024-01-31T12:17:30.573 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.295031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435962.log 2024-01-31T12:17:30.575 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33877.log 2024-01-31T12:17:30.575 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33356.log.gz 2024-01-31T12:17:30.578 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.435962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291621.log 2024-01-31T12:17:30.580 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.33877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404789.log 2024-01-31T12:17:30.581 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.291621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165409.log 2024-01-31T12:17:30.584 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.404789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366696.log 2024-01-31T12:17:30.587 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.165409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406407.log 2024-01-31T12:17:30.589 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.366696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400050.log 2024-01-31T12:17:30.591 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371638.log 2024-01-31T12:17:30.592 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.406407.log: /var/log/ceph/ceph-client.admin.400050.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34455.log.gz 2024-01-31T12:17:30.593 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34767.log.gz 2024-01-31T12:17:30.593 INFO:teuthology.orchestra.run.smithi049.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34533.log.gz 2024-01-31T12:17:30.594 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397173.log 2024-01-31T12:17:30.595 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202856.log 2024-01-31T12:17:30.598 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.371638.log: /var/log/ceph/ceph-client.admin.397173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236854.log 2024-01-31T12:17:30.599 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.91654.log.gz 2024-01-31T12:17:30.600 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.83590.log.gz 2024-01-31T12:17:30.600 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.283101.log 2024-01-31T12:17:30.602 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.236854.log: /var/log/ceph/ceph-client.admin.202856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292543.log 2024-01-31T12:17:30.605 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.283101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108978.log 2024-01-31T12:17:30.607 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.292543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82322.log 2024-01-31T12:17:30.608 INFO:teuthology.orchestra.run.smithi049.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.372433.log.gz 2024-01-31T12:17:30.608 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.108978.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.291612.log.gz 2024-01-31T12:17:30.610 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417133.log 2024-01-31T12:17:30.613 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.82322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191736.log 2024-01-31T12:17:30.614 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35249.log 2024-01-31T12:17:30.617 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.417133.log: /var/log/ceph/ceph-client.admin.191736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314536.log 2024-01-31T12:17:30.617 INFO:teuthology.orchestra.run.smithi049.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.231895.log.gz 2024-01-31T12:17:30.618 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222535.log 2024-01-31T12:17:30.619 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.314536.log: /var/log/ceph/ceph-client.admin.35249.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.233629.log.gz 2024-01-31T12:17:30.621 INFO:teuthology.orchestra.run.smithi049.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.365466.log.gz 2024-01-31T12:17:30.621 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32472.log 2024-01-31T12:17:30.621 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.406407.log.gz 2024-01-31T12:17:30.621 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.222535.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.236854.log.gz 2024-01-31T12:17:30.623 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.92861.log.gz 2024-01-31T12:17:30.623 INFO:teuthology.orchestra.run.smithi049.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.108969.log.gz 2024-01-31T12:17:30.625 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.314536.log.gz 2024-01-31T12:17:30.625 INFO:teuthology.orchestra.run.smithi049.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.317838.log.gz 2024-01-31T12:17:30.625 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171381.log 2024-01-31T12:17:30.625 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.318271.log.gz 2024-01-31T12:17:30.626 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36039.log.gz 2024-01-31T12:17:30.628 INFO:teuthology.orchestra.run.smithi049.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.378959.log.gz 2024-01-31T12:17:30.628 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36091.log.gz 2024-01-31T12:17:30.628 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32472.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.426363.log.gz 2024-01-31T12:17:30.629 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93263.log 2024-01-31T12:17:30.630 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.171381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99009.log 2024-01-31T12:17:30.632 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.93263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451099.log 2024-01-31T12:17:30.634 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189718.log 2024-01-31T12:17:30.636 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.451099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220273.log 2024-01-31T12:17:30.637 INFO:teuthology.orchestra.run.smithi049.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.366280.log.gz 2024-01-31T12:17:30.638 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473188.log 2024-01-31T12:17:30.640 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.189718.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.387670.log.gz 2024-01-31T12:17:30.640 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.366696.log.gz 90.1% 2024-01-31T12:17:30.640 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.435962.log.gz 2024-01-31T12:17:30.640 INFO:teuthology.orchestra.run.smithi049.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.126382.log.gz 2024-01-31T12:17:30.641 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322333.log 2024-01-31T12:17:30.641 INFO:teuthology.orchestra.run.smithi049.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.221720.log.gz 2024-01-31T12:17:30.642 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.473188.log: /var/log/ceph/ceph-client.admin.220273.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.191736.log.gz 2024-01-31T12:17:30.643 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355886.log 2024-01-31T12:17:30.646 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.322333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188089.log 2024-01-31T12:17:30.648 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.355886.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35355.log.gz 2024-01-31T12:17:30.649 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196794.log 2024-01-31T12:17:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.188089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435953.log 2024-01-31T12:17:30.654 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34507.log 2024-01-31T12:17:30.654 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.196794.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.292543.log.gz 2024-01-31T12:17:30.657 INFO:teuthology.orchestra.run.smithi049.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.33877.log.gz 2024-01-31T12:17:30.657 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.435953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472738.log 2024-01-31T12:17:30.658 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.222535.log.gz 2024-01-31T12:17:30.659 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313595.log 2024-01-31T12:17:30.660 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.162535.log.gz 2024-01-31T12:17:30.662 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.472738.log: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.165409.log.gz 2024-01-31T12:17:30.662 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159141.log 2024-01-31T12:17:30.665 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.313595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287156.log 2024-01-31T12:17:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.159141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477056.log 2024-01-31T12:17:30.672 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.287156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433529.log 2024-01-31T12:17:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.477056.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.206504.log.gz 2024-01-31T12:17:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298280.log 2024-01-31T12:17:30.676 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.433529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168388.log 2024-01-31T12:17:30.679 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.298280.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.202856.log.gz 2024-01-31T12:17:30.680 INFO:teuthology.orchestra.run.smithi049.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.477056.log.gz 2024-01-31T12:17:30.680 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303120.log 2024-01-31T12:17:30.683 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.168388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160002.log 2024-01-31T12:17:30.687 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.303120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283508.log 2024-01-31T12:17:30.690 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.160002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176536.log 2024-01-31T12:17:30.693 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.283508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188482.log 2024-01-31T12:17:30.696 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165811.log 2024-01-31T12:17:30.699 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.176536.log: /var/log/ceph/ceph-client.admin.188482.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.94959.log.gz 2024-01-31T12:17:30.700 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190530.log 2024-01-31T12:17:30.700 INFO:teuthology.orchestra.run.smithi049.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.355886.log.gz 2024-01-31T12:17:30.701 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208975.log 2024-01-31T12:17:30.704 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.165811.log: /var/log/ceph/ceph-client.admin.190530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135479.log 2024-01-31T12:17:30.705 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35249.log.gz 2024-01-31T12:17:30.708 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.208975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331922.log 2024-01-31T12:17:30.711 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125519.log 2024-01-31T12:17:30.715 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.331922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35381.log 2024-01-31T12:17:30.716 INFO:teuthology.orchestra.run.smithi049.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.295031.log.gz 2024-01-31T12:17:30.717 INFO:teuthology.orchestra.run.smithi049.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.283101.log.gz 2024-01-31T12:17:30.719 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.125519.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.106892.log.gz 2024-01-31T12:17:30.719 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190932.log 2024-01-31T12:17:30.719 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31612.log.gz 2024-01-31T12:17:30.721 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.127612.log.gz 2024-01-31T12:17:30.722 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35381.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.283508.log.gz 2024-01-31T12:17:30.724 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.313595.log.gz 2024-01-31T12:17:30.724 INFO:teuthology.orchestra.run.smithi049.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.404789.log.gz 2024-01-31T12:17:30.726 INFO:teuthology.orchestra.run.smithi049.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.322333.log.gz 2024-01-31T12:17:30.726 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.435953.log.gz 2024-01-31T12:17:30.726 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.316581.log.gz 2024-01-31T12:17:30.726 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425146.log 2024-01-31T12:17:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.190932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158735.log 2024-01-31T12:17:30.729 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.425146.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.201102.log.gz 2024-01-31T12:17:30.729 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.433529.log.gz 2024-01-31T12:17:30.730 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239668.log 2024-01-31T12:17:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.158735.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.371638.log.gz 2024-01-31T12:17:30.739 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.301502.log.gz 2024-01-31T12:17:30.739 INFO:teuthology.orchestra.run.smithi049.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.287156.log.gz 2024-01-31T12:17:30.739 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180683.log 2024-01-31T12:17:30.739 INFO:teuthology.orchestra.run.smithi049.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.159141.log.gz 2024-01-31T12:17:30.739 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.183913.log.gz 2024-01-31T12:17:30.740 INFO:teuthology.orchestra.run.smithi049.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.188482.log.gz 2024-01-31T12:17:30.740 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.208975.log.gz 2024-01-31T12:17:30.741 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353015.log 2024-01-31T12:17:30.743 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.239668.log: /var/log/ceph/ceph-client.admin.180683.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.190932.log.gz 2024-01-31T12:17:30.744 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.189718.log.gz 2024-01-31T12:17:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320716.log 2024-01-31T12:17:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.353015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443538.log 2024-01-31T12:17:30.751 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.320716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37187.log 2024-01-31T12:17:30.753 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.443538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232297.log 2024-01-31T12:17:30.756 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.37187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36143.log 2024-01-31T12:17:30.759 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.232297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485891.log 2024-01-31T12:17:30.762 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318681.log 2024-01-31T12:17:30.765 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.485891.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.485891.log.gz 2024-01-31T12:17:30.765 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33063.log 2024-01-31T12:17:30.768 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.318681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31580.log 2024-01-31T12:17:30.772 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104367.log 2024-01-31T12:17:30.774 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460230.log 2024-01-31T12:17:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.104367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306828.log 2024-01-31T12:17:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.460230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432722.log 2024-01-31T12:17:30.784 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.306828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167553.log 2024-01-31T12:17:30.787 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.432722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409356.log 2024-01-31T12:17:30.790 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.167553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232306.log 2024-01-31T12:17:30.793 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.409356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33080.log 2024-01-31T12:17:30.796 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.232306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35062.log 2024-01-31T12:17:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96176.log 2024-01-31T12:17:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35062.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.99009.log.gz 2024-01-31T12:17:30.803 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31492.log 2024-01-31T12:17:30.806 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.96176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33540.log 2024-01-31T12:17:30.808 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305208.log 2024-01-31T12:17:30.811 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433520.log 2024-01-31T12:17:30.812 INFO:teuthology.orchestra.run.smithi049.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.162544.log.gz 2024-01-31T12:17:30.813 INFO:teuthology.orchestra.run.smithi049.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35381.log.gz 2024-01-31T12:17:30.814 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.305208.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33080.log.gz 2024-01-31T12:17:30.815 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440074.log 2024-01-31T12:17:30.816 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33540.log.gz 2024-01-31T12:17:30.819 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.433520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213255.log 2024-01-31T12:17:30.820 INFO:teuthology.orchestra.run.smithi049.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34507.log.gz 2024-01-31T12:17:30.821 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37187.log.gz 2024-01-31T12:17:30.821 INFO:teuthology.orchestra.run.smithi049.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.93263.log.gz 2024-01-31T12:17:30.822 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.440074.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32472.log.gz 2024-01-31T12:17:30.822 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320725.log 2024-01-31T12:17:30.823 INFO:teuthology.orchestra.run.smithi049.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.239668.log.gz 2024-01-31T12:17:30.826 INFO:teuthology.orchestra.run.smithi049.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.409356.log.gz 2024-01-31T12:17:30.827 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.213255.log: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.125519.log.gz 2024-01-31T12:17:30.827 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136383.log 2024-01-31T12:17:30.827 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.305208.log.gz 2024-01-31T12:17:30.828 INFO:teuthology.orchestra.run.smithi049.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.82322.log.gz 2024-01-31T12:17:30.830 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.320725.log: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.303120.log.gz 2024-01-31T12:17:30.830 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97397.log 2024-01-31T12:17:30.831 INFO:teuthology.orchestra.run.smithi049.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.318681.log.gz 2024-01-31T12:17:30.832 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387661.log 2024-01-31T12:17:30.836 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.97397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362466.log 2024-01-31T12:17:30.836 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.362475.log.gz 2024-01-31T12:17:30.837 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.329590.log.gz 2024-01-31T12:17:30.839 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.387661.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.306828.log.gz 2024-01-31T12:17:30.840 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490139.log 2024-01-31T12:17:30.841 INFO:teuthology.orchestra.run.smithi049.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.400050.log.gz 2024-01-31T12:17:30.841 INFO:teuthology.orchestra.run.smithi049.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.387661.log.gz 2024-01-31T12:17:30.842 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.425146.log.gz 2024-01-31T12:17:30.843 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.362466.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.433520.log.gz 2024-01-31T12:17:30.845 INFO:teuthology.orchestra.run.smithi049.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.320716.log.gz 2024-01-31T12:17:30.845 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94112.log 2024-01-31T12:17:30.845 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.320725.log.gz 2024-01-31T12:17:30.845 INFO:teuthology.orchestra.run.smithi049.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.443538.log.gz 2024-01-31T12:17:30.845 INFO:teuthology.orchestra.run.smithi049.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.397173.log.gz 2024-01-31T12:17:30.847 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.490139.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.451099.log.gz 2024-01-31T12:17:30.847 INFO:teuthology.orchestra.run.smithi049.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.473188.log.gz 2024-01-31T12:17:30.848 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.136383.log.gz 2024-01-31T12:17:30.848 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324135.log 2024-01-31T12:17:30.849 INFO:teuthology.orchestra.run.smithi049.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.160002.log.gz 2024-01-31T12:17:30.851 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.324135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178669.log 2024-01-31T12:17:30.853 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94112.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36247.log.gz 2024-01-31T12:17:30.853 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.181899.log.gz 2024-01-31T12:17:30.853 INFO:teuthology.orchestra.run.smithi049.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.176536.log.gz 2024-01-31T12:17:30.853 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182694.log 2024-01-31T12:17:30.853 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.178669.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.190530.log.gz 2024-01-31T12:17:30.854 INFO:teuthology.orchestra.run.smithi049.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.460230.log.gz 2024-01-31T12:17:30.855 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.182694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188915.log 2024-01-31T12:17:30.857 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467492.log 2024-01-31T12:17:30.857 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.188915.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.490139.log.gz 2024-01-31T12:17:30.858 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32102.log 2024-01-31T12:17:30.861 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.467492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370428.log 2024-01-31T12:17:30.861 INFO:teuthology.orchestra.run.smithi049.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.165811.log.gz 2024-01-31T12:17:30.863 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106883.log 2024-01-31T12:17:30.866 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32102.log: /var/log/ceph/ceph-client.admin.370428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428013.log 2024-01-31T12:17:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376520.log 2024-01-31T12:17:30.870 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.428013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382630.log 2024-01-31T12:17:30.872 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411883.log 2024-01-31T12:17:30.874 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.376520.log: /var/log/ceph/ceph-client.admin.382630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185124.log 2024-01-31T12:17:30.877 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.411883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495264.log 2024-01-31T12:17:30.880 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.185124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184317.log 2024-01-31T12:17:30.882 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378558.log 2024-01-31T12:17:30.884 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.495264.log: /var/log/ceph/ceph-client.admin.184317.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.495264.log.gz 2024-01-31T12:17:30.884 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439811.log 2024-01-31T12:17:30.886 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.378558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435146.log 2024-01-31T12:17:30.889 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.439811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474938.log 2024-01-31T12:17:30.892 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.435146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36500.log 2024-01-31T12:17:30.892 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.474938.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.474938.log.gz 2024-01-31T12:17:30.894 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290383.log 2024-01-31T12:17:30.896 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403559.log 2024-01-31T12:17:30.898 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36500.log: /var/log/ceph/ceph-client.admin.290383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385624.log 2024-01-31T12:17:30.901 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.403559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34377.log 2024-01-31T12:17:30.903 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.385624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251859.log 2024-01-31T12:17:30.905 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313124.log 2024-01-31T12:17:30.906 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.251859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297486.log 2024-01-31T12:17:30.908 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.313124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281479.log 2024-01-31T12:17:30.911 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.297486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491887.log 2024-01-31T12:17:30.913 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496380.log 2024-01-31T12:17:30.914 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.491887.log: /var/log/ceph/ceph-client.admin.281479.log: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.491887.log.gz 2024-01-31T12:17:30.915 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225011.log 2024-01-31T12:17:30.915 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496380.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.496380.log.gz 2024-01-31T12:17:30.917 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239266.log 2024-01-31T12:17:30.918 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401365.log 2024-01-31T12:17:30.921 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.239266.log: /var/log/ceph/ceph-client.admin.225011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181497.log 2024-01-31T12:17:30.923 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79172.log 2024-01-31T12:17:30.924 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.181497.log: /var/log/ceph/ceph-client.admin.401365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292936.log 2024-01-31T12:17:30.927 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479568.log 2024-01-31T12:17:30.928 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106483.log 2024-01-31T12:17:30.929 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.479568.log: /var/log/ceph/ceph-client.admin.292936.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.479568.log.gz 2024-01-31T12:17:30.931 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373249.log 2024-01-31T12:17:30.933 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301493.log 2024-01-31T12:17:30.935 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.373249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416722.log 2024-01-31T12:17:30.936 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431032.log 2024-01-31T12:17:30.938 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.416722.log: /var/log/ceph/ceph-client.admin.301493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26991.log 2024-01-31T12:17:30.940 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.431032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496528.log 2024-01-31T12:17:30.941 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415327.log 2024-01-31T12:17:30.942 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496528.log: /var/log/ceph/ceph-client.admin.26991.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.496528.log.gz 2024-01-31T12:17:30.943 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287959.log 2024-01-31T12:17:30.946 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.415327.log: gzip -5 90.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.283919.log.gz 2024-01-31T12:17:30.946 INFO:teuthology.orchestra.run.smithi049.stderr: -- /var/log/ceph/ceph-client.admin.76091.log 2024-01-31T12:17:30.947 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.287959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130997.log 2024-01-31T12:17:30.949 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130528.log 2024-01-31T12:17:30.951 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361624.log 2024-01-31T12:17:30.952 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406810.log 2024-01-31T12:17:30.953 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.361624.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.362466.log.gz 2024-01-31T12:17:30.955 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389130.log 2024-01-31T12:17:30.956 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.406810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381409.log 2024-01-31T12:17:30.958 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.389130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248038.log 2024-01-31T12:17:30.961 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.381409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175685.log 2024-01-31T12:17:30.963 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.248038.log: 84.2% 80.7% -- replaced with /var/log/ceph/ceph-client.admin.96176.log.gz -- replaced with /var/log/ceph/ceph-client.admin.94112.log.gz 2024-01-31T12:17:30.964 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-31T12:17:30.964 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.175685.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.97397.log.gz 2024-01-31T12:17:30.964 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176975.log 2024-01-31T12:17:30.965 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.373249.log.gz 2024-01-31T12:17:30.967 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36143.log.gz 2024-01-31T12:17:30.967 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349487.log 2024-01-31T12:17:30.967 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33063.log.gz 2024-01-31T12:17:30.968 INFO:teuthology.orchestra.run.smithi049.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.130528.log.gz 2024-01-31T12:17:30.969 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205690.log 2024-01-31T12:17:30.971 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.176975.log: /var/log/ceph/ceph-client.admin.349487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355084.log 2024-01-31T12:17:30.974 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.205690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238053.log 2024-01-31T12:17:30.976 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.355084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217337.log 2024-01-31T12:17:30.978 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373656.log 2024-01-31T12:17:30.980 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.217337.log: /var/log/ceph/ceph-client.admin.238053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372040.log 2024-01-31T12:17:30.981 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193529.log 2024-01-31T12:17:30.983 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.372040.log: /var/log/ceph/ceph-client.admin.373656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481255.log 2024-01-31T12:17:30.986 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.193529.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.361624.log.gz 2024-01-31T12:17:30.986 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221288.log 2024-01-31T12:17:30.987 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.355084.log.gz 2024-01-31T12:17:30.987 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101430.log 2024-01-31T12:17:30.989 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.481255.log: /var/log/ceph/ceph-client.admin.221288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200643.log 2024-01-31T12:17:30.991 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32102.log.gz 2024-01-31T12:17:30.991 INFO:teuthology.orchestra.run.smithi049.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.481255.log.gz 2024-01-31T12:17:30.991 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.232297.log.gz 2024-01-31T12:17:30.992 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.101430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240534.log 2024-01-31T12:17:30.994 INFO:teuthology.orchestra.run.smithi049.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.158735.log.gz 2024-01-31T12:17:30.994 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35857.log 2024-01-31T12:17:30.996 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.240534.log: /var/log/ceph/ceph-client.admin.200643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190128.log 2024-01-31T12:17:30.996 INFO:teuthology.orchestra.run.smithi049.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.406810.log.gz 2024-01-31T12:17:30.997 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388732.log 2024-01-31T12:17:31.000 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.190128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108567.log 2024-01-31T12:17:31.002 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369995.log 2024-01-31T12:17:31.003 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.108567.log: /var/log/ceph/ceph-client.admin.388732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311757.log 2024-01-31T12:17:31.006 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.369995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32576.log 2024-01-31T12:17:31.006 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.432722.log.gz 2024-01-31T12:17:31.010 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.311757.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.467492.log.gz 2024-01-31T12:17:31.010 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448544.log 2024-01-31T12:17:31.012 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419761.log 2024-01-31T12:17:31.015 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.448544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429722.log 2024-01-31T12:17:31.018 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.419761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376529.log 2024-01-31T12:17:31.019 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349935.log 2024-01-31T12:17:31.020 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.429722.log: /var/log/ceph/ceph-client.admin.376529.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.106883.log.gz 2024-01-31T12:17:31.021 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212287.log 2024-01-31T12:17:31.022 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.349935.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.106483.log.gz 2024-01-31T12:17:31.024 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33592.log 2024-01-31T12:17:31.024 INFO:teuthology.orchestra.run.smithi049.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.217337.log.gz 2024-01-31T12:17:31.025 INFO:teuthology.orchestra.run.smithi049.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.168388.log.gz 2024-01-31T12:17:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.212287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457557.log 2024-01-31T12:17:31.028 INFO:teuthology.orchestra.run.smithi049.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.376520.log.gz 2024-01-31T12:17:31.029 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379778.log 2024-01-31T12:17:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.457557.log: /var/log/ceph/ceph-client.admin.33592.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.184317.log.gz 2024-01-31T12:17:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472298.log 2024-01-31T12:17:31.033 INFO:teuthology.orchestra.run.smithi049.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.200211.log.gz 2024-01-31T12:17:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.379778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409365.log 2024-01-31T12:17:31.038 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.472298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319100.log 2024-01-31T12:17:31.039 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.370428.log.gz 2024-01-31T12:17:31.041 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.409365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425155.log 2024-01-31T12:17:31.043 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.319100.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.472298.log.gz 2024-01-31T12:17:31.043 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.171381.log.gz 2024-01-31T12:17:31.044 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408963.log 2024-01-31T12:17:31.047 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.425155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131424.log 2024-01-31T12:17:31.051 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.408963.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.89174.log.gz 2024-01-31T12:17:31.052 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484190.log 2024-01-31T12:17:31.052 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.131424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203662.log 2024-01-31T12:17:31.053 INFO:teuthology.orchestra.run.smithi049.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.196794.log.gz 2024-01-31T12:17:31.054 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157818.log 2024-01-31T12:17:31.055 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.203662.log: /var/log/ceph/ceph-client.admin.484190.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34377.log.gz 2024-01-31T12:17:31.055 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32420.log.gz 2024-01-31T12:17:31.056 INFO:teuthology.orchestra.run.smithi049.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.298280.log.gz 2024-01-31T12:17:31.056 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.484190.log.gz 2024-01-31T12:17:31.056 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130537.log 2024-01-31T12:17:31.059 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.157818.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35036.log.gz 2024-01-31T12:17:31.060 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359520.log 2024-01-31T12:17:31.060 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36500.log.gz 2024-01-31T12:17:31.061 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35062.log.gz 2024-01-31T12:17:31.063 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304402.log 2024-01-31T12:17:31.065 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.359520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284719.log 2024-01-31T12:17:31.067 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137741.log 2024-01-31T12:17:31.068 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.304402.log: /var/log/ceph/ceph-client.admin.284719.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.108567.log.gz 2024-01-31T12:17:31.069 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78712.log 2024-01-31T12:17:31.070 INFO:teuthology.orchestra.run.smithi049.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.240534.log.gz 2024-01-31T12:17:31.070 INFO:teuthology.orchestra.run.smithi049.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.178669.log.gz 2024-01-31T12:17:31.071 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.137741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294236.log 2024-01-31T12:17:31.072 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78712.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.180683.log.gz 2024-01-31T12:17:31.074 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322799.log 2024-01-31T12:17:31.075 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.290383.log.gz 2024-01-31T12:17:31.075 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.294236.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.376529.log.gz 2024-01-31T12:17:31.076 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.401365.log.gz 2024-01-31T12:17:31.076 INFO:teuthology.orchestra.run.smithi049.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.457557.log.gz 2024-01-31T12:17:31.076 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.408963.log.gz 2024-01-31T12:17:31.078 INFO:teuthology.orchestra.run.smithi049.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.378558.log.gz 2024-01-31T12:17:31.078 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.221288.log.gz 2024-01-31T12:17:31.078 INFO:teuthology.orchestra.run.smithi049.stderr: 85.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.429722.log.gz -5 --verbose -- 2024-01-31T12:17:31.078 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.35805.log 2024-01-31T12:17:31.079 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409811.log 2024-01-31T12:17:31.080 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35805.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.225011.log.gz 2024-01-31T12:17:31.081 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.322799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104358.log 2024-01-31T12:17:31.082 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.213255.log.gz 2024-01-31T12:17:31.083 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.409811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481671.log 2024-01-31T12:17:31.084 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32846.log 2024-01-31T12:17:31.086 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.481671.log: /var/log/ceph/ceph-client.admin.104358.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.101430.log.gz 2024-01-31T12:17:31.086 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31492.log.gz 2024-01-31T12:17:31.086 INFO:teuthology.orchestra.run.smithi049.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.481671.log.gz 2024-01-31T12:17:31.087 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350337.log 2024-01-31T12:17:31.087 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.435146.log.gz 2024-01-31T12:17:31.088 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328137.log 2024-01-31T12:17:31.089 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.350337.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32576.log.gz 2024-01-31T12:17:31.090 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491009.log 2024-01-31T12:17:31.092 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.328137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321519.log 2024-01-31T12:17:31.095 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.491009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469780.log 2024-01-31T12:17:31.096 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321126.log 2024-01-31T12:17:31.098 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.469780.log: /var/log/ceph/ceph-client.admin.321519.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.389130.log.gz 2024-01-31T12:17:31.098 INFO:teuthology.orchestra.run.smithi049.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.469780.log.gz 2024-01-31T12:17:31.098 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.379778.log.gz 2024-01-31T12:17:31.099 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441906.log 2024-01-31T12:17:31.099 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241752.log 2024-01-31T12:17:31.102 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.441906.log: /var/log/ceph/ceph-client.admin.321126.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.297486.log.gz 2024-01-31T12:17:31.103 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.33592.log.gz 2024-01-31T12:17:31.103 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.224197.log 2024-01-31T12:17:31.107 INFO:teuthology.orchestra.run.smithi049.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.301493.log.gz 2024-01-31T12:17:31.107 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.181497.log.gz 2024-01-31T12:17:31.107 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.224197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361633.log 2024-01-31T12:17:31.108 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.241752.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.251859.log.gz 2024-01-31T12:17:31.108 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% 80.8% -- replaced with /var/log/ceph/ceph-client.admin.185124.log.gz -- replaced with /var/log/ceph/ceph-client.admin.188915.log.gz 2024-01-31T12:17:31.108 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-31T12:17:31.108 INFO:teuthology.orchestra.run.smithi049.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.491009.log.gz 2024-01-31T12:17:31.109 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493146.log 2024-01-31T12:17:31.109 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2%/var/log/ceph/ceph-client.admin.361633.log: -- replaced with /var/log/ceph/ceph-client.admin.137741.log.gz 2024-01-31T12:17:31.110 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428863.log 2024-01-31T12:17:31.111 INFO:teuthology.orchestra.run.smithi049.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.175685.log.gz 2024-01-31T12:17:31.113 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.493146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295442.log 2024-01-31T12:17:31.113 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.493146.log.gz 2024-01-31T12:17:31.114 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403550.log 2024-01-31T12:17:31.116 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.295442.log: /var/log/ceph/ceph-client.admin.428863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432255.log 2024-01-31T12:17:31.117 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.403550.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.319100.log.gz 2024-01-31T12:17:31.118 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196392.log 2024-01-31T12:17:31.120 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.432255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34663.log 2024-01-31T12:17:31.121 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-01-31T12:17:31.124 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34663.log: /var/log/ceph/ceph-client.admin.196392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224595.log 2024-01-31T12:17:31.124 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173095.log 2024-01-31T12:17:31.127 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.224595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328640.log 2024-01-31T12:17:31.129 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.173095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397182.log 2024-01-31T12:17:31.131 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.328640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234442.log 2024-01-31T12:17:31.133 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.397182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82331.log 2024-01-31T12:17:31.134 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281488.log 2024-01-31T12:17:31.136 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.234442.log: /var/log/ceph/ceph-client.admin.82331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420695.log 2024-01-31T12:17:31.139 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.281488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75283.log 2024-01-31T12:17:31.140 INFO:teuthology.orchestra.run.smithi049.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.205690.log.gz 2024-01-31T12:17:31.141 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431837.log 2024-01-31T12:17:31.142 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.420695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473621.log 2024-01-31T12:17:31.144 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.431837.log: /var/log/ceph/ceph-client.admin.75283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481662.log 2024-01-31T12:17:31.145 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.403559.log.gz 2024-01-31T12:17:31.145 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36474.log 2024-01-31T12:17:31.146 INFO:teuthology.orchestra.run.smithi049.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.193529.log.gz 2024-01-31T12:17:31.147 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.473621.log: /var/log/ceph/ceph-client.admin.481662.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.481662.log.gz 2024-01-31T12:17:31.147 INFO:teuthology.orchestra.run.smithi049.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.473621.log.gz 2024-01-31T12:17:31.147 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494401.log 2024-01-31T12:17:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284317.log 2024-01-31T12:17:31.151 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.494401.log: /var/log/ceph/ceph-client.admin.36474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187225.log 2024-01-31T12:17:31.153 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35433.log 2024-01-31T12:17:31.157 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.284317.log: /var/log/ceph/ceph-client.admin.187225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371236.log 2024-01-31T12:17:31.160 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34689.log 2024-01-31T12:17:31.162 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.371236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465477.log 2024-01-31T12:17:31.164 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101017.log 2024-01-31T12:17:31.167 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34689.log: /var/log/ceph/ceph-client.admin.465477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486325.log 2024-01-31T12:17:31.170 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.101017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438449.log 2024-01-31T12:17:31.172 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488863.log 2024-01-31T12:17:31.176 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.486325.log: /var/log/ceph/ceph-client.admin.438449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328631.log 2024-01-31T12:17:31.179 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.488863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363639.log 2024-01-31T12:17:31.183 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.328631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242185.log 2024-01-31T12:17:31.184 INFO:teuthology.orchestra.run.smithi049.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.486325.log.gz 2024-01-31T12:17:31.186 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.363639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482509.log 2024-01-31T12:17:31.189 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.242185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232739.log 2024-01-31T12:17:31.190 INFO:teuthology.orchestra.run.smithi049.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.488863.log.gz 2024-01-31T12:17:31.191 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240099.log 2024-01-31T12:17:31.193 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.482509.log: /var/log/ceph/ceph-client.admin.232739.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.482509.log.gz 2024-01-31T12:17:31.194 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299485.log 2024-01-31T12:17:31.196 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207352.log 2024-01-31T12:17:31.198 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.240099.log: /var/log/ceph/ceph-client.admin.299485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33434.log 2024-01-31T12:17:31.202 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.207352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354252.log 2024-01-31T12:17:31.204 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356700.log 2024-01-31T12:17:31.206 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.354252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210187.log 2024-01-31T12:17:31.209 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.356700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181890.log 2024-01-31T12:17:31.211 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.238053.log.gz 2024-01-31T12:17:31.212 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496179.log 2024-01-31T12:17:31.212 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.210187.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.313124.log.gz 2024-01-31T12:17:31.214 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.294236.log.gz 2024-01-31T12:17:31.215 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.181890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324579.log 2024-01-31T12:17:31.218 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496179.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.496179.log.gz 2024-01-31T12:17:31.220 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.324579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467081.log 2024-01-31T12:17:31.222 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.322799.log.gz 2024-01-31T12:17:31.223 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371227.log 2024-01-31T12:17:31.224 INFO:teuthology.orchestra.run.smithi049.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.440074.log.gz 2024-01-31T12:17:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.467081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327167.log 2024-01-31T12:17:31.228 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.371227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212853.log 2024-01-31T12:17:31.231 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.327167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430133.log 2024-01-31T12:17:31.234 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.212853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205287.log 2024-01-31T12:17:31.236 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.430133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35883.log 2024-01-31T12:17:31.238 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33082.log 2024-01-31T12:17:31.242 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.205287.log: /var/log/ceph/ceph-client.admin.35883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303593.log 2024-01-31T12:17:31.243 INFO:teuthology.orchestra.run.smithi049.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.292936.log.gz 2024-01-31T12:17:31.243 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.281488.log.gz 2024-01-31T12:17:31.245 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293338.log 2024-01-31T12:17:31.247 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.303593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461449.log 2024-01-31T12:17:31.251 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.293338.log: gzip -5 --verbose 81.7% -- -- replaced with /var/log/ceph/ceph-client.admin.431032.log.gz /var/log/ceph/ceph-client.admin.157348.log 2024-01-31T12:17:31.251 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-31T12:17:31.252 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35805.log.gz 2024-01-31T12:17:31.254 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.461449.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36474.log.gz 2024-01-31T12:17:31.254 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414831.log 2024-01-31T12:17:31.257 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.157348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294638.log 2024-01-31T12:17:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.414831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185925.log 2024-01-31T12:17:31.261 INFO:teuthology.orchestra.run.smithi049.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.182694.log.gz 2024-01-31T12:17:31.261 INFO:teuthology.orchestra.run.smithi049.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.181890.log.gz 2024-01-31T12:17:31.263 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.294638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474947.log 2024-01-31T12:17:31.264 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.299485.log.gz 2024-01-31T12:17:31.265 INFO:teuthology.orchestra.run.smithi049.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.284317.log.gz 2024-01-31T12:17:31.265 INFO:teuthology.orchestra.run.smithi049.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.409365.log.gz 2024-01-31T12:17:31.266 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.185925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31690.log 2024-01-31T12:17:31.268 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.474947.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.403550.log.gz 2024-01-31T12:17:31.268 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82777.log 2024-01-31T12:17:31.271 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.428013.log.gz 2024-01-31T12:17:31.271 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.474947.log.gz 2024-01-31T12:17:31.272 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33408.log 2024-01-31T12:17:31.272 INFO:teuthology.orchestra.run.smithi049.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.472738.log.gz 2024-01-31T12:17:31.274 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.82777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33696.log 2024-01-31T12:17:31.275 INFO:teuthology.orchestra.run.smithi049.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.467081.log.gz 2024-01-31T12:17:31.276 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427619.log 2024-01-31T12:17:31.279 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33408.log: /var/log/ceph/ceph-client.admin.33696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412688.log 2024-01-31T12:17:31.281 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.427619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287549.log 2024-01-31T12:17:31.283 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.412688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492733.log 2024-01-31T12:17:31.286 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.287549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32285.log 2024-01-31T12:17:31.289 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.492733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170946.log 2024-01-31T12:17:31.289 INFO:teuthology.orchestra.run.smithi049.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.492733.log.gz 2024-01-31T12:17:31.291 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285523.log 2024-01-31T12:17:31.293 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.419761.log.gz 2024-01-31T12:17:31.294 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.170946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295040.log 2024-01-31T12:17:31.297 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.285523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427167.log 2024-01-31T12:17:31.300 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.295040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206093.log 2024-01-31T12:17:31.302 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.427167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390343.log 2024-01-31T12:17:31.305 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.206093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449805.log 2024-01-31T12:17:31.307 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.390343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362064.log 2024-01-31T12:17:31.308 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.373656.log.gz 2024-01-31T12:17:31.309 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.449805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489279.log 2024-01-31T12:17:31.311 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.362064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346957.log 2024-01-31T12:17:31.313 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.489279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192734.log 2024-01-31T12:17:31.314 INFO:teuthology.orchestra.run.smithi049.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.489279.log.gz 2024-01-31T12:17:31.316 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33408.log.gz 2024-01-31T12:17:31.318 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.346957.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33082.log.gz 2024-01-31T12:17:31.318 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35883.log.gz 2024-01-31T12:17:31.318 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292945.log 2024-01-31T12:17:31.318 INFO:teuthology.orchestra.run.smithi049.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.33696.log.gz 2024-01-31T12:17:31.321 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.192734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31554.log 2024-01-31T12:17:31.323 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.292945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103049.log 2024-01-31T12:17:31.325 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367517.log 2024-01-31T12:17:31.328 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.103049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484615.log 2024-01-31T12:17:31.330 INFO:teuthology.orchestra.run.smithi049.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.324579.log.gz 2024-01-31T12:17:31.330 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.367517.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.295040.log.gz 2024-01-31T12:17:31.331 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128047.log 2024-01-31T12:17:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.484615.log: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.484615.log.gz 2024-01-31T12:17:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217776.log 2024-01-31T12:17:31.336 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.294638.log.gz 2024-01-31T12:17:31.337 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128047.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.241752.log.gz 2024-01-31T12:17:31.338 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229059.log 2024-01-31T12:17:31.340 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.217776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351172.log 2024-01-31T12:17:31.343 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.229059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32524.log 2024-01-31T12:17:31.345 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.351172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178263.log 2024-01-31T12:17:31.347 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32524.log: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.494401.log.gz 2024-01-31T12:17:31.348 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34957.log 2024-01-31T12:17:31.351 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.178263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440293.log 2024-01-31T12:17:31.353 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158726.log 2024-01-31T12:17:31.355 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34957.log: /var/log/ceph/ceph-client.admin.440293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35114.log 2024-01-31T12:17:31.356 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.158726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36195.log 2024-01-31T12:17:31.359 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462257.log 2024-01-31T12:17:31.361 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223795.log 2024-01-31T12:17:31.363 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367924.log 2024-01-31T12:17:31.364 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.462257.log: /var/log/ceph/ceph-client.admin.223795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213649.log 2024-01-31T12:17:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.367924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472729.log 2024-01-31T12:17:31.367 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.213649.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.385624.log.gz 2024-01-31T12:17:31.368 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180290.log 2024-01-31T12:17:31.369 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.472729.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.416722.log.gz 2024-01-31T12:17:31.369 INFO:teuthology.orchestra.run.smithi049.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.472729.log.gz 2024-01-31T12:17:31.370 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.415327.log.gz 2024-01-31T12:17:31.371 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186795.log 2024-01-31T12:17:31.373 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.180290.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.361633.log.gz 2024-01-31T12:17:31.373 INFO:teuthology.orchestra.run.smithi049.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.390343.log.gz 2024-01-31T12:17:31.374 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297879.log 2024-01-31T12:17:31.376 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416263.log 2024-01-31T12:17:31.377 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.412688.log.gz 2024-01-31T12:17:31.378 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.186795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329581.log 2024-01-31T12:17:31.378 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.180290.log.gz 2024-01-31T12:17:31.379 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.297879.log: /var/log/ceph/ceph-client.admin.416263.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.185925.log.gz 2024-01-31T12:17:31.381 INFO:teuthology.orchestra.run.smithi049.stderr:gzip 90.2% -- replaced with /var/log/ceph/ceph-client.admin.346957.log.gz 2024-01-31T12:17:31.381 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31241.log 2024-01-31T12:17:31.383 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.329581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357100.log 2024-01-31T12:17:31.385 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.425155.log.gz 2024-01-31T12:17:31.385 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31241.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.350337.log.gz 2024-01-31T12:17:31.386 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33462.log 2024-01-31T12:17:31.386 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.353015.log.gz 2024-01-31T12:17:31.386 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420686.log 2024-01-31T12:17:31.389 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33462.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.352622.log.gz 2024-01-31T12:17:31.389 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.357100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404386.log 2024-01-31T12:17:31.390 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348231.log 2024-01-31T12:17:31.391 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.420686.log: /var/log/ceph/ceph-client.admin.404386.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.461449.log.gz 2024-01-31T12:17:31.392 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282691.log 2024-01-31T12:17:31.394 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.348231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31208.log 2024-01-31T12:17:31.395 INFO:teuthology.orchestra.run.smithi049.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.409811.log.gz 2024-01-31T12:17:31.397 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.282691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357940.log 2024-01-31T12:17:31.399 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.281479.log.gz 2024-01-31T12:17:31.399 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5/var/log/ceph/ceph-client.admin.31208.log: --verbose -- /var/log/ceph/ceph-client.admin.126801.log 2024-01-31T12:17:31.403 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.357940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476577.log 2024-01-31T12:17:31.403 INFO:teuthology.orchestra.run.smithi049.stderr: 77.6% 90.2% -- replaced with /var/log/ceph/ceph-client.admin.321126.log.gz 2024-01-31T12:17:31.403 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.321519.log.gz 2024-01-31T12:17:31.403 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366289.log 2024-01-31T12:17:31.404 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.126801.log: /var/log/ceph/ceph-client.admin.476577.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.476577.log.gz 2024-01-31T12:17:31.407 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78309.log 2024-01-31T12:17:31.407 INFO:teuthology.orchestra.run.smithi049.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.206093.log.gz 2024-01-31T12:17:31.408 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.366289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87970.log 2024-01-31T12:17:31.411 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220264.log 2024-01-31T12:17:31.414 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.87970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400473.log 2024-01-31T12:17:31.416 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.220264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230674.log 2024-01-31T12:17:31.418 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.400473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36624.log 2024-01-31T12:17:31.419 INFO:teuthology.orchestra.run.smithi049.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.104358.log.gz 2024-01-31T12:17:31.420 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.230674.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.331922.log.gz 2024-01-31T12:17:31.421 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405612.log 2024-01-31T12:17:31.424 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213246.log 2024-01-31T12:17:31.425 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.405612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211872.log 2024-01-31T12:17:31.428 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.213246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128465.log 2024-01-31T12:17:31.431 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.211872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179477.log 2024-01-31T12:17:31.432 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-01-31T12:17:31.435 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128465.log: /var/log/ceph/ceph-client.admin.179477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204894.log 2024-01-31T12:17:31.437 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.76091.log.gz 2024-01-31T12:17:31.438 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442714.log 2024-01-31T12:17:31.439 INFO:teuthology.orchestra.run.smithi049.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.357940.log.gz 2024-01-31T12:17:31.439 INFO:teuthology.orchestra.run.smithi049.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.357100.log.gz 2024-01-31T12:17:31.439 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.416263.log.gz 2024-01-31T12:17:31.441 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.204894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36780.log 2024-01-31T12:17:31.444 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.442714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387269.log 2024-01-31T12:17:31.444 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35433.log.gz 2024-01-31T12:17:31.445 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33462.log.gz 2024-01-31T12:17:31.445 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32524.log.gz 2024-01-31T12:17:31.446 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288773.log 2024-01-31T12:17:31.449 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.387269.log: /var/log/ceph/ceph-client.admin.36780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227028.log 2024-01-31T12:17:31.452 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.288773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195588.log 2024-01-31T12:17:31.453 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.227028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326275.log 2024-01-31T12:17:31.456 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.195588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360783.log 2024-01-31T12:17:31.459 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31241.log.gz 2024-01-31T12:17:31.459 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31208.log.gz 2024-01-31T12:17:31.459 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.326275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79615.log 2024-01-31T12:17:31.462 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.360783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92459.log 2024-01-31T12:17:31.464 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426756.log 2024-01-31T12:17:31.465 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.128047.log.gz 2024-01-31T12:17:31.466 INFO:teuthology.orchestra.run.smithi049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36624.log.gz 2024-01-31T12:17:31.466 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36780.log.gz 2024-01-31T12:17:31.467 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.92459.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.239266.log.gz 2024-01-31T12:17:31.467 INFO:teuthology.orchestra.run.smithi049.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.240099.log.gz 2024-01-31T12:17:31.469 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35275.log 2024-01-31T12:17:31.469 INFO:teuthology.orchestra.run.smithi049.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.103049.log.gz 2024-01-31T12:17:31.469 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31554.log.gz 2024-01-31T12:17:31.469 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31580.log.gz 2024-01-31T12:17:31.471 INFO:teuthology.orchestra.run.smithi049.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.420686.log.gz 2024-01-31T12:17:31.471 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31690.log.gz 2024-01-31T12:17:31.472 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.426756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134568.log 2024-01-31T12:17:31.472 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.420695.log.gz 2024-01-31T12:17:31.474 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35275.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.400473.log.gz 2024-01-31T12:17:31.475 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214500.log 2024-01-31T12:17:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.134568.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.388732.log.gz 2024-01-31T12:17:31.477 INFO:teuthology.orchestra.run.smithi049.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.426756.log.gz 2024-01-31T12:17:31.478 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34559.log 2024-01-31T12:17:31.478 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.387269.log.gz 2024-01-31T12:17:31.480 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.214500.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.432255.log.gz 2024-01-31T12:17:31.481 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.75283.log.gz 2024-01-31T12:17:31.481 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35197.log 2024-01-31T12:17:31.482 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.348231.log.gz 2024-01-31T12:17:31.482 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.442714.log.gz 2024-01-31T12:17:31.484 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384814.log 2024-01-31T12:17:31.487 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156096.log 2024-01-31T12:17:31.489 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109807.log 2024-01-31T12:17:31.490 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.384814.log: /var/log/ceph/ceph-client.admin.156096.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.405612.log.gz 2024-01-31T12:17:31.490 INFO:teuthology.orchestra.run.smithi049.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.326275.log.gz 2024-01-31T12:17:31.492 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.170946.log.gz 2024-01-31T12:17:31.492 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474057.log 2024-01-31T12:17:31.495 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.109807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199768.log 2024-01-31T12:17:31.495 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.367924.log.gz 2024-01-31T12:17:31.497 INFO:teuthology.orchestra.run.smithi049.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.297879.log.gz 2024-01-31T12:17:31.497 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.303593.log.gz 2024-01-31T12:17:31.498 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.366289.log.gz 2024-01-31T12:17:31.498 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34585.log 2024-01-31T12:17:31.499 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.474057.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.212853.log.gz 2024-01-31T12:17:31.499 INFO:teuthology.orchestra.run.smithi049.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.474057.log.gz 2024-01-31T12:17:31.501 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.199768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376118.log 2024-01-31T12:17:31.502 INFO:teuthology.orchestra.run.smithi049.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.242185.log.gz 2024-01-31T12:17:31.503 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347367.log 2024-01-31T12:17:31.506 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.376118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237650.log 2024-01-31T12:17:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.347367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235639.log 2024-01-31T12:17:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.237650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375277.log 2024-01-31T12:17:31.513 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.227028.log.gz 2024-01-31T12:17:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.235639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36448.log 2024-01-31T12:17:31.515 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.375277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415786.log 2024-01-31T12:17:31.516 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36448.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.229059.log.gz 2024-01-31T12:17:31.517 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349073.log 2024-01-31T12:17:31.520 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.415786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299886.log 2024-01-31T12:17:31.521 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.203662.log.gz 2024-01-31T12:17:31.522 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.349073.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.217776.log.gz 2024-01-31T12:17:31.522 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189317.log 2024-01-31T12:17:31.523 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.224595.log.gz 2024-01-31T12:17:31.523 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.224197.log.gz 2024-01-31T12:17:31.525 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.299886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208965.log 2024-01-31T12:17:31.527 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.189317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100208.log 2024-01-31T12:17:31.529 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.208965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101421.log 2024-01-31T12:17:31.531 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496450.log 2024-01-31T12:17:31.532 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.100208.log: /var/log/ceph/ceph-client.admin.101421.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.192734.log.gz 2024-01-31T12:17:31.533 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312667.log 2024-01-31T12:17:31.534 INFO:teuthology.orchestra.run.smithi049.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.328631.log.gz 2024-01-31T12:17:31.534 INFO:teuthology.orchestra.run.smithi049.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.328137.log.gz 2024-01-31T12:17:31.535 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.329581.log.gz 2024-01-31T12:17:31.535 INFO:teuthology.orchestra.run.smithi049.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.293338.log.gz 2024-01-31T12:17:31.536 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36702.log 2024-01-31T12:17:31.537 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496450.log: /var/log/ceph/ceph-client.admin.312667.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.371227.log.gz 2024-01-31T12:17:31.538 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.496450.log.gz 2024-01-31T12:17:31.538 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129671.log 2024-01-31T12:17:31.539 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36702.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.371236.log.gz 2024-01-31T12:17:31.542 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348240.log 2024-01-31T12:17:31.542 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.411883.log.gz 2024-01-31T12:17:31.542 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.356700.log.gz 2024-01-31T12:17:31.542 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81502.log 2024-01-31T12:17:31.545 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.348240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189727.log 2024-01-31T12:17:31.548 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78300.log 2024-01-31T12:17:31.549 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101826.log 2024-01-31T12:17:31.551 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.189727.log: /var/log/ceph/ceph-client.admin.78300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167974.log 2024-01-31T12:17:31.551 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1%/var/log/ceph/ceph-client.admin.101826.log: -- replaced with /var/log/ceph/ceph-client.admin.35197.log.gz 2024-01-31T12:17:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496502.log 2024-01-31T12:17:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.167974.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32846.log.gz 2024-01-31T12:17:31.556 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35301.log 2024-01-31T12:17:31.560 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496502.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35857.log.gz 2024-01-31T12:17:31.560 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36702.log.gz 2024-01-31T12:17:31.560 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482500.log 2024-01-31T12:17:31.560 INFO:teuthology.orchestra.run.smithi049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.496502.log.gz 2024-01-31T12:17:31.560 INFO:teuthology.orchestra.run.smithi049.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.81502.log.gz 2024-01-31T12:17:31.560 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34559.log.gz 2024-01-31T12:17:31.560 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34585.log.gz 2024-01-31T12:17:31.561 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137187.log 2024-01-31T12:17:31.562 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.482500.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.482500.log.gz 2024-01-31T12:17:31.562 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287147.log 2024-01-31T12:17:31.564 INFO:teuthology.orchestra.run.smithi049.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.375277.log.gz 2024-01-31T12:17:31.565 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457566.log 2024-01-31T12:17:31.565 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.137187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494836.log 2024-01-31T12:17:31.567 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.457566.log: /var/log/ceph/ceph-client.admin.287147.log: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.157348.log.gz 2024-01-31T12:17:31.568 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32852.log 2024-01-31T12:17:31.569 INFO:teuthology.orchestra.run.smithi049.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.376118.log.gz 2024-01-31T12:17:31.569 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194342.log 2024-01-31T12:17:31.571 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.494836.log: /var/log/ceph/ceph-client.admin.32852.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.494836.log.gz 2024-01-31T12:17:31.571 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363534.log 2024-01-31T12:17:31.573 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.194342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99805.log 2024-01-31T12:17:31.576 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.363534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34637.log 2024-01-31T12:17:31.578 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465871.log 2024-01-31T12:17:31.579 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177406.log 2024-01-31T12:17:31.580 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.465871.log: /var/log/ceph/ceph-client.admin.34637.log: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.78300.log.gz 2024-01-31T12:17:31.581 INFO:teuthology.orchestra.run.smithi049.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.312667.log.gz 2024-01-31T12:17:31.581 INFO:teuthology.orchestra.run.smithi049.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.448544.log.gz 2024-01-31T12:17:31.582 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202445.log 2024-01-31T12:17:31.584 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.177406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234835.log 2024-01-31T12:17:31.584 INFO:teuthology.orchestra.run.smithi049.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.26991.log.gz 2024-01-31T12:17:31.586 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.202445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463456.log 2024-01-31T12:17:31.588 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.234835.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.230674.log.gz 2024-01-31T12:17:31.588 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183105.log 2024-01-31T12:17:31.590 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36650.log 2024-01-31T12:17:31.592 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.463456.log: /var/log/ceph/ceph-client.admin.183105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329109.log 2024-01-31T12:17:31.595 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31412.log 2024-01-31T12:17:31.595 INFO:teuthology.orchestra.run.smithi049.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.162110.log.gz 2024-01-31T12:17:31.596 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482064.log 2024-01-31T12:17:31.599 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.329109.log: /var/log/ceph/ceph-client.admin.31412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247203.log 2024-01-31T12:17:31.602 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.482064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323717.log 2024-01-31T12:17:31.602 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.482064.log.gz 2024-01-31T12:17:31.604 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.247203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37135.log 2024-01-31T12:17:31.605 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.323717.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.299886.log.gz 2024-01-31T12:17:31.607 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307624.log 2024-01-31T12:17:31.610 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.37135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42148.log 2024-01-31T12:17:31.612 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.307624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495971.log 2024-01-31T12:17:31.613 INFO:teuthology.orchestra.run.smithi049.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.462257.log.gz 2024-01-31T12:17:31.614 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42148.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.465871.log.gz 2024-01-31T12:17:31.615 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302319.log 2024-01-31T12:17:31.616 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.208965.log.gz 2024-01-31T12:17:31.616 INFO:teuthology.orchestra.run.smithi049.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.199768.log.gz 2024-01-31T12:17:31.616 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.167974.log.gz 2024-01-31T12:17:31.617 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35670.log 2024-01-31T12:17:31.619 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.495971.log: /var/log/ceph/ceph-client.admin.302319.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.495971.log.gz 2024-01-31T12:17:31.619 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180281.log 2024-01-31T12:17:31.621 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224188.log 2024-01-31T12:17:31.622 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.204894.log.gz 2024-01-31T12:17:31.622 INFO:teuthology.orchestra.run.smithi049.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.220264.log.gz 2024-01-31T12:17:31.623 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.180281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107705.log 2024-01-31T12:17:31.625 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.224188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305602.log 2024-01-31T12:17:31.626 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.156096.log.gz 2024-01-31T12:17:31.627 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.202445.log.gz 2024-01-31T12:17:31.628 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211863.log 2024-01-31T12:17:31.629 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.305602.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.234835.log.gz 2024-01-31T12:17:31.630 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379375.log 2024-01-31T12:17:31.632 INFO:teuthology.orchestra.run.smithi049.stderr: 79.0%/var/log/ceph/ceph-client.admin.211863.log: -- replaced with /var/log/ceph/ceph-client.admin.235639.log.gz 2024-01-31T12:17:31.632 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131433.log 2024-01-31T12:17:31.634 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94556.log 2024-01-31T12:17:31.635 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.379375.log: /var/log/ceph/ceph-client.admin.131433.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.189317.log.gz 2024-01-31T12:17:31.636 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81928.log 2024-01-31T12:17:31.637 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.189727.log.gz 2024-01-31T12:17:31.640 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208166.log 2024-01-31T12:17:31.641 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293347.log 2024-01-31T12:17:31.643 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81928.log: /var/log/ceph/ceph-client.admin.208166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489705.log 2024-01-31T12:17:31.646 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.293347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196803.log 2024-01-31T12:17:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.489705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90429.log 2024-01-31T12:17:31.649 INFO:teuthology.orchestra.run.smithi049.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.489705.log.gz 2024-01-31T12:17:31.652 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.196803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36976.log 2024-01-31T12:17:31.654 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96185.log 2024-01-31T12:17:31.656 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496205.log 2024-01-31T12:17:31.658 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36976.log: /var/log/ceph/ceph-client.admin.96185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363582.log 2024-01-31T12:17:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330056.log 2024-01-31T12:17:31.663 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.496205.log.gz 2024-01-31T12:17:31.663 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.363582.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32285.log.gz 2024-01-31T12:17:31.665 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460633.log 2024-01-31T12:17:31.667 INFO:teuthology.orchestra.run.smithi049.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.362064.log.gz 2024-01-31T12:17:31.668 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.330056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372836.log 2024-01-31T12:17:31.670 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.460633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348647.log 2024-01-31T12:17:31.672 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.372836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35223.log 2024-01-31T12:17:31.673 INFO:teuthology.orchestra.run.smithi049.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.94556.log.gz 2024-01-31T12:17:31.675 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.348647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200202.log 2024-01-31T12:17:31.676 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475359.log 2024-01-31T12:17:31.678 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35223.log: /var/log/ceph/ceph-client.admin.200202.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.372836.log.gz 2024-01-31T12:17:31.678 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32852.log.gz 2024-01-31T12:17:31.679 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35301.log.gz 2024-01-31T12:17:31.680 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388099.log 2024-01-31T12:17:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.475359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165007.log 2024-01-31T12:17:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228241.log 2024-01-31T12:17:31.684 INFO:teuthology.orchestra.run.smithi049.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.475359.log.gz 2024-01-31T12:17:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.388099.log: /var/log/ceph/ceph-client.admin.165007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322342.log 2024-01-31T12:17:31.689 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.228241.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42148.log.gz 2024-01-31T12:17:31.691 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169243.log 2024-01-31T12:17:31.691 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36650.log.gz 2024-01-31T12:17:31.691 INFO:teuthology.orchestra.run.smithi049.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.101017.log.gzgzip 93.6% 2024-01-31T12:17:31.692 INFO:teuthology.orchestra.run.smithi049.stderr: -5 -- replaced with /var/log/ceph/ceph-client.admin.187225.log.gz --verbose -- 2024-01-31T12:17:31.692 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.156497.log 2024-01-31T12:17:31.693 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.169243.log: /var/log/ceph/ceph-client.admin.322342.log: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.87970.log.gz 2024-01-31T12:17:31.694 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236041.log 2024-01-31T12:17:31.694 INFO:teuthology.orchestra.run.smithi049.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.196392.log.gz 2024-01-31T12:17:31.696 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.156497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362883.log 2024-01-31T12:17:31.697 INFO:teuthology.orchestra.run.smithi049.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.363534.log.gz 2024-01-31T12:17:31.698 INFO:teuthology.orchestra.run.smithi049.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.302319.log.gz 2024-01-31T12:17:31.698 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.236041.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.228241.log.gz 2024-01-31T12:17:31.699 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.90429.log.gz 2024-01-31T12:17:31.699 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184712.log 2024-01-31T12:17:31.700 INFO:teuthology.orchestra.run.smithi049.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.305602.log.gz 2024-01-31T12:17:31.700 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463858.log 2024-01-31T12:17:31.702 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.184712.log: /var/log/ceph/ceph-client.admin.362883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476174.log 2024-01-31T12:17:31.703 INFO:teuthology.orchestra.run.smithi049.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.439811.log.gz 2024-01-31T12:17:31.704 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.463858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89585.log 2024-01-31T12:17:31.706 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.476174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429329.log 2024-01-31T12:17:31.709 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81292.log 2024-01-31T12:17:31.709 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.476174.log.gz 2024-01-31T12:17:31.710 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.429329.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35670.log.gz 2024-01-31T12:17:31.711 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183509.log 2024-01-31T12:17:31.712 INFO:teuthology.orchestra.run.smithi049.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.236041.log.gz 2024-01-31T12:17:31.712 INFO:teuthology.orchestra.run.smithi049.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.367517.log.gz 2024-01-31T12:17:31.713 INFO:teuthology.orchestra.run.smithi049.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.404386.log.gz 2024-01-31T12:17:31.713 INFO:teuthology.orchestra.run.smithi049.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.463858.log.gz 2024-01-31T12:17:31.714 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81292.log: gzip -5 --verbose -- 77.5% -- replaced with /var/log/ceph/ceph-client.admin.360783.log.gz 2024-01-31T12:17:31.714 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.233236.log 2024-01-31T12:17:31.716 INFO:teuthology.orchestra.run.smithi049.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.214500.log.gz 2024-01-31T12:17:31.716 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87979.log 2024-01-31T12:17:31.717 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.183509.log: /var/log/ceph/ceph-client.admin.233236.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.363582.log.gz 2024-01-31T12:17:31.717 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.379375.log.gz 2024-01-31T12:17:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33055.log 2024-01-31T12:17:31.719 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.322342.log.gz 2024-01-31T12:17:31.720 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373647.log 2024-01-31T12:17:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.87979.log: /var/log/ceph/ceph-client.admin.33055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225816.log 2024-01-31T12:17:31.725 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.373647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32650.log 2024-01-31T12:17:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.225816.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.441906.log.gz 2024-01-31T12:17:31.728 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195999.log 2024-01-31T12:17:31.730 INFO:teuthology.orchestra.run.smithi049.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.381409.log.gz 2024-01-31T12:17:31.731 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191334.log 2024-01-31T12:17:31.733 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32650.log: /var/log/ceph/ceph-client.admin.195999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424273.log 2024-01-31T12:17:31.736 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207763.log 2024-01-31T12:17:31.736 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2%/var/log/ceph/ceph-client.admin.191334.log: -- replaced with /var/log/ceph/ceph-client.admin.427619.log.gz 2024-01-31T12:17:31.737 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473179.log 2024-01-31T12:17:31.739 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.424273.log: /var/log/ceph/ceph-client.admin.207763.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.205287.log.gz 2024-01-31T12:17:31.740 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398831.log 2024-01-31T12:17:31.741 INFO:teuthology.orchestra.run.smithi049.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.180281.log.gz 2024-01-31T12:17:31.742 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466687.log 2024-01-31T12:17:31.743 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.473179.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.473179.log.gz 2024-01-31T12:17:31.745 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.398831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423064.log 2024-01-31T12:17:31.745 INFO:teuthology.orchestra.run.smithi049.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.184712.log.gz 2024-01-31T12:17:31.746 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.354252.log.gz 2024-01-31T12:17:31.746 INFO:teuthology.orchestra.run.smithi049.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.200202.log.gz 2024-01-31T12:17:31.747 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.466687.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.183509.log.gz 2024-01-31T12:17:31.748 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408151.log 2024-01-31T12:17:31.748 INFO:teuthology.orchestra.run.smithi049.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.207352.log.gz 2024-01-31T12:17:31.748 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.423064.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.288773.log.gz 2024-01-31T12:17:31.749 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.191334.log.gz 2024-01-31T12:17:31.750 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389538.log 2024-01-31T12:17:31.750 INFO:teuthology.orchestra.run.smithi049.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.224188.log.gz 2024-01-31T12:17:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.408151.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.223795.log.gz 2024-01-31T12:17:31.752 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411874.log 2024-01-31T12:17:31.752 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.389538.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.349073.log.gz 2024-01-31T12:17:31.754 INFO:teuthology.orchestra.run.smithi049.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.427167.log.gz 2024-01-31T12:17:31.754 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135981.log 2024-01-31T12:17:31.756 INFO:teuthology.orchestra.run.smithi049.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.211863.log.gz 2024-01-31T12:17:31.757 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.411874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31386.log 2024-01-31T12:17:31.759 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.158726.log.gz 2024-01-31T12:17:31.760 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355477.log 2024-01-31T12:17:31.763 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368778.log 2024-01-31T12:17:31.765 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.355477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187655.log 2024-01-31T12:17:31.767 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.368778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285930.log 2024-01-31T12:17:31.769 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.187655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315734.log 2024-01-31T12:17:31.771 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214491.log 2024-01-31T12:17:31.774 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.285930.log: /var/log/ceph/ceph-client.admin.315734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464269.log 2024-01-31T12:17:31.776 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.214491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138134.log 2024-01-31T12:17:31.778 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.464269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31360.log 2024-01-31T12:17:31.780 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.138134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227435.log 2024-01-31T12:17:31.782 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496476.log 2024-01-31T12:17:31.784 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.227435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408142.log 2024-01-31T12:17:31.786 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400482.log 2024-01-31T12:17:31.787 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.496476.log.gz 2024-01-31T12:17:31.788 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.408142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300689.log 2024-01-31T12:17:31.790 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33055.log.gz 2024-01-31T12:17:31.791 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.400482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99814.log 2024-01-31T12:17:31.791 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32650.log.gz 2024-01-31T12:17:31.792 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.300689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315743.log 2024-01-31T12:17:31.794 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31520.log 2024-01-31T12:17:31.796 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34689.log.gz 2024-01-31T12:17:31.797 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.315743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166222.log 2024-01-31T12:17:31.799 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431444.log 2024-01-31T12:17:31.800 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363276.log 2024-01-31T12:17:31.800 INFO:teuthology.orchestra.run.smithi049.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.227435.log.gz 2024-01-31T12:17:31.801 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32342.log 2024-01-31T12:17:31.802 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.166222.log: /var/log/ceph/ceph-client.admin.363276.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.295442.log.gz 2024-01-31T12:17:31.804 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.431444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183096.log 2024-01-31T12:17:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74694.log 2024-01-31T12:17:31.808 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.183096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89165.log 2024-01-31T12:17:31.810 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358628.log 2024-01-31T12:17:31.812 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33644.log 2024-01-31T12:17:31.813 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89165.log: /var/log/ceph/ceph-client.admin.358628.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.408142.log.gz 2024-01-31T12:17:31.813 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218995.log 2024-01-31T12:17:31.816 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34715.log 2024-01-31T12:17:31.817 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31716.log 2024-01-31T12:17:31.819 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.218995.log: /var/log/ceph/ceph-client.admin.34715.log: gzip -5 --verbose 88.4% -- -- replaced with /var/log/ceph/ceph-client.admin.36195.log.gz /var/log/ceph/ceph-client.admin.363903.log 2024-01-31T12:17:31.819 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-31T12:17:31.821 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195186.log 2024-01-31T12:17:31.823 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179084.log 2024-01-31T12:17:31.824 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.363903.log: /var/log/ceph/ceph-client.admin.195186.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.233236.log.gz 2024-01-31T12:17:31.826 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35987.log 2024-01-31T12:17:31.826 INFO:teuthology.orchestra.run.smithi049.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.358628.log.gz 2024-01-31T12:17:31.827 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.287959.log.gz 2024-01-31T12:17:31.828 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.179084.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.315734.log.gz 2024-01-31T12:17:31.829 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441102.log 2024-01-31T12:17:31.829 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.348240.log.gz 2024-01-31T12:17:31.830 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.368778.log.gz 2024-01-31T12:17:31.831 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.315743.log.gz 2024-01-31T12:17:31.831 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.349935.log.gz 2024-01-31T12:17:31.832 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161274.log 2024-01-31T12:17:31.834 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.441102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237247.log 2024-01-31T12:17:31.836 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.161274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136374.log 2024-01-31T12:17:31.838 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376127.log 2024-01-31T12:17:31.839 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.428863.log.gz 2024-01-31T12:17:31.840 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.237247.log: /var/log/ceph/ceph-client.admin.136374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179486.log 2024-01-31T12:17:31.841 INFO:teuthology.orchestra.run.smithi049.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.101421.log.gz 2024-01-31T12:17:31.843 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.376127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75685.log 2024-01-31T12:17:31.845 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.179486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33566.log 2024-01-31T12:17:31.846 INFO:teuthology.orchestra.run.smithi049.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.398831.log.gz 2024-01-31T12:17:31.847 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.423064.log.gz 2024-01-31T12:17:31.847 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218596.log 2024-01-31T12:17:31.849 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437184.log 2024-01-31T12:17:31.851 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.218596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321117.log 2024-01-31T12:17:31.853 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.437184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37161.log 2024-01-31T12:17:31.855 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.321117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186356.log 2024-01-31T12:17:31.856 INFO:teuthology.orchestra.run.smithi049.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.389538.log.gz 2024-01-31T12:17:31.857 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.37161.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.466687.log.gz 2024-01-31T12:17:31.857 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219801.log 2024-01-31T12:17:31.858 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.179084.log.gz 2024-01-31T12:17:31.859 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.186356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206495.log 2024-01-31T12:17:31.861 INFO:teuthology.orchestra.run.smithi049.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.138134.log.gz 2024-01-31T12:17:31.862 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.219801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297085.log 2024-01-31T12:17:31.862 INFO:teuthology.orchestra.run.smithi049.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.169243.log.gz 2024-01-31T12:17:31.863 INFO:teuthology.orchestra.run.smithi049.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.130997.log.gz 2024-01-31T12:17:31.863 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381016.log 2024-01-31T12:17:31.863 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.179486.log.gz 2024-01-31T12:17:31.864 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.297085.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.188089.log.gz 2024-01-31T12:17:31.867 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.206495.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-31T12:17:31.868 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.381016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240543.log 2024-01-31T12:17:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468317.log 2024-01-31T12:17:31.871 INFO:teuthology.orchestra.run.smithi049.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.214491.log.gz 2024-01-31T12:17:31.872 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.240543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199777.log 2024-01-31T12:17:31.873 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.468317.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.136374.log.gz 2024-01-31T12:17:31.874 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496815.log 2024-01-31T12:17:31.874 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.135981.log.gz 2024-01-31T12:17:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374472.log 2024-01-31T12:17:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.199777.log: /var/log/ceph/ceph-client.admin.496815.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.496815.log.gz 2024-01-31T12:17:31.877 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.161274.log.gz 2024-01-31T12:17:31.878 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165016.log 2024-01-31T12:17:31.880 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159150.log 2024-01-31T12:17:31.882 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.374472.log: /var/log/ceph/ceph-client.admin.165016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316136.log 2024-01-31T12:17:31.884 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.159150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484624.log 2024-01-31T12:17:31.886 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36325.log 2024-01-31T12:17:31.887 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.484624.log: /var/log/ceph/ceph-client.admin.316136.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.126801.log.gz 2024-01-31T12:17:31.890 INFO:teuthology.orchestra.run.smithi049.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.484624.log.gz 2024-01-31T12:17:31.890 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36117.log 2024-01-31T12:17:31.890 INFO:teuthology.orchestra.run.smithi049.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.373647.log.gz 2024-01-31T12:17:31.893 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475759.log 2024-01-31T12:17:31.894 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36117.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35987.log.gz 2024-01-31T12:17:31.896 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490130.log 2024-01-31T12:17:31.897 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176115.log 2024-01-31T12:17:31.898 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.475759.log: /var/log/ceph/ceph-client.admin.490130.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.490130.log.gz 2024-01-31T12:17:31.899 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.475759.log.gz 2024-01-31T12:17:31.901 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496998.log 2024-01-31T12:17:31.902 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34663.log.gz 2024-01-31T12:17:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.176115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384001.log 2024-01-31T12:17:31.905 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34715.log.gz 2024-01-31T12:17:31.905 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37161.log.gz 2024-01-31T12:17:31.906 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103907.log 2024-01-31T12:17:31.907 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487599.log 2024-01-31T12:17:31.907 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.496998.log.gz 2024-01-31T12:17:31.910 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.103907.log: /var/log/ceph/ceph-client.admin.384001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164400.log 2024-01-31T12:17:31.911 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35407.log 2024-01-31T12:17:31.913 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.164400.log: /var/log/ceph/ceph-client.admin.487599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229860.log 2024-01-31T12:17:31.916 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281086.log 2024-01-31T12:17:31.917 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192143.log 2024-01-31T12:17:31.920 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.281086.log: /var/log/ceph/ceph-client.admin.229860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239677.log 2024-01-31T12:17:31.920 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.240543.log.gz 2024-01-31T12:17:31.921 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.192143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454934.log 2024-01-31T12:17:31.921 INFO:teuthology.orchestra.run.smithi049.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.487599.log.gz 2024-01-31T12:17:31.924 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.239677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37002.log 2024-01-31T12:17:31.927 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.454934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403952.log 2024-01-31T12:17:31.930 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.37002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170535.log 2024-01-31T12:17:31.933 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.403952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381007.log 2024-01-31T12:17:31.935 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.170535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410633.log 2024-01-31T12:17:31.938 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.381007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428417.log 2024-01-31T12:17:31.940 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.321117.log.gz 2024-01-31T12:17:31.940 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.410633.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.237247.log.gz 2024-01-31T12:17:31.940 INFO:teuthology.orchestra.run.smithi049.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.311757.log.gz 2024-01-31T12:17:31.940 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32644.log 2024-01-31T12:17:31.941 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.428417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34984.log 2024-01-31T12:17:31.943 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448553.log 2024-01-31T12:17:31.944 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409802.log 2024-01-31T12:17:31.947 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.448553.log: /var/log/ceph/ceph-client.admin.34984.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.200643.log.gz 2024-01-31T12:17:31.947 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295844.log 2024-01-31T12:17:31.948 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488854.log 2024-01-31T12:17:31.950 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.295844.log: /var/log/ceph/ceph-client.admin.409802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418922.log 2024-01-31T12:17:31.952 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.488854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411070.log 2024-01-31T12:17:31.952 INFO:teuthology.orchestra.run.smithi049.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.403952.log.gz 2024-01-31T12:17:31.952 INFO:teuthology.orchestra.run.smithi049.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.488854.log.gz 2024-01-31T12:17:31.955 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.418922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135488.log 2024-01-31T12:17:31.957 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.411070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414374.log 2024-01-31T12:17:31.959 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.135488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387260.log 2024-01-31T12:17:31.961 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.414374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321930.log 2024-01-31T12:17:31.963 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.387260.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.440293.log.gz 2024-01-31T12:17:31.963 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285532.log 2024-01-31T12:17:31.964 INFO:teuthology.orchestra.run.smithi049.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.431837.log.gz 2024-01-31T12:17:31.965 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.321930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167066.log 2024-01-31T12:17:31.967 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.285532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104807.log 2024-01-31T12:17:31.969 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.167066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418512.log 2024-01-31T12:17:31.970 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.104807.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.465477.log.gz 2024-01-31T12:17:31.971 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205296.log 2024-01-31T12:17:31.971 INFO:teuthology.orchestra.run.smithi049.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.468317.log.gz 2024-01-31T12:17:31.975 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.418512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127621.log 2024-01-31T12:17:31.977 INFO:teuthology.orchestra.run.smithi049.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.206495.log.gz 2024-01-31T12:17:31.977 INFO:teuthology.orchestra.run.smithi049.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.418922.log.gz 2024-01-31T12:17:31.978 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247611.log 2024-01-31T12:17:31.978 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.205296.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.218596.log.gz 2024-01-31T12:17:31.978 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.186795.log.gz 2024-01-31T12:17:31.979 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.219801.log.gz 2024-01-31T12:17:31.980 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.127621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178678.log 2024-01-31T12:17:31.980 INFO:teuthology.orchestra.run.smithi049.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.186356.log.gz 2024-01-31T12:17:31.982 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.247611.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.178263.log.gz 2024-01-31T12:17:31.982 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488449.log 2024-01-31T12:17:31.983 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.178678.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.129671.log.gz 2024-01-31T12:17:31.985 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470622.log 2024-01-31T12:17:31.988 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.488449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353818.log 2024-01-31T12:17:31.990 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.470622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36377.log 2024-01-31T12:17:31.992 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.353818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492329.log 2024-01-31T12:17:31.993 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.470622.log.gz 2024-01-31T12:17:31.994 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.428417.log.gz 2024-01-31T12:17:31.994 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480840.log 2024-01-31T12:17:31.996 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.492329.log: /var/log/ceph/ceph-client.admin.36377.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.492329.log.gz 2024-01-31T12:17:31.997 INFO:teuthology.orchestra.run.smithi049.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.488449.log.gz 2024-01-31T12:17:31.998 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175255.log 2024-01-31T12:17:32.001 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.480840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413970.log 2024-01-31T12:17:32.001 INFO:teuthology.orchestra.run.smithi049.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.480840.log.gz 2024-01-31T12:17:32.003 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.175255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83179.log 2024-01-31T12:17:32.006 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.413970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401833.log 2024-01-31T12:17:32.008 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479980.log 2024-01-31T12:17:32.010 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.401833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33056.log 2024-01-31T12:17:32.012 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31306.log 2024-01-31T12:17:32.014 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.479980.log: /var/log/ceph/ceph-client.admin.33056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166655.log 2024-01-31T12:17:32.017 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236443.log 2024-01-31T12:17:32.019 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32076.log 2024-01-31T12:17:32.021 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.236443.log: /var/log/ceph/ceph-client.admin.166655.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.351172.log.gz 2024-01-31T12:17:32.021 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467894.log 2024-01-31T12:17:32.022 INFO:teuthology.orchestra.run.smithi049.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.479980.log.gz 2024-01-31T12:17:32.024 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404798.log 2024-01-31T12:17:32.026 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.467894.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.195186.log.gz 2024-01-31T12:17:32.027 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180692.log 2024-01-31T12:17:32.027 INFO:teuthology.orchestra.run.smithi049.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.355477.log.gz 2024-01-31T12:17:32.028 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218192.log 2024-01-31T12:17:32.031 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.404798.log: /var/log/ceph/ceph-client.admin.180692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496302.log 2024-01-31T12:17:32.033 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.218192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194333.log 2024-01-31T12:17:32.034 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.103907.log.gz 2024-01-31T12:17:32.034 INFO:teuthology.orchestra.run.smithi049.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.323717.log.gz 2024-01-31T12:17:32.036 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31844.log 2024-01-31T12:17:32.036 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.496302.log.gz 2024-01-31T12:17:32.039 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.194333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359922.log 2024-01-31T12:17:32.041 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31844.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.408151.log.gz 2024-01-31T12:17:32.042 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297477.log 2024-01-31T12:17:32.044 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.359922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415318.log 2024-01-31T12:17:32.046 INFO:teuthology.orchestra.run.smithi049.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.127621.log.gz 2024-01-31T12:17:32.046 INFO:teuthology.orchestra.run.smithi049.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.236443.log.gz 2024-01-31T12:17:32.048 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.297477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231090.log 2024-01-31T12:17:32.050 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.415318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125979.log 2024-01-31T12:17:32.051 INFO:teuthology.orchestra.run.smithi049.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.460633.log.gz 2024-01-31T12:17:32.053 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.231090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377753.log 2024-01-31T12:17:32.056 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.125979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443106.log 2024-01-31T12:17:32.057 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32648.log 2024-01-31T12:17:32.059 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.377753.log: /var/log/ceph/ceph-client.admin.443106.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.387260.log.gz 2024-01-31T12:17:32.060 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385615.log 2024-01-31T12:17:32.063 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326692.log 2024-01-31T12:17:32.064 INFO:teuthology.orchestra.run.smithi049.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.424273.log.gz 2024-01-31T12:17:32.065 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.385615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230276.log 2024-01-31T12:17:32.067 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.326692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204492.log 2024-01-31T12:17:32.068 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.418512.log.gz 2024-01-31T12:17:32.072 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413547.log 2024-01-31T12:17:32.072 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.204492.log: /var/log/ceph/ceph-client.admin.230276.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36325.log.gz 2024-01-31T12:17:32.072 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222133.log 2024-01-31T12:17:32.072 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.413547.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.467894.log.gz 2024-01-31T12:17:32.073 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154061.log 2024-01-31T12:17:32.075 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496049.log 2024-01-31T12:17:32.075 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.222133.log: /var/log/ceph/ceph-client.admin.154061.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.199777.log.gz 2024-01-31T12:17:32.076 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.205296.log.gz 2024-01-31T12:17:32.078 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168822.log 2024-01-31T12:17:32.078 INFO:teuthology.orchestra.run.smithi049.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.284719.log.gz 2024-01-31T12:17:32.079 INFO:teuthology.orchestra.run.smithi049.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.89585.log.gz 2024-01-31T12:17:32.080 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212278.log 2024-01-31T12:17:32.081 INFO:teuthology.orchestra.run.smithi049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.496049.log.gz 2024-01-31T12:17:32.082 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.154061.log.gz 2024-01-31T12:17:32.083 INFO:teuthology.orchestra.run.smithi049.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.247611.log.gz 2024-01-31T12:17:32.084 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.168822.log: gzip -5 90.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.401833.log.gz 2024-01-31T12:17:32.084 INFO:teuthology.orchestra.run.smithi049.stderr: -- /var/log/ceph/ceph-client.admin.218183.log 2024-01-31T12:17:32.085 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.204492.log.gz 2024-01-31T12:17:32.085 INFO:teuthology.orchestra.run.smithi049.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.218192.log.gz 2024-01-31T12:17:32.087 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130988.log 2024-01-31T12:17:32.088 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.212278.log: /var/log/ceph/ceph-client.admin.218183.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.376127.log.gz 2024-01-31T12:17:32.089 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.180692.log.gz 2024-01-31T12:17:32.089 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128866.log 2024-01-31T12:17:32.092 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469771.log 2024-01-31T12:17:32.093 INFO:teuthology.orchestra.run.smithi049.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.287147.log.gz 2024-01-31T12:17:32.093 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.297477.log.gz 2024-01-31T12:17:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242621.log 2024-01-31T12:17:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.469771.log: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.469771.log.gz 2024-01-31T12:17:32.096 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97800.log 2024-01-31T12:17:32.098 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281885.log 2024-01-31T12:17:32.100 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.97800.log: /var/log/ceph/ceph-client.admin.242621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197200.log 2024-01-31T12:17:32.102 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.281885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211447.log 2024-01-31T12:17:32.105 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.197200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320323.log 2024-01-31T12:17:32.106 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483764.log 2024-01-31T12:17:32.108 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.320323.log: /var/log/ceph/ceph-client.admin.211447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77038.log 2024-01-31T12:17:32.111 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.483764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496974.log 2024-01-31T12:17:32.111 INFO:teuthology.orchestra.run.smithi049.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.483764.log.gz 2024-01-31T12:17:32.114 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36808.log 2024-01-31T12:17:32.116 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36351.log 2024-01-31T12:17:32.116 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.496974.log.gz 2024-01-31T12:17:32.118 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385207.log 2024-01-31T12:17:32.120 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36808.log: /var/log/ceph/ceph-client.admin.36351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479971.log 2024-01-31T12:17:32.123 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.385207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311355.log 2024-01-31T12:17:32.125 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.479971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167057.log 2024-01-31T12:17:32.126 INFO:teuthology.orchestra.run.smithi049.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.479971.log.gz 2024-01-31T12:17:32.128 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.311355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35961.log 2024-01-31T12:17:32.131 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.167057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346948.log 2024-01-31T12:17:32.133 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238062.log 2024-01-31T12:17:32.134 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.97800.log.gz 2024-01-31T12:17:32.136 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.346948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325873.log 2024-01-31T12:17:32.138 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171812.log 2024-01-31T12:17:32.140 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.238062.log: /var/log/ceph/ceph-client.admin.325873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248457.log 2024-01-31T12:17:32.142 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.171812.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35275.log.gz 2024-01-31T12:17:32.143 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413556.log 2024-01-31T12:17:32.144 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35961.log.gz 2024-01-31T12:17:32.146 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.248457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352049.log 2024-01-31T12:17:32.148 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.413556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426765.log 2024-01-31T12:17:32.151 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.352049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34221.log 2024-01-31T12:17:32.152 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388385.log 2024-01-31T12:17:32.155 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.426765.log: /var/log/ceph/ceph-client.admin.34221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413961.log 2024-01-31T12:17:32.157 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.388385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176106.log 2024-01-31T12:17:32.160 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.413961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371629.log 2024-01-31T12:17:32.162 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.176106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33252.log 2024-01-31T12:17:32.164 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.371629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381418.log 2024-01-31T12:17:32.167 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35487.log 2024-01-31T12:17:32.168 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496075.log 2024-01-31T12:17:32.169 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.381418.log: /var/log/ceph/ceph-client.admin.35487.log: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.164400.log.gz 2024-01-31T12:17:32.170 INFO:teuthology.orchestra.run.smithi049.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.281885.log.gz 2024-01-31T12:17:32.171 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216919.log 2024-01-31T12:17:32.173 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496075.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.230276.log.gz 2024-01-31T12:17:32.174 INFO:teuthology.orchestra.run.smithi049.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.130988.log.gz 2024-01-31T12:17:32.174 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.496075.log.gz 2024-01-31T12:17:32.174 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91252.log 2024-01-31T12:17:32.175 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31412.log.gz 2024-01-31T12:17:32.176 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356297.log 2024-01-31T12:17:32.177 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.216919.log: /var/log/ceph/ceph-client.admin.91252.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.194333.log.gz 2024-01-31T12:17:32.177 INFO:teuthology.orchestra.run.smithi049.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.311355.log.gz 2024-01-31T12:17:32.179 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.238062.log.gz 2024-01-31T12:17:32.179 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130087.log 2024-01-31T12:17:32.180 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.320323.log.gz 2024-01-31T12:17:32.180 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.359520.log.gz 2024-01-31T12:17:32.180 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.346948.log.gz 2024-01-31T12:17:32.181 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.385615.log.gz 2024-01-31T12:17:32.182 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.356297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366687.log 2024-01-31T12:17:32.183 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.431444.log.gz/var/log/ceph/ceph-client.admin.130087.log: 2024-01-31T12:17:32.183 INFO:teuthology.orchestra.run.smithi049.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.413547.log.gz 2024-01-31T12:17:32.184 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.413961.log.gz 2024-01-31T12:17:32.184 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323251.log 2024-01-31T12:17:32.187 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.366687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36403.log 2024-01-31T12:17:32.188 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36916.log 2024-01-31T12:17:32.191 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.323251.log: /var/log/ceph/ceph-client.admin.36403.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.231090.log.gz 2024-01-31T12:17:32.191 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308445.log 2024-01-31T12:17:32.192 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.282691.log.gz 2024-01-31T12:17:32.194 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36916.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.297085.log.gz 2024-01-31T12:17:32.194 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236050.log 2024-01-31T12:17:32.196 INFO:teuthology.orchestra.run.smithi049.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.212278.log.gz 2024-01-31T12:17:32.196 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.308445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217346.log 2024-01-31T12:17:32.197 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.99814.log.gz 2024-01-31T12:17:32.197 INFO:teuthology.orchestra.run.smithi049.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.218183.log.gz 2024-01-31T12:17:32.199 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.236050.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.183105.log.gz 2024-01-31T12:17:32.200 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105672.log 2024-01-31T12:17:32.200 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.217346.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.178678.log.gz 2024-01-31T12:17:32.201 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77029.log 2024-01-31T12:17:32.204 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.105672.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.464269.log.gz 2024-01-31T12:17:32.204 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229453.log 2024-01-31T12:17:32.206 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463063.log 2024-01-31T12:17:32.208 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363285.log 2024-01-31T12:17:32.210 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.229453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107298.log 2024-01-31T12:17:32.210 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.363285.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.321930.log.gz 2024-01-31T12:17:32.211 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33566.log.gz 2024-01-31T12:17:32.212 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.463063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423878.log 2024-01-31T12:17:32.215 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471887.log 2024-01-31T12:17:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.107298.log: /var/log/ceph/ceph-client.admin.423878.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.411874.log.gz 2024-01-31T12:17:32.217 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440691.log 2024-01-31T12:17:32.219 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.471887.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.248038.log.gz 2024-01-31T12:17:32.220 INFO:teuthology.orchestra.run.smithi049.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.471887.log.gz 2024-01-31T12:17:32.220 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153659.log 2024-01-31T12:17:32.221 INFO:teuthology.orchestra.run.smithi049.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35487.log.gz 2024-01-31T12:17:32.221 INFO:teuthology.orchestra.run.smithi049.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.99805.log.gz 2024-01-31T12:17:32.222 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33434.log.gz 87.7% 2024-01-31T12:17:32.222 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31360.log.gz 2024-01-31T12:17:32.223 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.175255.log.gz 2024-01-31T12:17:32.223 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31794.log 2024-01-31T12:17:32.225 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.440691.log: /var/log/ceph/ceph-client.admin.153659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218587.log 2024-01-31T12:17:32.226 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36916.log.gz 2024-01-31T12:17:32.227 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31794.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31716.log.gz 2024-01-31T12:17:32.227 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378160.log 2024-01-31T12:17:32.229 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295835.log 2024-01-31T12:17:32.229 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36448.log.gz 2024-01-31T12:17:32.230 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.378160.log: /var/log/ceph/ceph-client.admin.218587.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.75685.log.gz 2024-01-31T12:17:32.232 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439381.log 2024-01-31T12:17:32.235 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.295835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407221.log 2024-01-31T12:17:32.235 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.190128.log.gz 2024-01-31T12:17:32.237 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.439381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398840.log 2024-01-31T12:17:32.238 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.176106.log.gz 2024-01-31T12:17:32.239 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.407221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197209.log 2024-01-31T12:17:32.241 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.398840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35722.log 2024-01-31T12:17:32.244 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.197209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310961.log 2024-01-31T12:17:32.245 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.323251.log.gz 2024-01-31T12:17:32.247 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35722.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.409802.log.gz 2024-01-31T12:17:32.247 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.229453.log.gz 2024-01-31T12:17:32.247 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356691.log 2024-01-31T12:17:32.250 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.310961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135044.log 2024-01-31T12:17:32.251 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496632.log 2024-01-31T12:17:32.254 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.356691.log: /var/log/ceph/ceph-client.admin.135044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82786.log 2024-01-31T12:17:32.256 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173526.log 2024-01-31T12:17:32.258 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.496632.log.gz 2024-01-31T12:17:32.258 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209369.log 2024-01-31T12:17:32.260 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.82786.log: /var/log/ceph/ceph-client.admin.173526.log: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.104807.log.gz 2024-01-31T12:17:32.260 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128056.log 2024-01-31T12:17:32.261 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.105672.log.gz 2024-01-31T12:17:32.261 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.107705.log.gz 2024-01-31T12:17:32.263 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.209369.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.128866.log.gz 2024-01-31T12:17:32.263 INFO:teuthology.orchestra.run.smithi049.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.285523.log.gz 2024-01-31T12:17:32.264 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439390.log 2024-01-31T12:17:32.265 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.463456.log.gz 2024-01-31T12:17:32.267 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220700.log 2024-01-31T12:17:32.268 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.378160.log.gz 2024-01-31T12:17:32.269 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435554.log 2024-01-31T12:17:32.271 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.439390.log: /var/log/ceph/ceph-client.admin.220700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32859.log 2024-01-31T12:17:32.273 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471016.log 2024-01-31T12:17:32.275 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32859.log: /var/log/ceph/ceph-client.admin.435554.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.176115.log.gz 2024-01-31T12:17:32.275 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456236.log 2024-01-31T12:17:32.275 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.471016.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.471016.log.gz 2024-01-31T12:17:32.277 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.384814.log.gz 2024-01-31T12:17:32.277 INFO:teuthology.orchestra.run.smithi049.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.137187.log.gz 2024-01-31T12:17:32.278 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398036.log 2024-01-31T12:17:32.280 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461852.log 2024-01-31T12:17:32.280 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.456236.log: /var/log/ceph/ceph-client.admin.398036.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.156497.log.gz 2024-01-31T12:17:32.281 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36860.log 2024-01-31T12:17:32.284 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.461852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398438.log 2024-01-31T12:17:32.285 INFO:teuthology.orchestra.run.smithi049.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.218587.log.gz 2024-01-31T12:17:32.285 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357538.log 2024-01-31T12:17:32.286 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.398438.log: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.173526.log.gz 2024-01-31T12:17:32.288 INFO:teuthology.orchestra.run.smithi049.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.192143.log.gz 2024-01-31T12:17:32.289 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324999.log 2024-01-31T12:17:32.290 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.357538.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.168822.log.gz 2024-01-31T12:17:32.292 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416731.log 2024-01-31T12:17:32.293 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306425.log 2024-01-31T12:17:32.296 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.324999.log: /var/log/ceph/ceph-client.admin.416731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417124.log 2024-01-31T12:17:32.298 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.306425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127215.log 2024-01-31T12:17:32.301 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.417124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35145.log 2024-01-31T12:17:32.302 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437638.log 2024-01-31T12:17:32.305 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.127215.log: /var/log/ceph/ceph-client.admin.35145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33330.log 2024-01-31T12:17:32.306 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423466.log 2024-01-31T12:17:32.309 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.437638.log: /var/log/ceph/ceph-client.admin.33330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138573.log 2024-01-31T12:17:32.312 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.423466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169675.log 2024-01-31T12:17:32.314 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.138573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103499.log 2024-01-31T12:17:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.169675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490564.log 2024-01-31T12:17:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286740.log 2024-01-31T12:17:32.320 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.103499.log: /var/log/ceph/ceph-client.admin.490564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365882.log 2024-01-31T12:17:32.321 INFO:teuthology.orchestra.run.smithi049.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.490564.log.gz 2024-01-31T12:17:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.286740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184308.log 2024-01-31T12:17:32.324 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.407221.log.gz 2024-01-31T12:17:32.324 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.400482.log.gz 2024-01-31T12:17:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.365882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463867.log 2024-01-31T12:17:32.327 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.184308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179879.log 2024-01-31T12:17:32.327 INFO:teuthology.orchestra.run.smithi049.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.77029.log.gz 2024-01-31T12:17:32.329 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.463867.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.91252.log.gz 2024-01-31T12:17:32.329 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353827.log 2024-01-31T12:17:32.330 INFO:teuthology.orchestra.run.smithi049.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.92459.log.gz 2024-01-31T12:17:32.330 INFO:teuthology.orchestra.run.smithi049.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.363276.log.gz 2024-01-31T12:17:32.332 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.179879.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.356691.log.gz 2024-01-31T12:17:32.332 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157357.log 2024-01-31T12:17:32.334 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87508.log 2024-01-31T12:17:32.336 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.353827.log: /var/log/ceph/ceph-client.admin.157357.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33644.log.gz 2024-01-31T12:17:32.337 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295433.log 2024-01-31T12:17:32.339 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.87508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425952.log 2024-01-31T12:17:32.340 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37135.log.gz 2024-01-31T12:17:32.340 INFO:teuthology.orchestra.run.smithi049.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.308445.log.gz 2024-01-31T12:17:32.341 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.295433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286337.log 2024-01-31T12:17:32.343 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.425952.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35722.log.gz 2024-01-31T12:17:32.343 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31638.log 2024-01-31T12:17:32.344 INFO:teuthology.orchestra.run.smithi049.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31520.log.gz 2024-01-31T12:17:32.345 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.286337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236845.log 2024-01-31T12:17:32.346 INFO:teuthology.orchestra.run.smithi049.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.31844.log.gz 2024-01-31T12:17:32.346 INFO:teuthology.orchestra.run.smithi049.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.87508.log.gz 2024-01-31T12:17:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166213.log 2024-01-31T12:17:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31638.log: /var/log/ceph/ceph-client.admin.236845.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.31794.log.gz 2024-01-31T12:17:32.348 INFO:teuthology.orchestra.run.smithi049.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.125979.log.gz 2024-01-31T12:17:32.348 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.89165.log.gz 2024-01-31T12:17:32.350 INFO:teuthology.orchestra.run.smithi049.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.295433.log.gz 2024-01-31T12:17:32.350 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77888.log 2024-01-31T12:17:32.350 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36860.log.gz 2024-01-31T12:17:32.351 INFO:teuthology.orchestra.run.smithi049.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.415786.log.gz 2024-01-31T12:17:32.352 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.166213.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.130087.log.gz 2024-01-31T12:17:32.352 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153257.log 2024-01-31T12:17:32.354 INFO:teuthology.orchestra.run.smithi049.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.456236.log.gz 2024-01-31T12:17:32.354 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.365882.log.gz 2024-01-31T12:17:32.355 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77888.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.463867.log.gz 2024-01-31T12:17:32.356 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.441102.log.gz 2024-01-31T12:17:32.356 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192152.log 2024-01-31T12:17:32.359 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.153257.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.437638.log.gz 2024-01-31T12:17:32.359 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34325.log 2024-01-31T12:17:32.359 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.398036.log.gz 2024-01-31T12:17:32.360 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.398438.log.gz 2024-01-31T12:17:32.360 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430595.log 2024-01-31T12:17:32.361 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34325.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.435554.log.gz 2024-01-31T12:17:32.362 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.192152.log: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.135479.log.gz 2024-01-31T12:17:32.362 INFO:teuthology.orchestra.run.smithi049.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.286740.log.gz 2024-01-31T12:17:32.363 INFO:teuthology.orchestra.run.smithi049.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.179879.log.gz 2024-01-31T12:17:32.363 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421089.log 2024-01-31T12:17:32.365 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.430595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102233.log 2024-01-31T12:17:32.367 INFO:teuthology.orchestra.run.smithi049.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.184308.log.gzgzip 2024-01-31T12:17:32.367 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35748.log 2024-01-31T12:17:32.367 INFO:teuthology.orchestra.run.smithi049.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.286337.log.gz 2024-01-31T12:17:32.368 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.102233.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.128056.log.gz 2024-01-31T12:17:32.368 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.421089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224604.log 2024-01-31T12:17:32.371 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35748.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.388385.log.gz 2024-01-31T12:17:32.371 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.306425.log.gz 2024-01-31T12:17:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290374.log 2024-01-31T12:17:32.375 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.224604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375695.log 2024-01-31T12:17:32.377 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.290374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348638.log 2024-01-31T12:17:32.378 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.439381.log.gz 2024-01-31T12:17:32.379 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.375695.log: /var/log/ceph/ceph-client.admin.103508.log 2024-01-31T12:17:32.381 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.348638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89576.log 2024-01-31T12:17:32.382 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.153659.log.gz 2024-01-31T12:17:32.384 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.103508.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.153257.log.gz 2024-01-31T12:17:32.385 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429320.log 2024-01-31T12:17:32.387 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374879.log 2024-01-31T12:17:32.390 INFO:teuthology.orchestra.run.smithi049.stderr:gzip/var/log/ceph/ceph-client.admin.429320.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32181.log 2024-01-31T12:17:32.391 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376923.log 2024-01-31T12:17:32.394 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.374879.log: /var/log/ceph/ceph-client.admin.32181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495273.log 2024-01-31T12:17:32.395 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34221.log.gz 2024-01-31T12:17:32.397 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.376923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422496.log 2024-01-31T12:17:32.398 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310949.log 2024-01-31T12:17:32.401 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.495273.log: /var/log/ceph/ceph-client.admin.422496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363630.log 2024-01-31T12:17:32.401 INFO:teuthology.orchestra.run.smithi049.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.495273.log.gz 2024-01-31T12:17:32.404 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.310949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36013.log 2024-01-31T12:17:32.406 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.363630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31152.log 2024-01-31T12:17:32.408 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363679.log 2024-01-31T12:17:32.411 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31152.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.359922.log.gz 2024-01-31T12:17:32.411 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386462.log 2024-01-31T12:17:32.413 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.363679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165820.log 2024-01-31T12:17:32.416 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.386462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161667.log 2024-01-31T12:17:32.418 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.165820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496101.log 2024-01-31T12:17:32.420 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493155.log 2024-01-31T12:17:32.421 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.161667.log: /var/log/ceph/ceph-client.admin.496101.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.496101.log.gz 2024-01-31T12:17:32.422 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428022.log 2024-01-31T12:17:32.425 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.493155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182301.log 2024-01-31T12:17:32.427 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109798.log 2024-01-31T12:17:32.427 INFO:teuthology.orchestra.run.smithi049.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.493155.log.gz 2024-01-31T12:17:32.429 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.428022.log: /var/log/ceph/ceph-client.admin.182301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402694.log 2024-01-31T12:17:32.432 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.109798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352613.log 2024-01-31T12:17:32.433 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407212.log 2024-01-31T12:17:32.436 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.402694.log: /var/log/ceph/ceph-client.admin.352613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302726.log 2024-01-31T12:17:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.407212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323260.log 2024-01-31T12:17:32.440 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399635.log 2024-01-31T12:17:32.443 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.302726.log: /var/log/ceph/ceph-client.admin.323260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374870.log 2024-01-31T12:17:32.443 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35407.log.gz 2024-01-31T12:17:32.444 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36117.log.gz 2024-01-31T12:17:32.444 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98606.log 2024-01-31T12:17:32.447 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.374870.log: /var/log/ceph/ceph-client.admin.399635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226218.log 2024-01-31T12:17:32.450 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226227.log 2024-01-31T12:17:32.452 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.226218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468732.log 2024-01-31T12:17:32.454 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203249.log 2024-01-31T12:17:32.455 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.226227.log: /var/log/ceph/ceph-client.admin.468732.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31638.log.gz 2024-01-31T12:17:32.457 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248466.log 2024-01-31T12:17:32.458 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34325.log.gz 2024-01-31T12:17:32.459 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.203249.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34984.log.gz 2024-01-31T12:17:32.459 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35461.log 2024-01-31T12:17:32.460 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36377.log.gz 2024-01-31T12:17:32.461 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329118.log 2024-01-31T12:17:32.463 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.248466.log: /var/log/ceph/ceph-client.admin.35461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250249.log 2024-01-31T12:17:32.466 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31152.log.gz 2024-01-31T12:17:32.466 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.329118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421961.log 2024-01-31T12:17:32.468 INFO:teuthology.orchestra.run.smithi049.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.89576.log.gz 2024-01-31T12:17:32.468 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36976.log.gz 2024-01-31T12:17:32.469 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386868.log 2024-01-31T12:17:32.469 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.250249.log: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.353818.log.gz 2024-01-31T12:17:32.471 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.421961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283910.log 2024-01-31T12:17:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.386868.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.229860.log.gz 2024-01-31T12:17:32.475 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185115.log 2024-01-31T12:17:32.476 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318280.log 2024-01-31T12:17:32.476 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.283910.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.374870.log.gz 2024-01-31T12:17:32.478 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.185115.log: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.376923.log.gz 2024-01-31T12:17:32.478 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173104.log 2024-01-31T12:17:32.479 INFO:teuthology.orchestra.run.smithi049.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.247203.log.gz 2024-01-31T12:17:32.480 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.318280.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.77888.log.gz 2024-01-31T12:17:32.480 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.281086.log.gz 2024-01-31T12:17:32.481 INFO:teuthology.orchestra.run.smithi049.stderr:gzip 81.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.421961.log.gz 2024-01-31T12:17:32.481 INFO:teuthology.orchestra.run.smithi049.stderr: -- /var/log/ceph/ceph-client.admin.496919.log 2024-01-31T12:17:32.483 INFO:teuthology.orchestra.run.smithi049.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.211872.log.gz 2024-01-31T12:17:32.483 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.173104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229050.log 2024-01-31T12:17:32.484 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.236050.log.gz 2024-01-31T12:17:32.484 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496919.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.496919.log.gz 2024-01-31T12:17:32.485 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.103508.log.gz 2024-01-31T12:17:32.486 INFO:teuthology.orchestra.run.smithi049.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.318280.log.gz 2024-01-31T12:17:32.486 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357547.log 2024-01-31T12:17:32.487 INFO:teuthology.orchestra.run.smithi049.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.381007.log.gz 2024-01-31T12:17:32.487 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.239677.log.gz 2024-01-31T12:17:32.489 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381811.log 2024-01-31T12:17:32.490 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.229050.log: /var/log/ceph/ceph-client.admin.357547.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.399635.log.gz 2024-01-31T12:17:32.491 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231497.log 2024-01-31T12:17:32.492 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35748.log.gz 2024-01-31T12:17:32.493 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.381811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298289.log 2024-01-31T12:17:32.495 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.231497.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.439390.log.gz 2024-01-31T12:17:32.496 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428854.log 2024-01-31T12:17:32.496 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.428022.log.gz 2024-01-31T12:17:32.497 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-31T12:17:32.497 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.386868.log.gz 2024-01-31T12:17:32.498 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.428854.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.407212.log.gz 2024-01-31T12:17:32.498 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.298289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406014.log 2024-01-31T12:17:32.500 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.audit.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.414831.log.gz 2024-01-31T12:17:32.501 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.413970.log.gz 2024-01-31T12:17:32.502 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-01-31T12:17:32.502 INFO:teuthology.orchestra.run.smithi049.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.414374.log.gz 2024-01-31T12:17:32.505 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.406014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434737.log 2024-01-31T12:17:32.507 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491453.log 2024-01-31T12:17:32.508 INFO:teuthology.orchestra.run.smithi049.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.101826.log.gz 2024-01-31T12:17:32.509 INFO:teuthology.orchestra.run.smithi049.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.102233.log.gz 2024-01-31T12:17:32.510 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438440.log 2024-01-31T12:17:32.512 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.491453.log: /var/log/ceph/ceph-client.admin.434737.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.429320.log.gz 2024-01-31T12:17:32.513 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36754.log 2024-01-31T12:17:32.513 INFO:teuthology.orchestra.run.smithi049.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.491453.log.gz 2024-01-31T12:17:32.514 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.429329.log.gz 2024-01-31T12:17:32.515 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.438440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159581.log 2024-01-31T12:17:32.516 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351575.log 2024-01-31T12:17:32.517 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.234442.log.gz 2024-01-31T12:17:32.517 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.165016.log.gz 2024-01-31T12:17:32.519 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36754.log: /var/log/ceph/ceph-client.admin.159581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201093.log 2024-01-31T12:17:32.521 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.351575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35513.log 2024-01-31T12:17:32.522 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408560.log 2024-01-31T12:17:32.523 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.201093.log: /var/log/ceph/ceph-client.admin.35513.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.250249.log.gz 2024-01-31T12:17:32.524 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369578.log 2024-01-31T12:17:32.526 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.408560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305199.log 2024-01-31T12:17:32.528 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.369578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328146.log 2024-01-31T12:17:32.530 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.305199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494392.log 2024-01-31T12:17:32.534 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.328146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459828.log 2024-01-31T12:17:32.534 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.224604.log.gz 2024-01-31T12:17:32.534 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308454.log 2024-01-31T12:17:32.536 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.459828.log: /var/log/ceph/ceph-client.admin.494392.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.226227.log.gz 2024-01-31T12:17:32.537 INFO:teuthology.orchestra.run.smithi049.stderr: 77.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.494392.log.gz --verbose -- /var/log/ceph/ceph-client.admin.94969.log 2024-01-31T12:17:32.537 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-31T12:17:32.538 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406819.log 2024-01-31T12:17:32.540 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.308454.log: /var/log/ceph/ceph-client.admin.94969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306012.log 2024-01-31T12:17:32.542 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.406819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378567.log 2024-01-31T12:17:32.544 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.306012.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-01-31T12:17:32.546 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.378567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380582.log 2024-01-31T12:17:32.548 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197611.log 2024-01-31T12:17:32.550 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.380582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437193.log 2024-01-31T12:17:32.553 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.197611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375286.log 2024-01-31T12:17:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487175.log 2024-01-31T12:17:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.437193.log: /var/log/ceph/ceph-client.admin.375286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465468.log 2024-01-31T12:17:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.487175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204065.log 2024-01-31T12:17:32.563 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.465468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347358.log 2024-01-31T12:17:32.565 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471896.log 2024-01-31T12:17:32.567 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.347358.log: /var/log/ceph/ceph-client.admin.204065.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35461.log.gz 2024-01-31T12:17:32.567 INFO:teuthology.orchestra.run.smithi049.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.487175.log.gz 2024-01-31T12:17:32.568 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35513.log.gz 2024-01-31T12:17:32.568 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305611.log 2024-01-31T12:17:32.570 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.471896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496424.log 2024-01-31T12:17:32.572 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405205.log 2024-01-31T12:17:32.573 INFO:teuthology.orchestra.run.smithi049.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.471896.log.gz 2024-01-31T12:17:32.573 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.305611.log: /var/log/ceph/ceph-client.admin.496424.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36351.log.gz 2024-01-31T12:17:32.574 INFO:teuthology.orchestra.run.smithi049.stderr: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.496424.log.gz -5 2024-01-31T12:17:32.574 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.484199.log 2024-01-31T12:17:32.575 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.83179.log.gz 2024-01-31T12:17:32.575 INFO:teuthology.orchestra.run.smithi049.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.229050.log.gz 2024-01-31T12:17:32.575 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.405205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423475.log 2024-01-31T12:17:32.576 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.484199.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.82786.log.gz 2024-01-31T12:17:32.579 INFO:teuthology.orchestra.run.smithi049.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.484199.log.gz 2024-01-31T12:17:32.579 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165418.log 2024-01-31T12:17:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.423475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400897.log 2024-01-31T12:17:32.581 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.165418.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.369578.log.gz 2024-01-31T12:17:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314070.log 2024-01-31T12:17:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.400897.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.405205.log.gz 2024-01-31T12:17:32.585 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.316136.log.gz 2024-01-31T12:17:32.586 INFO:teuthology.orchestra.run.smithi049.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.428854.log.gz 2024-01-31T12:17:32.587 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33921.log 2024-01-31T12:17:32.589 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.314070.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.400897.log.gz 2024-01-31T12:17:32.590 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232730.log 2024-01-31T12:17:32.592 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470178.log 2024-01-31T12:17:32.593 INFO:teuthology.orchestra.run.smithi049.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.381811.log.gz 2024-01-31T12:17:32.593 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0%/var/log/ceph/ceph-client.admin.232730.log: -- replaced with /var/log/ceph/ceph.log.gz 2024-01-31T12:17:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222929.log 2024-01-31T12:17:32.595 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.470178.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.470178.log.gz 2024-01-31T12:17:32.595 INFO:teuthology.orchestra.run.smithi049.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.203249.log.gz 2024-01-31T12:17:32.596 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296684.log 2024-01-31T12:17:32.599 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.222929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157809.log 2024-01-31T12:17:32.600 INFO:teuthology.orchestra.run.smithi049.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.324135.log.gz 2024-01-31T12:17:32.601 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.296684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208157.log 2024-01-31T12:17:32.604 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.157809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76580.log 2024-01-31T12:17:32.604 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.377753.log.gz 2024-01-31T12:17:32.604 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.208157.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.306012.log.gz 2024-01-31T12:17:32.605 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.347358.log.gz 2024-01-31T12:17:32.606 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460642.log 2024-01-31T12:17:32.607 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.406014.log.gz 2024-01-31T12:17:32.608 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467090.log 2024-01-31T12:17:32.610 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.460642.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.434737.log.gz 2024-01-31T12:17:32.611 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473630.log 2024-01-31T12:17:32.613 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.467090.log: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.165007.log.gz 2024-01-31T12:17:32.613 INFO:teuthology.orchestra.run.smithi049.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.222929.log.gz 2024-01-31T12:17:32.614 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91663.log 2024-01-31T12:17:32.617 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.473630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319501.log 2024-01-31T12:17:32.618 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.91663.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.225816.log.gz 2024-01-31T12:17:32.620 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152850.log 2024-01-31T12:17:32.622 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35909.log 2024-01-31T12:17:32.622 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.152850.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.183096.log.gz 2024-01-31T12:17:32.624 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.319501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493565.log 2024-01-31T12:17:32.625 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35909.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.197200.log.gz 2024-01-31T12:17:32.626 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34082.log 2024-01-31T12:17:32.627 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.493565.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.197209.log.gz 2024-01-31T12:17:32.627 INFO:teuthology.orchestra.run.smithi049.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.493565.log.gz 2024-01-31T12:17:32.629 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477312.log 2024-01-31T12:17:32.629 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.201093.log.gz 2024-01-31T12:17:32.631 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240937.log 2024-01-31T12:17:32.634 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34082.log: /var/log/ceph/ceph-client.admin.477312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37057.log 2024-01-31T12:17:32.636 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.240937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485900.log 2024-01-31T12:17:32.639 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.37057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354659.log 2024-01-31T12:17:32.644 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.485900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34114.log 2024-01-31T12:17:32.644 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171372.log 2024-01-31T12:17:32.646 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34114.log: /var/log/ceph/ceph-client.admin.354659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231488.log 2024-01-31T12:17:32.647 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.171372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427158.log 2024-01-31T12:17:32.649 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.231488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100621.log 2024-01-31T12:17:32.650 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.427158.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.485900.log.gz 2024-01-31T12:17:32.650 INFO:teuthology.orchestra.run.smithi049.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.231497.log.gz 2024-01-31T12:17:32.651 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251050.log 2024-01-31T12:17:32.651 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.100621.log: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.211447.log.gz 2024-01-31T12:17:32.652 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367933.log 2024-01-31T12:17:32.653 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.251050.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.167057.log.gz 2024-01-31T12:17:32.654 INFO:teuthology.orchestra.run.smithi049.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.166655.log.gz 2024-01-31T12:17:32.654 INFO:teuthology.orchestra.run.smithi049.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.166213.log.gz 2024-01-31T12:17:32.655 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198004.log 2024-01-31T12:17:32.657 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128875.log 2024-01-31T12:17:32.659 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.367933.log: /var/log/ceph/ceph-client.admin.198004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125988.log 2024-01-31T12:17:32.662 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.128875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496354.log 2024-01-31T12:17:32.664 INFO:teuthology.orchestra.run.smithi049.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34114.log.gz 2024-01-31T12:17:32.665 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.125988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31464.log 2024-01-31T12:17:32.666 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496354.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.496354.log.gz 2024-01-31T12:17:32.668 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432713.log 2024-01-31T12:17:32.670 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496659.log 2024-01-31T12:17:32.672 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.432713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240108.log 2024-01-31T12:17:32.672 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496659.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.496659.log.gz 2024-01-31T12:17:32.674 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452445.log 2024-01-31T12:17:32.677 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.240108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403110.log 2024-01-31T12:17:32.679 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292110.log 2024-01-31T12:17:32.682 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.452445.log: /var/log/ceph/ceph-client.admin.403110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285939.log 2024-01-31T12:17:32.683 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468723.log 2024-01-31T12:17:32.685 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.292110.log: /var/log/ceph/ceph-client.admin.285939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172242.log 2024-01-31T12:17:32.686 INFO:teuthology.orchestra.run.smithi049.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.76580.log.gz 2024-01-31T12:17:32.686 INFO:teuthology.orchestra.run.smithi049.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.94969.log.gz 2024-01-31T12:17:32.688 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383349.log 2024-01-31T12:17:32.689 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.468723.log: /var/log/ceph/ceph-client.admin.172242.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.357538.log.gz 2024-01-31T12:17:32.690 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.100621.log.gz 2024-01-31T12:17:32.690 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397625.log 2024-01-31T12:17:32.692 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.416731.log.gz 2024-01-31T12:17:32.692 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.357547.log.gz 2024-01-31T12:17:32.693 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.383349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160414.log 2024-01-31T12:17:32.696 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.397625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249401.log 2024-01-31T12:17:32.698 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34273.log 2024-01-31T12:17:32.699 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.160414.log: /var/log/ceph/ceph-client.admin.249401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134152.log 2024-01-31T12:17:32.701 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287558.log 2024-01-31T12:17:32.703 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369587.log 2024-01-31T12:17:32.705 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.134152.log: /var/log/ceph/ceph-client.admin.287558.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35223.log.gz 2024-01-31T12:17:32.706 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354650.log 2024-01-31T12:17:32.708 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284728.log 2024-01-31T12:17:32.708 INFO:teuthology.orchestra.run.smithi049.stderr: 89.3%/var/log/ceph/ceph-client.admin.369587.log: -- replaced with /var/log/ceph/ceph-client.admin.35909.log.gz 2024-01-31T12:17:32.710 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.354650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214062.log 2024-01-31T12:17:32.712 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.284728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388506.log 2024-01-31T12:17:32.713 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.214062.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.173104.log.gz 2024-01-31T12:17:32.714 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478768.log 2024-01-31T12:17:32.715 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.388506.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32648.log.gz 2024-01-31T12:17:32.715 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90420.log 2024-01-31T12:17:32.716 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.478768.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.231488.log.gz 2024-01-31T12:17:32.717 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.478768.log.gz 2024-01-31T12:17:32.719 INFO:teuthology.orchestra.run.smithi049.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.232730.log.gz 2024-01-31T12:17:32.719 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233638.log 2024-01-31T12:17:32.719 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.304402.log.gz 2024-01-31T12:17:32.719 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.366687.log.gz 2024-01-31T12:17:32.720 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31464.log.gz 2024-01-31T12:17:32.720 INFO:teuthology.orchestra.run.smithi049.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.388506.log.gz 2024-01-31T12:17:32.721 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294629.log 2024-01-31T12:17:32.723 INFO:teuthology.orchestra.run.smithi049.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.460642.log.gz 2024-01-31T12:17:32.724 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.233638.log: /var/log/ceph/ceph-client.admin.32860.log 2024-01-31T12:17:32.724 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.294629.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.125988.log.gz 2024-01-31T12:17:32.726 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27107.log 2024-01-31T12:17:32.726 INFO:teuthology.orchestra.run.smithi049.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.329109.log.gz 2024-01-31T12:17:32.728 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.34012.log 2024-01-31T12:17:32.728 INFO:teuthology.orchestra.run.smithi049.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.397625.log.gz 2024-01-31T12:17:32.729 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314527.log 2024-01-31T12:17:32.730 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1%/var/log/ceph/ceph-client.2.34012.log: -- replaced with /var/log/ceph/ceph-client.admin.362883.log.gz 2024-01-31T12:17:32.731 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27107.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.296684.log.gz 2024-01-31T12:17:32.731 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410221.log 2024-01-31T12:17:32.733 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.314527.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.325873.log.gz 2024-01-31T12:17:32.734 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162101.log 2024-01-31T12:17:32.735 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.305611.log.gz 2024-01-31T12:17:32.736 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.410221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415795.log 2024-01-31T12:17:32.737 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79163.log 2024-01-31T12:17:32.739 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.415795.log: /var/log/ceph/ceph-client.admin.162101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369986.log 2024-01-31T12:17:32.741 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436363.log 2024-01-31T12:17:32.743 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.369986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440700.log 2024-01-31T12:17:32.743 INFO:teuthology.orchestra.run.smithi049.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.467090.log.gz 2024-01-31T12:17:32.745 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.436363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405603.log 2024-01-31T12:17:32.747 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32656.log 2024-01-31T12:17:32.748 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.405603.log: /var/log/ceph/ceph-client.admin.440700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459837.log 2024-01-31T12:17:32.750 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325402.log 2024-01-31T12:17:32.752 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.459837.log: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.187655.log.gz 2024-01-31T12:17:32.753 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185934.log 2024-01-31T12:17:32.754 INFO:teuthology.orchestra.run.smithi049.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.179477.log.gz 2024-01-31T12:17:32.755 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83992.log 2024-01-31T12:17:32.756 INFO:teuthology.orchestra.run.smithi049.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.135044.log.gz 2024-01-31T12:17:32.756 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.325402.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.198004.log.gz 2024-01-31T12:17:32.757 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.185934.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.251050.log.gz 2024-01-31T12:17:32.758 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208569.log 2024-01-31T12:17:32.759 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174386.log 2024-01-31T12:17:32.762 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.208569.log: /var/log/ceph/ceph-client.admin.83992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198441.log 2024-01-31T12:17:32.763 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129680.log 2024-01-31T12:17:32.767 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.198441.log: /var/log/ceph/ceph-client.admin.174386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350740.log 2024-01-31T12:17:32.767 INFO:teuthology.orchestra.run.smithi049.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.461852.log.gz 2024-01-31T12:17:32.767 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430124.log 2024-01-31T12:17:32.770 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129680.log: /var/log/ceph/ceph-client.admin.350740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330495.log 2024-01-31T12:17:32.772 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.430124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351163.log 2024-01-31T12:17:32.774 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312191.log 2024-01-31T12:17:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.330495.log: /var/log/ceph/ceph-client.admin.351163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92468.log 2024-01-31T12:17:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93670.log 2024-01-31T12:17:32.782 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.92468.log: /var/log/ceph/ceph-client.admin.312191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417683.log 2024-01-31T12:17:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37083.log 2024-01-31T12:17:32.786 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.417683.log: /var/log/ceph/ceph-client.admin.93670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36676.log 2024-01-31T12:17:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241340.log 2024-01-31T12:17:32.791 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.37083.log: /var/log/ceph/ceph-client.admin.36676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31742.log 2024-01-31T12:17:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27210.log 2024-01-31T12:17:32.795 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.241340.log: /var/log/ceph/ceph-client.admin.31742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207361.log 2024-01-31T12:17:32.798 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.27210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36888.log 2024-01-31T12:17:32.800 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235648.log 2024-01-31T12:17:32.801 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.207361.log: /var/log/ceph/ceph-client.admin.36888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186786.log 2024-01-31T12:17:32.802 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.235648.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.415795.log.gz 2024-01-31T12:17:32.803 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.356297.log.gz 2024-01-31T12:17:32.804 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36169.log 2024-01-31T12:17:32.806 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418096.log 2024-01-31T12:17:32.807 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36169.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.369587.log.gz 2024-01-31T12:17:32.808 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.186786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388394.log 2024-01-31T12:17:32.811 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.418096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98194.log 2024-01-31T12:17:32.814 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.388394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403101.log 2024-01-31T12:17:32.815 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386022.log 2024-01-31T12:17:32.818 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98194.log: /var/log/ceph/ceph-client.admin.403101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486741.log 2024-01-31T12:17:32.818 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36169.log.gz 2024-01-31T12:17:32.821 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.386022.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31306.log.gz 2024-01-31T12:17:32.822 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27107.log.gz 2024-01-31T12:17:32.822 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368769.log 2024-01-31T12:17:32.822 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31386.log.gz 2024-01-31T12:17:32.823 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36676.log.gz 2024-01-31T12:17:32.823 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.410633.log.gz 2024-01-31T12:17:32.823 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36888.log.gz 2024-01-31T12:17:32.825 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.486741.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.107298.log.gz 2024-01-31T12:17:32.825 INFO:teuthology.orchestra.run.smithi049.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.90420.log.gz 2024-01-31T12:17:32.826 INFO:teuthology.orchestra.run.smithi049.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.486741.log.gz 2024-01-31T12:17:32.826 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496867.log 2024-01-31T12:17:32.827 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.368769.log: 91.4% -- replaced with /var/log/ceph/ceph-client.2.34012.log.gz 2024-01-31T12:17:32.829 INFO:teuthology.orchestra.run.smithi049.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.325402.log.gz 2024-01-31T12:17:32.829 INFO:teuthology.orchestra.run.smithi049.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.477312.log.gz 2024-01-31T12:17:32.829 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.196803.log.gz 2024-01-31T12:17:32.829 INFO:teuthology.orchestra.run.smithi049.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.363630.log.gz 2024-01-31T12:17:32.830 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.368769.log.gz 2024-01-31T12:17:32.830 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193136.log 2024-01-31T12:17:32.830 INFO:teuthology.orchestra.run.smithi049.stderr: 77.5% 78.6% -- replaced with /var/log/ceph/ceph-client.admin.236845.log.gz 2024-01-31T12:17:32.830 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.369986.log.gz 2024-01-31T12:17:32.831 INFO:teuthology.orchestra.run.smithi049.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.385207.log.gz 2024-01-31T12:17:32.831 INFO:teuthology.orchestra.run.smithi049.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.386022.log.gz 2024-01-31T12:17:32.831 INFO:teuthology.orchestra.run.smithi049.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35114.log.gz 2024-01-31T12:17:32.832 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496606.log 2024-01-31T12:17:32.833 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.193136.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.496867.log.gz 2024-01-31T12:17:32.835 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.417683.log.gz 2024-01-31T12:17:32.835 INFO:teuthology.orchestra.run.smithi049.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.418096.log.gz 2024-01-31T12:17:32.835 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327651.log 2024-01-31T12:17:32.837 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234040.log 2024-01-31T12:17:32.838 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313133.log 2024-01-31T12:17:32.839 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.234040.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.496606.log.gz/var/log/ceph/ceph-client.admin.327651.log: 2024-01-31T12:17:32.841 INFO:teuthology.orchestra.run.smithi049.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.459828.log.gz 2024-01-31T12:17:32.842 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443955.log 2024-01-31T12:17:32.843 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.313133.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.436363.log.gz 2024-01-31T12:17:32.844 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95779.log 2024-01-31T12:17:32.844 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.443955.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.438440.log.gz 2024-01-31T12:17:32.846 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377344.log 2024-01-31T12:17:32.847 INFO:teuthology.orchestra.run.smithi049.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.172242.log.gz 2024-01-31T12:17:32.847 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.347367.log.gz 2024-01-31T12:17:32.849 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251059.log 2024-01-31T12:17:32.850 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.234040.log.gz 2024-01-31T12:17:32.851 INFO:teuthology.orchestra.run.smithi049.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.226218.log.gz 2024-01-31T12:17:32.851 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.207361.log.gz 2024-01-31T12:17:32.852 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.207763.log.gz 2024-01-31T12:17:32.852 INFO:teuthology.orchestra.run.smithi049.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.403101.log.gz 2024-01-31T12:17:32.853 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.377344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169684.log 2024-01-31T12:17:32.853 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.197611.log.gz 2024-01-31T12:17:32.854 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.251059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377744.log 2024-01-31T12:17:32.857 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.169684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414365.log 2024-01-31T12:17:32.860 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.377744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477321.log 2024-01-31T12:17:32.861 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303129.log 2024-01-31T12:17:32.864 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.414365.log: /var/log/ceph/ceph-client.admin.477321.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32644.log.gz 2024-01-31T12:17:32.864 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357109.log 2024-01-31T12:17:32.865 INFO:teuthology.orchestra.run.smithi049.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32860.log.gz 2024-01-31T12:17:32.866 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.303129.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32859.log.gz 2024-01-31T12:17:32.868 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380573.log 2024-01-31T12:17:32.869 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477527.log 2024-01-31T12:17:32.872 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.357109.log: /var/log/ceph/ceph-client.admin.380573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32652.log 2024-01-31T12:17:32.873 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22183.log 2024-01-31T12:17:32.874 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.477527.log: /var/log/ceph/ceph-client.admin.32652.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.477527.log.gz 2024-01-31T12:17:32.876 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75676.log 2024-01-31T12:17:32.879 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.tmp-client.admin.22183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301904.log 2024-01-31T12:17:32.879 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22183.log.gz 2024-01-31T12:17:32.881 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293739.log 2024-01-31T12:17:32.882 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75676.log: /var/log/ceph/ceph-client.admin.301904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32638.log 2024-01-31T12:17:32.885 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.293739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163005.log 2024-01-31T12:17:32.888 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464260.log 2024-01-31T12:17:32.889 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79624.log 2024-01-31T12:17:32.892 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.163005.log: /var/log/ceph/ceph-client.admin.464260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219407.log 2024-01-31T12:17:32.895 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370825.log 2024-01-31T12:17:32.898 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.219407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466678.log 2024-01-31T12:17:32.899 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363894.log 2024-01-31T12:17:32.902 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.370825.log: /var/log/ceph/ceph-client.admin.466678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194784.log 2024-01-31T12:17:32.905 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.363894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379769.log 2024-01-31T12:17:32.905 INFO:teuthology.orchestra.run.smithi049.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.354650.log.gz 2024-01-31T12:17:32.906 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.182301.log.gz 2024-01-31T12:17:32.907 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.194784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441504.log 2024-01-31T12:17:32.911 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.379769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301100.log 2024-01-31T12:17:32.913 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.441504.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33921.log.gz 2024-01-31T12:17:32.913 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319510.log 2024-01-31T12:17:32.916 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.301100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308039.log 2024-01-31T12:17:32.917 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412277.log 2024-01-31T12:17:32.920 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.308039.log: /var/log/ceph/ceph-client.admin.319510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485475.log 2024-01-31T12:17:32.922 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406005.log 2024-01-31T12:17:32.925 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.485475.log: /var/log/ceph/ceph-client.admin.412277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496554.log 2024-01-31T12:17:32.925 INFO:teuthology.orchestra.run.smithi049.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.485475.log.gz 2024-01-31T12:17:32.927 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.406005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412286.log 2024-01-31T12:17:32.927 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496554.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.496554.log.gz 2024-01-31T12:17:32.929 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172233.log 2024-01-31T12:17:32.931 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.412286.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.75676.log.gz 2024-01-31T12:17:32.932 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35539.log 2024-01-31T12:17:32.934 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.172233.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.374879.log.gz 2024-01-31T12:17:32.935 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410230.log 2024-01-31T12:17:32.935 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.377744.log.gz 2024-01-31T12:17:32.937 INFO:teuthology.orchestra.run.smithi049.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.375286.log.gz 2024-01-31T12:17:32.937 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32050.log 2024-01-31T12:17:32.938 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.410230.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.377344.log.gz 2024-01-31T12:17:32.940 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234433.log 2024-01-31T12:17:32.942 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176545.log 2024-01-31T12:17:32.944 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.234433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380171.log 2024-01-31T12:17:32.945 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.465468.log.gz 2024-01-31T12:17:32.946 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34741.log 2024-01-31T12:17:32.949 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.176545.log: /var/log/ceph/ceph-client.admin.380171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327660.log 2024-01-31T12:17:32.949 INFO:teuthology.orchestra.run.smithi049.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.414365.log.gz 2024-01-31T12:17:32.951 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487166.log 2024-01-31T12:17:32.954 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.327660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380180.log 2024-01-31T12:17:32.956 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.487166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323726.log 2024-01-31T12:17:32.957 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.380180.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.487166.log.gz 2024-01-31T12:17:32.958 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317390.log 2024-01-31T12:17:32.960 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.323726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361220.log 2024-01-31T12:17:32.964 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.317390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281077.log 2024-01-31T12:17:32.966 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.361220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87517.log 2024-01-31T12:17:32.969 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.281077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479171.log 2024-01-31T12:17:32.970 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493961.log 2024-01-31T12:17:32.972 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.479171.log: /var/log/ceph/ceph-client.admin.87517.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.479171.log.gz 2024-01-31T12:17:32.973 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496685.log 2024-01-31T12:17:32.975 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98203.log 2024-01-31T12:17:32.976 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496685.log: /var/log/ceph/ceph-client.admin.493961.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.496685.log.gz 2024-01-31T12:17:32.977 INFO:teuthology.orchestra.run.smithi049.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.493961.log.gz 2024-01-31T12:17:32.979 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34827.log 2024-01-31T12:17:32.980 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101835.log 2024-01-31T12:17:32.983 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.98203.log: /var/log/ceph/ceph-client.admin.34827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32311.log 2024-01-31T12:17:32.986 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.101835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199345.log 2024-01-31T12:17:32.988 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360386.log 2024-01-31T12:17:32.989 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32311.log: /var/log/ceph/ceph-client.admin.199345.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.285930.log.gz 2024-01-31T12:17:32.990 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93679.log 2024-01-31T12:17:32.990 INFO:teuthology.orchestra.run.smithi049.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.234433.log.gz 2024-01-31T12:17:32.991 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.360386.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.165820.log.gz 2024-01-31T12:17:32.992 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179075.log 2024-01-31T12:17:32.995 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227847.log 2024-01-31T12:17:32.997 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.93679.log: /var/log/ceph/ceph-client.admin.179075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228643.log 2024-01-31T12:17:32.999 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.227847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362874.log 2024-01-31T12:17:33.001 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.228643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496127.log 2024-01-31T12:17:33.003 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.362874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230683.log 2024-01-31T12:17:33.004 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496127.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.496127.log.gz 2024-01-31T12:17:33.006 INFO:teuthology.orchestra.run.smithi049.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.109798.log.gz 2024-01-31T12:17:33.006 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32154.log 2024-01-31T12:17:33.006 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175676.log 2024-01-31T12:17:33.008 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.230683.log: /var/log/ceph/ceph-client.admin.32154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34481.log 2024-01-31T12:17:33.010 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326701.log 2024-01-31T12:17:33.012 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34481.log: /var/log/ceph/ceph-client.admin.175676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227037.log 2024-01-31T12:17:33.013 INFO:teuthology.orchestra.run.smithi049.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.468732.log.gz 2024-01-31T12:17:33.015 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.326701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438851.log 2024-01-31T12:17:33.017 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.227037.log: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.177406.log.gz 2024-01-31T12:17:33.018 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.194784.log.gz 2024-01-31T12:17:33.018 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249410.log 2024-01-31T12:17:33.019 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296675.log 2024-01-31T12:17:33.020 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.379769.log.gz 2024-01-31T12:17:33.022 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.438851.log: /var/log/ceph/ceph-client.admin.249410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319912.log 2024-01-31T12:17:33.023 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349064.log 2024-01-31T12:17:33.025 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.319912.log: /var/log/ceph/ceph-client.admin.296675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195597.log 2024-01-31T12:17:33.027 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.349064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193931.log 2024-01-31T12:17:33.029 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.195597.log: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.363591.log.gz 2024-01-31T12:17:33.030 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368360.log 2024-01-31T12:17:33.033 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.193931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298681.log 2024-01-31T12:17:33.034 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.222133.log.gz 2024-01-31T12:17:33.035 INFO:teuthology.orchestra.run.smithi049.stderr:gzip/var/log/ceph/ceph-client.admin.368360.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.285121.log 2024-01-31T12:17:33.037 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.298681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496711.log 2024-01-31T12:17:33.039 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.285121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315331.log 2024-01-31T12:17:33.040 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496711.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.496711.log.gz 2024-01-31T12:17:33.041 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367526.log 2024-01-31T12:17:33.044 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.315331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433118.log 2024-01-31T12:17:33.046 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483338.log 2024-01-31T12:17:33.048 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.433118.log: /var/log/ceph/ceph-client.admin.367526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37031.log 2024-01-31T12:17:33.048 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.483338.log: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.483338.log.gz 2024-01-31T12:17:33.051 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384404.log 2024-01-31T12:17:33.053 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440065.log 2024-01-31T12:17:33.054 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.384404.log: /var/log/ceph/ceph-client.admin.37031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299494.log 2024-01-31T12:17:33.056 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.440065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234844.log 2024-01-31T12:17:33.059 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.299494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298690.log 2024-01-31T12:17:33.059 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.160844.log.gz 2024-01-31T12:17:33.060 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225409.log 2024-01-31T12:17:33.063 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.234844.log: /var/log/ceph/ceph-client.admin.298690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109400.log 2024-01-31T12:17:33.064 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477536.log 2024-01-31T12:17:33.067 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.225409.log: /var/log/ceph/ceph-client.admin.109400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213658.log 2024-01-31T12:17:33.068 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36299.log 2024-01-31T12:17:33.070 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.477536.log: /var/log/ceph/ceph-client.admin.213658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206906.log 2024-01-31T12:17:33.071 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36299.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.477536.log.gz 2024-01-31T12:17:33.071 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294227.log 2024-01-31T12:17:33.073 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.206906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496763.log 2024-01-31T12:17:33.075 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477934.log 2024-01-31T12:17:33.076 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.294227.log: /var/log/ceph/ceph-client.admin.496763.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.496763.log.gz 2024-01-31T12:17:33.077 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237659.log 2024-01-31T12:17:33.079 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477047.log 2024-01-31T12:17:33.080 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.477934.log: /var/log/ceph/ceph-client.admin.237659.log: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.477934.log.gz 2024-01-31T12:17:33.081 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35539.log.gz 2024-01-31T12:17:33.081 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353425.log 2024-01-31T12:17:33.083 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226621.log 2024-01-31T12:17:33.086 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.353425.log: /var/log/ceph/ceph-client.admin.477047.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.477047.log.gz 2024-01-31T12:17:33.087 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372442.log 2024-01-31T12:17:33.087 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36403.log.gz 2024-01-31T12:17:33.088 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288764.log 2024-01-31T12:17:33.091 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.226621.log: /var/log/ceph/ceph-client.admin.372442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376932.log 2024-01-31T12:17:33.092 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31664.log 2024-01-31T12:17:33.095 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.288764.log: /var/log/ceph/ceph-client.admin.376932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242176.log 2024-01-31T12:17:33.098 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31664.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.79615.log.gz 2024-01-31T12:17:33.098 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437647.log 2024-01-31T12:17:33.100 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77897.log 2024-01-31T12:17:33.101 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.242176.log: /var/log/ceph/ceph-client.admin.437647.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.193931.log.gz 2024-01-31T12:17:33.102 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.195597.log.gz 2024-01-31T12:17:33.102 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.195588.log.gz 2024-01-31T12:17:33.103 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402301.log 2024-01-31T12:17:33.104 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32181.log.gz 2024-01-31T12:17:33.105 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32154.log.gz 2024-01-31T12:17:33.106 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209773.log 2024-01-31T12:17:33.107 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.227037.log.gz 2024-01-31T12:17:33.107 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77897.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34481.log.gz 2024-01-31T12:17:33.107 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.402301.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.228643.log.gz 2024-01-31T12:17:33.108 INFO:teuthology.orchestra.run.smithi049.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.242176.log.gz 2024-01-31T12:17:33.108 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.360386.log.gz 2024-01-31T12:17:33.109 INFO:teuthology.orchestra.run.smithi049.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.313133.log.gz 2024-01-31T12:17:33.110 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170114.log 2024-01-31T12:17:33.110 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.380180.log.gz 2024-01-31T12:17:33.110 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.367526.log.gz 2024-01-31T12:17:33.111 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99402.log 2024-01-31T12:17:33.112 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.209773.log: /var/log/ceph/ceph-client.admin.170114.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.440065.log.gz 2024-01-31T12:17:33.114 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301091.log 2024-01-31T12:17:33.116 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300296.log 2024-01-31T12:17:33.118 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2%/var/log/ceph/ceph-client.admin.301091.log: -- replaced with /var/log/ceph/ceph-client.admin.319912.log.gz 2024-01-31T12:17:33.118 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169252.log 2024-01-31T12:17:33.120 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.300296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36834.log 2024-01-31T12:17:33.122 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435545.log 2024-01-31T12:17:33.123 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.169252.log: /var/log/ceph/ceph-client.admin.36834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174395.log 2024-01-31T12:17:33.126 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.435545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32368.log 2024-01-31T12:17:33.130 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.174395.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.237659.log.gz 2024-01-31T12:17:33.130 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94565.log 2024-01-31T12:17:33.133 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105663.log 2024-01-31T12:17:33.135 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.437184.log.gz 2024-01-31T12:17:33.136 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.94565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34351.log 2024-01-31T12:17:33.136 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.438449.log.gz 2024-01-31T12:17:33.139 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.437647.log.gz 2024-01-31T12:17:33.139 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220691.log 2024-01-31T12:17:33.139 INFO:teuthology.orchestra.run.smithi049.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.288764.log.gz 2024-01-31T12:17:33.140 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.105663.log: /var/log/ceph/ceph-client.admin.34351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153650.log 2024-01-31T12:17:33.142 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.220691.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.225409.log.gz 2024-01-31T12:17:33.142 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.173095.log.gz 2024-01-31T12:17:33.143 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238462.log 2024-01-31T12:17:33.144 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.208569.log.gz 2024-01-31T12:17:33.145 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.209369.log.gz 2024-01-31T12:17:33.147 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.153650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447294.log 2024-01-31T12:17:33.148 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.284728.log.gz 2024-01-31T12:17:33.149 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.238462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97388.log 2024-01-31T12:17:33.151 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153248.log 2024-01-31T12:17:33.153 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.447294.log: /var/log/ceph/ceph-client.admin.97388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156488.log 2024-01-31T12:17:33.156 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.153248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399644.log 2024-01-31T12:17:33.157 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462248.log 2024-01-31T12:17:33.160 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.156488.log: /var/log/ceph/ceph-client.admin.399644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290797.log 2024-01-31T12:17:33.161 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34195.log 2024-01-31T12:17:33.163 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.462248.log: /var/log/ceph/ceph-client.admin.290797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95363.log 2024-01-31T12:17:33.164 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486750.log 2024-01-31T12:17:33.167 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95363.log: /var/log/ceph/ceph-client.admin.34195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205699.log 2024-01-31T12:17:33.168 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36273.log 2024-01-31T12:17:33.170 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.486750.log: /var/log/ceph/ceph-client.admin.205699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403961.log 2024-01-31T12:17:33.171 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320314.log 2024-01-31T12:17:33.174 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.403961.log: /var/log/ceph/ceph-client.admin.36273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152841.log 2024-01-31T12:17:33.176 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.320314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390352.log 2024-01-31T12:17:33.178 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.152841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461843.log 2024-01-31T12:17:33.179 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.390352.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.486750.log.gz 2024-01-31T12:17:33.179 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221297.log 2024-01-31T12:17:33.182 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.461843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163875.log 2024-01-31T12:17:33.184 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436766.log 2024-01-31T12:17:33.185 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.221297.log: /var/log/ceph/ceph-client.admin.163875.log: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.95363.log.gz 2024-01-31T12:17:33.186 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282288.log 2024-01-31T12:17:33.188 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.95779.log.gz 2024-01-31T12:17:33.188 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.94565.log.gz 2024-01-31T12:17:33.189 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32844.log 2024-01-31T12:17:33.191 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.436766.log: /var/log/ceph/ceph-client.admin.282288.log: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.100208.log.gz 2024-01-31T12:17:33.192 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285130.log 2024-01-31T12:17:33.194 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32844.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.440700.log.gz 2024-01-31T12:17:33.194 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137483.log 2024-01-31T12:17:33.197 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.285130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109391.log 2024-01-31T12:17:33.199 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36013.log.gz 2024-01-31T12:17:33.199 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.374472.log.gz 2024-01-31T12:17:33.200 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36754.log.gz 2024-01-31T12:17:33.200 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33757.log 2024-01-31T12:17:33.202 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.137483.log: /var/log/ceph/ceph-client.admin.109391.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.216919.log.gz 2024-01-31T12:17:33.202 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.238462.log.gz 2024-01-31T12:17:33.203 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488440.log 2024-01-31T12:17:33.205 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360377.log 2024-01-31T12:17:33.207 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33757.log: /var/log/ceph/ceph-client.admin.488440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496328.log 2024-01-31T12:17:33.208 INFO:teuthology.orchestra.run.smithi049.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.488440.log.gz 2024-01-31T12:17:33.209 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382223.log 2024-01-31T12:17:33.210 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496328.log: /var/log/ceph/ceph-client.admin.360377.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.496328.log.gz 2024-01-31T12:17:33.211 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202847.log 2024-01-31T12:17:33.214 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.382223.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.348647.log.gz 2024-01-31T12:17:33.214 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228250.log 2024-01-31T12:17:33.216 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183500.log 2024-01-31T12:17:33.219 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.202847.log: /var/log/ceph/ceph-client.admin.228250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241349.log 2024-01-31T12:17:33.219 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.402301.log.gz 2024-01-31T12:17:33.222 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.183500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360792.log 2024-01-31T12:17:33.223 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.382223.log.gz 2024-01-31T12:17:33.225 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.241349.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.282288.log.gz 2024-01-31T12:17:33.225 INFO:teuthology.orchestra.run.smithi049.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.473630.log.gz 2024-01-31T12:17:33.225 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35171.log 2024-01-31T12:17:33.227 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.357109.log.gz 2024-01-31T12:17:33.227 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426354.log 2024-01-31T12:17:33.229 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.360792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404395.log 2024-01-31T12:17:33.231 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.426354.log: /var/log/ceph/ceph-client.admin.35171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129278.log 2024-01-31T12:17:33.234 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.404395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384805.log 2024-01-31T12:17:33.236 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.129278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359039.log 2024-01-31T12:17:33.238 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.384805.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.176975.log.gz 2024-01-31T12:17:33.238 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235246.log 2024-01-31T12:17:33.239 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.359039.log: gzip 90.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.441504.log.gz --verbose -- 2024-01-31T12:17:33.239 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.314061.log 2024-01-31T12:17:33.241 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.235246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168813.log 2024-01-31T12:17:33.245 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.314061.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.295844.log.gz 2024-01-31T12:17:33.245 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467483.log 2024-01-31T12:17:33.246 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491896.log 2024-01-31T12:17:33.248 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.168813.log: /var/log/ceph/ceph-client.admin.467483.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.423878.log.gz 2024-01-31T12:17:33.248 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398429.log 2024-01-31T12:17:33.249 INFO:teuthology.orchestra.run.smithi049.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.183500.log.gz 2024-01-31T12:17:33.250 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33064.log 2024-01-31T12:17:33.251 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.491896.log: /var/log/ceph/ceph-client.admin.398429.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.386462.log.gz 2024-01-31T12:17:33.253 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322808.log 2024-01-31T12:17:33.255 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33064.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.169684.log.gz 2024-01-31T12:17:33.256 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300287.log 2024-01-31T12:17:33.256 INFO:teuthology.orchestra.run.smithi049.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.461843.log.gz 2024-01-31T12:17:33.256 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327158.log 2024-01-31T12:17:33.259 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.322808.log: /var/log/ceph/ceph-client.admin.300287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248029.log 2024-01-31T12:17:33.259 INFO:teuthology.orchestra.run.smithi049.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.415318.log.gz 2024-01-31T12:17:33.260 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185518.log 2024-01-31T12:17:33.262 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.248029.log: /var/log/ceph/ceph-client.admin.327158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282297.log 2024-01-31T12:17:33.263 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-31T12:17:33.264 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.185518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104816.log 2024-01-31T12:17:33.267 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.282297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91261.log 2024-01-31T12:17:33.269 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.104816.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.491896.log.gz 2024-01-31T12:17:33.269 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225002.log 2024-01-31T12:17:33.272 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.91261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32394.log 2024-01-31T12:17:33.274 INFO:teuthology.orchestra.run.smithi049.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.153650.log.gz 2024-01-31T12:17:33.276 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.225002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319091.log 2024-01-31T12:17:33.277 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350731.log 2024-01-31T12:17:33.278 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.32394.log: /var/log/ceph/ceph-client.admin.319091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460239.log 2024-01-31T12:17:33.279 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.350731.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.135488.log.gz 2024-01-31T12:17:33.279 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.165418.log.gz 2024-01-31T12:17:33.281 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372845.log 2024-01-31T12:17:33.283 INFO:teuthology.orchestra.run.smithi049.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.168813.log.gz 2024-01-31T12:17:33.284 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.460239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211054.log 2024-01-31T12:17:33.287 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.372845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442705.log 2024-01-31T12:17:33.287 INFO:teuthology.orchestra.run.smithi049.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.310949.log.gz 2024-01-31T12:17:33.288 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235237.log 2024-01-31T12:17:33.290 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.211054.log: /var/log/ceph/ceph-client.admin.442705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250643.log 2024-01-31T12:17:33.292 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.330495.log.gz 2024-01-31T12:17:33.295 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.235237.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.425952.log.gz 2024-01-31T12:17:33.295 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34299.log 2024-01-31T12:17:33.296 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.250643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418105.log 2024-01-31T12:17:33.298 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36065.log 2024-01-31T12:17:33.300 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34299.log: /var/log/ceph/ceph-client.admin.418105.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.327651.log.gz 2024-01-31T12:17:33.301 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424750.log 2024-01-31T12:17:33.301 INFO:teuthology.orchestra.run.smithi049.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.327158.log.gz 2024-01-31T12:17:33.302 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.167553.log.gz 2024-01-31T12:17:33.303 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.36065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368369.log 2024-01-31T12:17:33.306 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.424750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413145.log 2024-01-31T12:17:33.308 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.368369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297888.log 2024-01-31T12:17:33.310 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.413145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496789.log 2024-01-31T12:17:33.311 INFO:teuthology.orchestra.run.smithi049.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35171.log.gz 2024-01-31T12:17:33.313 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.297888.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36065.log.gz 2024-01-31T12:17:33.313 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304805.log 2024-01-31T12:17:33.314 INFO:teuthology.orchestra.run.smithi049.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33757.log.gz 2024-01-31T12:17:33.316 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.496789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191325.log 2024-01-31T12:17:33.316 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.496789.log.gz 2024-01-31T12:17:33.318 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190119.log 2024-01-31T12:17:33.320 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.191325.log: /var/log/ceph/ceph-client.admin.304805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95372.log 2024-01-31T12:17:33.321 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.99402.log.gz 2024-01-31T12:17:33.322 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.190119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195990.log 2024-01-31T12:17:33.323 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.95372.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.371629.log.gz 2024-01-31T12:17:33.325 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173956.log 2024-01-31T12:17:33.326 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.91663.log.gz 2024-01-31T12:17:33.327 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.351163.log.gz 2024-01-31T12:17:33.327 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.372845.log.gz 2024-01-31T12:17:33.327 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136776.log 2024-01-31T12:17:33.328 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.195990.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.304805.log.gz 2024-01-31T12:17:33.329 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.173956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316145.log 2024-01-31T12:17:33.331 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.136776.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.248029.log.gz 2024-01-31T12:17:33.332 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438048.log 2024-01-31T12:17:33.333 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.241349.log.gz 2024-01-31T12:17:33.333 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.319091.log.gz 2024-01-31T12:17:33.334 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.316145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289180.log 2024-01-31T12:17:33.334 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34082.log.gz 2024-01-31T12:17:33.336 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.438048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226630.log 2024-01-31T12:17:33.337 INFO:teuthology.orchestra.run.smithi049.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.460239.log.gz 2024-01-31T12:17:33.337 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96592.log 2024-01-31T12:17:33.339 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.289180.log: /var/log/ceph/ceph-client.admin.226630.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.398429.log.gz 2024-01-31T12:17:33.339 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31768.log 2024-01-31T12:17:33.339 INFO:teuthology.orchestra.run.smithi049.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.388099.log.gz 2024-01-31T12:17:33.341 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.96592.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33064.log.gz 2024-01-31T12:17:33.342 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349926.log 2024-01-31T12:17:33.344 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31768.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.438048.log.gz 2024-01-31T12:17:33.344 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229462.log 2024-01-31T12:17:33.345 INFO:teuthology.orchestra.run.smithi049.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.467483.log.gz 2024-01-31T12:17:33.345 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208560.log 2024-01-31T12:17:33.347 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.229462.log: /var/log/ceph/ceph-client.admin.349926.log: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.329118.log.gz 2024-01-31T12:17:33.348 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412679.log 2024-01-31T12:17:33.350 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.208560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81282.log 2024-01-31T12:17:33.350 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.289180.log.gz 2024-01-31T12:17:33.353 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.412679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163014.log 2024-01-31T12:17:33.355 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476165.log 2024-01-31T12:17:33.357 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81282.log: /var/log/ceph/ceph-client.admin.163014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93272.log 2024-01-31T12:17:33.360 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.476165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77480.log 2024-01-31T12:17:33.361 INFO:teuthology.orchestra.run.smithi049.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.476165.log.gz 2024-01-31T12:17:33.363 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.93272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434728.log 2024-01-31T12:17:33.363 INFO:teuthology.orchestra.run.smithi049.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.314061.log.gz 2024-01-31T12:17:33.365 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77480.log: gzip -5 --verbose -- 85.3% /var/log/ceph/ceph-client.admin.210613.log -- replaced with /var/log/ceph/ceph-client.admin.185518.log.gz 2024-01-31T12:17:33.365 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-31T12:17:33.366 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.208560.log.gz 2024-01-31T12:17:33.367 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.173956.log.gz 2024-01-31T12:17:33.368 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.424750.log.gz 2024-01-31T12:17:33.368 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214053.log 2024-01-31T12:17:33.369 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.434728.log: /var/log/ceph/ceph-client.admin.210613.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.134152.log.gz 2024-01-31T12:17:33.370 INFO:teuthology.orchestra.run.smithi049.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.250643.log.gz 2024-01-31T12:17:33.371 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.129278.log.gz 2024-01-31T12:17:33.371 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.287558.log.gz 2024-01-31T12:17:33.371 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211045.log 2024-01-31T12:17:33.373 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.214053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424741.log 2024-01-31T12:17:33.376 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.211045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410624.log 2024-01-31T12:17:33.379 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.424741.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.297888.log.gz 2024-01-31T12:17:33.379 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324126.log 2024-01-31T12:17:33.381 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156918.log 2024-01-31T12:17:33.381 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.310961.log.gz 2024-01-31T12:17:33.382 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.410624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174825.log 2024-01-31T12:17:33.383 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.324126.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.152850.log.gz 2024-01-31T12:17:33.385 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.156918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416254.log 2024-01-31T12:17:33.386 INFO:teuthology.orchestra.run.smithi049.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.191325.log.gz 2024-01-31T12:17:33.388 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.174825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471025.log 2024-01-31T12:17:33.390 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.416254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32550.log 2024-01-31T12:17:33.390 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.235648.log.gz 2024-01-31T12:17:33.392 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443547.log 2024-01-31T12:17:33.394 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.471025.log: /var/log/ceph/ceph-client.admin.32550.log: gzip 81.2% -- replaced with /var/log/ceph/ceph-client.admin.170535.log.gz 2024-01-31T12:17:33.394 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.155277.log 2024-01-31T12:17:33.395 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179888.log 2024-01-31T12:17:33.398 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.443547.log: /var/log/ceph/ceph-client.admin.155277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370419.log 2024-01-31T12:17:33.399 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.136776.log.gz 2024-01-31T12:17:33.400 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106075.log 2024-01-31T12:17:33.401 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.179888.log: /var/log/ceph/ceph-client.admin.370419.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.296675.log.gz 2024-01-31T12:17:33.402 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204056.log 2024-01-31T12:17:33.402 INFO:teuthology.orchestra.run.smithi049.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.172233.log.gz 2024-01-31T12:17:33.403 INFO:teuthology.orchestra.run.smithi049.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.471025.log.gz 2024-01-31T12:17:33.403 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.301091.log.gz 2024-01-31T12:17:33.403 INFO:teuthology.orchestra.run.smithi049.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.220691.log.gz 2024-01-31T12:17:33.405 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6%/var/log/ceph/ceph-client.admin.106075.log: -- replaced with /var/log/ceph/ceph-client.admin.81282.log.gz 2024-01-31T12:17:33.405 INFO:teuthology.orchestra.run.smithi049.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.440691.log.gz 2024-01-31T12:17:33.405 INFO:teuthology.orchestra.run.smithi049.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.96592.log.gz 2024-01-31T12:17:33.406 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374057.log 2024-01-31T12:17:33.406 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.416254.log.gz 2024-01-31T12:17:33.406 INFO:teuthology.orchestra.run.smithi049.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.417124.log.gz 2024-01-31T12:17:33.407 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.204056.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.405603.log.gz 2024-01-31T12:17:33.407 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289581.log 2024-01-31T12:17:33.408 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37002.log.gz 2024-01-31T12:17:33.409 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.374057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359931.log 2024-01-31T12:17:33.412 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.289581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297076.log 2024-01-31T12:17:33.412 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32076.log.gz 2024-01-31T12:17:33.413 INFO:teuthology.orchestra.run.smithi049.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36808.log.gz 2024-01-31T12:17:33.414 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.359931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478344.log 2024-01-31T12:17:33.415 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.106075.log.gz 2024-01-31T12:17:33.415 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.297076.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.295835.log.gz 2024-01-31T12:17:33.416 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.229462.log.gz 2024-01-31T12:17:33.417 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288366.log 2024-01-31T12:17:33.418 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.226630.log.gz 2024-01-31T12:17:33.418 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.195990.log.gz 2024-01-31T12:17:33.419 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35010.log 2024-01-31T12:17:33.420 INFO:teuthology.orchestra.run.smithi049.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.78309.log.gz 2024-01-31T12:17:33.421 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.478344.log: /var/log/ceph/ceph-client.admin.288366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230267.log 2024-01-31T12:17:33.421 INFO:teuthology.orchestra.run.smithi049.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.478344.log.gz 2024-01-31T12:17:33.423 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398027.log 2024-01-31T12:17:33.424 INFO:teuthology.orchestra.run.smithi049.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.370419.log.gz 2024-01-31T12:17:33.424 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99000.log 2024-01-31T12:17:33.425 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.398027.log: /var/log/ceph/ceph-client.admin.230267.log: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.290374.log.gz 2024-01-31T12:17:33.426 INFO:teuthology.orchestra.run.smithi049.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.297076.log.gz 2024-01-31T12:17:33.427 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35696.log 2024-01-31T12:17:33.429 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.99000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176966.log 2024-01-31T12:17:33.430 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.314070.log.gz 2024-01-31T12:17:33.431 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161676.log 2024-01-31T12:17:33.431 INFO:teuthology.orchestra.run.smithi049.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.398027.log.gz 2024-01-31T12:17:33.432 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.434728.log.gz 2024-01-31T12:17:33.433 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.176966.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.349926.log.gz 2024-01-31T12:17:33.433 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449796.log 2024-01-31T12:17:33.435 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.161676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156087.log 2024-01-31T12:17:33.436 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31768.log.gz 2024-01-31T12:17:33.438 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.449796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130078.log 2024-01-31T12:17:33.440 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.156087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138143.log 2024-01-31T12:17:33.440 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.424741.log.gz 2024-01-31T12:17:33.442 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.130078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347833.log 2024-01-31T12:17:33.444 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.138143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154861.log 2024-01-31T12:17:33.446 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.347833.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.443547.log.gz 2024-01-31T12:17:33.446 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209782.log 2024-01-31T12:17:33.447 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33618.log 2024-01-31T12:17:33.449 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.209782.log: /var/log/ceph/ceph-client.admin.154861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154468.log 2024-01-31T12:17:33.449 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.412286.log.gz 2024-01-31T12:17:33.451 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.33618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465065.log 2024-01-31T12:17:33.453 INFO:teuthology.orchestra.run.smithi049.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.249401.log.gz 2024-01-31T12:17:33.453 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.308039.log.gz 2024-01-31T12:17:33.454 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.171812.log.gz 2024-01-31T12:17:33.454 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35618.log 2024-01-31T12:17:33.454 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.154468.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.185115.log.gz 2024-01-31T12:17:33.455 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.213246.log.gz 2024-01-31T12:17:33.456 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.465065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248929.log 2024-01-31T12:17:33.456 INFO:teuthology.orchestra.run.smithi049.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.204056.log.gz 2024-01-31T12:17:33.457 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 80.6% --verbose -- /var/log/ceph/ceph-client.admin.227444.log 2024-01-31T12:17:33.457 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.176966.log.gz 2024-01-31T12:17:33.458 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.179888.log.gz 2024-01-31T12:17:33.460 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35618.log: /var/log/ceph/ceph-client.admin.248929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96986.log 2024-01-31T12:17:33.461 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.251059.log.gz 2024-01-31T12:17:33.462 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.227444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382621.log 2024-01-31T12:17:33.464 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.96986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456245.log 2024-01-31T12:17:33.466 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.382621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316987.log 2024-01-31T12:17:33.468 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.456245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311766.log 2024-01-31T12:17:33.471 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34403.log 2024-01-31T12:17:33.473 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.316987.log: /var/log/ceph/ceph-client.admin.311766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102641.log 2024-01-31T12:17:33.475 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293748.log 2024-01-31T12:17:33.477 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.102641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31332.log 2024-01-31T12:17:33.479 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.293748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367110.log 2024-01-31T12:17:33.481 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.31332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237256.log 2024-01-31T12:17:33.483 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.367110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222124.log 2024-01-31T12:17:33.485 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.237256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174816.log 2024-01-31T12:17:33.488 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.222124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173965.log 2024-01-31T12:17:33.490 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.174816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359030.log 2024-01-31T12:17:33.492 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.173965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216910.log 2024-01-31T12:17:33.493 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463465.log 2024-01-31T12:17:33.493 INFO:teuthology.orchestra.run.smithi049.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.210613.log.gz 2024-01-31T12:17:33.493 INFO:teuthology.orchestra.run.smithi049.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.211045.log.gz 2024-01-31T12:17:33.496 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.359030.log: /var/log/ceph/ceph-client.admin.216910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187646.log 2024-01-31T12:17:33.496 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.289581.log.gz 2024-01-31T12:17:33.496 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.298681.log.gz 2024-01-31T12:17:33.497 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.463465.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.214053.log.gz 2024-01-31T12:17:33.497 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.293347.log.gz 2024-01-31T12:17:33.497 INFO:teuthology.orchestra.run.smithi049.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.98194.log.gz 2024-01-31T12:17:33.498 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181488.log 2024-01-31T12:17:33.499 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.187646.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.374057.log.gz 2024-01-31T12:17:33.500 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35329.log 2024-01-31T12:17:33.501 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.181488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443946.log 2024-01-31T12:17:33.503 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385216.log 2024-01-31T12:17:33.505 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.443946.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35618.log.gz 2024-01-31T12:17:33.506 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361229.log 2024-01-31T12:17:33.508 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.385216.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34273.log.gz 2024-01-31T12:17:33.508 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106474.log 2024-01-31T12:17:33.508 INFO:teuthology.orchestra.run.smithi049.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.34299.log.gz 2024-01-31T12:17:33.509 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33618.log.gz 2024-01-31T12:17:33.510 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35010.log.gz 2024-01-31T12:17:33.510 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35831.log 2024-01-31T12:17:33.510 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32050.log.gz 2024-01-31T12:17:33.511 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.361229.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.370825.log.gz 2024-01-31T12:17:33.512 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435137.log 2024-01-31T12:17:33.513 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.106474.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.81928.log.gz 2024-01-31T12:17:33.514 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198895.log 2024-01-31T12:17:33.516 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.435137.log: /var/log/ceph/ceph-client.admin.35831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312658.log 2024-01-31T12:17:33.516 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.227444.log.gz 2024-01-31T12:17:33.517 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291204.log 2024-01-31T12:17:33.518 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.198895.log: /var/log/ceph/ceph-client.admin.312658.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35696.log.gz 2024-01-31T12:17:33.519 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316572.log 2024-01-31T12:17:33.519 INFO:teuthology.orchestra.run.smithi049.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.130078.log.gz 2024-01-31T12:17:33.520 INFO:teuthology.orchestra.run.smithi049.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.283910.log.gz 2024-01-31T12:17:33.522 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.291204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35565.log 2024-01-31T12:17:33.523 INFO:teuthology.orchestra.run.smithi049.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.312191.log.gz 2024-01-31T12:17:33.524 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34169.log 2024-01-31T12:17:33.524 INFO:teuthology.orchestra.run.smithi049.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.312658.log.gz 2024-01-31T12:17:33.524 INFO:teuthology.orchestra.run.smithi049.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.406005.log.gz 2024-01-31T12:17:33.525 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.316572.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.92468.log.gz 2024-01-31T12:17:33.525 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37083.log.gz 2024-01-31T12:17:33.527 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372031.log 2024-01-31T12:17:33.527 INFO:teuthology.orchestra.run.smithi049.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.349064.log.gz 2024-01-31T12:17:33.529 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34169.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.463465.log.gz 2024-01-31T12:17:33.529 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408551.log 2024-01-31T12:17:33.529 INFO:teuthology.orchestra.run.smithi049.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.413556.log.gz 2024-01-31T12:17:33.530 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167544.log 2024-01-31T12:17:33.530 INFO:teuthology.orchestra.run.smithi049.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.465065.log.gz 2024-01-31T12:17:33.531 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.408551.log: /var/log/ceph/ceph-client.admin.372031.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.380171.log.gz 2024-01-31T12:17:33.533 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102650.log 2024-01-31T12:17:33.535 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.167544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219810.log 2024-01-31T12:17:33.535 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.319510.log.gz 2024-01-31T12:17:33.536 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442301.log 2024-01-31T12:17:33.537 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1%/var/log/ceph/ceph-client.admin.102650.log: -- replaced with /var/log/ceph/ceph-client.admin.385216.log.gz 2024-01-31T12:17:33.538 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.219810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299895.log 2024-01-31T12:17:33.540 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.442301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400888.log 2024-01-31T12:17:33.541 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.347833.log.gz 2024-01-31T12:17:33.541 INFO:teuthology.orchestra.run.smithi049.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.443946.log.gz 2024-01-31T12:17:33.543 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.299895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495997.log 2024-01-31T12:17:33.544 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.400888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401824.log 2024-01-31T12:17:33.546 INFO:teuthology.orchestra.run.smithi049.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.237256.log.gz 2024-01-31T12:17:33.546 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.495997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369185.log 2024-01-31T12:17:33.547 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.495997.log.gz 2024-01-31T12:17:33.548 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.401824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35779.log 2024-01-31T12:17:33.550 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.369185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414840.log 2024-01-31T12:17:33.551 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384413.log 2024-01-31T12:17:33.554 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35779.log: /var/log/ceph/ceph-client.admin.414840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33670.log 2024-01-31T12:17:33.567 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.384413.log: /var/log/ceph/ceph-client.admin.33670.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.459837.log.gz 2024-01-31T12:17:33.574 INFO:teuthology.orchestra.run.smithi049.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.435137.log.gz 2024-01-31T12:17:33.576 INFO:teuthology.orchestra.run.smithi049.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.449796.log.gz 2024-01-31T12:17:33.581 INFO:teuthology.orchestra.run.smithi049.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.209773.log.gz 2024-01-31T12:17:33.585 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.154468.log.gz 2024-01-31T12:17:33.588 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.174816.log.gz 2024-01-31T12:17:33.588 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.175676.log.gz 2024-01-31T12:17:33.588 INFO:teuthology.orchestra.run.smithi049.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.181488.log.gz 2024-01-31T12:17:33.608 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.186786.log.gz 2024-01-31T12:17:33.609 INFO:teuthology.orchestra.run.smithi049.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.187646.log.gz 2024-01-31T12:17:33.624 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34169.log.gz 2024-01-31T12:17:33.625 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34827.log.gz 2024-01-31T12:17:33.627 INFO:teuthology.orchestra.run.smithi049.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.361220.log.gz 2024-01-31T12:17:33.627 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.361229.log.gz 2024-01-31T12:17:33.627 INFO:teuthology.orchestra.run.smithi049.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.362874.log.gz 2024-01-31T12:17:33.628 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.285939.log.gz 2024-01-31T12:17:33.629 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.96185.log.gz 2024-01-31T12:17:33.629 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.301100.log.gz 2024-01-31T12:17:33.631 INFO:teuthology.orchestra.run.smithi049.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.372031.log.gz 2024-01-31T12:17:33.632 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.372442.log.gz 2024-01-31T12:17:33.633 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35565.log.gz 2024-01-31T12:17:33.634 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.372040.log.gz 2024-01-31T12:17:33.634 INFO:teuthology.orchestra.run.smithi049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33670.log.gz 2024-01-31T12:17:33.634 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.102650.log.gz 2024-01-31T12:17:33.635 INFO:teuthology.orchestra.run.smithi049.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.281077.log.gz 2024-01-31T12:17:33.648 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.369185.log.gz 2024-01-31T12:17:33.663 INFO:teuthology.orchestra.run.smithi049.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.348638.log.gz 2024-01-31T12:17:33.669 INFO:teuthology.orchestra.run.smithi049.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.401824.log.gz 2024-01-31T12:17:33.690 INFO:teuthology.orchestra.run.smithi049.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.423466.log.gz 2024-01-31T12:17:33.697 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.179075.log.gz 2024-01-31T12:17:33.697 INFO:teuthology.orchestra.run.smithi049.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.225002.log.gz 2024-01-31T12:17:33.699 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.234844.log.gz 2024-01-31T12:17:33.699 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.213658.log.gz 2024-01-31T12:17:33.700 INFO:teuthology.orchestra.run.smithi049.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.285121.log.gz 2024-01-31T12:17:33.717 INFO:teuthology.orchestra.run.smithi049.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.226621.log.gz 2024-01-31T12:17:33.721 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.408551.log.gz 2024-01-31T12:17:33.725 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.404798.log.gz 2024-01-31T12:17:33.726 INFO:teuthology.orchestra.run.smithi049.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.384001.log.gz 2024-01-31T12:17:33.737 INFO:teuthology.orchestra.run.smithi049.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.376932.log.gz 2024-01-31T12:17:33.740 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.299895.log.gz 2024-01-31T12:17:33.740 INFO:teuthology.orchestra.run.smithi049.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.316572.log.gz 2024-01-31T12:17:33.742 INFO:teuthology.orchestra.run.smithi049.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.442301.log.gz 2024-01-31T12:17:33.747 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.466678.log.gz 2024-01-31T12:17:33.752 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.98203.log.gz 2024-01-31T12:17:33.767 INFO:teuthology.orchestra.run.smithi049.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.138143.log.gz 2024-01-31T12:17:33.783 INFO:teuthology.orchestra.run.smithi049.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.128465.log.gz 2024-01-31T12:17:33.784 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34957.log.gz 2024-01-31T12:17:33.792 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32656.log.gz 2024-01-31T12:17:33.792 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37031.log.gz 2024-01-31T12:17:33.795 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36834.log.gz 2024-01-31T12:17:33.804 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.227847.log.gz 2024-01-31T12:17:33.806 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.228250.log.gz 2024-01-31T12:17:33.807 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.129680.log.gz 2024-01-31T12:17:33.810 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37057.log.gz 2024-01-31T12:17:33.814 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.131424.log.gz 2024-01-31T12:17:33.820 INFO:teuthology.orchestra.run.smithi049.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.360377.log.gz 2024-01-31T12:17:33.821 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.381016.log.gz 2024-01-31T12:17:33.822 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.381418.log.gz 2024-01-31T12:17:33.838 INFO:teuthology.orchestra.run.smithi049.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.443106.log.gz 2024-01-31T12:17:33.864 INFO:teuthology.orchestra.run.smithi049.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.152841.log.gz 2024-01-31T12:17:33.868 INFO:teuthology.orchestra.run.smithi049.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.163875.log.gz 2024-01-31T12:17:33.929 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.160414.log.gz 2024-01-31T12:17:33.931 INFO:teuthology.orchestra.run.smithi049.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.153248.log.gz 2024-01-31T12:17:33.939 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.205699.log.gz 2024-01-31T12:17:33.943 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.426765.log.gz 2024-01-31T12:17:33.957 INFO:teuthology.orchestra.run.smithi049.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.248466.log.gz 2024-01-31T12:17:33.970 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.353425.log.gz 2024-01-31T12:17:33.972 INFO:teuthology.orchestra.run.smithi049.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.315331.log.gz 2024-01-31T12:17:34.887 INFO:teuthology.orchestra.run.smithi195.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-01-31T12:17:35.038 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.159150.log.gz 2024-01-31T12:17:35.039 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.82777.log.gz 2024-01-31T12:17:35.039 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32368.log.gz 2024-01-31T12:17:35.040 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.298690.log.gz 2024-01-31T12:17:35.040 INFO:teuthology.orchestra.run.smithi049.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.237650.log.gz 2024-01-31T12:17:35.040 INFO:teuthology.orchestra.run.smithi049.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.303129.log.gz 2024-01-31T12:17:35.041 INFO:teuthology.orchestra.run.smithi049.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.176545.log.gz 2024-01-31T12:17:35.042 INFO:teuthology.orchestra.run.smithi049.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.437193.log.gz 2024-01-31T12:17:35.042 INFO:teuthology.orchestra.run.smithi049.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.169252.log.gz 2024-01-31T12:17:35.042 INFO:teuthology.orchestra.run.smithi049.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.328146.log.gz 2024-01-31T12:17:35.042 INFO:teuthology.orchestra.run.smithi049.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.353827.log.gz 2024-01-31T12:17:35.043 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.185934.log.gz 81.3% 2024-01-31T12:17:35.043 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.137483.log.gz 2024-01-31T12:17:35.043 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.307624.log.gz 2024-01-31T12:17:35.044 INFO:teuthology.orchestra.run.smithi049.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.210187.log.gz 2024-01-31T12:17:35.044 INFO:teuthology.orchestra.run.smithi049.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.402694.log.gz 2024-01-31T12:17:35.044 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.412679.log.gz 2024-01-31T12:17:35.045 INFO:teuthology.orchestra.run.smithi049.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.421089.log.gz 2024-01-31T12:17:35.045 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.404395.log.gz 2024-01-31T12:17:35.045 INFO:teuthology.orchestra.run.smithi049.stderr: 94.3% 81.1% -- replaced with /var/log/ceph/ceph-client.admin.462248.log.gz 2024-01-31T12:17:35.045 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.240108.log.gz 2024-01-31T12:17:35.046 INFO:teuthology.orchestra.run.smithi049.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.204065.log.gz 2024-01-31T12:17:35.046 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.378567.log.gz 2024-01-31T12:17:35.047 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.285532.log.gz 2024-01-31T12:17:35.047 INFO:teuthology.orchestra.run.smithi049.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.157809.log.gz 2024-01-31T12:17:35.075 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.398840.log.gz 2024-01-31T12:17:35.076 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.202847.log.gz 2024-01-31T12:17:35.076 INFO:teuthology.orchestra.run.smithi049.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.192152.log.gz 2024-01-31T12:17:35.076 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.208166.log.gz 2024-01-31T12:17:35.076 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.452445.log.gz 2024-01-31T12:17:35.076 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.406819.log.gz 2024-01-31T12:17:35.076 INFO:teuthology.orchestra.run.smithi049.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.410221.log.gz 2024-01-31T12:17:35.077 INFO:teuthology.orchestra.run.smithi049.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.380573.log.gz 2024-01-31T12:17:35.077 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.235246.log.gz 2024-01-31T12:17:35.077 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.423475.log.gz 2024-01-31T12:17:35.077 INFO:teuthology.orchestra.run.smithi049.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.93679.log.gz 2024-01-31T12:17:35.077 INFO:teuthology.orchestra.run.smithi049.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.198441.log.gz 2024-01-31T12:17:35.077 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.162101.log.gz 2024-01-31T12:17:35.077 INFO:teuthology.orchestra.run.smithi049.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.79163.log.gz 2024-01-31T12:17:35.078 INFO:teuthology.orchestra.run.smithi049.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.190119.log.gz 2024-01-31T12:17:35.078 INFO:teuthology.orchestra.run.smithi049.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.433118.log.gz 2024-01-31T12:17:35.078 INFO:teuthology.orchestra.run.smithi049.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.324999.log.gz 2024-01-31T12:17:35.078 INFO:teuthology.orchestra.run.smithi049.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.323726.log.gz 2024-01-31T12:17:35.078 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.314527.log.gz 2024-01-31T12:17:35.078 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33252.log.gz 2024-01-31T12:17:35.078 INFO:teuthology.orchestra.run.smithi049.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.206906.log.gz 2024-01-31T12:17:35.079 INFO:teuthology.orchestra.run.smithi049.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35779.log.gz 2024-01-31T12:17:35.079 INFO:teuthology.orchestra.run.smithi049.stderr: 81.7% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.240937.log.gz 2024-01-31T12:17:35.079 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.288366.log.gz 2024-01-31T12:17:35.079 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.91261.log.gz 2024-01-31T12:17:35.079 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34403.log.gz 2024-01-31T12:17:35.079 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.359030.log.gz 2024-01-31T12:17:35.079 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.324126.log.gz 2024-01-31T12:17:35.079 INFO:teuthology.orchestra.run.smithi049.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.293739.log.gz 2024-01-31T12:17:35.080 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.174386.log.gz 2024-01-31T12:17:35.080 INFO:teuthology.orchestra.run.smithi049.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.248457.log.gz 2024-01-31T12:17:35.080 INFO:teuthology.orchestra.run.smithi049.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.230267.log.gz 2024-01-31T12:17:35.080 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.102641.log.gz 2024-01-31T12:17:35.080 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.410230.log.gz 2024-01-31T12:17:35.080 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.209782.log.gz 2024-01-31T12:17:35.080 INFO:teuthology.orchestra.run.smithi049.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.156087.log.gz 2024-01-31T12:17:35.081 INFO:teuthology.orchestra.run.smithi049.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.198895.log.gz 2024-01-31T12:17:35.081 INFO:teuthology.orchestra.run.smithi049.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.400888.log.gz 2024-01-31T12:17:35.081 INFO:teuthology.orchestra.run.smithi049.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.463063.log.gz 2024-01-31T12:17:35.081 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.216910.log.gz 2024-01-31T12:17:35.081 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.109400.log.gz 2024-01-31T12:17:35.081 INFO:teuthology.orchestra.run.smithi049.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.222124.log.gz 2024-01-31T12:17:35.081 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33330.log.gz 2024-01-31T12:17:35.081 INFO:teuthology.orchestra.run.smithi049.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.106474.log.gz 2024-01-31T12:17:35.082 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32394.log.gz 2024-01-31T12:17:35.082 INFO:teuthology.orchestra.run.smithi049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33056.log.gz 2024-01-31T12:17:35.082 INFO:teuthology.orchestra.run.smithi049.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.382621.log.gz 2024-01-31T12:17:35.082 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.354659.log.gz 2024-01-31T12:17:35.082 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.98606.log.gz 2024-01-31T12:17:35.082 INFO:teuthology.orchestra.run.smithi049.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.432713.log.gz 2024-01-31T12:17:35.082 INFO:teuthology.orchestra.run.smithi049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35329.log.gz 2024-01-31T12:17:35.082 INFO:teuthology.orchestra.run.smithi049.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.300287.log.gz 2024-01-31T12:17:35.083 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.282297.log.gz 2024-01-31T12:17:35.083 INFO:teuthology.orchestra.run.smithi049.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34637.log.gz 2024-01-31T12:17:35.083 INFO:teuthology.orchestra.run.smithi049.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.300689.log.gz 2024-01-31T12:17:35.083 INFO:teuthology.orchestra.run.smithi049.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.368360.log.gz 2024-01-31T12:17:35.083 INFO:teuthology.orchestra.run.smithi049.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.414840.log.gz 2024-01-31T12:17:35.083 INFO:teuthology.orchestra.run.smithi049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32652.log.gz 2024-01-31T12:17:35.083 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.213649.log.gz 2024-01-31T12:17:35.083 INFO:teuthology.orchestra.run.smithi049.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.294227.log.gz 2024-01-31T12:17:35.083 INFO:teuthology.orchestra.run.smithi049.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32550.log.gz 2024-01-31T12:17:35.084 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.326701.log.gz 2024-01-31T12:17:35.084 INFO:teuthology.orchestra.run.smithi049.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32311.log.gz 2024-01-31T12:17:35.084 INFO:teuthology.orchestra.run.smithi049.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.426354.log.gz 2024-01-31T12:17:35.084 INFO:teuthology.orchestra.run.smithi049.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32342.log.gz 2024-01-31T12:17:35.084 INFO:teuthology.orchestra.run.smithi049.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.287549.log.gz 2024-01-31T12:17:35.084 INFO:teuthology.orchestra.run.smithi049.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.317390.log.gz 2024-01-31T12:17:35.084 INFO:teuthology.orchestra.run.smithi049.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.241340.log.gz 2024-01-31T12:17:35.085 INFO:teuthology.orchestra.run.smithi049.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.427158.log.gz 2024-01-31T12:17:35.085 INFO:teuthology.orchestra.run.smithi049.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.383349.log.gz 2024-01-31T12:17:35.085 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.384413.log.gz 2024-01-31T12:17:35.085 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31742.log.gz 2024-01-31T12:17:35.085 INFO:teuthology.orchestra.run.smithi049.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.403961.log.gz 2024-01-31T12:17:35.085 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.169675.log.gz 2024-01-31T12:17:35.085 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36299.log.gz 2024-01-31T12:17:35.085 INFO:teuthology.orchestra.run.smithi049.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.468723.log.gz 2024-01-31T12:17:35.086 INFO:teuthology.orchestra.run.smithi049.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.211054.log.gz 2024-01-31T12:17:35.086 INFO:teuthology.orchestra.run.smithi049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36273.log.gz 2024-01-31T12:17:35.086 INFO:teuthology.orchestra.run.smithi049.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.167544.log.gz 2024-01-31T12:17:35.087 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.193136.log.gz 2024-01-31T12:17:35.087 INFO:teuthology.orchestra.run.smithi049.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.327167.log.gz 2024-01-31T12:17:35.087 INFO:teuthology.orchestra.run.smithi049.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.294629.log.gz 2024-01-31T12:17:35.095 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.300296.log.gz 2024-01-31T12:17:35.102 INFO:teuthology.orchestra.run.smithi049.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.464260.log.gz 2024-01-31T12:17:35.105 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27210.log.gz 2024-01-31T12:17:35.107 INFO:teuthology.orchestra.run.smithi049.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.199345.log.gz 2024-01-31T12:17:35.111 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.292945.log.gz 2024-01-31T12:17:35.118 INFO:teuthology.orchestra.run.smithi049.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.163014.log.gz 2024-01-31T12:17:35.127 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.208157.log.gz 2024-01-31T12:17:35.136 INFO:teuthology.orchestra.run.smithi049.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.171372.log.gz 2024-01-31T12:17:35.194 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.293748.log.gz 2024-01-31T12:17:35.239 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.290797.log.gz 2024-01-31T12:17:35.239 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.298289.log.gz 2024-01-31T12:17:35.244 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.101835.log.gz 2024-01-31T12:17:35.446 INFO:teuthology.orchestra.run.smithi049.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.161676.log.gz 2024-01-31T12:17:40.314 INFO:teuthology.orchestra.run.smithi049.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.363679.log.gz 2024-01-31T12:17:40.314 INFO:teuthology.orchestra.run.smithi049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31332.log.gz 2024-01-31T12:17:40.314 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.128875.log.gz 2024-01-31T12:17:40.314 INFO:teuthology.orchestra.run.smithi049.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.221297.log.gz 2024-01-31T12:17:40.315 INFO:teuthology.orchestra.run.smithi049.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.442705.log.gz 90.1% 2024-01-31T12:17:40.315 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.233638.log.gz 2024-01-31T12:17:40.315 INFO:teuthology.orchestra.run.smithi049.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.349487.log.gz 2024-01-31T12:17:40.316 INFO:teuthology.orchestra.run.smithi049.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.435545.log.gz 2024-01-31T12:17:40.316 INFO:teuthology.orchestra.run.smithi049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31664.log.gz 2024-01-31T12:17:40.316 INFO:teuthology.orchestra.run.smithi049.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.99000.log.gz 2024-01-31T12:17:40.316 INFO:teuthology.orchestra.run.smithi049.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35831.log.gz 2024-01-31T12:17:40.316 INFO:teuthology.orchestra.run.smithi049.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.412277.log.gz 2024-01-31T12:17:40.317 INFO:teuthology.orchestra.run.smithi049.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.384805.log.gz 2024-01-31T12:17:40.317 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.173965.log.gz 2024-01-31T12:17:40.317 INFO:teuthology.orchestra.run.smithi049.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.316987.log.gz 2024-01-31T12:17:40.317 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% 93.9% -- replaced with /var/log/ceph/ceph-client.admin.328640.log.gz -- replaced with /var/log/ceph/ceph-client.admin.323260.log.gz 2024-01-31T12:17:40.317 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-31T12:17:40.318 INFO:teuthology.orchestra.run.smithi049.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.413145.log.gz 2024-01-31T12:17:40.318 INFO:teuthology.orchestra.run.smithi049.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.350731.log.gz 2024-01-31T12:17:40.318 INFO:teuthology.orchestra.run.smithi049.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.163422.log.gz 2024-01-31T12:17:40.319 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% 81.9% -- replaced with /var/log/ceph/ceph-client.admin.352613.log.gz 2024-01-31T12:17:40.319 INFO:teuthology.orchestra.run.smithi049.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.384404.log.gz 2024-01-31T12:17:40.319 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.156488.log.gz 2024-01-31T12:17:40.319 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.93272.log.gz 2024-01-31T12:17:40.319 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.174825.log.gz 2024-01-31T12:17:40.319 INFO:teuthology.orchestra.run.smithi049.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.104816.log.gz 2024-01-31T12:17:40.319 INFO:teuthology.orchestra.run.smithi049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34741.log.gz 2024-01-31T12:17:40.320 INFO:teuthology.orchestra.run.smithi049.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.301904.log.gz 2024-01-31T12:17:40.322 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.302726.log.gz 2024-01-31T12:17:40.322 INFO:teuthology.orchestra.run.smithi049.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.326692.log.gz 87.6% 2024-01-31T12:17:40.322 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32638.log.gz 2024-01-31T12:17:40.322 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.411070.log.gz 2024-01-31T12:17:40.322 INFO:teuthology.orchestra.run.smithi049.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.105663.log.gz 2024-01-31T12:17:40.322 INFO:teuthology.orchestra.run.smithi049.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.399644.log.gz 2024-01-31T12:17:40.323 INFO:teuthology.orchestra.run.smithi049.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.403110.log.gz 2024-01-31T12:17:40.323 INFO:teuthology.orchestra.run.smithi049.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.93670.log.gz 2024-01-31T12:17:40.323 INFO:teuthology.orchestra.run.smithi049.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.368369.log.gz 2024-01-31T12:17:40.323 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.219407.log.gz 2024-01-31T12:17:40.323 INFO:teuthology.orchestra.run.smithi049.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.163005.log.gz 81.9% 2024-01-31T12:17:40.323 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.218995.log.gz 2024-01-31T12:17:40.323 INFO:teuthology.orchestra.run.smithi049.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.380582.log.gz 2024-01-31T12:17:40.323 INFO:teuthology.orchestra.run.smithi049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34195.log.gz 2024-01-31T12:17:40.324 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34351.log.gz 2024-01-31T12:17:40.324 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.170114.log.gz 2024-01-31T12:17:40.324 INFO:teuthology.orchestra.run.smithi049.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.410624.log.gz 2024-01-31T12:17:40.325 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.299494.log.gz 2024-01-31T12:17:40.325 INFO:teuthology.orchestra.run.smithi049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32844.log.gz 2024-01-31T12:17:40.325 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.156918.log.gz 2024-01-31T12:17:40.325 INFO:teuthology.orchestra.run.smithi049.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.311766.log.gz 2024-01-31T12:17:40.325 INFO:teuthology.orchestra.run.smithi049.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.235237.log.gz 2024-01-31T12:17:40.325 INFO:teuthology.orchestra.run.smithi049.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.375695.log.gz 2024-01-31T12:17:40.325 INFO:teuthology.orchestra.run.smithi049.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.369995.log.gz 2024-01-31T12:17:40.326 INFO:teuthology.orchestra.run.smithi049.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.161667.log.gz 2024-01-31T12:17:40.326 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% 95.0% -- replaced with /var/log/ceph/ceph-client.admin.352049.log.gz 2024-01-31T12:17:40.326 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.155277.log.gz 2024-01-31T12:17:40.326 INFO:teuthology.orchestra.run.smithi049.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.363894.log.gz 2024-01-31T12:17:40.326 INFO:teuthology.orchestra.run.smithi049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35145.log.gz 2024-01-31T12:17:40.327 INFO:teuthology.orchestra.run.smithi049.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.214062.log.gz 2024-01-31T12:17:40.327 INFO:teuthology.orchestra.run.smithi049.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.127215.log.gz 2024-01-31T12:17:40.327 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.285130.log.gz 2024-01-31T12:17:40.327 INFO:teuthology.orchestra.run.smithi049.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.194342.log.gz 2024-01-31T12:17:40.327 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.443955.log.gz 2024-01-31T12:17:40.327 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.174395.log.gz 2024-01-31T12:17:40.328 INFO:teuthology.orchestra.run.smithi049.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.230683.log.gz 2024-01-31T12:17:40.328 INFO:teuthology.orchestra.run.smithi049.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.430124.log.gz 2024-01-31T12:17:40.328 INFO:teuthology.orchestra.run.smithi049.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.95372.log.gz 2024-01-31T12:17:40.328 INFO:teuthology.orchestra.run.smithi049.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.154861.log.gz 2024-01-31T12:17:40.328 INFO:teuthology.orchestra.run.smithi049.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.97388.log.gz 2024-01-31T12:17:40.329 INFO:teuthology.orchestra.run.smithi049.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.109391.log.gz 2024-01-31T12:17:40.329 INFO:teuthology.orchestra.run.smithi049.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.96986.log.gz 2024-01-31T12:17:40.329 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.418105.log.gz 2024-01-31T12:17:40.331 INFO:teuthology.orchestra.run.smithi049.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.367110.log.gz 2024-01-31T12:17:40.331 INFO:teuthology.orchestra.run.smithi049.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.163884.log.gz 2024-01-31T12:17:40.331 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% 77.6% -- replaced with /var/log/ceph/ceph-client.admin.408560.log.gz -- replaced with /var/log/ceph/ceph-client.admin.305199.log.gz 2024-01-31T12:17:40.332 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-31T12:17:40.332 INFO:teuthology.orchestra.run.smithi049.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.320314.log.gz 2024-01-31T12:17:40.332 INFO:teuthology.orchestra.run.smithi049.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.103499.log.gz 2024-01-31T12:17:40.333 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.195999.log.gz 2024-01-31T12:17:40.333 INFO:teuthology.orchestra.run.smithi049.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.319501.log.gz 2024-01-31T12:17:40.333 INFO:teuthology.orchestra.run.smithi049.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.327660.log.gz 2024-01-31T12:17:40.334 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.422496.log.gz 2024-01-31T12:17:40.334 INFO:teuthology.orchestra.run.smithi049.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.363903.log.gz 2024-01-31T12:17:40.360 INFO:teuthology.orchestra.run.smithi049.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.388394.log.gz 2024-01-31T12:17:40.784 INFO:teuthology.orchestra.run.smithi049.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.477321.log.gz 2024-01-31T12:17:40.813 INFO:teuthology.orchestra.run.smithi049.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.330056.log.gz 2024-01-31T12:17:40.844 INFO:teuthology.orchestra.run.smithi049.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.74694.log.gz 2024-01-31T12:17:40.878 INFO:teuthology.orchestra.run.smithi049.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.363285.log.gz 2024-01-31T12:17:40.878 INFO:teuthology.orchestra.run.smithi049.stderr: 93.2% 93.7% -- replaced with /var/log/ceph/ceph-client.admin.130537.log.gz -- replaced with /var/log/ceph/ceph-client.admin.363639.log.gz 2024-01-31T12:17:40.878 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-31T12:17:40.878 INFO:teuthology.orchestra.run.smithi049.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.363543.log.gz 2024-01-31T12:17:41.119 INFO:teuthology.orchestra.run.smithi049.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.248929.log.gz 2024-01-31T12:17:41.354 INFO:teuthology.orchestra.run.smithi195.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-01-31T12:17:41.611 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.159581.log.gz 2024-01-31T12:17:41.613 INFO:teuthology.orchestra.run.smithi049.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.88438.log.gz 2024-01-31T12:17:41.613 INFO:teuthology.orchestra.run.smithi049.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.350740.log.gz 2024-01-31T12:17:42.738 INFO:teuthology.orchestra.run.smithi049.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.166222.log.gz 2024-01-31T12:17:42.777 INFO:teuthology.orchestra.run.smithi049.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.76100.log.gz 2024-01-31T12:17:49.546 INFO:teuthology.orchestra.run.smithi049.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.90832.log.gz 2024-01-31T12:17:53.142 INFO:teuthology.orchestra.run.smithi049.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-01-31T12:17:54.042 INFO:teuthology.orchestra.run.smithi049.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.232306.log.gz 2024-01-31T12:17:55.093 INFO:teuthology.orchestra.run.smithi049.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.201607.log.gz 2024-01-31T12:17:56.252 INFO:teuthology.orchestra.run.smithi195.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-01-31T12:17:56.768 INFO:teuthology.orchestra.run.smithi049.stderr: 97.4% -- replaced with /var/log/ceph/ceph-client.admin.351575.log.gz 2024-01-31T12:17:59.492 INFO:teuthology.orchestra.run.smithi195.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-01-31T12:18:03.401 INFO:teuthology.orchestra.run.smithi049.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.198904.log.gz 2024-01-31T12:18:06.479 INFO:teuthology.orchestra.run.smithi049.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.359039.log.gz 2024-01-31T12:18:09.193 INFO:teuthology.orchestra.run.smithi049.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.104367.log.gz 2024-01-31T12:18:10.525 INFO:teuthology.orchestra.run.smithi049.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.220700.log.gz 2024-01-31T12:18:11.755 INFO:teuthology.orchestra.run.smithi049.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.220273.log.gz 2024-01-31T12:18:12.350 INFO:teuthology.orchestra.run.smithi049.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.105221.log.gz 2024-01-31T12:18:13.285 INFO:teuthology.orchestra.run.smithi049.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.103058.log.gz 2024-01-31T12:18:13.953 INFO:teuthology.orchestra.run.smithi049.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.82331.log.gz 2024-01-31T12:18:16.184 INFO:teuthology.orchestra.run.smithi049.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.291621.log.gz 2024-01-31T12:18:16.749 INFO:teuthology.orchestra.run.smithi049.stderr: 97.7% -- replaced with /var/log/ceph/ceph-client.admin.249410.log.gz 2024-01-31T12:18:18.633 INFO:teuthology.orchestra.run.smithi049.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.219810.log.gz 2024-01-31T12:18:18.643 INFO:teuthology.orchestra.run.smithi049.stderr: 97.5% -- replaced with /var/log/ceph/ceph-client.admin.291204.log.gz 2024-01-31T12:18:19.088 INFO:teuthology.orchestra.run.smithi049.stderr: 97.7% -- replaced with /var/log/ceph/ceph-client.admin.79172.log.gz 2024-01-31T12:18:19.110 INFO:teuthology.orchestra.run.smithi049.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.103916.log.gz 2024-01-31T12:18:19.116 INFO:teuthology.orchestra.run.smithi049.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.87979.log.gz 2024-01-31T12:18:19.452 INFO:teuthology.orchestra.run.smithi049.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.322808.log.gz 2024-01-31T12:18:19.473 INFO:teuthology.orchestra.run.smithi049.stderr: 95.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-01-31T12:18:20.054 INFO:teuthology.orchestra.run.smithi049.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.357949.log.gz 2024-01-31T12:18:20.072 INFO:teuthology.orchestra.run.smithi049.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.316145.log.gz 2024-01-31T12:18:20.569 INFO:teuthology.orchestra.run.smithi049.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.77897.log.gz 2024-01-31T12:18:21.616 INFO:teuthology.orchestra.run.smithi049.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.292110.log.gz 2024-01-31T12:18:21.940 INFO:teuthology.orchestra.run.smithi049.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.108978.log.gz 2024-01-31T12:18:23.269 INFO:teuthology.orchestra.run.smithi195.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-01-31T12:18:25.161 INFO:teuthology.orchestra.run.smithi049.stderr: 97.3% -- replaced with /var/log/ceph/ceph-client.admin.77480.log.gz 2024-01-31T12:18:25.165 INFO:teuthology.orchestra.run.smithi049.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.417133.log.gz 2024-01-31T12:18:26.079 INFO:teuthology.orchestra.run.smithi049.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.87517.log.gz 2024-01-31T12:18:26.759 INFO:teuthology.orchestra.run.smithi049.stderr: 97.7% -- replaced with /var/log/ceph/ceph-client.admin.367933.log.gz 2024-01-31T12:18:27.683 INFO:teuthology.orchestra.run.smithi195.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-01-31T12:18:29.949 INFO:teuthology.orchestra.run.smithi049.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.198013.log.gz 2024-01-31T12:18:33.668 INFO:teuthology.orchestra.run.smithi049.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.397182.log.gz 2024-01-31T12:18:43.219 INFO:teuthology.orchestra.run.smithi049.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.83992.log.gz 2024-01-31T12:18:49.098 INFO:teuthology.orchestra.run.smithi049.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.217346.log.gz 2024-01-31T12:18:54.506 INFO:teuthology.orchestra.run.smithi049.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.359931.log.gz 2024-01-31T12:18:58.930 INFO:teuthology.orchestra.run.smithi049.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.438851.log.gz 2024-01-31T12:19:03.066 INFO:teuthology.orchestra.run.smithi049.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.214929.log.gz 2024-01-31T12:19:21.262 INFO:teuthology.orchestra.run.smithi049.stderr: 97.6% -- replaced with /var/log/ceph/ceph-client.admin.436766.log.gz 2024-01-31T12:19:23.429 INFO:teuthology.orchestra.run.smithi195.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-01-31T12:19:23.431 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-01-31T12:19:23.432 INFO:teuthology.orchestra.run.smithi195.stderr:real 1m54.127s 2024-01-31T12:19:23.432 INFO:teuthology.orchestra.run.smithi195.stderr:user 1m49.079s 2024-01-31T12:19:23.432 INFO:teuthology.orchestra.run.smithi195.stderr:sys 0m11.196s 2024-01-31T12:19:26.842 INFO:teuthology.orchestra.run.smithi049.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.94121.log.gz 2024-01-31T12:20:09.417 INFO:teuthology.orchestra.run.smithi049.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.223341.log.gz 2024-01-31T12:20:20.621 INFO:teuthology.orchestra.run.smithi049.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.81292.log.gz 2024-01-31T12:20:34.527 INFO:teuthology.orchestra.run.smithi049.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.430595.log.gz 2024-01-31T12:20:46.470 INFO:teuthology.orchestra.run.smithi049.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.125528.log.gz 2024-01-31T12:20:49.400 INFO:teuthology.orchestra.run.smithi049.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.157357.log.gz 2024-01-31T12:21:06.540 INFO:teuthology.orchestra.run.smithi049.stderr: 96.3% -- replaced with /var/log/ceph/ceph-client.admin.308454.log.gz 2024-01-31T12:22:17.318 INFO:teuthology.orchestra.run.smithi049.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.157818.log.gz 2024-01-31T12:22:48.515 INFO:teuthology.orchestra.run.smithi049.stderr: 96.3% -- replaced with /var/log/ceph/ceph-client.admin.198450.log.gz 2024-01-31T12:23:07.153 INFO:teuthology.orchestra.run.smithi049.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.134568.log.gz 2024-01-31T12:23:43.964 INFO:teuthology.orchestra.run.smithi049.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.325411.log.gz 2024-01-31T12:24:15.465 INFO:teuthology.orchestra.run.smithi049.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.108117.log.gz 2024-01-31T12:25:10.073 INFO:teuthology.orchestra.run.smithi049.stderr: 96.3% -- replaced with /var/log/ceph/ceph-client.admin.167066.log.gz 2024-01-31T12:26:34.197 INFO:teuthology.orchestra.run.smithi049.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.138573.log.gz 2024-01-31T12:26:35.241 INFO:teuthology.orchestra.run.smithi049.stderr: 95.4% -- replaced with /var/log/ceph/ceph-client.admin.76589.log.gz 2024-01-31T12:29:04.685 INFO:teuthology.orchestra.run.smithi049.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.360792.log.gz 2024-01-31T12:29:26.580 INFO:teuthology.orchestra.run.smithi049.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.78712.log.gz 2024-01-31T12:29:40.321 INFO:teuthology.orchestra.run.smithi049.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.430133.log.gz 2024-01-31T12:32:11.389 INFO:teuthology.orchestra.run.smithi049.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.458787.log.gz 2024-01-31T12:34:17.059 INFO:teuthology.orchestra.run.smithi049.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.232739.log.gz 2024-01-31T12:34:56.739 INFO:teuthology.orchestra.run.smithi049.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.212287.log.gz 2024-01-31T12:35:11.352 INFO:teuthology.orchestra.run.smithi049.stderr: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.331931.log.gz 2024-01-31T12:36:05.615 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-01-31T12:36:11.286 INFO:teuthology.orchestra.run.smithi049.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.79624.log.gz 2024-01-31T12:36:55.578 INFO:teuthology.orchestra.run.smithi049.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.77038.log.gz 2024-01-31T12:42:00.996 INFO:teuthology.orchestra.run.smithi049.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.451108.log.gz 2024-01-31T12:42:07.112 INFO:teuthology.orchestra.run.smithi049.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.447294.log.gz 2024-01-31T12:42:33.870 INFO:teuthology.orchestra.run.smithi049.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.452455.log.gz 2024-01-31T12:42:45.512 INFO:teuthology.orchestra.run.smithi049.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.456245.log.gz 2024-01-31T12:43:13.544 INFO:teuthology.orchestra.run.smithi049.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.454934.log.gz 2024-01-31T12:43:21.264 INFO:teuthology.orchestra.run.smithi049.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.448553.log.gz 2024-01-31T12:43:36.695 INFO:teuthology.orchestra.run.smithi049.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.453701.log.gz 2024-01-31T12:43:57.314 INFO:teuthology.orchestra.run.smithi049.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.457566.log.gz 2024-01-31T12:44:11.023 INFO:teuthology.orchestra.run.smithi049.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.252274.log.gz 2024-01-31T12:45:02.723 INFO:teuthology.orchestra.run.smithi049.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.449805.log.gz 2024-01-31T12:45:11.770 INFO:teuthology.orchestra.run.smithi049.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.444387.log.gz 2024-01-31T12:49:45.276 INFO:teuthology.orchestra.run.smithi049.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.164409.log.gz 2024-01-31T12:53:14.420 INFO:teuthology.orchestra.run.smithi049.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.390352.log.gz 2024-01-31T12:58:48.991 INFO:teuthology.orchestra.run.smithi049.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-01-31T13:04:56.098 INFO:teuthology.orchestra.run.smithi049.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-01-31T13:05:18.147 INFO:teuthology.orchestra.run.smithi049.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.383358.log.gz 2024-01-31T13:06:00.060 INFO:teuthology.orchestra.run.smithi049.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.382630.log.gz 2024-01-31T13:08:14.103 INFO:teuthology.orchestra.run.smithi049.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.242621.log.gz 2024-01-31T13:12:53.212 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.131433.log.gz 2024-01-31T13:15:51.709 INFO:teuthology.orchestra.run.smithi049.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-01-31T13:16:13.506 INFO:teuthology.orchestra.run.smithi049.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-01-31T13:27:57.501 INFO:teuthology.orchestra.run.smithi049.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.109807.log.gz 2024-01-31T13:49:54.704 INFO:teuthology.orchestra.run.smithi049.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.469154.log.gz 2024-01-31T13:49:54.707 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-01-31T13:49:54.708 INFO:teuthology.orchestra.run.smithi049.stderr:real 92m25.415s 2024-01-31T13:49:54.708 INFO:teuthology.orchestra.run.smithi049.stderr:user 60m49.319s 2024-01-31T13:49:54.708 INFO:teuthology.orchestra.run.smithi049.stderr:sys 8m59.899s 2024-01-31T13:49:54.710 INFO:tasks.ceph:Archiving logs... 2024-01-31T13:49:54.711 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539483/remote/smithi049/log 2024-01-31T13:49:54.712 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-31T14:01:19.835 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539483/remote/smithi195/log 2024-01-31T14:01:19.878 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-31T14:07:18.063 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-31T14:07:18.073 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-31T14:07:18.073 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-31T14:07:18.080 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-31T14:07:18.252 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-31T14:07:18.261 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-31T14:07:18.261 DEBUG:teuthology.orchestra.run.smithi049:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-31T14:07:18.267 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-31T14:07:18.348 INFO:teuthology.orchestra.run.smithi195.stdout: remote refid st t when poll reach delay offset jitter 2024-01-31T14:07:18.349 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================== 2024-01-31T14:07:18.349 INFO:teuthology.orchestra.run.smithi195.stdout:*hv01.front.sepi 44.4.53.2 2 u 444 1024 377 0.154 -7.333 3.031 2024-01-31T14:07:18.349 INFO:teuthology.orchestra.run.smithi195.stdout:+hv02.front.sepi 63.231.80.2 3 u 623 1024 377 0.159 -5.330 3.887 2024-01-31T14:07:18.349 INFO:teuthology.orchestra.run.smithi195.stdout:+hv03.front.sepi 74.6.168.72 3 u 505 1024 377 0.141 -4.461 3.387 2024-01-31T14:07:18.349 INFO:teuthology.orchestra.run.smithi195.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-01-31T14:07:18.396 INFO:teuthology.orchestra.run.smithi049.stdout: remote refid st t when poll reach delay offset jitter 2024-01-31T14:07:18.396 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================== 2024-01-31T14:07:18.397 INFO:teuthology.orchestra.run.smithi049.stdout:*hv01.front.sepi 44.4.53.2 2 u 462 1024 377 0.173 -2.393 0.591 2024-01-31T14:07:18.397 INFO:teuthology.orchestra.run.smithi049.stdout:+hv02.front.sepi 63.231.80.2 3 u 359 1024 377 0.157 -0.437 1.433 2024-01-31T14:07:18.397 INFO:teuthology.orchestra.run.smithi049.stdout:+hv03.front.sepi 74.6.168.72 3 u 862 1024 377 0.172 +0.607 0.849 2024-01-31T14:07:18.397 INFO:teuthology.orchestra.run.smithi049.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-01-31T14:07:18.399 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-31T14:07:18.409 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-31T14:07:18.409 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-31T14:07:18.423 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-31T14:07:18.431 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-31T14:07:18.464 INFO:teuthology.task.internal:Duration was 33270.589272 seconds 2024-01-31T14:07:18.465 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-31T14:07:18.474 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-31T14:07:18.474 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-31T14:07:18.480 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-31T14:07:18.915 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-31T14:07:18.916 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi049.front.sepia.ceph.com 2024-01-31T14:07:18.916 DEBUG:teuthology.orchestra.run.smithi049:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-31T14:07:18.995 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2024-01-31T14:07:18.996 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-31T14:07:19.017 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-31T14:07:19.017 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-31T14:07:19.023 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-31T14:07:19.251 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-31T14:07:19.252 DEBUG:teuthology.orchestra.run.smithi049:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-31T14:07:19.256 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-31T14:07:20.040 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-31T14:07:20.050 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-31T14:07:20.050 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-31T14:07:20.140 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-31T14:07:20.202 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-31T14:07:20.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-31T14:07:20.218 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-31T14:07:20.272 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2024-01-31T14:07:20.308 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = core 2024-01-31T14:07:20.386 DEBUG:teuthology.orchestra.run.smithi049:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-31T14:07:20.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T14:07:20.405 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-31T14:07:20.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T14:07:20.413 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-31T14:07:20.423 INFO:teuthology.task.internal:Transferring archived files... 2024-01-31T14:07:20.424 DEBUG:teuthology.misc:Transferring archived files from smithi049:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539483/remote/smithi049 2024-01-31T14:07:20.425 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-31T14:07:20.518 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539483/remote/smithi195 2024-01-31T14:07:20.518 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-31T14:07:20.549 INFO:teuthology.task.internal:Removing archive directory... 2024-01-31T14:07:20.549 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-31T14:07:20.565 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-31T14:07:20.599 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-31T14:07:20.610 INFO:teuthology.task.internal:Not uploading archives. 2024-01-31T14:07:20.611 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-31T14:07:20.633 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-31T14:07:20.633 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-31T14:07:20.639 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-31T14:07:20.651 INFO:teuthology.orchestra.run.smithi195.stdout: 658077 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 31 14:07 /home/ubuntu/cephtest 2024-01-31T14:07:20.653 INFO:teuthology.orchestra.run.smithi049.stdout: 658074 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 31 14:07 /home/ubuntu/cephtest 2024-01-31T14:07:20.659 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-31T14:07:20.669 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-31T14:07:20.768 INFO:teuthology.nuke:Checking targets against current locks 2024-01-31T14:07:20.797 DEBUG:teuthology.nuke:shortname: smithi049 2024-01-31T14:07:20.797 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-31T14:07:20.821 DEBUG:teuthology.nuke:shortname: smithi195 2024-01-31T14:07:20.821 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-31T14:07:20.825 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539483', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-31 04:40:04.463942', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPFxmT4wC/zThucb9khkDkUHR3lKlMB/awM8/KXblCtL1201ldkv8uxM3iAzdMJb468Vp9CPethCr0crd0/SJPw='} 2024-01-31T14:07:20.846 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539483', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-31 04:40:04.462540', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEupds0LOIiCuVGxS99rzAnFhSRtCQ38YtaVzvSc9IwsznDlXx+gUEfrFIkgXUYMscxQ8OtkQpuwPo7TKEtACqw='} 2024-01-31T14:07:20.879 INFO:teuthology.orchestra.console.smithi049:Power off 2024-01-31T14:07:20.880 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-31T14:07:20.907 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2024-01-31T14:07:20.908 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T14:07:20.925 INFO:teuthology.orchestra.console.smithi195:Power off 2024-01-31T14:07:20.925 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-31T14:07:20.939 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-01-31T14:07:20.954 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2024-01-31T14:07:20.954 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T14:07:20.977 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-01-31T14:07:24.940 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T14:07:24.979 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T14:07:25.053 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-01-31T14:07:25.090 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-01-31T14:07:29.056 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T14:07:29.091 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T14:07:29.167 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-01-31T14:07:29.201 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-01-31T14:07:29.268 INFO:teuthology.orchestra.console.smithi049:Power off completed 2024-01-31T14:07:29.302 INFO:teuthology.orchestra.console.smithi195:Power off completed 2024-01-31T14:07:29.407 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} duration: 33270.589272260666 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default mon.a-kernel-sha1: cd42140e628558a450ba1d39a9d0835a2fa62cda mon.b-kernel-sha1: cd42140e628558a450ba1d39a9d0835a2fa62cda owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=21bd76ff615d44acb861ec82052920ba status: fail success: false 2024-01-31T14:07:29.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T14:07:29.508 INFO:teuthology.run:FAIL